# Infrastructure

- [The modern data centre](/infrastructure/the-modern-data-centre.md)
- [Enhancing Data Centre Efficiency: Strategies to Improve PUE](/infrastructure/the-modern-data-centre/enhancing-data-centre-efficiency-strategies-to-improve-pue.md)
- [TCO of NVIDIA GPUs and falling barriers to entry](/infrastructure/the-modern-data-centre/tco-of-nvidia-gpus-and-falling-barriers-to-entry.md)
- [Maximising GPU Utilisation with Kubernetes and NVIDIA GPU Operator](/infrastructure/the-modern-data-centre/maximising-gpu-utilisation-with-kubernetes-and-nvidia-gpu-operator.md)
- [Data Centres](/infrastructure/the-modern-data-centre/data-centres.md)
- [Liquid Cooling](/infrastructure/the-modern-data-centre/liquid-cooling.md)
- [Servers and Chips](/infrastructure/servers-and-chips.md)
- [The NVIDIA H100 GPU](/infrastructure/servers-and-chips/the-nvidia-h100-gpu.md)
- [NVIDIA H100 NVL](/infrastructure/servers-and-chips/nvidia-h100-nvl.md): For large language model inference workloads
- [Lambda Hyperplane 8-H100](/infrastructure/servers-and-chips/lambda-hyperplane-8-h100.md)
- [NVIDIA DGX Servers](/infrastructure/servers-and-chips/nvidia-dgx-servers.md)
- [NVIDIA DGX-2](/infrastructure/servers-and-chips/nvidia-dgx-2.md)
- [NVIDIA DGX H-100 System](/infrastructure/servers-and-chips/nvidia-dgx-h-100-system.md): An absolute beast
- [NVLink Switch](/infrastructure/servers-and-chips/nvlink-switch.md): Rapid Communication between GPUs
- [Tensor Cores](/infrastructure/servers-and-chips/tensor-cores.md)
- [NVIDIA Grace Hopper Superchip](/infrastructure/servers-and-chips/nvidia-grace-hopper-superchip.md)
- [NVIDIA Grace CPU Superchip](/infrastructure/servers-and-chips/nvidia-grace-cpu-superchip.md)
- [NVIDIA GB200 NVL72](/infrastructure/servers-and-chips/nvidia-gb200-nvl72.md)
- [Hopper versus Blackwell](/infrastructure/servers-and-chips/hopper-versus-blackwell.md): A comparison between the two latest GPU servers
- [HGX: High-Performance GPU Platforms](/infrastructure/servers-and-chips/hgx-high-performance-gpu-platforms.md)
- [ARM Chips](/infrastructure/servers-and-chips/arm-chips.md)
- [ARM versus x86](/infrastructure/servers-and-chips/arm-versus-x86.md)
- [RISC versus CISC](/infrastructure/servers-and-chips/risc-versus-cisc.md)
- [Introduction to RISC-V](/infrastructure/servers-and-chips/introduction-to-risc-v.md)
- [Networking and Connectivity](/infrastructure/networking-and-connectivity.md)
- [Infiniband versus Ethernet](/infrastructure/networking-and-connectivity/infiniband-versus-ethernet.md): Networking Technologies
- [NVIDIA Quantum InfiniBand](/infrastructure/networking-and-connectivity/nvidia-quantum-infiniband.md): Networking Solution
- [PCIe (Peripheral Component Interconnect Express)](/infrastructure/networking-and-connectivity/pcie-peripheral-component-interconnect-express.md)
- [NVIDIA ConnectX InfiniBand adapters](/infrastructure/networking-and-connectivity/nvidia-connectx-infiniband-adapters.md)
- [NVMe (Non-Volatile Memory Express)](/infrastructure/networking-and-connectivity/nvme-non-volatile-memory-express.md)
- [NVMe over Fabrics (NVMe-oF)](/infrastructure/networking-and-connectivity/nvme-over-fabrics-nvme-of.md): A protocol that enables high-performance, low-latency access to shared storage resources over various network fabrics
- [NVIDIA Spectrum-X](/infrastructure/networking-and-connectivity/nvidia-spectrum-x.md)
- [NVIDIA GPUDirect](/infrastructure/networking-and-connectivity/nvidia-gpudirect.md)
- [Evaluating Modern GPU Interconnect](/infrastructure/networking-and-connectivity/evaluating-modern-gpu-interconnect.md): Ang Li et al
- [Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)](/infrastructure/networking-and-connectivity/scalable-hierarchical-aggregation-and-reduction-protocol-sharp.md)
- [Next-generation networking in AI environments](/infrastructure/networking-and-connectivity/next-generation-networking-in-ai-environments.md)
- [NVIDIA Collective Communications Library (NCCL)](/infrastructure/networking-and-connectivity/nvidia-collective-communications-library-nccl.md)
- [Data and Memory](/infrastructure/data-and-memory.md)
- [NVIDIA BlueField Data Processing Units (DPUs)](/infrastructure/data-and-memory/nvidia-bluefield-data-processing-units-dpus.md)
- [Remote Direct Memory Access (RDMA)](/infrastructure/data-and-memory/remote-direct-memory-access-rdma.md)
- [High Bandwidth Memory (HBM3)](/infrastructure/data-and-memory/high-bandwidth-memory-hbm3.md): SK Hynix Inc
- [Flash Memory](/infrastructure/data-and-memory/flash-memory.md)
- [Model Requirements](/infrastructure/data-and-memory/model-requirements.md)
- [Calculating GPU memory for serving LLMs](/infrastructure/data-and-memory/calculating-gpu-memory-for-serving-llms.md)
- [Transformer training costs](/infrastructure/data-and-memory/transformer-training-costs.md)
- [GPU Performance Optimisation](/infrastructure/data-and-memory/gpu-performance-optimisation.md)
- [Libraries and Complements](/infrastructure/libraries-and-complements.md)
- [NVIDIA Base Command](/infrastructure/libraries-and-complements/nvidia-base-command.md)
- [NVIDIA AI Enterprise](/infrastructure/libraries-and-complements/nvidia-ai-enterprise.md)
- [CUDA - NVIDIA GTC 2024 presentation](/infrastructure/libraries-and-complements/cuda-nvidia-gtc-2024-presentation.md): Steven Jones' presentation on CUDA at NVIDIA GTC 2024
- [RAPIDs](/infrastructure/libraries-and-complements/rapids.md)
- [RAFT](/infrastructure/libraries-and-complements/raft.md)
- [Vast Data Platform](/infrastructure/vast-data-platform.md)
- [Vast Datastore](/infrastructure/vast-data-platform/vast-datastore.md)
- [Vast Database](/infrastructure/vast-data-platform/vast-database.md)
- [Vast Data Engine](/infrastructure/vast-data-platform/vast-data-engine.md)
- [DASE (Disaggregated and Shared Everything)](/infrastructure/vast-data-platform/dase-disaggregated-and-shared-everything.md)
- [Dremio and VAST Data](/infrastructure/vast-data-platform/dremio-and-vast-data.md)
- [Storage](/infrastructure/storage.md)
- [WEKA: A High-Performance Storage Solution for AI Workloads](/infrastructure/storage/weka-a-high-performance-storage-solution-for-ai-workloads.md)
- [Introduction to NVIDIA GPUDirect Storage (GDS)](/infrastructure/storage/introduction-to-nvidia-gpudirect-storage-gds.md)
- [GDS cuFile API](/infrastructure/storage/introduction-to-nvidia-gpudirect-storage-gds/gds-cufile-api.md)
- [NVIDIA Magnum IO GPUDirect Storage (GDS)](/infrastructure/storage/nvidia-magnum-io-gpudirect-storage-gds.md)
- [Vectors in Memory](/infrastructure/storage/vectors-in-memory.md)