PNY NVIDIA H200
SKU: NVBGPUNTH200NVL141GB
The NVIDIA H200 NVL brings Hopper-generation AI and HPC performance to mainstream enterprise servers. It has 141GB of HBM3e memory at 4.8TB/s, which is 1.5x the memory and 1.2x the bandwidth of the previous generation (H100 NVL), so larger language models fit on fewer GPUs. NVIDIA quotes 1.8x faster LLM inference than the previous generation.
- 141GB HBM3e, 4.8TB/s memory bandwidth
- 3,958 TFLOPS FP8 Tensor Core (with sparsity); 67 TFLOPS FP64 Tensor Core
- Dual-slot, passively cooled PCIe 5.0 card, up to 600W (configurable)
- 2- or 4-way NVIDIA NVLink bridge at 900GB/s
- Up to 7 MIG instances at 18GB each; confidential computing supported
- Includes a five-year NVIDIA AI Enterprise subscription
Because it is passively cooled, the H200 NVL needs a server chassis with the airflow to match. We can build it into a tested server configured for your models and workloads. Talk to us about yours.
Available on Backorder
(Usually 1-3 weeks lead time)
System Configuration
Available on Backorder
(Usually 1-3 weeks lead time)
Details & Specifications
Details & Specifications
| Manufacturer | |
|---|---|
| Manufacturer Part Number |
NVH200NVLTCGPU-KIT |
Additional:
| NVIDIA AI Enterprise |
Included (5-year subscription) |
|---|---|
| NVLink |
2- or 4-way NVIDIA NVLink bridge: 900 GB/s |
| Server Options |
NVIDIA MGX H200 NVL partner and NVIDIA-Certified Systems with up to 8 GPUs |
Cooling:
| Thermal Solution |
Passive |
|---|
Dimensions:
| Form Factor |
PCIe, dual slot |
|---|
GPU:
| BFLOAT16 Tensor Core Performance |
1,979 TFLOPS (with sparsity) |
|---|---|
| Confidential Compute |
Supported |
| FP16 Tensor Core Performance |
1,979 TFLOPS (with sparsity) |
| FP32 Performance |
67 TFLOPS |
| FP64 Performance |
34 TFLOPS |
| FP64 Tensor Core Performance |
67 TFLOPS |
| FP8 Tensor Core Performance |
3,958 TFLOPS (with sparsity)- |
| GPU Architecture | |
| GPU Slot Size | |
| INT8 Tensor Core Performance |
3,958 TOPS (with sparsity) |
| TF32 Tensor Core Performance |
989 TFLOPS (with sparsity) |
| Video Engines |
7x NVDEC |
Memory:
| GPU Memory |
141 GB HBM3e |
|---|---|
| Memory Bandwidth |
4.8 TB/s |
| MIG Support |
Up to 7 MIGs @ 18 GB each |
PCIe:
| PCIe Version |
PCIe 5.0 x16 (128 GB/s) |
|---|
Power:
| Power Consumption |
Max thermal design power: up to 600 W (configurable) |
|---|
Warranty:
| Mfr Warranty Length |
36 Months |
|---|---|
| Mfr Warranty Type |
Manufacturer Warranty |