Be the first to review “NVIDIA® H100” Cancel reply
Our website uses cookies to give you the best experience possible. By continuing to use our site, you agree with our use of cookies outlined in our Privacy Policy
Home / Components / NVIDIA Data Centre GPUs / NVIDIA® H100
The NVIDIA H100 Tensor Core GPU is the ultimate data centre GPU for large-scale AI and HPC. It has unprecedented performance, scalability, and security, and comes with the NVIDIA AI Enterprise software suite to make AI development and deployment easier. H100 can handle exascale workloads with a dedicated Transformer Engine for massive language models. It can also be split into right-sized Multi-Instance GPU (MIG) partitions for small jobs. With Hopper Confidential Computing, H100 can protect sensitive applications on shared data centre infrastructure. H100 is the most powerful end-to-end AI and HPC data centre platform with NVIDIA AI Enterprise.
The NVIDIA Hopper architecture is the foundation of H100. It has new compute core capabilities, such as the Transformer Engine, and faster networking to deliver an order of magnitude speedup over the previous generation. NVIDIA NVLink enables ultra-high bandwidth and low latency between two H100 boards, and supports memory pooling and performance scaling (application support required). Second-generation MIG allows secure partitioning of the GPU into isolated instances for 7x more secured tenants. NVIDIA AI Enterprise (exclusive to the H100 PCIe) is a software suite that optimizes the development and deployment of accelerated AI workflows, and leverages the new H100 architectural innovations. These technology breakthroughs make the H100 Tensor Core GPU – the world’s most advanced GPU ever built.
Manufacturer | |
---|---|
Manufacturer Part Number | NVH100TCGPU-KIT |
Gen2 MIG (Multi-Instance GPU) Support | Yes, Up to 7 GPU Instances at 10GB Each |
---|---|
NVIDIA AI Enterprise Support | Bundled with NVIDIA H100 |
NVLink | 2-Way, 2-Slot, 600 GB/s Bidirectional |
vGPU Support | NVIDIA Virtual Compute Server with MIG Support |
Passive Cooling | Yes |
---|
# Transistors | 80 Billion |
---|---|
BFLOAT16 Tensor Core Performance (TFLOPS) | 1513 | Sparcity |
FP16 Tensor Core Performance (TFLOPS) | 1513 | Sparcity |
FP32 Performance (TFLOPS) | 51 |
FP32 Tensor Core Performance (TFLOPS) | 51 | Sparcity |
FP64 Performance (TFLOPS) | 26 |
FP64 Tensor Core Performance (TFLOPS) | 51 | Sparcity |
FP8 Tensor Core Performance (TFLOPS) | 3016 | Sparcity |
GPU Architecture | |
GPU Slot Size | |
INT8 Tensor Core Performance (TOPS) | 3026 | Sparcity |
Lithography | 4nm |
Memory Bandwidth (TB/s) | 2 |
---|---|
Memory Capacity (GB) | 80 |
Memory Type | HBM2e |
Max Power Consumption (W) | 350 |
---|
Supported OS | Linux, Windows |
---|
Mfr Warranty Length (M) | 36 |
---|---|
Mfr Warranty Type | Direct To Manufacturer |
By signing up to the Workstation Specialists newsletter, you agree you have read and agree to our Privacy Policy and consent to us communicating/marketing to you in accordance with the policy. Read the terms and conditions here. You can unsubscribe at any time.
Reviews
There are no reviews yet.