Chip
Chip manufacturer
NVIDIA
Model designation
H200
Graphics processor
GH100
Number of stream processors
16,896×
Production technology
5 nm
Performance & usage
Use
Professional
Card profile
FHFL
Memory
VRAM capacity
141 GB
Memory type
HBM3e
Frequency
Core frequency
1,365 MHz
Core clock speed (Boost clock)
1,785 MHz
Memory frequency
6,400 MHz (6.4 GHz)
Effective memory clock (bandwidth)
6.4 Gbps
Interface
PC connection
PCI Express x16 5.0
Bus interface
PCIe 5.0 x16
NVLink version
4.0
Technology
Cooling system
Cooling type
Passive
Cooling size
Dual-slot
Dimensions
Width
266.7 mm
Depth
111.8 mm
Consumption
TDP
600 W
Auxiliary power supply
1× 8-pin
AI
Total number of TOPS
3,958
INT8 TOPS
3,341
Max. number of MIG instances
7
Supported precision
FP64
Tops
Total number of TOPS
3,958
AI specifications
Primary AI use
LLM Inference
