NVIDIA H200 SXM
Hopper Architecture
Active
Launched November 2023
Core Specifications
VendorNVIDIA
ArchitectureHopper
Form FactorSXM
VRAM141 GB
Memory Bandwidth4,800 GB/s
TDP700 W
Compute Performance
| Precision | TFLOPs |
|---|---|
| FP32 | 67 |
| FP16 | 1,979 |
| BF16 | 1,979 |
| FP8 | 3,958 |
Performance Benchmarks
llm train
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| 8x NVLink | BF16 | 15,000 tokens/sec | View |
Pricing
Hardware Purchase (CAPEX)
| Type | Price (USD) | Region | As of |
|---|---|---|---|
| Street Price | $40,000 | Global | Oct 2024 |
| Street Price | $40,000 | global | Oct 2025 |
Cloud Rental (OPEX)
| Provider | Instance Type | Price per Hour | Region | As of |
|---|---|---|---|---|
| Hyperstack | — | $3.50/hr | global | Nov 2025 |
| Civo | — | $3.49/hr | global | Nov 2025 |
| Contabo | — | $3.45/hr | global | Nov 2025 |
| Novita | — | $3.25/hr | global | Nov 2025 |
| Sesterce | — | $2.69/hr | global | Nov 2025 |
| DataCrunch | — | $2.59/hr | global | Nov 2025 |
| Hyperstack | — | $2.45/hr | global | Nov 2025 |
| Fal.ai | — | $2.10/hr | global | Nov 2025 |
| Novita | — | $1.63/hr | global | Nov 2025 |
| FluidStack | — | $2.30/hr | global | Nov 2025 |
| AWS | p5e.48xlarge (8x H200) | $327.68/hr | us-east-1 | Oct 2024 |
| AWS | p5e.xlarge (1x H200) | $40.96/hr | us-east-1 | Oct 2024 |