Compare XPUs
Select up to 5 XPUs to compare side-by-side
Select XPUs to Compare
Alibaba
Hanguang 800
AMD
MI100
23.1 TFLOPs
AMD
MI210
181 TFLOPs
AMD
MI250X
383 TFLOPs
AMD
MI300X
1,307 TFLOPs
AMD
MI325X
1,400 TFLOPs
AMD
MI350X
2,100 TFLOPs
AMD
MI355X
5,300 TFLOPs
AMD
Radeon Pro V520
23.04 TFLOPs
AWS
Inferentia2
190 TFLOPs
AWS
Trainium
190 TFLOPs
AWS
Trainium2
680 TFLOPs
Baidu
Kunlun II
Biren Technology
BR100
Cambricon
MLU370
256 TFLOPs
Cerebras
WSE-3
Enflame Technology
CloudBlazer T20
FuriosaAI
RNGD (Renegade)
256 TFLOPs
FuriosaAI
Warboy
TPU v4
275 TFLOPs
TPU v5e
197 TFLOPs
TPU v5p
459 TFLOPs
Graphcore
Bow IPU
Graphcore
IPU-M2000
Groq
LPU Inference Engine
Huawei
Ascend 910B
Iluvatar CoreX
BI-V150
300 TFLOPs
Intel
Data Center GPU Max 1100
177 TFLOPs
Intel
Data Center GPU Max 1550
419 TFLOPs
Intel Habana
Gaudi 2
432 TFLOPs
Intel Habana
Gaudi 3
1,835 TFLOPs
Meta
MTIA v1
Microsoft
Maia 100
700 TFLOPs
Moore Threads
MTT S80
NVIDIA
A10
125 TFLOPs
NVIDIA
A100 SXM
312 TFLOPs
NVIDIA
A10G
125 TFLOPs
NVIDIA
A16
71.2 TFLOPs
NVIDIA
A30
165 TFLOPs
NVIDIA
A40
150 TFLOPs
NVIDIA
A800
312 TFLOPs
NVIDIA
B100
1,800 TFLOPs
NVIDIA
B200
2,250 TFLOPs
NVIDIA
GB200
2,500 TFLOPs
NVIDIA
GeForce GT 710
0.366 TFLOPs
NVIDIA
GeForce GT 730
0.693 TFLOPs
NVIDIA
GeForce GTX 1050 Ti
2.138 TFLOPs
NVIDIA
GeForce GTX 1060
4.375 TFLOPs
NVIDIA
GeForce GTX 1070
6.463 TFLOPs
NVIDIA
GeForce GTX 1070 Ti
8.186 TFLOPs
NVIDIA
GeForce GTX 1080
8.873 TFLOPs
NVIDIA
GeForce GTX 1080 Ti
11.34 TFLOPs
NVIDIA
GeForce GTX 1650
2.984 TFLOPs
NVIDIA
GeForce GTX 1660
5.027 TFLOPs
NVIDIA
GeForce GTX 1660 Super
5.027 TFLOPs
NVIDIA
GeForce RTX 2060
6.5 TFLOPs
NVIDIA
GeForce RTX 2060 Super
7.2 TFLOPs
NVIDIA
GeForce RTX 2070
7.5 TFLOPs
NVIDIA
GeForce RTX 2080
10.1 TFLOPs
NVIDIA
GeForce RTX 2080 Ti
13.4 TFLOPs
NVIDIA
GeForce RTX 3050
18.2 TFLOPs
NVIDIA
GeForce RTX 3060
25.4 TFLOPs
NVIDIA
GeForce RTX 3060 Ti
33.2 TFLOPs
NVIDIA
GeForce RTX 3070
40.5 TFLOPs
NVIDIA
GeForce RTX 3070 Ti
43.2 TFLOPs
NVIDIA
GeForce RTX 3080
59.2 TFLOPs
NVIDIA
GeForce RTX 3080 Ti
68.4 TFLOPs
NVIDIA
GeForce RTX 3090
71 TFLOPs
NVIDIA
GeForce RTX 3090 Ti
80 TFLOPs
NVIDIA
GeForce RTX 4060
30 TFLOPs
NVIDIA
GeForce RTX 4060 Ti
44 TFLOPs
NVIDIA
GeForce RTX 4060 Ti 16GB
44 TFLOPs
NVIDIA
GeForce RTX 4070
58.92 TFLOPs
NVIDIA
GeForce RTX 4070 Super
70 TFLOPs
NVIDIA
GeForce RTX 4070 Ti
80.16 TFLOPs
NVIDIA
GeForce RTX 4070 Ti Super
88 TFLOPs
NVIDIA
GeForce RTX 4080
97.76 TFLOPs
NVIDIA
GeForce RTX 4080 Super
104 TFLOPs
NVIDIA
GeForce RTX 4090
165.2 TFLOPs
NVIDIA
GeForce RTX 4090 D
165 TFLOPs
NVIDIA
GeForce RTX 5060
60 TFLOPs
NVIDIA
GeForce RTX 5060 Ti
88 TFLOPs
NVIDIA
GeForce RTX 5070
110 TFLOPs
NVIDIA
GeForce RTX 5070 Ti
133 TFLOPs
NVIDIA
GeForce RTX 5080
171 TFLOPs
NVIDIA
GeForce RTX 5090
318 TFLOPs
NVIDIA
GH200
989 TFLOPs
NVIDIA
H100 SXM
1,979 TFLOPs
NVIDIA
H200 SXM
1,979 TFLOPs
NVIDIA
K80
8.73 TFLOPs
NVIDIA
L4
121 TFLOPs
NVIDIA
L40
181.05 TFLOPs
NVIDIA
L40S
733 TFLOPs
NVIDIA
P100
9.3 TFLOPs
NVIDIA
P4
5.5 TFLOPs
NVIDIA
P40
12 TFLOPs
NVIDIA
Quadro K620
0.768 TFLOPs
NVIDIA
Quadro M4000
2.57 TFLOPs
NVIDIA
Quadro M60
4.825 TFLOPs
NVIDIA
Quadro P1000
1.894 TFLOPs
NVIDIA
Quadro P4000
5.304 TFLOPs
NVIDIA
Quadro P5000
8.873 TFLOPs
NVIDIA
Quadro P600
1.117 TFLOPs
NVIDIA
Quadro P6000
12.63 TFLOPs
NVIDIA
Quadro P620
1.386 TFLOPs
NVIDIA
Quadro RTX 6000
130.5 TFLOPs
NVIDIA
RTX 4000
57.6 TFLOPs
NVIDIA
RTX 4000 SFF Ada Generation
52 TFLOPs
NVIDIA
RTX 4500 Ada Generation
97 TFLOPs
NVIDIA
RTX 5000
89.2 TFLOPs
NVIDIA
RTX 5000 Ada Generation
130 TFLOPs
NVIDIA
RTX 5000 Blackwell
242 TFLOPs
NVIDIA
RTX 5880 Ada Generation
167 TFLOPs
NVIDIA
RTX 6000 Ada Generation
182.5 TFLOPs
NVIDIA
RTX 6000 Blackwell
362 TFLOPs
NVIDIA
RTX A2000
16 TFLOPs
NVIDIA
RTX A4000
38.7 TFLOPs
NVIDIA
RTX A4500
46.6 TFLOPs
NVIDIA
RTX A5000
54.2 TFLOPs
NVIDIA
RTX A6000
77.9 TFLOPs
NVIDIA
T1000
2.5 TFLOPs
NVIDIA
T4
65 TFLOPs
NVIDIA
T4G
65 TFLOPs
NVIDIA
V100S
16.4 TFLOPs
Rebellions
ATOM
SambaNova
SN40L
Tenstorrent
Grayskull
200 TFLOPs
Tenstorrent
Wormhole
364 TFLOPs
Maximum of 5 XPUs can be compared at once. Deselect one to add another.
Multi-Metric Comparison
Relative performance across 5 key metrics (normalized to 100 = best in comparison)
Compute Performance (BF16)
Memory Capacity
Power Consumption
Power Efficiency
Specifications
| Specification | Intel Habana Gaudi 2 | Intel Habana Gaudi 3 | Groq LPU Inference Engine | NVIDIA L4 | NVIDIA Quadro P600 | NVIDIA GeForce RTX 3090 |
|---|---|---|---|---|---|---|
| Architecture | Gaudi Gen2 | Gaudi Gen3 | TSP (Tensor Streaming Processor) | Ada Lovelace | Pascal | Ampere |
| Form Factor | OAM | OAM | — | PCIe | PCIe | PCIe |
| VRAM | 96 GB | 128 GB | 230 GB | 24 GB | 2 GB | 24 GB |
| Memory Bandwidth | 2,450 GB/s | 3,700 GB/s | — | 300 GB/s | 64 GB/s | 936 GB/s |
| TFLOPs (FP32) | — | — | — | 30.3 | 1.117 | 35.6 |
| TFLOPs (FP16) | — | — | — | 242 | — | — |
| TFLOPs | 432 | 1,835 | — | 121 | 1.117 | 71 |
| TFLOPs (FP8) | — | 3,670 | — | 485 | — | — |
| TDP | 600 W | 900 W | 300 W | 72 W | 40 W | 350 W |
| Launch Date | May 2022 | Apr 2024 | Feb 2024 | Mar 2023 | Feb 2017 | Sep 2020 |
Efficiency Metrics
| Metric | Gaudi 2 | Gaudi 3 | LPU Inference Engine | L4 | Quadro P600 | GeForce RTX 3090 |
|---|---|---|---|---|---|---|
| TFLOPs per Watt (FP32-eq) | 0.36 | 1.02 | — | 0.84 | 0.03 | 0.10 |
| Memory Bandwidth per GB | 25.5 GB/s | 28.9 GB/s | — | 12.5 GB/s | 32.0 GB/s | 39.0 GB/s |
Performance Equivalence
How many units of each GPU are needed to match the performance of the others?
To match 1x Intel Habana Gaudi 2
To match 1x Intel Habana Gaudi 3
To match 1x Groq LPU Inference Engine
To match 1x NVIDIA L4
To match 1x NVIDIA Quadro P600
To match 1x NVIDIA GeForce RTX 3090
Pricing
| Price Type | Gaudi 2 | Gaudi 3 | LPU Inference Engine | L4 | Quadro P600 | GeForce RTX 3090 |
|---|---|---|---|---|---|---|
| CAPEX (Street Price) | — | $15,000 | — | $4,000 | — | — |
| OPEX (per hour) | — | $1.20/hr | — | $0.80/hr | $0.05/hr | $0.11/hr |
| Price per TFLOPs (FP32-eq) | — | $16 | — | $66 | — | — |