AWS Trainium
Inferentia/Trainium Architecture
Active
Launched November 2021
Core Specifications
VendorAWS
ArchitectureInferentia/Trainium
Form Factor—
VRAM32 GB
Memory Bandwidth—
TDP200 W
Compute Performance
| Precision | TFLOPs |
|---|---|
| BF16 | 190 |
Pricing
Cloud Rental (OPEX)
| Provider | Instance Type | Price per Hour | Region | As of |
|---|---|---|---|---|
| AWS | trn1.32xlarge (16x Trainium) | $24.78/hr | us-east-1 | Oct 2024 |
| AWS | trn1.32xlarge (16x Trainium) | $24.78/hr | us-east-1 | Oct 2024 |