NVIDIA A10

Ampere Architecture

Active

Launched April 2021

Core Specifications

VendorNVIDIA
ArchitectureAmpere
Form FactorPCIe
VRAM24 GB
Memory Bandwidth600 GB/s
TDP150 W

Compute Performance

PrecisionTFLOPs
FP3231.2
FP16125
BF16125

Performance Benchmarks

image gen

ConfigurationPrecisionPerformanceSource
Stable Diffusion 1.5, 512x512FP161 images_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 7B, edge inferenceFP162,800 tokens_per_secondView

Quick Stats

Peak Performance
125
TFLOPs (BF16)
Efficiency
0.83
TFLOPs per Watt

Supported Platform

This NVIDIA accelerator can be orchestrated and managed with hosted·ai

Learn more at hosted·ai

Similar XPUs

View other NVIDIA GPUs or compare across vendors