| # | Model · Build | Hardware | Decode · tok/s | tok/100W |
|---|---|---|---|---|
M6 mini 32GB | 61.9 | 229.3 | ||
M5 Pro 64GB | 89.9 | 224.8 | ||
M4 Pro | 85.5 | 190 | ||
M4 Pro | 82.8 | 184 | ||
M5 Max | 126.5 | 180.7 | ||
M4 Pro | 49.3 | 109.6 | ||
M4 Pro | 48.3 | 107.3 | ||
M5 Max 128GB | 65 | 92.9 | ||
RTX A5000 | 177.6 | 77.2 | ||
M1 Max 32GB | 37 | 61.7 | ||
RTX 5090 32GB | 351 | 61 | ||
RTX A5000 | 139.3 | 60.6 | ||
RTX 4090 24GB | 220 | 48.9 | ||
DGX Spark | 102.9 | 42.9 | ||
2× DGX Spark | 94.4 | 39.3 | ||
DGX Spark | 79.5 | 33.1 | ||
RTX 5060 8GB | 47 | 32.4 | ||
GTX 1660 SUPER 6GB | 40 | 32 | ||
DGX Spark | 74.8 | 31.2 | ||
RTX 5090 32GB | 173 | 30.1 | ||
DGX Spark | 72 | 30 | ||
RTX 3060 12GB | 50 | 29.4 | ||
RTX 3090 24GB | 100.6 | 28.7 | ||
2× DGX Spark | 60.4 | 25.2 | ||
RTX 5090 32GB | 142 | 24.7 | ||
2x DGX Spark | 55.6 | 23.2 | ||
RTX 3090 24GB | 72 | 20.6 | ||
2× DGX Spark | 45 | 18.8 | ||
RTX 5090 32GB | 104 | 18.1 | ||
RTX 3060 12GB | 27.7 | 16.3 | ||
RTX 5090 32GB | 80.9 | 14.1 | ||
RTX 5060 Ti 16GB | 23 | 12.8 | ||
4x DGX Spark | 30 | 12.5 | ||
RTX 5060 Ti 16GB | 19 | 10.6 | ||
RTX 4090 24GB | 40.7 | 9 | ||
RTX 5060 Ti 16GB | 14 | 7.8 | ||
DGX Spark | 18.6 | 7.7 | ||
2x DGX Spark | 15 | 6.3 | ||
RTX 5060 Ti 16GB | 10 | 5.6 |







