GPU Cloud Price Index
Mtundu uliwonse wa GPU womwe tikutsatira, ndi mtengo wotsika kwambiri wogulitsa ndalama m'mabungwe onse.
| GPU | VRAM | Architecture | FP16 TFLOPS | Mem BW | Kuchokera $/GPU/hr |
|---|---|---|---|---|---|
| MI350X | 288GB | CDNA 4 | 2500 | 8000 GB/s | $4.000 |
| MI355X | 288GB | CDNA 4 | 2500 | 8000 GB/s | $4.500 |
| MI325X | 256GB | CDNA 3 | 1307 | 6000 GB/s | $3.800 |
| MI300X | 192GB | CDNA 3 | 1307 | 5300 GB/s | $0.500 |
| MI250X | 128GB | CDNA 2 | 383 | 3277 GB/s | — |
| Trainium2 | 96GB | Trainium | 667 | 2900 GB/s | — |
| TPU v5e | 16GB | TPU | 197 | 819 GB/s | — |
| Gaudi 3 | 128GB | Gaudi | 1835 | 3675 GB/s | — |
| Gaudi 2 | 96GB | Gaudi | 432 | 2450 GB/s | $1.100 |
| B300 | 288GB | Blackwell Ultra | 2250 | 8000 GB/s | $6.940 |
| RTX 5050 wogwiritsa ntchito | 8GB | Blackwell | 27 | 320 GB/s | — |
| RTX 5060 wogwiritsa ntchito | 8GB | Blackwell | 38 | 448 GB/s | $0.097 |
| RTX 5060 Ti wogwiritsa ntchito | 16GB | Blackwell | 47 | 448 GB/s | $0.096 |
| RTX 5070 wogwiritsa ntchito | 12GB | Blackwell | 62 | 672 GB/s | $0.136 |
| RTX 5070 Ti wogwiritsa ntchito | 16GB | Blackwell | 88 | 896 GB/s | $0.114 |
| RTX 5080 wogwiritsa ntchito | 16GB | Blackwell | 113 | 960 GB/s | $0.210 |
| RTX 5090 wogwiritsa ntchito | 32GB | Blackwell | 210 | 1792 GB/s | $0.455 |
| RTX PRO 2000 Blackwell | 16GB | Blackwell | 50 | 448 GB/s | — |
| RTX PRO 4000 Blackwell | 24GB | Blackwell | 90 | 672 GB/s | $0.256 |
| RTX PRO 4500 Blackwell | 32GB | Blackwell | 120 | 896 GB/s | $0.340 |
| RTX PRO 5000 Blackwell | 48GB | Blackwell | 190 | 1344 GB/s | $0.656 |
| RTX PRO 6000 Blackwell | 96GB | Blackwell | 252 | 1792 GB/s | $0.500 |
| B200 | 192GB | Blackwell | 2250 | 8000 GB/s | $5.627 |
| H200 | 141GB | Hopper | 989 | 4800 GB/s | $3.000 |
| H200 NVL | 141GB | Hopper | 835 | 4800 GB/s | $0.500 |
| RTX 2000 Ada | 16GB | Ada Lovelace | 24 | 224 GB/s | $0.240 |
| RTX 5880 Ada | 48GB | Ada Lovelace | 139 | 960 GB/s | $0.670 |
| GH200 | 96GB | Hopper | 989 | 4000 GB/s | — |
| H100 NVL | 94GB | Hopper | 835 | 3900 GB/s | $2.362 |
| L20 | 48GB | Ada Lovelace | — | 864 GB/s | — |
| L4 | 24GB | Ada Lovelace | 121 | 300 GB/s | $0.323 |
| L40S | 48GB | Ada Lovelace | 366 | 864 GB/s | $0.734 |
| RTX 4000 Ada | 20GB | Ada Lovelace | 53 | 360 GB/s | $0.174 |
| RTX 4060 wogwiritsa ntchito | 8GB | Ada Lovelace | 30 | 272 GB/s | $0.069 |
| RTX 4060 Ti wogwiritsa ntchito | 16GB | Ada Lovelace | 44 | 288 GB/s | $0.084 |
| RTX 4070 wogwiritsa ntchito | 12GB | Ada Lovelace | 58 | 504 GB/s | $0.081 |
| RTX 4070 Ti wogwiritsa ntchito | 12GB | Ada Lovelace | 80 | 504 GB/s | $0.190 |
| RTX 4500 Ada | 24GB | Ada Lovelace | 79 | 432 GB/s | $0.337 |
| RTX 5000 Ada | 32GB | Ada Lovelace | 131 | 576 GB/s | $0.490 |
| H100 PCIe | 80GB | Hopper | 756 | 2000 GB/s | $1.990 |
| H100 SXM | 80GB | Hopper | 989 | 3350 GB/s | $1.869 |
| L40 | 48GB | Ada Lovelace | 181 | 864 GB/s | $0.662 |
| RTX 3050 wogwiritsa ntchito | 8GB | Ampere | 18 | 224 GB/s | $0.169 |
| RTX 4080 wogwiritsa ntchito | 16GB | Ada Lovelace | 98 | 717 GB/s | $0.150 |
| RTX 4090 wogwiritsa ntchito | 24GB | Ada Lovelace | 165 | 1008 GB/s | $0.296 |
| RTX 6000 Ada | 48GB | Ada Lovelace | 182 | 960 GB/s | $0.683 |
| A10 | 24GB | Ampere | 125 | 600 GB/s | $0.243 |
| A100X | 80GB | Ampere | 312 | 1935 GB/s | — |
| A16 | 64GB | Ampere | 72 | 800 GB/s | $0.108 |
| A2 | 16GB | Ampere | 18 | 200 GB/s | — |
| A30 | 24GB | Ampere | 165 | 933 GB/s | $0.350 |
| RTX 3060 wogwiritsa ntchito | 12GB | Ampere | 25 | 360 GB/s | $0.051 |
| RTX A2000 | 12GB | Ampere | 32 | 288 GB/s | $0.052 |
| RTX A4000 | 16GB | Ampere | 77 | 448 GB/s | $0.070 |
| RTX A4500 | 20GB | Ampere | 95 | 640 GB/s | $0.190 |
| RTX A5000 | 24GB | Ampere | 111 | 768 GB/s | $0.160 |
| A100 40GB | 40GB | Ampere | 312 | 1555 GB/s | $1.000 |
| A100 PCIe 80GB | 80GB | Ampere | 312 | 1935 GB/s | $0.602 |
| A100 SXM 80GB | 80GB | Ampere | 312 | 2039 GB/s | $0.401 |
| A40 | 48GB | Ampere | 150 | 696 GB/s | $0.350 |
| RTX 3070 wogwiritsa ntchito | 8GB | Ampere | 41 | 448 GB/s | $0.069 |
| RTX 3080 wogwiritsa ntchito | 10GB | Ampere | 60 | 760 GB/s | $0.096 |
| RTX 3090 wogwiritsa ntchito | 24GB | Ampere | 71 | 936 GB/s | $0.090 |
| RTX A6000 | 48GB | Ampere | 155 | 768 GB/s | $0.330 |
| T10 | 16GB | Turing | — | 403 GB/s | $1.250 |
| GTX 1650 wogwiritsa ntchito | 4GB | Turing | — | 192 GB/s | $0.047 |
| GTX 1660 Ti wogwiritsa ntchito | 6GB | Turing | — | 288 GB/s | $0.053 |
| Quadro P2200 | 5GB | Pascal | — | 200 GB/s | — |
| RTX 2060 wogwiritsa ntchito | 6GB | Turing | 26 | 336 GB/s | $0.053 |
| Quadro RTX 4000 | 8GB | Turing | — | 416 GB/s | $0.054 |
| Quadro RTX 5000 | 16GB | Turing | — | 448 GB/s | $0.089 |
| Quadro RTX 6000 | 24GB | Turing | 65 | 672 GB/s | $0.170 |
| Quadro RTX 8000 | 48GB | Turing | 65 | 672 GB/s | $0.210 |
| RTX 2070 wogwiritsa ntchito | 8GB | Turing | 30 | 448 GB/s | $0.062 |
| RTX 2080 wogwiritsa ntchito | 8GB | Turing | 40 | 448 GB/s | $1.400 |
| RTX 2080 Ti wogwiritsa ntchito | 11GB | Turing | 54 | 616 GB/s | $0.068 |
| T4 | 16GB | Turing | 65 | 320 GB/s | $0.473 |
| Titan RTX wogwiritsa ntchito | 24GB | Turing | 65 | 672 GB/s | $0.201 |
| V100 32GB | 32GB | Volta | 125 | 900 GB/s | $0.120 |
| GTX 1070 Ti wogwiritsa ntchito | 8GB | Pascal | — | 256 GB/s | $0.067 |
| GTX 1080 Ti wogwiritsa ntchito | 11GB | Pascal | — | 484 GB/s | $0.056 |
| Quadro P2000 | 5GB | Pascal | — | 140 GB/s | $0.028 |
| Quadro P4000 | 8GB | Pascal | — | 243 GB/s | $0.042 |
| Titan V wogwiritsa ntchito | 12GB | Volta | 110 | 653 GB/s | $0.134 |
| Titan Xp wogwiritsa ntchito | 12GB | Pascal | 0 | 548 GB/s | $0.047 |
| V100 | 16GB | Volta | 125 | 900 GB/s | $0.110 |
| GTX 1050 wogwiritsa ntchito | 2GB | Pascal | — | 112 GB/s | $0.050 |
| GTX 1050 Ti wogwiritsa ntchito | 4GB | Pascal | — | 112 GB/s | — |
| GTX 1060 wogwiritsa ntchito | 6GB | Pascal | — | 192 GB/s | — |
| GTX 1070 wogwiritsa ntchito | 8GB | Pascal | — | 256 GB/s | $0.048 |
| GTX 1080 wogwiritsa ntchito | 8GB | Pascal | — | 320 GB/s | $0.054 |
| P100 | 16GB | Pascal | 21 | 732 GB/s | $0.094 |
| P40 | 24GB | Pascal | 0 | 346 GB/s | $0.108 |
| Tesla M10 | 32GB | Maxwell | — | 332 GB/s | — |
| Tesla P4 | 8GB | Pascal | — | 192 GB/s | — |
| GTX Titan X wogwiritsa ntchito | 12GB | Maxwell | — | 336 GB/s | $0.056 |
| Quadro M4000 | 8GB | Maxwell | — | 192 GB/s | — |
| Tesla M40 | 24GB | Maxwell | — | 288 GB/s | $1.790 |
| GTX 745 wogwiritsa ntchito | 4GB | Maxwell | — | 29 GB/s | — |