Skip to content

Cloud GPUs

By Sergey Karayev. Updated August 5, 2022.

Cloud Comparison

We have assembled cloud GPU vendor pricing all in one table, sortable and filterable to your liking!

We welcome your help in adding more cloud GPU providers and keeping the pricing info current.

Please file an issue or make a pull request to this repo, editing this file to update the text on this page and/or cloud-gpus.csv to update the data.

All prices are in $/hr.

Notes

  • GCP does not have GPU "instances" in the same way that AWS and Azure do. Instead, any suitable machine can be connected to a configuration of GPUs. We have selected machines that are roughly equivalent to AWS options.
  • Regions were set to be the west or central parts of the United States. GPU availability depends on the region.
  • Raw data can be found in a Google sheet.

GPUs

Below are the TFLOPs of the different GPUs available from cloud providers.

Model Arch FP32 Mixed-precision FP16 Source
A100 Ampere 19.5 156 312 Datasheet
A10G Ampere 35 35 70 Datasheet
A6000 Ampere 38 ? ? Datasheet
V100 Volta 14 112 28 Datasheet
T4 Turing 8.1 65 ? Datasheet
P4 Pascal 5.5 N/A N/A Datasheet
P100 Pascal 9.3 N/A 18.7 Datasheet
K80 Kepler 8.73 N/A N/A Datasheet
A40 Ampere 37 150 150 Datasheet

Benchmark of different GPUs on a single ImageNet epoch, by AIME

Benchmark of different GPUs on a single ImageNet epoch, by AIME

Benchmark of different GPUs on a mix of tasks, by Lambda Labs

Benchmark of different GPUs on a mix of tasks, by Lambda Labs