u/RhubarbKindly9210

Two months ago I posted a small VPS/cloud benchmark here comparing Hetzner, AWS and OVHcloud: Link to old Post

I kept working on it and just released a bigger update: Live Github Page

Screenshot main page

Screenshot history

The main thing I wanted to improve after the first discussion was the provider and instance coverage. Azure and Google Cloud are now included. The part I find most useful is the history. It does not only show a one-time benchmark result, but also tracks price and measured performance over time. That makes it easier to see if an instance type is stable or if results move around.

Obviously this is still not perfect. VPS/cloud comparisons get messy quickly because of storage type, region, burst behaviour, CPU steal and network latency. But it has already been more useful to me than comparing only vCPU counts, RAM and monthly price.

Repo: Github Repo - Feel free to use it, fork it, or suggest instance types/providers that would make sense to add.

I keep getting stuck at the same point when comparing cloud instances. The specs look clear at first, but 2 vCPU / 8 GB RAM can mean very different things depending on the provider, CPU generation, storage setup, burst behavior and how the instance is placed.

So I created an open-source benchmark tool to make the comparison a bit less "lucky": https://fabianwimberger.github.io/cloud-bench/

The part that makes it useful to me is not only having several providers in one place with architecture, vCPU/RAM and monthly price. It also tracks history, so price changes and actually measured performance changes are visible over time.

The process is open source, reproducible and transparent: Terraform provisions fresh instances, Ansible runs the benchmarks, GitHub Actions ties it together and publishes the result.

I updated it recently with more Azure and Google Cloud instances to complete the big three. Azure was especially annoying to represent because a fair comparison needs a mix of burstable, normal x86 and ARM instances.

Obviously this is still not perfect. Storage type, region, CPU steal, burst credits and network latency all matter. But it has already been more useful to me than comparing only vCPU counts and memory.