u/Shot-Calligrapher166

Making a website that allows you to compare providers of cloud GPU like Runpod, Vast ai, Lambda labs, etc., would be a huge help, especially since currently I have to visit several websites for the same purpose.

The idea is simple; I want to allow those with access to GPU hardware via the Cloud to find what they need based on Price and Performance instead of having to search through multiple websites to compare them.

The current backend includes the following:

1. Pricing from providers such as Vast.ai, RunPod, and Lambda Labs.

2. Synchronisation of GPU specifications.

3. Storage in Supabase.

4. Calculation of ranking score.

5. Providing the frontend with data through an API.

As it stands the frontend is disconnected from the backend and the architecture is in-place; therefore, I would like to know the following:

If you rent GPUs often, what are the main things you typically look at first? (Other than price per hour.)

Other than the hourly cost of the GPU, what other criteria do you look at (VRAM, TFLOPS, reliability, startup time, region, availability, etc.)?

What Providers do you think I should include?

Are there specific features or functionality you use today that have become unmanageable due to the way existing comparison sites work?

I'm currently at the point where I'm just starting with this project, so now is the time for me to make any major changes before I develop the frontend.

I would welcome any ideas, feedback, and suggestions for features.

Following up on the on-demand comparison from a couple weeks back - pulled spot/ interruptible pricing this time since that's where the real savings conversation actually lives for anyone running checkpointed training or batch jobs.

Checked: June 2026. Spot/interruptible tier, single GPU.

~ H100 80GB -Spot/Interruptible

RunPod :- $1.80-$2.40/hr , Community spot, can terminate without notice. Vast.ai :- $1.47-$2.00/hr (low end seen as low as $1.03/hr in thinner markets) wide range, host-dependent. AWS (P5, spot) :- technically available, $2.50-$3.10/hr extremely limited, frequently unavailable at any price.

~ A100 80GB - Spot/Interruptible

RunPod :- community spot as low as $0.20-0.40/hr (high variance) , reliability drops fast at this end. Vast.ai:- $0.67/hr typical, lower with thinner-reliability hosts, marketplace bidding, varies by host score. AWS (P4d, spot) :- ~$1.00-1.50/hr more consistently available than P5 spot.

What stood out:

• The spot discount vs on-demand is real - 40-60% off on H100, sometimes more on A100 - but the spread between providers on spot is much wider than on-demand. You're not comparing apples to apples, you're comparing apples to "whatever fell off the truck this hour."
• AWS spot for H100 (P5) is more of a theoretical price point than a practical one right now - availability is thin enough that "checked the price" and "could actually get one" are two different questions.
• Vast.ai's floor prices look incredible until you check host reliability scores. The $0.67/hr A100 and the $1.50/hr A100 are not the same product even though they're listed the same way.

This tier only makes sense if your job checkpoints well - anything customer-facing or latency-sensitive, spot isn't worth the risk regardless of price.

Not selling anything, just tracking this for my own training runs and figured others here are doing the same math. Anyone actually running production batch jobs on spot right now? Curious what interruption rates you're actually seeing vs what's advertised.

Following up on the on-demand comparison from a couple weeks back - pulled spot/ interruptible pricing this time since that's where the real savings conversation actually lives for anyone running checkpointed training or batch jobs.

Checked: June 2026. Spot/interruptible tier, single GPU.

~ H100 80GB -Spot/Interruptible

RunPod :- $1.80-$2.40/hr , Community spot, can terminate without notice. Vast.ai :- $1.47-$2.00/hr (low end seen as low as $1.03/hr in thinner markets) wide range, host-dependent. AWS (P5, spot) :- technically available, $2.50-$3.10/hr extremely limited, frequently unavailable at any price.

~ A100 80GB - Spot/Interruptible

RunPod :- community spot as low as $0.20-0.40/hr (high variance) , reliability drops fast at this end. Vast.ai:- $0.67/hr typical, lower with thinner-reliability hosts, marketplace bidding, varies by host score. AWS (P4d, spot) :- ~$1.00-1.50/hr more consistently available than P5 spot.

What stood out:

• The spot discount vs on-demand is real - 40-60% off on H100, sometimes more on A100 - but the spread between providers on spot is much wider than on-demand. You're not comparing apples to apples, you're comparing apples to "whatever fell off the truck this hour."
• AWS spot for H100 (P5) is more of a theoretical price point than a practical one right now - availability is thin enough that "checked the price" and "could actually get one" are two different questions.
• Vast.ai's floor prices look incredible until you check host reliability scores. The $0.67/hr A100 and the $1.50/hr A100 are not the same product even though they're listed the same way.

This tier only makes sense if your job checkpoints well - anything customer-facing or latency-sensitive, spot isn't worth the risk regardless of price.

Not selling anything, just tracking this for my own training runs and figured others here are doing the same math. Anyone actually running production batch jobs on spot right now? Curious what interruption rates you're actually seeing vs what's advertised.

Following up on the on-demand comparison from a couple weeks back - pulled spot/ interruptible pricing this time since that's where the real savings conversation actually lives for anyone running checkpointed training or batch jobs.

Checked: June 2026. Spot/interruptible tier, single GPU.

~ H100 80GB -Spot/Interruptible

RunPod :- $1.80-$2.40/hr , Community spot, can terminate without notice. Vast.ai :- $1.47-$2.00/hr (low end seen as low as $1.03/hr in thinner markets) wide range, host-dependent. AWS (P5, spot) :- technically available, $2.50-$3.10/hr extremely limited, frequently unavailable at any price.

~ A100 80GB - Spot/Interruptible

RunPod :- community spot as low as $0.20-0.40/hr (high variance) , reliability drops fast at this end. Vast.ai:- $0.67/hr typical, lower with thinner-reliability hosts, marketplace bidding, varies by host score. AWS (P4d, spot) :- ~$1.00-1.50/hr more consistently available than P5 spot.

What stood out:

• The spot discount vs on-demand is real - 40-60% off on H100, sometimes more on A100 - but the spread between providers on spot is much wider than on-demand. You're not comparing apples to apples, you're comparing apples to "whatever fell off the truck this hour."
• AWS spot for H100 (P5) is more of a theoretical price point than a practical one right now - availability is thin enough that "checked the price" and "could actually get one" are two different questions.
• Vast.ai's floor prices look incredible until you check host reliability scores. The $0.67/hr A100 and the $1.50/hr A100 are not the same product even though they're listed the same way.

This tier only makes sense if your job checkpoints well - anything customer-facing or latency-sensitive, spot isn't worth the risk regardless of price.

Not selling anything, just tracking this for my own training runs and figured others here are doing the same math. Anyone actually running production batch jobs on spot right now? Curious what interruption rates you're actually seeing vs what's advertised.

Following up on the on-demand comparison from a couple weeks back - pulled spot/ interruptible pricing this time since that's where the real savings conversation actually lives for anyone running checkpointed training or batch jobs.

Checked: June 2026. Spot/interruptible tier, single GPU.

~ H100 80GB -Spot/Interruptible

RunPod :- $1.80-$2.40/hr , Community spot, can terminate without notice. Vast.ai :- $1.47-$2.00/hr (low end seen as low as $1.03/hr in thinner markets) wide range, host-dependent. AWS (P5, spot) :- technically available, $2.50-$3.10/hr extremely limited, frequently unavailable at any price.

~ A100 80GB - Spot/Interruptible

RunPod :- community spot as low as $0.20-0.40/hr (high variance) , reliability drops fast at this end. Vast.ai:- $0.67/hr typical, lower with thinner-reliability hosts, marketplace bidding, varies by host score. AWS (P4d, spot) :- ~$1.00-1.50/hr more consistently available than P5 spot.

What stood out:

• The spot discount vs on-demand is real - 40-60% off on H100, sometimes more on A100 - but the spread between providers on spot is much wider than on-demand. You're not comparing apples to apples, you're comparing apples to "whatever fell off the truck this hour."
• AWS spot for H100 (P5) is more of a theoretical price point than a practical one right now - availability is thin enough that "checked the price" and "could actually get one" are two different questions.
• Vast.ai's floor prices look incredible until you check host reliability scores. The $0.67/hr A100 and the $1.50/hr A100 are not the same product even though they're listed the same way.

This tier only makes sense if your job checkpoints well - anything customer-facing or latency-sensitive, spot isn't worth the risk regardless of price.

Not selling anything, just tracking this for my own training runs and figured others here are doing the same math. Anyone actually running production batch jobs on spot right now? Curious what interruption rates you're actually seeing vs what's advertised.

Did a spot/interruptible pricing pass across the main providers

this week. Sharing since most public comparisons only cover

on-demand and that's not where most training budgets actually go.

Data pulled June 2026, single GPU, US region.

H100 80GB interruptible tier

RunPod community spot sits around $1.80 to $2.40/hr with no

termination guarantee

Vast.ai ranges from $1.47 to $2.00/hr, occasionally hitting

$1.03/hr when marketplace supply thins out

AWS P5 spot lists at $2.50 to $3.10/hr but capacity availability

is unreliable enough that it's more of a reference point than

a practical option

A100 80GB interruptible tier

RunPod community goes as low as $0.20 to $0.40/hr but host

reliability degrades significantly at that end

Vast.ai typically around $0.67/hr, varies by host score

AWS P4d spot more consistently available at $1.00 to $1.50/hr

The more interesting observation is how much wider the variance

is on spot vs on-demand. On-demand you're comparing providers.

On spot you're comparing providers, hosts, availability windows,

and reliability tiers all at once. Vast.ai's low end numbers

look compelling until you factor in that a $0.67/hr A100 and

a $1.50/hr A100 on the same platform are not equivalent

products in any meaningful operational sense.

AWS P5 spot for H100 is technically listed but practically

constrained enough that building any training pipeline around

it seems unwise right now.

For anyone doing serious training runs with solid checkpointing,

the savings are real. What interruption rates are people actually

observing across these providers? The advertised numbers and

real world experience seem like they could diverge significantly.

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

If you've trained on RunPod/Vast.ai spot/community-cloud instances: has a job ever died mid-run from preemption? What did restarting cost you ? time, wasted compute spend, or a corrupted checkpoint?

how often do you lose runs to interruption, what does it cost you in time/money?

how often do you lose runs to interruption, what does it cost you in time/money?

how often do you lose runs to interruption, what does it cost you in time/money?

how often do you lose runs to interruption, what does it cost you in time/money?

Hey, I am going to start DSA, I know python, pandas, and a couple of ML algorithms. I don't want to stuck in yt tutorial hell or watching just videos.I can give my 6-12 months just to get good at DSA.

I am open for suggestion.