GPU marketplace
Vast.ai
A marketplace of host-offered GPUs with competitive spot-style pricing for interruptible or carefully filtered capacity.
Some outbound links use a first-party redirect hop for click counting. Commission is only claimed when a partner programme is active for that specific link — most vendor hops here are not paid placements. Affiliate disclosure.
Marketplace referrals (for example RunPod or Vast) may return credits or kickbacks when a programme is active — that is a material connection even when it is not a cash CPA.
Best for
Cost-sensitive batch jobs and experiments that can tolerate host variability
Watch out
Host quality and availability vary — filter carefully for production inference. Interruptible/community instances are cheaper but can be reclaimed; stop ≠ terminate (disk can still bill).
| Billing | Marketplace hourly bids |
|---|---|
| GPU choice | Wide, host-dependent inventory |
| Cold start | Instance provisioning + your stack |
| Model access | Self-managed models on rented machines |
Fit detail
When Vast.ai is the right shortlist — and when it is not
Use these lists to kill bad comparisons early, before you compare logos.
Ideal for
- Price-hunting batch jobs and research sweeps
- Interruptible training or offline inference
- Teams willing to filter hosts carefully
Usually not ideal for
- Latency-critical user-facing chat without redundancy
- Compliance workloads that need a single accountable cloud
- Engineers who refuse to babysit host quality
Spend & ops
How cost behaves — and what breaks first
No invented $/hour quotes. These notes explain the failure modes that show up on the first real invoice.
Cost mental model
Marketplace bids can undercut reserved clouds, but host variance and interruptions are part of the price. Budget engineering time, not just GPU hours.
Ops notes
- Filter by reliability, verified hosts, and disk before you bookmark a cheap bid
- Assume interruption risk on the cheapest inventory
- Bake your image — surprise host images waste the savings
Fit scores
Vast.ai on the decision axes
Same editorial scale as the hub chart — useful for shortlists, not as a price quote.
- GPU choice9/10
- Time-to-serving (editorial)5/10
- Price clarity7/10
- Production ops4/10
- Open-model breadth7/10
Among all providers
GPU choice
Pick exact GPUs
Time-to-serving (editorial)
Warm-path fit
Price clarity
Easy to forecast
Production ops
Less DIY ops
Open-model breadth
Catalog depth
Scores are editorial planning ratings (1–10) for product shape — not published $/hour quotes or vendor SLAs. Verify current pricing on each provider site.
Compare
Vast.ai vs alternatives
Open a head-to-head when you are deciding between product shapes.
Related
Keep the decision attached to the rest of the stack
Cloud rental is one path. Local VRAM and open-weight fit still matter.