Skip to main content
PromptQuorumBuilt for humans. Structured for AI.
Home/Power Local LLM
Overview & Reference

Vast.ai Review (2026): Marketplace Prices vs Reliability

·9 min readBy · Founder of PromptQuorum · Discovery engine for open-weight & open-source AI

Vast.ai is a per-second GPU rental marketplace where price depends on the host you pick; it suits cost-sensitive, interruption-tolerant work. Vast.ai positions its Secure Cloud tier for regulated and enterprise needs; check the Data Processing Agreement and certifications yourself before relying on it. Vast.ai states "No minimum hours, no rounding up" and lists on-demand, interruptible ("50%+ cheaper") and reserved ("Up to 50% Off") pricing (checked 2026-11-22). PromptQuorum assessment: 7.6/10 overall, not a hands-on lab test. The catch is variance: verified hosts are tested, but Vast.ai's docs note that "Individual hosts may have less formal security measures", so do not put regulated data on a non-Secure-Cloud host. → Check Vast.ai GPU pricing

Key Takeaways

  • Vast.ai is a GPU marketplace billed per second; it states "No minimum hours, no rounding up" (checked 2026-11-22)
  • Three pricing types: on-demand (guaranteed), interruptible (may be paused, "50%+ cheaper" per Vast.ai), reserved (pre-paid, up to 50% off)
  • Two trust tiers: Secure Cloud (vetted datacenters) and verified hosts (manually tested, for non-regulated workloads)
  • Vast.ai states it has completed SOC 2 Type 2 certification; the report is available under NDA
  • Storage is billed even when an instance is stopped; delete the instance to end storage charges
  • Spent credits are not refundable per Vast.ai's billing docs; unspent credits usually are, via support chat
  • Per-GPU hourly prices are live marketplace values and were not verified in this review

Vast.ai is a GPU marketplace: independent hosts and vetted datacenters list machines, and you rent them by the second. This review is one entry in our overview of the best cloud GPU providers, and it covers how the marketplace works, what Vast.ai itself documents about pricing, host tiers and data handling, and where the trade-off sits between low marketplace prices and uneven host quality. Every price and security statement below comes from Vast.ai's own pages (checked 2026-11-22); where a figure could not be verified, the page says so.

This page contains links to third-party products for reference. PromptQuorum is not enrolled in any affiliate program — these are plain links that earn no commission. Clicking links and your next steps are entirely your own responsibility. Any recommendation on this page reflects our own reading of the vendors' public pages, not a vendor endorsement or a test.

Vast.ai Review (2026): Marketplace Prices vs Reliability

Vast.ai Scorecard

PromptQuorum assessment based on Vast.ai's own documentation and public statements. This is not a hands-on lab test, and no uptime or speed was measured. Scores reflect fit for renting GPUs to run local-style open-weight models.

Price

Score:
9/10
Why:
Marketplace plus interruptible tier targets the low end

Reliability

Score:
6/10
Why:
Varies by host; interruptible instances may be paused

Ease of setup

Score:
7/10
Why:
Docker, SSH and a host search; more steps than a managed pod

GPU choice

Score:
9.5/10
Why:
68+ GPU types, RTX 3060 to B200, per Vast.ai

Support / docs

Score:
7.5/10
Why:
Detailed docs; billing and security FAQ pages exist

Data trust

Score:
6.5/10
Why:
SOC 2 Type 2 claim; hosts differ by tier

Overall

Score:
7.6/10
Why:
Low marketplace prices and wide GPU choice; weaker on uniformity

PromptQuorum assessment, derived from official Vast.ai pages (see "How We Evaluate"). Not the result of PromptQuorum running workloads on Vast.ai.

Verdict: Who Should Rent Here

Rent on Vast.ai when price and GPU choice matter more than uniformity, and when an interruption or a slower host costs you little. It fits fine-tuning with checkpoints, batch jobs, benchmarking and trying a model before buying a card. If you are weighing renting against owning, the local LLM cost calculator gives a break-even view.

Do not treat a cheap marketplace host as a private environment. Vast.ai's own security FAQ says individual hosts may have less formal security measures. For sensitive data, filter for Secure Cloud or choose a provider with a single operator.

For a side-by-side with a managed alternative, read the RunPod review and the RunPod vs Vast.ai pricing comparison.

Check Vast.ai GPU pricing →product link · disclosed

How the Marketplace Works

Vast.ai lists GPU machines from many providers; you search offers, pick one and launch a Docker container on it. Hosts differ in hardware, location, bandwidth price and trust tier, so the search filters matter more than on a single-operator cloud.

  • Offers: you filter by GPU model, VRAM, price, reliability and location (the Vast.ai CLI page describes these filters).
  • Instance types: on-demand is "fixed pricing, guaranteed resources (high priority)"; interruptible is "lowest cost, may be paused (low priority)"; reserved is "discounted rates with pre-payment" (Vast.ai pricing docs).
  • Host tiers: Secure Cloud draws on vetted datacenters; verified hosts are "manually tested for reliability and performance" with Docker-level tenant isolation (Vast.ai compliance page).
  • Runtime: each workload runs in an unprivileged Docker container, isolated from other tenants, per Vast.ai.
  • Access: SSH, Jupyter and an API/CLI are the documented ways in.

Pricing and Billing

Billing is per second for actual usage, and credits must be added before any instance starts. Checked 2026-11-22. Per-GPU hourly rates are live marketplace values that change by host and were not verified in this review, so no per-GPU number is quoted.

  • The $0.14/hr and $0.50/hr figures are Vast.ai's advertised "from" floors on its CLI page (checked 2026-11-22), not the price of a specific GPU.
  • Sources: Vast.ai pricing, instance pricing docs, billing docs.
  • Payment methods in the billing docs: major credit cards through Stripe, and crypto through BitPay and Crypto.com. Autobilling works with a saved card only.
  • When the balance reaches zero, instances stop; with a saved card the balance is charged, without one instances and data are destroyed.
  • For current per-GPU rates, see our cloud GPU cost per hour page and the live Vast.ai search.

Billing unit

What Vast.ai states:
Per second; "No minimum hours, no rounding up"

On-demand

What Vast.ai states:
Fixed pricing, guaranteed resources

Interruptible

What Vast.ai states:
"50%+ cheaper" than on-demand; may be paused

Reserved

What Vast.ai states:
Up to 50% off; 1, 3 or 6 month terms

Advertised floor

What Vast.ai states:
From $0.14/hr spot and $0.50/hr on-demand (CLI page)

Storage

What Vast.ai states:
Billed while the instance exists, even if stopped

Bandwidth

What Vast.ai states:
Varies by host; upload and download, per byte

Minimum deposit

What Vast.ai states:
Not stated in the docs reviewed

Which Open-Weight Models Fit

Pick the GPU by VRAM first. The figures below are Q4_K_M VRAM estimates from our DeepSeek-R1 distill VRAM cheatsheet; see how much VRAM a local LLM needs for the method. They are not Vast.ai measurements, and no tokens-per-second figure is claimed.

  • Serving models in a Docker image works with Ollama or vLLM, both of which run in a container.
  • Availability of a given GPU on the marketplace changes by hour; confirm the offer and its VRAM before launching.

7B

VRAM needed:
~5.5 GB
Typical card class:
12 GB card

14B

VRAM needed:
~9.5 GB
Typical card class:
16 GB card

32B

VRAM needed:
~20.5 GB
Typical card class:
24 GB card (tight)

70B

VRAM needed:
~44 GB
Typical card class:
48 GB or multi-GPU

Use Cases

Best fits are workloads where cost matters and an interruption is cheap.

  • Good fit: fine-tuning with regular checkpoints, batch inference, benchmarking a model before buying hardware, image or video generation experiments.
  • Conditional fit: a 70B-class model that needs a multi-GPU offer; check the offer lists the GPU count you need.
  • Poor fit: confidential or regulated data on non-Secure-Cloud hosts, and always-on production endpoints without redundancy.
  • Deciding between renting and buying a card: see RTX 3090: buy or rent and the cheapest way to run a 70B model.

Risk and Trust

Vast.ai is a marketplace, so the party running the hardware depends on the offer you choose. Statements below are from Vast.ai's own pages, checked 2026-11-22.

  • Host security varies: the security FAQ says "Individual hosts may have less formal security measures" and advises encrypting sensitive data and not storing credentials in instances.
  • Docs do not say whether a host can read your data: they state clients only access their own data and are container-isolated, but do not address host access, so treat non-Secure-Cloud hosts as untrusted.
  • Partner certification wording differs between pages: the compliance page says ISO 27001 or SOC 2 are encouraged but not required for Secure Cloud partners, while the security FAQ lists ISO 27001 for Secure Cloud providers. Verify the current requirement before relying on either.
  • Billing: compute is billed by the second, storage continues while stopped, and a negative balance without a saved card leads to destroyed instances and data. Source: billing docs.
  • Vast.ai's SOC 2 Type 2 statement concerns the company's controls, not a guarantee about any individual host. This is not legal or compliance advice.

Hardware source

What Vast.ai states:
Independent hosts and vetted datacenters (Secure Cloud)

Secure Cloud

What Vast.ai states:
For regulated and enterprise needs; partners sign DPAs

Verified hosts

What Vast.ai states:
Manually tested; Docker isolation; non-regulated work

SOC 2

What Vast.ai states:
"Completed SOC 2 Type 2 certification"; report under NDA

Data deletion

What Vast.ai states:
Destroyed immediately when you delete an instance

Transit encryption

What Vast.ai states:
TLS 1.2+ for API and console traffic

Refunds

What Vast.ai states:
Spent credits: none. Unspent: usually, via chat

Pros & Cons

Low-price flexibility on one side, host variance on the other.

  • Pros
  • Per-second billing with no rounding up
  • Interruptible pricing described as 50%+ cheaper than on-demand
  • 68+ GPU types, from RTX 3060 to B200
  • Secure Cloud tier positioned for sensitive workloads
  • Stated SOC 2 Type 2 certification
  • Cons
  • Quality and security vary by host
  • Interruptible instances can be paused
  • Storage is charged while an instance is stopped
  • Spent credits are not refundable
  • Per-GPU prices change constantly; budgeting needs a live check

Where to Sign Up

Create an account, add credits, then filter offers before launching.

  1. 1
    Create an account on the Vast.ai site and add credits (required before any instance starts)
  2. 2
    Search offers by GPU model, VRAM, reliability and price; enable the Secure Cloud filter if the data is sensitive
  3. 3
    Choose on-demand for guaranteed resources or interruptible for the lowest cost
  4. 4
    Launch a Docker image (Ollama or vLLM) and connect over SSH
  5. 5
    Delete the instance when done to stop storage charges
Check Vast.ai GPU pricing →product link · disclosedOpen Vast.ai →product link · disclosed

Alternatives to Consider

If marketplace variance is the issue, a single-operator cloud is the usual step.

  • Managed pods with a Secure/Community split: RunPod review.
  • Another community GPU marketplace: Clore.ai review, which is crypto-denominated.
  • Owning hardware: compare against buying with the cost calculator before committing to a rental.
  • Larger providers such as Lambda and CoreWeave are single-operator clouds; this review did not verify their prices.

How We Evaluate

This review has not been hands-on tested by PromptQuorum. It is built from Vast.ai's own pages, fetched 2026-11-22.

  • Provider-stated: billing unit, instance types, host tiers, SOC 2 statement, refund and storage rules, from vast.ai and docs.vast.ai.
  • Not verified: per-GPU hourly prices, minimum deposit, uptime and speed.
  • PromptQuorum assessment: the scorecard, buy/skip guidance and model-fit notes, which are editorial judgment, not measurements.

Frequently Asked Questions

What is Vast.ai?

Vast.ai is a GPU rental marketplace where independent hosts and vetted datacenters list machines, billed per second. It offers on-demand, interruptible and reserved pricing, according to its pricing page.

How does Vast.ai billing work?

Compute is billed by the second for actual usage and credits must be added before starting any instance. Storage is billed while the instance exists, even when stopped (checked 2026-11-22).

What is the difference between on-demand and interruptible?

On-demand has fixed pricing and guaranteed resources. Interruptible is the lowest cost and may be paused; Vast.ai describes it as often 50%+ cheaper than on-demand.

What are reserved instances?

Reserved instances are discounted with pre-payment; Vast.ai lists up to 50% off and 1, 3 or 6 month terms on its pricing page.

Is Vast.ai secure?

Vast.ai states it has completed SOC 2 Type 2 certification, and each workload runs in an unprivileged Docker container. Its own docs also say individual hosts may have less formal security measures. Vast.ai positions Secure Cloud for sensitive data; confirm its DPA and certifications for your case.

What is the Secure Cloud tier?

Secure Cloud is a tier of vetted datacenter partners aimed at regulated and enterprise needs. Partners sign Data Processing Agreements with Vast.ai, per its compliance page.

What are verified hosts?

Verified hosts are manually tested for reliability and performance and use Docker-level tenant isolation. Vast.ai positions them for non-regulated workloads.

Can I get a refund on Vast.ai?

Per the billing docs, spent credits are not refundable, while unspent credits can usually be refunded by contacting support through the website chat. Legacy Coinbase Commerce credits cannot be refunded.

What happens if my balance runs out?

Instances stop automatically when the balance reaches zero. With a saved card the balance is charged to cover it; without a saved card instances and stored data are destroyed.

Is there a minimum deposit?

The billing and pricing docs reviewed do not state a minimum amount. They only say credits must be added before starting any instance.

Which payment methods does Vast.ai accept?

The billing docs list major credit cards through Stripe, and crypto through BitPay and Crypto.com. Autobilling is credit card only.

Can I run a 70B model on Vast.ai?

A 70B model at Q4_K_M needs roughly 44 GB of VRAM per our cheatsheet, so you need a 48 GB card or a multi-GPU offer. Check the offer's GPU count and VRAM before launching.

← Back to Power Local LLM

MCP