Every argument about what an AI model costs to train ends the same way: someone quotes a number, and nobody can say where it came from. So we collected only the figures labs have published themselves, in their own papers, model cards and release notes, and recorded for each what it covers and what the lab says it leaves out.
The result is 21 rows from 12 organisations between May 2022 and September 2026, plus two academic fine-tunes kept apart. Six rows give a dollar amount. The rest are GPU-hours, carbon, water or days-times-chips, and they cannot be added together. No dollar figure has been checked by anyone outside the lab. The four labs most people mean when they say “frontier” publish nothing for their frontier models.
The newest row, Xiaomi’s September 22 disclosure of its MiMo-V2.6 reinforcement-learning run, is also the only 2026 figure we found that prices post-training. Our post on that release covers it in full; here it takes its place in the table.
- 01Six rows put a dollar figure on a training run. Five price GPU time at an assumed rental rate; Xiaomi does not say.DeepSeek-V3 ($5.576M), DeepSeek-R1 ($294K), MiniMax-M1 ($534,700), OLMo 3 ($2.75M), BLOOM ($2–5M) and Xiaomi ($850K and $2.62M). None counts staff, and only BLOOM's range includes preliminary experiments.
- 02Every figure excludes something, and the most candid labs say so themselves.Meta puts the true OPT cost at roughly twice the final run. BigScience says the final BLOOM run was 37% of emissions. Ai2 puts development at half of training again.
- 03Post-training is where the interesting numbers are, and there are only four of them.DeepSeek-R1 at $294K on a $5.576M base, MiniMax-M1 at $534,700, NVIDIA's 140K H100-hours, and Xiaomi's $2.62M. All centred on RL, all self-reported.
- 04OpenAI, Anthropic, Google DeepMind and xAI publish no figure for their frontier models.Only OpenAI's GPT-4 report states a reason. Third-party estimates for those models range from $30M to $191M depending on method, and should be cited by estimator.
01 — The findingWhat the labs have published, in four numbers
Lab-published figures
From 12 organisations, 2022 to 2026, each in the lab's own paper, card or release note. Two academic fine-tunes are listed separately.
Carry a dollar amount
Five are priced at a cloud-rental rate, usually $2 per H800 or H100 hour; Xiaomi states no basis. None is presented as a cost of ownership.
Checked by an outside party
Peer review of a paper is not an audit of its cost line. Mistral's life-cycle analysis, reviewed by two external firms, is the nearest thing.
Frontier labs with no figure
OpenAI, Anthropic, Google DeepMind and xAI. Their current model cards and system cards give no compute, hardware-hour or cost line.
02 — The datasetThe census: every self-published training-cost figure we found
One row per disclosure. The figure column keeps the lab’s own unit and, where a phrase is quoted, its own words. The last column says what the figure covers, because that is the part every secondary citation drops.
| Lab | Model · published | Figure as stated | What it covers |
|---|---|---|---|
| Xiaomi | MiMo-V2.6 Flash / Pro · Sep 2026 | “around 850,000 and 2.62 million US dollars” (release note); “$0.9M” and “$2.6M” (technical report) | RL post-training only: under 6 days, 30 steps each. Pre-training tokens stated (48T / 30T) but not priced. |
| DeepSeek | DeepSeek-V3 · Dec 2024 | 2.788M H800 GPU-hours; “$5.576M” at an assumed $2 per GPU-hour rental | The official run: pre-training ($5.328M), context extension ($0.238M), post-training ($0.01M). |
| DeepSeek | DeepSeek-R1 · Sep 2025 (Nature) | 147K H800 GPU-hours; $294K at the same $2 rental assumption | Reasoning RL stages plus SFT-data creation on top of the V3 base, which is not included. |
| DeepSeek | DeepSeek-V2 · May 2024 | 172.8K GPU-hours per trillion tokens (vs 300.6K for DeepSeek 67B) | Pre-training rate only. No total, no dollar figure. |
| MiniMax | MiniMax-M1 · Jun 2025 | “a rental cost of just $534,700”; 512 H800s for three weeks | The RL run only, after 7.5T tokens of continued pre-training and SFT that are not costed. |
| Meta | Llama 2 · Jul 2023 | 3.3M A100-80GB GPU-hours; 539 tCO2eq, offset | Pre-training only. Fine-tuning and evaluation on third-party cloud, not quantified. |
| Meta | Llama 3 · Apr 2024 | 7.7M H100-80GB GPU-hours; 2,290 tCO2eq | Pre-training only. No dollar figure. |
| Meta | Llama 3.1 · Jul 2024 | 39.3M H100-80GB GPU-hours; 11,390 t location-based, 0 t market-based; 405B at 3.8 × 10²⁵ FLOPs | “Training” per the card; the FLOPs figure is 405B pre-training. Up to 16K H100s. |
| Meta | Llama 4 Scout / Maverick · Apr 2025 | 7.38M H100-80GB GPU-hours; 1,999 t location-based | Pre-training only. The Behemoth teacher model is not in the table. |
| Meta | OPT-175B · May 2022 | 75 t CO2eq for the final run; 992 A100s | Final run. Meta’s own footnote: with ablations, baselines and downtime, total is “roughly 2× higher.” |
| Ai2 | OLMo 2 · Dec 2024 | about 154 tCO2eq; about 1.1 million litres of water | Final pre-training energy, measured at the node. Stated as a lower bound. |
| Ai2 | OLMo 3 Think 32B · Dec 2025 | 56 days on 1,024 dedicated H100s; “At a price of $2/H100 hour, this would cost $2.75M” | Wall-clock for the whole pipeline: pre-, mid-, long-context and post-training. Research detours excluded. |
| Ai2 (Morrison et al.) | OLMo development series · Mar 2025 | 493 t CO2 and 2.769 million litres of water | Development, hardware manufacturing and final runs together. Development alone was about half of training. |
| BigScience / Hugging Face | BLOOM-176B · Nov 2022 | 1,082,990 compute hours; 433 MWh; 25 t CO2eq; card: “Equivalent of $2-5M in cloud computing (including preliminary experiments)” | The dollar range includes preliminary experiments. The final run was about 37% of overall emissions. |
| TII | Falcon-180B · Nov 2023 | 43,500 PF-days on up to 4,096 A100s; 3.5T tokens | Pre-training compute in PF-days. No hours, dollars or energy. |
| Google DeepMind | Gemma 2B / 7B · Mar 2024 | about 131 tCO2eq on TPUv5e | Pre-training, scaled to include data-centre overhead. No dollars or hours. |
| Google DeepMind | Gemma 2 · Jul 2024 | 1,247.61 tCO2eq | Pre-training, same method. Gemma 3 (2025) gives chip counts only. |
| Hugging Face | SmolLM3-3B · Jul 2025 | 384 H100s for 24 days (about 221K GPU-hours, our arithmetic) | Pre-training run. Ablations on the recipe not quantified. |
| Microsoft | Phi-4 · Dec 2024 | 1,920 H100-80G for 21 days on 9.8T tokens (about 968K GPU-hours, our arithmetic) | Training run; the card does not split stages. No dollars or energy. |
| NVIDIA | Llama-3.1-Nemotron-Ultra-253B · May 2025 | “approximately 140k H100 hours” for the reasoning-RL stage | Reasoning RL only. The Llama 3.1 parent, pruning, distillation and SFT are outside the figure. |
| Mistral AI | Mistral Large 2 · Jul 2025 | 20.4 ktCO2e, 281,000 m³ of water and 660 kg Sb eq after 18 months of use | A full life-cycle analysis: training plus 18 months of inference and hardware manufacturing. Not training-only. |
| Academic: Stanford et al. | s1-32B · Jan 2025 | “Finetuning took 26 minutes on 16 NVIDIA H100 GPUs” | SFT of Qwen2.5-32B on 1K examples. The widely quoted “$50” is not in the paper. |
| Academic: NovaSky, UC Berkeley | Sky-T1-32B-Preview · Jan 2025 | “trained for less than $450”; 19 hours on 8 H100s at Lambda rental | The SFT run only. Data generation and the Qwen2.5 base are not costed. |
Seven more model reports give hardware or relative compute but no absolute cost, hours or energy figure, and are not counted above: NVIDIA’s Nemotron-4 (768 DGX H100 nodes), Apple’s AFM-server (8,192 TPUv4 chips), Gemma 3 (chip counts per model), Kimi K2 (an H800 cluster), Kimi K3 (relative RL-compute plots only), Qwen3 (a relative one-tenth claim for distillation) and GLM-4.5 (nothing found).
03 — The unitsWhy the figures cannot be added up
The table has four families of unit, and a reader who wants one ranking has to convert between them with assumptions the labs did not make. We have not converted anything except chips times days, and we have not ranked the rows.
Rental dollars
DeepSeek and Ai2 assume $2 per H800 or H100 hour, MiniMax and NovaSky use rental prices, and BigScience gives a cloud-equivalent range. Xiaomi does not state its basis. A different rate moves every one of these numbers.
GPU-hours or PF-days
Meta's four Llama cards, DeepSeek-V2, NVIDIA and TII. Convertible to dollars only with a rental assumption the lab did not endorse, and only within one chip generation.
Carbon, energy, water
Ai2, Google DeepMind, Mistral and Meta's OPT. Depends on grid mix, offsets and whether manufacturing is included. Meta reports 0 t market-based beside 11,390 t location-based.
Chips times days
Microsoft, Hugging Face and the academic rows. Honest about time, silent about utilisation. Ai2 chose this unit for OLMo 3 deliberately, then priced it.
04 — The exclusionsThe five things a disclosed cost almost always leaves out
The labs are more candid about this than their quoters. Read the exclusions in their own words first; the pattern follows.
| Who | What the lab says is outside the figure |
|---|---|
| DeepSeek, V3 paper | The costs “include only the official training of DeepSeek-V3, excluding the costs associated with prior research and ablation experiments on architectures, algorithms, or data.” |
| Meta, OPT paper | “With ablations, baselines and downtime, our own estimates of total cost is roughly 2× higher.” |
| BigScience, BLOOM paper | The final training run was about 37% of overall emissions; intermediate runs and evaluation made up the other 63%. |
| Ai2, Morrison et al. | Model development, which most developers do not disclose, amounted to about half of the final training’s impact. |
| Xiaomi, MiMo-V2.6 release note | “Behind these 6 days lie half a year of foundational research accumulation and engineering trial and error.” |
| Ai2, OLMo 3 paper | The 56-day window “does not include any substantial modifications or research ideas that could expand the timeline substantially.” The recipe was developed at 7B or smaller. |
| Meta, Llama 2 and 3 cards | Emissions are reported for pre-training; fine-tuning, annotation and evaluation ran on third-party cloud compute and are not quantified. |
| Ai2, OLMo 2 paper | The estimate excludes embodied emissions, deployment and inference, so it “should be viewed as lower bounds.” |
- The research before the run. Ablations, baselines and abandoned experiments. Meta’s OPT footnote doubles the total; BigScience’s share puts the final run at just over a third; Ai2 measured development at half of training again.
- The base model under a post-training figure. DeepSeek-R1’s $294K sits on DeepSeek-V3’s $5.576M. MiniMax-M1’s $534,700 follows 7.5 trillion tokens of continued pre-training. Xiaomi’s RL cost sits on 30 to 48 trillion tokens of pre-training it did not price.
- People, capital and data. Five of the six dollar rows are rental-priced GPU time, and Xiaomi does not say how it priced its run. Epoch AI’s estimate for GPT-4 puts the hardware at about $800 million to acquire against $40 million amortised for the run; staff at tens of millions. No lab row says it includes any of the three.
- Post-training, evaluation and fine-tuning. The Llama cards cover pre-training. Ai2 notes that repeated checkpoint evaluations and post-training consume a non-trivial share that pre-training hours alone do not capture.
- Inference and hardware life cycle. Only Mistral’s row includes use after training and the emissions of making the chips, and it is a different kind of number: 18 months of a deployed model, not a training run.
Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.OpenAI, GPT-4 Technical Report, March 2023
05 — The shiftPost-training is the number now, and there are four of them
Pre-training compute is the figure labs used to disclose, when they disclosed anything. The rows that matter for a 2026 buyer are the ones that price the reinforcement-learning phase, because that is where this year’s agent capability was added. There are four.
- DeepSeek-R1: $294K, or 147K H800 GPU-hours, published with the Nature paper in September 2025. That is about 5% of the $5.576M DeepSeek stated for the V3 base, our arithmetic on two figures priced at the same $2 rate. Epoch AI had estimated the RL cost at around $1 million eight months earlier.
- MiniMax-M1: $534,700 for three weeks on 512 H800s, June 2025. RL only.
- NVIDIA Nemotron Ultra 253B: about 140K H100 hours for the reasoning-RL stage, May 2025. No dollar figure.
- Xiaomi MiMo-V2.6: about $850K for Flash and $2.62M for Pro, six days, 30 steps, September 2026. Xiaomi ties the spend to a result: on its own harness, DeepSWE v1.1 moved from 48.8 to 65.7 for Flash and from 58.4 to 72.6 for Pro over those 30 steps.
Xiaomi’s report plots its benchmark score against cumulative dollars spent, which is why it is a more useful disclosure than the others even though it is the least specified on hardware. It is also the largest, and Xiaomi’s report says the run used thousands of GPUs. Kimi K3’s August 2026 report shows RL compute only as a relative plot, so the comparison a reader wants most, Xiaomi against Moonshot, is not possible from primaries. Our post on RL as the new moat covers why labs now guard this number.
06 — The silenceWho publishes nothing, and the estimates that fill the gap
| Lab | Document checked | What it says |
|---|---|---|
| OpenAI | GPT-4 Technical Report, Mar 2023 | An explicit decline: the report “contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.” |
| OpenAI | GPT-5 System Card, Aug 2025 | No training compute, hardware or cost figure. Mentions of compute refer to test-time compute. |
| Anthropic | Claude Fable 5.1 and Mythos 5.1 System Card, Sep 2026 | Describes the data mix and post-training. No compute, hardware, energy or cost figure. |
| Google DeepMind | Gemini 3 Pro Model Card (updated May 2026) | Hardware family only: trained on TPUs. No compute, energy or cost figure. Gemma is the exception, above. |
| xAI | Grok 4 Model Card, Aug 2025 | No training compute, hardware or cost figure. |
Where labs are silent, two estimators are quoted most. They disagree with each other by about 2× on GPT-4 and about 6× on Gemini Ultra, because they use different methods, and a citation should say which.
- Epoch AI (Cottier et al., May 2024, revised February 2025) amortises hardware plus energy for the final run: GPT-4 about $40 million, Gemini Ultra about $30 million. The same paper puts GPT-4’s hardware at about $800 million to acquire and says frontier run costs have grown at 2.4× a year since 2016.
- Stanford AI Index (2024 and 2025, using Epoch data at cloud-rental prices) gives GPT-4 about $78 to $79 million, Gemini Ultra $191 million and Llama 3.1-405B about $170 million. Meta’s own card for that model gives 39.3M GPU-hours and no dollar figure. The 2025 report adds that labs are disclosing less about their training processes, which makes the estimates harder.
Two numbers in wide circulation are not lab figures. The “$6 million DeepSeek model” rounds $5.576M and drops DeepSeek’s own exclusion of prior research; our post on DeepSeek’s first funding round covers the round it was reported to be raising. The “$50 reasoning model” for s1 does not appear in the s1 paper, which states 26 minutes on 16 H100s and nothing in dollars.
07 — The checklistHow to read the next one
Which phase (pre-training, mid-training, RL, SFT)? Which unit, and at what rental rate if dollars? Which chips, how many, for how long? What does the lab itself say is excluded? Is there a base model under it? Has anyone outside the lab checked it? If the source cannot answer the first four, it is an estimate, and it should be cited by the estimator’s name.
08 — MethodologyHow this census was built
Primary-source census. Every row is a figure the organisation published itself; third-party estimates are separated and labelled.
- What qualifies
- A figure the lab or organisation published itself, in a paper, technical report, model card, official blog or release note, about the compute, energy or money cost of training a named model. Press reports, leaks and analyst estimates do not qualify for the main table.
- Sources
- arXiv abstracts and PDFs, the Nature supplementary PDF for DeepSeek-R1, GitHub and Hugging Face model cards, lab blogs and release notes, and Xiaomi’s technical report PDF. Quoted phrases are verbatim from the current version of each document.
- As-of date
- Every row was re-read at its primary URL on September 25, 2026. OLMo 2 and OLMo 3 have revised arXiv versions (October 2025 and April 2026); quotes were checked against the current version. The Sky-T1 page shows an update dated March 14, 2026.
- Units and arithmetic
- Each row keeps the lab’s own unit. The only conversions we made are chips multiplied by stated days, marked “our arithmetic,” and one ratio between two DeepSeek figures priced at the same stated rate. We did not rank rows across units.
- Independent check
- Means a named outside party reproduced, audited or reviewed the cost figure itself. Peer review of a paper does not count. No row meets the bar; Mistral’s externally reviewed life-cycle analysis is noted as the nearest.
- Not found
- No absolute cost, hours or energy figure for Kimi K2, Kimi K3, Qwen3, GLM-4.5, DeepSeek-V4, Nemotron-4 or Apple’s AFM. Those are listed as hardware-only or omitted, not estimated.
- Refresh
- Maintained by the Digital Applied Team and updated in place at this URL when a lab publishes a new figure. Rows added later will carry their own read date.
09 — ConclusionThe disclosed number is always the floor
Cite the lab’s figure with its scope attached, and treat any bare dollar number as an estimate until you find the paper
Twenty-one rows is the whole public record, and it is thinner than the argument it gets used in. What the rows do show is consistent: the final run is a fraction of the spend, post-training is now a cost line of its own, and the labs with the most compute say the least. For the price of running these models rather than training them, our frontier model price index is updated monthly, our post on what $200 a month of AI buys covers the small end, and our AI transformation team can help you size a fine-tune of your own.