AI DevelopmentFramework8 min readPublished September 16, 2026

Paper plus code in · tested tools out · 74 of 100 converted

Paper2Agent in Nature: Research Papers Become Working Tools

A Stanford method published in Nature turns a paper and its code into tested tools an AI agent can call. The reported results, and the pattern for business.

DA
Digital Applied Team
Research and practical guidance
Editorial dateSeptember 16, 2026
SourceNature · Miao, Davis, Zhang, Pritchard, Zou

A method published in Nature on September 16, 2026 takes a research paper and its code repository and produces a set of tested tools that an AI agent can run on request. The Stanford authors call it Paper2Agent. Instead of cloning a repository and fighting its dependencies, a user asks the agent in plain language to apply the paper's method to a new dataset.

This post is for technical founders, analysts and research leads who depend on methods that arrive as a paper plus code, and for builders who want the pattern for any codebase. It draws on the Nature article by Jiacheng Miao, Joe R. Davis, Yaohui Zhang, Jonathan Pritchard and James Zou, received by the journal on October 13, 2025 and accepted August 14, 2026. An arXiv preprint dates from 2025. All figures below are the authors' own.

Key takeaways
  1. 01
    The output is an MCP server, not a chatbot.Each paper becomes a server of tools, resources and workflow prompts that any compatible agent can connect to.
  2. 02
    Tools are tested against the paper's own outputs.A tool ships only if it reproduces the reference results within tolerance. Tools that keep failing are dropped.
  3. 03
    About three in four papers converted.Of 100 computational biology papers, 74 were converted end to end without manual help, producing 593 validated tools.
  4. 04
    Wrapped tools beat reading the raw repository.On 300 benchmark questions the authors report 91.2% accuracy, against 80.3% for a coding agent given the repository directly, using the same model.

01ContextThe problem it solves

A paper describing a computational method is, in the authors' word, passive. To use it you find the repository, install dependencies, set up the environment and work out what inputs the code expects. Their example is AlphaGenome, a model that predicts the effects of DNA variants. Using it in code means installing an environment, creating API clients, building input objects and learning the parameter hierarchy, which is a real barrier for a biologist who only wants the answer.

Paper2Agent's answer is to package the method behind the Model Context Protocol, or MCP, the standard interface through which AI agents call external tools. Once a paper is an MCP server, the request becomes a sentence. The article's example is "Apply the method in this paper to the newly generated dataset".

02MechanismThe pipeline, step by step

The system is itself a group of agents, built on Claude Code. The authors state they used Claude Sonnet 4 for all applications in the paper, so nothing here says which model works best. The steps:

  1. Find the code. Identify the repository that belongs to the paper.
  2. Build the environment. An environment agent installs what the code needs so it actually runs.
  3. Extract tools. An extraction agent turns the paper's core methods, usually shown in its tutorials, into callable functions with documented parameters.
  4. Test against known outputs. A testing agent runs each tool on the paper's example data and compares the result with the reference. A test passes when expected files appear, numbers fall within tolerance and figures match. Code and environment are revised until it does, and tools that keep failing are excluded.
  5. Package and host. Validated tools and their environment become one MCP server, which can be hosted remotely. The authors name Hugging Face Spaces as an example host.

The server carries three kinds of content, which map onto standard MCP concepts.

Tools
Executable functions
What the agent can run

Each tool wraps one of the paper's methods with a pre-configured environment and a link back to the original source code.

Validated, then locked
Resources
Static material
What the agent can read

The manuscript text, the codebase, and supplementary datasets, tables and figures in standard formats.

Works without runnable code
Prompts
Workflow instructions
The order to run things in

Short templates that encode a multi-step analysis so tools run in the right sequence. The authors say these are inferred from the paper and code.

No manual curation

The locking step is the part to notice. Once a tool passes, its code is fixed. The agent calls it and does not rewrite it on each request. The authors present this as the defence against what they call "code hallucination", where an agent writes plausible new code that quietly computes the wrong thing.

03FiguresReported results

Every number in this table is from the Nature article and was produced by its authors. Accuracy figures are printed as the article gives them, a mean plus or minus its error. The AlphaGenome benchmark used five runs graded by two human experts against set rubrics. "Claude + Repo" is the authors' baseline: Claude Code given a local copy of the repository.

Source: Miao et al., Nature, published September 16, 2026. Author-reported; no independent replication at publication.
TestPaper2AgentBaselineNote
AlphaGenome build22 tools, ~45 min, US$14All 22 passed validation, on a personal laptop, without human intervention
Scanpy build7 tools, ~45 min, US$13Covers preprocessing and clustering of single-cell data
AlphaGenome, 15 tutorial queries98.7 ± 1.3%82.7 ± 3.4%Baseline is Claude + Repo
AlphaGenome, 15 novel queries100.0 ± 0.0%78.7 ± 4.4%Baseline is Claude + Repo
AlphaGenome, 30 open-ended queries82.7 ± 2.4%56.7 ± 2.3%Multi-step questions needing several tools
100 computational biology papers74 converted599 tools proposed, 593 passed validation; no manual cleanup
300 tutorial-derived questions91.2 ± 1.6%80.3 ± 2.3%Both on Sonnet 4; the baseline on Sonnet 4.6 scored 86.3 ± 1.1%
Cost and time per queryUS$0.20, 1.6 minUS$0.38, 4.3 minBaseline is Sonnet 4 with the paper and repository
10 non-biology papers, 42 tasks98.1 ± 0.8%AI, statistics, econometrics, game theory, astrophysics

Two details stand out. The wrapped tools on an older model beat the raw-repository approach on a newer one, 91.2% against 86.3%. That suggests, in this test, that preparing the code helped more than upgrading the model. And for the Scanpy case the authors report that the agent's output on four public datasets matched what human researchers produced on the same data: the same cell and gene counts after quality control and equivalent top marker genes.

For 26 papers that were about data or findings, with no method to run, only the resource layer was built. The authors report 89.0% accuracy on 100 synthesis questions against 82.0% for a browser-based baseline, at 34 times lower cost. We make no claim about the scientific findings in any case study.

04ApplicationThe same pattern for business code

Nothing in the pipeline is specific to science. Most companies have a version of the same problem: an analysis repository one person understands. A pricing model, a churn score, a forecasting notebook, a data-cleaning script with a README from 2023. The knowledge is in the code, and using it means finding its author.

The Paper2Agent recipe carries over if the repository has what the papers had: a worked example with known outputs. That example is the test. Wrap each function as a tool, run it on the example, compare with the saved result, and only expose tools that match. An analyst can then ask an agent to run the churn model on this month's export without opening the code.

Why the tests are the product

An agent that reads your repository and writes fresh code each time will be right most of the time, and you will not know which time. A tool validated against a known answer and then locked gives the same result on every call. In the paper's 300-question test that difference was about 11 points of accuracy on the same model. For a number that goes into a board pack, the fixed tool is the one to trust.

If you want to build one by hand first, our tutorial on building an MCP server in TypeScript covers the server side. For judging how strong a paper's evidence is before you wrap its method, see the reference on types of proof in AI research. The project's GitHub repository packages the method as a skill for coding agents, and its README names Claude Code and Codex as supported.

05CaveatsLimits the authors state

Twenty-six of the 100 biology papers could not be converted. The article lists the causes: missing executable code, missing data or model files, environment and dependency failures, and scripts too specific to generalise. The authors suggest that how easily a paper converts may itself be a practical measure of its reproducibility. The same is true of a company repository.

They add four cautions that apply outside science too:

  • Open-ended reasoning stays with people. The agent can run analyses at scale, and researchers remain responsible for choosing directions and judging evidence.
  • On open-ended questions a benchmark that scores agreement with one reference answer measures faithful execution, not whether the analysis is valid.
  • Wrapped tools need maintenance as the underlying code and dependencies change.
  • Exposing code as callable tools raises security, intellectual property and attribution questions.

The last point matters more for a business than for a lab. A tool server that can run your pricing model is a system to put behind authentication and access control. Our AI transformation practice builds internal tool servers with those controls in place.

06Next stepTested tools beat clever reading

Put it into practice

Pick one internal repository and save its known-good output

Choose the analysis script your team is most afraid to touch. Run it on a fixed input and save the result as the reference. That file is the asset: it lets you, or an agent, wrap the code as tools and prove they still give the right answer. If you cannot produce a reference output, you have learned that the script is not reproducible, which is worth knowing before an agent gets near it.

Digital Applied

Turn the code only one person understands into tools everyone can use.

We wrap internal analysis code as tested, access-controlled tools that an AI agent can run on request, with reference outputs that prove they still work.

Reference-output testsMCP tool serversAccess control
Your next project

Start with one repository and one test

  • Save a known-good output
  • Wrap functions as tools that must match it
  • Host behind authentication
Questions and answers

Applying this post

The idea was first posted as an arXiv preprint in 2025, and Nature lists the manuscript as received on October 13, 2025. The peer-reviewed article was accepted on August 14, 2026 and published on September 16, 2026. The large-scale evaluation figures in this post are from the published article.
Digital Applied newsletter

Deep dives on AI, marketing and development.

Practical guides and fresh insights by email. No recycled takes.

Related dispatches

Continue reading

AI Development

AI Agents Left a Public Trail: Logs to Keep for Next Time

SentinelLABS matched public Hugging Face commits to OpenAI's May agent incident, to the second. What the report shows, and the logs a platform should keep.

September 16, 2026 · 8 minRead
AI Development

Claude Chat and Cowork Are Now One App: What Teams Should Do

Anthropic merged Claude chat and Cowork on September 16 and added Docs and Slides in beta. The rollout by plan, and the one approval setting to decide.

September 16, 2026 · 6 minRead
AI Development

Eight Worlds of AI Agents Faced Three Attacks: None Passed

Emergence AI ran eight worlds of ten agents for up to 21 days, then staged three attacks. No world passed all three. The scores, and three fixes for builders.

September 16, 2026 · 8 minRead
AI Development

OpenAI Listed Six Cases of Its AI Misbehaving: What to Check

OpenAI's new disclosure framework shipped with six dated reports of models hiding mistakes, using a found API key and uploading files. Four checks to run.

September 16, 2026 · 8 minRead
AI Development

TabPFN 3.5 Beats Boosted Trees: When to Use It on Your Data

Prior Labs' TabPFN-3.5 report claims first place on seven tabular benchmarks. What a tabular foundation model is, when to use it, and what the licence allows.

September 15, 2026 · 8 minRead
AI Development

AI Agent or Fixed Workflow? A Business Decision Table

Choose rules, an AI-assisted workflow or an autonomous agent by checking task uncertainty, verification and consequences with a business decision table.

September 13, 2026 · 5 minRead