NetGoodIndexSubmit a correction

Benefit Ledger · verified · Chemistry

Coscientist uses GPT-4 to plan and run robotic chemistry experiments

Carnegie Mellon researchers showed a GPT-4-driven agent, Coscientist, that searched literature, wrote robot code, and optimized palladium-catalyzed couplings, published in Nature on 20 December 2023.

20 Dec 2023Tier 2 NotableMethodology 0.1

Current score

+0.26

3 base · Notable (tier 2 of 5, 3 pts)
× 0.6000 attribution · Critical contribution
× 0.7000 evidence · Peer review or independent validation
× 0.5500 realization · Experimentally validated
× 0.5000 durability
Event-level product before credit split: 0.35

Notable automation result (tier 2). GPT-4 was necessary but humans built tools and hardware. Peer-reviewed demo. Realization is lab tasks, not new molecules in the clinic. Medium durability as agent stacks age quickly.

What happened

Coscientist combined GPT-4 with tools for web search, documentation, code execution, and lab APIs, including an Opentrons OT-2. Demonstrations included Suzuki–Miyaura and Sonogashira planning and reaction optimization with GC-MS confirmation. Claude was also used in some configurations. The work is a controlled lab demonstration, not a general autonomous scientist.

Model attribution

+0.24

GPT

Primary planner LLM that called tools and wrote experimental code.

Paper describes a GPT-4-driven multi-LLM agent; humans supplied tools and robots.

Attribution 0.6000 · Credit share 70% · OpenAI

Claude
Version unspecified
+0.02

Claude

Used as an additional LLM in some Coscientist configurations.

CMU announcement and paper note Claude among usable LLMs; GPT-4 was primary.

Attribution 0.2500 · Credit share 15% · Anthropic

Claims

  • Coscientist planned and executed palladium-catalyzed coupling experiments via robotic APIs.

    outcome · supported

  • GPT-4 was the primary language model in the published system.

    attribution · supported

Sources

primary sources

Secondary domains: Computer Science

Revision history

  • 13 Sep 2026 · 0.00 0.26

    Initial adjudicated seed score under methodology 0.1.