Net Good IndexSubmit a correction

Benefit Ledger · verified · Computer Science

GitHub Copilot becomes a paid pair-programmer for every developer

On 21 June 2022 GitHub made Copilot generally available, the first mass-market AI coding assistant, powered by OpenAI Codex. A Microsoft/GitHub controlled study found developers completed a JavaScript HTTP-server task 55.8% faster with Copilot.

Tier 3 MajorMethodology 0.1
Submit a correction

Current score

+2.45

10 base · Major (tier 3 of 5, 10 pts)
× 0.7500 attribution · Critical contribution
× 0.5500 evidence · Peer review or substantial independent validation
× 0.8500 realization · Realized outcome
× 0.7000 durability · Useful for many years
Event-level product before credit split: 2.45

The first mass-deployed AI pair programmer is a major industry change (tier 3), not a new algorithm. Codex is the model inside the product (0.75). Evidence is a vendor-adjacent RCT plus GitHub telemetry, not independent firm-level productivity (0.55). Realization is a paid GA product (0.85). Follow-up ingest: added a follow-up source. Follow-up ingest: added a follow-up source.

What happened

Copilot had been a technical preview with more than a million developers. General availability sold the product at $10/month and, GitHub said, was already writing nearly 40% of code in files where it was enabled for popular languages. The underlying model was OpenAI Codex, a GPT-3 descendant fine-tuned on public code. Peng, Kalliamvakou, Cihon, and Demirer later reported a randomized experiment (n=95) in which treated developers finished a standardized task 55.8% faster (95% CI 21–89%). That study measures a narrow task, not firm-level output, and later field studies of AI coding tools have been mixed. The event is still the product launch that made inline AI coding a default part of professional software engineering, not a benchmark score and not a user-count trophy. Update (2026-09-06): Research acceleration: The view inside OpenAI ↗. Inside OpenAI, coding agents are reshaping AI research. Explore early data on agent usage, experiment velocity, task complexity, and research acceleration. Update (2026-09-21): AI coding has made CI a bottleneck, so we reworked ours to keep up. Article URL: https://linear.app/now/ci-bottleneck-reworked Comments URL: https://news.ycombinator.com/item?id=49792067 Points: 14 # Comments: 4

Model attribution

Codex

GPT-3 descendant fine-tuned on public code; the model GitHub shipped as Copilot at general availability.

GitHub Copilot GA was powered by OpenAI Codex; GitHub supplied the editor product and distribution.

Attribution 0.7500 · Credit share 100% · OpenAI

Claims

  • GitHub made Copilot generally available to individual developers on 21 June 2022, powered by OpenAI Codex.

    outcome · supported

  • In a 95-developer controlled experiment, Copilot users completed a JavaScript HTTP-server task 55.8% faster than the control group.

    outcome · supported

  • The 55.8% speedup is a measured increase in firm-level software output.

    significance · disputed

Sources

primary sources

independent sources

Secondary domains: Engineering

Revision history

  • 13 Sep 2026 · 0.00 → 2.45

    Imported September 2026 mathematics events under methodology 0.1 credit-unit rules.

  • 17 Sep 2026 · 2.45 → 2.45

    Ingest update: added a follow-up source.

  • 21 Sep 2026 · 2.45 → 2.45

    Ingest update: added a follow-up source.