AlphaCode

Samples millions of candidate programs per competitive programming problem, filters by example tests, and clusters by synthetic input behavior.

Read the paper

The loop

  1. Proposes

    An encoder-decoder transformer generates a large pool of candidate C++ and Python solutions from the problem description.

  2. Judged by

    A sandboxed execution engine filters out candidates that fail public example tests (>99% pruned) and runs the survivors on generated test inputs to cluster equivalent behaviors.

  3. Steers

    Behavioral clustering selects one representative program from each of the largest equivalence classes for final submission.

Headline result

Placed in the top 54.3% of human participants across 10 recent Codeforces competitions, the first AI system to reach competitive human rank.

What this does not prove

Relies on sampling hundreds of thousands of programs per problem; passing public example tests does not prove correctness on hidden edge cases.

How it generalizes the harness

Large-scale execution filtering and behavioral equivalence clustering select among a massive population of candidate programs.

Classification

Classification of AlphaCode
What it proposesProgram
Generative model41B encoder-decoder code transformer
Algorithmic authoritySandboxed test execution and input-output equivalence clustering
FeedbackTest results
What gets updatedPopulation of candidates
When it runsAt inference time
ValidityEmpirical (measured)
EvidenceExperiments reported
LineageOriginal system