BFS-Prover

A plain best-first search over Lean tactics, with a model retrained each round on the proofs and compiler errors the search produced.

Read the paper

The loop

  1. Proposes

    Lean 4 tactics for the current proof state, from a language model

  2. Judged by

    The Lean 4 compiler through LeanDojo, which runs each tactic and reports success or an error

  3. Steers

    Best-first search ranks states by log probability; expert iteration retrains on proofs (SFT) and error pairs (DPO)

Headline result

Reaches 72.95% on the miniF2F test set as an accumulative score; the single-run figure is 70.83% +/- 0.89 at a budget of 2048 x 2 x 600 (Lean 4.7.0). The authors say this shows plain best-first search can compete when scaled.

What this does not prove

The 72.95% is a cumulative (union across runs and settings) score, not one fixed-budget run. Its claims date from early 2025 and are compared with provers that used different budgets.

How it generalizes the harness

Compiler verdicts retrain the generator between rounds while a search tree is explored; the proofs it outputs are machine-checkable without it.

Classification

Classification of BFS-Prover
What it proposesProof tactic
Generative model7B policy language model (open-sourced as BFS-Prover-V1-7B)
Algorithmic authorityLean 4 compiler via LeanDojo
FeedbackVerifier errors
What gets updatedModel weights, search tree and training data
When it runsDuring training
ValidityFormal (machine-checked)
EvidenceExperiments reported
LineageOriginal system