Skip to content

Repository files navigation

Logo
Matbench Discovery

arXiv Tests GitHub Pages Requires Python 3.14+ PyPI

Matbench Discovery is an interactive leaderboard that ranks ML interatomic potentials across crystal stability prediction, geometry optimization, phonons and thermal conductivity, molecular dynamics, and diatomic potential-energy curves.

We rank 20+ models covering multiple methodologies including graph neural network (GNN) interatomic potentials, GNN one-shot predictors, iterative Bayesian optimizers and random forests with shallow-learning structure fingerprints.

The benchmark exposes accuracy, robustness, and computational-cost trade-offs across these tasks to help users choose models for static and finite-temperature materials simulations.

📖 Important: In Matbench Discovery, the convex hull used to evaluate stability is constructed from DFT reference energies, not from model predictions. This differs from some other benchmarking approaches and has important implications for metric interpretation. See /tasks/discovery for more information.

To cite Matbench Discovery, use:

Riebesell, J., Goodall, R.E.A., Benner, P. et al. A framework to evaluate machine learning crystal stability predictions. Nat Mach Intell 7, 836–847 (2025). https://doi.org/10.1038/s42256-025-01055-1

Are you submitting a new model? Follow the contributing guide, including its branch-specific PR instructions for loading the model checklist. For other changes, use GitHub's documented branch selector to open a regular PR with a blank description. Ask support questions via GitHub discussion.

Disclaimer: We evaluate how accurately ML models predict several material properties like thermodynamic stability, thermal conductivity, and atomic positions, in all cases using PBE DFT as reference data. Although these properties are important for high-throughput materials discovery, the ranking cannot give a complete picture of a model's overall ability to drive materials research. A high ranking does not constitute endorsement by the Materials Project.

About

An evaluation framework for machine learning models simulating high-throughput materials discovery.

Topics

Resources

Contributing

Stars

246 stars

Watchers

10 watching

Forks

Releases

Used by

Contributors

Languages