|
Research
While machine learning systems can be incredibly powerful, it is of crucial interest to understand how confident we can be in their outputs.
My work focuses on providing statistical guarantees for these predictions.
In particular, I do research on classifier calibration, proper scoring rules, and conformal prediction.
|
|
Software
I am developping the probmetrics Python package with David Holzmüller.
The package provides efficient implementations for various post-hoc calibration methods, as well as classification metrics, especially metrics for assessing the quality of probabilistic predictions.
|
|
Publications
|
CalArena: A Large-Scale Post-Hoc Calibration Benchmark
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
Preprint, 2026
paper /
code & leaderboard
|
A Variational Estimator for Lp Calibration Errors
Eugène Berta*, Sacha Braun*, David Holzmüller*, Michael I. Jordan, Francis Bach (* denotes equal contribution)
AISTATS workshop "Towards Trustworthy Predictions: Theory and Applications of Calibration for Modern AI", 2026
paper
|
Structured Matrix Scaling for Multi-Class Calibration
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
International Conference on Artificial Intelligence and Statistics (AISTATS), 2026
paper /
code
|
Multivariate Conformal Prediction via Conformalized Gaussian Scoring
Sacha Braun, Eugène Berta, Michael I. Jordan, Francis Bach
Preprint, 2025
paper /
code
|
Rethinking Early Stopping: Refine, Then Calibrate
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
Preprint, 2025
paper /
code /
slides
|
Classifier Calibration with ROC-Regularized Isotonic Regression
Eugène Berta, Francis Bach, Michael I. Jordan
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
paper /
code
|
|
Teaching
2025-2026: Teaching assistant for the second year course "Mathématiques fondamentales" in the "Cycle Pluridisciplinaire d’Études Supérieures" (CPES) of Lycée Henri IV and PSL university.
|
|