|
Research
While machine learning systems can be incredibly powerful, it is of crucial interest to understand how confident we can be in their outputs.
My work focuses on providing statistical guarantees for these predictions.
In particular, I do research on classifier calibration, proper scoring rules, and conformal prediction.
|
|
Software
I am developing the probmetrics Python package.
The package provides efficient implementations for various post-hoc calibration methods, as well as classification metrics, especially metrics for assessing the quality of probabilistic predictions.
|
|
Publications
|
CalArena: A Large-Scale Post-Hoc Calibration Benchmark
Eugène Berta, David Holzmüller, Francis Bach, Michael I. Jordan
To appear at: Advances in Neural Information Processing Systems (NeurIPS), 2026
paper /
code & leaderboard
|
A Variational Estimator for Lp Calibration Errors
Eugène Berta*, Sacha Braun*, David Holzmüller*, Michael I. Jordan, Francis Bach (* denotes equal contribution)
AISTATS workshop "Towards Trustworthy Predictions: Theory and Applications of Calibration for Modern AI", 2026
paper
|
Structured Matrix Scaling for Multi-Class Calibration
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
International Conference on Artificial Intelligence and Statistics (AISTATS), 2026
paper /
code
|
Multivariate Conformal Prediction via Conformalized Gaussian Scoring
Sacha Braun, Eugène Berta, Michael I. Jordan, Francis Bach
Preprint, 2025
paper /
code
|
Rethinking Early Stopping: Refine, Then Calibrate
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
To appear in the SIAM Journal on Mathematics of Data Science (SIMODS), 2025
paper /
code /
slides
|
Classifier Calibration with ROC-Regularized Isotonic Regression
Eugène Berta, Francis Bach, Michael I. Jordan
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
paper /
code
|
|
Teaching
2025-2026: Teaching assistant for the second year course "Mathématiques fondamentales" in the "Cycle Pluridisciplinaire d’Études Supérieures" (CPES) of Lycée Henri IV and PSL university.
|
|
Carbon footprint
Air travel is generally the largest part of the work-related carbon footprint of a researcher (by far!).
For example, a single return flight from Paris to the US emits roughly 2 tonnes of CO2-equivalent per passenger,
which is about the yearly per-person budget compatible with the goals of the Paris agreement.
While I do not expect (nor wish) everybody to stop flying at once,
I believe that we should prioritize longer research stays and drastically reduce flying for short trips.
As a scientific community, it is our responsibility to listen to what our colleagues are documenting and to lead by example.
Since starting my PhD, I have chosen not to fly.
Despite this constraint, I managed to attend several international conferences and workshops, for instance travelling
from Paris to AISTATS in Valencia (2024) and in Tangier (2026) by train and ferry.
While the journeys are longer, they are great for reading, spending time with other motivated colleagues, and realizing how far you are going.
I am very grateful to the researchers who organise local editions of major conferences, such as the NeurIPS satellite in Paris this year.
This makes it much easier for everyone to connect with the community while reducing distances travelled.
For a broader analysis of the problem and concrete solution proposals I recommend having a look at Pierre Marion's website.
|
|