profile photo

Eugène Berta

I am a third year PhD student in the SIERRA team at INRIA Paris and École Normale Supérieure. I am advised by Francis Bach and Michael I. Jordan.

Prior to that, I graduated from Télécom Paris and got my Master's degrees in Mathematics, Vision and Learning at Université Paris Saclay.

Email  /  Scholar  /  Github  /  LinkedIn

Research

While machine learning systems can be incredibly powerful, it is of crucial interest to understand how confident we can be in their outputs. My work focuses on providing statistical guarantees for these predictions. In particular, I do research on classifier calibration, proper scoring rules, and conformal prediction.

Software

I am developping the probmetrics Python package with David Holzmüller. The package provides efficient implementations for various post-hoc calibration methods, as well as classification metrics, especially metrics for assessing the quality of probabilistic predictions.

Publications
CalArena: A Large-Scale Post-Hoc Calibration Benchmark
Eugène Berta, David Holzmüller, Francis Bach, Michael I. Jordan
Preprint, 2026
paper / code & leaderboard
A Variational Estimator for Lp Calibration Errors
Eugène Berta*, Sacha Braun*, David Holzmüller*, Michael I. Jordan, Francis Bach (* denotes equal contribution)
AISTATS workshop "Towards Trustworthy Predictions: Theory and Applications of Calibration for Modern AI", 2026
paper
Structured Matrix Scaling for Multi-Class Calibration
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
International Conference on Artificial Intelligence and Statistics (AISTATS), 2026
paper / code
Multivariate Conformal Prediction via Conformalized Gaussian Scoring
Sacha Braun, Eugène Berta, Michael I. Jordan, Francis Bach
Preprint, 2025
paper / code
Rethinking Early Stopping: Refine, Then Calibrate
Eugène Berta, David Holzmüller, Michael I. Jordan, Francis Bach
Preprint, 2025
paper / code / slides
Classifier Calibration with ROC-Regularized Isotonic Regression
Eugène Berta, Francis Bach, Michael I. Jordan
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
paper / code
Service

I co-organised the workshop Towards Trustworthy Predictions: Theory and Applications of Calibration for Modern AI at AISTATS 2026. The event was held on May 5, 2026 in Tangier, Morocco. A list of accepted paper can be found on the workshop website or on OpenReview.

I regularly review for the AISTATS, ICML, and NeurIPS conferences.

Teaching

2025-2026: Teaching assistant for the second year course "Mathématiques fondamentales" in the "Cycle Pluridisciplinaire d’Études Supérieures" (CPES) of Lycée Henri IV and PSL university.


Thanks to Jon Barron and Nivasini Ananthakrishnan for the template.