13–15 Sept 2021
Online
Europe/Berlin timezone

Calibrating Prediction Intervals for Gaussian Processes using Cross-Validation method

15 Sept 2021, 12:20
20m
Room 4

Room 4

Modelling Modelling 5

Speaker

ACHARKI Naoufal

Description

Gaussian Processes are considered as one of the most important Bayesian Machine Learning methods (Rasmussen and Williams [1], 2006). They typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. Unfortunately, these methods may give advantage to the solutions that fit observations in average (F. Bachoc [2], 2013), but they do not pay attention to the coverage and the width of Prediction Intervals. This may be inadmissible, especially for systems that require risk management. Indeed, an interval is crucial and offers valuable information that helps for better management than just predicting a single value.

In this work, we address the question of adjusting and calibrating Prediction Intervals for Gaussian Processes Regression. First we determine the model's parameters by a standard Cross-Validation or Maximum Likelihood Estimation method then we adjust the parameters to assess the optimal type II Coverage Probability to a nominal level. We apply a relaxation method to choose parameters that minimize the Wasserstein distance between the Gaussian distribution of the initial parameters (Cross-Validation or Maximum Likelihood Estimation) and the proposed Gaussian distribution among the set of parameters that achieved the desired Coverage Probability.

References :
1. Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press (2005).
2. Bachoc, F.: Cross validation and maximum likelihood estimations of hyper-parameters of gaussian processes with model misspecification. Computational Statistics & Data Analysis66, 55–69 (2013).

Keywords Cross-Validation ; Gaussian Processes ; Prediction Intervals

Primary authors

ACHARKI Naoufal Dr Antoine Bertoncello (TotalEnergies SE) Prof. Josselin Garnier (CMAP - Ecole Polytechnique)

Presentation materials

There are no materials yet.