Bayesian Optimization

Leveraging Bayesian optimization to improve regression models

Flowchart of the Bayesian optimization
(expected improvement is used for the acquisition function)

Different queries during Bayesian optimization due to uncertainty calibration process 

After uncertainty calibration, different exploration characteristics can be observed
(after calibration, much stronger exploratory tendency w.r.t. input variable δr is shown)