uncertainty-toolbox (conda): Uncertainty Toolbox provides standard metrics to quantify and compare predictive uncertainty estimates, gives intuition for these metrics, produces visualizations of these metrics/uncertainties, and implements simple "re-calibration" procedures to improve these uncertainties. This toolbox currently focuses on regression tasks.
Keywords: bayesian-deep-learning|bayesian-neural-networks|calibration|metrics|predictive-uncertainty|recalibration|scoring-rules|sharpness|toolbox|uncertainty|uncertainty-calibration|uncertainty-estimation|uncertainty-metrics|uncertainty-quantification|uncertainty-toolbox|visualization|visualizations