SILO: Confidence Sequences via Online Learning
Abstract: Confidence sequence provides ways to characterize uncertainty in stochastic environments, which is a widely-used tool for interactive machine learning algorithms and statistical problems including A/B testing, Bayesian optimization, reinforcement learning, and offline learning. In these problems, constructing confidence sequences that are tight without losing correctness is crucial since it …