SILO: Uncertainty Quantification for Foundation Models under Data and Compute Constraints
Abstract Foundation models are increasingly used in settings where labeled data are scarce and adaptation must be fast and lightweight. But scarce data must often do double duty: we need labeled examples both to adapt a foundation model to a new task and to evaluate how much we can trust …