Systems | Information | Learning | Optimization
 

SILO: Characterizing the power of MCMC methods for sparse estimation

Abstract: Markov Chain Monte Carlo (MCMC) and local-search optimization methods have been extensively used in the practice of statistical research for many decades now. However, their exact theoretical performance has been strikingly eluding even for simple parametric estimation tasks. This is in stark contrast to other classes of estimators such …

Emotions in Engineering: Methods for the Interpretation of Ambiguous Emotional Content

Emotion has intrigued researchers for generations. This fascination has permeated the engineering community, motivating the development of affective computational models for classification. However, human emotion remains notoriously difficult to interpret both because of the mismatch between the emotional cue generation (the speaker) and cue perception (the observer) processes and because …

Iterative Collaborative Filtering for Sparse Noisy Tensor Estimation

We present a generalization of the collaborative filtering algorithm for the task of tensor estimation, i.e. estimating a low-rank 3-order n-by-n-by-n tensor from noisy observations of randomly chosen entries in the sparse regime. Not only does the algorithm have desirable computational properties, it also provably achieves sample complexity that (nearly) …

Adaptive Experimental Design for Multiple Testing and Best Identification

Adaptive experimental design (AED), or active learning, leverages already-collected data to guide future measurements, in a closed loop, to collect the most informative data for the learning problem at hand. In both theory and practice, AED can extract considerably richer insights than any measurement plan fixed in advance, using the …