Systems | Information | Learning | Optimization
 

Hardware Accelerators for Deep Learning: A Proving Ground for Specialized Computing

The computing industry has a power problem: the days of ideal transistor scaling are over, and chips now have more devices than can be fully powered simultaneously, limiting performance. New architecture-level solutions are needed to continue scaling performance, and specialized hardware accelerators are one such solution. While accelerators promise to …

Learning From Sub-Optimal Data

Learning algorithms typically assume their input data is good natured. If one takes this input data and trains an agent with it, then the agent should, given enough time and compute, eventually learn how to solve the intended task. But this is not always a realistic expectation. Sometimes, the data …

Data-Driven Discovery and Control of Complex Systems: Uncovering Interpretable and Generalizable Nonlinear Models

Accurate and efficient reduced-order models are essential to understand, predict, estimate, and control complex, multiscale, and nonlinear dynamical systems. These models should ideally be generalizable, interpretable, and based on limited training data. This work develops a general framework to discover the governing equations underlying a dynamical system simply from data …

Multistage Distributionally Robust Optimization with Total Variation Distance: Modeling and Effective Scenarios

Traditional multistage stochastic optimization assumes the underlying probability distribution is known. However, in practice, the probability distribution is often not known or cannot be accurately approximated. One way to address such distributional ambiguity is to use distributionally robust optimization (DRO), which minimizes the worst-case expected cost with respect to a …

Information-theoretic Privacy: Leakage measures, robust privacy guarantees, and generative adversarial mechanism design

Privacy is the problem of ensuring limited leakage of information about sensitive features while sharing information (utility) about non-private features to legitimate data users. Even as differential privacy has emerged as a strong desideratum for privacy, there is also an equally strong need for context-aware utility-guaranteeing approaches in many data …

Model-Predictive Policy Learning with Uncertainty Regularisation for Driving in Dense Traffic

Learning a policy using only observational data is challenging because the distribution of states it induces at execution time may differ from the distribution observed during training. In this work, we propose to train a policy while explicitly penalising the mismatch between these two distributions over a fixed time horizon. …

Iterative Collaborative Filtering for Sparse Noisy Tensor Estimation

We present a generalization of the collaborative filtering algorithm for the task of tensor estimation, i.e. estimating a low-rank 3-order n-by-n-by-n tensor from noisy observations of randomly chosen entries in the sparse regime. Not only does the algorithm have desirable computational properties, it also provably achieves sample complexity that (nearly) …