Systems | Information | Learning | Optimization
 

Packing Ellipsoids and Chromosomes

Problems of packing shapes with maximal density, possibly into a container of restricted size, are classical in discrete mathematics. We describe here the problem of packing ellipsoids of given (but varying) dimensions into a finite container, in a way that minimizes the maximum overlap between adjacent ellipsoids. A bilevel optimization …

Universal Laws and Architectures

his talk will focus on progress towards a more “unified” theory for complex networks motivated by biology and technology, and involving several elements: hard limits on achievable robust performance ( “laws”), the organizing principles that succeed or fail in achieving them (architectures and protocols), the resulting high variability data and …

Kevin: Query Complexity of Derivative-Free Optimization || Pari: Covariance Sketching

Kevin: This work provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and those with access to only function evaluations. However, there are situations in which DFO is …

Fast global convergence of gradient methods for high-dimensional statistical recovery

Many statistical M-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient methods for solving such problems, working within a high-dimensional framework that allows the data dimension d to grow with (and …