Is Your Model Overtained?
WeightWatcher depends on theoretical evaluation (accomplished injoint with UC Berkeley) into Why Deep Learning Works, based mostly totally on our Theory of Heavy Tailed Self-Regularization (HT-SR). It makes use of ideas from Random Matrix Theory (RMT), Statistical Mechanics, and Strongly Correlated Systems.