How to Determine if Your Machine Learning Model is Overtrained
WeightWatcher is based on theoretical evaluation (achieved injoint with UC Berkeley) into Why Deep Learning Works, based on our Theory of Heavy Tailed Self-Regularization (HT-SR). It makes use of ideas from Random Matrix Theory (RMT), Statistical Mechanics, and Strongly Correlated Systems.