Statistical Mechanics of Deep Linear Neural Networks: The Backpropagating Kernel Renormalization

The groundbreaking success of deep learning in many real-world tasks has triggered an intense effort to theoretically understand the power and limitations of deep learning in the training and generalization of complex tasks, so far with limited progress. In this work, we study the statistical mechan...

Full description

Saved in:
Bibliographic Details
Main Authors: Qianyi Li, Haim Sompolinsky
Format: article
Language:EN
Published: American Physical Society 2021
Subjects:
Online Access:https://doaj.org/article/510738e70abd43f7a350f976de4a2e33
Tags: Add Tag
No Tags, Be the first to tag this record!