Statistical Mechanics of Deep Linear Neural Networks: The Backpropagating Kernel Renormalization
The groundbreaking success of deep learning in many real-world tasks has triggered an intense effort to theoretically understand the power and limitations of deep learning in the training and generalization of complex tasks, so far with limited progress. In this work, we study the statistical mechan...
Saved in:
Main Authors: | Qianyi Li, Haim Sompolinsky |
---|---|
Format: | article |
Language: | EN |
Published: |
American Physical Society
2021
|
Subjects: | |
Online Access: | https://doaj.org/article/510738e70abd43f7a350f976de4a2e33 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
Tensor Renormalization Group for interacting quantum fields
by: Manuel Campos, et al.
Published: (2021) -
Taming nucleon density distributions with deep neural network
by: Zu-Xing Yang, et al.
Published: (2021) -
Spintronics Meets Density Matrix Renormalization Group: Quantum Spin-Torque-Driven Nonclassical Magnetization Reversal and Dynamical Buildup of Long-Range Entanglement
by: Marko D. Petrović, et al.
Published: (2021) -
Separability and geometry of object manifolds in deep neural networks
by: Uri Cohen, et al.
Published: (2020) -
Modeling the Influence of Data Structure on Learning in Neural Networks: The Hidden Manifold Model
by: Sebastian Goldt, et al.
Published: (2020)