User: Guest  Login
Document type:
Konferenzbeitrag 
Contribution type:
Vortrag / Präsentation 
Author(s):
Severin Reiz 
Title:
A Fast Multipole Method for Training Neural Networks 
Abstract:
We propose a fast multipole method for the fast approximation and factorization of the Gauss-Newton Hessian for fully-connected multilayer perceptron and convolutional neural networks. We use a block-low rank approximation scheme that is inspired by methods for N-body problems in computational physics. In addition, we propose precomputation and sampling algorithms that reduce the complexity of the overall scheme. For a net with N weights, an average layer dimension d, and batch size n, the Gauss...    »
 
Book / Congress title:
PhD Forum: IEEE International Supercomputing Conference 
Year:
2019 
Quarter:
3. Quartal 
Year / month:
2019-06 
Month:
Jun 
Reviewed:
ja 
Language:
en 
TUM Institution:
Department of Informatics