Sebastian Raschka
@sebastianraschka·88.6K subscribers·307 videos
L11.4 Why BatchNorm Works
Posted
March 11, 2021
Views
3,235
Likes
59
Comments
8
Engagement
2.07%
March 11, 2021
3,235
59
8
2.07%
Every word spoken in this episode is indexed. Type any phrase to jump straight to the moment it was said.
Type any word or phrase that may have been spoken. Click a result to seek the player to that exact moment.
Try a name, a topic, or a quoted line
23:38Now PlayingSebastian's books
BatchNorm papers:
Ioffe, S., & Szegedy, C. (2015). Batch NormalizationAccelerating Deep Network Training by Reducing Internal Covariate Shift. In International Conference on Machine Learning (pp. 448456).
Santurkar, S., Tsipras, D., Ilyas, A., & Madry, A. (2018). How does batch normalization help optimization?. In Advances in Neural Information Processing Systems (pp. 24882498).
Morcos, A. S., Barrett, D. G., Rabinowitz, N. C., & Botvinick, M. (2018). On the importance of single directions for generalization.
Luo, P., Wang, X., Shao, W., & Peng, Z. (2018). Towards understanding regularization in batch normalization.
Yang, G., Pennington, J., Rao, V., SohlDickstein, J., & Schoenholz, S. S. (2019). A mean field theory of batch normalization.
==============
Some Benchmarks
-------
This video is part of my Introduction of Deep Learning course.
The complete playlist
A handy overview page with links to the materials
-------
If you want to be notified about future videos, please consider subscribing to my channel
Sentinel Indexing in Progress
Metadata and chapters are available. Claim extraction for this episode is pending.
All video content is delivered via YouTube embedded players in accordance with the YouTube Terms of Service. Sentinel provides research tools that promote discovery and accountability across political media.
