Lecture 1: Introduction and Logistics 课程的目标 本课程的目标是学习现代深度学习系统,了解包括自动微分、神经网络架构、优化以及GPU上的高效操作在内的技术的底层原理。作为实践,本课程将实现一个 needle(deep learning library)库,类似PyTorch。 为什么学习深度学习系统? 为什么学习?深度学习这一概念很早就存在了,但...
Other notesIt's important to appreciate simple and elegant modular design of modern Deep Learning frameworks. This design might seem obvious now, but back in the past it was not yet invented.Lecture 9 - Normalization and RegularizationInitializationInitialization matters a lot MNIST 50 layer network...
《Deep Learning: Methods and Applications》 介绍:这是一本来自微的研究员 li Peng和Dong Yu所著的关于深度学习的方法和应用的电子书 《Machine Learning Summer School 2014》 介绍:2014年七月CMU举办的机器学习夏季课刚刚结束 有近50小时的视频、十多个PDF版幻灯片,覆盖 深度学习,贝叶斯,分布式机器学习,伸缩性 ...
最近在学深度学习相关的东西,在网上搜集到了一些不错的资料,现在汇总一下: Free Online BooksDeep Learning66 by Yoshua Bengio, Ian Goodfellow and Aaron CourvilleNeural Networks and Deep Learning42 by M…
Some Notes on Applied Mathematics for Machine Learning 100 Best GitHub: Deep Learning 介绍:100 Best GitHub: Deep Learning 《UFLDL-斯坦福大学Andrew Ng教授“Deep Learning”教程》 介绍:本教程将阐述无监督特征学习和深度学习的主要观点。通过学习,你也将实现多个功能学习/深度学习算法,能看到它们为你工作,并学...
For people who are still unsure about what in Deep Learning excites them the most, Carnegie Mellon University (CMU) has a course onTopics in Deep Learning, which introduces a broad range of topics from Restricted Boltzmann Machines to Deep Reinforcement Learning. Oxford also has a Deep Learning...
《Information Processing and Learning》 介绍:CMU的信息论课程. 《Scheduled sampling for sequence prediction with recurrent neural networks》 介绍:谷歌研究院Samy Bengio等人最近写的RNN的Scheduled Sampling训练方法论文. 《基于Hadoop集群的大规模分布式深度学习》 介绍:基于Hadoop集群的大规模分布式深度学习. 《Lea...
《A Tutorial on Graph-based Semi-Supervised Learning Algorithms for NLP》 介绍:CMU(ACL 2012)(500+页)面向NLP基于图的半监督学习算法. 《Arbitrariness of peer review: A Bayesian analysis of the NIPS experiment》 介绍:从贝叶斯分析NIPS,看同行评审的意义. 《Basics of Computational Reinforcement Learnin...
Jerry Hargrove - AWS Cloud Diagrams & Notes (https://www.awsgeek.com/) Cheat Sheets for Machine Learning and Data Science - by Aqeel Anwar (https://sites.google.com/view/datascience-cheat-sheets) Cheat Sheets for Machine Learning Interview Topics - by Aqeel Anwar (https://medium.com/swl...
https://github.com/dennybritz/deeplearning-papernotes/blob/master/notes/self_attention_embedding.md (review) https://github.com/yufengm/SelfAttentive code https://github.com/Diego999/SelfSent code July 17, 2017 - Hacker Dojo https://arxiv.org/pdf/1706.03762.pdf - attention is all you need...