11-785
Introduction to Deep Learning
Fall 2020
Pseudocode
Lecture 4: Backprop Part 1
Forward Pass
Backward Pass
Lecture 5: Backprop Part 2
Backward Pass Softmax
Neural Network Training Algorithm
Lecture 6: Optimization Part 1
Forward Pass
Lecture 7: Optimization Part 2
Forward Pass
Lecture 8: Optimizers
Forward Pass
Lecture 9: CNNs Part 1
Scanning MLP 1D
Scanning MLP 1D (Simple)
Scanning MLP 1D (Vector)
Scanning MLP 2D
Scanning MLP 2D (Simple)
Scanning MLP 2D (Vector)
Shared Parameter Gradient Descent
Convolutional Neural Network
Lecture 11: CNNs Part 3
CNN Layer Backward
CNN Layer Backward (Vector)
CNN Backward Pass
Max Pooling Layer
Max Pooling Layer Backward
Mean Pooling Layer
Mean Pooling Layer Backward
CNN Transform Invariant Layer
CNN Expanding Layer
Lecture 12: RNNs Part 1
Forward Pass
Lecture 13: RNNs Part 2
Forward Pass
Lecture 15: RNNs Part 4
Forward Pass
Lecture 16: Attention
Forward Pass