Lecture	Date	Topics	Slides, Videos	Additional Materials	Quiz
0	Monday Jan 5	Course Logistics Learning Objectives Grading Deadlines	Slides YouTube		No Quiz
1	Monday Jan 12	Introduction	Slides YouTube MediaService	The New Connectionism (1988) On Alan Turing's Anticipation of Connectionism McCullogh and Pitts paper Rosenblatt: The perceptron Bain: Mind and body Hebb: The Organization Of Behaviour	Quiz 1
2	Wednesday Jan 14	Neural Nets As Universal Approximators	Slides YouTube MediaService	Size and Depth complexity of Boolean Circuits The Synthesis of Two-Terminal Switching Circuits
3	Friday Jan 16	Training Part I The Problem of Learning Empirical Risk Minimization	Slides YouTube MediaService	Artificial Neural Networks of the Perceptron, Madaline, and Backpropagation Family The Perceptron Learning Algorithm and its Convergence	Quiz 2
4	Wednesday Jan 21	Training Part II Gradient Descent Training the Network	Slides YouTube MediaService	Widrow and Lehr (1992) Adaline and Madaline Convergence of perceptron algorithm Threshold Logic TC (Complexity) AC (Complexity)
5	Monday Jan 26	Training Part III Backpropagation Calculus of Backpropagation	Slides YouTube MediaService	Werbos (1990) Rumelhart, Hinton and Williams (1986)	Quiz 3
6	Wednesday Jan 28	Training Part IV Convergence issues Loss Surfaces Momentum	Slides YouTube MediaService	Backpropagation Fails to Separate, Where Perceptrons Succeed, Brady et al. (1989) Why Momentum Really Works
7	Monday Feb 2	Training Part V Optimization Batch Size, SGD, Mini-batch, Second-order Methods	Slides YouTube MediaService	Momentum and Polyak (1964) Nesterov (1983) Derivatives and Influences	Quiz 4
8	Wednesday Feb 4	Training Part VI Optimizers and Regularizers Choosing a Divergence (Loss) Function Batch Normalization Dropout	Slides YouTube MediaService	Derivatives and Influence Diagrams ADAGRAD, Duchi, Hazan and Singer (2011) Adam: A method for stochastic optimization, Kingma and Ba (2014)
9	Monday Feb 9	Convolutional Neural Networks (CNNs) I	Slides YouTube MediaService		Quiz 5
10	Wednesday Feb 11	CNNs II	Slides YouTube MediaService
11	Monday Feb 16	CNNs III	Slides YouTube MediaService	CNN Explainer	Quiz 6
12	Wednesday Feb 18	CNNs IV	Slides YouTube MediaService
13	Monday Feb 23	Recurrent Neural Networks (RNNs) I	Slides YouTube MediaService	Fahlman and Lebiere (1990)	Quiz 7
14	Wednesday Feb 25	RNNs II	Slides YouTube MediaService	How to compute a derivative
15	Monday Mar 9	Sequence to Sequence Models Connectionist Temporal Classification (CTC)	Slides YouTube MediaService		Quiz 8
16	Wednesday Mar 11	Connectionist Temporal Classification Blanks Beam Search	Slides YouTube MediaService
17	Monday Mar 16	Language Models Translation	Slides YouTube MediaService		Quiz 9
18	Wednesday Mar 18	Attention Models Transformers	Slides YouTube MediaService
19	Monday Mar 23	Transformers and Newer Architectures	Slides YouTube MediaService		Quiz 10
20	Wednesday Mar 25	Large Language Models	Slides YouTube MediaService
21	Monday Mar 30	Representation and Autoencoders	Slides YouTube MediaService		Quiz 11
22	Wednesday Apr 1	Variational Auto Encoders	Slides YouTube MediaService
23	Monday Apr 6	Diffusion	Slides YouTube MediaService		Quiz 12
24	Wednesday Apr 8	Generative Adversarial Networks	Slides YouTube MediaService
25	Monday Apr 13	Graph Neural Networks (GNNs)	Slides YouTube MediaService		Quiz 13
26	Wednesday Apr 15	Reinforcement Learning	Slides YouTube MediaService
27	Monday Apr 20	Hopfield Networks	Slides YouTube MediaService		Quiz 14
28	Wednesday Apr 22	Boltzmann Machines	Slides YouTube MediaService