Active Deadlines and Bulletin

Assignment Deadline Description Links
HW2P2 Checkpoint Submission: Oct 3 11:59 PM
Final Submission: Oct 10, 11:59 PM
Face Verification using CNNs. Final Submission Autolab
Piazza
HW3P1 Early Deadline: Friday, Oct 31 11:59 PM
On-Time Deadline: Friday, Nov 7 11:59 PM
RNNs, GRUs, and Search Autolab
Piazza
HW3P2 Checkpoint Deadline: Friday, Oct 31 11:59 PM
Final Deadline: Friday, Nov 7 11:59 PM
Face Verification using CNNs. Checkpoint Submission Autolab
Final Submission Autolab
Piazza
HW1 Bonus Friday, Dec 5 11:59 PM
Implementation of Adam, AdamW optimizers and Dropout Autolab
Piazza
HW1 Autograd Friday, Dec 5 11:59 PM
Building the autograd engine. Autolab
Piazza
HW2 Bonus Friday, Dec 5 11:59 PM
Implementation of Dropout2d, BatchNorm2d and ResNet Autolab
HW2 Autograd Friday, Dec 5 11:59 PM
Building the autograd engine. Autolab
HW3 Bonus Friday, Dec 5 11:59 PM
Implementation of GRUs and Search Autolab
Piazza
HW3 Autograd Friday, Dec 5 11:59 PM
Building the autograd engine. Autolab
Project Gallery

The Course

“Deep Learning” systems, typified by deep neural networks, are increasingly taking over all the AI tasks, ranging from language understanding, speech and image recognition, to machine translation, planning, and even game playing and autonomous driving. As a result, expertise in deep learning is fast changing from an esoteric desirable to a mandatory prerequisite in many advanced academic settings, and a large advantage in the industrial job market.

In this course we will learn about the basics of deep neural networks, and their applications to various AI tasks. By the end of the course, it is expected that students will have significant familiarity with the subject, and be able to apply Deep Learning to a variety of tasks. They will also be positioned to understand much of the current literature on the topic and extend their knowledge through further study.

If you are only interested in the lectures, you can watch them on the YouTube channel.

Course Description from a Student's Perspective

The course is well rounded in terms of concepts. It helps us understand the fundamentals of Deep Learning. The course starts off gradually with MLPs and it progresses into the more complicated concepts such as attention and sequence-to-sequence models. We get a complete hands on with PyTorch which is very important to implement Deep Learning models. As a student, you will learn the tools required for building Deep Learning models. The homeworks usually have 2 components which is Autolab and Kaggle. The Kaggle components allow us to explore multiple architectures and understand how to fine-tune and continuously improve models. The task for all the homeworks were similar and it was interesting to learn how the same task can be solved using multiple Deep Learning approaches. Overall, at the end of this course you will be confident enough to build and tune Deep Learning models.

Prerequisites

  1. We will be using Numpy and PyTorch in this class, so you will need to be able to program in python3.
  2. You will need familiarity with basic calculus (differentiation, chain rule), linear algebra, and basic probability.

Units

Courses 11-785 and 11-685 are equivalent 12-unit graduate courses, and have a final project and a guided project respectively.
Course 11-485 is the undergraduate version worth 9 units, the only difference being that there is no final project nor guided project.

Your Supporters

Instructors:

Core Instruction TAs:

Support TAs:

Acknowledgments

Wall of fame

Past TA Acknowledgments

Pittsburgh Schedule (Eastern Time)

Lecture: Monday and Wednesday, 8:00 a.m. - 9:20 a.m. - Good times :)

Recitation Labs: Friday, 8:00 a.m. - 9:20 a.m.

Office Hours: Please refer the below OH Calendar / Piazza for up-to-date information.

Homework Hackathon: During 'Homework Hackathons', students will be assisted with homework by the course staff. It is recommended to come as study groups.
Every Saturday

Event Calendar: The Google Calendar below contains all course events and deadlines for student's convenience. Please feel free to add this calendar to your Google Calendar by clicking on the plus (+) button on the bottom right corner of the calendar below. Any adhoc changes to the schedule will be reflected in this calendar first.


OH Calendar: The Google Calendar below contains the schedule for Office Hours. Please feel free to add this calendar to your Google Calendar by clicking on the plus (+) button on the bottom right corner of the calendar below. Any adhoc changes to the schedule will be reflected in this calendar first.