Assignment | Deadline | Description | Links | |
---|---|---|---|---|
HW0 | TBA | TBA | Autolab, Writeup, Handouts - TBA | |
Project Gallery | ||||
Here's an example of a successful project from Fall 2020. The team developed an AI Limmerick generator, and compiled a book from the AI Poet's creations. |
Project Report, Project Video, Book (Amazon) | |||
This piece is performed by the Chinese Music Institute at Peking University (PKU) together with PKU's Chinese orchestra. This is an adaptation of Beethoven: Serenade in D major, Op.25 - 1. Entrata (Allegro),for Chinese transverse flute (Dizi), clarinet and flute. |
In the event that the course is moved online due to CoVID-19, we will continue to deliver lectures via zoom. In the event that an instructor is unable to deliver a lecture in person, we will broadcast that lecture over zoom or, in extreme situations, expect you to view pre-recorded lectures from prior semesters. You will be notified through Piazza should any of these eventualities arise.
“Deep Learning” systems, typified by deep neural networks, are increasingly taking over all AI tasks, ranging from language understanding, and speech and image recognition, to machine translation, planning, and even game playing and autonomous driving. As a result, expertise in deep learning is fast changing from an esoteric desirable to a mandatory prerequisite in many advanced academic settings, and a large advantage in the industrial job market.
In this course we will learn about the basics of deep neural networks, and their applications to various AI tasks. By the end of the course, it is expected that students will have significant familiarity with the subject, and be able to apply Deep Learning to a variety of tasks. They will also be positioned to understand much of the current literature on the topic and extend their knowledge through further study.
If you are only interested in the lectures, you can watch them on the YouTube channel.
The course is well rounded in terms of concepts. It helps us understand the fundamentals of Deep Learning. The course starts off gradually with MLPs and it progresses into the more complicated concepts such as attention and sequence-to-sequence models. We get a complete hands on with PyTorch which is very important to implement Deep Learning models. As a student, you will learn the tools required for building Deep Learning models. The homeworks usually have 2 components which is Autolab and Kaggle. The Kaggle components allow us to explore multiple architectures and understand how to fine-tune and continuously improve models. The task for all the homeworks were similar and it was interesting to learn how the same task can be solved using multiple Deep Learning approaches. Overall, at the end of this course you will be confident enough to build and tune Deep Learning models.
Courses 11-785 and 11-685 are equivalent 12-unit graduate courses, and have a final project and HW 5 respectively. Course 11-485 is the undergraduate version worth 9 units, the only difference being that there is no final project or HW 5.
Instructors:
TAs:
Lecture: TBD/TBA
Recitation: TBD/TBA
Office hours: We will be using OHQueue for zoom related Office hours, others would be in-person. The OH schedule is given below.
Day | Time (Eastern Time) | TA | Zoom/In Person Venue |
---|---|---|---|
Monday | TBD/TBA | TBD/TBA | TBD/TBA |
Tuesday | TBD/TBA | TBD/TBA | TBD/TBA |
Wednesday | TBD/TBA | TBD/TBA | TBD/TBA |
Thursday | TBD/TBA | TBD/TBA | TBD/TBA |
Friday | TBD/TBA | TBD/TBA | TBD/TBA |
Saturday | TBD/TBA | TBD/TBA | TBD/TBA |
Sunday | TBD/TBA | TBD/TBA | TBD/TBA |
Policy | ||
Breakdown | ||
Score Assignment | Grading will be based on weekly quizzes (24%), homeworks (50%) and a course project (25%). Note that 1% of your grade is assigned to Attendance. | |
Quizzes | ||
Quizzes |
There will be weekly quizzes.
|
|
Assignments | ||
Assignments | There will be five assignments in all. Assignments will include autolab
components, where you must complete designated tasks, and a kaggle component
where you compete with your colleagues.
|
|
Project | ||
Project |
|
|
Attendance | ||
Attendance |
|
|
Final grade | ||
Final grade | The end-of-term grade is curved. Your overall grade will depend on your performance relative to your classmates. | |
Pass/Fail | ||
Pass/Fail | Students registered for pass/fail must complete all quizzes, HWs and if they are in the graduate course, the project. A grade equivalent to B- is required to pass the course. | |
Auditing | ||
Auditing | Auditors are not required to complete the course project, but must complete all quizzes and homeworks. We encourage doing a course project regardless. | |
End Policy |
This semester we will be implementing study groups. It is highly recommended that you join a study group; see the forms on the bulletin.
Piazza is what we use for discussions. You should be automatically signed up if you're enrolled at the start of the semester. If not, please sign up TBA. Also, please follow the Piazza Etiquette when you use the piazza.
AutoLab TBA is what we use to test your understand of low-level concepts, such as engineering your own libraries, implementing important algorithms, and developing optimization methods from scratch.
Kaggle is where we test your understanding and ability to extend neural network architectures discussed in lecture. Similar to how AutoLab shows scores, Kaggle also shows scores, so don't feel intimidated -- we're here to help. We work on hot AI topics, like speech recognition, face recognition, and neural machine translation.
CMU students who are not in the live lectures should watch the uploaded lectures at Media Services - Link TBA in order to get attendance credit. Links to individual videos will be posted as they are uploaded.
Our YouTube Channel is where non-CMU folks can view all lecture and recitation recordings. Videos marked “Old“ are not current, so please be aware of the video title.
The course will not follow a specific book, but will draw from a number of sources. We list relevant books at the end of this page. We will also put up links to relevant reading material for each class. Students are expected to familiarize themselves with the material before the class. The readings will sometimes be arcane and difficult to understand; if so, do not worry, we will present simpler explanations in class.
You can also find a nice catalog of models that are current in the literature here. We expect that you will be in a position to interpret, if not fully understand many of the architectures on the wiki and the catalog by the end of the course.
Lecture | Date | Topics | Slides and Video | Additional Materials | Quiz |
---|---|---|---|---|---|
0 | - |
|
TBA: |
||
1 | TBA |
|
TBA: |
|
|
2 | TBA |
|
TBA: |
||
3 | TBA |
|
TBA: |
||
4 | TBA |
|
TBA: |
||
5 | TBA |
|
TBA: |
||
6 | TBA |
|
TBA: |
||
7 | TBA |
|
TBA: |
||
8 | TBA |
|
TBA: |
||
9 | TBA |
|
TBA: |
||
10 | TBA |
|
TBA: |
||
11 | TBA |
|
TBA: |
||
12 | TBA |
|
TBA: |
||
13 | TBA |
|
TBA: |
||
14 | TBA |
|
TBA: |
||
15 | TBA |
|
TBA: |
||
16 | TBA |
|
TBA: | ||
17 | TBA |
|
TBA: |
||
18 | TBA |
|
TBA: |
||
19 | TBA |
|
TBA: |
||
20 | TBA |
|
TBA: |
||
21 | TBA |
|
TBA: |
||
22 | TBA |
|
TBA: |
||
23 | TBA |
|
TBA: |
||
24 | TBA |
|
TBA: |
||
25 | TBA |
|
TBA: |
||
26 | TBA |
|
TBA: |
||
27 | TBA |
|
TBA: |
Recitation | Date | Topics | Materials | Videos | Instructor |
---|---|---|---|---|---|
0A | TBA | Python & OOP Fundamentals |
TBA |
TBA | |
0B | TBA | Fundamentals of NumPy |
|
TBA | |
0C | TBA | PyTorch Tensor Fundamentals |
TBA |
TBA | |
0D | TBA | Dataset & DataLoaders | TBA | ||
0E | TBA | Introduction to Google Colab | TBA | ||
0F | TBA | AWS Fundamentals | TBA | ||
0G | TBA | Debugging, Monitoring |
|
TBA | |
0H | TBA | Remote Notebooks |
|
TBA | |
0I | TBA | What to do if you're struggling | TBA | ||
0J | Due: TBA | Data Preprocessing | TBA | ||
1 | TBA | Your first MLP Code | TBA | ||
2 | TBA | Optimizing the Networks, Ensembles | TBA | ||
HW1 Bootcamp | TBA | How to get started with HW1 | TBA | ||
3 | TBA | Computing Derivatives & Autograd | TBA | ||
4 | TBA | Hyperparameters Tuning | TBA | ||
5 | TBA | CNN: Basics & Backprop | TBA | ||
HW2 Bootcamp | TBA | How to get started with HW2 | TBA | ||
6 | TBA | CNNs: Classification & Verification | TBA | ||
7 | TBA | Paper Writing Workshop | TBA | ||
8 | TBA | RNN Basics (Pre-recorded) | TBA | ||
9 | TBA | CTC, Beam Search | TBA | ||
HW3 Bootcamp | TBA | How to get started with HW3 | TBA | ||
10 | TBA | Attention, MT, LAS | TBA | ||
11 | Apr 1, 2022 | Transformers | TBA | ||
HW4 Bootcamp | April 6, 2022 | How to get started with HW4 | TBA | 12 | TBA | Generative Adversarial Networks (GANs) + HW5 Bootcamp | TBA |
13 | TBA | Graph Neural Networks | TBA | ||
14 | Pre-recorded | YOLO | TBA |
∑ Ongoing, ∏ Upcoming
Assignment | Release Date | Due Date | Related Materials / Links |
---|---|---|---|
HW0p1 | TBA | TBA TBA |
(see recitation 0s) |
HW0p2 | TBA | TBA TBA |
(see recitation 0s) |
HW1p1 | TBA | TBA TBA |
|
HW1p2 | TBA | Early Submission: TBA TBA |
|
Final: TBA TBA |
|||
HW1 Bonus | TBA | TBA TBA |
|
Project Proposal | - | TBA | |
HW2p1 | TBA | TBA TBA |
|
HW2p2 | TBA | Early Submission: TBA TBA |
|
Final: TBA TBA |
|||
Project Midterm Report | - | TBA | |
HW3p1 | TBA | TBA TBA |
|
HW3p2 | TBA | Early Submission: TBA TBA |
|
Final: TBA TBA |
|||
HW4p1 | TBA | TBA TBA |
|
HW4p2 | TBA | Early Submission (Bonus): TBA TBA |
|
Final: TBA TBA |
|||
Final Project Video Presentation & Preiliminary Project Report | TBA |
TBA TBA |
|
Project Peer reviews |
TBA |
TBA TBA |
- |
Final Project Report Submission | - |
TBA TBA |
This is a selection of optional textbooks you may find useful