<aside> 💡 Who is this curriculum for: The advanced track is prepared for club members who have finished intro track and wish to have more hands-on experience in technical perspective on relevant AI Safety technologies. This semester's curriculum will delve into NLP and LLM, gradually introducing basic deep learning skills, transformer, and relevant safety topics.

</aside>

📆 Schedule

Week 1️⃣: Introduction to Deep Learning

In this class, we will build a neural network using PyTorch to classify images.

<aside> 📚 Pre-class readings

• A short introduction to machine learning
• But what is a neural network? | Chapter 1
• Gradient descent, how neural networks learn | Chapter 2 </aside>

Week 2️⃣: Backpropagation and Gradient-Based Adversarial Attacks

In this class, we will build adversarial attacks against an image classifier.

<aside> 📚 Pre-class readings

• What is backpropagation really doing? | Chapter 3
• Introduction to PyTorch </aside>

Week 3️⃣: Introduction to Language Modeling

In this class, we will download and run GPT-2.

<aside> 📚 Pre-class readings

• Large language models, explained with a minimum of math and jargon

Extra readings

• Summary of the tokenizers
• An interesting paper on training data
• A great introduction to decoding strategies
• A more advanced paper proposing a new decoding technique
• Word2Vec paper
• More HuggingFace tutorials
  • text classification
  • question answering
  • summarization
  • generation
  • fine-tuning </aside>

Week 4️⃣: Fine-tuning Language Models

In this class, we’ll finetune GPT-2 for IMDB movie reviews.

<aside> 📚 Pre-class readings

• RLHF: Reinforcement Learning from Human Feedback </aside>

Week 5️⃣: Self-Attention