SDSU CS 696 Applied Large Language Models
Spring Semester, 2025
Lecture Notes
DCS
To Course Web Site
San Diego State University -- This page was last updated on 27-Mar-25

This page contains links to lecture notes for the CS 696 Applied Large Language Models course. This page will be updated as more notes become available.

Lecture Notes By Topic
  1. Course Introduction
  2. NN Review
  3. NN Review 2
  4. Running Models
  5. Tokens
  6. Cluster, Embedding, Attention
  7. News, Model, Attention
  8. Reducing Heads
  9. GPU Cluster, Attention, GPT Model
  10. Attention, GPT Model, Training
  11. Assignment 2
  12. Training
  13. Fine Tuning 1 Revised
  14. Fine Tuning 2
  15. Hooks, Continually Pre-train, DPO
  16. DPO, DeepSeekMath, GRPO
  17. Assignment 2, Performance Issues
  18. News, Activation Steering, Performance Issues V2
  19. Prompt Engineering

Lecture Video By Date
Tuesday Thursday
Jan 21 Course Introduction Jan 23 NN Review
Jan 28 News, NN Review, Tokens Jan 30 Tokens, Embeding
Feb 4 News, Model, Attention Feb 6 Reducing Heads
Feb 11 GPU Cluster, Attention, GPT Model Feb 13 GPU Cluster, Attention, GPT Model
Feb 18 Assignment 2 Feb 20 Training, Fine Tuning
Feb 25 Fine Tuning Feb 27 Finetuning 2
Mar 4 Hooks, Continually Pre-train, DPO Mar 6 DPO, DeepSeekMath, GRPO
Mar 11 Exam Mar 13 Assignment 2, Performance Issues
Mar 18 News, Activation Steering, Performance Issues Mar 20 News, Activation Steering, Performance Issues
Mar 25 Project Proposal Mar 27 Prompt Engineering
Apr 1 Spring Break Apr 3 Spring Break
Apr 8 Apr 10 Project Milestone
Apr 15 Apr 17
Apr 22 Apr 24
Apr 29 Apr 30
May 6 May 8 Last Class
May 13 May 15 Projects Due