SDSU CS 696 Applied Large Language Models
Spring Semester, 2025
Lecture Notes
DCS
To Course Web Site
San Diego State University -- This page was last updated on 1-May-25

This page contains links to lecture notes for the CS 696 Applied Large Language Models course. This page will be updated as more notes become available.

Lecture Notes By Topic
  1. Course Introduction
  2. NN Review
  3. NN Review 2
  4. Running Models
  5. Tokens
  6. Cluster, Embedding, Attention
  7. News, Model, Attention
  8. Reducing Heads
  9. GPU Cluster, Attention, GPT Model
  10. Attention, GPT Model, Training
  11. Assignment 2
  12. Training
  13. Fine Tuning 1 Revised
  14. Fine Tuning 2
  15. Hooks, Continually Pre-train, DPO
  16. DPO, DeepSeekMath, GRPO
  17. Assignment 2, Performance Issues
  18. News, Activation Steering, Performance Issues V2
  19. Prompt Engineering
  20. News, LangChain
  21. News, LangChain 2
  22. RAG
  23. Exam
  24. MLOPs
  25. News, More RAG
  26. End Comments

Lecture Video By Date
Tuesday Thursday
Jan 21 Course Introduction Jan 23 NN Review
Jan 28 News, NN Review, Tokens Jan 30 Tokens, Embeding
Feb 4 News, Model, Attention Feb 6 Reducing Heads
Feb 11 GPU Cluster, Attention, GPT Model Feb 13 GPU Cluster, Attention, GPT Model
Feb 18 Assignment 2 Feb 20 Training, Fine Tuning
Feb 25 Fine Tuning Feb 27 Finetuning 2
Mar 4 Hooks, Continually Pre-train, DPO Mar 6 DPO, DeepSeekMath, GRPO
Mar 11 Exam Mar 13 Assignment 2, Performance Issues
Mar 18 News, Activation Steering, Performance Issues Mar 20 News, Activation Steering, Performance Issues
Mar 25 Project Proposal Mar 27 Prompt Engineering
Apr 1 Spring Break Apr 3 Spring Break
Apr 8 News, LangChain Apr 10 Project Milestone
Apr 15 News, LangChain 2 Apr 17 RAG
Apr 22 Exam Apr 24 MLOPs
Apr 29 News, More RAG May 1 End Comments
May 6 May 8 Last Class
May 13 May 15 Projects Due