\( \newcommand{\vect}[1]{\mathbf{#1}} \newcommand{\mat}[1]{\mathbf{#1}} \newcommand{\R}{\mathbb{R}} \newcommand{\E}{\mathbb{E}} \newcommand{\Prob}{\mathbb{P}} \newcommand{\T}{^{\top}} \newcommand{\norm}[1]{\lVert #1 \rVert} \newcommand{\abs}[1]{\lvert #1 \rvert} \newcommand{\ihat}{\mkern1mu\hat{\boldsymbol{\imath}}\mkern2mu} \newcommand{\jhat}{\mkern1mu\hat{\boldsymbol{\jmath}}\mkern2mu} \newcommand{\pd}[2]{\frac{\partial #1}{\partial #2}} \newcommand{\argmax}{\operatorname*{arg\,max}} \newcommand{\argmin}{\operatorname*{arg\,min}} \newcommand{\cdata}[1]{\class{c-data}{#1}} \newcommand{\cmodel}[1]{\class{c-model}{#1}} \newcommand{\ctruth}[1]{\class{c-truth}{#1}} \newcommand{\cgrad}[1]{\class{c-grad}{#1}} \newcommand{\closs}[1]{\class{c-loss}{#1}} \newcommand{\cparam}[1]{\class{c-param}{#1}} \newcommand{\csecond}[1]{\class{c-second}{#1}} \renewcommand{\,}{\mkern3mu} \)

DL07 · Generative Models II: Diffusion and Flow Matching

A free, illustrated L3 to L4 course of 10 modules in the Deep Learning track. Modules include: Denoising diffusion models; Score matching; The SDE and ODE views.

DL07 L3 to L4 · Advanced to Expert 10 modules · about 40 lessons Planned · Ring 4

Part of the Deep Learning track. Ships in Ring 4 (Expert) of the roadmap.

Modules

1. Denoising diffusion models
2. Score matching
3. The SDE and ODE views
4. Samplers and fast sampling
5. Guidance and conditioning
6. Latent diffusion
7. Flow matching and rectified flow
8. Architectures from U-Net to diffusion transformers
9. Consistency models and distillation
10. Video, 3D and discrete diffusion

Signature illustrations

The pictures a learner should still see in their head a year later:

Strips of forward noising, arrows of a score field, fans of sampling trajectories, grids across guidance scale, straight versus curved flow paths.

Status

This course is planned, not written yet. It ships with Ring 4 (Expert).

Every lesson will follow the same twelve-part blueprint with at least three purpose-made figures. Watch the repository to hear when modules ship, or help write and review it.