What are Diffusion Models? | Lil'Log
5
Public whispers
5
Contributors
2026-07-27 10:01:22
First whispered
Public whispers on this page
Text Highlight2026-07-27 13:22:22
Original Highlight Excerpt
"stochastic gradient Langevin dynamics injects Gaussian noise into the parameter updates to avoid collapses into local minima."
Whisper Note
Huh, but doesn't the noise mess up the final accuracy sometimes?
Text Highlight2026-07-27 13:13:22
Original Highlight Excerpt
"stochastic gradient Langevin dynamics injects Gaussian noise into the parameter updates to avoid collapses into local minima."
Whisper Note
So it's like adding a little randomness to not get stuck, makes sense.
Text Highlight2026-07-27 10:19:22
Original Highlight Excerpt
"Diffusion models are inspired by non-equilibrium thermodynamics."
Whisper Note
But how is that different from just adding noise, though?
Text Highlight2026-07-27 10:10:22
Original Highlight Excerpt
"Diffusion models are inspired by non-equilibrium thermodynamics."
Whisper Note
Makes sense why my physics background finally pays off.
Text Highlight2026-07-27 10:01:22
Original Highlight Excerpt
"Diffusion models are inspired by non-equilibrium thermodynamics."
Whisper Note
So basically they're just fancy thermodynamics, huh.
Share this page's whispers
Short link
https://domwhisper.com/s/3bed1fb32c03Embed snippet
<iframe src="https://domwhisper.com/embed/3bed1fb32c03" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>See what people are discussing on lilianweng.github.io
Install DomWhisper to view live whispers as you browse, and join the discussion.
Get the extension