A Recipe for Training Neural Networks

Public whispers

Contributors

2026-07-10 21:09:18

First whispered

Discussion activity

Public whispers on karpathy.github.io over the last 17 weeks

3 active days

Less

Text Highlight2026-07-13 09:09:18

Original Highlight Excerpt

"See what actions led to high rewards. Increase their probability."

Whisper Note

That's the whole trick in one line, love the simplicity.

Text Highlight2026-07-12 03:09:18

Original Highlight Excerpt

"training recurrent nets is optimization over programs"

Whisper Note

this is such a clean way to put it, programs over functions just clicks.

Text Highlight2026-07-10 21:09:18

Original Highlight Excerpt

"patience and attention to detail"

Whisper Note

so true, patience and attention to detail are everything in this game

Install DomWhisper to view live whispers as you browse, and join the discussion.