Attention Is All You Need - Wikipedia
6
Public whispers
6
Contributors
2026-07-20 09:17:01
First whispered
Public whispers on this page
Text Highlight2026-07-20 15:41:01
Original Highlight Excerpt
"We chose the sinusoidal version because it may allow the model to extrapolate to sequence lengths longer than the ones encountered during training."
Whisper Note
Sinusoidal positions really do help with longer sequences, nice choice.
Text Highlight2026-07-20 12:38:01
Original Highlight Excerpt
"the paper has been cited more than 250,000 times, placing it among the top ten most-cited papers of the 21st century"
Whisper Note
Guess the authors knew it was peak, all jumped ship right after lol.
Text Highlight2026-07-20 12:29:01
Original Highlight Excerpt
"the paper has been cited more than 250,000 times, placing it among the top ten most-cited papers of the 21st century"
Whisper Note
250k citations is insane, but honestly the paper deserves it, it changed everything.
Text Highlight2026-07-20 09:35:01
Original Highlight Excerpt
"The paper introduced a new deep learning architecture known as the transformer"
Whisper Note
I remember reading this back then; felt like a neat tweak, not a revolution.
Text Highlight2026-07-20 09:26:01
Original Highlight Excerpt
"The paper introduced a new deep learning architecture known as the transformer"
Whisper Note
Honestly, the 'foreseeing' part is impressive, but they didn't fully predict the scale.
Text Highlight2026-07-20 09:17:01
Original Highlight Excerpt
"The paper introduced a new deep learning architecture known as the transformer"
Whisper Note
So this is where the whole GPT craze started—crazy to think it's just 2017.
Share this page's whispers
Short link
https://domwhisper.com/s/34c4c8ee90c4Embed snippet
<iframe src="https://domwhisper.com/embed/34c4c8ee90c4" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>See what people are discussing on en.wikipedia.org
Install DomWhisper to view live whispers as you browse, and join the discussion.
Get the extension