Tag: ai
Public whispers tagged ai
Text Highlight2026-08-12 13:35:25
Original Highlight Excerpt
"capable of recalling and reasoning over fine-grained information"
Whisper Note
Recalling fine-grained stuff is cool, but I'd rather see it not hallucinate the details first.
Text Highlight2026-08-12 13:26:25
Original Highlight Excerpt
"capable of recalling and reasoning over fine-grained information"
Whisper Note
10M tokens is wild, but can it actually find that one specific line in a 500-page PDF?
Text Highlight2026-08-12 10:32:25
Original Highlight Excerpt
"next generation of highly compute-efficient multimodal models"
Whisper Note
Still waiting for the open source model that does this without breaking the bank.
Text Highlight2026-08-12 10:23:25
Original Highlight Excerpt
"next generation of highly compute-efficient multimodal models"
Whisper Note
Million token context is wild, finally can throw whole codebases at it.
Text Highlight2026-08-12 10:14:25
Original Highlight Excerpt
"next generation of highly compute-efficient multimodal models"
Whisper Note
Compute-efficient but what about the energy cost for training these things?
Text Highlight2026-08-11 18:38:31
Original Highlight Excerpt
"QLoRA backprop"
Whisper Note
My 48GB card finally feels useful for something other than gaming.
Text Highlight2026-08-11 03:06:31
Original Highlight Excerpt
"General reasoning represents a long-standing and formidable challenge"
Whisper Note
The abstract is truncated, but DeepSeek-R1's RL approach sounds really promising.
Text Highlight2026-08-10 14:32:38
Original Highlight Excerpt
"a herd of language models that natively support multilingua"
Whisper Note
multilinguality is cool but tool usage is where it's really at
Text Highlight2026-08-10 14:23:38
Original Highlight Excerpt
"a herd of language models that natively support multilingua"
Whisper Note
405B params is insane, wonder how much compute that took
Text Highlight2026-08-10 14:14:38
Original Highlight Excerpt
"a herd of language models that natively support multilingua"
Whisper Note
finally a model that actually gets multiple languages without breaking a sweat
Text Highlight2026-08-08 15:09:57
Original Highlight Excerpt
"The term machine learning was coined in 1959 by Arthur Samuel"
Whisper Note
Arthur Samuel coined the term way back in 1959, that's wild.
Text Highlight2026-08-08 15:09:18
Original Highlight Excerpt
"this is sounding awfully familiar."
Whisper Note
baseline choice is like picking what 'missing' means for your model, tricky stuff.
Text Highlight2026-08-01 03:09:18
Original Highlight Excerpt
"standard interface for models, embeddings, vector stores, and more."
Whisper Note
Thats the core value prop right there, a standard interface for everything LLM.
Text Highlight2026-07-30 21:09:18
Original Highlight Excerpt
"not a modular toolbox of building blocks for neural nets."
Whisper Note
That's a refreshing take, keeping it simple for researchers to hack on.
Text Highlight2026-07-28 16:29:34
Original Highlight Excerpt
"reduce the training time"
Whisper Note
Finally a normalization that works for RNNs without all that batch size fuss.
Text Highlight2026-07-28 13:26:34
Original Highlight Excerpt
"batch norma"
Whisper Note
Does this actually scale well for CNNs though? Batch norm felt more natural there.
Text Highlight2026-07-28 13:23:53
Original Highlight Excerpt
"An energy function is a macroscopic measure of a network's activation state."
Whisper Note
Wait, so lower energy means better? That's like the opposite of what I'd expect from "energy".
Text Highlight2026-07-28 13:17:34
Original Highlight Excerpt
"batch norma"
Whisper Note
So layer norm is basically batch norm but for single examples, makes sense for RNNs.
Text Highlight2026-07-28 13:14:53
Original Highlight Excerpt
"An energy function is a macroscopic measure of a network's activation state."
Whisper Note
So it's basically using physics jargon to describe how the network settles into a stable state. Cool.
Text Highlight2026-07-28 13:04:22
Original Highlight Excerpt
"use of consistency training on a large amount of unlabe"
Whisper Note
So basically, they found that how you add noise matters more than the amount of unlabeled data?