[2403.05530] Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
[2403.05530] Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
273
公开标注数
7
参与人数
2026-06-28 09:09:18
首次 Whisper
讨论活跃度
arxiv.org 近 17 周的公开 Whisper
少多
最新公开 Whisper
划选高亮2026-08-12 13:35:25
原文高亮摘录
“capable of recalling and reasoning over fine-grained information”
Whisper 随想笔记
Recalling fine-grained stuff is cool, but I'd rather see it not hallucinate the details first.
划选高亮2026-08-12 13:26:25
原文高亮摘录
“capable of recalling and reasoning over fine-grained information”
Whisper 随想笔记
10M tokens is wild, but can it actually find that one specific line in a 500-page PDF?
划选高亮2026-08-12 10:32:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Still waiting for the open source model that does this without breaking the bank.
划选高亮2026-08-12 10:23:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Million token context is wild, finally can throw whole codebases at it.
划选高亮2026-08-12 10:14:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Compute-efficient but what about the energy cost for training these things?
划选高亮2026-08-11 18:38:31
原文高亮摘录
“QLoRA backprop”
Whisper 随想笔记
My 48GB card finally feels useful for something other than gaming.
划选高亮2026-08-11 03:06:31
原文高亮摘录
“General reasoning represents a long-standing and formidable challenge”
Whisper 随想笔记
The abstract is truncated, but DeepSeek-R1's RL approach sounds really promising.
划选高亮2026-08-10 14:32:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
multilinguality is cool but tool usage is where it's really at
划选高亮2026-08-10 14:23:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
405B params is insane, wonder how much compute that took
划选高亮2026-08-10 14:14:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
finally a model that actually gets multiple languages without breaking a sweat
划选高亮2026-07-28 16:29:34
原文高亮摘录
“reduce the training time”
Whisper 随想笔记
Finally a normalization that works for RNNs without all that batch size fuss.
划选高亮2026-07-28 16:07:22
原文高亮摘录
“arXivLabs: experimental projects with community collaborators”
Whisper 随想笔记
Is this just for the staff or can anyone pitch in?
划选高亮2026-07-28 16:05:55
原文高亮摘录
“arXivLabs: experimental projects with community collaborators”
Whisper 随想笔记
Cool, community collabs always bring fresh ideas to the table.
划选高亮2026-07-28 13:26:34
原文高亮摘录
“batch norma”
Whisper 随想笔记
Does this actually scale well for CNNs though? Batch norm felt more natural there.
划选高亮2026-07-28 13:17:34
原文高亮摘录
“batch norma”
Whisper 随想笔记
So layer norm is basically batch norm but for single examples, makes sense for RNNs.
划选高亮2026-07-28 13:04:22
原文高亮摘录
“use of consistency training on a large amount of unlabe”
Whisper 随想笔记
So basically, they found that how you add noise matters more than the amount of unlabeled data?
划选高亮2026-07-28 13:02:55
原文高亮摘录
“arXiv-issued DOI via DataCite”
Whisper 随想笔记
Huh, I always thought DOIs were just for journals, cool that arXiv does it too.
划选高亮2026-07-28 12:55:22
原文高亮摘录
“use of consistency training on a large amount of unlabe”
Whisper 随想笔记
Consistency training with better noise is the real winner here, not just the semi-supervised part.
划选高亮2026-07-28 12:53:55
原文高亮摘录
“arXiv-issued DOI via DataCite”
Whisper 随想笔记
Wait, arXiv is giving DOIs now? That's actually kinda neat.
划选高亮2026-07-28 10:23:34
原文高亮摘录
“normalize the activities of the neurons”
Whisper 随想笔记
tried it on my lstm and yeah, training felt way smoother