Computer science2024 · shared on Hacker News
What Algorithms Can Transformers Learn? A Study in Length Generalization
Explore What Algorithms Can Transformers Learn? A Study in Length Generalization, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yhenrik_w ·
What can LLMs never do?
460 points374 comments
Yzxexz ·
Byte Latent Transformer: Patches Scale Better Than Tokens
378 points84 comments
YAnon84 ·
Every model learned by gradient descent is approximately a kernel machine (2020)
176 points136 comments
Ysebg ·
What Algorithms Can Transformers Learn? A Study in Length Generalization
2 points1 comments