Computer science2024 · shared on Hacker News

What Algorithms Can Transformers Learn? A Study in Length Generalization

Explore What Algorithms Can Transformers Learn? A Study in Length Generalization, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.

Read original

The conversation around the idea.

Original Hacker News threads. Different perspectives, questions, and things worth thinking about.

Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.

Links found in the discussion

Up to 50 recent source links, in HN item order.

Yhenrik_w ·

What can LLMs never do?

460 points374 comments
Yzxexz ·

Byte Latent Transformer: Patches Scale Better Than Tokens

378 points84 comments
YAnon84 ·

Every model learned by gradient descent is approximately a kernel machine (2020)

176 points136 comments
Ysebg ·

What Algorithms Can Transformers Learn? A Study in Length Generalization

2 points1 comments

One idea leads to another.

Explore more papers