AI & machine learning2024 · shared on Hacker News

Infini-Gram: Scaling unbounded n-gram language models to a trillion tokens

Explore Infini-Gram: Scaling unbounded n-gram language models to a trillion tokens, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.

Read original

The conversation around the idea.

Original Hacker News threads. Different perspectives, questions, and things worth thinking about.

Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.

Links found in the discussion

Up to 50 recent source links, in HN item order.

Yingve ·

What's the strongest AI model you can train on a laptop in five minutes?

571 points194 comments
Yscrlk ·

A new Google model is nearly perfect on automated handwriting recognition

553 points313 comments
Ychilipepperhott ·

Markov Chains are the Original Language Models

251 points170 comments
YJPLeRouzic ·

Ask HN: How are Markov chains so different from tiny LLMs?

204 points189 comments
Ynsagent ·

Infini-Gram: Scaling unbounded n-gram language models to a trillion tokens

142 points58 comments
Ysupriyo-biswas ·

Transformers Represent Belief State Geometry in Their Residual Stream

85 points19 comments
YPaulHoule ·

Infini-Gram: Scaling Unbounded N-Gram Language Models to a Trillion Tokens

3 points0 comments
Ynsagent ·

Infini-Gram: Scaling unbounded n-gram language models to a trillion tokens

2 points1 comments
Yadunk ·

Soul Player C64 – A real transformer running on a 1 MHz Commodore 64

2 points0 comments

One idea leads to another.

Explore more papers