Ideas & society2023 · shared on Hacker News
Megabyte: Predicting Million-Byte Sequences with Multiscale Transformers
Explore Megabyte: Predicting Million-Byte Sequences with Multiscale Transformers, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Ykarimf ·
Neural audio codecs: how to get audio into LLMs
428 points119 comments
Ynojito ·
LongRoPE: Extending LLM Context Window Beyond 2M Tokens
142 points46 comments
Ythunderbong ·
Meta AI Unleashes Megabyte, a Revolutionary Scalable Model Architecture
3 points0 comments
Ykordlessagain ·
Megabyte: Predicting Million-Byte Sequences with Multiscale Transformers
2 points0 comments
Ybeefman ·
Megabyte: Predicting Million-Byte Sequences with Multiscale Transformers
1 points0 comments
Yftxbro ·
Meta AI Megabyte: Predicting Million-Byte Sequences with Multiscale Transformers
1 points0 comments
Ypmoriarty ·
Bytes Are All You Need: Transformers Operating Directly on File Bytes
1 points0 comments
Ygoranmoomin ·
Weird GPT-4 behavior for the specific string “ davidjl”
1 points0 comments