AI & machine learning2023 · shared on Hacker News
Attention with Linear Biases (ALiBi)
Explore Attention with Linear Biases (ALiBi), its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yweirdcat ·
Differential Transformer
562 points177 comments
Yszermer ·
ChatGPT for Teams
436 points418 comments
Ysamwillis ·
Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words
69 points24 comments
Ynickthegreek ·
Code Llama, an AI tool for coding
47 points10 comments
Yswyx ·
Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week
3 points0 comments
Ypmoriarty ·
Attention with Linear Biases (ALiBi)
3 points0 comments