Ideas & society2023 · shared on Hacker News
RWKV: Reinventing RNNs for the Transformer Era
Explore RWKV: Reinventing RNNs for the Transformer Era, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yguybedo ·
Eagle 7B: Soaring past Transformers
400 points81 comments
Ymilliondreams ·
Mixture-of-Depths: Dynamically allocating compute in transformers
281 points83 comments
Ytaiboku256 ·
Ask HN: Is anybody building an alternative transformer?
148 points93 comments
Yianbutler ·
RWKV: Reinventing RNNs for the Transformer Era
60 points31 comments
Ymatt_d ·
FlashAttention-T: Towards Tensorized Attention
12 points0 comments
Yreachableceo ·
Is anyone using self hosted LLM day to day and training it like a new employee
6 points0 comments
Ymottiden ·
Scaling Transformers to 1B Tokens
1 points0 comments
Yminimaxir ·
Paving the way to efficient architectures: StripedHyena-7B
1 points0 comments