AI & machine learning2025 · shared on Hacker News
DeepSeek Native Sparse Attention
Explore DeepSeek Native Sparse Attention, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
YAlifatisk ·
Google Titans architecture, helping AI have long-term memory
587 points186 comments
Yshallow-mind ·
Bamba: An open-source LLM that crosses a transformer with an SSM
207 points69 comments
Ymirrir ·
Zebra-Llama – Towards efficient hybrid models
113 points61 comments
Ybandwitch ·
DeepSeek Native Sparse Attention
16 points1 comments
Ymfiguiere ·
Native Sparse Attention: Hardware-Aligned, Natively Trainable Sparse Attention
15 points2 comments
Yunignorant ·
NSA: Hardware-Aligned and Natively Trainable Sparse Attention
4 points2 comments
Yteepo ·
Native Sparse Attention: Hardware-Aligned and Natively Trainable
2 points0 comments
YPaulHoule ·
HW-Aligned Sparse Attention Architecture for Efficient Long-Context Modeling
2 points0 comments