AI & machine learning2022 · shared on Hacker News
Flash Attention accelerates GPT2 3x
Explore Flash Attention accelerates GPT2 3x, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Ytspeterkim ·
Show HN: Flash Attention in ~100 lines of CUDA
230 points39 comments
Ynojito ·
LongRoPE: Extending LLM Context Window Beyond 2M Tokens
142 points46 comments
Ydavidbarker ·
Stability AI Launches the First of Its StableLM Suite of Language Models
76 points15 comments
Ykaveenk ·
GPT3/DALL-E2 in Discord, chat like ChatGPT, generate images, and more
12 points3 comments
Ybx376 ·
GPT-4 Details Leaked
4 points0 comments
Yelegantly ·
400x AI Acceleration
4 points1 comments
Yyarapavan ·
The Coming of Local LLMs
3 points0 comments
Ysmcleod ·
GGML Flash Attention support merged into llama.cpp
3 points1 comments
Ysinenomine ·
Flash Attention accelerates GPT2 3x
2 points1 comments
Yghshephard ·
LLM in a Flash: Efficient LLM Inference with Limited Memory
2 points0 comments
Yfzliu ·
Flash Attention
1 points0 comments
Yftxbro ·
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
1 points1 comments
YTaurenHunter ·
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
1 points1 comments