Ideas & society2022 · shared on Hacker News
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
Explore LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yingve ·
Hot Chips 34: AMD’s Instinct MI200 Architecture
102 points30 comments
Yelbasti ·
Transformer Attention is off by one
79 points10 comments
Ygeorgehill ·
Optimizing AI Inference at Character.ai
63 points6 comments
Ytosh ·
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
15 points2 comments
Yofirpress ·
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale
7 points1 comments
Yeternalban ·
How to Train Large Models on Many GPUs?
1 points0 comments
Ysillysaurusx ·
Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
1 points0 comments
Ytim_sw ·
Billion-Scale Approximate Nearest Neighbor Search [pdf]
1 points0 comments
YGarcia98 ·
QLoRA: Efficient Finetuning of Quantized LLMs
1 points0 comments