Ideas & society2023 · shared on Hacker News
GPTQ Accurate Post-Training Quantization for Generative Pre-Trained Transformers
Explore GPTQ Accurate Post-Training Quantization for Generative Pre-Trained Transformers, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Comment #38661763 Comment #37494660 Comment #36135608 Comment #36069346 Comment #35942032 Comment #35577219 Comment #35393898 Comment #35393773 Comment #35283442 Comment #35239175 Comment #35239016 Comment #35172271 Comment #35148542 Comment #35146184 Comment #35140963 Comment #35134081 Comment #35123568 Comment #35123559 Comment #35123296 Comment #35114832 Comment #35107058 Comment #35101594
Ybehnamoh ·
Apple: Transformer architecture optimized for Apple Silicon
143 points55 comments
Ymsoad ·
Llama.cpp 30B runs with only 6GB of RAM now
124 points26 comments
YFreddie111 ·
The genie escapes: Stanford copies the ChatGPT AI for less than $600
70 points35 comments
Yog_kalu ·
Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up
53 points17 comments
Ypr337h4m ·
LLaMa running at 5 tokens/second on a Pixel 6
39 points11 comments
Yrain1 ·
How to run Llama 13B with a 6GB graphics card
16 points0 comments
Y0xbadc0de5 ·
LLaMA Text-Generation-Webui
7 points1 comments
YMacsHeadroom ·
Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
5 points1 comments
YPalmik ·
70B Llama 2 at 35tokens/second on 4090
5 points4 comments
Ysimonw ·
Large language models are having their Stable Diffusion moment
4 points0 comments
Ymrtksn ·
LLaMA-7B in Pure C++ with full Apple Silicon support
2 points1 comments
Ytosh ·
GPTQ Accurate Post-Training Quantization for Generative Pre-Trained Transformers
2 points0 comments
Ybelter ·
Do large language models need all those layers?
2 points0 comments
Ymrv_asura ·
Matrix Calculus: Calculate derivatives of matrices
1 points0 comments
Ysuper256 ·
The tiny corp raised $5.1M
1 points0 comments