人工智能2023 · 分享于 Hacker News

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

探索《LLM in a Flash: Efficient Large Language Model Inference with Limited Memory》的原文与 Hacker News 社区讨论,查看来源并加入阅读清单。

阅读原文

看看社区如何讨论这个想法。

来自 Hacker News 的原始讨论。不同的视角、疑问,以及值得继续思考的线索。

最多展示 100 条相关讨论。论文可能出现在评论中,并非原帖投稿内容。

在讨论中发现的引用

按 HN 条目顺序展示最近的 50 条引用来源。

Yweirdcat ·

Ferret: A Multimodal Large Language Model

621 赞同308 评论
Yhomarp ·

Towards 1-bit Machine Learning Models

351 赞同157 评论
Ythunderbong ·

Apple wants AI to run directly on its hardware instead of in the cloud

235 赞同203 评论
YBAAIBeijing ·

Show HN: Emu2 – A Gemini-like open-source 37B Multimodal Model

153 赞同27 评论
Ytosh ·

Apple Closes in on Deal with OpenAI to Put ChatGPT on iPhone

62 赞同49 评论
Ysteveharing1 ·

Granite 4.1: IBM's 8B Model Matching 32B MoE

27 赞同5 评论
Yrntn ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

18 赞同1 评论
Ykeep_reading ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

12 赞同1 评论
Ym-hodges ·

Qwen3.5-397B at 4.74 tok/s using 5.9GB RAM

10 赞同0 评论
Yanemll ·

iPhone 17 Pro Demonstrated Running a 400B LLM

6 赞同5 评论
Yghshephard ·

Apple Announces LLM in a Flash: Efficient LLM Inference with Limited Memory

5 赞同1 评论
Yrobin_reala ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

5 赞同0 评论
Yinterpol_p ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

3 赞同0 评论
Ysherlockxu ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

3 赞同1 评论
YPaulHoule ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

3 赞同0 评论
Ysaikatsg ·

LLM in a Flash

2 赞同0 评论
Yabhinavk ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

2 赞同0 评论
Ympweiher ·

LLM in a Flash: Efficient Large Language Model Inference with Limited Memory

1 赞同0 评论
Y_ktnd ·

Ask HN: How to execute an 180B+ LLM on a Turing machine?

1 赞同0 评论

一个想法,引向另一个。

发现更多论文