AI & machine learning2024 · shared on Hacker News
Mixtral 8x7B: A sparse Mixture of Experts language model
A starting point for exploring sparse mixture-of-experts language models.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Ymeetpateltech ·
Gemma: New Open Models
1,129 points509 comments
Yignoramous ·
Mixtral 8x7B: A sparse Mixture of Experts language model
359 points150 comments
YBUFU ·
What happens if we remove 50 percent of Llama?
231 points132 comments
Yvarunvummadi ·
Mistral AI launches Mixtral-Next
204 points49 comments
Yfamouswaffles ·
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
174 points33 comments
Ysscaryterry ·
Small AI Models Gain Traction In places with unreliable networks
1 points0 comments
Yvforno ·
Getting GLM 5.2 running on my slow computer
1 points0 comments