AI & machine learning2021 · shared on Hacker News
Pay Attention to MLPs
Explore Pay Attention to MLPs, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Yrohitpaulk ·
Visualizing Attention, a Transformer's Heart [video]
999 points172 comments
Yfzliu ·
A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNet
3 points0 comments
Yfzliu ·
Pay Attention to MLPs
3 points0 comments
Yjonathanbgn ·
Pay Attention to MLPs
2 points0 comments
Yred2awn ·
Gated MLP performs on par with transformers
1 points0 comments