AI & machine learning2023 · shared on Hacker News
Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training
Explore Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Ytosh ·
Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training
54 points2 comments
Ydrhodes ·
MITx Differential Equations starts May 31
20 points5 comments
Ym00x ·
Introducing the Sophia optimizer, a faster alternative to AdamW
4 points1 comments
Ykelseyfrog ·
Sophia: A Scalable Stochastic Second-Order Optimizer
2 points0 comments
Yprogramd ·
Sophia: A Scalable Stochastic Optimizer for Language Model Pre-Training
2 points0 comments
Ysonabinu ·
Risky Giant Steps Can Solve Optimization Problems Faster
2 points0 comments
YAnon84 ·
Sophia: A Scalable Second-Order Optimizer for Language Model Pre-Training
2 points0 comments
Yalechammond ·
Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training
1 points0 comments
Ymontebicyclelo ·
Notes on training BERT from scratch on an 8GB consumer GPU
1 points0 comments