AI & machine learning2020 · shared on Hacker News

Scaling Laws for Neural Language Models

Explore Scaling Laws for Neural Language Models, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.

Read original

The conversation around the idea.

Original Hacker News threads. Different perspectives, questions, and things worth thinking about.

Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.

Links found in the discussion

Up to 50 recent source links, in HN item order.

Yjspann ·

OpenAI to become for-profit company

1,346 points745 comments
Ysieste ·

GPT-Neo – Building a GPT-3-sized model, open source and free

725 points252 comments
Yeigenvalue ·

The impact of competition and DeepSeek on Nvidia

655 points479 comments
Ysh_tomer ·

Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”

313 points110 comments
Yhnhn34 ·

Understanding the Limitations of Mathematical Reasoning in LLMs

282 points266 comments
Yhomarp ·

Pathways Language Model (PaLM): Scaling to 540B parameters

235 points207 comments
YTenoke ·

Talking to myself: how I trained GPT2-1.5b for rubber ducking using my chat data

217 points67 comments
Ymfiguiere ·

Mark Zuckerberg’s new goal is creating artificial general intelligence

209 points338 comments
Ysebg ·

Learning@home hivemind – train large neural networks across the internet

148 points38 comments
Ydbrereton ·

Bing AI Can't Be Trusted

142 points58 comments
Ygsky ·

OpenAI in throes of executive exodus as three walk at once

137 points128 comments
Ytmfi ·

Complexity No Bar to AI

120 points118 comments
Yselimonder ·

Megatron-Turing NLG 530B, the World’s Largest Generative Language Model

116 points99 comments
Ynsoonhui ·

It’s Like GPT-3 but for Code – Fun, Fast, and Full of Flaws

91 points68 comments
Ynpmipg ·

GPU-rich labs have won: What's left for the rest of us is distillation

88 points50 comments
Yfzliu ·

Matryoshka Representation Learning

83 points11 comments
Yebalit ·

AMD Open-Source 1B OLMo Language Models

78 points33 comments
Ylnyan ·

Program Synthesis with Large Language Models

63 points20 comments
Yminimaxir ·

Introducing ChatGPT and Whisper APIs

53 points17 comments
Yupmind ·

Ask HN: How worried are you about being replaced by an LLM

18 points47 comments
Yksec ·

Intel Announces Aurora GenAI, ChatGPT Competitor with 1T Parameters

15 points0 comments
Ymfiguiere ·

LLaMA: A foundational, 65B-parameter large language model

12 points6 comments
Ykiyanwang ·

"It's a lemon"–OpenAI's largest AI model ever arrives to mixed reviews

5 points4 comments
YDDSDev ·

OpenAI’s CEO confirms the company isn’t training GPT-5 and ‘won’t for some time’

4 points3 comments
Ybirriel ·

How Is LLaMa.cpp Possible?

4 points0 comments
Yatg_abhishek ·

Scaling Laws for Neural Language Models

3 points0 comments
Yjnord ·

Jensen Huang says Nvidia is pulling back from OpenAI and Anthropic

3 points0 comments
Yoshrimpton ·

GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2

3 points0 comments
YLordNibbler ·

Scaling Laws for Neural Language Models

2 points0 comments
Ydoener ·

Newer data once again shows: the human brain is just a scaled up primate brain

2 points0 comments
Ysnow_mac ·

Which GPU(s) to Get for Deep Learning

2 points1 comments
Ybelter ·

Do large language models need all those layers?

2 points0 comments
Yashvardanian ·

Transcending Scaling Laws with 0.1% Extra Compute

1 points0 comments
Yffwd ·

Ask HN: How “real” are AI scaling laws?

1 points1 comments
Yvinhnx ·

The Problem with LLMs

1 points0 comments
Yelsewhen ·

US Is Starting to See Heavy Job Losses in Roles Exposed to AI

1 points0 comments
Ynotmcrowley ·

30papers.com – Ilya's 30 essential ML papers, in a beginner friendly format

1 points0 comments

One idea leads to another.

Explore more papers