人工智能2021 · 分享于 Hacker News

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

探索《The Pile: An 800GB Dataset of Diverse Text for Language Modeling》的原文与 Hacker News 社区讨论,查看来源并加入阅读清单。

阅读原文

看看社区如何讨论这个想法。

来自 Hacker News 的原始讨论。不同的视角、疑问,以及值得继续思考的线索。

最多展示 100 条相关讨论。论文可能出现在评论中,并非原帖投稿内容。

在讨论中发现的引用

按 HN 条目顺序展示最近的 50 条引用来源。

Ygameshot911 ·

Meta torrented & seeded 81.7 TB dataset containing copyrighted data

1,270 赞同938 评论
Yjasondavies ·

DBRX: A new open LLM

866 赞同343 评论
Ycanada_dry ·

GPT-J-6B – A 6 billion parameter, autoregressive text generation model

636 赞同146 评论
Ycrazypython ·

Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

263 赞同134 评论
Ywebmaven ·

The makers of Eleuther hope it will be an open source alternative to GPT-3

145 赞同95 评论
Ysohkamyung ·

Greater than 99% consensus on human caused climate change in the literature

137 赞同282 评论
Yskilled ·

X updates Terms to allow it to use data for AI training

92 赞同56 评论
YFanaHOVA ·

LLaMA2 isn't “Open Source” – and why it doesn't matter

28 赞同6 评论
Yoccamschainsaw ·

Just know stuff. (Or, how to achieve success in a machine learning PhD)

27 赞同3 评论
Yaresende ·

OpenSubtitles is not open anymore

17 赞同8 评论
Ycolesantiago ·

Google Announces Layoffs: A difficult decision to set us up for the future

9 赞同0 评论
Yeqmvii ·

Tell HN: ChatGPT can reply like a specific Reddit or HN user, including you

8 赞同1 评论
YJuliusSu ·

How good could GTP-4 get if copyright was not an issue?

6 赞同3 评论
Yijk ·

Scaling Data-Constrained Language Models

4 赞同0 评论
YTomte ·

Sarah Silverman is suing OpenAI and Meta for copyright infringement

4 赞同0 评论
Ytosh ·

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

3 赞同1 评论
Yandyxor ·

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

2 赞同1 评论
Ynigamanth ·

The Limits of GPT-3 and Similar Large Language Models

2 赞同0 评论
Ytomduncalf ·

David Guetta uses ChatGPT and uberduck.ai to create fake Eminem rap for DJ set

2 赞同0 评论
Ycharlysl ·

The Pile: a dataset for language modeling [pdf]

2 赞同0 评论
Yllmmadness ·

Even 'uncensored' models can't say what they want

2 赞同1 评论
Ysharemywin ·

Could an open source/data GPT like chatbot be created?

1 赞同0 评论
Ymfabbri77 ·

ChatGPT playing a not so simple game

1 赞同0 评论
Yasim ·

Ask HN: Can you crowdfund the compute for GPT?

1 赞同0 评论
Ytim_sw ·

RedPajama: Reproduction of Llama with Friendly License (Stanford, MILA Quebec)

1 赞同0 评论
Yskilled ·

What OpenAI Really Wants

1 赞同1 评论
Ybirriel ·

Phi-2: The surprising power of small language models

1 赞同0 评论

一个想法,引向另一个。

发现更多论文