Ideas & society2018 · shared on Hacker News

BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding

Explore BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.

Read original

The conversation around the idea.

Original Hacker News threads. Different perspectives, questions, and things worth thinking about.

Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.

Links found in the discussion

Up to 50 recent source links, in HN item order.

Ymmq ·

Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award

773 points146 comments
Yvincent_s ·

OpenAI – Application for US trademark “GPT” has failed

602 points259 comments
Yputtycat ·

Machine Learning: The Great Stagnation

484 points218 comments
Yhiphipjorge ·

The Unreasonable Effectiveness of Deep Feature Extraction

324 points55 comments
Yxcodevn ·

GPT-2: 6-Month Follow-Up

160 points93 comments
Ysachaarbonel ·

Building a semantic search engine in Rust

136 points27 comments
YArtWomb ·

TensorFlow Code for Google Research's BERT: Pre-Training Method for NLP Tasks

129 points13 comments
Ynshm ·

Microsoft’s New MT-DNN Outperforms Google BERT

121 points38 comments
Ytheafh ·

Google Research: Looking Back at 2019, and Forward to 2020 and Beyond

96 points14 comments
Ymoondistance ·

New AI Training Technique Is Drastically Faster, Says Google

84 points38 comments
Yandreyk ·

Beyond Local Pattern Matching: Recent Advances in Machine Reading

80 points18 comments
Yliviosoares ·

BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding

78 points5 comments
Ykartayyar ·

Generalized Language Models

40 points3 comments
YMurizS ·

AlphaCode Attention Visualization

23 points7 comments
YEGreg ·

Google internally developed chatbots like ChatGPT years ago

7 points2 comments
Ydragonmouse ·

Ask HN: How to Break into AI Engineering

7 points1 comments
Ymelvinmelih ·

Show HN: Turn Any ArXiv Paper into a 200-Page Prerequisite Reading Book

6 points3 comments
Yjohncole ·

Ernie, China's ChatGPT, Cracks Under Pressure

4 points1 comments
Yghosthamlet ·

Dissecting Bert

3 points1 comments
Ychatmasta ·

Google trained Bard on ChatGPT chats from ShareGPT

3 points1 comments
Ythoughtpeddler ·

Superintelligence: The Idea That Eats Smart People (2016)

3 points0 comments
Yalan-stark ·

What were the 40 research papers on the list Ilya Sutskever gave John Carmack?

2 points0 comments
Ysimonw ·

Embeddings: What they are and why they matter

2 points0 comments
Yskadamat ·

Ask HN: Why is OpenAI still called OpenAI?

2 points2 comments
Ymusha68k ·

Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding

1 points0 comments
Ymontebicyclelo ·

Notes on training BERT from scratch on an 8GB consumer GPU

1 points0 comments

One idea leads to another.

Explore more papers