AI & machine learning2018 · shared on Hacker News
Subword Regularization: Improving Neural Network Translation Models
Explore Subword Regularization: Improving Neural Network Translation Models, its original source and Hacker News discussions. Discover community perspectives and save it to your reading list.
GO BEYOND THE ABSTRACT
The conversation around the idea.
Original Hacker News threads. Different perspectives, questions, and things worth thinking about.
Showing up to 100 related threads. A paper may appear in a comment rather than the original submission.
Links found in the discussion
Up to 50 recent source links, in HN item order.
Ymagoghm ·
Code for the Byte Pair Encoding algorithm, commonly used in LLM tokenization
81 points31 comments
Yphewlink ·
Tokenization for language modeling: BPE vs. Unigram Language Modeling (2020)
80 points39 comments
Yrerx ·
Subword Regularization: Improving Neural Network Translation Models
1 points0 comments