Language modeling is really a subtask of more interesting natural language problems, specifically those that condition the language model on some other input.
这激励了模型去学习更多有意义的“词对”表征,而不是更通用的目标,比如语言建模。
This encourages the model to learn more meaningful representations of word pairs than with more general objectives,such as language modelling.
语言建模(LM)在给定前一个单词的情况下尝试预测下一个单词。
Language modeling(LM) aims to predict the next word given its previous word.
这对带有大量输出的任务尤其有用,比如语言建模(Melisetal.,2017)。
This is useful particularly for tasks with a large number of outputs,such as language modelling(Melis et al., 2017).
Transformer-XL is up to 1,800+times faster than a vanilla Transformer during evaluation on language modeling tasks, because no re-computation is needed(see figures above).
这鼓励模型学习更有意义的词对表示,而不是更一般的目标,如语言建模。
This encourages the model to learn more meaningful representations of word pairs than with more general objectives,such as language modelling.
GPT-2在WinogradSchema、LAMBADA和其他语言建模任务中达到了当前最佳性能。
GPT-2 achieves state-of-the-art on Winograd Schema, LAMBADA, and other language modeling tasks.
In our research, we identified three steps- word-by-word initialization, language modeling, and back translation- as important principles for unsupervised MT.
Deep Neural Networks(DNNs) have facilitated tremendous progress across a range of applications, including image classification,translation, language modeling, and video captioning.
RNNs thus don't seem to have the right bias for modeling language, which in practice can lead to statistical inefficiency and poor generalization behaviour.
这使词汇量变小,提高了许多语言建模任务的准确性。
This keeps the vocabulary small and improves the accuracy of many language modeling tasks.
中文
Bahasa indonesia
日本語
عربى
Български
বাংলা
Český
Dansk
Deutsch
Ελληνικά
Español
Suomi
Français
עִברִית
हिंदी
Hrvatski
Magyar
Italiano
Қазақ
한국어
മലയാളം
मराठी
Bahasa malay
Nederlands
Norsk
Polski
Português
Română
Русский
Slovenský
Slovenski
Српски
Svenska
தமிழ்
తెలుగు
ไทย
Tagalog
Turkce
Українська
اردو
Tiếng việt