The Natural Language Decathlon

Deep learning has significantly improved state-of-the-art performance for natural language processing tasks like machine translation, summarization, question answering, and text classification.

20 Jun 2018 • #research

Learned in Translation: Contextualized Word Vectors

There are times when word vectors are initialized to lists of random numbers before a model is trained for a specific task, but it is also quite common to initialize the word vectors of a model with those obtained by running methods like word2vec, GloVe, or FastText.

31 Jul 2017 • #research