Word Embeddings: Theory and Analysis

To implement natural language processing tasks, we deal with various kinds of discrete types. The most common being words. Words originate from a finite set; vocabulary. Other examples are characters, part-of-speech tags, named entities, named entity types, parse features, items in a product catalog and more. Any input feature that