Practical NLP for Risk Modeling, Part I - Turning Text into Embeddings with Pretrained Transformers

The notebook version of this post can be downloaded here . Modern NLP workflows increasingly rely on pretrained transformer models such as BERT and its variants. These models are trained on massive text datasets to learn general purpose language representations that can be reused across a wide range of downstream tasks, including classification, information extraction, and document triage. In an…