What good is a protein language model?

Protein language models are large transformers trained on datasets of protein sequences. Where natural language models use a vocabulary made up of "tokens," protein language models use the small, simple vocabulary of the 20 amino acids, plus a couple more characters. You can prompt a natural language model like GPT-2, say, with some tokens "I'm a protein like" and it will complete the text ( "a…