Predicting and designing proteins (4): What protein language models learn from sequences

Calling proteins a language is useful only if the analogy is handled carefully. Amino acids are not words with dictionary meanings, and evolution does not compose sentences with an intention. A protein sequence is a physical polymer that must be synthesized, folded, and selected in an organism. Yet sequences do have context-dependent regularities. Some residue combinations are common, some are…