Memorization and Privacy in Language Models

How language models memorize training data, methods for measuring extractable memorization, PII risks in web-scale corpora, and practical privacy mitigations. Read full notebook