Information Bandwidth in Reinforcement Learning

How Gradient Structure Determines Information Capacity When I first read the &ldquo; LoRA Without Regret &rdquo; blog post, one claim caught my attention: policy gradient algorithms learn roughly 1 bit of information per episode . This insight elegantly explains why LoRA—with its mere thousands of trainable parameters—works so remarkably well for RL fine-tuning of large language models. But what…