# deep rl (blogs) — RSS Amplifier Recent posts from the 2 feeds in the RSS Amplifier directory that cover deep rl. Page: Feed: --- ## [Mini-Retirement: Or, How I Learned to Stop Grinding and Took Two Years Off](https://neuralpensieve.github.io/2026/02/15/mini-retirement.html) _2026-02-15 · Ali · Neural Pensieve_ Sunrise over Mt. Bromo, Java, Indonesia ## [Why You Should Start an AI PhD Now](https://jasonppy.github.io/story/best-time-AI-phd/) _2025-10-14 · Puyuan Peng · Puyuan Peng_ 1. You are pushing the boundary of this industrial revolution ## [Why You Shouldn’t Start an AI PhD Now](https://jasonppy.github.io/story/worst-time-AI-phd/) _2025-10-14 · Puyuan Peng · Puyuan Peng_ 1. Research direction is largely decided by industry ## [PhD in AI – My Experience](https://jasonppy.github.io/story/phd-in-AI-my-experience/) _2025-09-29 · Puyuan Peng · Puyuan Peng_ In October 2024, I contacted 9 companies for research positions in AI. I received interview invites from 8 of them, finished full interview loops with 6, and got offers from 4. The total market cap of the 4 companies that offered me a research scientist job was $10 trillion by mid-September 2025. I chose Meta. ## [The Art of Safe Policy Updates: From REINFORCE to TRPO and PPO](https://neuralpensieve.github.io/2025/09/18/trpo-ppo-intuition.html) _2025-09-18 · Ali · Neural Pensieve_ Policy gradient methods are like climbing a treacherous terrain to find the highest peak. Better use a harness like TRPO or PPO! ## [Teaching AI to Play Hokm: A Multi-Agent Reinforcement Learning Challenge](https://neuralpensieve.github.io/2025/09/12/hokm-rl.html) _2025-09-12 · Ali · Neural Pensieve_ Hokm is a 4-player Persian card game similar to Bridge, and the robot is learning it by playing against younger versions of itself! ## [Teaching (tiny) LLMs to Play Text-Based Games Using RL (on a $300 GPU)](https://neuralpensieve.github.io/2025/08/26/rl-llm-textworld.html) _2025-08-26 · Ali · Neural Pensieve_ TL;DR: I trained small LLMs like GPT-2 to play text-based games using reinforcement learning (PPO) on my budget GPU. Key innovations: token-level PPO for richer signals and trie-based masking to ensure only valid actions. It worked well on with various levels of difficulty, with techniques applicable to real-world structured outputs. Code on GitHub, results show generalization, and I share lessons… ## [The Beautiful Intuition Behind Diffusion Models](https://neuralpensieve.github.io/2025/07/18/diffusion-intuition.html) _2025-07-18 · Ali · Neural Pensieve_ The first time I heard about how diffusion models work, I was dumbfounded! How can you start from random noise, denoise it over and over, and get a clean generated image? In other words, how can no information result in a lot of information? There are many papers and blog posts explaining the math behind this, and honestly, it may even seem intimidating at first, but when you understand the… ## [How to Tame Your Deep RL](https://neuralpensieve.github.io/2025/07/09/how-to-tame-your-deep-rl.html) _2025-07-09 · Ali · Neural Pensieve_ Running reinforcement learning (RL) experiments—especially when implementing models yourself—is notoriously more challenging than typical supervised learning (SL) experiments (as attested by none other than Andrej Karpathy here ). SL models are generally well-behaved: they converge predictably, respond well to cross-validation, and scale efficiently on GPUs. Deep RL models, however, are entirely… ## [How many words do you know?](https://neuralpensieve.github.io/2024/12/05/vocabulary-size.html) _2024-12-05 · Ali · Neural Pensieve_ A few years back, I started wondering: what’s the minimum number of questions you’d need to ask someone to figure out the size of their vocabulary? Of course, asking random questions is not exactly optimal, and clearly the best solution would involve some kind of exploration-exploitation trade-off, but I never got around to actually work on it. Now that I’ve got some free time, I figured I’d give… ## [Unlimited Mobile Internet, One V-SIM (Sponsored)](https://crawlproof.com/a/Fq6WFTaKdfEr) _2024-12-04 · **Sponsored**_ Automatically switches across T-Mobile, AT&T and Verizon; no throttling, no contract. ## [Perils and Promises of AI](https://neuralpensieve.github.io/2024/10/20/perils-and-promises-of-ai.html) _2024-10-20 · Ali · Neural Pensieve_ With the rapid rise of Generative AI and its growing influence, humanity is entering an era of uncertainty, particularly concerning AI’s negative impact on society. The unprecedented capabilities of AI are both exciting and alarming, as they hold the potential to radically transform industries, economies, and human interactions—for better or worse. It is not hard to imagine a future where AI…