Reflections After Completing the AI Evals Course

Background This blog post is part journal, part reflection, and part planning around the topics of AI engineering, AI evals, applied AI, and my career path into machine learning. When I decided to take Hamel and Shreya’s AI evals course , I had recently watched a very short talk on LLM reliability by Featherless AI CEO Eugene Cheah. I had also learned about the realevals.xyz benchmark , which…