Data Engineer Things is dedicated to creating and sharing learning resources for data engineering. Our audience ranges from aspirational data engineers to experienced data leaders. Subscribe to grow and learn together!
Subscribe:.rss.atom.json.md.m3u.pls
Live Last read · last published · next check
Airflow’s AI-powered pipeline resilience, Uber’s data abstraction layer, Netflix’s in-house LLM serving, AI governance, and Spotify’s Random Access Parquet for faster data lake lookups
Near-Infinite Velocity: On Agents, Standards, and What Never Changes
Netflix's multimodal AI for video search, Context layer behind Spotify’s data assistant, Harness engineering for coding agent users, Reddit data tech stack (120M+ DAU)
Lessons from Airflow, open source, and AI workflows on building data platforms that can adapt as systems, tools, and semantics drift.
How Airbnb created a multi-product compatible data architecture, the 8 engineering metrics AI has broken, why more LLM reasoning effort isn't always better, making Semantic Layer work for AI Agents
The craft is no longer in the code. It’s in how you define context, questions and evaluations
Spotify's coding agents that saved 10 engineering weeks, how Meta encoded tribal knowledge for AI agents, and Pinterest's CDC-to-Iceberg architecture explained
DEOF 2026 Recap: 20+ sessions all pointing the same direction: the data engineer role is expanding, not disappearing. Talk recordings, and a closing keynote that hit different.
Context engineering for AI-native platforms, Spotify's pipelines behind Wrapped 2025, and DuckLake 1.0 production release
80% highway, 20% off-road: Michelle Winters on building platforms that last and rethinking what data engineering actually is
