Embedding workflow templates in skills: shifting the LLM's role from "generation" to "rendering"

The dream of LLM-powered ML workflow generation At my company, an ML feature called provides capabilities like RFM analysis, recommendation, and contextual bandits. To run ML predictions at scale, the system calls an ML API that spins up parallel workers on AWS Batch behind the scenes. To make this parallelization work, input tables are aggregated per profile, which is a deliberate trade-off for…