What goes into an inference stack?

In the pre-LLM era, deploying machine learning models was an entirely different experience.