Local LLM Inference - Offline Scenario

I read many news about LLMs nowadays. One topic I&rsquo;m most interested in&#xA;is local inference for LLMs, and trying to find the sweet spot where they can be used&#xA;in local setups.