chores 0.3.0 and local LLMs

The tl;dr: