Exposing local llm's to the internet (draft)

My blog uses ~~AI~~ , no seriously! Head to my homepage and you will find that the "quote of the day" is (or used to be) powered by ChatGPT. This site refreshes daily which ended up very silently leaking my whole 5$ of OpenAI API credit, leaving my blog stuck with a fallback, ultra-generic quote. Sad times! Instead of throwing more money into the OpenAI pit, I decided to spin up my own local LLM…