Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent

Introduction Small AI computers are usually sold with large dreams and shitty memory buses. I have a ridiculous server that pulls a few kilowatts, but I wanted a local Hermes Agent box that could sit on a shelf, stay near silent, draw laptop-class power, and still run a serious model with enough context for real agent work: always available, and cheap enough that leaving it on doesn’t gener...