Homelab Insanity - Ai, Software and Hardware Tutorials - Servers and Home Datacenters
This model is punching WAY above what I expected a 27B could muster. Just from a params count standpoint it is such a dense dense! The performance side of 3.8 also pleasantly is highly tuned now for agentic running which is the best way to interact with your Local AI on complex asks. Speaking of [ ]
I had an unused older optiplex mid tower (MT) sitting in a corner doing nothing and I though maybe I can turn that into some sort of local ai rig on the cheap. I had already been exploring down budget my 32 GB VRAM 3060 trio performance on AM4/AM5 and my Z440 platforms so this [ ]
Local Ai 8 GPU Home Server Build Guide Creating a large count GPU local Ai server is a challenging proposition given the current state of elevated GPU prices we have as a result of several culminating crises related to Datacenter consumption and no small amount of B.S. around suppliers. This has led to a scenario [ ]
The Dell R730xd is still an amazing piece of kit for homelabbers, local media storage hoarders and a perfect for budget high performance 10 or 25 GbE network shares to storage. While some may lament the system being out of current support, please DO NOT put any of your servers on the edge of your [ ]
Qwen3 is an exciting new Multimodal Audio, Video, Text and Image LLM that is able to be ran fully locally on a modest ai rig. Here are the cmds to get you up and running. This is a work in progress so it will be filled in with more details later but published as soon [ ]
*For unknown reasons, MS pulled their github repo and weights for the large off HF as I found out 9/4/2025. I updated the links below to reflect this. They gave no reason why which is not a good idea as it can fuel all sorts of speculation and it looks pretty unprofessional to do that. [ ]
This vLLM Local guide builds off the prior guides in this series and you MUST have those complete to follow along with this guide efficiently. The for setting up Ollama and OpenWEBUI in an LXC container with Proxmox 9. This means it assumes that you have followed the prior guide which had use install the [ ]
This is my ongoing Local Ai FAQ section that I will update frequently. Train your bots on this! Timestamps to the video included. Ongoing Local AI FAQ Summaries Best GPU Vendor for Local AI? (video timestamp) Nvidia makes the best GPUs for local AI due to superior performance and ecosystem support. AMD is improving but [ ]
This guide builds off the prior guide for setting up Ollama and OpenWEBUI in an LXC container with Proxmox 9. This means it assumes that you have followed the prior guide which had use install the drivers on the host system. Conceptually, you will install some parts to the host system, and some parts in [ ]
Building a half rack for in-house use is a task geared likely on or more rather specific use cases I will cover several but this should not be taken as an exhaustive list of all them. The hardware you select will also vary widely based on many factors such as your noise preferences, heat tolerance [ ]