Recent content on mudler.pm

 I love vLLM, I really mean it. It made AI inferencing affordable and fast, but it has a cost.
A vLLM install here is also 9.1 GiB of virtualenv, a CUDA runtime, a
pinned torch, and a dependency tree somebody has to scan for CVEs every week, if you take care about security. I
did that for a while, but one of the things that broke me is trying to maintain vLLM in LocalAI. It is…

 If you’re building software today, you’ve probably felt the new kind of developer burnout. 
 Things changed drammatically in the last two months. 
 Even Karpathy sensei could not write it better: 
 
 
 View on X (Twitter) → 
 
 The real pain isn’t writing the code anymore, it’s the brutal cognitive load of context switching between managing…
If you are a lucky(?) owner of the Jetson Nano Devkit (4GB), and you don’t know anymore on what to do with it, you can try to run LocalAI with llama.cpp on it. 
 The Jetson Nano Devkit is currently not supported anymore by Nvidia, and receives little to no attention, however, it can still do something, and if you are like me that recycles the board at home, you might want to have fun…
There has been a lot of buzz around AI, Langchain, and the possibilities they offer nowadays. In this blog post, I will delve into the process of creating a small assistant for yourself or your team on Slack. This assistant will be able to provide answers related to your documentation. 
 
 The problem § 
 I work at Spectro Cloud , and we have an exciting open source project called…
Have you ever dreamed of building AI-native applications that can leverage the power of large language models (LLMs) without relying on expensive cloud services or complex infrastructure? If so, you’re not alone. Many developers are looking for ways to create and deploy AI-powered solutions that are fast, flexible, and cost-effective, or just experiment locally. In this blog post, I’m going to…

 LocalAI has been a massive hit! Thanks to everyone who has shown support by following us. Your contribution is helping to democratize AI! 
 If you’re not familiar with LocalAI, it’s a self-hostable, free, and open-source alternative to the OpenAI API. It simplifies the AI development process and makes it accessible to everyone. You can check it out on Github:…
Hello users, 
 Time passed when i first wrote the article “ [Part 1] Building Gentoo and Sabayon packages in your machine locally or remotely with Docker and Cloud Services ” that was going to be divided into parts. But things changed amazingly fast and there is better news, I wrote up a suite of tools that makes the whole operation much easier, thanks also to +Ben Roberts…
Updates, TMiD (This Month in the Dev world) 
 
 Something landed here! Thanks to +Ben Roberts for the donation! 
 ARM § 
 
 Marsala, the board that +Ben Roberts was so kind to donate has just landed here, and i’m very happy about it, because that means that i can test against the board again myself. 
 I’m glad also to announce that the ROS framework and some…
As anticipated on Sabayon Linux site releases notes, that day was going to be close. 
 ARM meet Sabayon , Sabayon meet ARM . 
 
 The approach to the ARM(hfp) support will be different from the previous attempt, we are not going to support kernels for each different board we intend to build images, instead we will release cutted images with vendor-kernel to avoid incompatibilities and…

 As previously anticipated in the previous blog post, here i explain what’s going on with Sabayon Docker images, and how can the Official Sabayon images help you in developing/deploying your application. In this article, i’ll show how to build Sabayon/Gentoo packages using Docker. 
 I’ll cover five cases and will be divided in differents articles: 
 
 You want to…
Sabayon, official call for testers (and well, developers are welcome too) 
 
 Testers, come to us § 
 Probably most of you already have seen Ballmer in show-mode 
 Also if controversial, it was a quite funny commercial / raindance move, balls included. But i can say that he is wrong, testers are as important as developers. 
Consider helping Sabayon in a different way: testing…

 Image: an ancient hen-foot print found on Mars (Mars Photo credit to NASA) 
 Sabayon 15.10 is a modern and easy to use Linux distribution based on Gentoo, following an extreme, yet reliable, rolling release model. 
 This is a monthly release generated, tested and published to mirrors by our build servers containing the latest and greatest collection of software available in the…

 Sabayon is officially moving to Plasma 5, please read if you are a KDE Sabayon user. 
 KDM is going to be removed! migrate to SDDM now! 
 Yes, finally we are moving on. 
 While KDE 4 was a pretty stable DM, Plasma 5 brings awesomeness and, if you didn’t noticed, it’s the future. 
 From KDM to SDDM § 
 We tried to do our best to make the transition as smooth as…
!! WARNING - HERE BE DRAGONS !! 
 
 Sabayon Plasma 5 LiveCD Tech preview is available for download 
 This release is just for testing only, it is just a preview of Plasma5 on Sabayon for those of you that 
 wants just to snoop on what’s going on without touching your system. 
 If you want to install Plasma 5 with the community repository, follow those instructions. 
…
I’m glad to announce that Plasma 5.4 is available on Sabayon Plasma5 community repository. 
 
 Plasma 5.4 
 The KDE team announced on 25 August the release of Plasma 5.4: 
 
 This release of Plasma brings many nice touches for our users such as much improved high DPI support, KRunner auto-completion and many new beautiful Breeze icons. It also lays the ground for the…
Since i became Sabayon developer, i started to work on customizing it and giving some love to the entropy packages. 
A lot as been done in those months, and you can see that picking up a “-dev” image from our mirrors . 
After giving to the entropy packages a fullfill of love (systemd was bumped, ati-drivers and nvidia-drivers as well to be in line with upstream, implemented…
The first post of a series that will guide you to install and configure your domotic environment with Google@Home (following updates) 
 Introduction § 
 I’m starting in the blog a new series of posts illustrating the features of G@H as they are being developed, and how you can start to play with it. 
 This time we are going to see how to install it correctly, how to handle the…
Predicting github contrib calendar with Perl and PDL 
 Premise : this is my first time using PDL 
 Lately i had the chance to put my hands on PDL, i was glad to discover that it’s awesome! 
 I come from a matlab/octave and Mathematica background, at first was a bit difficult to dig thru the PDL equivalents functions and i have to admit that PyMC has some fancy stuff that require…
Introducing Deeme a database-agnostic driven event emitter base-class. 
 Deeme is a database-agnostic driven event emitter base-class. Deeme allows you to define binding subs on different points in multiple applications, and execute them later, in another worker with a switchable backend database. It is handy if you have to attach subs to events that are delayed in time and must be fixed. It…
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. Finally a sketchup of the Android App! 
 That’s the current status of the project: 
 The GSoC student : 
 
 RPC server integration, fully pluggable with Mojolicious (better than the one…
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment. In this post i’ll report also the work by the GSoC student so far 
 During this period i haven’t…
Well, if you don’t know what pushbullet is, it’s a free-less-complicated version of what pusher.com does, unifying push’s across all the devices. In this article i’ll show how to implement pushbullet api in perl, in few lines of code. 
 Pushbullet enables to notify instantly to all your devices a message, a link, a file, an address or even a list of todo’s (and…
_ 
These months are full of bugs to put hands on, there are multiple vulnerabilities (3) found in libXfont that trusts the font server protocol data, and not verifying that the values will not overflow or cause other damage._ 
 From the Alan Coopersmith announce: 
 Ilja van Sprundel, a security researcher with IOActive, has discovered several issues in the way the libXfont library…
Two days ago a temible exploit was released for local privilage escalation in the linux kernel. The bug was found on the 29th of April : memory corruption via a race in pty write handling , affected kernels are 2.6.31 -> 3.14rcX 
 The n_tty_write function in drivers/tty/n_tty.c in the Linux kernel through 3.14.3 does not properly manage tty driver access in the “LECHO & !OPOST”…
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment. 
 During this period i focused on fixing bugs, microphone settings and some structural restyling 
 This is…
About me § 
 
 Hey! Thanks for stopping by. 
 I’m Ettore, known online as mudler . I’ve been an open source hacker and
hacktivist for nearly two decades — since organizing Linux Days as a teenager —
and I hold an MS in Computer Science. 
 I’m the creator and maintainer of LocalAI , the free,
open-source AI engine for running LLMs, vision, voice and…
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment. 
 During this week i focused on fixing bug and few structural enhancements 
 This is a small summary of the…
_ 
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment. 
_ 
 For now it’s still required to manually set-up the YAML file to configure which nodes…
This is my blog, it’s powered it was powered with Perl and Mojolicious. Enjoy! You will find here some interesting perl posts and updates for the projects where i am involved. 
 Unfortunately i had to move to blogger, due to time issues. Enjoy!
![](https://mudler.pm/posts/2026/08/13/why-vllm.cpp-exists/"https://mudler.pm/images/vllmcpp-manifesto.png")
![](https://mudler.pm/posts/2026/02/28/a-call-to-open-source-maintainers-stop-babysitting-ai-how-i-built-a-100-local-autonomous-dev-team-to-maintain-localai-and-why-you-should-too/"https://mudler.pm/images/agents_header.png")
![](https://mudler.pm/posts/2023/05/11/localai-updates/"https://user-images.githubusercontent.com/2420543/233147843-88697415-6dbf-4368-a862-ab217f9f7342.jpeg")
![](https://mudler.pm/2016/02/"http://the9gag.com/images/pictuers/thumb/eat_sleep_code_repeat.jpg")
![](https://mudler.pm/2016/01/"https://www.raspberrypi.org/wp-content/uploads/2015/01/Pi2ModB1GB_-comp.jpeg")
![](https://mudler.pm/2015/11/"http://1.bp.blogspot.com/-s-2KEJ0FoF8/VkiGi_oCjBI/AAAAAAAAMfg/JkAeUmowseI/s640/cloud-47581_1280.png")
![](https://mudler.pm/2015/10/"http://4.bp.blogspot.com/-aKxCHaqb3X4/VhTf8i951mI/AAAAAAAAMB0/1HrGxtWUY2Q/s320/keep-calm-and-test-develop.png")
![](https://mudler.pm/2015/09/"http://3.bp.blogspot.com/-AbWz1Wk7__U/Vgl_vSomVNI/AAAAAAAAL4I/rdcLxP0vxOE/s400/mars-sabayon.jpg")
![](https://mudler.pm/2015/09/"http://3.bp.blogspot.com/-jRJmCVvyYJ4/Vebu_7a86OI/AAAAAAAALnE/d8DCNFt13_w/s320/plasma_sab.png")
![](https://mudler.pm/2015/09/"http://1.bp.blogspot.com/-jRJmCVvyYJ4/Vebu_7a86OI/AAAAAAAALnA/tCSegvEXQDc/s320/plasma_sab.png")
![](https://mudler.pm/2015/08/"https://www.kde.org/announcements/plasma-5.4/plasma-screen-desktop-2-shadow.png")
![](https://mudler.pm/about/"https://mudler.pm/images/me.jpg")