Software plumbing using middleware wrenches
A long time back I read an article on NYT about how costly being polite to chat bots was for OpenAI, et. al. Beyond stating that a Thank You was costing AI vendors millions and millions of dollars, the article wondered if we were losing something as a society by not being polite to our [ ]
When I first starting using Quarkus Langchain4j I ran into some issues because I didn t fully understand how Quarkus managed chat memory with Langchain4j. So, here s what I m gonna discuss: Chat Memory in Quarkus Langchain4j Chat Memory is a history of the conversation you ve had with an LLM. When using Quarkus Langchain4j (or just Langchain4j [ ]
TLDR; Reduce callbacks to your LLM by immediately returning from tool invocations. This can greatly improve performance, give you fine grain control of your tool invocations, and even save you money too. Check out the docs for more information, or read on. Intro In my Baldur s Forge chat application I talked about in my last [ ]
So, writing a hello world examples did not really help me to understand the limitations of LLMs. I decided to see if I could write a pure natural language chat interface for a CRUD application. My thought was maybe a natural language chat interface for CRUD was a high volume application that most organizations would [ ]
Quarkus Playen 1.0.0 is released! Live coding with your development cluster Temporarily route requests to a service in a cluster to your laptop or to a temporary pod. This allows you to develop realtime with a development cluster so that you can see your service in action with the rest of your deployed service mesh. https://github.com/quarkiverse/quarkus-playpen/tree/1.0.0
It took me a while to figure this out so I thought I d share it. I have Java quarkiverse project that releases a quarkus extension to nexus using the maven release plugin and builds CLI binaries with Graal after the fact for windows, macosx, and linux. The binaries are uploaded to a Github release of [ ]
You can take an existing Quarkus HTTP application and deploy it as a native executable (Graal build) to Azure Functions using the Custom Handler runtime provided with Azure Functions. Prerequisites: You ll need to configure a root path in application.properties: Replace {functionName} with whatever you want to call the function you re creating for the Quarkus HTTP [ ]
Last week I merged Quarkus Live Coding and Continuous Testing support for Lambda and it will be available in Quarkus 2.3. I m excited to see how its received by the Quarkus community. The PR allows you to run in Quarkus Dev or Test mode all locally within a mock Lambda environment automatically set up by [ ]
I ll start by introducing some flaim bait: PR REVIEWS ARE WORTHLESS! How often are you waiting days or even weeks for a PR review? And when it is about to be approved you get a merge conflict and have to start all over again? How often are PR reviews subjective rather than objective? How often [ ]
Quarkus has a new JSON parser and object mapper called QSON. It does bytecode generation for the Java classes you want to map to and from JSON around a small core library. I m not going to get into details on how to use it, just visit the github page for more information. I started this [ ]