Description
JJML provides enterprise-grade Java bindings for the llama.cpp LLM inference library.
Rather than to support all ggml and llama.cpp fatures, the main goal of this lightweight library is to be compatible with a broad range of Java versions (currently Java 11 to 25) and to provide a stable Java API for core LLM inference capabilities:
* Simple user/assistant dialog based on standard Java functional interfaces
* Embeddings
* Persistence of context state, in order to "pre-compile" prompt prefixes
* Parallel batches
* Chat templates (limited to those embedded in llama.cpp)
* Combination and configuration of the native samplers from the Java side
* API for implementing samplers in pure Java
This package contains the portable Java binaries, with OSGi and JPMS metadata.
Upload more screenshots
Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.
Upload a screenshotHint: upload an image here from your clipboard with Ctrl-V
Homepage
http://git.argeo.org/?p=argeo-jjml;a=summary
Install this software package
If the package is available for the distribution you are currently using on your computer then install the software by clicking on…