Description
GGUF is a file format for storing models for inference with GGML and executors based on GGML. GGUF is a binary format that is designed for fast loading and saving of models, and for ease of reading. Models are traditionally developed using PyTorch or another framework, and then converted to GGUF for use in GGML.
This package provides a Python library for reading and writing files in the GGUF format, and exposes this to the CLI in the form of a few utilities.
Upload more screenshots
Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.
Upload a screenshotHint: upload an image here from your clipboard with Ctrl-V
Homepage
https://github.com/ggml-org/llama.cpp/
Install this software package
If the package is available for the distribution you are currently using on your computer then install the software by clicking on…