koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Run GGUF models easily with a KoboldAI UI. One File. Zero Install. Written mainly in C++. Released under the AGPL-3.0 licence.
What this is
Local models and inference , Running and fine-tuning models on your own hardware, and the servers that make them fast enough to use.
This entry describes koboldcpp in its own words, taken from its own page. KuponGuru publishes no ratings or review scores, and claims no affiliate relationship with any tool listed.