KoboldCpp
KoboldCpp is free, open-source software (AGPL-3.0) for running large language models locally on a user's own hardware. It loads GGUF-format open-weight models across hundreds of…
About KoboldCpp
KoboldCpp is free, open-source software (AGPL-3.0) for running large language models locally on a user's own hardware. It loads GGUF-format open-weight models across hundreds of architectures and bundles the KoboldAI Lite web interface, which offers storywriter, adventure, chat and instruct modes for fiction writing and roleplay. Because inference happens entirely on-device, there is no account, no cloud logging and no external content policy; model choice, including community fine-tunes for uncensored fiction, is up to the user.
The engine also supports local image generation with Stable Diffusion and Flux models, speech-to-text and text-to-speech, and exposes an OpenAI-compatible API so it can serve as a backend for other writing tools such as SillyTavern or NovelCrafter. Precompiled binaries are available for Windows, macOS and Linux, with community setups for Colab, Docker and Android. The software is entirely free.
User reviews
Loading reviews…
Similar tools
Bring you spiciest sexual fantasies to life with Promptchan AI Porn generator. Enjoy generating nude AI porn in a range of different styles, from Hentai, Realistic, Fury and…
Welcome to PornJourney! The best AI porn images, AI hentai generator and AI porn video. PornJourney's AI is using the most advanced hand-engineered AI porn. Pricing PornJourney:…
Dolphin Mistral 24B Venice Edition is an open-weight language model from the Dolphin project (dphn, formerly Cognitive Computations), fine-tuned from Mistral Small 24B Instruct…
FreedomGPT is a web and mobile AI chat service that gives access to a large catalogue of language models from different providers under one account. An Auto mode selects a model…