KoboldCpp
KoboldCpp is free, open-source software (AGPL-3.0) for running large language models locally on a user's own hardware. It loads GGUF-format open-weight models across hundreds of…
About KoboldCpp
KoboldCpp is free, open-source software (AGPL-3.0) for running large language models locally on a user's own hardware. It loads GGUF-format open-weight models across hundreds of architectures and bundles the KoboldAI Lite web interface, which offers storywriter, adventure, chat and instruct modes for fiction writing and roleplay. Because inference happens entirely on-device, there is no account, no cloud logging and no external content policy; model choice, including community fine-tunes for uncensored fiction, is up to the user.
The engine also supports local image generation with Stable Diffusion and Flux models, speech-to-text and text-to-speech, and exposes an OpenAI-compatible API so it can serve as a backend for other writing tools such as SillyTavern or NovelCrafter. Precompiled binaries are available for Windows, macOS and Linux, with community setups for Colab, Docker and Android. The software is entirely free.
User reviews
Loading reviews…
Similar tools
Chub AI is a character-based chat platform for long-form AI roleplay and collaborative fiction, grown out of the CharacterHub card repository. Users browse community-created…
DreamPress is an AI story generator focused on personalized fiction: users describe a premise and characters, and the service produces a finished story in one of three modes —…
Nomi is an AI companion platform available on the web, iOS, and Android, centered on long-term memory and consistent personality across friendship, romance, and mentorship…
Venice AI is a privacy-focused generative AI platform for chat, image, and video generation built on open-source models. Prompts and conversations are stored locally in the user's…