Skip to main content

KoboldAI

KoboldAI is a free, open-source project that allows users to run AI models locally on their own computer. It's a browser-based front-end that can be used for writing or role playing with an AI. KoboldAI is a "a browser-based front-end for AI-assisted writing with multiple local & remote AI models...". It has a public and local API that can be used in LangChain.

Installation and Setup

Check out the installation guide.

LLMs

See a usage example.

from langchain_community.llms import KoboldApiLLM
API Reference:KoboldApiLLM

Was this page helpful?