LLMonitor
LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.
Installation and Setup
Create an account on llmonitor.com, then copy your new app's tracking id
.
Once you have it, set it as an environment variable by running:
export LLMONITOR_APP_ID="..."
Callbacks
See a usage example.
from langchain.callbacks import LLMonitorCallbackHandler
API Reference:LLMonitorCallbackHandler