Overview
AIMon's open-source SDK for Python provides a Python API for LLM App builders to send data to AIMon. Using the SDK for Python, you can instrument your LLM applications built with a custom internal framework or any popular frameworks like LlamaIndex, LangChain, etc.
Requirements
Python versions 3.8+ are required.
Python SDK
To install the Python SDK, run the following command:
pip install -U aimon
Detect and Evaluate
The Python SDK supports both synchronous and asynchronous operations.
The detect API can be used for both synchronous and asynchronous operations.
The evaluate function is used for running offline evaluations of your LLM applications.
The detect function when used in synchronous mode can be used for real-time or online evaluations. The detect function when used in asynchronous mode (async_mode=True) can be used for
continuous monitoring of you LLM applications.
Refer to the API Reference for more details.