Overview
AIMon's open-source SDK for Typescript provides a Typescript API for front-end focused LLM App builders to send data to AIMon. Using the SDK for Typescript, you can instrument your LLM applications built with a custom internal framework or any popular frameworks like LlamaIndex.
Requirements
- Requires Node.js v20.11.1 or later
Typescript SDK
To install the Typescript SDK, run the following command:
npm install aimon
Detect and Evaluate
The Python SDK supports both synchronous and asynchronous operations.
The detect API can be used for both synchronous and asynchronous operations.
The evaluate function is used for running offline evaluations of your LLM applications.
The detect function when used in synchronous mode can be used for real-time or online evaluations. The detect function when used in asynchronous mode (async_mode=True) can be used for
continuous monitoring of you LLM applications.
Initialize client
import Client from "aimon";
// Create the AIMon client. You would need an API Key (that can be retrieved from the UI in your user profile).
const aimon = new Client({ authHeader: "Bearer API_KEY" });