baserun 0.5.1

Tools for testing, debugging, and evaluating LLM features.

Baserun

Baserun is the testing and observability platform for LLM apps.

Quick Start

1. Generate an API key

Create an account at https://baserun.ai. Then generate an API key for your project in the settings tab and set it as an environment variable.

export BASERUN_API_KEY="your_api_key_here"

2. Install Baserun

pip install baserun

3. Start testing

export BASERUN_API_KEY="your_api_key_here"

Use our pytest plugin and start immediately testing with Baserun. By default all OpenAI and Anthropic requests will be automatically logged.

# test_module.py

import openai

def test_paris_trip():
    response = openai.ChatCompletion.create(
        model="gpt-3.5-turbo",
        temperature=0.7,
        messages=[
            {
                "role": "user",
                "content": "What are three activities to do in Paris?"
            }
        ],
    )
    
    assert "Eiffel Tower" in response['choices'][0]['message']['content']

To run the test and log to baserun:

pytest --baserun test_module.py
...
========================Baserun========================
Test results available at: https://baserun.ai/runs/<id>
=======================================================

Documentation

For a deeper dive on all capabilities and more advanced usage, please refer to our Documentation.

License

MIT License