Python AI SDK

Statsig’s Python SDK for AI Application Configuration & Telemetry

Python AI SDK on Github, PyPI Package

This SDK is available in an open beta, and its methods may change. We encourage you to reach out on Slack for help getting setup, and so we can communicate changes.

Overview

The Statsig Python AI SDK lets you manage your prompts, online and offline evals, and debug your LLM applications in production. It depends upon the Statsig Python Server SDK, but provides convenient hooks for AI-specific functionality.

1. Install the SDK

   pip

   pip install statsig-ai
   
2. Initialize the SDK

   For initialization requirements in forking and WSGI servers, see the Statsig Python Server SDK docs.

   If you already have a Statsig instance, you can pass it into the SDK. Otherwise, we’ll create an instance for you internally.

   Don't use Statsig

   Initialize the AI SDK with a Server Secret Key from the Statsig console.

   Server Secret Keys should always be kept private. If you expose one, you can disable and recreate it in the Statsig console.

   from statsig_ai import StatsigAI, StatsigCreateConfig
   
   statsig_ai = StatsigAI(statsig_source=StatsigCreateConfig(server_secret_key='YOUR_SERVER_SECRET_KEY'))
   statsig_ai.initialize().
   

   Initializing With Options

   Optionally, you can configure StatsigOptions for your Statsig instance:

   from statsig_ai import StatsigAI
   from statsig_python_core import StatsigOptions
   
   # if you want to configure any statsig options, this is optional:
   statsig_options = StatsigOptions()
   statsig_options.environment = 'production'
   
   statsig_ai_options.statsig_options = statsig_options
   
   statsig_ai = StatsigAI(statsig_source=StatsigCreateConfig(server_secret_key='YOUR_SERVER_SECRET_KEY', statsig_options=statsig_options))
   statsig_ai.initialize()
   
   # if you would like to use any statsig methods, you can access the statsig instance from the statsig_ai instance:
   gate = statsig_ai.get_statsig().check_gate(statsig_user, 'my_gate')
   

   Already have Statsig instance

   After installation, initialize the SDK with a Server Secret Key from the Statsig console.

   Server Secret Keys should always be kept private. If you expose one, you can disable and recreate it in the Statsig console.

   If you initialize this way, the AI SDK won’t handle initialization, flushing, or shutdown.

   from statsig_python_core import Statsig
   from statsig_ai import StatsigAI, StatsigAttachConfig
   
   statsig = Statsig('YOUR_SERVER_SECRET_KEY')
   statsig.initialize()
   
   statsig_ai = StatsigAI(statsig_source=StatsigAttachConfig(statsig=statsig))
   statsig_ai.initialize()
   

   Initializing With Options

   Optionally, you can configure StatsigOptions:

   from statsig_python_core import Statsig, StatsigOptions
   from statsig_ai import StatsigAI, StatsigAttachConfig
   
   options = StatsigOptions()
   options.environment = 'production'
   
   statsig = Statsig('YOUR_SERVER_SECRET_KEY', options)
   statsig.initialize()
   
   statsig_ai = StatsigAI(statsig_source=StatsigAttachConfig(statsig=statsig))
   statsig_ai.initialize()
   

Using the SDK

Getting a Prompt

Statsig can act as the control plane for your LLM prompts, allowing you to version and change them without deploying code. For more information, see the Prompts documentation.

from statsig_ai import StatsigUser

# Create a user object
user = StatsigUser(user_id='a-user')

# Get the prompt
my_prompt = statsig_ai.get_prompt(user, 'my_prompt')

# Use the live version of the prompt
live_version = my_prompt.get_live()

# Get the candidate versions of the prompt
candidate_versions = my_prompt.get_candidates()

# Use the live version of the prompt in a completion
response = openai.chat.completions.create(
    model=live_version.get_model(fallback='gpt-4'),  # optional fallback
    temperature=live_version.get_temperature(),
    max_tokens=live_version.get_max_tokens(),
    messages=[{'role': 'user', 'content': 'Your prompt here'}],
)

Logging Eval Results

When running an online eval, you can log results back to Statsig for analysis. Provide a score between 0 and 1, along with the grader name and any useful metadata (e.g., session IDs). Currently, you must provide the grader manually — future releases will support automated grading options.

from statsig_ai import StatsigUser

live_prompt_version = statsig_ai.get_prompt(user, 'my_prompt').get_live()
# Create a user object
user = StatsigUser(user_id='a-user')

# Log the results of the eval
statsig_ai.log_eval_grade(user, live_prompt_version, 0.5, 'my_grader', {
    'session_id': '1234567890',
})

# flush eval grade events to statsig
statsig_ai.flush().wait()

OpenTelemetry (OTEL)

The AI SDK works with OpenTelemetry for sending telemetry to Statsig. You can either turn on the default OTel integration in the StatsigAIOptions, or set up your own OTel to send traces to Statsig. More advanced OTel configuration and exporter support are on the way.

Otel is not supported in the Python AI SDK yet. Coming soon!

Wrapping OpenAI

The Statsig OpenAI Wrapper automatically adds tracing and log events to your OpenAI SDK usage, giving you in-console visibility with minimal setup.

OpenAI wrapper is not supported in the Python AI SDK yet. Coming soon!

Using other SDK methods

Whether you passed in a Statsig instance or not, you can access the Statsig instance from the statsig_ai instance, and use its many methods:

# Check a gate value
gate = statsig_ai.get_statsig().check_gate(statsig_user, 'my_gate')

# Log an event
statsig_ai.get_statsig().log_event(statsig_user, 'my_event', value=1)

Refer to the Statsig Python SDK docs for more information on how to use the Core Statsig SDK methods, plus information on advanced setup + singleton usage.