Quickstart example

This quickstart example will teach you how to get started with Adaptive Engine, by mocking an AI customer support co-pilot use case. You’ll be taken through the following steps to deploy, use, and adapt your first model:

Install the Adaptive Python SDK
Create a new use case
Deploy a model and make an inference request
Log feedback on the model’s completion
Adapt a model on previous interaction feedback

Step-by-step walkthrough

Install the Adaptive Python SDK

First, you pip install the Adaptive SDK.

pip install adaptive_sdk

Instantiate the Adaptive client.

Adaptive SDK

from adaptive_sdk import Adaptive

adaptive = Adaptive(
    base_url="ADAPTIVE_URL",
    api_key="ADAPTIVE_API_KEY"
)

Create a new use case

An Adaptive Engine use case is a user-defined workspace where you group together resources such as models, interaction logs and metrics for monitoring and evaluation.You first create a Customer Support Assistant use case that to service your customer support operations.

Adaptive SDK

use_case = adaptive.use_cases.create(
    key="customer_support_assistant"
)

Deploy a model and make an inference request

You deploy the Llama 3.1 70B instruction-tuned model and attach it to the use case, so your customer support agents can start using it. This is a capable base model that can provide satisfactory performance initially. Learn more about other supported models.

Adaptive SDK

# configure default client use case
# SDK methods will target the customer support use case going forward, unless specifically overridden
client = adaptive.set_default_use_case(use_case.key)

model = adaptive.models.attach(
    model="llama-3.3-70b-instruct",
)

You can now integrate the Adaptive SDK in your customer support application, and start making inference requests. The Adaptive Chat API is also compatible with the OpenAI Python library, so there is no need to refactor application code if you were previously using it.

Adaptive SDK

chat_response = adaptive.chat.create(
    model=model.key,
    messages=[
        {
            "role": "system",
            "content": "You are a helpful customer support assistant."
        },
        {
            "role": "user",
            "content": "I was blocked out of my account, I don't know why."
        }
    ]
)
print(chat_response.choices[0].message.content)

Output:

Have you tried recovering your password?

Pairs of messages, completion resulting from chat requests are automatically logged and saved on Adaptive.

Log feedback on the model's completion

Your customer support agent who is using the model as an assistant finds the model’s completion appropriate, and accepts it to be sent to the customer.To log and aggregate this feedback, you register a new Acceptance feedback key, link it to your use case, and log the agent’s feedback against the completion_id.

Adaptive SDK

feedback_key = adaptive.feedback.register_key(
    key="acceptance",
    kind="bool",
    scoring_type="higher_is_better",
)
_ = adaptive.feedback.link(feedback_key.key)

completion_id = chat_response.choices[0].completion_id

feedback = adaptive.feedback.log_metric(
    completion_id=completion_id,
    feedback_key=feedback_key.key,
    value=True,
)

Learn more about feedback types in Adaptive.

Adapt a model on previous interaction feedback

After running your customer support operations with the help of Adaptive Engine, you have accumulated feedback from your human agents in production. To align a model to the preferences of your human agents, you adapt a smaller 8B model on the feedback you logged. This tunes the smaller model using reinforcement learning methods, learning from the successes and failures of the larger, more capable model.

Adaptive SDK

job = adaptive.training.jobs.create(
    model="llama-3.1-8b-instruct",
    data_source="COMPLETIONS",
    data_config={"selection_type": "ALL"},
    alignment_objective={
        "metric": {
            "metric_key": feedback_key.key
        }
    }
)

The job trains and saves a new, improved model that you can immediately deploy for better results! Learn more in Adapt a model.

Next steps

Check out how to A/B test models in production for easy iteration and decision making.
Dive deeper into training with Adaptive Engine.

Platform

Inference

Evaluation

Graders

Recipes & Runs

Datasets

Interactions

Integrations

Deployment

Step-by-step walkthrough

Next steps

​Step-by-step walkthrough

​Next steps

Step-by-step walkthrough

Next steps