Portkey Basic

Route a basic agent through the Portkey AI gateway with sync, streaming, and async runs.

Apply the account model and explicit-key setup below before running the preserved source.

basic.py
"""
Portkey Basic
=============

Cookbook example for `portkey/basic.py`.
"""

from agno.agent import Agent, RunOutput  # noqa
from agno.models.portkey import Portkey
import asyncio

# ---------------------------------------------------------------------------
# Create Agent
# ---------------------------------------------------------------------------

# Create model using Portkey
model = Portkey(
    id="@first-integrati-707071/gpt-5-nano",
)

agent = Agent(model=model, markdown=True)

# Get the response in a variable
# run: RunOutput = agent.run("What is Portkey and why would I use it as an AI gateway?")
# print(run.content)

# Print the response in the terminal

# ---------------------------------------------------------------------------
# Run Agent
# ---------------------------------------------------------------------------
if __name__ == "__main__":
    # --- Sync ---
    agent.print_response("What is Portkey and why would I use it as an AI gateway?")

    # --- Sync + Streaming ---
    agent.print_response(
        "What is Portkey and why would I use it as an AI gateway?", stream=True
    )

    # --- Async ---
    asyncio.run(
        agent.aprint_response(
            "What is Portkey and why would I use it as an AI gateway?"
        )
    )

    # --- Async + Streaming ---
    asyncio.run(
        agent.aprint_response("Share a breakfast recipe.", markdown=True, stream=True)
    )

Run the Example

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Install dependencies

uv pip install -U agno openai portkey-ai

Export your Portkey API key

export PORTKEY_API_KEY="your_portkey_api_key_here"

Select and configure your Portkey model

In the Portkey model catalog, configure an AI Provider integration with its provider credentials and enable the model for your workspace. Copy its full model slug, including your integration prefix. The source's @first-integrati-707071 prefix belongs to a different account.

export PORTKEY_MODEL_ID="@your-integration/your-enabled-model"

Replace the placeholder with your copied slug. Add from os import environ to the saved file, then replace every model construction with Portkey(id=environ["PORTKEY_MODEL_ID"], portkey_api_key=environ["PORTKEY_API_KEY"]). Keep any additional model options you need. This revision requires the explicit portkey_api_key argument; setting the environment variable alone is insufficient. Choose a model that supports this example's tools or JSON Schema when those are used.

Run the example

Save the code above as basic.py, then run:

python basic.py

Full source: cookbook/90_models/portkey/basic.py