Cloudflare AI Gateway: switching models (OpenRouter-style ids)

Switch Cloudflare AI Gateway models by passing a catalog binding to `Cloudflare(id=...)` or a `cloudflare:` model string.

Same idea as OpenRouter: you pick one slash-separated route per client via id. Changing model = new Cloudflare(id=...) or a new Agent(model="cloudflare:...") string.

The current Agno Cloudflare adapter uses AI Gateway's /compat/chat/completions endpoint. Cloudflare deprecates this endpoint for single-model calls while keeping it working for existing integrations. Dynamic routes still require it. For new direct model integrations, follow Cloudflare's current REST API guide.

switch_model.py
"""
Cloudflare AI Gateway — switching models (OpenRouter-style ids)
==============================================================

Same idea as OpenRouter: you pick one slash-separated route per client via ``id``.
Changing model = new ``Cloudflare(id=...)`` or a new ``Agent(model="cloudflare:...")`` string.

OpenRouter also supports ``models=[...]`` for fallbacks in the request body. The Cloudflare
compat API does not; use AI Gateway Dynamic Routes and ``id="dynamic/<route>"`` instead.

Requires ``CLOUDFLARE_API_TOKEN`` and ``CLOUDFLARE_ACCOUNT_ID`` (see README).

How to pick another **Workers AI** model (see https://developers.cloudflare.com/workers-ai/models/):

1. Open the catalog and choose a **Text generation** model.
2. On that model's doc page, copy the binding id from the box (e.g. ``@cf/google/gemma-4-26b-a4b-it``).
3. Paste it straight into Agno: ``Cloudflare(id="@cf/google/gemma-4-26b-a4b-it")`` or
   ``Agent(model="cloudflare:@cf/google/gemma-4-26b-a4b-it")``. Agno prepends ``workers-ai/`` for the gateway.
   You can still pass the full form ``workers-ai/@cf/...`` if you prefer.

**Gemini** (Google's API product) is not the same as **Gemma** / Llama on Workers AI. Do not invent
``@cf/.../gemini-...`` slugs — they are not in the catalog. For Gemini via the gateway use a
``google/...`` route and BYOK (see README), not ``workers-ai/...``.
"""

from agno.agent import Agent
from agno.models.cloudflare import DEFAULT_GATEWAY_MODEL, Cloudflare

# Second Workers AI model: paste the same string as the catalog "copy" box on the model page.
ALT_WORKERS_MODEL = "@cf/google/gemma-4-26b-a4b-it"

if __name__ == "__main__":
    # Default Workers AI model (no explicit id).
    Agent(model=Cloudflare(), markdown=True).print_response("Say hello in five words.")

    # Same as OpenRouter: pass the gateway route string as ``id``.
    Agent(model=Cloudflare(id=DEFAULT_GATEWAY_MODEL), markdown=True).print_response(
        "Say hello in five words."
    )

    # Switch model: new client instance with a different ``id``.
    Agent(model=Cloudflare(id=ALT_WORKERS_MODEL), markdown=True).print_response(
        "Say hello in five words."
    )

    # String syntax: everything after the first colon is the gateway ``model`` id.
    Agent(
        model=f"cloudflare:{ALT_WORKERS_MODEL}",
        markdown=True,
    ).print_response("Say hello in five words.")

    # Dynamic route configured in the Cloudflare dashboard (example id only).
    # Agent(model=Cloudflare(id="dynamic/my-route"), markdown=True).print_response("...")

Run the Example

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Install dependencies

uv pip install -U agno openai

Set up Cloudflare access

Use a Cloudflare account and an API token with the permissions required for AI Gateway and Workers AI. The default gateway is created on the first request; set CLOUDFLARE_AI_GATEWAY_ID only to use another existing gateway.

export CLOUDFLARE_ACCOUNT_ID="your_cloudflare_account_id_here"
export CLOUDFLARE_API_TOKEN="your_cloudflare_api_token_here"

Workers AI examples use this Cloudflare token. Other providers can require stored provider keys or supported unified billing; configure the selected route in the gateway before switching to it.

Run the example

Save the code above as switch_model.py, then run:

python switch_model.py

Full source: cookbook/90_models/cloudflare/switch_model.py