Streaming Agent

Stream a Claude response through Vertex AI with an Agno agent.

Set stream=True on agent.print_response() to print the response as it arrives.

Code

streaming_agent.py
from typing import Iterator  # noqa
from agno.agent import Agent, RunOutputEvent  # noqa
from agno.models.vertexai.claude import Claude

agent = Agent(model=Claude(id="claude-sonnet-4-6"), markdown=True)

# Get the response in a variable
# run_response: Iterator[RunOutputEvent] = agent.run("Share a 2 sentence horror story", stream=True)
# for chunk in run_response:
#     print(chunk.content)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story", stream=True)

Usage

Complete the Vertex project, model enablement, permissions, and CLI prerequisites first. Use a region that serves Sonnet 4.6.

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Set your environment variables

export CLOUD_ML_REGION="us-east5"
export GOOGLE_CLOUD_PROJECT=xxx

Authenticate your CLI session

gcloud auth application-default login
You don't need to authenticate your CLI every time.

Install dependencies

uv pip install -U 'anthropic[vertex]' agno

Run Agent

python streaming_agent.py