xAI Image Agent With Memory

Analyze an image with Grok 4.5 and retain history for follow-up questions.

The source-fidelity code uses the older grok-2-vision-latest model. Replace it with grok-4.5 before running the example.

image_agent_with_memory.py
"""
Xai Image Agent With Memory
===========================

Cookbook example for `xai/image_agent_with_memory.py`.
"""

from agno.agent import Agent
from agno.media import Image
from agno.models.xai import xAI
from agno.tools.websearch import WebSearchTools

# ---------------------------------------------------------------------------
# Create Agent
# ---------------------------------------------------------------------------

agent = Agent(
    model=xAI(id="grok-2-vision-latest"),
    tools=[WebSearchTools()],
    markdown=True,
    add_history_to_context=True,
    num_history_runs=3,
)

agent.print_response(
    "Tell me about this image and give me the latest news about it.",
    images=[
        Image(
            url="https://upload.wikimedia.org/wikipedia/commons/0/0c/GoldenGateBridge-001.jpg"
        )
    ],
)

agent.print_response("Tell me where I can get more images?")

# ---------------------------------------------------------------------------
# Run Agent
# ---------------------------------------------------------------------------

if __name__ == "__main__":
    pass

Run the Example

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Install dependencies

uv pip install -U agno ddgs openai

Export your xAI API key

export XAI_API_KEY="your_xai_api_key_here"

Update the model

When saving the code, replace grok-2-vision-latest with grok-4.5.

Store the image conversation

Add from agno.db.in_memory import InMemoryDb to the imports and db=InMemoryDb() to Agent(...). History needs storage to retain the image, question and answer for the follow-up. This database lasts for the current process; use a persistent database for conversation reuse across restarts.

Run the example

Save the code above as image_agent_with_memory.py, then run:

python image_agent_with_memory.py

Full source: cookbook/90_models/xai/image_agent_with_memory.py