Ollama Reasoning Tools

Local Llama 3.2 via Ollama uses ReasoningTools and web search for an NVDA vs TSLA report.

ollama_reasoning_tools.py
"""
Ollama Reasoning Tools
======================

Demonstrates this reasoning cookbook example.
"""

from agno.agent import Agent
from agno.models.ollama.chat import Ollama
from agno.tools.reasoning import ReasoningTools
from agno.tools.websearch import WebSearchTools


# ---------------------------------------------------------------------------
# Create Example
# ---------------------------------------------------------------------------
def run_example() -> None:
    reasoning_agent = Agent(
        model=Ollama(id="llama3.2:latest"),
        tools=[
            ReasoningTools(
                enable_think=True,
                enable_analyze=True,
                add_instructions=True,
                add_few_shot=True,
            ),
            WebSearchTools(),
        ],
        instructions="Use tables where possible",
        markdown=True,
    )
    reasoning_agent.print_response(
        "Write a report comparing NVDA to TSLA",
        stream=True,
        show_full_reasoning=True,
    )


# ---------------------------------------------------------------------------
# Run Example
# ---------------------------------------------------------------------------
if __name__ == "__main__":
    run_example()

Before running, replace the model constructor with:

Ollama(id="llama3.2:latest", host="http://localhost:11434", api_key=None)

Clear cloud credentials in the setup step below. The model inference runs locally; WebSearchTools still makes external search requests.

Run the Example

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Install dependencies

uv pip install -U agno ddgs ollama

Select the local Ollama server

In the shell used for the pull commands and Python example, clear a previous cloud key and point native clients and embeddings at your local server:

unset OLLAMA_API_KEY
export OLLAMA_HOST="http://localhost:11434"

Without this reset, OLLAMA_API_KEY makes Agno's default Ollama model route to https://ollama.com even when OLLAMA_HOST points locally. Keep a local Ollama server running for the following steps.

Prepare Ollama

Install and start Ollama, then pull the model used by this example:

ollama pull llama3.2:latest

Run the example

Save the code above as ollama_reasoning_tools.py, then run:

python ollama_reasoning_tools.py

Full source: cookbook/10_reasoning/tools/ollama_reasoning_tools.py