LangDB Basic

Run a Llama 3.1 70B agent through the LangDB gateway with streaming.

basic.py
"""
Langdb Basic
============

Cookbook example for `langdb/basic.py`.
"""

from agno.agent import Agent, RunOutput  # noqa
from agno.models.langdb import LangDB

# ---------------------------------------------------------------------------
# Create Agent
# ---------------------------------------------------------------------------

agent = Agent(model=LangDB(id="llama3-1-70b-instruct-v1.0"), markdown=True)

# Get the response in a variable
# run: RunOutput = agent.run("Share a 2 sentence horror story")
# print(run.content)

# Print the response in the terminal

# ---------------------------------------------------------------------------
# Run Agent
# ---------------------------------------------------------------------------
if __name__ == "__main__":
    # --- Sync ---
    agent.print_response("Share a 2 sentence horror story")

    # --- Sync + Streaming ---
    agent.print_response("Share a 2 sentence horror story", stream=True)

Run the Example

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Install dependencies

uv pip install -U agno openai

Configure LangDB access

Create a LangDB project and API key, and enable the provider access required by your selected model. Set the current API host; Agno appends the project ID and /v1.

export LANGDB_API_BASE_URL="https://api.langdb.ai"
export LANGDB_API_KEY="your_langdb_api_key"
export LANGDB_PROJECT_ID="your_langdb_project_id"

Check your project's model catalog for the exact ID and required capabilities, such as vision, tool calling or structured output. Gateway aliases and access can vary by project.

Run the example

Save the code above as basic.py, then run:

python basic.py

Full source: cookbook/90_models/langdb/basic.py