This commit is contained in:
Yiorgis Gozadinos 2026-02-12 17:38:41 +02:00
parent a5b8e3be7e
commit 2496b02a3b
No known key found for this signature in database
2 changed files with 65 additions and 29 deletions

View file

@ -432,27 +432,26 @@ See [RLM Agent](agents/rlm.md) for details on capabilities and configuration.
haiku.rag provides composable toolset factories that can be mixed into any pydantic-ai agent. This lets you build custom agents with exactly the capabilities you need — search, document management, Q&A, or code analysis — sharing state across tools via `ToolContext`. haiku.rag provides composable toolset factories that can be mixed into any pydantic-ai agent. This lets you build custom agents with exactly the capabilities you need — search, document management, Q&A, or code analysis — sharing state across tools via `ToolContext`.
```python ```python
from dataclasses import dataclass
from pydantic_ai import Agent from pydantic_ai import Agent
from haiku.rag.tools import ToolContext, RAGDeps, create_search_toolset, create_qa_toolset from haiku.rag.tools import (
AgentDeps, ToolContext, prepare_context,
@dataclass create_search_toolset, create_qa_toolset,
class MyDeps: )
client: HaikuRAG
tool_context: ToolContext | None = None
search = create_search_toolset(config) search = create_search_toolset(config)
qa = create_qa_toolset(config) qa = create_qa_toolset(config)
agent = Agent( agent = Agent(
"openai:gpt-4o", "openai:gpt-4o",
deps_type=MyDeps, deps_type=AgentDeps,
instructions="You are a helpful assistant.", instructions="You are a helpful assistant.",
toolsets=[search, qa], toolsets=[search, qa],
) )
async with HaikuRAG("path/to/db.lancedb") as client: async with HaikuRAG("path/to/db.lancedb") as client:
deps = MyDeps(client=client, tool_context=ToolContext()) context = ToolContext()
prepare_context(context, features=["search", "qa"])
deps = AgentDeps(client=client, tool_context=context)
result = await agent.run("What are the main findings?", deps=deps) result = await agent.run("What are the main findings?", deps=deps)
``` ```

View file

@ -37,7 +37,7 @@ state = context.get_or_create("my_namespace", MyState)
The entire context can be serialized and restored: The entire context can be serialized and restored:
```python ```python
# Serialize all namespaces # Serialize all namespaces (keyed by namespace)
data = context.dump_namespaces() data = context.dump_namespaces()
# {"my_namespace": {"count": 0}} # {"my_namespace": {"count": 0}}
@ -45,6 +45,30 @@ data = context.dump_namespaces()
context.load_namespace("my_namespace", MyState, data["my_namespace"]) context.load_namespace("my_namespace", MyState, data["my_namespace"])
``` ```
For AG-UI state management, use flat snapshots:
```python
# Flat snapshot of all namespaces (for AG-UI state)
snapshot = context.build_state_snapshot()
# {"document_filter": [], "citations": [], "citation_registry": {}, "qa_history": []}
# Restore from flat snapshot (updates registered namespaces in place)
context.restore_state_snapshot(snapshot)
```
### Preparing context for toolsets
`prepare_context()` registers the required namespaces for a given set of features:
```python
from haiku.rag.tools import ToolContext, prepare_context
context = ToolContext()
prepare_context(context, features=["search", "qa"], state_key="my_app")
```
This is idempotent and registers `SessionState` (for search, QA, and analysis features) and `QASessionState` (for QA). The chat agent's `prepare_chat_context()` is a thin wrapper that defaults to chat features and sets the AG-UI state key.
## Search Toolset ## Search Toolset
`create_search_toolset()` provides hybrid search (vector + full-text) with context expansion and citation tracking. `create_search_toolset()` provides hybrid search (vector + full-text) with context expansion and citation tracking.
@ -110,6 +134,7 @@ qa = create_qa_toolset(config)
| `config` | required | AppConfig | | `config` | required | AppConfig |
| `base_filter` | `None` | SQL WHERE clause applied to searches | | `base_filter` | `None` | SQL WHERE clause applied to searches |
| `tool_name` | `"ask"` | Name of the tool exposed to the agent | | `tool_name` | `"ask"` | Name of the tool exposed to the agent |
| `on_ask_complete` | `None` | Callback `(QASessionState, AppConfig) -> None` invoked after each QA cycle |
**Tool: `ask(question, document_name?)`** **Tool: `ask(question, document_name?)`**
@ -117,7 +142,7 @@ Runs the research graph in conversational mode and returns a `QAResult`. When a
- Prior answers from `QASessionState.qa_history` are matched via embedding similarity - Prior answers from `QASessionState.qa_history` are matched via embedding similarity
- The answer is appended to `qa_history` - The answer is appended to `qa_history`
- Background summarization is triggered - `on_ask_complete` callback is invoked (if provided)
- Citations get stable indices via `SessionState.citation_registry` - Citations get stable indices via `SessionState.citation_registry`
**State:** QA history accumulates in `QASessionState` under the `haiku.rag.qa_session` namespace. **State:** QA history accumulates in `QASessionState` under the `haiku.rag.qa_session` namespace.
@ -136,6 +161,7 @@ result = await run_qa_core(
document_name="User Guide", # optional document filter document_name="User Guide", # optional document filter
context=context, # optional ToolContext context=context, # optional ToolContext
session_context="User is building a web app", # optional session_context="User is building a web app", # optional
on_qa_complete=my_callback, # optional post-QA callback
) )
print(result.answer) print(result.answer)
@ -168,42 +194,36 @@ Executes a computational task via code execution and returns an `AnalysisResult`
## Composing Custom Agents ## Composing Custom Agents
Toolsets are designed to be composed into custom pydantic-ai agents: Toolsets are designed to be composed into custom pydantic-ai agents. Use `AgentDeps` and `prepare_context` for minimal boilerplate:
```python ```python
from dataclasses import dataclass
from pydantic_ai import Agent from pydantic_ai import Agent
from haiku.rag.client import HaikuRAG from haiku.rag.client import HaikuRAG
from haiku.rag.config import Config
from haiku.rag.tools import ( from haiku.rag.tools import (
AgentDeps,
ToolContext, ToolContext,
RAGDeps, prepare_context,
create_search_toolset, create_search_toolset,
create_qa_toolset, create_qa_toolset,
create_document_toolset, create_document_toolset,
) )
# Toolsets are created once at configuration time # Toolsets are created once at configuration time
search = create_search_toolset(Config) search = create_search_toolset(config)
qa = create_qa_toolset(Config) qa = create_qa_toolset(config)
docs = create_document_toolset(Config) docs = create_document_toolset(config)
@dataclass
class MyDeps:
"""Must satisfy the RAGDeps protocol (client + tool_context)."""
client: HaikuRAG
tool_context: ToolContext | None = None
agent = Agent( agent = Agent(
"openai:gpt-4o", "openai:gpt-4o",
deps_type=MyDeps, deps_type=AgentDeps,
instructions="You are a helpful research assistant.", instructions="You are a helpful research assistant.",
toolsets=[search, qa, docs], toolsets=[search, qa, docs],
) )
async with HaikuRAG("path/to/db.lancedb") as client: async with HaikuRAG("path/to/db.lancedb") as client:
context = ToolContext() context = ToolContext()
deps = MyDeps(client=client, tool_context=context) prepare_context(context, features=["search", "documents", "qa"])
deps = AgentDeps(client=client, tool_context=context)
result = await agent.run("What documents do we have about climate?", deps=deps) result = await agent.run("What documents do we have about climate?", deps=deps)
print(result.output) print(result.output)
@ -215,13 +235,31 @@ async with HaikuRAG("path/to/db.lancedb") as client:
print(f"Total search results: {len(search_state.results)}") print(f"Total search results: {len(search_state.results)}")
``` ```
Tool functions access `client` and `tool_context` via pydantic-ai's `RunContext.deps`, so toolsets can be created once and reused across requests. Your deps type just needs to satisfy the `RAGDeps` protocol (have `client` and `tool_context` attributes). `AgentDeps` satisfies the `RAGDeps` protocol and implements the AG-UI state protocol (`state` getter/setter). For AG-UI streaming, pass a `state_key`:
```python
deps = AgentDeps(client=client, tool_context=context, state_key="my_app")
```
Tool functions access `client` and `tool_context` via pydantic-ai's `RunContext.deps`, so toolsets can be created once and reused across requests.
All toolsets respect session-level document filters when a `SessionState` is registered in the context. This means setting `SessionState.document_filter` restricts all tools simultaneously. All toolsets respect session-level document filters when a `SessionState` is registered in the context. This means setting `SessionState.document_filter` restricts all tools simultaneously.
## AG-UI State Management ## AG-UI State Management
When using the chat agent with [AG-UI](https://docs.ag-ui.com) streaming, `ChatDeps` implements the `StateHandler` protocol. State is emitted under a namespaced key via `state_key`: Both `AgentDeps` and `ChatDeps` implement the AG-UI `StateHandler` protocol. State is emitted under a namespaced key via `state_key`.
**Custom agents** use `AgentDeps` + `prepare_context`:
```python
from haiku.rag.tools import AgentDeps, ToolContext, ToolContextCache, prepare_context
context = ToolContext()
prepare_context(context, features=["search", "qa"], state_key="my_app")
deps = AgentDeps(client=client, tool_context=context, state_key="my_app")
```
**Chat agent** uses `ChatDeps` + `prepare_chat_context` (adds chat-specific overrides like background summarization and initial context handling):
```python ```python
from haiku.rag.agents.chat import ( from haiku.rag.agents.chat import (
@ -229,7 +267,6 @@ from haiku.rag.agents.chat import (
) )
from haiku.rag.tools import ToolContext, ToolContextCache from haiku.rag.tools import ToolContext, ToolContextCache
# Agent can be created once at startup
agent = create_chat_agent(config) agent = create_chat_agent(config)
# For multi-session apps, cache ToolContext per thread # For multi-session apps, cache ToolContext per thread