History

Yiorgis Gozadinos ea7a4a9a8f apply dotenv usecwd fix to remaining files Apply the same find_dotenv(usecwd=True) fix from cli.py to: - evaluations/evaluations/benchmark.py - app/backend/main.py Co-Authored-By: Tianyi Cui <contact@tianyicui.com>		2026-01-22 12:41:35 +02:00
..
backend	apply dotenv usecwd fix to remaining files	2026-01-22 12:41:35 +02:00
frontend	Rename initial_context to background_context	2026-01-16 15:03:42 +02:00
.env.example	Update docs for app	2026-01-13 12:18:13 +02:00
docker-compose.dev.yml	Mount haiku.rag.yaml config in docker compose	2026-01-12 12:36:30 +02:00
docker-compose.yml	Mount haiku.rag.yaml config in docker compose	2026-01-12 12:36:30 +02:00
haiku.rag.yaml.example	Update docs for app	2026-01-13 12:18:13 +02:00
README.md	Update docs for app	2026-01-13 12:18:13 +02:00

README.md

haiku.rag Chat App

A conversational RAG interface built with CopilotKit and pydantic-ai's AG-UI protocol.

Prerequisites

Docker and Docker Compose
A haiku.rag database (created via the haiku-rag CLI)
An LLM API key (Anthropic, OpenAI, or local Ollama)

Quick Start

Set up environment variables:

cp .env.example .env
# Edit .env with your API keys and database path

Configure the LLM and embedding models:

cp haiku.rag.yaml.example haiku.rag.yaml
# Edit haiku.rag.yaml to configure your models

Start the app:
```
docker compose up -d
```
Open the chat interface: http://localhost:3000

Configuration

Environment Variables

Variable	Description	Required
`DB_PATH`	Path to your haiku.rag LanceDB database	Yes
`ANTHROPIC_API_KEY`	Anthropic API key	One LLM key required
`OPENAI_API_KEY`	OpenAI API key	One LLM key required
`OLLAMA_BASE_URL`	Ollama server URL (default: `http://host.docker.internal:11434`)	For local models
`LOGFIRE_TOKEN`	Pydantic Logfire token for debugging	No

haiku.rag.yaml

Configure the chat agent's LLM, embeddings, and search settings:

qa:
  model:
    provider: anthropic  # or openai, ollama
    name: claude-sonnet-4-20250514

embeddings:
  model:
    provider: ollama
    name: nomic-embed-text

search:
  limit: 10
  context_radius: 1

See haiku.rag.yaml.example for all options.

Development

For local development with hot reloading:

docker compose -f docker-compose.dev.yml up -d --build

Backend code changes reload automatically
Frontend available at http://localhost:3000
Backend API at http://localhost:8001

Architecture

┌─────────────────┐     ┌─────────────────┐     ┌─────────────────┐
│    Frontend     │────▶│     Backend     │────▶│   haiku.rag     │
│  (CopilotKit)   │     │  (pydantic-ai)  │     │   (LanceDB)     │
│  localhost:3000 │     │  localhost:8001 │     │                 │
└─────────────────┘     └─────────────────┘     └─────────────────┘

Backend Endpoints

Endpoint	Method	Description
`/v1/chat/stream`	POST	AG-UI chat streaming
`/api/documents`	GET	List documents in database
`/api/info`	GET	Database statistics
`/api/visualize/{chunk_id}`	GET	Visual grounding for chunks
`/health`	GET	Health check

Chat Capabilities

The chat agent can:

Search your documents with hybrid vector + full-text search
Answer questions with citations from your knowledge base
Filter by document when you ask about specific files
Show visual grounding for PDF/image sources