haiku.rag/docs
Yiorgis Gozadinos 7f7223e0ac
Default to ollama:qwen3.8
Replaces gpt-oss on ModelConfig, qa.model and processing.title_model, and
ministral-3 on the picture-description model. qa.model.vision follows the
model and is now true.

enable_thinking was gated on the gpt-oss name, so it did nothing for
qwen3.8. With title_model's max_tokens of 100 the reasoning consumed the
whole budget and title generation returned an empty string. The mapping
now applies to any ollama model via reasoning_effort(): false sends
"none", true sends "high". Measured on qwen3.8:27b-mlx, "low" does not
disable thinking and "none" does; gpt-oss is the inverse, its template
has no "none" level, so it keeps "low".

Picture description bypasses get_model -- docling posts the request
itself from a params dict -- so the flag was inert on that path too.
vlm_api_params() carries reasoning_effort into both converters' request
bodies. At max_tokens 200 the description survived either way, but the
switch cut completion tokens from 141 to 45.

test_search_tool_skips_binary_content_when_qa_model_is_text_only asserted
the vision default rather than setting it; it now configures vision=False
itself.

docs/benchmarks.md keeps ministral-3: those are recorded measurements.
2026-09-04 12:36:36 +03:00
..
capabilities Remove the environment overrides and the last unnamed-database wording 2026-09-03 15:12:09 +03:00
configuration Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00
img Add ingester screenshot 2026-05-27 15:53:01 +03:00
stylesheets Landing page hero with TUI screen recording 2026-05-20 16:56:25 +03:00
apps.md Remove the environment overrides and the last unnamed-database wording 2026-09-03 15:12:09 +03:00
benchmarks.md Document vector index state and measured cost 2026-09-01 15:19:13 +03:00
changelog.md Improve documentation 2025-11-28 13:10:03 +02:00
chat.md Update caps documentation 2026-08-13 14:08:14 +03:00
cli.md One reference and one placement for a database 2026-09-03 15:12:08 +03:00
custom-pipelines.md Linting, doc edits 2026-08-18 12:18:10 +02:00
development.md Delete comments that restate the line below them 2026-08-20 15:22:33 +03:00
index.md Give the docs an architecture page and one extras list 2026-08-20 15:07:06 +03:00
ingester.md Give the docs an architecture page and one extras list 2026-08-20 15:07:06 +03:00
installation.md Give the docs an architecture page and one extras list 2026-08-20 15:07:06 +03:00
mcp.md Accept images on CLI ask/analyze and MCP tools 2026-07-25 10:35:25 +03:00
overview.md One reference and one placement for a database 2026-09-03 15:12:08 +03:00
python.md Name the remedy for a missing configured database and list the databases an unknown name could have meant 2026-09-03 15:26:42 +03:00
remote-processing.md Wire providers.docling_serve.timeout through to the client 2026-08-19 13:30:45 +03:00
tools.md replace haiku.skills with native Pydantic AI capabilities 2026-07-24 15:26:17 +03:00
tuning.md Remove the wix evaluation dataset 2026-08-14 14:46:51 +03:00
tutorial.md Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00