haiku.rag/docs/configuration
Yiorgis Gozadinos 7f7223e0ac
Default to ollama:qwen3.8
Replaces gpt-oss on ModelConfig, qa.model and processing.title_model, and
ministral-3 on the picture-description model. qa.model.vision follows the
model and is now true.

enable_thinking was gated on the gpt-oss name, so it did nothing for
qwen3.8. With title_model's max_tokens of 100 the reasoning consumed the
whole budget and title generation returned an empty string. The mapping
now applies to any ollama model via reasoning_effort(): false sends
"none", true sends "high". Measured on qwen3.8:27b-mlx, "low" does not
disable thinking and "none" does; gpt-oss is the inverse, its template
has no "none" level, so it keeps "low".

Picture description bypasses get_model -- docling posts the request
itself from a params dict -- so the flag was inert on that path too.
vlm_api_params() carries reasoning_effort into both converters' request
bodies. At max_tokens 200 the description survived either way, but the
switch cut completion tokens from 141 to 45.

test_search_tool_skips_binary_content_when_qa_model_is_text_only asserted
the vision default rather than setting it; it now configures vision=False
itself.

docs/benchmarks.md keeps ministral-3: those are recorded measurements.
2026-09-04 12:36:36 +03:00
..
index.md Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00
processing.md Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00
prompts.md Make the documented configuration match the code 2026-08-19 15:52:50 +03:00
providers.md Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00
qa.md Default to ollama:qwen3.8 2026-09-04 12:36:36 +03:00
storage.md Document LanceDB Cloud region as required 2026-09-03 17:44:32 +03:00