Point FRAMES at the live reranker and give the judge room to think

Port 11433 serves nothing; Qwen3-Reranker-4B is on 11455. Qwen3.6 spends
its budget reasoning before it answers, and its 131072 window leaves ample
input space at 32768.
This commit is contained in:
Yiorgis Gozadinos 2026-07-30 09:34:36 +03:00
parent bc6c23cbf3
commit 4df31ff16e
No known key found for this signature in database

View file

@ -21,7 +21,7 @@ reranking:
model:
provider: vllm
name: Qwen/Qwen3-Reranker-4B
base_url: http://vllm:11433
base_url: http://vllm:11455
analysis:
# Bounds per-execution sandbox output so accumulated code returns cannot
@ -40,7 +40,13 @@ qa:
evaluations:
judge:
provider: openai
name: RedHatAI/Qwen3.6-35B-A3B-NVFP4
base_url: http://vllm:11430/v1
temperature: 0.0
name: Inferact/Qwen3.8-27B-NVFP4
base_url: http://vllm:11439/v1
temperature: 0.6
max_tokens: 16384
extra_body:
top_p: 0.95
top_k: 20
min_p: 0
chat_template_kwargs:
reasoning_effort: low