Update t2_finqa config
This commit is contained in:
parent
5fc4056dcd
commit
325f4517ba
1 changed files with 13 additions and 3 deletions
|
|
@ -15,6 +15,11 @@ embeddings:
|
||||||
vector_dim: 2560
|
vector_dim: 2560
|
||||||
base_url: http://vllm:11431/v1
|
base_url: http://vllm:11431/v1
|
||||||
|
|
||||||
|
processing:
|
||||||
|
converter: docling-local
|
||||||
|
pictures: none # ~4% of pages carry a figure/chart; dropped as non-essential to the numeric QA
|
||||||
|
chunking_use_markdown_tables: true
|
||||||
|
|
||||||
reranking:
|
reranking:
|
||||||
model:
|
model:
|
||||||
provider: mxbai
|
provider: mxbai
|
||||||
|
|
@ -23,13 +28,18 @@ reranking:
|
||||||
qa:
|
qa:
|
||||||
model:
|
model:
|
||||||
provider: openai
|
provider: openai
|
||||||
name: gemma4-26b
|
name: RedHatAI/Qwen3.6-35B-A3B-NVFP4
|
||||||
base_url: http://vllm:11432/v1
|
base_url: http://vllm:11430/v1
|
||||||
|
temperature: 0.3
|
||||||
|
max_tokens: 16384
|
||||||
|
extra_body:
|
||||||
|
chat_template_kwargs:
|
||||||
|
enable_thinking: true
|
||||||
|
|
||||||
prompts:
|
prompts:
|
||||||
domain_preamble: |
|
domain_preamble: |
|
||||||
Use search() to find the relevant documents. Do not iterate over all of
|
Use search() to find the relevant documents. Do not iterate over all of
|
||||||
/documents or read every document's content, that will time out.
|
/documents or read every document's content — that will time out.
|
||||||
|
|
||||||
For questions with a numeric answer, end your response with a final line
|
For questions with a numeric answer, end your response with a final line
|
||||||
formatted exactly as `ANSWER: <number>`, containing a single number. Keep a
|
formatted exactly as `ANSWER: <number>`, containing a single number. Keep a
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue