danvics/pediatric-ai-scribe-v3
1
0
Fork 0
Code Issues Pull requests Projects Releases 16 Packages Wiki Activity Actions

Fix LiteLLM STT: remove prompt/response_format unsupported by Vertex Chirp

Browse source 
Vertex AI Chirp via LiteLLM rejects/hangs when 'prompt' and
'response_format' are included — these are OpenAI Whisper-only params.
Send only file + model for LiteLLM/Chirp.
This commit is contained in:
Daniel Onyejesi 2026-03-29 21:54:12 -04:00
parent d1138c8cc2
commit 832fbc1283
1 changed files with 2 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
src/routes/transcribe.js
View file

@ -79,9 +79,8 @@ router.post('/transcribe', authMiddleware, upload.single('audio'), async (req, r
contentType: req.file.mimetype || 'audio/webm' contentType: req.file.mimetype || 'audio/webm'
}); });
form.append('model', sttModel); form.append('model', sttModel);
form.append('language', 'en'); // Note: Vertex AI Chirp via LiteLLM does not support 'prompt' or 'response_format'
form.append('response_format', 'json'); // Only send parameters Chirp actually accepts
form.append('prompt', 'Medical patient encounter. Pediatric. Clinical terms, diagnoses, medications.');
var sttHeaders = Object.assign({}, form.getHeaders()); var sttHeaders = Object.assign({}, form.getHeaders());
if (process.env.LITELLM_API_KEY) sttHeaders['Authorization'] = 'Bearer ' + process.env.LITELLM_API_KEY; if (process.env.LITELLM_API_KEY) sttHeaders['Authorization'] = 'Bearer ' + process.env.LITELLM_API_KEY;
var base = process.env.LITELLM_API_BASE.replace(/\/+$/, ''); var base = process.env.LITELLM_API_BASE.replace(/\/+$/, '');