Commit graph

3 commits

Author SHA1 Message Date
malibrated
4ead99754a Minor improvements to account for large-VRAM Apple Silicon machines, and refine the inferencing code to ignore spurious, non-audio responses from the Orpheus model, use the system prompt if it exists in the directory structure, and for long texts, 1) use nltk for segmenting the text according to user-specified max character lengths, and 2) use the previous segment (For segment index n>1) as context in the system prompt, to hopefully improve audio generation consistency. 2025-04-21 22:30:33 -07:00
Lex-au
92ccffab93 New quants + Environment update
README.md:
- Added new quants (Q2_K, Q4_K_M)

TTS_ENGINE:
- Updated the External Inference Server section:
- Made the model parameter configurable via ORPHEUS_MODEL_NAME environment variable

Environment:
- Updated .env.example to include this new parameter
2025-03-24 21:32:21 +11:00
Lex-au
bcd7403cd0 v1.1.0
lgtm
2025-03-23 07:48:07 +11:00