Update README.md
This commit is contained in:
parent
70a5e06aef
commit
08cb92b6d5
1 changed files with 1 additions and 0 deletions
|
|
@ -103,6 +103,7 @@ Orpheus-FastAPI/
|
||||||
- Python 3.8-3.11 (Python 3.12 is not supported due to removal of pkgutil.ImpImporter)
|
- Python 3.8-3.11 (Python 3.12 is not supported due to removal of pkgutil.ImpImporter)
|
||||||
- CUDA-compatible GPU (recommended: RTX series for best performance)
|
- CUDA-compatible GPU (recommended: RTX series for best performance)
|
||||||
- Using docker compose or separate LLM inference server running the Orpheus model (e.g., LM Studio or llama.cpp server)
|
- Using docker compose or separate LLM inference server running the Orpheus model (e.g., LM Studio or llama.cpp server)
|
||||||
|
- For Docker GPU Support, ensure you're using an Nvidia GPU on either Linux or Windows with CUDA 12.4 or greater and NVIDIA Container Toolkit installed
|
||||||
|
|
||||||
### 🐳 Docker compose
|
### 🐳 Docker compose
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue