diff --git a/README.md b/README.md index 6dc1fc8..167277e 100644 --- a/README.md +++ b/README.md @@ -106,6 +106,7 @@ Orpheus-FastAPI/ ### 🐳 Docker compose The docker compose file orchestrates the Orpheus-FastAPI for audio and a llama.cpp inference server for the base model token generation. The GGUF model is downloaded with the model-init service. +There are two versions, one for machines that have access to GPU support `docker-compose-gpu.yaml` and one for CPU support only: `docker-compose-cpu.yaml` ```bash cp .env.example .env # Create your .env file from the example @@ -119,8 +120,15 @@ ORPHEUS_MODEL_NAME=Orpheus-3b-French-FT-Q8_0.gguf # Example for French ``` Then start the services: + +For GPU support run ```bash -docker compose up --build +docker compose -f docker-compose-gpu.yml up +``` + +For CPU support run: +```bash +docker compose -f docker-compose-cpu.yml up ``` The system will automatically download the specified model from Hugging Face before starting the service.