From 08cb92b6d513d3532804992f74ccf231f4641c11 Mon Sep 17 00:00:00 2001 From: "Alexander J." Date: Mon, 30 Jun 2025 12:59:07 +1000 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 867c46e..bd1aeee 100644 --- a/README.md +++ b/README.md @@ -103,6 +103,7 @@ Orpheus-FastAPI/ - Python 3.8-3.11 (Python 3.12 is not supported due to removal of pkgutil.ImpImporter) - CUDA-compatible GPU (recommended: RTX series for best performance) - Using docker compose or separate LLM inference server running the Orpheus model (e.g., LM Studio or llama.cpp server) +- For Docker GPU Support, ensure you're using an Nvidia GPU on either Linux or Windows with CUDA 12.4 or greater and NVIDIA Container Toolkit installed ### 🐳 Docker compose