Richard R 874e5ef359 refactor(whisper): migrate word alignment to ONNX backend and remove whisper.cpp integration

Replace the previous whisper.cpp-based word alignment with a fully ONNX-based
implementation using onnxruntime-node and @huggingface/tokenizers. Add new
Whisper ONNX model management, alignment mapping, and spectral analysis modules.
Remove all code and documentation referencing whisper.cpp, update environment
variables, Dockerfile, and docs to reflect ONNX-only alignment. Add unit tests
for alignment and ONNX model logic.

2026-05-19 13:00:21 -06:00

3.7 KiB

Raw Blame History

📄🔊 OpenReader

OpenReader is an open source, self-host-friendly text-to-speech document reader built with Next.js for EPUB, PDF, TXT, MD, and DOCX with synchronized read-along playback.

Previously named OpenReader-WebUI.

Get started in the docs.

✨ Highlights

🎯 Multi-provider TTS with OpenAI-compatible endpoints and cloud providers (Kokoro-FastAPI, KittenTTS-FastAPI, Orpheus-FastAPI or OpenAI, Replicate, DeepInfra).
📖 Read-along playback for PDF/EPUB with sentence-aware narration.
⏱️ Word-by-word highlighting via built-in ONNX Whisper alignment in local compute mode (OPENREADER_COMPUTE_MODE=local).
🧱 Layout-aware PDF parsing (PP-DocLayoutV3 ONNX) with structured blocks for cleaner TTS/chaptering.
🛜 Sync + library import to bring docs across devices and from server-mounted folders.
🗂️ Flexible storage with embedded SeaweedFS or external S3-compatible backends.
🎧 Audiobook export in m4b/mp3 with resumable chapter processing.
🐳 Self-host friendly with Docker, optional auth, and automatic startup migrations.

🚀 Start Here

Goal	Link
Run with Docker	Docker Quick Start
Deploy on Vercel	Vercel Deployment
Develop locally	Local Development
Configure auth	Auth
Configure SQL database	Database and Migrations
Configure object storage	Object / Blob Storage
Configure TTS providers	TTS Providers
Run Kokoro locally	Kokoro-FastAPI
Run KittenTTS locally	KittenTTS-FastAPI
Get support or contribute	Support and Contributing

🧭 Community

Questions and ideas: GitHub Discussions
Bug reports: GitHub Issues
Contributions: open a pull request

📜 License

MIT. See LICENSE.