pediatric-ai-scribe-v3/docs/features-explained.md

4.5 KiB

Features Explained

This file is a practical operator-oriented overview of major Ped-AI features. It intentionally describes the current fork, not historical browser Whisper behavior.

Clinical Documentation

Ped-AI generates pediatric clinical notes from typed input, dictation, or recorded audio. Major workflows include live encounters, dictation cleanup, sick visits, well visits, SOAP notes, hospital courses, chart review, ED documentation, and developmental milestones.

Model selection is available per task where the UI exposes a tab-level selector. Admin defaults provide the baseline model and user/task choices can override that baseline.

Generated notes can expose post-note helper panels. Billing suggestions and don't-miss review are clinician-facing. Patient education handouts are parent-facing drafts generated from the edited note, with optional diagnosis, medication, and preferred-language context. The clinician must verify the handout before sharing it.

Phone Extensions And Pagers

The bedside tools include a per-user phone extension and pager directory. Entries support active/trash views, search, soft delete/restore, permanent purge, ZIP export, and JSON/ZIP import. Import preview flags exact active duplicates, exact trashed matches that can be restored, and possible duplicates before committing changes.

Speech

Final transcription is server-side through LiteLLM. Configure upstream STT providers in LiteLLM rather than in Ped-AI.

Browser-native Web Speech is only an explicit opt-in preview path. It is not the final clinical transcript and may use browser-vendor cloud services.

Browser Whisper and browser-local model workers are removed. Do not expect a pre-download model button, public Whisper worker, or bundled Xenova model path.

Text To Speech

The voice preview button calls LiteLLM TTS and plays the returned audio in the browser. If preview is silent, check that a LiteLLM voice is selected, the gateway is configured, the user is authenticated, and browser autoplay has not blocked playback.

Learning Hub

Learning Hub is both a learner-facing content area and an admin/moderator CMS.

  • Articles and pearls render sanitized content.
  • Quizzes support single-answer, multi-select, and true/false questions.
  • Presentations use Marp-style markdown with preview and PPTX export.
  • AI generation can use topic text, uploaded source files, or connected Nextcloud WebDAV files.
  • Categories can organize content without deleting the content when category assignments change.

Nextcloud WebDAV

Users can connect a Nextcloud account with an app password. Learning Hub AI generation can browse files from the connected WebDAV account, and users can set a default browse path to avoid repeatedly navigating to the same clinical content folder.

Documents And S3

Document upload is optional and depends on S3-compatible storage configuration. Treat uploaded documents as PHI unless you have a separate deployment reason not to.

Audio Backups

Audio backups exist to recover failed transcription attempts.

  • They are created when transcription fails.
  • They are encrypted before persistent storage.
  • They expire automatically.
  • Users can retry or delete them from Settings.

Admin Panel

Admins can manage users, roles, registration, security settings, model defaults, prompts, logs, and Learning Hub content. Production deployments should enable SSO/2FA and restrict admin access.

Feature Status

Feature Status Notes
Clinical note generation Active Provider depends on AI_PROVIDER.
Server transcription Active Google/AWS/LiteLLM/OpenAI paths.
Browser Web Speech preview Optional Explicit opt-in only.
Browser Whisper Removed No public worker or model download path.
Learning Hub CMS Active Articles, pearls, quizzes, presentations.
Nextcloud WebDAV Active Used for file browsing/content import.
Patient handouts Active Parent-facing, note-derived, preferred-language draft.
Extension transfer Active ZIP export plus JSON/ZIP import preview.
Audio backups Active Failure recovery only.
TTS preview Active Depends on configured provider.

Troubleshooting

  • Check browser console for frontend errors.
  • Check docker logs pediatric-ai-scribe -f for backend errors.
  • Check /api/health for service status.
  • Check provider credentials and model names before debugging UI state.
  • For Learning Hub file import failures, verify Nextcloud URL, username, app password, and folder path.