Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whisper load balancing / preference lists? #13

Open
tonydamage opened this issue Dec 19, 2023 · 1 comment
Open

Whisper load balancing / preference lists? #13

tonydamage opened this issue Dec 19, 2023 · 1 comment

Comments

@tonydamage
Copy link

Hi,
not sure if this is correct place:
in my local setup I run 2 wyoming-whisper instances

  • tiny-8 on Raspberry Pi 4, which is fast and good enough for simple voice commands for Home Assistant
  • medium on desktop PC with RTX 2070

The medium whisper is not always on, and what I would like to see is behaviour like this:

  • If medium whisper is available (online) use that for speech detection
  • Otherwise fallback to tiny-8

It is possible to somehow configure / create wyoming instance which will have preferences? I can contribute code / help developing it, but I would need pointers to starting point and maybe some hints (since stt is stream based, it is harder to decide when switch processing node).

I also have same configuration for piper, but piper proxy is easier for understanding boundaries of request (eg. when I can safely use different instance for generation).

@synesthesiam
Copy link
Contributor

The expected event flow for speech-to-text can be found here: https://github.com/rhasspy/wyoming?tab=readme-ov-file#speech-to-text

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants