with whisper it works. But extremely slow if you host the model local.
for that reason, I decided to use “searches ai” in a container. It provides a flexible way to deal with stt and tts models. But the biggest benefit was to have a easy way for GPU usage and it provides a openAI API.
The whisperstt addon works out of the box with this service, as it is openai API compatible.
The openaitts service works with the API too, but has a lot of hardcoded stuff like voices, language etc…
After I fixed all of this locally, I’m able to run the full voice pipeline using whisperstt and openaitts using my local running “searches AI” service fully accelerated.
my STT service went down from ~20s to 1.2 s… it is acceptable for prototyping.
now I can continue working on my voice assistant integration.
and before anyone asks, I will provide my changes later as patches. Currently I’m in a very early stage where I’m not sure if this is the right way to fix and improve things.
everything is just for playing, exploring and learning.