Researching ways to speed up WhisperAI startup
Seasoned Front End Dev with background in C++. New to Python, Docker, WhisperAI. Using an RTX-3080 and Ryzen 5800X with 32GB or RAM for development.Got a Docker image/container of WhisperX going that I can tap for transcriptions.[WhisperX Docker Images]It works really well but there’s something I’m curious about. Whisper takes about 10 seconds to start transcribing each time I send over an audio file (using themedium model).Any way to mitigate those 10 seconds? Via Docker? Via built in functionality of Whisper/WhisperX?Wish there was a way to keep those startup scripts spun up so that the next Whisper request didn’t have to start from zero.Screenshot of Whisper’s output when initiating a transcription. It’s this startup process that I would like to know if it can be mitigated/reduced.image1263×394 181 KB