How to Use TTS - STT with Mistral-7b or Other LLMs for an Offline Voice Assistant?
Hello everyone,I’ve been diving deep into open-source AI research, specifically focusing on LLMs (Large Language Models) and voice assistants. The primary aim of my research is to develop an offline voice assistant, where TTS (Text-to-Speech) plays a pivotal role.While I’ve come across solutions likeWhisper AIandBark AI, I haven’t found any concrete information regarding their compatibility with LLMs like Mistral-7b. If anyone has any experience or knowledge about this, it would be greatly appreciated.Moreover, if anyone has access to Google Colab notebooks that demonstrate the use of TTS with LLMs, I’d be incredibly grateful if you could share them. Similarly, if you’re aware of any TTS AI systems that are known to be compatible with LLMs, please do share that information as well.As this project progresses, I’m committed to sharing any useful findings and solutions with the community to benefit all. Your insights today can help shape better tools for everyone tomorrow.Thanks in advance for any insights, resources, or advice!
2023-11-06T00:21:39Z
So far this is the only information i foundgithub.comArijit1080/Open-AI-based-Voice-Chatbot-in-Raspberry-Pi-or-PC/blob/main/openAIBot.pyimport speech_recognition as sr
import pyttsx3
import openai

#Initializing pyttsx3
listening = True
engine = pyttsx3.init()

#Set your openai api key and customizing the chatgpt role
openai.api_key = "xyz"
messages = [{"role": "system", "content": "Your name is Jarvis and give answers in 2 lines"}]

#Customizing The output voice
voices = engine.getProperty('voices')
rate = engine.getProperty('rate')
volume = engine.getProperty('volume')


def get_response(user_input):
    messages.append({"role": "user", "content": user_input})This file has been truncated.show original
2023-11-06T00:28:38Z
Here is another video