2024-03-07.03-34-04.mp4
- llama-cpp-python (+ compatible models)
- TTS
- PyAudio
- OpenAi whisper
- ===For the bot part:
- discord-ext-voice-recv
- dev version of discord.py
- virtual audio cable + voicemeeter
- python_dotenv
- clone repo
- create venv and pip install requirements.txt into it
- find devices (TTS input, output) (Im currently using
VoiceMeeter Input
,VoiceMeeter Out
) python get_audio_devices.py
- copy the names of the devices into appropriate place in main.py and bot.py
- main.py gets the input, bot.py gets the output
- create .env and set TOKEN="your discord bot token"
- download llama.cpp compatible models into ./models
- edit config.json
- launch both main and bot
- press enter in main to start
- join vc and ping bot join
@yourbot join
- it probably wont work because i forgot to mention something
- Currently using/tested mistral dolphin 2.1 and nous hermes 2
- For tts using
Xtts_v2Vits (theres probably better options) - Often came across torch not detecting CUDA
- To fix torch, install using this