RealTimeSTT-fork/example_app

GPU Support with CUDA (recommended)

Steps for a GPU-optimized installation:

1. Install NVIDIA CUDA Toolkit 11.8:

   • Visit NVIDIA CUDA Toolkit Archive.
   • Select version 11.
   • Download and install the software.

2. Install NVIDIA cuDNN 8.7.0 for CUDA 11.x:

   • Visit NVIDIA cuDNN Archive.
   • Click on "Download cuDNN v8.7.0 (November 28th, 2022), for CUDA 11.x".
   • Download and install the software.

3. Install ffmpeg:

   You can download an installer for your OS from the ffmpeg Website.

   Or use a package manager:

   • On Ubuntu or Debian:

     sudo apt update && sudo apt install ffmpeg
     

     • On Arch Linux: bash sudo pacman -S ffmpeg

   • On MacOS using Homebrew (https://brew.sh/):

     brew install ffmpeg
     

     • On Windows using Chocolatey (https://chocolatey.org/): bash choco install ffmpeg

   • On Windows using Scoop (https://scoop.sh/):

     scoop install ffmpeg
     

4. ElevenlabsEngine

   • If you plan to use the ElevenlabsEngine, you need mpv is installed on your system for streaming mpeg audio

   • macOS:

     brew install mpv
     

     • Linux and Windows: Visit mpv.io for installation instructions.
     1. Install PyTorch with CUDA support:

     2. run install_gpu.bat

     3. Configure script

     4. open ui_openai_voice_interface.py and configure your engine, set API keys, Azure service region, language etc