Space: utkarsh-dixit/WhisperFusion
title: WhisperFusion
sdk: docker
suggested_storage: medium
base_path: /
models: teknium/OpenHermes-2.5-Mistral-7B
tags: AI, chatbot, speech-to-text, real-time, TensorRT, LLM
hf_oauth: no
disable_embedding: no
description: WhisperFusion is an AI chatbot that provides ultra-low latency conversations. It integrates Mistral, a Large Language Model (LLM), on top of the real-time speech-to-text pipeline. It utilizes OpenAI WhisperLive to convert spoken language into text in real-time and is optimized to run as TensorRT engines, ensuring high-performance and low-latency processing.
installation: Install [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/installation.md) to build Whisper and Mistral TensorRT engines. Refer to the README and the [Dockerfile.multi](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/Dockerfile.multi) to install the required packages in the base pytorch docker image.
usage: Run the main.py script with the appropriate arguments to start the chatbot.
source: This information is provided by Hugging Face.
Tags: docker, AI, chatbot, speech-to-text, real-time, TensorRT, LLM, region:us