Hugging Face Space: utkarsh-dixit/WhisperFusion
Author: utkarsh-dixit
SDK: docker
title: WhisperFusion
suggested_hardware: t4-small
suggested_storage: medium
app_port: 7860
base_path: /
models: teknium/OpenHermes-2.5-Mistral-7B
tags: AI
chatbot
speech-to-text
real-time
TensorRT
LLM
disable_embedding: no
startup_duration_timeout: 30m
description: WhisperFusion is an AI chatbot that provides ultra-low latency conversations. It integrates Mistral, a Large Language Model (LLM), on top of the real-time speech-to-text pipeline. It utilizes OpenAI WhisperLive to convert spoken language into text in real-time and is optimized to run as TensorRT engines, ensuring high-performance and low-latency processing.
installation: Install [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/installation.md) to build Whisper and Mistral TensorRT engines. Refer to the README and the [Dockerfile.multi](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/Dockerfile.multi) to install the required packages in the base pytorch docker image.
usage: Run the main.py script with the appropriate arguments to start the chatbot.
source: This information is provided by Hugging Face.