Model: MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION
Author: MERaLiON
Pipeline: automatic-speech-recognition
Library: transformers
Tags: transformers, safetensors, meralion, automatic-speech-recognition, vllm, LLM-as-a-Judge, chat, audio, custom_code, dataset:MERaLiON/MNSC, arxiv:2412.09818, arxiv:2406.16020, base_model:openai/whisper-large-v2, base_model:finetune:openai/whisper-large-v2, license:other, region:us
Base models (finetune): id: openai/whisper-large-v2
Card metadata: base_model: openai/whisper-large-v2
datasets: MERaLiON/MNSC
library_name: transformers
license: other
license_name: meralion-public-license
license_link: https://huggingface.co/MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION/blob/main/MERaLiON-Public-Licence-v1.pdf
metrics: bleu, wer
pipeline_tag: automatic-speech-recognition
tags: vllm, LLM-as-a-Judge, chat, audio, safetensors
widget: example_title: Sentence-level ASR
src: https://huggingface.co/MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION/resolve/main/librispeech_clean.wav
output: text: USER Instruction: Please transcribe this speech.
 MODEL Output: <Speaker1> When they were outside, Ung simply latched the door and started up the path., example_title: Dialogue-level ASR
src: https://huggingface.co/MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION/resolve/main/IMDA_conversation.wav
output: text: USER Instruction: Please turn this speech into written format.
 MODEL Output: <Speaker1> Okay, (um) in that case, (uh) how do I apply? <Speaker2> Alright, you can just (um) apply it online and then (um) we'll need some documents from you. (um) let's say the bank statement with your address and your name, and also the (um) Nsf card that you have to enjoy the promotion. <Speaker1> (mmhmm) (mmhmm) (mmhmm) [ah] I see the green one, right?, example_title: Spoken Dialogue Summarization
src: https://huggingface.co/MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION/resolve/main/IMDA_conversation.wav
output: text: USER Instruction: Please briefly summarize this conversation.
 MODEL Output: Speaker1 and Speaker2 discussed the application process for a promotion. Speaker2 explained that the application can be done online and provided a list of required documents, including a bank statement with the applicant's address and name, and an NSF card. Speaker1 acknowledged the information and confirmed the details of the required documents.
Likes: 28 | All-time downloads: 18522
Created: 2024-11-22 08:59:01