{"_id":"69b333f655042d860651db6e","id":"arcada-labs/assistant-bench","author":"arcada-labs","sha":"7d8464ca6a73b490f23be0a51feb3cb3656cc107","lastModified":"2026-03-24T05:11:19.000Z","private":false,"gated":false,"disabled":false,"tags":["task_categories:automatic-speech-recognition","task_categories:text-generation","language:en","license:mit","size_categories:n<1K","format:json","modality:audio","modality:text","library:datasets","library:pandas","library:polars","library:mlcroissant","region:us","audio","benchmark","speech-to-speech","voice-ai","multi-turn","tool-use","evaluation","state-tracking","function-calling"],"description":"\n\t\n\t\t\n\t\n\t\n\t\tAssistant Bench\n\t\n\n31-turn multi-turn speech-to-speech benchmark for evaluating voice AI models as a personal assistant handling flights, email, calendar, and reminders.\nPart of Audio Arena, a suite of 6 benchmarks spanning 221 turns across different domains. Built by Arcada Labs.\nLeaderboard | GitHub | All Benchmarks\n\n\t\n\t\t\n\t\n\t\n\t\tDataset Description\n\t\n\nThe model acts as a personal assistant managing flight bookings, email composition, calendar events, and reminders. Turns include… See the full description on the dataset page: https://huggingface.co/datasets/arcada-labs/assistant-bench.","downloads":127,"likes":2,"cardData":{"language":["en"],"license":"mit","pretty_name":"Assistant Bench","tags":["audio","benchmark","speech-to-speech","voice-ai","multi-turn","tool-use","evaluation","state-tracking","function-calling"],"task_categories":["automatic-speech-recognition","text-generation"],"size_categories":["n<1K"],"configs":[{"config_name":"default","data_files":[{"split":"train","path":"metadata.jsonl"}]}]},"siblings":[{"rfilename":".gitattributes"},{"rfilename":"README.md"},{"rfilename":"audio/turn_000.wav"},{"rfilename":"audio/turn_001.wav"},{"rfilename":"audio/turn_002.wav"},{"rfilename":"audio/turn_003.wav"},{"rfilename":"audio/turn_004.wav"},{"rfilename":"audio/turn_005.wav"},{"rfilename":"audio/turn_006.wav"},{"rfilename":"audio/turn_007.wav"},{"rfilename":"audio/turn_008.wav"},{"rfilename":"audio/turn_009.wav"},{"rfilename":"audio/turn_010.wav"},{"rfilename":"audio/turn_011.wav"},{"rfilename":"audio/turn_012.wav"},{"rfilename":"audio/turn_013.wav"},{"rfilename":"audio/turn_014.wav"},{"rfilename":"audio/turn_015.wav"},{"rfilename":"audio/turn_016.wav"},{"rfilename":"audio/turn_017.wav"},{"rfilename":"audio/turn_018.wav"},{"rfilename":"audio/turn_019.wav"},{"rfilename":"audio/turn_020.wav"},{"rfilename":"audio/turn_021.wav"},{"rfilename":"audio/turn_022.wav"},{"rfilename":"audio/turn_023.wav"},{"rfilename":"audio/turn_024.wav"},{"rfilename":"audio/turn_025.wav"},{"rfilename":"audio/turn_026.wav"},{"rfilename":"audio/turn_027.wav"},{"rfilename":"audio/turn_028.wav"},{"rfilename":"audio/turn_029.wav"},{"rfilename":"audio/turn_030.wav"},{"rfilename":"benchmark/hard_turns.json"},{"rfilename":"benchmark/knowledge_base.txt"},{"rfilename":"benchmark/tool_schemas.json"},{"rfilename":"benchmark/turns.json"},{"rfilename":"metadata.jsonl"},{"rfilename":"real_audio/person1/recording_metadata.json"},{"rfilename":"real_audio/person1/turn_000.wav"},{"rfilename":"real_audio/person1/turn_001.wav"},{"rfilename":"real_audio/person1/turn_002.wav"},{"rfilename":"real_audio/person1/turn_003.wav"},{"rfilename":"real_audio/person1/turn_004.wav"},{"rfilename":"real_audio/person1/turn_005.wav"},{"rfilename":"real_audio/person1/turn_006.wav"},{"rfilename":"real_audio/person1/turn_007.wav"},{"rfilename":"real_audio/person1/turn_008.wav"},{"rfilename":"real_audio/person1/turn_009.wav"},{"rfilename":"real_audio/person1/turn_010.wav"},{"rfilename":"real_audio/person1/turn_011.wav"},{"rfilename":"real_audio/person1/turn_012.wav"},{"rfilename":"real_audio/person1/turn_013.wav"},{"rfilename":"real_audio/person1/turn_014.wav"},{"rfilename":"real_audio/person1/turn_015.wav"},{"rfilename":"real_audio/person1/turn_016.wav"},{"rfilename":"real_audio/person1/turn_017.wav"},{"rfilename":"real_audio/person1/turn_018.wav"},{"rfilename":"real_audio/person1/turn_019.wav"},{"rfilename":"real_audio/person1/turn_020.wav"},{"rfilename":"real_audio/person1/turn_021.wav"},{"rfilename":"real_audio/person1/turn_022.wav"},{"rfilename":"real_audio/person1/turn_023.wav"},{"rfilename":"real_audio/person1/turn_024.wav"},{"rfilename":"real_audio/person1/turn_025.wav"},{"rfilename":"real_audio/person1/turn_026.wav"},{"rfilename":"real_audio/person1/turn_027.wav"},{"rfilename":"real_audio/person1/turn_028.wav"},{"rfilename":"real_audio/person1/turn_029.wav"},{"rfilename":"real_audio/person1/turn_030.wav"},{"rfilename":"real_audio/person2/recording_metadata.json"},{"rfilename":"real_audio/person2/turn_000.wav"},{"rfilename":"real_audio/person2/turn_001.wav"},{"rfilename":"real_audio/person2/turn_002.wav"},{"rfilename":"real_audio/person2/turn_003.wav"},{"rfilename":"real_audio/person2/turn_004.wav"},{"rfilename":"real_audio/person2/turn_005.wav"},{"rfilename":"real_audio/person2/turn_006.wav"},{"rfilename":"real_audio/person2/turn_007.wav"},{"rfilename":"real_audio/person2/turn_008.wav"},{"rfilename":"real_audio/person2/turn_009.wav"},{"rfilename":"real_audio/person2/turn_010.wav"},{"rfilename":"real_audio/person2/turn_011.wav"},{"rfilename":"real_audio/person2/turn_012.wav"},{"rfilename":"real_audio/person2/turn_013.wav"},{"rfilename":"real_audio/person2/turn_014.wav"},{"rfilename":"real_audio/person2/turn_015.wav"},{"rfilename":"real_audio/person2/turn_016.wav"},{"rfilename":"real_audio/person2/turn_017.wav"},{"rfilename":"real_audio/person2/turn_018.wav"},{"rfilename":"real_audio/person2/turn_019.wav"},{"rfilename":"real_audio/person2/turn_020.wav"},{"rfilename":"real_audio/person2/turn_021.wav"},{"rfilename":"real_audio/person2/turn_022.wav"},{"rfilename":"real_audio/person2/turn_023.wav"},{"rfilename":"real_audio/person2/turn_024.wav"},{"rfilename":"real_audio/person2/turn_025.wav"},{"rfilename":"real_audio/person2/turn_026.wav"},{"rfilename":"real_audio/person2/turn_027.wav"},{"rfilename":"real_audio/person2/turn_028.wav"},{"rfilename":"real_audio/person2/turn_029.wav"},{"rfilename":"real_audio/person2/turn_030.wav"}],"createdAt":"2026-03-12T21:45:26.000Z","usedStorage":26138857}