sharkiefff/RBAC-Text2SQL-Benchmark huggingface dataset:
Database: hulushows
Question: Let’s find out which titles are getting strong user scores even though they don’t have any trailers or clips. I want to look across all content and find the highest user rating among those that don’t offer any visual previews but still include a valid score. Just return that one number, rounded to 2 decimals—it tells us how well these visually sparse titles are performing.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: I want to find out how long it's been since each show got any new updates. For each show, check the most recent update date. But if there's no update info, just use the launch date instead. Then, I’d like to see how many days it's been since that date, and treat that as the staleness score. If a show is available in multiple tiers, take the smallest one. Can you show the show ID and the number of days it's been stale? Finally, sort the list so the stalest shows—that is, the ones that haven't been updated in the longest time—come first.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: How many titles are spread across over six nested genre tags and lean more on short clips, including both general clips and film-related clips, than full-length features?
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s all find groups of shows that belong to the same franchise. Can you only include franchises that have at least two shows? For each group, can you show me the franchise ID, how many shows it has, and list the show titles? Also, I need to sort the list so that the biggest franchises with the most shows come first.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: I want to find out how many episodes there are on average in each season for every show. Can you look at shows where we know both the total number of episodes and how many seasons they have. For each one, give me the show ID, how many episodes it has, how many seasons, and the average episodes per season. Please skip anything where the season count is missing or zero. Finally, show the ones with the highest average first.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s figure out what the most frequent top-end maturity rating is across all the shows. Basically, I want to scan all the records, grab the maturity info, and tell me which of those high-end ratings pops up the most. Just return the one that shows up the most often.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Which franchises are producing the most content? Group shows in the same franchise and add up their episodes. Some episode counts may be text or invalid — after trimming whitespace, parse only digit strings (digits 0–9 only) and treat the rest as zero. Show only franchises with more than 100 total episodes, listing the identifier, number of shows, and total episodes from largest to smallest.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s see how our shows are spread out across the different subscription plans. For each plan, I want to know how many titles it has and what chunk of the full catalog that is. Just give me the plan name, the total count of media in it, and what percentage of the catalog that represents. Start with the plans that have the biggest share of content.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s see which franchises are really making waves across different subscription levels. We’re looking for those that have at least 3 shows, and those shows appear across 3 or more tiers. For each of these franchise powerhouses, show me the franchise ID, how many shows they’ve got, and how many tiers they show up in. Sort the list by number of shows to spotlight the most widely spread ones first.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s dive into the main genre types that keep popping up in our show catalog. I’m only interested in shows labeled as Drama, Comedy, or Animation and Cartoons. For each of those, can you pull together a quick list that includes the show’s ID, its title, and what genre it’s tagged under? Sort the list by title.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: yes
Database: hulushows
Question: I want to look at how packed each show’s video library is. Can you pull up a list that shows the total number of video items for each show and group them into three levels? Label them High if they’ve got over 500 videos, Medium if they’re between 200 and 500, and Low if they’re under 200. Let’s sort the list so the shows with the most content show up first, and include the show ID, total count, and the volume level tag.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Which show feels the most crammed with promotional stuff? Just give me the one with the heaviest promo presence overall.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: How many shows land in our usual user-score buckets—Low, Medium, or High? Just give me the total.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s grab the shows where the bigger of their trailer or feature count is over 100. Show the ID, title, and that number, sorted from highest to lowest.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: I want to see how shows rank based on what viewers think. Just group them by how well they’re rated, ignore anything without a proper score, and tell me the show ID, name, how it scored, and which group it ended up in—start from the highest-rated and go down.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Which shows actually have film clips? List the ones with the most film-related clips first. For each show, show the title, how many film clips it has, and a quick flag for Has Clips or No Clips.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s see which shows are loading up on promo messages. For each one, count availability updates, promo messages, alerts, and expiration notices across the free and member tiers. Only include shows with at least one note, and list them starting with the most.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: SELECT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s drop in a new show using these exact values: make the ID 900001, set the official name to new-show-canonical, call it New Show Title, link it to series 99999999, tag it to studio 8, and add the note ‘This is a newly added show for fall season release.’ For genres, store a JSON with score 4.25, type show, main genre Science Fiction, and breakdown Science Fiction~Space|Adventure. Once that’s saved, return what you added.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: INSERT
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: So, which studios are really cranking out the content? Let’s create a function called calculate_studio_activity_index that tells us how many entries a studio has in the system. Just pass in the studio’s ID, and it’ll return the total number of catalog records linked to that studio—even if some titles repeat. Simple enough, right? Oh, and while we’re at it—find the show with ID 54 and update its official name to ‘updated-family-guy’.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: yes
Database: hulushows
Question: Let’s check how much content each subscription gets. Just give me the plan name—like “free” or “subscriber”—and I’ll count all the shows linked to it. Don’t worry about casing or spaces; it should match even if someone types it differently.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: yes
Database: hulushows
Question: Let’s check how many titles belong to a given series. Just pass in a series ID, and we’ll return the total number of titles linked to that series.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: yes
Database: hulushows
Question: Let’s see how our shows break down by age-appropriateness—like “TV-Y”, “TV-PG”, etc. Just group them and count how many land in each level, making sure different casing or extra spaces are treated the same.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: I want to know if all shows in a series share the same name? Just use check_series_title_uniformity with the series ID. it returns true if the titles match across the board, false if they don’t.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: yes
Database: hulushows
Question: Let’s figure out which studios have been the busiest. For each one, can you show me how many titles they’ve worked on? Just include the studios that are actually linked to content, and sort the list so the most active ones show up first. I need this saved as a permanent table called studio_catalog_size.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: no
Reference output: Sorry, I cannot answer.
Database: hulushows
Question: Let’s figure out which studios have been the busiest in the catalog and save it in a table called title_count_per_studio. For each one, can you show me their ID, name, and how many shows they’ve worked on? Only count the ones that are actually linked to a studio. We’ll need to pull the studio info by joining the show records with the studio list. Then, sort the results so the studios with the most titles show up first.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: DROP
Access allowed: yes
Database: hulushows
Question: Set up a permanent table called avg_title_length_per_studio so we can track how long each studio’s show titles usually are. It should include which studio it is and the average number of characters in the titles of its shows. We’re only defining the structure for avg_title_length_per_studio right now—no data yet.
Role: DataOperator_3
DDL allowed: yes
INSERT allowed on tables: core, rollups, show_rollups
DELETE allowed on tables: core, rollups, show_rollups
Table-level permissions:
core: SELECT: annotations, canonical_name, content_key, content_title, genreclass, studiolink
UPDATE: annotations, canonical_name, content_key, content_title, genreclass, studiolink
rollups: SELECT: *
UPDATE: *
show_rollups: SELECT: html5metrics, latestadd, ratinginfo, srkeys, srlinks
UPDATE: html5metrics, latestadd, ratinginfo, srkeys, srlinks
Operation: CREATE
Access allowed: yes