Omkar2118/datasets huggingface dataset:
Business Matching

This is a proprietary dataset from a large internet services company of ranked pairs of relevant and irrelevant businesses for different queries, for a total
of 17,069 pairs. How well a query matches a candidate is represented by 41 features.

Introducing paper: Pairwise Fairness for Ranking and Regression
Wiki Talk Page Comments

This public dataset contains 127,820 comments from Wikipedia Talk Pages labeled with whether or not they are toxic
W3C Experts

This is a subset of the TREC 2005 enterprise track data, and consists of 48 topics and 200 candidates per topic, with each candidate labeled as an expert or non-expert for the topic. The task is to rank the candidates based on their expertise on a topic, using a corpus of mailing lists from the World Wide Web Consortium (W3C). This is an application where the  unconstrained algorithm does better for the minority protected group.

Introducing paper: Reducing Disparate Exposure in Ranking: A Learning To Rank Approach
SMAC
Full name: The StarCraft Multi-Agent Challenge

The StarCraft Multi-Agent Challenge (SMAC) is a benchmark that provides elements of partial observability, challenging dynamics, and high-dimensional observation spaces. SMAC is built using the StarCraft II game engine, creating a testbed for research in cooperative MARL where each game unit is an independent RL agent.

Introducing paper: The StarCraft Multi-Agent Challenge