Spaces:
Running
Running
Update index.html
Browse files- index.html +54 -4
index.html
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
<!DOCTYPE html>
|
| 2 |
-
<html>
|
| 3 |
<head>
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="description"
|
| 6 |
content="Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI">
|
| 7 |
-
<meta name="keywords" content="Generative AI, Evaluation, Social Impact, NeurIPS, Workshop">
|
| 8 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 9 |
-
<title>Evaluating Evaluations
|
| 10 |
|
| 11 |
<link rel="preconnect" href="https://fonts.googleapis.com">
|
| 12 |
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
|
@@ -153,7 +153,57 @@
|
|
| 153 |
</ul>
|
| 154 |
</td>
|
| 155 |
</tr>
|
| 156 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 157 |
</tbody>
|
| 158 |
</table>
|
| 159 |
</div>
|
|
|
|
| 1 |
<!DOCTYPE html>
|
| 2 |
+
<html lang="en">
|
| 3 |
<head>
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="description"
|
| 6 |
content="Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI">
|
| 7 |
+
<meta name="keywords" content="Generative AI, Evaluation, Social Impact, NeurIPS, Workshop, AI Ethics">
|
| 8 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 9 |
+
<title>Evaluating Evaluations: NeurIPS Workshop 2024</title>
|
| 10 |
|
| 11 |
<link rel="preconnect" href="https://fonts.googleapis.com">
|
| 12 |
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
|
|
|
| 153 |
</ul>
|
| 154 |
</td>
|
| 155 |
</tr>
|
| 156 |
+
<tr>
|
| 157 |
+
<td>11:00 AM - 11:15 AM</td>
|
| 158 |
+
<td>Break</td>
|
| 159 |
+
<td></td>
|
| 160 |
+
</tr>
|
| 161 |
+
<tr>
|
| 162 |
+
<td>11:15 AM - 12:45 PM</td>
|
| 163 |
+
<td>Talks + Provocations</td>
|
| 164 |
+
<td>
|
| 165 |
+
<ul>
|
| 166 |
+
<li>Invited speakers present on current technical evaluations for base models across all modalities</li>
|
| 167 |
+
<li>Key social impact categories covered: Bias and stereotyping, Cultural values, Performance disparities, Privacy, Financial and environmental costs, Data moderator labor</li>
|
| 168 |
+
<li>Presentations of accepted provocations</li>
|
| 169 |
+
</ul>
|
| 170 |
+
</td>
|
| 171 |
+
</tr>
|
| 172 |
+
<tr>
|
| 173 |
+
<td>12:45 PM - 1:45 PM</td>
|
| 174 |
+
<td>Lunch Break</td>
|
| 175 |
+
<td></td>
|
| 176 |
+
</tr>
|
| 177 |
+
<tr>
|
| 178 |
+
<td>1:45 PM - 3:45 PM</td>
|
| 179 |
+
<td>Group Activity</td>
|
| 180 |
+
<td>
|
| 181 |
+
<ul>
|
| 182 |
+
<li>Participants break into groups focusing on key social impact categories</li>
|
| 183 |
+
<li>Activities include: Choosing Evaluations, Reviewing Tools and Datasets, Examining construct reliability, validity, and ranking methodologies</li>
|
| 184 |
+
</ul>
|
| 185 |
+
</td>
|
| 186 |
+
</tr>
|
| 187 |
+
<tr>
|
| 188 |
+
<td>3:45 PM - 4:00 PM</td>
|
| 189 |
+
<td>Break</td>
|
| 190 |
+
<td></td>
|
| 191 |
+
</tr>
|
| 192 |
+
<tr>
|
| 193 |
+
<td>4:00 PM - 5:45 PM</td>
|
| 194 |
+
<td>What's Next? Documentation + Resources</td>
|
| 195 |
+
<td>
|
| 196 |
+
<ul>
|
| 197 |
+
<li>Develop policy guidance highlighting impact categories, subcategories, and modalities requiring further investment</li>
|
| 198 |
+
<li>Discussions on: Documenting Methods, Developing Shareable Resources, Underlying Frameworks, Contextualization Challenges, Defining Robust Evaluations</li>
|
| 199 |
+
</ul>
|
| 200 |
+
</td>
|
| 201 |
+
</tr>
|
| 202 |
+
<tr>
|
| 203 |
+
<td>5:45 PM - 6:00 PM</td>
|
| 204 |
+
<td>Closing Remarks</td>
|
| 205 |
+
<td></td>
|
| 206 |
+
</tr>
|
| 207 |
</tbody>
|
| 208 |
</table>
|
| 209 |
</div>
|