Spaces:
Running
Running
Update index.html
Browse files- index.html +54 -4
index.html
CHANGED
@@ -1,12 +1,12 @@
|
|
1 |
<!DOCTYPE html>
|
2 |
-
<html>
|
3 |
<head>
|
4 |
<meta charset="utf-8">
|
5 |
<meta name="description"
|
6 |
content="Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI">
|
7 |
-
<meta name="keywords" content="Generative AI, Evaluation, Social Impact, NeurIPS, Workshop">
|
8 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
9 |
-
<title>Evaluating Evaluations
|
10 |
|
11 |
<link rel="preconnect" href="https://fonts.googleapis.com">
|
12 |
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
@@ -153,7 +153,57 @@
|
|
153 |
</ul>
|
154 |
</td>
|
155 |
</tr>
|
156 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
157 |
</tbody>
|
158 |
</table>
|
159 |
</div>
|
|
|
1 |
<!DOCTYPE html>
|
2 |
+
<html lang="en">
|
3 |
<head>
|
4 |
<meta charset="utf-8">
|
5 |
<meta name="description"
|
6 |
content="Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI">
|
7 |
+
<meta name="keywords" content="Generative AI, Evaluation, Social Impact, NeurIPS, Workshop, AI Ethics">
|
8 |
<meta name="viewport" content="width=device-width, initial-scale=1">
|
9 |
+
<title>Evaluating Evaluations: NeurIPS Workshop 2024</title>
|
10 |
|
11 |
<link rel="preconnect" href="https://fonts.googleapis.com">
|
12 |
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
|
|
153 |
</ul>
|
154 |
</td>
|
155 |
</tr>
|
156 |
+
<tr>
|
157 |
+
<td>11:00 AM - 11:15 AM</td>
|
158 |
+
<td>Break</td>
|
159 |
+
<td></td>
|
160 |
+
</tr>
|
161 |
+
<tr>
|
162 |
+
<td>11:15 AM - 12:45 PM</td>
|
163 |
+
<td>Talks + Provocations</td>
|
164 |
+
<td>
|
165 |
+
<ul>
|
166 |
+
<li>Invited speakers present on current technical evaluations for base models across all modalities</li>
|
167 |
+
<li>Key social impact categories covered: Bias and stereotyping, Cultural values, Performance disparities, Privacy, Financial and environmental costs, Data moderator labor</li>
|
168 |
+
<li>Presentations of accepted provocations</li>
|
169 |
+
</ul>
|
170 |
+
</td>
|
171 |
+
</tr>
|
172 |
+
<tr>
|
173 |
+
<td>12:45 PM - 1:45 PM</td>
|
174 |
+
<td>Lunch Break</td>
|
175 |
+
<td></td>
|
176 |
+
</tr>
|
177 |
+
<tr>
|
178 |
+
<td>1:45 PM - 3:45 PM</td>
|
179 |
+
<td>Group Activity</td>
|
180 |
+
<td>
|
181 |
+
<ul>
|
182 |
+
<li>Participants break into groups focusing on key social impact categories</li>
|
183 |
+
<li>Activities include: Choosing Evaluations, Reviewing Tools and Datasets, Examining construct reliability, validity, and ranking methodologies</li>
|
184 |
+
</ul>
|
185 |
+
</td>
|
186 |
+
</tr>
|
187 |
+
<tr>
|
188 |
+
<td>3:45 PM - 4:00 PM</td>
|
189 |
+
<td>Break</td>
|
190 |
+
<td></td>
|
191 |
+
</tr>
|
192 |
+
<tr>
|
193 |
+
<td>4:00 PM - 5:45 PM</td>
|
194 |
+
<td>What's Next? Documentation + Resources</td>
|
195 |
+
<td>
|
196 |
+
<ul>
|
197 |
+
<li>Develop policy guidance highlighting impact categories, subcategories, and modalities requiring further investment</li>
|
198 |
+
<li>Discussions on: Documenting Methods, Developing Shareable Resources, Underlying Frameworks, Contextualization Challenges, Defining Robust Evaluations</li>
|
199 |
+
</ul>
|
200 |
+
</td>
|
201 |
+
</tr>
|
202 |
+
<tr>
|
203 |
+
<td>5:45 PM - 6:00 PM</td>
|
204 |
+
<td>Closing Remarks</td>
|
205 |
+
<td></td>
|
206 |
+
</tr>
|
207 |
</tbody>
|
208 |
</table>
|
209 |
</div>
|