# AI Safety Camp, Virtual Edition 2023

AI Safety Camp connects you with an experienced research lead to collaborate on a research project – helping you try your fit for a potential career in AI Safety research.

*The applications for AI Safety Camp’s Virtual Edition in 2023 are* [*now open*](https://airtable.com/shrNF1n4m1yqzCjbW)*!*

AI Safety Camp Virtual 8 will be a 3.5-month long online research program from 4 March to 18 June 2023, where participants form teams to work on pre-selected projects.

We value people with diverse backgrounds and skillsets, such as cybersecurity or cognitive science. Not all projects require participants to have prior experience in AI Safety, mathematics or machine learning. You will be able to read in detail about the research topics & each project’s skill requirements for our upcoming edition by following the Project Proposal links below.

Projects
========

Projects you can apply to…

Conceptualise AGI dynamics
--------------------------

[**Uncertainty -> Soft Optimization**](https://docs.google.com/document/d/1ayZ6goQhbvNZCSRXE7GFTSJm3Ptlenv7KjLr62Q3EzY/edit?usp=sharing) with Jeremy Gillen

[**Inquire into Uncontrollable Dynamics of AGI**](https://docs.google.com/document/d/1Zvt-tUksgtsuFs0LG8k6AHtDBmzHTOk-CfSz6nUYJrM/edit?usp=sharing) with Remmelt Ellen

[**Discussing and Crystallising a Research Agenda Based on Positive Attractors and Inherently Interpretable Architectures**](https://docs.google.com/document/d/1Fh2nCtNICVX60iFEwHHU6pZHZUoiKLX7InL_5e5dO9I/edit?usp=sharing) with Robert Kralisch  
 

Investigate transformer models
------------------------------

[**Cyborgism**](https://docs.google.com/document/d/16YZljz2w44Fzqs0ZXgVKhkef8tTPkypjp7PK4S32SSs/edit?usp=sharing) with Nicholas Kees Dupuis

[**Understanding Search in Transformers**](https://hackmd.io/@YoMjTL9WTqOXv85V9skJxw/HJzTofMFj/edit) with Michael Ivanitskiy

[**Interdisciplinary Investigation of DebateGPT**](https://docs.google.com/document/d/1iDraPS4qst_-jcpxEpBN6xT0y80EWnTu02R7uAvQOno/edit) with Paul Bricman  
 

Finetune language transformers
------------------------------

[**Does Introspective Truthfulness Generalize in LMs?**](https://docs.google.com/document/d/1qugeQWJwfwbu59ykxWwK95oMPi9aTZeQspMJQQvo-fo/edit?usp=sharing) with Jacob Pfau

[**Inducing Human-Like Biases in Moral Reasoning LMs**](https://docs.google.com/document/d/17GPZR289OVYVtBN6LfFdguz-tGO3fQh0x_48nMcevig/edit?usp=sharing) with Bogdan-Ionut Cirstea  
 

Create annotation tools
-----------------------

[**Behavioral Annotation Framework for the Contextualized and Personalized Fine-Tuning of Foundation Models**](https://docs.google.com/document/d/1HP0tli2g6cQUme0mVQ4gfVQnFmt_IcN8YdpHWKRSC-g/edit?usp=sharing) with Eleanor “Nell” Watson  
 

Review and analyse literature
-----------------------------

[**How Should Machines Learn from Default Options?**](https://docs.google.com/document/d/1xJm6yul6V-FSZOTEGxguJa99JEKKYMBPNnPrbCjB6RU/edit?usp=sharing) with En Qi Teo

[**Literature Review of the Neurological Basis of Human Values and Preferences**](https://docs.google.com/document/d/1YrqlM8i2SRj3MoojD4dKDv1f_-1Ezo0AyV3yDqEL-Pk/edit?usp=sharing) with Linda Linsefors

[**Machine learning for Scientific Discovery: the Present and Future of Science-Producing AI Models**](https://docs.google.com/document/d/1J6aadVK6b2nQGaVNPu0bV13ki0ijEy576CFGF0qV3oo/edit?usp=sharing) with Eleni Angelou  
 

Propose public policy/communication
-----------------------------------

[**Policy Proposals for High-Risk AI Regulation**](https://docs.google.com/document/d/1FQGMjPBLWVIiuzFVBpVScqpi6nzeY0CWNK_Edd2F59M/edit?usp=sharing) with Koen Holtman

[**Developing Specific Failure Stories about Uncontrollable AI**](https://docs.google.com/document/d/1U--XV5Cuu5lug1kIJLJGYYEaqvYrsUZV7d1Q7cDR_ss/edit?usp=sharing) with Karl von Wendt  
 

[**    Apply to AISC Virtual 2023        **](https://airtable.com/shrNF1n4m1yqzCjbW)
====================================================================================

### Apply if you…

1.  want to try out & consider ways you could help ensure that future AI performs safely and in line with what people value upon reflection;
2.  are ready to dig into our research leads’ research topics and are able to write down a few clear arguments for why you’d research one in particular & how you might start;
3.  previously studied a topic or practiced skills unique to your perspective/background that can bolster your new research team’s progress; 
4.  can block off hours to focus on research from **March to June 2023** on normal workdays and the weekends (at least 10 hours per week).  
     

### Application timeline

| 5 Jan 2023 | 00:01 UTC | Project proposals are posted on our website. Application form [opens](https://airtable.com/shrNF1n4m1yqzCjbW). Reviews start right away . |
| --- | --- | --- |
| 19 Jan | 23:59 AoE | Deadline to apply to teams closes. Late submissions might not get a response. |
| 1 March | 23:59 AoE | Last applicant admitted or declined (most will be informed of our decision earlier). |

  
![](https://i2.wp.com/aisafety.camp/wp-content/uploads/2020/11/AI-Safety-Camp-3-Participant-Teams-Organisers-spontaneous-virtual-collage.png?resize=900%2C520&ssl=1)*First virtual edition – a spontaneous collage*  
 

Timeline
========

*   January 5:  Accepted proposals are posted on the AISC website. Application to join teams [open](https://airtable.com/shrNF1n4m1yqzCjbW).
*   January 19:  Application to join teams closes. 
*   Until February end:  Organisers pre-filter applications. RLs interview potential members and pick their team.
*   March 4-5:  Opening weekend.  
    From here, teams meet weekly, and plan in their own work hours. 
*   June 17-18: Closing weekend.  
    All teams present their results.

​

Team structure
==============

Every team will have:

*   one Research Lead
*   one Team Coordinator
*   other team members

All team members are expected to work at least 10 hours per week on the project, which includes joining weekly team meetings, and communicating regularly (between meetings) with other team members about their work.

As of yet, we cannot commit to offering stipends compensation for team members, because a confirmed grant fell through. Another grantmaker is in the midst of evaluating a replacement grant for AI Safety Camp. If confirmed, team members can opt in to receive a minimum of $500 gross per month (up to $2000 for full-time work).

Research Lead (RL)
------------------

The RL is the person behind the research proposal. If a group forms around their topics, the RL will guide the research project, and keep track of relevant milestones. When things inevitably don’t go as planned (this is research after all) the RL is in charge of setting the new course.

The RL is part of the research team and will be contributing to research the same as everyone else on the team.

Team Coordinator (TC)
---------------------

The TC is the ops person of the team. They are in charge of making sure meetings are scheduled, checks in with individuals on their task progress, etc. TC and RL can be the same person.

The role of the TC is important but not expected to take too much time (except for project management-heavy teams). Most of the time, the TC will act like a regular team member contributing to the research, same as everyone else on the team.

Other team members
------------------

Other team members will work on the project under the leadership of the RL and the TC. Team members will be selected based on relevant skills, understandings and commitments to contribute to the research project.

Questions?
==========

You can contact us at [contact@aisafety.camp](mailto:contact@aisafety.camp)