# AI Safety Camp 2024

**AI Safety Camp** connects you with a research lead to collaborate on a project – to see where your work could help ensure future AI is safe.

[Apply](https://airtable.com/appi7jDH1gAfAZDyC/shrwKt5p0TKG86j9G) before December 1, to collaborate online from January to April 2024.

We value diverse backgrounds. Many roles but definitely not all require some knowledge in one of:  AI safety, mathematics or machine learning.

**Some skills requested by various projects:**

*   Art, design, photography
*   Humanistic academics
*   Communication
*   Marketing/PR
*   Legal expertise
*   Project management
*   Interpretability methods
*   Using LLMs
*   Coding
*   Math
*   Economics
*   Cybersecurity
*   Reading scientific papers
*   Know scientific methodologies
*   Think and work independently
*   Familiarity of AI risk research landscape

Projects
--------

**To not build uncontrollable AI**  
Projects to restrict corporations from recklessly scaling the training and uses of ML models. Given controllability limits.  
 

*   1\. [Towards realistic ODDs for foundation model based AI offerings](https://docs.google.com/document/d/1ROdSPA5TaJDe18pK59YUyEnv0qqUqkEbrUezLamcn54/edit?usp=sharing)  
    2\. [Luddite Pro: information for the refined luddite](https://docs.google.com/document/d/1KeO_zaTDMSGKKYHW_TiAQdvrvvJkKy5tCINV8zE7oM8/edit)  
    3\. [Lawyers (and coders) for restricting AI data laundering](https://docs.google.com/document/d/1fblXOOz4KLn8EA1omhrwdIUJYB9NJJ7LxUdRPGDWvXo/edit)  
    4\. [Assessing the potential of congressional messaging campaigns for AIS](https://docs.google.com/document/d/1vZMMr7gSNNmlVI1C3ouagcbOKTcRmVfQ0L05DbCZf6Q/edit?usp=sharing)

**Everything else**  
Diverse other projects, including technical control of AGI in line with human values.  
 

*   Mech-Interp  
    5\. [Modelling trajectories of language models](https://docs.google.com/document/d/1pAEnfUza987OMmt8fnXuOpGO9MykoVgDLcT3V48IkaY/edit?usp=sharing)  
    6\. [Towards ambitious mechanistic interpretability](https://docs.google.com/document/d/1jce3f64Fz7PXmdCEyd9i0PTmcFaiP1pZdcBn5ye5sxY/edit?usp=sharing)  
    7\. [Exploring toy models of agents](https://docs.google.com/document/d/19Lu2NDVJN-7ZdA-cQuLcqTuWJSr7SA88ZLAM8H7Qgzs/edit)  
    8\. [High-level mechanistic interpretability and activation engineering library](https://docs.google.com/document/d/1DbRHPBlFUFojiEEGJnI0ghNOWnE5bOZBNXC1fC51T9I/edit#heading=h.jepgk0u8wx8p)  
    9\. [Out-of-context learning interpretability](https://docs.google.com/document/d/1qs0v6emq3Sn1UbDbstmsz7rzT38qklvIl4q3gw9lvaU/edit#heading=h.9lmc73wscx1r)  
    10\. [Understanding search and goal representations in transformers](https://unsearch-ai.notion.site/AISC-2024-Research-Proposal-5adbd5918fe443c491a0a5b4252113fc)
*   Evaluating and Steering Models  
    11\. [Benchmarks for stable reflectivity](https://docs.google.com/document/d/1N0Kcvu3aNTUWTXMi3rE9PrrRVcF4soR6ucgq4ej0g8I/edit#heading=h.9lmc73wscx1r)  
    12\. [SADDER: situational awareness datasets for detecting extreme risks](https://docs.google.com/document/d/1WARwqgH9UAIri2I9215OoLZPTJdq4evLPN2wgs0hP3Y/edit#heading=h.9lmc73wscx1r)  
    13\. [TinyEvals: how language models speak coherent English?](https://docs.google.com/document/d/1myBsd-LqTaEWOqZwqOX3UBphOGiEdlANDtOA1a-lFFg/edit#heading=h.9lmc73wscx1r)  
    14\. [Evaluating alignment evaluations](https://docs.google.com/document/d/1hLdNZhzQgGSRDIdulHi2lZjM159iyYcZ5PFJNAPma1s/edit#heading=h.9lmc73wscx1r)  
    15\. [Pipelines for evaluating and steering LLMs towards faithful reasoning](https://docs.google.com/document/d/1P-SrvH9V8IGa_rP_c7uNkobIcQ5LXWrLouJER2NnAE4/edit#heading=h.9lmc73wscx1r)  
    16\. [Steering of LLMs through addition of activation vectors with latent ethical valence](https://docs.google.com/document/d/1VYWKz_Oly6vtJKaA4iXWzKLDpNhI7pJ_h-3FXw08JHQ/edit#)
*   Agent Foundations  
    17\. [High actuation spaces](https://docs.google.com/document/d/1d-ARdZZDHFPIfGcTTOKK8IZWlQj0NZQrmteJj2mvmYA/edit#heading=h.zat5vvnwtl0j)  
    18\. [Does sufficient optimization imply agent structure?](https://docs.google.com/document/d/1VGmOim2pGm8NZMFQSaBpEXXI9AcmRcai1viq33_njQs/edit#heading=h.9lmc73wscx1r)  
    19\. [Discovering agents in raw bytestreams](https://docs.google.com/document/d/1Xqmh9By3yZGVWLgvHWxl4saw2u4S71GouOU_ms9UoqY/edit)  
    20\. [The science algorithm](https://docs.google.com/document/d/1GoXaYtUyanRrkBcjAknafqdKDCyTzzgxpckYMBtgPkQ/edit#heading=h.9lmc73wscx1r)
*   Miscellaneous Alignment Methods  
    21\. [SatisfIA – AI that satisfies without overdoing it](https://docs.google.com/document/d/1JhmK31IwYGcwqX0nKmxKsbmTh_DX3o1OoW7NJmhVbIw/edit#heading=h.l9ot7n22b6ry)  
    22\. [How promising is automating alignment research? (literature review)](https://docs.google.com/document/d/1cXU-DoE2O2vLhVBRWYFBcXyyOuvwVQx97wwtMroJzZU/edit#heading=h.9lmc73wscx1r)  
    23\. [Personalized fine-tuning token for AI value alignment](https://docs.google.com/document/d/1NMRmB9NL_Sv_u8H4Fmn6mwCRHW4Pbbje-OvHQrrm0Co/edit#heading=h.1443xgz5n5cm)  
    24\. [Self-other overlap @AE Studio](https://docs.google.com/document/d/1fMropF42vJLyKsm99XLk1UK8iCnlrjs6NhryUUCr9IM/edit)  
    25\. [Asymmetric control in LLMs: model editing and steering that resists control for unalignment](https://docs.google.com/document/d/1wuHalfHjAmFA-RKYcq3MBptFYLPvoMdy9KTPelyZ67A/edit#heading=h.9lmc73wscx1r)  
    26\. [Tackling key challenges in Debate](https://docs.google.com/document/d/1BLpAMmrhkl3EQY18AFX5rBIwNRBX4HMOggEz-oZPlpE/edit)
*   Other  
    27\. [AI-driven economic safety nets: restricting the macroeconomic disruptions of AGI deployment](https://docs.google.com/document/d/13Jv8HV3D40Ig-lgj2eO7AHU4hPU3eNWuQR2FmoRF5W4/edit#heading=h.9lmc73wscx1r)  
    28\. [Policy-based access to powerful models](https://docs.google.com/document/d/1VvoE1u0Mmifol5TdlQfsMXviIF0bug5CpQ5hsLEg9Fs/edit#heading=h.9lmc73wscx1r)  
    29\. [Organise the next Virtual AI Safety Unconference](https://docs.google.com/document/d/133ZqQDGtm3ZY4JqSYUfGvTPtxDLDCl8VDb6iUeOS1Do/edit#heading=h.9lmc73wscx1r)

Please write your application with the research lead of your favorite project in mind. Research leads will directly review applications this round. We organizers will only assist when a project receives an overwhelming number of applications.

[**        Apply now      **](https://airtable.com/appi7jDH1gAfAZDyC/shrwKt5p0TKG86j9G)

Apply if you…
-------------

1.  want to consider and try out roles for helping ensure future AI function safely;
2.  are able to explain why and how you would contribute to one or more projects;
3.  previously studied a topic or trained in skills that can bolster your new team’s progress; 
4.  can join weekly team calls and block out 5 hours of work each week from **January to April 2024**.

Timeline
--------

**Applications**

By 1 Dec:  Apply.  Fill in the [questions doc](https://docs.google.com/document/d/12eA66mMxPSOn7FlZ4WG_gk7ajf14atnr_ZMYcxsRkFc/copy) and submit it through the [form](https://airtable.com/appi7jDH1gAfAZDyC/shrwKt5p0TKG86j9G).

Dec 1-22:  Interviews.  You may receive an email for an interview, from one or more of the research leads whose project you applied for.

By 28 Dec:  Final decisions.  You will definitely know if you are admitted. Hopefully we can tell you sooner, but we pinky-swear we will by 28 Dec.  
 

**Program **

Jan 13-14:  Opening weekend.  First meeting with your teammates and one-on-one chats.

Jan 15 – Apr 28:  Research is happening. Teams meet weekly, and plan in their own work hours. 

April 25-28:  Final presentations spread over four days.

**Afterwards**

For as long as you want:  Some teams keep working together after the official end of AISC.

When you start the project, we recommend that you don’t make any commitment beyond the official length of the program. However if you find that you work well together as a team, we encourage you to keep going even after AISC is officially over.

  
![](https://aisafety.camp/wp-content/uploads/2020/11/AI-Safety-Camp-3-Participant-Teams-Organisers-spontaneous-virtual-collage.png)*First virtual edition – a spontaneous collage*  
 

Team structure
--------------

Every team will have:

*   one Research Lead (RL)
*   one Team Coordinator (TC)
*   other team members

All team members are expected to work at least 5 hours per week on the project (this number can be higher for specific projects), which includes joining weekly team meetings, and communicating regularly with other team members about their work.

**Research Lead (RL)**

The RL is the person behind the research proposal. They will guide the research project, and keep track of relevant milestones. When things inevitably don’t go as planned (this is research after all) the RL is in charge of setting the new course.

The RL is part of the research team and will be contributing to research the same as everyone else on the team.

**Team Coordinator (TC)**

The TC is the ops person of the team. If you are the TC then you are in charge of making sure meetings are scheduled, checks in with individuals on their task progress, etc. 

The role of the TC is important but not expected to take too much time (except for project management-heavy teams). Most of the time, the TC will act like a regular team member contributing to the research, same as everyone else on the team.

Each project proposal states whether the looking for someone like you to take on this role.

**Other team members**

Other team members will work on the project under the guidance of the RL and the TC. Team members will be selected based on relevant skills, understandings and commitments to contribute to the research project.

[**        Apply now      **](https://airtable.com/appi7jDH1gAfAZDyC/shrwKt5p0TKG86j9G)

  
Questions?
-------------

Check out our [frequently asked questions](https://aisafety.camp/faq), in case you can find the answer there.

*   For questions on a project, please contact the research lead. Find their contact info at the bottom of their [project doc](https://aisafety.camp/#Projects).  
     
*   For questions about the camp in general, or if you can’t reach the specific research lead, please email [contact@aisafety.camp](mailto:contact@aisafety.camp).  
    May take 5 days for organizers to reply.

We are fundraising!
-------------------

Organizers are volunteering this round, since we had to freeze our salaries. This is not sustainable. To make next editions happen, consider [making a donation](https://donorbox.org/ai-safety-camp). For larger amounts, feel free to email [Remmelt](mailto:remmelt@aisafety.camp).

[**        Donate      **](https://donorbox.org/ai-safety-camp)