# AI Safety Europe Retreat 2023 Retrospective

This is a short impression of the AI Safety Europe Retreat (AISER) 2023 in Berlin.

**Tl;dr:** 67 people working on AI safety technical research, AI governance, and AI safety field building came together for three days to learn, connect, and make progress on AI safety.

![](https://lh4.googleusercontent.com/QKot5NFTe-dxkUuhI3ZTjz9gJ6PKeCtEUGj1icLTV9Y-DhuMTKfLGHZYbApm3QwfoBXfjZMvzAE_rr2tLA8UcnRBHSfEgByJIY315tiCZrSQNPp0BPIyM8KzrIqSFj9EwTD1czQtJHMJkNYiOxoTeB0)

### Format

The retreat was an [unconference](https://en.wikipedia.org/wiki/Unconference): Participants prepared sessions in advance (presentations, discussions, workshops, ...). At the event, we put up an empty schedule, and participants could add in their sessions at their preferred time and location. 

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/ff0dcc36366562fe5d21916f7ade6511d291d6ea289e9cf6.png)

Empty and full Schedule. In each time-slot there were multiple sessions in parallel in different locations. This way, people could choose which one to go to based on their interests.

Participants
------------

### Career Stage

About half the participants are working, and half of them are students. Everyone was either already working on AI safety, or intending to transition to work on AI safety.

![](https://lh4.googleusercontent.com/77z4AIsJmF6z94NuA2Hk8Ga5NBiJK8apSJvxRNk4-MavHFiWMhtfC1mLh6tShxlmzkXPshsBJhKR6nH-IX6vYVWxTnLFIIlgL1TKGe7rxRJof4wu4xw8YcaLM6aUcgha34G76gV3vLCn2S-49qENpXQ)

### Focus areas

Most participants are focusing on technical research, but there were also many people working on field building and AI governance:

![](https://lh5.googleusercontent.com/7MkxU1zLNsOVAzQ3cbAUaN-_BhlcaUHoxC82yGY4ILtnR7-cEY8bQpGkZwOz_PNmiZQOPRmyGi4FEy_c667uw7SAO75cgqzXRHIyt4cCvV2wEJfvsxjjsXTQRXijbYq6I1AEKKB3vjsS52fO1gb0dHI)

### Research Programs

Many participants had previously participated, or currently participate in **AI safety research programs** ([SERI MATS](http://serimats.org/), [AI safety Camp](https://aisafety.camp/), [SPAR](https://berkeleyaisafety.com/spar), [PIBBSS](https://www.pibbss.ai/), [MLSS](https://www.lesswrong.com/posts/CphfDP4ynz3QQ4AKY/introducing-the-ml-safety-scholars-program), [SERI SRF](https://forum.effectivealtruism.org/posts/2aDiu52s7HnWJJn22/launching-the-seri-summer-research-fellowship), [Refine](https://www.lesswrong.com/posts/D7epkkJb3CqDTYgX9/refine-an-incubator-for-conceptual-alignment-research-bets)) 

![](https://lh6.googleusercontent.com/XM9HptqybDxXt8XC0x5eTlRXMn5uEF9uMyGRV0ijj7DYcnNluATT6MsCJgHapSnwACMk5Of3-O1QTcy7Uk2rolmlYmvqaBveaKlHM2xbqWqzGlptWySIHeA-G655HQGAjFAWn7j94LKKYxS3hrIk99g)

### Countries

All but one participant were based in Europe, with most people from Germany, the Netherlands and the UK.

![](https://lh6.googleusercontent.com/g4tLbcvDVaG5BZqzI2XLtP2M70bjoOyi2aab7KVLzZUB7E7x2e4BNrW9I433qC558sentb8bpgrw5s7tudbh8A0e2pr4Kd8mU3LP7TfJN0FObw-uyMzisAYOvdB-8Glxvrw2WPdZheMi1SjfmfksOds)

Who was behind the retreat?
---------------------------

The retreat was organized by **Carolin Basilowski** (now [EAGx Berlin](https://www.effectivealtruism.org/ea-global/events/eagxberlin-2022) team lead) and me, **Magdalena Wache** (independent technical AI safety researcher and [SERI MATS](http://serimats.org/) scholar). We got funding from the [long-term future fund](https://funds.effectivealtruism.org/funds/far-future). 

Takeaways
---------

*   I got a feeling of "European AI safety community".
    *   Unlike in AI safety hubs like the Bay area, continental Europe’s AI safety crowd is scattered across many locations.
    *   Before the retreat I already personally knew many people working on AI safety in Europe, but that didn't feel as community-like as it does now.
    *   Other people noted a similar feeling of community.
*   Prioritizing 1:1s was helpful![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/39a58378cb7abd0f4b4e9845633bad8f63cdc0c97891495a.png)  
     
    *   We reserved a few time slots just for 1:1 conversations, and encouraged people to prioritize 1:1s over content-sessions.
    *   Many people reported in the feedback form that 1:1 conversations were the most valuable part of the retreat for them.
*   There is a demand for **more retreats** like this.
    *   Almost everyone would like to attend this kind of retreat at least yearly:

![](https://lh4.googleusercontent.com/DarfJUsZ97-OWlzSAr86e79a00o8F7BhtqDWlPegrvzG82DiPaJqS0ZVeg-UvjwQ2uCHr8faRw5ODBb22HcR2lZ63Ap1ub61QsqrqVgDJn3b-5fgGeHo01DTBZrM8PMIc2PZwA1nsLhQGxNn715yknM)

*   The retreat was relatively low-budget. It was free of charge, and most participants slept in dorm rooms. Next time, I would make the retreat **ticketed** and pay for a better venue with more single/double rooms
*   I would make a future retreat **larger**.
    *   We closed the applications early because we had limited space, and wanted to limit the [cost](https://forum.effectivealtruism.org/posts/Khon9Bhmad7v4dNKe/the-cost-of-rejection) that comes with rejecting people who are actually a good fit. I think we would have had ~50 more qualified applications if we had left them open for longer.
    *   I would also do **targeted outreach** to AI safety institutions next time, in order to increase the share of **senior people** at the retreat.
*   I think the participant-driven "unconference" format is great for a few reasons:
    *   **Lots of content**: As the work for preparing the content was distributed among many people, there was more content overall, and there could be multiple sessions in parallel.
        *   For me, being able to **choose the topics** that are most interesting to me makes me take away a lot more relevant content than if there was only one track of content.
    *   **Small groups** (usually 10-20 people) made it possible to have very interactive sessions.
    *   There was **no "speaker-participant divide"**.
        *   I think this makes an important psychological difference: If there are "speakers" who get the label of "experienced person", other people are a lot more likely to defer to their opinion, and won't speak up if something seems wrong or confusing.
        *   However, when everyone can contribute to the content, and everyone feels more “on the same level”, it becomes a lot easier to disagree and to ask questions.

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/96d884f17e16b25bd4f0ede61187b2b9899cf39601554975.png)  
 

I’m very excited about more retreats such as this one happening! If you are interested in organizing one, I am happy to support you - **please reach out to me!** 

*If you would like to be notified of further retreats, fill in this 1-minute* [*form*](https://docs.google.com/forms/d/e/1FAIpQLScku77RE97IpnMon17tGQEPRcAIfclXzbGNuAQoYf6LO3U-hQ/viewform)*.*