# AI Safety & Entrepreneurship v1.0

+++ Why did I create both a post and a wiki article?

Posts are best for making sure people see the initial version of the post, whilst Wiki articles are best for long-term maintenance. Posting an article that links to a Wiki page provides the best of both worlds.




+++

### **For the most up-to-date version, see the** [**Wiki page**](https://www.lesswrong.com/w/ai-safety-and-entrepreneurship)**.**

### **Articles**:

[There should be more AI safety organisations](https://www.lesswrong.com/posts/MhudbfBNQcMxBBvj8/there-should-be-more-ai-safety-orgs)

[Why does the AI Safety Community need help founding projects?](https://www.lesswrong.com/posts/tPjAgWpsQrveFECWP/ryan-kidd-s-shortform?commentId=JDcp5AhWwk9ZCv59r)

[AI Assurance Tech Report](https://www.aiat.report/)

[AI Safety as a YC Startup](https://www.lesswrong.com/posts/QxJFjqT6oFY3jo47s/ai-safety-as-a-yc-startup-1)

[Alignment can be the ‘clean energy’ of AI](https://www.lesswrong.com/posts/irxuoCTKdufEdskSk/alignment-can-be-the-clean-energy-of-ai)

[AI Tools for Existential Security](https://forum.effectivealtruism.org/posts/6m6Q7jgB8iwXGYhXw/ai-tools-for-existential-security)

### **Incubation Programs:**

[Def/acc at Entrepreneur First](https://www.joinef.com/posts/introducing-def-acc-at-ef/) \- this is a new program, which focuses on "defensive" tech, which will produce a wide variety of startups, some of which may help with reducing x-risk, but others may include AI applications like autonomous weapons or diagnostic medical software, which, while they generally won't increase x-risk, may not reduce it either.

[Catalyze - AI Safety Incubation](https://www.catalyze-impact.org/apply)

[Seldon Accelerator](https://seldonaccelerator.com/): “We take on AGI risk with optimism”

[AE Studio](https://docs.google.com/forms/d/e/1FAIpQLSeU1_dZapdxH5SIooC3VK7nbnKSCZxxGG1JuqeNDpTOa22xbA/viewform) has expressed interest in helping seed neglected approaches, incl. ideas that take the form of business ideas

### **AIS Friendly General Program:**

[Founding to Give](https://forum.effectivealtruism.org/posts/q2PwXNsXsfDYkxeHb/aim-ce-new-program-founding-to-give-apply-now-to-launch-a): General EA incubator

[Entrepreneur First](https://www.joinef.com/) \- They run def/acc, so this could be a decent alternative

[Halycon Futures](https://halcyonfutures.org/): “We’re an entrepreneurial nonprofit and VC fund dedicated to making AI safe, secure and good for humanity.” They do new project incubation, grants, investments, ect.

### **Communities**:

[Entrepreneurship Channel EA Anyway](https://eavirtualmeetupgroup.slack.com/archives/C04T8LBDZUN)

AI Safety Founders: [Website](https://aisfounders.com/), [Discord](https://discord.gg/2dvYYxqXvS), [LinkedIn](https://www.linkedin.com/company/ai-safety-founders/)

### **VC:**

[AI Safety Seed Funding Network](https://forum.effectivealtruism.org/posts/oTuesHYxdXZm76d5k/ai-safety-seed-funding-network-join-as-a-donor-or-investor)

[Lionheart Ventures](https://www.lionheart.vc/) \- “We invest in the wise development of transformative technologies.”

[Juniper Ventures](https://juniperventures.xyz/) \- Invests in companies “working to make AI safe, secure and beneficial for humanity”. Published the AI Assurance Tech Report

[Polaris Ventures](https://polaris-ventures.org/) \- “We support projects and people aiming to build a future guided by wisdom and compassion for all”

[Mythos Ventures](https://www.mythos.vc/) \- “an early-stage venture capital firm investing in prosocial technologies for the transformative AI era.”

[Metaplanet](https://metaplanet.com/) \- “We support novel and evidence-based innovation that could produce an outsized return for the benefit of humankind.”

[Anthology Fund](https://menlovc.com/anthology-fund/) \- Backed by Anthropic. One of the five key areas is “trust and safety tooling”

[Menlo Ventures](https://menlovc.com/) \- Lead the GoodFire round ([article](https://menlovc.com/perspective/leading-goodfires-50m-series-a-to-interpret-how-ai-models-think/))

[Safe AI Fund](https://www.saif.vc/)

### **Organisational Support:**

[Ashgro](https://www.ashgro.org/) \- fiscal sponsorship

[Rethink Priorities Special Projects](https://rethinkpriorities.org/our-services/special-projects/) \- provides fiscal sponsorship or incubation

### **Other:**

[Hackathon for AI Safety Startups](https://www.apartresearch.com/event/ais-startup-hackathon) \- Ran once by Apart Research, may run again

[Constellation Residency](https://www.constellation.org/programs/residency) \- Year-long position

[Nonlinear](https://www.nonlinear.org/) \- Free coaching for people who are running an AI safety startup or who are considering starting one

### **Dustbin - Things that previously existed**

[Longtermist Entrepreneurship Project](https://forum.effectivealtruism.org/topics/longtermist-entrepreneurship-fellowship) - [Retrospective](https://forum.effectivealtruism.org/topics/longtermist-entrepreneurship-fellowship)