# AI Safety Newsletter #39: Implications of a Trump Administration for AI Policy
Plus, Safety Engineering

Welcome to the AI Safety Newsletter by the [Center for AI Safety](https://www.safe.ai/). We discuss developments in AI and AI safety. No technical background required.

Listen to the AI Safety Newsletter for free on [Spotify](https://spotify.link/E6lHa1ij2Cb) or [Apple Podcasts](https://podcasts.apple.com/us/podcast/ai-safety-newsletter/id1702875110).

* * *

Implications of a Trump administration for AI policy
====================================================

Trump [named](https://www.nytimes.com/2024/07/16/us/politics/trump-vance-vp-decision.html) Ohio Senator J.D. Vance—an AI regulation skeptic—as his pick for vice president. This choice sheds light on the AI policy landscape under a future Trump administration. In this story, we cover: (1) Vance’s views on AI policy, (2) views of key players in the administration, such as Trump’s party, donors, and allies, and (3) why AI safety should remain bipartisan.

**Vance has pushed for reducing AI regulations and making AI weights open.** At a recent [Senate hearing](https://www.commerce.senate.gov/2024/7/the-need-to-protect-americans-privacy-and-the-ai-accelerant), Vance accused Big Tech companies of overstating risks from AI in order to justify regulations to stifle competition. This led tech policy experts to [expect](https://www.nytimes.com/2024/07/17/technology/vance-ai-regulation.html) that Vance would favor looser AI regulations.

However, Vance has also [praised](https://www.theverge.com/24199314/jd-vance-donald-trump-vp-antitrust-big-tech-ftc-lina-khan-elizabeth-warren-google) Lina Khan, Chair of the Federal Trade Commission, for her antitrust action against big AI companies. This suggests Vance is against “Big Tech” rather than for de-regulating AI generally.

Vance has also [defended](https://x.com/ShakeelHashim/status/1812908699289325666) open weight AI models as the best way to prevent left-wing bias in models, while dismissing their risks.

![](https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F902ac97b-07bb-4232-adb5-d17778692649_1600x1067.png)

*J.D. Vance at the tech and media Sun Valley Conference in 2017.* [*Photo Credit*](https://www.theverge.com/24199314/jd-vance-donald-trump-vp-antitrust-big-tech-ftc-lina-khan-elizabeth-warren-google)*.*

**The Republican Party platform pledges to repeal Biden’s executive order on AI. **The Republican platform [reads](https://www.presidency.ucsb.edu/documents/2024-republican-party-platform), “Joe Biden's dangerous Executive Order that hinders AI Innovation, and imposes Radical Leftwing ideas on the development of this technology. In its place, Republicans support AI Development rooted in Free Speech and Human Flourishing.”

This suggests that a Trump administration might roll back requirements for reporting and safety testing and pause further plans for regulation.

**Marc Andreessen and Ben Horowitz to fund Trump. **Andreessen and Horowitz, who run the eponymous venture capital firm, [announced](https://www.theinformation.com/articles/marc-andreessen-ben-horowitz-say-they-plan-to-donate-to-trump-pac?rc=2scvgf) plans to make large donations to Trump’s political action committees. 

In a blog post, Horowitz [described](https://a16z.com/politics-and-the-future/) the firm as “non-partisan, one issue voters” for “an optimistic technology-enabled future.” The two also released a [joint statement](https://a16z.com/the-little-tech-agenda/) of broad allegiance to political candidates who support tech startups. 

The founders’ interests seem especially well-aligned with a potential Trump administration on AI. In a [recent interview](https://www.theverge.com/2024/7/24/24204706/marc-andreessen-ben-horowitz-a16z-trump-donations), the pair singled out Biden’s Executive Order on AI as a reason for donating to Trump.

Their firm is also heavily invested in cryptocurrency, which—as they told employees—they expect the Trump administration to more lightly regulate. Trump’s tax cuts are also [up for renewal next year](https://www.brookings.edu/articles/what-will-happen-to-the-trump-tax-cuts-in-2025-and-how-will-they-affect-the-national-debt/).

**Trump allies push an AI race with China. **Jacob Helberg is [a rising power broker](https://www.theinformation.com/articles/trumps-young-man-in-silicon-valley?rc=2scvgf) between the GOP and tech leaders. He is pushing for more AI integration into the military through providers like Palantir—which Helberg advises—and more effective stunting of China’s AI capabilities. 

Other Trump allies are [privately drafting](https://www.washingtonpost.com/technology/2024/07/16/trump-ai-executive-order-regulations-military/) an AI executive order to launch a series of “Manhattan Projects” to develop military technology, review “burdensome regulations,” and secure AI systems from foreign adversaries.

Overall, the administration would likely accelerate military AI development. This benefits hawkish allies and tech leaders that contract with the Pentagon, both of which are close to the Trump campaign.

**Still, much AI policy is—and *****should remain*****—bipartisan. **The former Trump and current Biden administrations have aligned on some AI regulatory principles, such as national security, and specific rules, such as export controls. The Trump administration imposed curbs on high-tech semiconductors exports to China in 2020; the Biden administration in 2022 followed up by imposing its own rounds of export restrictions, tightening them a year later.

Apparent partisan divisions over AI safety might be an aberration rather than the norm. According to [a new poll](https://time.com/6996090/ai-china-american-voters-poll/), a majority of both Republicans and Democrats favor “taking a careful controlled approach” to AI over “moving forward on AI as fast as possible to be the first country to get extremely powerful AI.”

Moreover, AI safety has largely remained bipartisan in Congress. Many Republican members of Congress have sponsored AI legislation. The Bipartisan Senate Artificial Intelligence [Working Group](https://www.hklaw.com/en/insights/publications/2024/05/senate-releases-bipartisan-ai-roadmap) continues to identify areas of policy consensus.

Safety Engineering
==================

Our new book, *Introduction to AI Safety, Ethics and Society*, is [available for free online](https://www.aisafetybook.com/) and will be published by Taylor & Francis in the next year. This week, we will look at [Chapter 4: Safety Engineering](https://www.aisafetybook.com/textbook/safety-engineering). This chapter outlines key insights from safety engineering, a field which specializes in identifying hazards and managing risk. We can view AI safety as a special case of safety engineering focused on reducing the risk of AI-related catastrophes. Here is the chapter’s accompanying [video](https://www.youtube.com/watch?v=R7sazz_MtP8).

**Risk can be decomposed into **[**four factors**](https://www.aisafetybook.com/textbook/risk-decomposition)**: exposure, probability, severity, and vulnerability. ***Exposure *is the extent to which we are exposed to a hazard. *Probability* is the likelihood an accident results from the hazard. *Severity* is the damage an accident would cause. *Vulnerability* is how susceptible we are to that damage. Increasing any of these factors will increase risk, and reducing any of these factors will reduce risk.

For example, consider the risk associated with a wet floor. *Exposure* is the number of people walking across the floor when it’s wet. *Probability* is the likelihood one of those people slips. *Severity* is the extent of damage or force a slip would cause. *Vulnerability* is how susceptible someone is to getting injured from a slip, perhaps due to bone density or age. 

**We can reduce risk by following **[**safe design principles**](https://www.aisafetybook.com/textbook/safe-design-principles)**.** “Safe design principles'' are features we can build into a system from the design stage to make it safer. They can often be divided into preventative (or “control”) measures, which reduce the *exposure* and *probability* of a hazard, and protective (or “recovery”) measures, which reduce the *severity* of and our *vulnerability* to a hazard if it does occur. 

While preventative measures are generally more effective than protective measures, both are integral to ensuring a system’s safety. Perhaps the most important safe design principle is *defense in depth*: employing multiple safe design principles rather than relying on just one, since any safety feature will have weaknesses.

![](https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6041e326-c428-4327-bfd0-32066833d9ec_1600x584.png)

*Each safe design principle (safety culture, red teaming, etc.) is a layer of defense with its own holes in the Swiss cheese model.*

[**Systemic accident models**](https://www.aisafetybook.com/textbook/systemic-factors) **can identify potential risks in a system by concentrating on underlying “systemic factors.”**Some factors that contribute to risk can not be easily decomposed. Systemic factors are conditions inherent to a system that diffusely impact its risk. One key systemic factor is an organization’s “safety culture,” or how serious an organization’s personnel really are about safety. 

Unlike many traditional risk models, systemic accident models take into account that systems are made of complex, interacting components, and that their risks cannot be understood simply by examining a chain of causal events.

**We can miss worst-case scenarios if we fail to consider **[**tail events and black swans**](https://www.aisafetybook.com/textbook/tail-events-and-black-swans)**.** Tail events, named for their location at the extremes, or “tails,” of probability distributions, are events that occur rarely but have a sizable impact when they do occur. Examples of tail events include the 2008 financial crisis and the COVID-19 pandemic. 

Black swans are tail events that are also “unknown unknowns”; in other words, they are events we don’t even know are possible. While it may be tempting to ignore tail events and black swans because they are so rare, they have a significant impact on the average risk of a system. In the case of AI, failing to address them can be catastrophic.

Links
=====

**Governance updates**

*   The FTC wrote [a blog post ](https://www.ftc.gov/policy/advocacy-research/tech-at-ftc/2024/07/open-weights-foundation-models)discussing open-weight (not “open source”) AI models. 
*   Yoshia Bengio wrote [an essay](https://yoshuabengio.org/2024/07/09/reasoning-through-arguments-against-taking-ai-safety-seriously/) arguing why we should take AI safety seriously.
*   Senate Armed Services Committee [releases the text](https://www.armed-services.senate.gov/imo/media/doc/fy25_ndaa_bill_text.pdf) of the 2025 National Defense Authorization Act. [Several](https://www.armed-services.senate.gov/imo/media/doc/fy25_ndaa_committee_report.pdf#page=165) [of its](https://www.armed-services.senate.gov/imo/media/doc/fy25_ndaa_bill_text.pdf#page=100) [provisions](https://www.armed-services.senate.gov/imo/media/doc/fy25_ndaa_committee_report.pdf#page=145) [address](https://www.armed-services.senate.gov/imo/media/doc/fy25_ndaa_bill_text.pdf#page=763) AI’s national security implications.
*   The EU AI Act was [officially published](https://techcrunch.com/2024/07/12/eus-ai-act-gets-published-in-blocs-official-journal-starting-clock-on-legal-deadlines/) in the European Union’s journal. The law will come into effect on August 1st, and enforcement will roll out over the next 24 months.
*   The Biden Administration [announced](https://www.nytimes.com/2024/07/09/technology/chips-packaging-semiconductors.html?wpisrc=nl_technology202) that $1.6 billion in funding from the CHIPS Act will be directed towards new technology for chip packaging.
*   GOP lawmakers [raise national security concerns](https://www.bloomberg.com/news/articles/2024-07-11/gop-lawmakers-call-for-intelligence-probe-of-microsoft-g42-deal) about a $1.5 billion partnership between Microsoft and Abu Dhabi AI firm G42.
*   According to its [revised AI strategy](https://www.nato.int/cps/en/natohq/news_227234.htm), NATO will “work to protect against the adversarial use of AI, including through increased strategic foresight and analysis.”

**Industry updates**

*   **Deepmind’s AlphaGeometry2 and AlphaProof were just **[**one point shy of a gold medal performance**](https://www.nytimes.com/2024/07/25/science/ai-math-alphaproof-deepmind.html) **on 2024 International Mathematical Olympiad questions.**
*   OpenAI announced a prototype of [SearchGPT](https://openai.com/index/searchgpt-prototype/), a feature that allows an AI system to pull information from the web when responding to prompts.
*   **Meta released **[**Llama 3.1**](https://llama.meta.com/)**, which is now the world's largest open-weight model, and the first with frontier capabilities. Alongside the release, Mark Zuckerberg published **[**a blog post**](https://about.fb.com/news/2024/07/open-source-ai-is-the-path-forward/) **arguing in favor of “open source” models.**
*   OpenAI whistleblowers say that [OpenAI rushed through its testing for GPT-4o](https://www.washingtonpost.com/technology/2024/07/12/openai-ai-safety-regulation-gpt4/) in a single week.
*   Meta, Apple, and Microsoft are facing [pressure from shareholders](https://news.bloomberglaw.com/daily-labor-report/meta-apple-microsoft-move-to-fend-off-mounting-ai-concerns) to be more transparent about the risks of AI systems. 
*   Microsoft and Apple are also [giving up their OpenAI board observer seats](https://www.reuters.com/technology/microsoft-ditches-openai-board-observer-seat-amid-regulatory-scrutiny-2024-07-10/) in response to antitrust scrutiny.
*   OpenAI believes its technology is approaching [the next level on the path to AGI](https://www.bloomberg.com/news/articles/2024-07-11/openai-sets-levels-to-track-progress-toward-superintelligent-ai).
*   Meta funds [an ad campaign](https://www.transformernews.ai/p/american-edge-meta-ai-regulation-lobbying?r=45y612&triedRedirect=true) against AI regulation.
*   [Gray Swan AI](https://www.grayswan.ai/news/gray-swan-launch), an AI safety and security start-up, launched last week. The company “specializes in building tools to help companies assess the risks of their AI systems and safeguard their AI deployments from harmful use.”
*   xAI now has the [world’s largest supercomputer](https://www.datacenterdynamics.com/en/news/xais-memphis-supercluster-has-gone-live-with-up-to-100000-nvidia-h100-gpus/).

See also: [CAIS website](https://www.safe.ai/), [CAIS X account](https://x.com/ai_risks?lang=en), our [ML Safety benchmark competition](https://www.mlsafety.org/safebench#get-started), our [new course](https://www.aisafetybook.com/), and our [feedback form](https://forms.gle/EU3jfTkxfFgyWVmV7). The Center for AI Safety is also [hiring a project manager](https://jobs.lever.co/aisafety/a8fe8185-e33e-4ce5-9f5c-2d347b14c911).  
  
Listen to the AI Safety Newsletter for free on [Spotify](https://spotify.link/E6lHa1ij2Cb) or [Apple Podcasts.](https://podcasts.apple.com/us/podcast/ai-safety-newsletter/id1702875110)

Subscribe [here](https://newsletter.safe.ai/subscribe?utm_medium=web&utm_source=subscribe-widget-preamble&utm_content=113135916) to receive future versions.