# Voting Results for the 2022 Review

The 5th Annual LessWrong Review has come to a close!

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/8a2786113f9739ff2a47db45496795c0247abf612eec8583.png)

Review Facts
------------

There were 5330 posts published in 2022. 

Here's how many posts passed through the different review phases.

| **Phase** | **No. of posts** | **Eligibility** |
| --- | --- | --- |
| Nominations Phase | 579 | Any 2022 post could be given preliminary votes |
| Review Phase | 363 | Posts with 2+ votes could be reviewed |
| Voting Phase | 168 | Posts with 1+ reviews could be voted on |

Here how many votes and voters there were by karma bracket.

|     | **Karma Bucket** | **No. of Voters** | **No. of Votes Cast** |     |
| --- | --- | --- | --- | --- |
|     | Any | 333 | 5007 |     |
|     | 1+  | 307 | 4944 |     |
|     | 10+ | 298 | 4902 |     |
|     | 100+ | 245 | 4538 |     |
|     | 1,000+ | 121 | 2801 |     |
|     | 10,000+ | 24  | 816 |     |

To give some context on this annual tradition, here are the absolute numbers compared to last year and to the first year of the LessWrong Review.

|     |     | **2018** | **2021** | **2022** |     |
| --- | --- | --- | --- | --- | --- |
|     | **Voters** | 59  | 238 | 333 |     |
|     | **Nominations** | 75  | 452 | 579 |     |
|     | **Reviews** | 120 | 209 | 227 |     |
|     | **Votes** | 1272 | 2870 | 5007 |     |
|     | **Total LW Posts** | 1703 | 4506 | 5330 |     |

Review Prizes
-------------

There were lots of great reviews this year! [Here's a link to all of them](https://www.lesswrong.com/reviews/2022)

Of 227 reviews we're giving 31 of them prizes. 

This follows up on Habryka who gave out about half of these prizes [2 months ago.](https://www.lesswrong.com/posts/Lqf7H9zREnRbmWL4M/the-lesswrong-2022-review-review-phase?commentId=JvtFtuzboh8fx69Ex)

Note that two users were paid to produce reviews and so will not be receiving the prize money. They're still here because I wanted to indicate that they wrote some really great reviews.

Click below to expand and see who won prizes.

**Excellent ($200) (7 reviews)**

*   [ambigram](https://www.lesswrong.com/users/ambigram?mention=user) for their [review](https://www.lesswrong.com/posts/SvKpaPbZ2tibeDpgh/meadow-theory?commentId=K6KXsCcwF7gJbRYfx) of *Meadow Theory*
*   [Buck](https://www.lesswrong.com/users/buck?mention=user) for his [self-review](https://www.lesswrong.com/posts/JvZhhzycHu2Yd57RN/causal-scrubbing-a-method-for-rigorously-testing?commentId=oikvsKEmmBrBr9Yno) of *Causal Scrubbing: a method for rigorously testing interpretability hypotheses*
*   [DirectedEvolution](https://www.lesswrong.com/users/directedevolution?mention=user)  for their [paid review](https://www.lesswrong.com/posts/xggxWfyzZmnz7hydm/how-satisfied-should-you-expect-to-be-with-your-partner?commentId=QntRoKeRMAG7vNioh) of *How satisfied should you expect to be with your partner?*
*   [LawrenceC](https://www.lesswrong.com/users/lawrencec?mention=user)  for their [paid review](https://www.lesswrong.com/posts/3ecs6duLmTfyra3Gp/some-lessons-learned-from-studying-indirect-object?commentId=b3CenvuGe5LoqoWb3) of *Some Lessons Learned from Studying Indirect Object Identification in GPT-2 small*
*   [LawrenceC](https://www.lesswrong.com/users/lawrencec?mention=user) for their [paid review](https://www.lesswrong.com/posts/L4anhrxjv8j2yRKKp/how-discovering-latent-knowledge-in-language-models-without?commentId=6vWbeBcFwdvLqSNEA) of *How "Discovering Latent Knowledge in Language Models Without Supervision" Fits Into a Broader Alignment Scheme*
*   [LoganStrohl](https://www.lesswrong.com/users/brienneyudkowsky?mention=user) for their [self-review](https://www.lesswrong.com/posts/pPWiLGsWCtN92vLwu/intro-to-naturalism-orientation?commentId=5Fnx6cKGfM7Hudi9N) of the *Intro to Naturalism sequence*
*   [porby](https://www.lesswrong.com/users/porby?mention=user) for their [self-review](https://www.lesswrong.com/posts/K4urTDkBbtNuLivJx/why-i-think-strong-general-ai-is-coming-soon?commentId=5Q3qAWBS3P6wqqsdn) of *Why I think strong general AI is coming soon*

**Great ($100) (6 reviews)**

*   [DirectedEvolution](https://www.lesswrong.com/users/directedevolution?mention=user) for their [paid review](https://www.lesswrong.com/posts/xEHy9oivifjgFbnvc/slack-matters-more-than-any-outcome?commentId=kWBekfZNDSe68Nh7o) of *Slack matters more than any outcome *
*   [janus](https://www.lesswrong.com/users/janus-1?mention=user) for their [self-review](https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators?commentId=EouDrGb8YJE4jxrmF) of *Simulators*
*   [Lee Sharkey](https://www.lesswrong.com/users/lee_sharkey?mention=user) for their [self-review](https://www.lesswrong.com/posts/z6QQJbtpkEAX3Aojj/interim-research-report-taking-features-out-of-superposition?commentId=ANAfjneQNZSC76DDE) of *Taking features out of superposition with sparse autoencoders*
*   [Neel Nanda](https://www.lesswrong.com/users/neel-nanda-1?mention=user) for their [review](https://www.lesswrong.com/posts/3ecs6duLmTfyra3Gp/some-lessons-learned-from-studying-indirect-object?commentId=2ZZAAaGvf6R5fzedj) of "Some Lessons Learned from Studying Indirect Object Identification in GPT-2 small"
*   [nostalgebraist](https://www.lesswrong.com/users/nostalgebraist?mention=user) for their [review](https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators?commentId=vQyJXdcZxGaJAuMCL) of Simulators
*   [Writer](https://www.lesswrong.com/users/writer?mention=user) for their [review](https://www.lesswrong.com/posts/gHefoxiznGfsbiAu9/inner-and-outer-alignment-decompose-one-hard-problem-into?commentId=BRDiJr7N7iAazXPSx) of "Inner and outer alignment decompose one hard problem into two extremely hard problems"

**Good ($50) (18 reviews)**

*   [Alex_Altair](https://www.lesswrong.com/users/alex_altair?mention=user) for their [review](https://www.lesswrong.com/posts/pPWiLGsWCtN92vLwu/intro-to-naturalism-orientation?commentId=WGoDdCr7DqTSRGF9Q) of the *Intro to Naturalism sequence*
*   [Buck](https://www.lesswrong.com/users/buck?mention=user)  for their [review](https://www.lesswrong.com/posts/KcvJXhKqx4itFNWty/k-complexity-is-silly-use-cross-entropy-instead?commentId=Ks77D8scr8CcNzC8y) of *K-complexity is silly; use cross-entropy instead*
*   [Davidmanheim](https://www.lesswrong.com/users/davidmanheim?mention=user) for their [review](https://www.lesswrong.com/posts/7iAABhWpcGeP5e6SB/it-s-probably-not-lithium?commentId=3GM3ExCt3YdKjWEQr) of *It's Probably not Lithium*
*   [\[DEACTIVATED\] Duncan Sabien](https://www.lesswrong.com/users/deactivated-duncan-sabien?mention=user) for their [review](https://www.lesswrong.com/posts/kcoqwHscvQTx4xgwa/here-s-the-exit?commentId=8QRSAvcbDGXwfToZo) of *Here's the exit.*
*   [\[DEACTIVATED\] Duncan Sabien](https://www.lesswrong.com/users/deactivated-duncan-sabien?mention=user)  for their [self-review](https://www.lesswrong.com/posts/T6kzsMDJyKwxLGe3r/benign-boundary-violations?commentId=GLd2du3c5PtWvQzyF) of *Benign Boundary Violations*
*   [eukaryote](https://www.lesswrong.com/users/eukaryote?mention=user) for their [self-review](https://www.lesswrong.com/posts/FfPukic3Qskd9ZAkk/fiber-arts-mysterious-dodecahedrons-and-waiting-on-eureka?commentId=mgLcGnAwosd59C4Jn) of *Fiber arts, mysterious dodecahedrons, and waiting on “Eureka!”*
*   [Jan_Kulveit](https://www.lesswrong.com/users/jan_kulveit?mention=user) for their [review](https://www.lesswrong.com/posts/CQAMdzA4MZEhNRtTp/human-values-and-biases-are-inaccessible-to-the-genome?commentId=gXLAmCKtGFtAaLHM8) of *Human values & biases are inaccessible to the genome*
*   [Jan_Kulveit](https://www.lesswrong.com/users/jan_kulveit?mention=user) for their [review](https://www.lesswrong.com/posts/iCfdcxiyr2Kj8m8mT/the-shard-theory-of-human-values?commentId=t7pc5sHfjqEksR9tm) of *The shard theory of human values*
*   [johnswentworth](https://www.lesswrong.com/users/johnswentworth?mention=user)  for their [review](https://www.lesswrong.com/posts/Cvr723R7DmKcLiAzQ/revisiting-algorithmic-progress?commentId=qAnGWiNpZgiBrfBHS) of *Revisiting algorithmic progress*
*   [L Rudolf L](https://www.lesswrong.com/users/l-rudolf-l?mention=user) for their [self-review](https://www.lesswrong.com/posts/Pix8haJTbkuxPtxpb/review-amusing-ourselves-to-death?commentId=mzyKLEPSbRGRFewpF) of *Review: Amusing Ourselves to Death*
*   [Nathan Young](https://www.lesswrong.com/users/nathan-young?mention=user) for their [review](https://www.lesswrong.com/posts/FuGHKKMcAL2GYbxrn/introducing-pastcasting-a-tool-for-forecasting-practice?commentId=ZavJ9EBKgM6Mt7vDi) of *Introducing Pastcasting: A tool for forecasting practice*
*   [Neel Nanda](https://www.lesswrong.com/users/neel-nanda-1?mention=user) for their [self-review](https://www.lesswrong.com/posts/uK6sQCNMw8WKzJeCQ/a-longlist-of-theories-of-impact-for-interpretability?commentId=D7nBWdPq8dvpt7JHx) of *A Longlist of Theories of Impact for Interpretability*
*   [Screwtape](https://www.lesswrong.com/users/screwtape?mention=user)  for their [review](https://www.lesswrong.com/posts/WotMLgX9hHXzBxKCB/how-to-a-workshop-or-anything?commentId=eKgq82mpcjPSk8XRB) of *How To: A Workshop (or anything)*
*   [Screwtape](https://www.lesswrong.com/users/screwtape?mention=user) for their [review](https://www.lesswrong.com/posts/k9dsbn8LZ6tTesDS3/sazen?commentId=pmmYuiHoX9zkNrG4q) of *Sazen*
*   [TurnTrout](https://www.lesswrong.com/users/turntrout?mention=user) for their [review](https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators?commentId=8N7anBfTK7otmnfSG) of *Simulators*
*   [Vanessa Kosoy](https://www.lesswrong.com/users/vanessa-kosoy?mention=user) for their [post-length review](https://www.lesswrong.com/posts/CoZhXrhpQxpy9xw9y/where-i-agree-and-disagree-with-eliezer?commentId=R9rKMMPowWHmvxFXG) of *Where I agree and disagree with Eliezer*
*   [Vika](https://www.lesswrong.com/users/vika?mention=user) for their [self-review](https://www.lesswrong.com/posts/qJgz2YapqpFEDTLKn/deepmind-alignment-team-opinions-on-agi-ruin-arguments?commentId=9kryfBXyXnBwb7jER) of *DeepMind alignment team opinions on AGI ruin arguments*
*   [Vika](https://www.lesswrong.com/users/vika?mention=user) for their [self-review](https://www.lesswrong.com/posts/usKXS5jGDzjwqv3FJ/refining-the-sharp-left-turn-threat-model-part-1-claims-and?commentId=hwDZMtt4AeYn3zodL) of *Refining the Sharp Left Turn threat model, part 1: claims and mechanisms*

We'll reach out to prizewinners in the coming weeks to give you your prizes.

We have been working on a new way of celebrating the best posts of the year
---------------------------------------------------------------------------

The top 50 posts of each year are being celebrated in a new way! Read [this companion post](https://www.lesswrong.com/posts/qvCMiwkBqdYjfiX6n/announcing-the-leastwrong-and-review-winner-post-pages) to find out all the details, but for now here's a preview of the sorts of changes we've made for the top-voted posts of the annual review.

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5d1ece2198017f7bf879c16973ca317a3543f80f9589a683.png)

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/7451bff7b84c6a75e548724a64a08a8ffe0b3986e95ea0db.png)

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5c48d6496e93e9735651ff5ea0d311e219cd039a797e30db.png)

And there's a [new *LeastWrong* page](https://www.lesswrong.com/leastwrong) with the top 50 posts from all 5 annual reviews so far, sorted into categories.

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/11238e64159ae4ac449e8232f5143c77d415f732bc9f9c39.png)

You can learn more about what we've built in [the companion post](https://www.lesswrong.com/posts/qvCMiwkBqdYjfiX6n/announcing-the-leastwrong-and-review-winner-post-pages).

Okay, now onto the voting results!

Voting Results
--------------

Voting is visualized here with dots of varying sizes, roughly indicating that a user thought a post was "good" (+1), "important" (+4), or "extremely important" (+9). 

Green dots indicate positive votes. Red indicate negative votes.

If a user spent more than their budget of 500 points, all of their votes were scaled down slightly, so some of the circles are slightly smaller than others.

These are the 161 posts that got a net positive score, out of 168 posts that were eligible for the vote.

| 0   | [AGI Ruin: A List of Lethalities](/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities) Eliezer Yudkowsky |     |
| --- | --- | --- |
| 1   | [MIRI announces new "Death With Dignity" strategy](/posts/j9Q8bRmwCgXRYAgcJ/miri-announces-new-death-with-dignity-strategy) Eliezer Yudkowsky |     |
| 2   | [Where I agree and disagree with Eliezer](/posts/CoZhXrhpQxpy9xw9y/where-i-agree-and-disagree-with-eliezer) paulfchristiano |     |
| 3   | [Let’s think about slowing down AI](/posts/uFNgRumrDTpBfQGrs/let-s-think-about-slowing-down-ai) KatjaGrace |     |
| 4   | [Reward is not the optimization target](/posts/pdaGN6pQyQarFHXF4/reward-is-not-the-optimization-target) TurnTrout |     |
| 5   | [Six Dimensions of Operational Adequacy in AGI Projects](/posts/keiYkaeoLHoKK4LYA/six-dimensions-of-operational-adequacy-in-agi-projects) Eliezer Yudkowsky |     |
| 6   | [It Looks Like You're Trying To Take Over The World](/posts/a5e9arCnbDac9Doig/it-looks-like-you-re-trying-to-take-over-the-world) gwern |     |
| 7   | [Staring into the abyss as a core life skill](/posts/vzfz4AS6wbooaTeQk/staring-into-the-abyss-as-a-core-life-skill) benkuhn |     |
| 8   | [You Are Not Measuring What You Think You Are Measuring](/posts/9kNxhKWvixtKW5anS/you-are-not-measuring-what-you-think-you-are-measuring) johnswentworth |     |
| 9   | [Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover](/posts/pRkFkzwKZ2zfa3R6H/without-specific-countermeasures-the-easiest-path-to) Ajeya Cotra |     |
| 10  | [Sazen](/posts/k9dsbn8LZ6tTesDS3/sazen) \\[DEACTIVATED\\] Duncan Sabien |     |
| 11  | [Luck based medicine: my resentful story of becoming a medical miracle](/posts/fFY2HeC9i2Tx8FEnK/luck-based-medicine-my-resentful-story-of-becoming-a-medical) Elizabeth |     |
| 12  | [Inner and outer alignment decompose one hard problem into two extremely hard problems](/posts/gHefoxiznGfsbiAu9/inner-and-outer-alignment-decompose-one-hard-problem-into) TurnTrout |     |
| 13  | [On how various plans miss the hard bits of the alignment challenge](/posts/3pinFH3jerMzAvmza/on-how-various-plans-miss-the-hard-bits-of-the-alignment) So8res |     |
| 14  | [Simulators](/posts/vJFdjigzmcXMhNTsx/simulators) janus |     |
| 15  | [Epistemic Legibility](/posts/jbE85wCkRr9z7tqmD/epistemic-legibility) Elizabeth |     |
| 16  | [Tyranny of the Epistemic Majority](/posts/o3RLHYviTE4zMb9T9/tyranny-of-the-epistemic-majority) Scott Garrabrant |     |
| 17  | [Counterarguments to the basic AI x-risk case](/posts/LDRQ5Zfqwi8GjzPYG/counterarguments-to-the-basic-ai-x-risk-case) KatjaGrace |     |
| 18  | [What Are You Tracking In Your Head?](/posts/bhLxWTkRc8GXunFcB/what-are-you-tracking-in-your-head) johnswentworth |     |
| 19  | [Safetywashing](/posts/xhD6SHAAE9ghKZ9HS/safetywashing) Adam Scholl |     |
| 20  | [Threat-Resistant Bargaining Megapost: Introducing the ROSE Value](/posts/vJ7ggyjuP4u2yHNcP/threat-resistant-bargaining-megapost-introducing-the-rose) Diffractor |     |
| 21  | [Nonprofit Boards are Weird](/posts/nSjavaKcBrtNktzGa/nonprofit-boards-are-weird) HoldenKarnofsky |     |
| 22  | [Optimality is the tiger, and agents are its teeth](/posts/kpPnReyBC54KESiSn/optimality-is-the-tiger-and-agents-are-its-teeth) Veedrac |     |
| 23  | [chinchilla's wild implications](/posts/6Fpvch8RR29qLEWNH/chinchilla-s-wild-implications) nostalgebraist |     |
| 24  | [Losing the root for the tree](/posts/ma7FSEtumkve8czGF/losing-the-root-for-the-tree) Adam Zerner |     |
| 25  | [Worlds Where Iterative Design Fails](/posts/xFotXGEotcKouifky/worlds-where-iterative-design-fails) johnswentworth |     |
| 26  | [Decision theory does not imply that we get to have nice things](/posts/rP66bz34crvDudzcJ/decision-theory-does-not-imply-that-we-get-to-have-nice) So8res |     |
| 27  | [Comment reply: my low-quality thoughts on why CFAR didn't get farther with a "real/efficacious art of rationality"](/posts/B9kP6x5rpmuCzpfWb/comment-reply-my-low-quality-thoughts-on-why-cfar-didn-t-get) AnnaSalamon |     |
| 28  | [What an actually pessimistic containment strategy looks like](/posts/kipMvuaK3NALvFHc9/what-an-actually-pessimistic-containment-strategy-looks-like) lc |     |
| 29  | [Introduction to abstract entropy](/posts/REA49tL5jsh69X3aM/introduction-to-abstract-entropy) Alex_Altair |     |
| 30  | [A Mechanistic Interpretability Analysis of Grokking](/posts/N6WM6hs7RQMKDhYjB/a-mechanistic-interpretability-analysis-of-grokking) Neel Nanda |     |
| 31  | [The Redaction Machine](/posts/CKgPFHoWFkviYz7CB/the-redaction-machine) Ben |     |
| 32  | [Butterfly Ideas](/posts/R6M4vmShiowDn56of/butterfly-ideas) Elizabeth |     |
| 33  | [Causal Scrubbing: a method for rigorously testing interpretability hypotheses \\[Redwood Research\\]](/posts/JvZhhzycHu2Yd57RN/causal-scrubbing-a-method-for-rigorously-testing) LawrenceC |     |
| 34  | [Language models seem to be much better than humans at next-token prediction](/posts/htrZrxduciZ5QaCjw/language-models-seem-to-be-much-better-than-humans-at-next) Buck |     |
| 35  | [Toni Kurz and the Insanity of Climbing Mountains](/posts/J3wemDGtsy5gzD3xa/toni-kurz-and-the-insanity-of-climbing-mountains) GeneSmith |     |
| 36  | [Useful Vices for Wicked Problems](/posts/2MiDpjWraeL5bypRE/useful-vices-for-wicked-problems) HoldenKarnofsky |     |
| 37  | [What should you change in response to an "emergency"? And AI risk](/posts/mmHctwkKjpvaQdC3c/what-should-you-change-in-response-to-an-emergency-and-ai) AnnaSalamon |     |
| 38  | [Models Don't "Get Reward"](/posts/TWorNr22hhYegE4RT/models-don-t-get-reward) Sam Ringer |     |
| 39  | [How To Go From Interpretability To Alignment: Just Retarget The Search](/posts/w4aeAFzSAguvqA5qu/how-to-go-from-interpretability-to-alignment-just-retarget) johnswentworth |     |
| 40  | [Security Mindset: Lessons from 20+ years of Software Security Failures Relevant to AGI Alignment](/posts/Ke2ogqSEhL2KCJCNx/security-mindset-lessons-from-20-years-of-software-security) elspood |     |
| 41  | [Why Agent Foundations? An Overly Abstract Explanation](/posts/FWvzwCDRgcjb9sigb/why-agent-foundations-an-overly-abstract-explanation) johnswentworth |     |
| 42  | [A central AI alignment problem: capabilities generalization, and the sharp left turn](/posts/GNhMPAWcfBCASy8e6/a-central-ai-alignment-problem-capabilities-generalization) So8res |     |
| 43  | [Humans provide an untapped wealth of evidence about alignment](/posts/CjFZeDD6iCnNubDoS/humans-provide-an-untapped-wealth-of-evidence-about) TurnTrout |     |
| 44  | [Learning By Writing](/posts/ii4xtogen7AyYmN6B/learning-by-writing) HoldenKarnofsky |     |
| 45  | [Limerence Messes Up Your Rationality Real Bad, Yo](/posts/Jk9yMXpBLMWNTFLzh/limerence-messes-up-your-rationality-real-bad-yo) Raemon |     |
| 46  | [The Onion Test for Personal and Institutional Honesty](/posts/nTGEeRSZrfPiJwkEc/the-onion-test-for-personal-and-institutional-honesty) chanamessinger |     |
| 47  | [Counter-theses on Sleep](/posts/sbcmACvB6DqYXYidL/counter-theses-on-sleep) Natália Coelho Mendonça |     |
| 48  | [The shard theory of human values](/posts/iCfdcxiyr2Kj8m8mT/the-shard-theory-of-human-values) Quintin Pope |     |
| 49  | [How "Discovering Latent Knowledge in Language Models Without Supervision" Fits Into a Broader Alignment Scheme](/posts/L4anhrxjv8j2yRKKp/how-discovering-latent-knowledge-in-language-models-without) Collin |     |
| 50  | [ProjectLawful.com: Eliezer's latest story, past 1M words](/posts/SA9hDewwsYgnuscae/projectlawful-com-eliezer-s-latest-story-past-1m-words) Eliezer Yudkowsky |     |
| 51  | [Intro to Naturalism: Orientation](/posts/pPWiLGsWCtN92vLwu/intro-to-naturalism-orientation) LoganStrohl |     |
| 52  | [Why I think strong general AI is coming soon](/posts/K4urTDkBbtNuLivJx/why-i-think-strong-general-ai-is-coming-soon) porby |     |
| 53  | [How might we align transformative AI if it’s developed very soon?](/posts/rCJQAkPTEypGjSJ8X/how-might-we-align-transformative-ai-if-it-s-developed-very) HoldenKarnofsky |     |
| 54  | [It’s Probably Not Lithium](/posts/7iAABhWpcGeP5e6SB/it-s-probably-not-lithium) Natália Coelho Mendonça |     |
| 55  | [(My understanding of) What Everyone in Technical Alignment is Doing and Why](/posts/QBAjndPuFbhEXKcCr/my-understanding-of-what-everyone-in-technical-alignment-is) Thomas Larsen |     |
| 56  | [Plans Are Predictions, Not Optimization Targets](/posts/5ntgky9ShzKKWu7us/plans-are-predictions-not-optimization-targets) johnswentworth |     |
| 57  | [Takeoff speeds have a huge effect on what it means to work on AI x-risk](/posts/hRohhttbtpY3SHmmD/takeoff-speeds-have-a-huge-effect-on-what-it-means-to-work-1) Buck |     |
| 58  | [The Feeling of Idea Scarcity](/posts/mfPHTWsFhzmcXw8ta/the-feeling-of-idea-scarcity) johnswentworth |     |
| 59  | [Six (and a half) intuitions for KL divergence](/posts/no5jDTut5Byjqb4j5/six-and-a-half-intuitions-for-kl-divergence) CallumMcDougall |     |
| 60  | [Trigger-Action Planning](/posts/W5HcGywyPoDDdJtbz/trigger-action-planning) CFAR!Duncan |     |
| 61  | [Have You Tried Hiring People?](/posts/ido3qfidfDJbigTEQ/have-you-tried-hiring-people) rank-biserial |     |
| 62  | [The Wicked Problem Experience](/posts/kgmkdf3C7EkDX7dnT/the-wicked-problem-experience) HoldenKarnofsky |     |
| 63  | [What does it take to defend the world against out-of-control AGIs?](/posts/LFNXiQuGrar3duBzJ/what-does-it-take-to-defend-the-world-against-out-of-control) Steven Byrnes |     |
| 64  | [On Bounded Distrust](/posts/6YYmkpumigAmh3efu/on-bounded-distrust) Zvi |     |
| 65  | [Setting the Zero Point](/posts/Gh6LWHd9kR5FBmCWx/setting-the-zero-point) \\[DEACTIVATED\\] Duncan Sabien |     |
| 66  | [\\[Interim research report\\] Taking features out of superposition with sparse autoencoders](/posts/z6QQJbtpkEAX3Aojj/interim-research-report-taking-features-out-of-superposition) Lee Sharkey |     |
| 67  | [Limits to Legibility](/posts/4gDbqL3Tods8kHDqs/limits-to-legibility) Jan_Kulveit |     |
| 68  | [Harms and possibilities of schooling](/posts/aaHDA4X6cTzFrvuSX/harms-and-possibilities-of-schooling) TsviBT |     |
| 69  | [Look For Principles Which Will Carry Over To The Next Paradigm](/posts/bmoQ2wy7Nd7EiJdpg/look-for-principles-which-will-carry-over-to-the-next) johnswentworth |     |
| 70  | [Steam](/posts/inedT6KkbLSDwZvfd/steam) abramdemski |     |
| 71  | [High Reliability Orgs, and AI Companies](/posts/FBoyR2rt29oYvazsE/high-reliability-orgs-and-ai-companies) Raemon |     |
| 72  | [Toy Models of Superposition](/posts/CTh74TaWgvRiXnkS6/toy-models-of-superposition) evhub |     |
| 73  | [Editing Advice for LessWrong Users](/posts/5e49dHLDJoDpeXGnh/editing-advice-for-lesswrong-users) JustisMills |     |
| 74  | [Deep Learning Systems Are Not Less Interpretable Than Logic/Probability/Etc](/posts/gebzzEwn2TaA6rGkc/deep-learning-systems-are-not-less-interpretable-than-logic) johnswentworth |     |
| 75  | [why assume AGIs will optimize for fixed goals?](/posts/dKTh9Td3KaJ8QW6gw/why-assume-agis-will-optimize-for-fixed-goals) nostalgebraist |     |
| 76  | [Lies Told To Children](/posts/uyBeAN5jPEATMqKkX/lies-told-to-children-1) Eliezer Yudkowsky |     |
| 77  | [Revisiting algorithmic progress](/posts/Cvr723R7DmKcLiAzQ/revisiting-algorithmic-progress) Tamay |     |
| 78  | [Things that can kill you quickly: What everyone should know about first aid](/posts/sGnPTfjE5JthAStqg/things-that-can-kill-you-quickly-what-everyone-should-know) jasoncrawford |     |
| 79  | [Postmortem on DIY Recombinant Covid Vaccine](/posts/McN9BNtNcbYNfdCB5/postmortem-on-diy-recombinant-covid-vaccine) caffemacchiavelli |     |
| 80  | [Reflections on six months of fatherhood](/posts/hpjou9ZnLZkSJR7sd/reflections-on-six-months-of-fatherhood) jasoncrawford |     |
| 81  | [Some Lessons Learned from Studying Indirect Object Identification in GPT-2 small](/posts/3ecs6duLmTfyra3Gp/some-lessons-learned-from-studying-indirect-object) KevinRoWang |     |
| 82  | [The Plan - 2022 Update](/posts/BzYmJYECAc3xyCTt6/the-plan-2022-update) johnswentworth |     |
| 83  | [12 interesting things I learned studying the discovery of nature's laws](/posts/uiyWHaTrz3ML7JqDX/12-interesting-things-i-learned-studying-the-discovery-of) Ben Pace |     |
| 84  | [Impossibility results for unbounded utilities](/posts/hbmsW2k9DxED5Z4eJ/impossibility-results-for-unbounded-utilities) paulfchristiano |     |
| 85  | [Searching for outliers](/posts/WsSybGTqpBoHpXJyQ/searching-for-outliers) benkuhn |     |
| 86  | [Greyed Out Options](/posts/2KacvW34BbXFmDBtQ/greyed-out-options) ozymandias |     |
| 87  | [“Pivotal Act” Intentions: Negative Consequences and Fallacious Arguments](/posts/Jo89KvfAs9z7owoZp/pivotal-act-intentions-negative-consequences-and-fallacious) Andrew_Critch |     |
| 88  | [Do bamboos set themselves on fire?](/posts/WNpvK67MjREgvB8u8/do-bamboos-set-themselves-on-fire) Malmesbury |     |
| 89  | [Murphyjitsu: an Inner Simulator algorithm](/posts/Htjbj8ystqc2zLtMX/murphyjitsu-an-inner-simulator-algorithm) CFAR!Duncan |     |
| 90  | [Deliberate Grieving](/posts/gs3vp3ukPbpaEie5L/deliberate-grieving-1) Raemon |     |
| 91  | [We Choose To Align AI](/posts/BseaxjsiDPKvGtDrm/we-choose-to-align-ai) johnswentworth |     |
| 92  | [The alignment problem from a deep learning perspective](/posts/KbyRPCAsWv5GtfrbG/the-alignment-problem-from-a-deep-learning-perspective) Richard_Ngo |     |
| 93  | [Slack matters more than any outcome](/posts/xEHy9oivifjgFbnvc/slack-matters-more-than-any-outcome) Valentine |     |
| 94  | [Consider your appetite for disagreements](/posts/8vesjeKybhRggaEpT/consider-your-appetite-for-disagreements) Adam Zerner |     |
| 95  | [everything is okay](/posts/CMHogeqTTajhmnEKx/everything-is-okay) Tamsin Leake |     |
| 96  | [Mysteries of mode collapse](/posts/t9svvNPNmFf5Qa3TA/mysteries-of-mode-collapse) janus |     |
| 97  | [Slow motion videos as AI risk intuition pumps](/posts/Ccsx339LE9Jhoii9K/slow-motion-videos-as-ai-risk-intuition-pumps) Andrew_Critch |     |
| 98  | [ITT-passing and civility are good; "charity" is bad; steelmanning is niche](/posts/MdZyLnLHuaHrCskjy/itt-passing-and-civility-are-good-charity-is-bad) Rob Bensinger |     |
| 99  | [Meadow Theory](/posts/SvKpaPbZ2tibeDpgh/meadow-theory) \\[DEACTIVATED\\] Duncan Sabien |     |
| 100 | [The next decades might be wild](/posts/qRtD4WqKRYEtT5pi3/the-next-decades-might-be-wild) Marius Hobbhahn |     |
| 101 | [Marriage, the Giving What We Can Pledge, and the damage caused by vague public commitments](/posts/XXFiZ4swvxN9ogKqz/marriage-the-giving-what-we-can-pledge-and-the-damage-caused) Jeffrey Ladish |     |
| 102 | [Lessons learned from talking to >100 academics about AI safety](/posts/SqjQFhn5KTarfW8v7/lessons-learned-from-talking-to-greater-than-100-academics) Marius Hobbhahn |     |
| 103 | [Activated Charcoal for Hangover Prevention: Way more than you wanted to know](/posts/LfrNFfJFcqnG9WuFf/activated-charcoal-for-hangover-prevention-way-more-than-you) Maxwell Peterson |     |
| 104 | [More Is Different for AI](/posts/Lp4Q9kSGsJHLfoHX3/more-is-different-for-ai) jsteinhardt |     |
| 105 | [How satisfied should you expect to be with your partner?](/posts/xggxWfyzZmnz7hydm/how-satisfied-should-you-expect-to-be-with-your-partner) Vaniver |     |
| 106 | [How my team at Lightcone sometimes gets stuff done](/posts/6LzKRP88mhL9NKNrS/how-my-team-at-lightcone-sometimes-gets-stuff-done) jacobjacob |     |
| 107 | [The metaphor you want is "color blindness," not "blind spot."](/posts/7Pq9KwZhG6vejmYpo/the-metaphor-you-want-is-color-blindness-not-blind-spot) \\[DEACTIVATED\\] Duncan Sabien |     |
| 108 | [Logical induction for software engineers](/posts/jtMXj24Masrnq3SpS/logical-induction-for-software-engineers) Alex Flint |     |
| 109 | [Call For Distillers](/posts/zo9zKcz47JxDErFzQ/call-for-distillers) johnswentworth |     |
| 110 | [Fiber arts, mysterious dodecahedrons, and waiting on “Eureka!”](/posts/FfPukic3Qskd9ZAkk/fiber-arts-mysterious-dodecahedrons-and-waiting-on-eureka) eukaryote |     |
| 111 | [A Longlist of Theories of Impact for Interpretability](/posts/uK6sQCNMw8WKzJeCQ/a-longlist-of-theories-of-impact-for-interpretability) Neel Nanda |     |
| 112 | [On A List of Lethalities](/posts/LLRtjkvh9AackwuNB/on-a-list-of-lethalities) Zvi |     |
| 113 | [LOVE in a simbox is all you need](/posts/WKGZBCYAbZ6WGsKHc/love-in-a-simbox-is-all-you-need) jacob_cannell |     |
| 114 | [A transparency and interpretability tech tree](/posts/nbq2bWLcYmSGup9aF/a-transparency-and-interpretability-tech-tree) evhub |     |
| 115 | [DeepMind alignment team opinions on AGI ruin arguments](/posts/qJgz2YapqpFEDTLKn/deepmind-alignment-team-opinions-on-agi-ruin-arguments) Vika |     |
| 116 | [Contra shard theory, in the context of the diamond maximizer problem](/posts/Aet2mbnK7GDDfrEQu/contra-shard-theory-in-the-context-of-the-diamond-maximizer) So8res |     |
| 117 | [On infinite ethics](/posts/5iZTwGHv2tNfFmeDa/on-infinite-ethics) Joe Carlsmith |     |
| 118 | [Wisdom Cannot Be Unzipped](/posts/zHBMY273suDnMqNLq/wisdom-cannot-be-unzipped) Sable |     |
| 119 | [Different perspectives on concept extrapolation](/posts/j9vCEjRFDwmH8FTKH/different-perspectives-on-concept-extrapolation) Stuart_Armstrong |     |
| 120 | [Utilitarianism Meets Egalitarianism](/posts/hTMFt3h7QqA2qecn7/utilitarianism-meets-egalitarianism) Scott Garrabrant |     |
| 121 | [The ignorance of normative realism bot](/posts/NpwPi5HkKpcAvexJz/the-ignorance-of-normative-realism-bot) Joe Carlsmith |     |
| 122 | [Shah and Yudkowsky on alignment failures](/posts/tcCxPLBrEXdxN5HCQ/shah-and-yudkowsky-on-alignment-failures) Rohin Shah |     |
| 123 | [Nuclear Energy - Good but not the silver bullet we were hoping for](/posts/aJm9Ff2GfMbzDLCWM/nuclear-energy-good-but-not-the-silver-bullet-we-were-hoping) Marius Hobbhahn |     |
| 124 | [Patient Observation](/posts/sAiHxHkQrsYsRpKFP/patient-observation) LoganStrohl |     |
| 125 | [Monks of Magnitude](/posts/pHHaNkG8xDcaq5DJF/monks-of-magnitude) \\[DEACTIVATED\\] Duncan Sabien |     |
| 126 | [AI coordination needs clear wins](/posts/vavnqwYbc8jMu3dTY/ai-coordination-needs-clear-wins) evhub |     |
| 127 | [Actually, All Nuclear Famine Papers are Bunk](/posts/jnDibtfvWNHLucf4D/actually-all-nuclear-famine-papers-are-bunk) Lao Mein |     |
| 128 | [New Frontiers in Mojibake](/posts/wBH4APSRictfuhq8z/new-frontiers-in-mojibake) Adam Scherlis |     |
| 129 | [My take on Jacob Cannell’s take on AGI safety](/posts/hsf7tQgjTZfHjiExn/my-take-on-jacob-cannell-s-take-on-agi-safety) Steven Byrnes |     |
| 130 | [Introducing Pastcasting: A tool for forecasting practice](/posts/FuGHKKMcAL2GYbxrn/introducing-pastcasting-a-tool-for-forecasting-practice) Sage Future |     |
| 131 | [K-complexity is silly; use cross-entropy instead](/posts/KcvJXhKqx4itFNWty/k-complexity-is-silly-use-cross-entropy-instead) So8res |     |
| 132 | [Beware boasting about non-existent forecasting track records](/posts/ZEgQGAjQm5rTAnGuM/beware-boasting-about-non-existent-forecasting-track-records) Jotto999 |     |
| 133 | [Clarifying AI X-risk](/posts/GctJD5oCDRxCspEaZ/clarifying-ai-x-risk) zac_kenton |     |
| 134 | [Narrative Syncing](/posts/iprqfLaDLCGoJFeiZ/narrative-syncing) AnnaSalamon |     |
| 135 | [publishing alignment research and exfohazards](/posts/nLpertJnQptmBhiAv/publishing-alignment-research-and-exfohazards) Tamsin Leake |     |
| 136 | [Deontology and virtue ethics as "effective theories" of consequentialist ethics](/posts/JvXNCc6w58iHTYHuz/deontology-and-virtue-ethics-as-effective-theories-of) Jan_Kulveit |     |
| 137 | [Range and Forecasting Accuracy](/posts/MquvZCGWyYinsN49c/range-and-forecasting-accuracy) niplav |     |
| 138 | [Trends in GPU price-performance](/posts/c6KFvQcZggQKZzxr9/trends-in-gpu-price-performance) Marius Hobbhahn |     |
| 139 | [How To Observe Abstract Objects](/posts/EgPE2xxKGYqkPfpnz/how-to-observe-abstract-objects) LoganStrohl |     |
| 140 | [Criticism of EA Criticism Contest](/posts/pohTfSGsNQZYbGpCy/criticism-of-ea-criticism-contest) Zvi |     |
| 141 | [Takeaways from our robust injury classifier project \\[Redwood Research\\]](/posts/n3LAgnHg6ashQK3fF/takeaways-from-our-robust-injury-classifier-project-redwood) dmz |     |
| 142 | [Bad at Arithmetic, Promising at Math](/posts/qy5dF7bQcFjSKaW58/bad-at-arithmetic-promising-at-math) cohenmacaulay |     |
| 143 | [Don't use 'infohazard' for collectively destructive info](/posts/yET7wbjjJZtpz6NF3/don-t-use-infohazard-for-collectively-destructive-info) Eliezer Yudkowsky |     |
| 144 | [Conditions for mathematical equivalence of Stochastic Gradient Descent and Natural Selection](/posts/5XbBm6gkuSdMJy9DT/conditions-for-mathematical-equivalence-of-stochastic) Oliver Sourbut |     |
| 145 | [Human values & biases are inaccessible to the genome](/posts/CQAMdzA4MZEhNRtTp/human-values-and-biases-are-inaccessible-to-the-genome) TurnTrout |     |
| 146 | [I learn better when I frame learning as Vengeance for losses incurred through ignorance, and you might too](/posts/YRzFcubbrvuhb9rtk/i-learn-better-when-i-frame-learning-as-vengeance-for-losses) chaosmage |     |
| 147 | [Jailbreaking ChatGPT on Release Day](/posts/RYcoJdvmoBbi5Nax7/jailbreaking-chatgpt-on-release-day) Zvi |     |
| 148 | [Open technical problem: A Quinean proof of Löb's theorem, for an easier cartoon guide](/posts/rrpnEDpLPxsmmsLzs/open-technical-problem-a-quinean-proof-of-loeb-s-theorem-for) Andrew_Critch |     |
| 149 | [Review: Amusing Ourselves to Death](/posts/Pix8haJTbkuxPtxpb/review-amusing-ourselves-to-death) L Rudolf L |     |
| 150 | [QNR prospects are important for AI alignment research](/posts/FKE6cAzQxEK4QH9fC/qnr-prospects-are-important-for-ai-alignment-research) Eric Drexler |     |
| 151 | [Disagreement with bio anchors that lead to shorter timelines](/posts/Q3fesop6HKnemJ5Jc/disagreement-with-bio-anchors-that-lead-to-shorter-timelines) Marius Hobbhahn |     |
| 152 | [Why all the fuss about recursive self-improvement?](/posts/8NKu9WES7KeKRWEKK/why-all-the-fuss-about-recursive-self-improvement) So8res |     |
| 153 | [LessWrong Has Agree/Disagree Voting On All New Comment Threads](/posts/HALKHS4pMbfghxsjD/lesswrong-has-agree-disagree-voting-on-all-new-comment) Ben Pace |     |
| 154 | [Opening Session Tips & Advice](/posts/gKeHcikcXA3bApyoM/opening-session-tips-and-advice) CFAR!Duncan |     |
| 155 | [Searching for Search](/posts/FDjTgDcGPc7B98AES/searching-for-search-4) NicholasKees |     |
| 156 | [Refining the Sharp Left Turn threat model, part 1: claims and mechanisms](/posts/usKXS5jGDzjwqv3FJ/refining-the-sharp-left-turn-threat-model-part-1-claims-and) Vika |     |
| 157 | [Takeaways from a survey on AI alignment resources](/posts/rXSBvSKvKdaNkhLeJ/takeaways-from-a-survey-on-ai-alignment-resources) DanielFilan |     |
| 158 | [Trying to disambiguate different questions about whether RLHF is “good”](/posts/NG6FrXgmqPd5Wn3mh/trying-to-disambiguate-different-questions-about-whether) Buck |     |
| 159 | [Benign Boundary Violations](/posts/T6kzsMDJyKwxLGe3r/benign-boundary-violations) \\[DEACTIVATED\\] Duncan Sabien |     |
| 160 | [How To: A Workshop (or anything)](/posts/WotMLgX9hHXzBxKCB/how-to-a-workshop-or-anything) \\[DEACTIVATED\\] Duncan Sabien |     |