# 2018 Review: Voting Results!

The votes are in!

59 of the 430 eligible voters participated, evaluating 75 posts. Meanwhile, 39 users submitted a total of 120 reviews, with most posts getting at least one review. 

Thanks a ton to everyone who put in time to think about the posts - nominators, reviewers and voters alike. Several reviews substantially changed my mind about many topics and ideas, and I was quite grateful for the authors participating in the process. I'll mention [Zack\_M\_Davis](https://www.lesswrong.com/users/zack_m_davis/reviews), [Vanessa Kosoy](https://www.lesswrong.com/users/vanessa-kosoy/reviews), and [Daniel Filan](https://www.lesswrong.com/users/danielfilan/reviews) as great people who wrote the most upvoted reviews.

In the coming months, the LessWrong team will write further analyses of the vote data, and use the information to form a sequence and a book of the best writing on LessWrong from 2018.

Below are the results of the vote, followed by a discussion of how reliable the result is and plans for the future.

Top 15 posts
------------

1.  [Embedded Agents](https://www.lesswrong.com/posts/p7x32SEt43ZMC9r7r/embedded-agents) by Abram Demski and Scott Garrabrant
2.  [The Rocket Alignment Problem](https://www.lesswrong.com/posts/Gg9a4y8reWKtLe3Tn/the-rocket-alignment-problem) by Eliezer Yudkowsky
3.  [Local Validity as a Key to Sanity and Civilization](https://www.lesswrong.com/posts/WQFioaudEH8R7fyhm/local-validity-as-a-key-to-sanity-and-civilization) by Eliezer Yudkowsky
4.  [Arguments about fast takeoff](https://www.lesswrong.com/posts/AfGmsjGPXN97kNp57/arguments-about-fast-takeoff) by Paul Christiano
5.  [The Costly Coordination Mechanism of Common Knowledge](https://www.lesswrong.com/posts/9QxnfMYccz9QRgZ5z/the-costly-coordination-mechanism-of-common-knowledge) by Ben Pace
6.  [Toward a New Technical Explanation of Technical Explanation](https://www.lesswrong.com/posts/tKwJQbo6SfWF2ifKh/toward-a-new-technical-explanation-of-technical-explanation) by Abram Demski
7.  [Anti-social Punishment](https://www.lesswrong.com/posts/X5RyaEDHNq5qutSHK/anti-social-punishment) by Martin Sustrik
8.  [The Tails Coming Apart As Metaphor For Life](https://www.lesswrong.com/posts/asmZvCPHcB4SkSCMW/the-tails-coming-apart-as-metaphor-for-life) by Scott Alexander
9.  [Babble](https://www.lesswrong.com/posts/i42Dfoh4HtsCAfXxL/babble) by alkjash
10.  [The Loudest Alarm Is Probably False](https://www.lesswrong.com/posts/B2CfMNfay2P8f2yyc/the-loudest-alarm-is-probably-false) by orthonormal
11.  [The Intelligent Social Web](https://www.lesswrong.com/posts/AqbWna2S85pFTsHH4) by Valentine
12.  [Prediction Markets: When Do They Work?](https://www.lesswrong.com/posts/a4jRN9nbD79PAhWTB) by Zvi
13.  [Coherence arguments do not imply goal-directed behavior](https://www.lesswrong.com/posts/NxF5G6CJiof6cemTw) by Rohin Shah
14.  [Is Science Slowing Down?](https://www.lesswrong.com/posts/v7c47vjta3mavY3QC) by Scott Alexander
15.  [A voting theory primer for rationalists](https://www.lesswrong.com/posts/D6trAzh6DApKPhbv4) by Jameson Quinn and [Robustness to Scale](https://www.lesswrong.com/posts/bBdfbWfWxHN9Chjcq) by Scott Garrabrant

Top 15 posts not about AI
-------------------------

1.  [Local Validity as a Key to Sanity and Civilization](https://www.lesswrong.com/posts/WQFioaudEH8R7fyhm/local-validity-as-a-key-to-sanity-and-civilization) by Eliezer Yudkowsky
2.  [The Costly Coordination Mechanism of Common Knowledge](https://www.lesswrong.com/posts/9QxnfMYccz9QRgZ5z/the-costly-coordination-mechanism-of-common-knowledge) by Ben Pace
3.  [Anti-social Punishment](https://www.lesswrong.com/posts/X5RyaEDHNq5qutSHK/anti-social-punishment) by Martin Sustrik
4.  [The Tails Coming Apart As Metaphor For Life](https://www.lesswrong.com/posts/asmZvCPHcB4SkSCMW/the-tails-coming-apart-as-metaphor-for-life) by Scott Alexander
5.  [Babble](https://www.lesswrong.com/posts/i42Dfoh4HtsCAfXxL/babble) by alkjash
6.  [The Loudest Alarm Is Probably False](https://www.lesswrong.com/posts/B2CfMNfay2P8f2yyc/the-loudest-alarm-is-probably-false) by Orthonormal
7.  [The Intelligent Social Web](https://www.lesswrong.com/posts/AqbWna2S85pFTsHH4/the-intelligent-social-web) by Valentine
8.  [Prediction Markets: When Do They Work?](https://www.lesswrong.com/posts/a4jRN9nbD79PAhWTB/prediction-markets-when-do-they-work) by Zvi
9.  [Is Science Slowing Down?](https://www.lesswrong.com/posts/v7c47vjta3mavY3QC/is-science-slowing-down) by Scott Alexander
10.  [A voting theory primer for rationalists](https://www.lesswrong.com/posts/D6trAzh6DApKPhbv4/a-voting-theory-primer-for-rationalists) by Jameson Quinn
11.  [Toolbox-thinking and Law-thinking](https://www.lesswrong.com/posts/CPP2uLcaywEokFKQG) by Eliezer Yudkowsky
12.  [A Sketch of Good Communication](https://www.lesswrong.com/posts/yeADMcScw8EW9yxpH) by Ben Pace
13.  [A LessWrong Crypto Autopsy](https://www.lesswrong.com/posts/MajyZJrsf8fAywWgY) by Scott Alexander
14.  [Unrolling social metacognition: Three levels of meta are not enough.](https://www.lesswrong.com/posts/K4eDzqS2rbcBDsCLZ) by Academian
15.  [Varieties Of Argumentative Experience](https://www.lesswrong.com/posts/NLBbCQeNLFvBJJkrt) by Scott Alexander

Top 10 posts about AI
---------------------

(The vote included 20 posts about AI.)

1.  [Embedded Agents](https://www.lesswrong.com/posts/p7x32SEt43ZMC9r7r/embedded-agents) by Abram Demski and Scott Garrabrant
2.  [The Rocket Alignment Problem](https://www.lesswrong.com/posts/Gg9a4y8reWKtLe3Tn/the-rocket-alignment-problem) by Eliezer Yudkowsky
3.  [Arguments about fast takeoff](https://www.lesswrong.com/posts/AfGmsjGPXN97kNp57/arguments-about-fast-takeoff) by Paul Christiano
4.  [Toward a New Technical Explanation of Technical Explanation](https://www.lesswrong.com/posts/tKwJQbo6SfWF2ifKh/toward-a-new-technical-explanation-of-technical-explanation) by Abram Demski
5.  [Coherence arguments do not imply goal-directed behavior](https://www.lesswrong.com/posts/NxF5G6CJiof6cemTw/coherence-arguments-do-not-imply-goal-directed-behavior) by Rohin Shah
6.  [Robustness to Scale](https://www.lesswrong.com/posts/bBdfbWfWxHN9Chjcq/robustness-to-scale) by Scott Garrabrant
7.  [Paul's research agenda FAQ](https://www.lesswrong.com/posts/Djs38EWYZG8o7JMWY/paul-s-research-agenda-faq) by zhukeepa
8.  [An Untrollable Mathematician Illustrated](https://www.lesswrong.com/posts/CvKnhXTu9BPcdKE4W/an-untrollable-mathematician-illustrated) by Abram Demski
9.  [Specification gaming examples in AI](https://www.lesswrong.com/posts/AanbbjYr5zckMKde7/specification-gaming-examples-in-ai) by Vika
10.  [2018 AI Alignment Literature Review and Charity Comparison](https://www.lesswrong.com/posts/a72owS5hz3acBK5xc/2018-ai-alignment-literature-review-and-charity-comparison) by Larks

The Complete Results
====================

[**Click Here If You Would Like A More Comprehensive Vote Data Spreadsheet**](https://docs.google.com/spreadsheets/d/1X4IKe2POOyYCb3hULxCPDoi90yKXNWLrTdsfKZwVNeQ/edit#gid=769331654)

To help users see the spread of the vote data, we've included [*swarmplot*](https://seaborn.pydata.org/generated/seaborn.swarmplot.html)  visualizations.

*   For space reasons, only votes with weights between -10 and 16 are plotted. This covers 99.4% of votes.
*   Gridlines are spaced 2 points apart.
*   Concrete illustration: The plot immediately below has 18 votes ranging in strength from -3 to 12.

![](https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/85917114bb57b0c2634f991d39720a8b4d146601976e6afc.png)

| **#** | **Post Title** | ** Total ** | ** Vote Spread ** |
| --- | --- | --- | --- |
| **1** | [**Embedded Agents**](https://www.lesswrong.com/posts/p7x32SEt43ZMC9r7r) | 209 | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_p7x32SEt43ZMC9r7r.png) (One outlier vote of +17 is not shown) |
| **2** | [**The Rocket Alignment Problem**](https://www.lesswrong.com/posts/Gg9a4y8reWKtLe3Tn) | 183 | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_Gg9a4y8reWKtLe3Tn.png) |
| **3** | [**Local Validity as a Key to Sanity and Civilization**](https://www.lesswrong.com/posts/WQFioaudEH8R7fyhm) | 133 | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_WQFioaudEH8R7fyhm.png) |
| **4** | [**Arguments about fast takeoff**](https://www.lesswrong.com/posts/AfGmsjGPXN97kNp57) | 98  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_AfGmsjGPXN97kNp57.png) |
| **5** | [**The Costly Coordination Mechanism of Common Knowledge**](https://www.lesswrong.com/posts/9QxnfMYccz9QRgZ5z) | 95  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_9QxnfMYccz9QRgZ5z.png) |
| **6** | [**Toward a New Technical Explanation of Technical Explanation**](https://www.lesswrong.com/posts/tKwJQbo6SfWF2ifKh) | 91  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_tKwJQbo6SfWF2ifKh.png) |
| **7** | [**Anti-social Punishment**](https://www.lesswrong.com/posts/X5RyaEDHNq5qutSHK) | 90  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_X5RyaEDHNq5qutSHK.png) (One outlier vote of +20 is not shown) |
| **8** | [**The Tails Coming Apart As Metaphor For Life**](https://www.lesswrong.com/posts/asmZvCPHcB4SkSCMW) | 89  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_asmZvCPHcB4SkSCMW.png) |
| **9** | [**Babble**](https://www.lesswrong.com/posts/i42Dfoh4HtsCAfXxL) | 85  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_i42Dfoh4HtsCAfXxL.png) |
| **10** | [**The Loudest Alarm Is **](https://www.lesswrong.com/posts/B2CfMNfay2P8f2yyc) [**Probably False**](https://www.lesswrong.com/posts/B2CfMNfay2P8f2yyc) | 84  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_B2CfMNfay2P8f2yyc.png) |
| **11** | [**The Intelligent Social Web**](https://www.lesswrong.com/posts/AqbWna2S85pFTsHH4) | 79  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_AqbWna2S85pFTsHH4.png) |
| **12** | [**Prediction Markets: **](https://www.lesswrong.com/posts/a4jRN9nbD79PAhWTB) [**When Do They Work?**](https://www.lesswrong.com/posts/a4jRN9nbD79PAhWTB) | 77  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_a4jRN9nbD79PAhWTB.png) |
| **13** | [**Coherence arguments do not imply goal-directed behavior**](https://www.lesswrong.com/posts/NxF5G6CJiof6cemTw) | 76  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_NxF5G6CJiof6cemTw.png) |
| **14** | [**Is Science Slowing Down?**](https://www.lesswrong.com/posts/v7c47vjta3mavY3QC) | 75  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_v7c47vjta3mavY3QC.png) |
| **15** | [**Robustness to Scale**](https://www.lesswrong.com/posts/bBdfbWfWxHN9Chjcq) | 74  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_bBdfbWfWxHN9Chjcq.png) |
| **15** | [**A voting theory primer for rationalists**](https://www.lesswrong.com/posts/D6trAzh6DApKPhbv4) | 74  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_D6trAzh6DApKPhbv4.png) |
| **17** | [**Toolbox-thinking and Law-thinking**](https://www.lesswrong.com/posts/CPP2uLcaywEokFKQG) | 73  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_CPP2uLcaywEokFKQG.png) |
| **18** | [**A Sketch of Good Communication**](https://www.lesswrong.com/posts/yeADMcScw8EW9yxpH) | 72  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_yeADMcScw8EW9yxpH.png) |
| **19** | [**A LessWrong Crypto Autopsy**](https://www.lesswrong.com/posts/MajyZJrsf8fAywWgY) | 71  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_MajyZJrsf8fAywWgY.png) |
| **20** | [**Paul's research agenda FAQ**](https://www.lesswrong.com/posts/Djs38EWYZG8o7JMWY) | 70  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_Djs38EWYZG8o7JMWY.png) |
| **21** | [**Unrolling social metacognition: Three levels of meta are not enough.**](https://www.lesswrong.com/posts/K4eDzqS2rbcBDsCLZ) | 69  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_K4eDzqS2rbcBDsCLZ.png) |
| **22** | [**An Untrollable Mathematician Illustrated**](https://www.lesswrong.com/posts/CvKnhXTu9BPcdKE4W) | 65  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_CvKnhXTu9BPcdKE4W.png) |
| **23** | [**Specification gaming **](https://www.lesswrong.com/posts/AanbbjYr5zckMKde7) [**examples in AI**](https://www.lesswrong.com/posts/AanbbjYr5zckMKde7) | 64  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_AJtfNyBsum6ZzWxKR.png) |
| **23** | [**Will AI See Sudden Progress?**](https://www.lesswrong.com/posts/AJtfNyBsum6ZzWxKR) | 64  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_NLBbCQeNLFvBJJkrt.png) |
| **23** | [**Varieties Of Argumentative Experience**](https://www.lesswrong.com/posts/NLBbCQeNLFvBJJkrt) | 64  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_AanbbjYr5zckMKde7.png) |
| **26** | [**Meta-Honesty: Firming Up Honesty Around Its Edge-Cases**](https://www.lesswrong.com/posts/xdwbX9pFEr7Pomaxv) | 62  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_xdwbX9pFEr7Pomaxv.png) |
| **27** | [**My attempt to explain **](https://www.lesswrong.com/posts/mELQFMi9egPn5EAjK) [**Looking, insight meditation, **](https://www.lesswrong.com/posts/mELQFMi9egPn5EAjK) [**and enlightenment in **](https://www.lesswrong.com/posts/mELQFMi9egPn5EAjK) [**non-mysterious terms**](https://www.lesswrong.com/posts/mELQFMi9egPn5EAjK) | 60  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_mELQFMi9egPn5EAjK.png) |
| **27** | [**Naming the Nameless**](https://www.lesswrong.com/posts/4ZwGqkMTyAvANYEDw) | 60  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_4ZwGqkMTyAvANYEDw.png) |
| **27** | [**Inadequate Equilibria vs. Governance of the Commons**](https://www.lesswrong.com/posts/2G8j8D5auZKKAjSfY) | 60  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_2G8j8D5auZKKAjSfY.png) |
| **30** | [**2018 AI Alignment Literature Review and Charity Comparison**](https://www.lesswrong.com/posts/a72owS5hz3acBK5xc) | 57  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_a72owS5hz3acBK5xc.png) |
| **31** | [**Noticing the Taste of Lotus**](https://www.lesswrong.com/posts/KwdcMts8P8hacqwrX) | 55  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_KwdcMts8P8hacqwrX.png) |
| **31** | [**On Doing the Improbable**](https://www.lesswrong.com/posts/st7DiQP23YQSxumCt) | 55  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_st7DiQP23YQSxumCt.png) |
| **31** | [**The Pavlov Strategy**](https://www.lesswrong.com/posts/3rxMBRCYEmHCNDLhu) | 55  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_3rxMBRCYEmHCNDLhu.png) |
| **31** | [**Being a Robust, Coherent Agent (V2)**](https://www.lesswrong.com/posts/2jfiMgKkh7qw9z8Do) | 55  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_2jfiMgKkh7qw9z8Do.png) |
| **35** | [**Spaghetti Towers**](https://www.lesswrong.com/posts/NQgWL7tvAPgN2LTLn) | 54  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_NQgWL7tvAPgN2LTLn.png) |
| **36** | [**Beyond Astronomical Waste**](https://www.lesswrong.com/posts/Qz6w4GYZpgeDp6ATB) | 51  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_Qz6w4GYZpgeDp6ATB.png) |
| **36** | [**Research: Rescuers during the Holocaust**](https://www.lesswrong.com/posts/BhXA6pvAbsFz3gvn4) | 51  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_BhXA6pvAbsFz3gvn4.png) |
| **38** | [**Open question: are minimal circuits daemon-free?**](https://www.lesswrong.com/posts/nyCHnY7T5PHPLjxmN) | 48  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_nyCHnY7T5PHPLjxmN.png) |
| **38** | [**Decoupling vs Contextualising Norms**](https://www.lesswrong.com/posts/7cAsBPGh98pGyrhz9) | 48  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_7cAsBPGh98pGyrhz9.png) (One outlier vote of +23) |
| **40** | [**On the Loss and Preservation of Knowledge**](https://www.lesswrong.com/posts/nnNdz7XQrd5bWTgoP) | 47  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_nnNdz7XQrd5bWTgoP.png) |
| **41** | [**Is Clickbait Destroying Our General Intelligence?**](https://www.lesswrong.com/posts/YicoiQurNBxSp7a65) | 46  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_YicoiQurNBxSp7a65.png) |
| **42** | [**What makes people intellectually active?**](https://www.lesswrong.com/posts/XYYyzgyuRH5rFN64K) | 43  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_XYYyzgyuRH5rFN64K.png) |
| **43** | [**Why everything might have taken so long**](https://www.lesswrong.com/posts/yxTP9FckrwoMjxPc4) | 40  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_yxTP9FckrwoMjxPc4.png) |
| **44** | [**Challenges to Christiano’s capability amplification proposal**](https://www.lesswrong.com/posts/S7csET9CgBtpi7sCh) | 39  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_S7csET9CgBtpi7sCh.png) |
| **45** | [**Public Positions and Private Guts**](https://www.lesswrong.com/posts/Zbf2L4ZJf4ykZqmPA) | 38  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_Zbf2L4ZJf4ykZqmPA.png) |
| **46** | [**Clarifying "AI Alignment"**](https://www.lesswrong.com/posts/ZeE7EKHTFMBs8eMxn) | 36  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_H7Rs8HqrwBDque8Ru.png) |
| **46** | [**Expressive Vocabulary**](https://www.lesswrong.com/posts/H7Rs8HqrwBDque8Ru) | 36  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_ZeE7EKHTFMBs8eMxn.png) |
| **48** | [**Bottle Caps Aren't Optimisers**](https://www.lesswrong.com/posts/26eupx3Byc8swRS7f) | 34  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_26eupx3Byc8swRS7f.png) |
| **49** | [**Argue Politics* With Your Best Friends**](https://www.lesswrong.com/posts/n4ukoQzkgbAqpzqb5) | 32  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_n4ukoQzkgbAqpzqb5.png) |
| **50** | [**Player vs. Character: A Two-Level Model of Ethics**](https://www.lesswrong.com/posts/fyGEP4mrpyWEAfyqj) | 30  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_fyGEP4mrpyWEAfyqj.png) |
| **51** | [**Conversational Cultures: Combat vs Nurture (V2)**](https://www.lesswrong.com/posts/ExssKjAaXEEYcnzPd) | 29  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_ExssKjAaXEEYcnzPd.png) |
| **51** | [**Act of Charity**](https://www.lesswrong.com/posts/rwjv8bZfSuE9ZAigH) | 29  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_rwjv8bZfSuE9ZAigH.png) |
| **53** | [**Optimization Amplifies**](https://www.lesswrong.com/posts/zEvqFtT4AtTztfYC4) | 27  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_zEvqFtT4AtTztfYC4.png) |
| **53** | [**Circling**](https://www.lesswrong.com/posts/aFyWFwGWBsP5DZbHF) | 27  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_aFyWFwGWBsP5DZbHF.png) (One outlier vote of -17) |
| **55** | [**Realism about rationality**](https://www.lesswrong.com/posts/suxvE2ddnYMPJN9HD) | 25  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_suxvE2ddnYMPJN9HD.png) (Two outliers of -30 and +18) |
| **55** | [**Caring less**](https://www.lesswrong.com/posts/dPLSxceMtnQN2mCxL) | 25  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_dPLSxceMtnQN2mCxL.png) |
| **57** | [**Lessons from the Cold War on Information Hazards: Why Internal Communication is Critical**](https://www.lesswrong.com/posts/k8qLzbHTubMjCHL2E) | 24  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_k8qLzbHTubMjCHL2E.png) |
| **57** | [**The Bat and Ball Problem Revisited**](https://www.lesswrong.com/posts/vk2yS8osapSch9Cz2) | 24  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_vk2yS8osapSch9Cz2.png) |
| **59** | [**Argument, intuition, and recursion**](https://www.lesswrong.com/posts/XHMCvvhb7zTZcQAgA) | 21  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_XHMCvvhb7zTZcQAgA.png) |
| **59** | [**Unknown Knowns**](https://www.lesswrong.com/posts/7w2tCRocphK9yW8rG) | 21  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_7w2tCRocphK9yW8rG.png) |
| **61** | [**Competitive Markets as Distributed Backprop**](https://www.lesswrong.com/posts/brhWPoNsBN7za3xjs) | 18  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_brhWPoNsBN7za3xjs.png) |
| **62** | [**Towards a New Impact Measure**](https://www.lesswrong.com/posts/yEa7kwoMpsBgaBCgb) | 14  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_PqbDgCtyRPYkYwHsm.png) |
| **62** | [**Explicit and Implicit Communication**](https://www.lesswrong.com/posts/PqbDgCtyRPYkYwHsm) | 14  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_sWof2zGexwwJ8Q4ND.png) |
| **62** | [**On the Chatham House Rule**](https://www.lesswrong.com/posts/sWof2zGexwwJ8Q4ND) | 14  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_tj8QP2EFdP8p54z6i.png) |
| **62** | [**Historical mathematicians exhibit a birth order effect too**](https://www.lesswrong.com/posts/tj8QP2EFdP8p54z6i) | 14  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_yEa7kwoMpsBgaBCgb.png) |
| **66** | [**Everything I ever needed to know, I learned from World of Warcraft: Goodhart’s law**](https://www.lesswrong.com/posts/GxW8ef8tH4yX6KMrf) | 13  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_GxW8ef8tH4yX6KMrf.png) |
| **67** | [**The funnel of human experience**](https://www.lesswrong.com/posts/SwBEJapZNzWFifLN6) | 11  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_SwBEJapZNzWFifLN6.png) |
| **68** | [**Understanding is translation**](https://www.lesswrong.com/posts/MRqnYuCFHW46JPJag) | 9   | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_MRqnYuCFHW46JPJag.png) |
| **69** | [**Preliminary thoughts on **](https://www.lesswrong.com/posts/2jTQTxYNwo6zb3Kyp) [**moral weight**](https://www.lesswrong.com/posts/2jTQTxYNwo6zb3Kyp) | 7   | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_2jTQTxYNwo6zb3Kyp.png) |
| **70** | [**Metaphilosophical competence can't be disentangled from alignment**](https://www.lesswrong.com/posts/CCgvJHpbvc7Lm8ZS8) | 3   | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_CCgvJHpbvc7Lm8ZS8.png) |
| **71** | [**Two types of mathematician**](https://www.lesswrong.com/posts/5QnvHZpy4pGgCo3Pp) | 2   | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_5QnvHZpy4pGgCo3Pp.png) |
| **72** | [**How did academia ensure papers were correct in the early 20th Century?**](https://www.lesswrong.com/posts/LYQW9B2YgvegWqjXB) | -2  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_LYQW9B2YgvegWqjXB.png) |
| **73** | [**Birth order effect found in Nobel Laureates in Physics**](https://www.lesswrong.com/posts/QTLTic5nZ2DaBtoCv) | -5  | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_QTLTic5nZ2DaBtoCv.png) |
| **74** | [**Give praise**](https://www.lesswrong.com/posts/fg7pqjiKfqLsErAfq) | -10 | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_fg7pqjiKfqLsErAfq.png) |
| **75** | [**Affordance Widths**](https://www.lesswrong.com/posts/5zSbwSDgefTvmWzHZ) | -142 | ![](https://res.cloudinary.com/lesswrong-2-0/image/upload/c_crop,g_center,w_285,x_4,y_0/v1579736222/2018_view_vote_result_visualizations/vote_visualization_5zSbwSDgefTvmWzHZ.png) (One outlier of -29) |

How reliable is the output of this vote?
========================================

For most posts, between 10-20 people voted on them (median of 17). A change by 10-15 in a post's score is enough to move a post up or down around 10 positions within the rankings. This is equal to a few moderate strength votes from two or three people, or an exceedingly strong vote from a single strongly-feeling voter. This means that the system is somewhat noisy, though it seems to me very unlikely that posts at the very top could end up placed much differently. 

The vote was also affected by two technical mistakes the team made:

1.  *The post-order was not randomized.* For the first half of the voting period, the posts on the voting page appeared in order of number of nominations (least to most) instead of appearing randomly, thereby giving more visual attention to the first ~15 or so posts (these were posts with 2 nominations). Ruby looked into it and says that 15-30% more people cast votes on these earlier-appearing posts compared to those appearing elsewhere in the list. [*Thanks to gjm for identifying this issue*](https://www.lesswrong.com/posts/zLhSjwXHnTg9QBzqH/voting-phase-of-2018-lw-review-deadline-sun-19th-jan?commentId=svDTYH5T7pKwimMdD)*.*
2.  *Users were given some free negative votes.* When calculating the cost of users' votes, we used a simple equation, but missed that it produced an off-by-one error for negative numbers. Essentially, users got a free 1-negative-vote-weight on all the posts to which they had voted on negatively. To correct for this, for those who had exceeded their budget - 18 users in total - we reduced the strength of their negative votes by a single unit, and for those who had not spent all their points their votes were unaffected. This didn't affect the rank-ordering very much, a few posts changed by 1 position, and a smaller number changed by 2-3 positions.

The effect size of these errors is not certain since it's hard to know how people would have voted counterfactually. My sense is that the effect is pretty small, and that the majority of noise in the system comes from elsewhere.

Finally, we discarded exactly one ballot, which spent 10,000 points on voting instead of the allotted 500. Had a user gone over by a small amount e.g. 1-50 points, we had planned to scale their votes down to fit the budget. However when someone's allocation was so extreme, we were honestly unsure what adjustment to their votes they would have wanted, as if their points had been normalised down to 500, the majority of their votes would have been adjusted to zero. (This decision was made without knowing the user who cast the ballot or which posts were affected.)

Overall, I think the vote is a good indicator to about 10 places within the rankings, but, for example, I wouldn't agonise over whether a post is at position #42 vs #43.

The Future
==========

This has been the first LessWrong Annual Review. This project was started with the vision of creating a piece of infrastructure that would:

1.  Create common knowledge about how the LessWrong community feels about various posts and topics and the progress we've made.
2.  Improve our longterm incentives, feedback, and rewards for authors.
3.  Help create a highly curated "Best of 2018" Sequence and Book.

The vote reveals much disagreement between LessWrongers. Every post has at least five positive votes and every post had at least one negative vote – except for [An Untrollable Mathematician Illustrated](https://www.lesswrong.com/posts/CvKnhXTu9BPcdKE4W/an-untrollable-mathematician-illustrated) by Abram Demski, which was evidently just too likeable – and many people had strongly different feelings about many posts. Many of these seem more interesting to me than the specific ranking of the given post.

In total, users wrote 207 nominations and 120 reviews, and many authors updated their posts with new thinking, or clearer explanations, showing that both readers and authors reflected a lot (and I think changed their mind a lot) during the review period. I think all of this is great, and like the idea of us having a Schelling time in the year for this sort of thinking.

Speaking for myself, this has been a fascinating and successful experiment - I've learned a lot. My thanks to Ray for pushing me and the rest of the team to actually do it this year, in a move-fast-and-break-things kind of way. The team will be conducting a *Review of the Review* where we take stock of what happened, discuss the value and costs of the Review process, and think about how to make the review process more effective and efficient in future years.

In the coming months, the LessWrong team will write further analyses of the vote data, award prizes to authors and reviewers, and use the vote to help design a sequence and a book of the best writing on LW from 2018. 

I think it's awesome that we can do things like this, and I was honestly surprised by the level of community participation. Thanks to everyone who helped out in the LessWrong 2018 Review - everyone who nominated, reviewed, voted and wrote the posts.