# Superintelligence reading group

In just over two weeks I will be running an online reading group on Nick Bostrom's _[Superintelligence](http://en.wikipedia.org/wiki/Superintelligence)_, on behalf of [MIRI](http://intelligence.org/). It will be here on LessWrong. This is an advance warning, so you can [get a copy](http://api.viglink.com/api/click?format=go&jsonp=vglnk_jsonp_14094970392396&key=9f37ca02a1e3cbd4f3d0a3618a39fbca&libId=eba361d5-f623-4b32-ba74-e1dc943c603d&loc=http%3A%2F%2Flesswrong.com%2Fuser%2FKatjaGrace%2Foverview%2F&v=1&out=http%3A%2F%2Fwww.amazon.com%2FSuperintelligence-Dangers-Strategies-Nick-Bostrom%2Fdp%2F0199678111&ref=http%3A%2F%2Flesswrong.com%2F&title=Overview%20for%20KatjaGrace%20-%20Less%20Wrong&txt=Superintelligence) and get ready for some stimulating discussion. MIRI's [post](http://intelligence.org/2014/08/31/superintelligence-reading-group/), appended below, gives the details.

**Added:** At the bottom of this post is a list of the discussion posts so far.

* * *

![](http://images.lesswrong.com/t3_kw4_0.png)

Nick Bostrom’s eagerly awaited [_Superintelligence_](http://smile.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0199678111/) comes out in the US this week. To help you get the most out of it, MIRI is running an online reading group where you can join with others to ask questions, discuss ideas, and probe the arguments more deeply.

The reading group will “meet” on a weekly post on the [LessWrong discussion forum](/r/discussion/new/). For each ‘meeting’, we will read about half a chapter of _Superintelligence_, then come together virtually to discuss. I’ll summarize the chapter, and offer a few relevant notes, thoughts, and ideas for further investigation. (My notes will also be used as the source material for the final reading guide for the book.)

Discussion will take place in the comments. I’ll offer some questions, and invite you to bring your own, as well as thoughts, criticisms and suggestions for interesting related material. Your contributions to the reading group might also (with permission) be used in our final reading guide for the book.

We welcome both newcomers and veterans on the topic. Content will aim to be intelligible to a wide audience, and topics will range from novice to expert level. All levels of time commitment are welcome.

We will follow [**this preliminary reading guide**](https://intelligence.org/wp-content/uploads/2014/08/Superintelligence-Readers-Guide-early-version.pdf), produced by MIRI, reading one section per week.

If you have already read the book, don’t worry! To the extent you remember what it says, your superior expertise will only be a bonus. To the extent you don’t remember what it says, now is a good time for a review! If you don’t have time to read the book, but still want to participate, you are also welcome to join in. I will provide summaries, and many things will have page numbers, in case you want to skip to the relevant parts.

If this sounds good to you, first grab a copy of _[Superintelligence](http://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0199678111)_. You may also want to [**sign up here**](http://eepurl.com/1-S41) to be emailed when the discussion begins each week. The first virtual meeting (forum post) will go live at 6pm Pacific on **Monday, September 15th**. Following meetings will start at 6pm every Monday, so if you’d like to coordinate for quick fire discussion with others, put that into your calendar. If you prefer flexibility, come by any time! And remember that if there are any people you would especially enjoy discussing _Superintelligence_ with, link them to this post!

Topics for the first week will include impressive displays of artificial intelligence, why computers play board games so well, and what a reasonable person should infer from the agricultural and industrial revolutions.

* * *

Posts in this sequence
======================

Week 1: [Past developments and present capabilities](/lw/ku6/superintelligence_reading_group_section_1_past/)

Week 2: [Forecasting AI](/r/discussion/lw/l0o/superintelligence_reading_group_2_forecasting_ai/)

Week 3: [AI and uploads](/r/discussion/lw/l10/superintelligence_reading_group_3_ai_and_uploads/)

Week 4: [Biological cognition, BCIs, organizations](/r/discussion/lw/l2n/srg_4_biological_cognition_bcis_organizations/)

Week 5: [Forms of superintelligence](/lw/l40/superintelligence_5_forms_of_superintelligence/)

Week 6: [Intelligence explosion kinetics](/r/discussion/lw/l4e/superintelligence_6_intelligence_explosion/)

Week 7: [Decisive strategic advantage](/lw/l4i/superintelligence_7_decisive_strategic_advantage/)

Week 8: [Cognitive superpowers](/r/discussion/lw/l4h/superintelligence_8_cognitive_superpowers/)

Week 9: [The orthogonality of intelligence and goals](/r/discussion/lw/l4g/superintelligence_9_the_orthogonality_of/)

Week 10: [Instrumentally convergent goals](/r/discussion/lw/l4f/superintelligence_10_instrumentally_convergent/)

Week 11: [The treacherous turn](/r/discussion/lw/l9u/superintelligence_11_the_treacherous_turn/)

Week 12: [Malignant failure modes](/r/discussion/lw/l9t/superintelligence_12_malignant_failure_modes/)

Week 13: [Capability control methods](/r/discussion/lw/l9s/superintelligence_13_capability_control_methods/)

Week 14: [Motivation selection methods](/lw/l9r/superintelligence_14_motivation_selection_methods/)

Week 15: [Oracles, genies and sovereigns](/lw/l9q/superintelligence_15_oracles_genies_and_sovereigns/)

Week 16: [Tool AIs](/r/discussion/lw/l9p/superintelligence_16_tool_ais/)

Week 17: [Multipolar scenarios](/r/discussion/lw/l9o/superintelligence_17_multipolar_scenarios/)

Week 18: [Life in an algorithmic economy](/r/discussion/lw/l9n/superintelligence_18_life_in_an_algorithmic/)

Week 19: [Post-transition formation of a singleton](/r/discussion/lw/l9m/superintelligence_19_posttransition_formation_of/)

Week 20: [The value-loading problem](/r/discussion/lw/llr/superintelligence_20_the_valueloading_problem/)

Week 21: [Value learning](/lw/llg/superintelligence_21_value_learning/)

Week 22: [Emulation modulation and institution design](/r/discussion/lw/llh/superintelligence_22_emulation_modulation_and/)

Week 23: [Coherent extrapolated volition](/r/discussion/lw/llq/superintelligence_23_coherent_extrapolated/)

Week 24: [Morality models and "do what I mean"](/r/discussion/lw/llp/superintelligence_24_morality_models_and_do_what/)

Week 25: [Components list for acquiring values](/r/discussion/lw/llo/superintelligence_25_components_list_for/)

Week 26: [Science and technology strategy](/r/discussion/lw/lln/superintelligence_26_science_and_technology/)

Week 27: [Pathways and enablers](/r/discussion/lw/llm/superintelligence_27_pathways_and_enablers/)

Week 28: [Collaboration](/r/discussion/lw/lll/superintelligence_28_collaboration/)

Week 29: [Crunch time](/r/discussion/lw/llk/superintelligence_29_crunch_time/)