# Video lectures on the learning-theoretic agenda

This is a YouTube playlist of recorded lectures on the [learning-theoretic AI alignment agenda](https://www.alignmentforum.org/posts/ZwshvqiqCvXPsZEct/the-learning-theoretic-agenda-status-2023) (LTA) I gave for my [MATS](https://www.matsprogram.org/) scholars of the Winter 2024 cohort, edited by my beloved spouse [@Marcus Ogren](https://www.alignmentforum.org/users/marcus-ogren?mention=user). H/t William Brewer for helping with the recording, and the rest of the MATS team for making this possible.

I hope these will become a useful resource for anyone who wants to get up to speed on the LTA, complementary to the [reading list](https://www.alignmentforum.org/posts/fsGEyCYhqs7AWwdCe/learning-theoretic-agenda-reading-list). Notable topics that aren't covered include [metacognitive agents](https://www.lesswrong.com/posts/dPmmuaz9szk26BkmD/vanessa-kosoy-s-shortform?commentId=L2ipvPNWnfgxgwd6p) (although there is an older [recorded talk](https://youtu.be/mE28UJ3tkos) on that) and [infra-Bayesian physicalism](https://www.lesswrong.com/posts/gHgs2e2J5azvGFatb/infra-bayesian-physicalism-a-formal-theory-of-naturalized). In the future, I might record more lectures to expand this playlist.

**EDIT:** I know the audio quality is bad, and I apologize. I will try to do better next time.

Table of Contents
=================

1.  [Agents and AIXI](https://youtu.be/1ynlpfuy6Go?si=BcvTF904st2j9fiq)
2.  [Hidden rewards and the problem of privilege](https://youtu.be/hqR-qhV2BBg?si=QA9-2GCeTTiCFIaQ)
3.  [Compositionality](https://youtu.be/50NnxDkIxPU?si=mXavv6SNJYL6zmWB)
4.  [Nonrealizability](https://youtu.be/_4s7r1RYSD4?si=PXizI-VqWNqRCyxp)
5.  [It's a](https://youtu.be/rme_BpYtuCg?si=0RirzmUqxIXdElDK) [trap](https://www.youtube.com/watch?v=dQw4w9WgXcQ)!
6.  [Traps, continued](https://youtu.be/vcQwqkdstD0?si=r-zOBXPPIvcrNe2W)
7.  [Traps and frequentist guarantees](https://youtu.be/Wt5eBXhZXYY?si=EdJVqAqPXc2FnwQo)
8.  [Game theory and learning theory](https://youtu.be/Q5piPMSKYZw?si=yTdc9AsApZrP8_ek)
9.  [Hidden rewards](https://youtu.be/MfaVFyELu60?si=iZcjPR-Il9na7n6I)
10.  [Algorithmic Descriptive Agency Measure (ADAM)](https://youtu.be/RBB3mn-Mhho?si=U2OT0weJds-Uyi82)
11.  [General reinforcement learning](https://youtu.be/9kiT4MlLOl4?si=ykJLevALkpxmmw5B)
12.  [Infra-Bayesianism](https://youtu.be/v_gwJtvrjg4?si=Z_4vqVA4e799EAVS)
13.  [Learnability](https://youtu.be/g6h0_tUnXoM?si=ZMBQAljUUdsRseFn)
14.  [Infra-Bandits](https://youtu.be/gwkx-_0nx1I?si=1FBDXsW2yEjVKeZI)
15.  [Newcombian problems](https://youtu.be/VVDpE2C4gXA?si=I7Vf0g4FlLJiBvN0)
16.  [Ultradistributions and semi-environments](https://youtu.be/5kV-b8ValDE?si=GQuuTdUMtm2kw4ec)
17.  [Formalizing Newcombian problems](https://youtu.be/mjQVbHU2rXA?si=nx1NHHat5A3o0_xj)
18.  [Pseudocausality and a general formulation of Newcombian problems](https://youtu.be/p3syWaz0RDY?si=WbQlmuBmiVGiFy_f)
19.  [Decision rules and pseudocausality](https://youtu.be/rRaB9nDkBc8?si=aYH6D11oaW94Vtm7)
20.  [Instrumental reward functions](https://youtu.be/iK9kdilCmRU?si=_VlW9uOPMzRJ9qs1)
21.  [Infra-Bayesian haggling, part 1](https://youtu.be/3pAVPXsltHc?si=LvurI94VJN1yE8Qu)
22.  [Infra-Bayesian haggling, part 2](https://youtu.be/8IBm7TK_FBQ?si=0O5kc2AblwxDoXXm)
23.  [Anytime algorithms in multi-agent settings](https://youtu.be/uLo-1gjK5ds?si=Krp1_zhQW7hRgxJ7)
24.  [Bounded inductive rationality](https://youtu.be/9TiUaF5jsl0?si=oWAv3bwTLrapDYAw)