New Directions in Cooperative AI

Cultural evolution is the fastest known intelligence generating algorithm. In humans, it is responsible for the upward ratchet of our cooperative understanding, communication, commitments and institutions. In this talk, I will draw on the evolutionary psychology literature to define cultural evolution. I will explain how cultural transmission can arise in AI systems via reinforcement learning, leading to "cognitive gadgets" analogous to human thought. Finally, I will outline how cultural evolution offers an important, tractable and under-explored path towards safe, generally-capable Cooperative AI.