on Toshareproject.it - curated by Bruce Sterling
*You’d have plenty of work at hand for the New Year if you dared to tackle this one.
https://docs.google.com/document/d/1bEQM1W-1fzSVWNbS4ne5PopB2b7j8zD4Jc3nm4rbK-U/edit#
AI Reading List
Music Playlist
This is aimed towards the AI curious looking to go down the rabbit hole not the AI expert. It will be updated ~monthly. Recommendations are accepted via DM @JackSoslow
Blogs / Threads / Papers
S Tier
Tim Urban (2015) — The AI Revolution: The Road to Superintelligence
Andrej Karpathy (2017) — Software 2.0
Gwern (2020) — The Scaling Hypothesis
Wikipedia — The History of Artificial Intelligence
Google Research, Vaswani et al. (2017) — Attention Is All You Need
A Tier
Eliezer Yudkowsky (2001) — Creating Friendly AI Summary
Tim Urban (2015) — The AI Revolution: Our Immortality or Extinction
Deepmind (2017) — AlphaGo
Eliezer Yudkowsky (2017) — There’s no Fire Alarm for Artificial Intelligence
Jay Alammar (2018) — The Illustrated Transformer
OpenAI (2020) — Language Models are Few Shot Learners (GPT-3)
Deepmind (2020) — MuZero: Mastering Go, Chess, Shogi, and Atari without rules
OpenAI (2020) — AI and Efficiency
OpenAI (2021) — CLIP: Connecting Text and Images
Nostalgebraist (2022) — Chinchilla’s Wild Implications
Gwern (2022) — It looks like you’re trying to take over the world
Best of the Rest
Scott Alexander (2016) — Superintelligence FAQ
OpenAI (2017) — Learning to Communicate
OpenAI (2017) — Evolution Strategies as an Alternative to Reinforcement Learning
OpenAI (2017) — Learning to Cooperate, Compete, and Communicate
OpenAI (2017) — Proximal Policy Optimization
OpenAI (2017) — Competitive Self-Play
OpenAI (2018) — AI and Compute
Deepmind (2019) — Capture the Flag: the emergence of complex cooperative agents
OpenAI (2019) — OpenAI Five defeats Dota 2 World Champions
OpenAI (2019) — Deep Double Descent
Jay Alammar (2020) — How GPT-3 Works: Visualizations and Animations
Evhub (2020) — 11 Proposals of for Building Safe Advanced AI
Deepmind (2022) — Discovering novel algorithms with AlphaTensor
Deepmind (2020) — Using JAX to accelerate our research’
Deepmind (2020) — AlphaFold: a solution to a 50-year-old grand challenge in biology
Leigh Marie Braswell (2021) — Startup Opportunities in Machine Learning Infrastructure
Meta AI (2021) — Teaching AI how to forget at scale
OpenAI (2021) — DALL-E: Creating Images from Text
OpenAI (2021) — Multimodal Neurons in Artificial Neural Networks
OpenAI (2021) — Improving Language Model Behavior by Training on a Curated Dataset
OpenAI (2021) — OpenAI Codex
OpenAI (2022) — Aligning Language Models to Follow Instructions
OpenAI (2022) — DALL-E 2
OpenAI (2022) — Learning to Play Minecraft with Video PreTraining
OpenAI (2022) — Introducing Whisper
OpenAI (2022) — ChatGPT: Optimizing Language Models for Dialog
Nature (2022) — What’s next for AlphaFold
Meta AI (2022) — CICERO: AN AI agent that negotiates, persuades, and cooperates with people
Yann Lecun (2022) — How to make AI systems learn and reason like animals and humans
Robert May (2022) — The Mental Model Most AI Investors Are Missing
Roon (2022) — Text is the Universal Interface
Jack Soslow (2022) — 2022 AI Research and Trends Round Up
Podcasts
S Tier
Sam Altman | Greymatter — AI for the Next Era
Connor Leahy | Machine Learning Street Talk — AI Alignment & AGI Fire Alarm
Demis Hassabis | Lex Fridman — Demis Hassabis: DeepMind
A Tier
George Hotz | Lex Fridman — Comma.ai, OpenPilot, and Autonomous Vehicles
Ilya Sutskever | Lex Fridman — Deep Learning
Emad Mostaque | Good Time Show — Founder of Stable Diffusion on AI ethics, religion, India’s AI future and open source
Ben Goertzel | Machine Learning Street Talk — Artificial General Intelligence
Andrej Karpathy | Lex Fridman — Tesla AI, Self-Driving, Optimus, Aliens, and AGI
Best of the Rest
a16z — GPT-3, Beyond the Hype
Stratechery — The AI Unbundling
Reading for your Life — The Singularity is Near by Ray Kurzweil
Yann Lecun | Lex Fridman — Dark Matter of Intelligence and Self-Supervised Learning
Jim Keller | Lex Fridman — The Future of Computing, AI, Life, and Consciousness
George Hotz | Lex Fridman — Hacking the Simulation & Learning to Drive with Neural Nets
Ben Goertzel | Lex Fridman — Artificial General Intelligence — Lex Fridman Podcast
Gary Marcus | Machine Learning Street Talk — Prof. Gary Marcus 3.0
Connor Leahy — GPT-3 as an AI Fire Alarm
Joscha Bach | Lex Fridman — Artificial Consciousness and the Nature of Reality
John Carmack | Lex Fridman — Doom, Quake, VR, AGI, Programming, Video Games, and Rockets
Videos / Video Podcasts / Video Essays
S Tier
Eliezer Yudkowsky (2007) — Introducing the Singularity: Three Major Schools of Thought
Eliezer Yudkowsky (2017) — Difficulties of Artificial General Intelligence Alignment
Eric Elliott (2020) — What it’s like to be a Computer: An Interview with GPT-3
Ethan Caballero (2022) — Broken Neural Scaling Laws
A Tier
Yannic Kilcher (2017) — Attention is all you need
OpenAI (2019) — Multi Agent Hide and Seek
WSJ (2019) — How China is Using Artificial Intelligence in Classrooms
Yannic Kilcher (2020) — GPT-3: Language Models are Few Shot Learners (paper explained)
Best of the Rest
Eliezer Yudkowsky (2012) — Intelligence Explosion
OpenAI (2017) — Dota2
Fei Fei Li (2018) — How to make AI that’s good for people
George Hotz (2019) — Jailbreaking the Simulation with George Hotz
Lex Fridman (2019) — Deep Learning Basics: Introduction and Overview
Sam Altman (2020) — Sam Altman talks about AI at Big Compute 20 Tech Conference
Two Minute Papers (2020) — OpenAI GPT-3 – Good at Almost Everything
Jack Soslow (2020) — Two AIs talking to each other
Lex Fridman (2020) — GPT-3 vs Human Brain
Harrison Kinsley and Daniel Kukiela (2020) – Neural Networks from Scratch – p.3 The Dot Product
Lex Fridman (2020) — Deep Learning State of the Art
Bycloud (2020) — What Happens When AI Robots Design Themselves
Two Minute Papers (2020) — MuZero: DeepMind’s New AI Mastered More Than 50 Games
Mira Murati (2020) — Ensuring AGI benefits all of humanity
Two Minute Papers (2020) — Can an AI Design Our Tax Policy?
Neat AI (2021) — Lenia — Conway’s game of life arrives in the 21st century
Sam Altman (2021) — The Future of AI Research from DALL-E to GPT-3
Yannic Kilcher (2021) — How far can we scale up? Deep Learning’s Diminishing Returns (Article Review)
Two Minute Papers (2021) — Watch Tesla’s Self-Driving Car Learning in a Simulation
Ethan Caballero (2022) — Scale is all you need
Two Minute Papers (2022) — DeepMind AlphaFold A Gift to Humanity
OpenAI (2022) — Aligning AI Systems with Human Intent
NeatAI (2022) — AI Learns NEAT Pacman Solution
Yannic Kilcher (2022) — Grokking: Generalization beyond Overfitting on small algorithmic datasets (Paper Explained)
The Third Build (2022) — How an AI is Becoming the World’s Best Pokemon Player
Books
Deep Learning (2016)
Superintelligence (2014)
The Singularity is Near (2005)
Movies
AlphaGo (2017)
Her (2013)
2001: A Space Odyssey (1968)
List was inspired by The Index from Jeremy Nixon, which is more about worldly knowledge, and Aman’s Reading List, which is more about becoming technically up to speed.