{"id":2944,"date":"2022-12-31T15:45:59","date_gmt":"2022-12-31T15:45:59","guid":{"rendered":"https:\/\/toshareproject.it\/artmakerblog\/?p=2944"},"modified":"2022-12-31T15:45:59","modified_gmt":"2022-12-31T15:45:59","slug":"an-extensive-ai-reading-list","status":"publish","type":"post","link":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/","title":{"rendered":"An extensive AI Reading List"},"content":{"rendered":"<p>*You&#8217;d have plenty of work at hand for the New Year if you dared to tackle this one.<\/p>\n<p><a href=\"https:\/\/docs.google.com\/document\/d\/1bEQM1W-1fzSVWNbS4ne5PopB2b7j8zD4Jc3nm4rbK-U\/edit#\">https:\/\/docs.google.com\/document\/d\/1bEQM1W-1fzSVWNbS4ne5PopB2b7j8zD4Jc3nm4rbK-U\/edit#<\/a><\/p>\n<p>AI Reading List<br \/>\nMusic Playlist<\/p>\n<p>This is aimed towards the AI curious looking to go down the rabbit hole not the AI expert. It will be updated ~monthly. Recommendations are accepted via DM @JackSoslow<\/p>\n<p>Blogs \/ Threads \/ Papers<br \/>\nS Tier<br \/>\nTim Urban (2015) \u2014 The AI Revolution: The Road to Superintelligence<br \/>\nAndrej Karpathy (2017) \u2014 Software 2.0<br \/>\nGwern (2020) \u2014 The Scaling Hypothesis<br \/>\nWikipedia \u2014 The History of Artificial Intelligence<br \/>\nGoogle Research, Vaswani et al. (2017) \u2014 Attention Is All You Need<\/p>\n<p>A Tier<br \/>\nEliezer Yudkowsky (2001) \u2014 Creating Friendly AI Summary<br \/>\nTim Urban (2015) \u2014 The AI Revolution: Our Immortality or Extinction<br \/>\nDeepmind (2017) \u2014 AlphaGo<br \/>\nEliezer Yudkowsky (2017) \u2014 There\u2019s no Fire Alarm for Artificial Intelligence<br \/>\nJay Alammar (2018) \u2014 The Illustrated Transformer<br \/>\nOpenAI (2020) \u2014 Language Models are Few Shot Learners (GPT-3)<br \/>\nDeepmind (2020) \u2014 MuZero: Mastering Go, Chess, Shogi, and Atari without rules<br \/>\nOpenAI (2020) \u2014 AI and Efficiency<br \/>\nOpenAI (2021) \u2014 CLIP: Connecting Text and Images<br \/>\nNostalgebraist (2022) \u2014 Chinchilla\u2019s Wild Implications<br \/>\nGwern (2022) \u2014  It looks like you\u2019re trying to take over the world<\/p>\n<p>Best of the Rest<br \/>\nScott Alexander (2016) \u2014 Superintelligence FAQ<br \/>\nOpenAI (2017) \u2014 Learning to Communicate<br \/>\nOpenAI (2017) \u2014 Evolution Strategies as an Alternative to Reinforcement Learning<br \/>\nOpenAI (2017) \u2014 Learning to Cooperate, Compete, and Communicate<br \/>\nOpenAI (2017) \u2014 Proximal Policy Optimization<br \/>\nOpenAI (2017) \u2014 Competitive Self-Play<br \/>\nOpenAI (2018) \u2014 AI and Compute<br \/>\nDeepmind (2019) \u2014 Capture the Flag: the emergence of complex cooperative agents<br \/>\nOpenAI (2019) \u2014 OpenAI Five defeats Dota 2 World Champions<br \/>\nOpenAI (2019) \u2014 Deep Double Descent<br \/>\nJay Alammar (2020) \u2014 How GPT-3 Works: Visualizations and Animations<br \/>\nEvhub (2020) \u2014 11 Proposals of for Building Safe Advanced AI<br \/>\nDeepmind (2022) \u2014 Discovering novel algorithms with AlphaTensor<br \/>\nDeepmind (2020) \u2014 Using JAX to accelerate our research\u2019<br \/>\nDeepmind (2020) \u2014 AlphaFold: a solution to a 50-year-old grand challenge in biology<br \/>\nLeigh Marie Braswell (2021) \u2014 Startup Opportunities in Machine Learning Infrastructure<br \/>\nMeta AI (2021) \u2014 Teaching AI how to forget at scale<br \/>\nOpenAI (2021) \u2014 DALL-E: Creating Images from Text<br \/>\nOpenAI (2021) \u2014 Multimodal Neurons in Artificial Neural Networks<br \/>\nOpenAI (2021) \u2014 Improving Language Model Behavior by Training on a Curated Dataset<br \/>\nOpenAI (2021) \u2014 OpenAI Codex<br \/>\nOpenAI (2022) \u2014 Aligning Language Models to Follow Instructions<br \/>\nOpenAI (2022) \u2014 DALL-E 2<br \/>\nOpenAI (2022) \u2014 Learning to Play Minecraft with Video PreTraining<br \/>\nOpenAI (2022) \u2014 Introducing Whisper<br \/>\nOpenAI (2022) \u2014 ChatGPT: Optimizing Language Models for Dialog<br \/>\nNature (2022) \u2014 What\u2019s next for AlphaFold<br \/>\nMeta AI (2022) \u2014 CICERO: AN AI agent that negotiates, persuades, and cooperates with people<br \/>\nYann Lecun (2022) \u2014 How to make AI systems learn and reason like animals and humans<br \/>\nRobert May (2022) \u2014 The Mental Model Most AI Investors Are Missing<br \/>\nRoon (2022) \u2014 Text is the Universal Interface<br \/>\nJack Soslow (2022) \u2014 2022 AI Research and Trends Round Up<br \/>\nPodcasts<br \/>\nS Tier<br \/>\nSam Altman | Greymatter \u2014 AI for the Next Era<br \/>\nConnor Leahy | Machine Learning Street Talk \u2014 AI Alignment &#038; AGI Fire Alarm<br \/>\nDemis Hassabis | Lex Fridman \u2014 Demis Hassabis: DeepMind<\/p>\n<p>A Tier<br \/>\nGeorge Hotz | Lex Fridman \u2014 Comma.ai, OpenPilot, and Autonomous Vehicles<br \/>\nIlya Sutskever | Lex Fridman \u2014 Deep Learning<br \/>\nEmad Mostaque | Good Time Show \u2014 Founder of Stable Diffusion on AI ethics, religion, India\u2019s AI future and open source<br \/>\nBen Goertzel | Machine Learning Street Talk \u2014 Artificial General Intelligence<br \/>\nAndrej Karpathy | Lex Fridman \u2014 Tesla AI, Self-Driving, Optimus, Aliens, and AGI<\/p>\n<p>Best of the Rest<br \/>\na16z \u2014 GPT-3, Beyond the Hype<br \/>\nStratechery \u2014 The AI Unbundling<br \/>\nReading for your Life \u2014 The Singularity is Near by Ray Kurzweil<br \/>\nYann Lecun | Lex Fridman \u2014 Dark Matter of Intelligence and Self-Supervised Learning<br \/>\nJim Keller | Lex Fridman \u2014 The Future of Computing, AI, Life, and Consciousness<br \/>\nGeorge Hotz | Lex Fridman \u2014 Hacking the Simulation &#038; Learning to Drive with Neural Nets<br \/>\nBen Goertzel | Lex Fridman \u2014 Artificial General Intelligence \u2014 Lex Fridman Podcast<br \/>\nGary Marcus | Machine Learning Street Talk \u2014 Prof. Gary Marcus 3.0<br \/>\nConnor Leahy \u2014 GPT-3 as an AI Fire Alarm<br \/>\nJoscha Bach | Lex Fridman \u2014 Artificial Consciousness and the Nature of Reality<br \/>\nJohn Carmack | Lex Fridman \u2014 Doom, Quake, VR, AGI, Programming, Video Games, and Rockets<\/p>\n<p>Videos \/ Video Podcasts \/ Video Essays<br \/>\nS Tier<br \/>\nEliezer Yudkowsky (2007) \u2014  Introducing the Singularity: Three Major Schools of Thought<br \/>\nEliezer Yudkowsky (2017) \u2014 Difficulties of Artificial General Intelligence Alignment<br \/>\nEric Elliott (2020) \u2014 What it\u2019s like to be a Computer: An Interview with GPT-3<br \/>\nEthan Caballero (2022) \u2014 Broken Neural Scaling Laws<\/p>\n<p>A Tier<br \/>\nYannic Kilcher (2017) \u2014 Attention is all you need<br \/>\nOpenAI (2019) \u2014 Multi Agent Hide and Seek<br \/>\nWSJ (2019) \u2014 How China is Using Artificial Intelligence in Classrooms<br \/>\nYannic Kilcher (2020) \u2014 GPT-3: Language Models are Few Shot Learners (paper explained)<\/p>\n<p>Best of the Rest<br \/>\nEliezer Yudkowsky (2012) \u2014 Intelligence Explosion<br \/>\nOpenAI (2017) \u2014 Dota2<br \/>\nFei Fei Li (2018) \u2014 How to make AI that\u2019s good for people<br \/>\nGeorge Hotz (2019) \u2014 Jailbreaking the Simulation with George Hotz<br \/>\nLex Fridman (2019) \u2014 Deep Learning Basics: Introduction and Overview<br \/>\nSam Altman (2020) \u2014 Sam Altman talks about AI at Big Compute 20 Tech Conference<br \/>\nTwo Minute Papers (2020) \u2014 OpenAI GPT-3 &#8211; Good at Almost Everything<br \/>\nJack Soslow (2020) \u2014 Two AIs talking to each other<br \/>\nLex Fridman (2020) \u2014 GPT-3 vs Human Brain<br \/>\nHarrison Kinsley and Daniel Kukiela (2020) \u2013 Neural Networks from Scratch &#8211; p.3 The Dot Product<br \/>\nLex Fridman (2020) \u2014 Deep Learning State of the Art<br \/>\nBycloud (2020) \u2014 What Happens When AI Robots Design Themselves<br \/>\nTwo Minute Papers (2020) \u2014 MuZero: DeepMind\u2019s New AI Mastered More Than 50 Games<br \/>\nMira Murati (2020) \u2014 Ensuring AGI benefits all of humanity<br \/>\nTwo Minute Papers (2020) \u2014 Can an AI Design Our Tax Policy?<br \/>\nNeat AI (2021) \u2014 Lenia \u2014 Conway\u2019s game of life arrives in the 21st century<br \/>\nSam Altman (2021) \u2014 The Future of AI Research from DALL-E to GPT-3<br \/>\nYannic Kilcher (2021) \u2014 How far can we scale up? Deep Learning\u2019s Diminishing Returns (Article Review)<br \/>\nTwo Minute Papers (2021) \u2014 Watch Tesla\u2019s Self-Driving Car Learning in a Simulation<br \/>\nEthan Caballero (2022) \u2014 Scale is all you need<br \/>\nTwo Minute Papers (2022) \u2014 DeepMind AlphaFold A Gift to Humanity<br \/>\nOpenAI (2022) \u2014 Aligning AI Systems with Human Intent<br \/>\nNeatAI (2022) \u2014 AI Learns NEAT Pacman Solution<br \/>\nYannic Kilcher (2022) \u2014 Grokking: Generalization beyond Overfitting on small algorithmic datasets (Paper Explained)<br \/>\nThe Third Build (2022) \u2014 How an AI is Becoming the World\u2019s Best Pokemon Player<br \/>\nBooks<br \/>\nDeep Learning (2016)<br \/>\nSuperintelligence (2014)<br \/>\nThe Singularity is Near (2005)<br \/>\nMovies<br \/>\nAlphaGo (2017)<br \/>\nHer (2013)<br \/>\n2001: A Space Odyssey (1968)<\/p>\n<p>List was inspired by The Index from Jeremy Nixon, which is more about worldly knowledge, and Aman\u2019s Reading List, which is more about becoming technically up to speed. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>*You&#8217;d have plenty of work at hand for the New Year if you dared to tackle this one. https:\/\/docs.google.com\/document\/d\/1bEQM1W-1fzSVWNbS4ne5PopB2b7j8zD4Jc3nm4rbK-U\/edit# AI Reading List Music Playlist This is aimed towards the AI curious looking to go down the rabbit hole not the AI expert. It will be updated ~monthly. Recommendations are accepted via DM @JackSoslow Blogs \/ [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2944","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v17.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>An extensive AI Reading List | Artmaker Blog<\/title>\n<meta name=\"description\" content=\"An extensive AI Reading List | Artmaker Blog\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"An extensive AI Reading List | Artmaker Blog\" \/>\n<meta property=\"og:description\" content=\"An extensive AI Reading List | Artmaker Blog\" \/>\n<meta property=\"og:url\" content=\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/\" \/>\n<meta property=\"og:site_name\" content=\"Artmaker Blog\" \/>\n<meta property=\"article:published_time\" content=\"2022-12-31T15:45:59+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bruce Sterling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/\",\"name\":\"Artmaker Blog\",\"description\":\"on Toshareproject.it - curated by Bruce Sterling\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#webpage\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/\",\"name\":\"An extensive AI Reading List | Artmaker Blog\",\"isPartOf\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\"},\"datePublished\":\"2022-12-31T15:45:59+00:00\",\"dateModified\":\"2022-12-31T15:45:59+00:00\",\"author\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\"},\"description\":\"An extensive AI Reading List | Artmaker Blog\",\"breadcrumb\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/toshareproject.it\/artmakerblog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"An extensive AI Reading List\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\",\"name\":\"Bruce Sterling\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#personlogo\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"caption\":\"Bruce Sterling\"},\"description\":\"Art director at Share Festival, author and journalist\",\"sameAs\":[\"http:\/\/toshareproject.it\/tomorrowart\"],\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"An extensive AI Reading List | Artmaker Blog","description":"An extensive AI Reading List | Artmaker Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/","og_locale":"en_GB","og_type":"article","og_title":"An extensive AI Reading List | Artmaker Blog","og_description":"An extensive AI Reading List | Artmaker Blog","og_url":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/","og_site_name":"Artmaker Blog","article_published_time":"2022-12-31T15:45:59+00:00","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bruce Sterling","Estimated reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/toshareproject.it\/artmakerblog\/#website","url":"https:\/\/toshareproject.it\/artmakerblog\/","name":"Artmaker Blog","description":"on Toshareproject.it - curated by Bruce Sterling","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#webpage","url":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/","name":"An extensive AI Reading List | Artmaker Blog","isPartOf":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#website"},"datePublished":"2022-12-31T15:45:59+00:00","dateModified":"2022-12-31T15:45:59+00:00","author":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085"},"description":"An extensive AI Reading List | Artmaker Blog","breadcrumb":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/toshareproject.it\/artmakerblog\/an-extensive-ai-reading-list\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/toshareproject.it\/artmakerblog\/"},{"@type":"ListItem","position":2,"name":"An extensive AI Reading List"}]},{"@type":"Person","@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085","name":"Bruce Sterling","image":{"@type":"ImageObject","@id":"https:\/\/toshareproject.it\/artmakerblog\/#personlogo","inLanguage":"en-GB","url":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","caption":"Bruce Sterling"},"description":"Art director at Share Festival, author and journalist","sameAs":["http:\/\/toshareproject.it\/tomorrowart"],"url":"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/"}]}},"_links":{"self":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/2944","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/comments?post=2944"}],"version-history":[{"count":1,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/2944\/revisions"}],"predecessor-version":[{"id":2945,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/2944\/revisions\/2945"}],"wp:attachment":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/media?parent=2944"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/categories?post=2944"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/tags?post=2944"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}