{"id":3249,"date":"2023-03-30T08:51:31","date_gmt":"2023-03-30T07:51:31","guid":{"rendered":"https:\/\/toshareproject.it\/artmakerblog\/?p=3249"},"modified":"2023-03-30T08:51:31","modified_gmt":"2023-03-30T07:51:31","slug":"remiss-in-my-moral-duties-as-a-human","status":"publish","type":"post","link":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/","title":{"rendered":"“Remiss in my moral duties as a human”"},"content":{"rendered":"

https:\/\/time.com\/6266923\/ai-eliezer-yudkowsky-open-letter-not-enough\/<\/a><\/p>\n

Pausing AI Developments Isn’t Enough. We Need to Shut it All Down<\/p>\n

IDEAS
\nBY ELIEZER YUDKOWSKY MARCH 29, 2023 6:01 PM EDT<\/p>\n

Yudkowsky is a decision theorist from the U.S. and leads research at the Machine Intelligence Research Institute. He’s been working on aligning Artificial General Intelligence since 2001 and is widely regarded as a founder of the field.<\/p>\n

An open letter published today calls for \u201call AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.\u201d<\/p>\n

This 6-month moratorium would be better than no moratorium. I have respect for everyone who stepped up and signed it. It\u2019s an improvement on the margin.<\/p>\n

I refrained from signing because I think the letter is understating the seriousness of the situation and asking for too little to solve it.<\/p>\n

Many researchers steeped in these issues, including myself, expect that the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die. Not as in \u201cmaybe possibly some remote chance,\u201d but as in \u201cthat is the obvious thing that would happen.\u201d It\u2019s not that you can\u2019t, in principle, survive creating something much smarter than you; it\u2019s that it would require precision and preparation and new scientific insights, and probably not having AI systems composed of giant inscrutable arrays of fractional numbers.<\/p>\n

Without that precision and preparation, the most likely outcome is AI that does not do what we want, and does not care for us nor for sentient life in general. That kind of caring is something that could in principle be imbued into an AI but we are not ready and do not currently know how.<\/p>\n

Absent that caring, we get \u201cthe AI does not love you, nor does it hate you, and you are made of atoms it can use for something else.\u201d<\/p>\n

The likely result of humanity facing down an opposed superhuman intelligence is a total loss. Valid metaphors include \u201ca 10-year-old trying to play chess against Stockfish 15\u201d, \u201cthe 11th century trying to fight the 21st century,\u201d and \u201cAustralopithecus trying to fight Homo sapiens\u201c.<\/p>\n

To visualize a hostile superhuman AI, don\u2019t imagine a lifeless book-smart thinker dwelling inside the internet and sending ill-intentioned emails. Visualize an entire alien civilization, thinking at millions of times human speeds, initially confined to computers\u2014in a world of creatures that are, from its perspective, very stupid and very slow. A sufficiently intelligent AI won\u2019t stay confined to computers for long. In today\u2019s world you can email DNA strings to laboratories that will produce proteins on demand, allowing an AI initially confined to the internet to build artificial life forms or bootstrap straight to postbiological molecular manufacturing….<\/p>\n","protected":false},"excerpt":{"rendered":"

https:\/\/time.com\/6266923\/ai-eliezer-yudkowsky-open-letter-not-enough\/ Pausing AI Developments Isn’t Enough. We Need to Shut it All Down IDEAS BY ELIEZER YUDKOWSKY MARCH 29, 2023 6:01 PM EDT Yudkowsky is a decision theorist from the U.S. and leads research at the Machine Intelligence Research Institute. He’s been working on aligning Artificial General Intelligence since 2001 and is widely regarded as […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3249","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"yoast_head":"\n"Remiss in my moral duties as a human" | Artmaker Blog<\/title>\n<meta name=\"description\" content=\""Remiss in my moral duties as a human" | Artmaker Blog\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\""Remiss in my moral duties as a human" | Artmaker Blog\" \/>\n<meta property=\"og:description\" content=\""Remiss in my moral duties as a human" | Artmaker Blog\" \/>\n<meta property=\"og:url\" content=\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/\" \/>\n<meta property=\"og:site_name\" content=\"Artmaker Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-30T07:51:31+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bruce Sterling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/\",\"name\":\"Artmaker Blog\",\"description\":\"on Toshareproject.it - curated by Bruce Sterling\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#webpage\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/\",\"name\":\"\\\"Remiss in my moral duties as a human\\\" | Artmaker Blog\",\"isPartOf\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\"},\"datePublished\":\"2023-03-30T07:51:31+00:00\",\"dateModified\":\"2023-03-30T07:51:31+00:00\",\"author\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\"},\"description\":\"\\\"Remiss in my moral duties as a human\\\" | Artmaker Blog\",\"breadcrumb\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/toshareproject.it\/artmakerblog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"“Remiss in my moral duties as a human”\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\",\"name\":\"Bruce Sterling\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#personlogo\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"caption\":\"Bruce Sterling\"},\"description\":\"Art director at Share Festival, author and journalist\",\"sameAs\":[\"http:\/\/toshareproject.it\/tomorrowart\"],\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\"Remiss in my moral duties as a human\" | Artmaker Blog","description":"\"Remiss in my moral duties as a human\" | Artmaker Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/","og_locale":"en_GB","og_type":"article","og_title":"\"Remiss in my moral duties as a human\" | Artmaker Blog","og_description":"\"Remiss in my moral duties as a human\" | Artmaker Blog","og_url":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/","og_site_name":"Artmaker Blog","article_published_time":"2023-03-30T07:51:31+00:00","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bruce Sterling","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/toshareproject.it\/artmakerblog\/#website","url":"https:\/\/toshareproject.it\/artmakerblog\/","name":"Artmaker Blog","description":"on Toshareproject.it - curated by Bruce Sterling","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#webpage","url":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/","name":"\"Remiss in my moral duties as a human\" | Artmaker Blog","isPartOf":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#website"},"datePublished":"2023-03-30T07:51:31+00:00","dateModified":"2023-03-30T07:51:31+00:00","author":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085"},"description":"\"Remiss in my moral duties as a human\" | Artmaker Blog","breadcrumb":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/toshareproject.it\/artmakerblog\/remiss-in-my-moral-duties-as-a-human\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/toshareproject.it\/artmakerblog\/"},{"@type":"ListItem","position":2,"name":"“Remiss in my moral duties as a human”"}]},{"@type":"Person","@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085","name":"Bruce Sterling","image":{"@type":"ImageObject","@id":"https:\/\/toshareproject.it\/artmakerblog\/#personlogo","inLanguage":"en-GB","url":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","caption":"Bruce Sterling"},"description":"Art director at Share Festival, author and journalist","sameAs":["http:\/\/toshareproject.it\/tomorrowart"],"url":"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/"}]}},"_links":{"self":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/3249","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/comments?post=3249"}],"version-history":[{"count":1,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/3249\/revisions"}],"predecessor-version":[{"id":3250,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/3249\/revisions\/3250"}],"wp:attachment":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/media?parent=3249"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/categories?post=3249"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/tags?post=3249"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}