{"id":6247,"date":"2026-01-19T10:47:24","date_gmt":"2026-01-19T10:47:24","guid":{"rendered":"https:\/\/toshareproject.it\/artmakerblog\/?p=6247"},"modified":"2026-01-19T10:47:24","modified_gmt":"2026-01-19T10:47:24","slug":"the-something-something-dataset","status":"publish","type":"post","link":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/","title":{"rendered":"The Something-Something Dataset"},"content":{"rendered":"<p>*It&#8217;s almost ten years old.<\/p>\n<p><a href=\"https:\/\/www.qualcomm.com\/developer\/software\/something-something-v-2-dataset\">https:\/\/www.qualcomm.com\/developer\/software\/something-something-v-2-dataset<\/a><\/p>\n<p>Your model recognizes certain simple, single-frame gestures like a thumbs-up. But for a truly responsive, accurate system, you want your model to recognize gestures in the context of everyday objects. Is the person pointing to something or wagging their index finger? Is the hand cleaning the display or zooming in and out of an image with two fingers? Given enough examples, your model can learn the difference.<\/p>\n<p>The Something-Something dataset (version 2) is a collection of 220,847 labeled video clips of humans performing pre-defined, basic actions with everyday objects. It is designed to train machine learning models in fine-grained understanding of human hand gestures like putting something into something, turning something upside down and covering something with something.<\/p>\n<p>The dataset was created with the help of more than 1,300 unique crowd actors.<\/p>\n<p>Developers like you have successfully created classification models based on the training set and found that they perform well on the validation set. Running their models on the test set, they can achieve scores of up to 91 percent.<\/p>\n<p>The video data is provided as one large TGZ archive, split into parts of 1 GB maximum. The total download size is 19.4 GB. The archive contains webm-files, using the VP9 codec, with a height of 240px. Files are numbered from 1 to 220847.<\/p>\n<p>For each video in the training and validation sets there is an object annotation in addition to the video label, if applicable. For example, for a label like &#8220;Putting [something] onto [something],&#8221; there is also an annotated version, such as &#8220;Putting a cup onto a table.&#8221; In total, there are 318,572 annotations involving 30,408 unique objects.<\/p>\n<p>To reduce label noise, five different crowd actors have verified that the action shown in each video matches the description given. The dataset contains only those videos in which all five crowd actors confirmed the match.<br \/>\nDataset license<\/p>\n<p>The Something-Something dataset is available for research purposes.<\/p>\n<div id=\"attachment_6248\" style=\"width: 1034px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6248\" src=\"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-1024x796.jpg\" alt=\"\" width=\"1024\" height=\"796\" class=\"size-large wp-image-6248\" srcset=\"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-1024x796.jpg 1024w, https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-300x233.jpg 300w, https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-768x597.jpg 768w, https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14.jpg 1354w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><p id=\"caption-attachment-6248\" class=\"wp-caption-text\">Screenshot<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>*It&#8217;s almost ten years old. https:\/\/www.qualcomm.com\/developer\/software\/something-something-v-2-dataset Your model recognizes certain simple, single-frame gestures like a thumbs-up. But for a truly responsive, accurate system, you want your model to recognize gestures in the context of everyday objects. Is the person pointing to something or wagging their index finger? Is the hand cleaning the display or zooming [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6247","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v17.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Something-Something Dataset | Artmaker Blog<\/title>\n<meta name=\"description\" content=\"The Something-Something Dataset | Artmaker Blog\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Something-Something Dataset | Artmaker Blog\" \/>\n<meta property=\"og:description\" content=\"The Something-Something Dataset | Artmaker Blog\" \/>\n<meta property=\"og:url\" content=\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/\" \/>\n<meta property=\"og:site_name\" content=\"Artmaker Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-01-19T10:47:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-1024x796.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Bruce Sterling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/\",\"name\":\"Artmaker Blog\",\"description\":\"on Toshareproject.it - curated by Bruce Sterling\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#primaryimage\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14.jpg\",\"contentUrl\":\"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14.jpg\",\"width\":1354,\"height\":1052,\"caption\":\"Screenshot\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#webpage\",\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/\",\"name\":\"The Something-Something Dataset | Artmaker Blog\",\"isPartOf\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#primaryimage\"},\"datePublished\":\"2026-01-19T10:47:24+00:00\",\"dateModified\":\"2026-01-19T10:47:24+00:00\",\"author\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\"},\"description\":\"The Something-Something Dataset | Artmaker Blog\",\"breadcrumb\":{\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/toshareproject.it\/artmakerblog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Something-Something Dataset\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085\",\"name\":\"Bruce Sterling\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/toshareproject.it\/artmakerblog\/#personlogo\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g\",\"caption\":\"Bruce Sterling\"},\"description\":\"Art director at Share Festival, author and journalist\",\"sameAs\":[\"http:\/\/toshareproject.it\/tomorrowart\"],\"url\":\"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Something-Something Dataset | Artmaker Blog","description":"The Something-Something Dataset | Artmaker Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/","og_locale":"en_GB","og_type":"article","og_title":"The Something-Something Dataset | Artmaker Blog","og_description":"The Something-Something Dataset | Artmaker Blog","og_url":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/","og_site_name":"Artmaker Blog","article_published_time":"2026-01-19T10:47:24+00:00","og_image":[{"url":"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14-1024x796.jpg"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"Bruce Sterling","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/toshareproject.it\/artmakerblog\/#website","url":"https:\/\/toshareproject.it\/artmakerblog\/","name":"Artmaker Blog","description":"on Toshareproject.it - curated by Bruce Sterling","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/toshareproject.it\/artmakerblog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"ImageObject","@id":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#primaryimage","inLanguage":"en-GB","url":"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14.jpg","contentUrl":"https:\/\/toshareproject.it\/artmakerblog\/wp-content\/uploads\/2026\/01\/Screenshot-2026-01-19-at-11.52.14.jpg","width":1354,"height":1052,"caption":"Screenshot"},{"@type":"WebPage","@id":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#webpage","url":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/","name":"The Something-Something Dataset | Artmaker Blog","isPartOf":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#primaryimage"},"datePublished":"2026-01-19T10:47:24+00:00","dateModified":"2026-01-19T10:47:24+00:00","author":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085"},"description":"The Something-Something Dataset | Artmaker Blog","breadcrumb":{"@id":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/toshareproject.it\/artmakerblog\/the-something-something-dataset\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/toshareproject.it\/artmakerblog\/"},{"@type":"ListItem","position":2,"name":"The Something-Something Dataset"}]},{"@type":"Person","@id":"https:\/\/toshareproject.it\/artmakerblog\/#\/schema\/person\/6f20726ed2761431f3e0ff4e096c3085","name":"Bruce Sterling","image":{"@type":"ImageObject","@id":"https:\/\/toshareproject.it\/artmakerblog\/#personlogo","inLanguage":"en-GB","url":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c390e8ed4db57a34278dcf667f928a643cf769a865c8a8632dcd310412bb9a99?s=96&d=mm&r=g","caption":"Bruce Sterling"},"description":"Art director at Share Festival, author and journalist","sameAs":["http:\/\/toshareproject.it\/tomorrowart"],"url":"https:\/\/toshareproject.it\/artmakerblog\/author\/brucesterling\/"}]}},"_links":{"self":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6247","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/comments?post=6247"}],"version-history":[{"count":1,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6247\/revisions"}],"predecessor-version":[{"id":6249,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/posts\/6247\/revisions\/6249"}],"wp:attachment":[{"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/media?parent=6247"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/categories?post=6247"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/toshareproject.it\/artmakerblog\/wp-json\/wp\/v2\/tags?post=6247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}