{"id":1031,"date":"2016-10-28T00:58:52","date_gmt":"2016-10-27T15:58:52","guid":{"rendered":"http:\/\/sonicviz.com\/?p=1031"},"modified":"2017-09-10T21:58:10","modified_gmt":"2017-09-10T12:58:10","slug":"earthquake-data-scope","status":"publish","type":"post","link":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/","title":{"rendered":"Earthquake Data Scope"},"content":{"rendered":"

Interactive Data Visualization & Exploration<\/h2>\n

I recently attended\u00a0the Rakuten Technology Conference 2016<\/a>\u00a0and saw a very interesting presentation from Erik Berlow titled “Next-Generation Interfaces for Thinking with Data<\/a>“, which was about data scope interfaces.<\/span><\/p>\n

I’m familiar with Data Science, data mining, and data visualization and have been working with a few tools, from RapidMiner <\/a>to cloud based ML platforms such as IBM Watson, Microsoft, Amazon, & Google.<\/p>\n

Data Scope Interfaces<\/h3>\n

Erik opened my eyes to some new ways of looking at the problem of constructing visualization and analysis tools in an increasingly data saturated world.\u00a0He introduced the concept of Data Scopes, interactive tools for exploring multidimensional data and inter-relationships using the human visual system as the pattern recognition engine. The data can be pre-processed with Machine Learning to slice, dice, connect and categorize to provide a rich content source for the visual interfaces to explore.<\/p>\n

So I decided to do some prototyping and see what I could come up with to explore the Data Scope concept at a basic level. There are a wealth of great open source Javascript libraries for visualization around. I focused on DC.js<\/a>\u00a0which is a mashup of the well known D3 library for manipulating data documents and Crossfilter, a multivariate dataset explorer library originally released by Square.<\/p>\n

Living in quake city (Tokyo) I decided to start with the NOAA Global Significant Earthquake Database, 2150 BC to present<\/a>\u00a0for this exercise.<\/p>\n

As anyone who has worked with data science will tell you, massaging the data into shape is usually the most time consuming and painful part of the process. Garbage in, Garbage out as the old computer saying goes! I actually asked Erik in the Q&A what his processes were to clean the data, and he made the interesting comment that Data Scopes are also useful for rapidly detecting anomalous data. That’s why this earthquake data set is a great example because it has lots of missing data, in addition to lots of useful data.<\/p>\n

Have a play with the Data Explorer below and see what patterns and relationships you can detect. See if you can spot where the data is missing, and see if you can spot where data looks a little strange (usually due to inaccuracy of records going back in time I suspect). It was a fun project and I learned a lot which I hope to apply moving forward to some more explorations.<\/p>\n

Disclaimer: I did a small amount data manipulation for the purposes of this example . Many of the largest & oldest quake events are missing data in key categories, so I added a baseline 10000 to total injured in order to get some to display in the bubble chart.<\/p>\n

Open the Quakescop in a new tab:\u00a0https:\/\/sonicviz.github.io\/quakescope\/<\/a><\/p>\n

Source code available on GitHub:\u00a0https:\/\/github.com\/sonicviz\/quakescope<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Interactive Data Visualization & Exploration I recently attended\u00a0the Rakuten Technology Conference 2016\u00a0and saw a very interesting presentation from Erik Berlow titled “Next-Generation Interfaces for Thinking with Data“, which was about data scope interfaces. I’m familiar with Data Science, data mining, and data visualization and have been working with a few tools, from RapidMiner to cloud […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"

Major Earthquakes Data Explorer<\/h1>

[iframe src=\"http:\/\/sonicviz.com\/quakescope\/index.html\" width=\"100%\" height=\"1000\"]<\/p>","_et_gb_content_width":"","_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","footnotes":""},"categories":[52,57],"tags":[58],"yoast_head":"\nEarthquake Data Scope - Sonicviz<\/title>\n<meta name=\"description\" content=\"Earthquake interactive data visualization and data scope using dc.js\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Earthquake Data Scope - Sonicviz\" \/>\n<meta property=\"og:description\" content=\"Earthquake interactive data visualization and data scope using dc.js\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/\" \/>\n<meta property=\"og:site_name\" content=\"Sonicviz\" \/>\n<meta property=\"article:published_time\" content=\"2016-10-27T15:58:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-09-10T12:58:10+00:00\" \/>\n<meta name=\"author\" content=\"Paul Cohen\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Paul Cohen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/\",\"url\":\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/\",\"name\":\"Earthquake Data Scope - Sonicviz\",\"isPartOf\":{\"@id\":\"https:\/\/sonicviz.com\/#website\"},\"datePublished\":\"2016-10-27T15:58:52+00:00\",\"dateModified\":\"2017-09-10T12:58:10+00:00\",\"author\":{\"@id\":\"https:\/\/sonicviz.com\/#\/schema\/person\/8115792e586d39016845c396beb90e49\"},\"description\":\"Earthquake interactive data visualization and data scope using dc.js\",\"breadcrumb\":{\"@id\":\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sonicviz.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Earthquake Data Scope\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sonicviz.com\/#website\",\"url\":\"https:\/\/sonicviz.com\/\",\"name\":\"Sonicviz\",\"description\":\"Play Smart\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sonicviz.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/sonicviz.com\/#\/schema\/person\/8115792e586d39016845c396beb90e49\",\"name\":\"Paul Cohen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sonicviz.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/66822b21413c5e011617ce48377c5005?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/66822b21413c5e011617ce48377c5005?s=96&d=mm&r=g\",\"caption\":\"Paul Cohen\"},\"url\":\"https:\/\/sonicviz.com\/author\/komuso\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Earthquake Data Scope - Sonicviz","description":"Earthquake interactive data visualization and data scope using dc.js","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/","og_locale":"en_US","og_type":"article","og_title":"Earthquake Data Scope - Sonicviz","og_description":"Earthquake interactive data visualization and data scope using dc.js","og_url":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/","og_site_name":"Sonicviz","article_published_time":"2016-10-27T15:58:52+00:00","article_modified_time":"2017-09-10T12:58:10+00:00","author":"Paul Cohen","twitter_misc":{"Written by":"Paul Cohen","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/","url":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/","name":"Earthquake Data Scope - Sonicviz","isPartOf":{"@id":"https:\/\/sonicviz.com\/#website"},"datePublished":"2016-10-27T15:58:52+00:00","dateModified":"2017-09-10T12:58:10+00:00","author":{"@id":"https:\/\/sonicviz.com\/#\/schema\/person\/8115792e586d39016845c396beb90e49"},"description":"Earthquake interactive data visualization and data scope using dc.js","breadcrumb":{"@id":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sonicviz.com\/2016\/10\/28\/earthquake-data-scope\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sonicviz.com\/"},{"@type":"ListItem","position":2,"name":"Earthquake Data Scope"}]},{"@type":"WebSite","@id":"https:\/\/sonicviz.com\/#website","url":"https:\/\/sonicviz.com\/","name":"Sonicviz","description":"Play Smart","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sonicviz.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/sonicviz.com\/#\/schema\/person\/8115792e586d39016845c396beb90e49","name":"Paul Cohen","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sonicviz.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/66822b21413c5e011617ce48377c5005?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/66822b21413c5e011617ce48377c5005?s=96&d=mm&r=g","caption":"Paul Cohen"},"url":"https:\/\/sonicviz.com\/author\/komuso\/"}]}},"_links":{"self":[{"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/posts\/1031"}],"collection":[{"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/comments?post=1031"}],"version-history":[{"count":0,"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/posts\/1031\/revisions"}],"wp:attachment":[{"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/media?parent=1031"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/categories?post=1031"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sonicviz.com\/wp-json\/wp\/v2\/tags?post=1031"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}