{"id":559,"date":"2018-05-13T11:36:49","date_gmt":"2018-05-13T11:36:49","guid":{"rendered":"http:\/\/marcel-jan.eu\/datablog\/?p=559"},"modified":"2018-05-13T11:41:41","modified_gmt":"2018-05-13T11:41:41","slug":"making-a-hertzsprung-russell-diagram-from-gaia-dr2-data-with-elasticsearch","status":"publish","type":"post","link":"https:\/\/marcel-jan.eu\/datablog\/2018\/05\/13\/making-a-hertzsprung-russell-diagram-from-gaia-dr2-data-with-elasticsearch\/","title":{"rendered":"Making a Hertzsprung-Russell diagram from Gaia DR2 data with Elasticsearch"},"content":{"rendered":"<p>Elasticsearch was one of the open source products on my list to try out, ever since I got rejected for a couple of assignments as a consultant last year. Apparently it&#8217;s a popular product. But why do you need a search engine in a Big Data architecture? This I explain in my new video where I load newly released data from ESA&#8217;s Gaia mission in Elasticsearch with Logstash and visualize it with Kibana.<\/p>\n<p><iframe loading=\"lazy\" title=\"Making a Hertzsprung-Russell diagram from Gaia data with Elasticsearch\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/4UilfVKf_cA?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>I&#8217;ve also created an extra video wherein I explain how the code works.<\/p>\n<p><iframe loading=\"lazy\" title=\"The code behind the Hertzsprung-Russell diagram from Gaia data\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/8RUv9XAeUUg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>You can get the code I&#8217;ve used at <a href=\"https:\/\/github.com\/Marcel-Jan\/fun-with-Gaia\">my Github page<\/a>.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Elasticsearch was one of the open source products on my list to try out, ever since I got rejected for a couple of assignments as a consultant last year. Apparently it&#8217;s a popular product. But why do you need a search engine in a Big Data architecture? This I explain [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[102],"tags":[147,17,150,145,146,143,144,149,148],"class_list":["post-559","post","type-post","status-publish","format-standard","hentry","category-nosql","tag-2001-a-space-odyssey","tag-elasticsearch","tag-frank-kane","tag-gaia","tag-hertzsprung-russell-diagram","tag-kibana","tag-logstash","tag-udemy","tag-vega"],"_links":{"self":[{"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/posts\/559","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/comments?post=559"}],"version-history":[{"count":6,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/posts\/559\/revisions"}],"predecessor-version":[{"id":799,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/posts\/559\/revisions\/799"}],"wp:attachment":[{"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/media?parent=559"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/categories?post=559"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marcel-jan.eu\/datablog\/wp-json\/wp\/v2\/tags?post=559"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}