Monthly Archives: May 2017

Building HDP 2.6 on AWS, Part 2: the master nodes

Posted on May 26, 2017 by Marcel-Jan Krijgsman

This is part 2 in a series on how to build a Hortonworks Data Platform 2.6 cluster on AWS. In part 1 we created an edge node where we will later install Ambari Server. The next step is creating the … Continue reading →

Posted in Howto, Learning Big Data | Tagged , , , , , , , | 5 Comments

Building HDP 2.6 on AWS, Part 1: the edge node

Posted on May 15, 2017 by Marcel-Jan Krijgsman

Installing Hortonworks Data Platform 2.6 on Amazon Web Services (Amazon’s cloud platform), how hard could it be? It’s click, click, next, next, confirm, right? Well-lll, not quite. Especially if HDP or AWS is new to you. There are many steps … Continue reading →

Posted in Howto, Learning Big Data | Tagged , , , , , , | 2 Comments

Quickly start of the Nifi crash course

Posted on May 11, 2017 by Marcel-Jan Krijgsman

As I said last in my last blogpost, I have followed the Apache NiFi crash course that Hortonworks provides. Now the tutorial describes several different scenarios and options and you have to read through that to find which you want. … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , | 2 Comments

The new product anxiety cycle

Posted on May 9, 2017 by Marcel-Jan Krijgsman

Am I the only one who has this? Let me know. Phase 1: Discovery of New Product Suddenly everybody talks about New Product. It’s said it changes everything. Articles about New Product appear on Hacker News for weeks. Then colleagues … Continue reading →

Posted in Uncategorized | Tagged , , | 1 Comment

My first experiences with Apache NiFi

Posted on May 5, 2017 by Marcel-Jan Krijgsman

There are a lot of data-related Apache products out there and it’s hard to keep up with all of them. There are several products to stream or flow data (what’s the difference?). Like Kafka, Storm, Flink and NiFi. Yes, all … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , , , , , | 2 Comments