Category Archives: Apache Products for Outsiders

My Github repo got 50 stars

Posted on March 19, 2022 by Marcel-Jan Krijgsman

I never imagined myself as a maintainer of a data engineering related open source thing. Yet. But when I was working on our data engineering course, I needed some kind of data lake software. At first I used the Cloudera … Continue reading →

Posted in Apache Products for Outsiders, Data engineering | Tagged , , , , | Leave a comment

Gaining insights on my workout data with Apache Superset

Posted on October 24, 2021 by Marcel-Jan Krijgsman

For a few years I’ve been gathering data on my workouts. In Excel. It’s not exactly state of the art data architecture, but it was fine for a while. But data alone doesn’t do much. I wanted some questions answered. … Continue reading →

Posted in Apache Products for Outsiders, Howto | Tagged , , , , , | Leave a comment

Hadoop in a Hurry – Security

Posted on January 11, 2018 by Marcel-Jan Krijgsman

When talking about Hadoop security there are so many products and features. What do all of them do? This video gives a high over overview.

Posted in Apache Products for Outsiders | Tagged , , , , , , , , , | Leave a comment

Recovering your HDP 2.6.1 Sandbox on VirtualBox after a restart

Posted on November 17, 2017 by Marcel-Jan Krijgsman

If you’ve worked with the Hortonworks Data Platform 2.x sandbox of later versions in VirtualBox and made it shutdown rather vigorously, you might have noticed that you won’t get past this startup screen when you try to start it up … Continue reading →

Posted in Apache Products for Outsiders, Howto | Tagged , , , , , , , , , | 2 Comments

Tutorial: Let’s throw some asteroids in Apache Hive

Posted on November 14, 2017 by Marcel-Jan Krijgsman

This is a tutorial on how to import data (with fixed lenght) in Apache Hive (in Hortonworks Data Platform 2.6.1). The idea is that any non-Hive, non-Hadoop savvy people can follow along, so let me know if I succeeded (make … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , , , , , | Leave a comment

Hadoop High Availability In A Hurry – Part 2: YARN

Posted on July 24, 2017 by Marcel-Jan Krijgsman

If you don’t know a lot about YARN and why it’s called a data operating system, you’re in luck. I found it necessary to explain how YARN works before I could explain the solutions for high availability. At first YARN … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , , , | 1 Comment

Hadoop High Availability In A Hurry – Part 1: HDFS

Posted on June 26, 2017 by Marcel-Jan Krijgsman

I’ve been studying for a couple of hours how Hadoop high availability works, for the HDPCA exam. And now I’ve condensed that knowledge to a video on HDFS HA in just under 9 minutes. Enjoy!

Posted in Apache Products for Outsiders | Tagged , , , , , , , , , , , | 1 Comment

Quickly start of the Nifi crash course

Posted on May 11, 2017 by Marcel-Jan Krijgsman

As I said last in my last blogpost, I have followed the Apache NiFi crash course that Hortonworks provides. Now the tutorial describes several different scenarios and options and you have to read through that to find which you want. … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , | 2 Comments

My first experiences with Apache NiFi

Posted on May 5, 2017 by Marcel-Jan Krijgsman

There are a lot of data-related Apache products out there and it’s hard to keep up with all of them. There are several products to stream or flow data (what’s the difference?). Like Kafka, Storm, Flink and NiFi. Yes, all … Continue reading →

Posted in Apache Products for Outsiders | Tagged , , , , , , , , | 2 Comments