Recent Comments
Category Archives: Data engineering
I started vlogging about data mesh (and other things)
Last June I made a short video while walking in the park next to the DIKW Intelligence office. And I posted it on LinkedIn. To my surprise it did very well. So I thought: why not make more of these … Continue reading
Posted in Active Learning, Data engineering
Tagged data bike ride, data mesh, vlogging
Leave a comment
Photo locations, marker icons and displaying photos on my map
When I was finished last week with creating my video location map in Python, I thought “shame I can’t plot photo locations”. That’s because my Fuji X-T30 camera doesn’t store GPS info. When I bought the camera I assumed every … Continue reading
Posted in Data engineering, Howto, Python
Tagged exif, Folium, glyphicon, jpg, media_gpsplot, object oriented, Python, video location map
Leave a comment
Making my video location map even better with Folium
Yesterday I shared how I plotted locations of videos shot with my Sony FDR-X3000 camera on a map. I was already pretty happy. Then I got a tip from Twitter user Bob Haffner (@bobhaffner): why not use Folium to create … Continue reading
Posted in Data engineering, Howto, Python
Tagged Folium, pandas, Sony FDR-X3000, zoomable map
Leave a comment
Plotting video locations from my Sony camera in Python
Two years ago I bought a Sony FDR-X3000 actioncam to record video on my bike rides. And I’m really happy about it. It’s just great reliving my rides in 4K, going downhill for kilometers from some col I climbed. I … Continue reading
Posted in Data engineering, Howto, Python
Tagged geodata, matplotlib, pandas, Sidecar, Sony FDR-X3000, XML, xmldom
Leave a comment
My Github repo got 50 stars
I never imagined myself as a maintainer of a data engineering related open source thing. Yet. But when I was working on our data engineering course, I needed some kind of data lake software. At first I used the Cloudera … Continue reading
Posted in Apache Products for Outsiders, Data engineering
Tagged Docker, docker-compose, Github, Hadoop, stars
Leave a comment
Five years of data engineering
Five years ago I made the switch from Oracle database administration to data engineering. It has been quite a ride. I made a video about this to celebrate.
What a year 2021 has been
So at the end of 2021 I found myself in the waiting room of an emergency dentist. An infection above my front teeth became unbearable. Fortunately antibiotics makes my live much better now. Let that event not colour my view … Continue reading
Posted in Active Learning, Data engineering
Tagged astronomy, Certified Data Engineering Professional, cycling, Github, Hadoop, Kupka, Paris, vacation
Leave a comment
What I think data engineering is (revisited)
Four years now I’ve been working as a data engineer. And when I started writing about how to enter this field (because people sometimes ask me), I found out it’s beter to start writing about what data engineering actually is. … Continue reading