-
Recent Posts
Recent Comments
- Mart Laurano on I built a working Hadoop-Spark-Hive cluster on Docker. Here is how.
- Marcel-Jan Krijgsman on I tried Lion’s Mane as a cognitive enhancer. Here are my experiences with it.
- B on I tried Lion’s Mane as a cognitive enhancer. Here are my experiences with it.
- Suresh Vemuri on I built a working Hadoop-Spark-Hive cluster on Docker. Here is how.
- Suresh Vemuri on I built a working Hadoop-Spark-Hive cluster on Docker. Here is how.
Archives
- May 2022
- April 2022
- March 2022
- January 2022
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- February 2021
- October 2020
- November 2019
- September 2019
- June 2019
- April 2019
- March 2019
- January 2019
- December 2018
- May 2018
- April 2018
- February 2018
- January 2018
- December 2017
- November 2017
- August 2017
- July 2017
- June 2017
- May 2017
- April 2017
- February 2017
Categories
Meta
-
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
Category Archives: Data engineering
Photo locations, marker icons and displaying photos on my map
When I was finished last week with creating my video location map in Python, I thought “shame I can’t plot photo locations”. That’s because my Fuji X-T30 camera doesn’t store GPS info. When I bought the camera I assumed every … Continue reading
Posted in Data engineering, Howto, Python
Tagged exif, Folium, glyphicon, jpg, media_gpsplot, object oriented, Python, video location map
Leave a comment
Making my video location map even better with Folium
Yesterday I shared how I plotted locations of videos shot with my Sony FDR-X3000 camera on a map. I was already pretty happy. Then I got a tip from Twitter user Bob Haffner (@bobhaffner): why not use Folium to create … Continue reading
Posted in Data engineering, Howto, Python
Tagged Folium, pandas, Sony FDR-X3000, zoomable map
Leave a comment
Plotting video locations from my Sony camera in Python
Two years ago I bought a Sony FDR-X3000 actioncam to record video on my bike rides. And I’m really happy about it. It’s just great reliving my rides in 4K, going downhill for kilometers from some col I climbed. I … Continue reading
Posted in Data engineering, Howto, Python
Tagged geodata, matplotlib, pandas, Sidecar, Sony FDR-X3000, XML, xmldom
Leave a comment
My Github repo got 50 stars
I never imagined myself as a maintainer of a data engineering related open source thing. Yet. But when I was working on our data engineering course, I needed some kind of data lake software. At first I used the Cloudera … Continue reading
Posted in Apache Products for Outsiders, Data engineering, Learning Big Data
Tagged Docker, docker-compose, Github, Hadoop, stars
Leave a comment
Five years of data engineering
Five years ago I made the switch from Oracle database administration to data engineering. It has been quite a ride. I made a video about this to celebrate.
Posted in Active Learning, Data engineering, Learning Big Data
Tagged data engineering
Leave a comment
What a year 2021 has been
So at the end of 2021 I found myself in the waiting room of an emergency dentist. An infection above my front teeth became unbearable. Fortunately antibiotics makes my live much better now. Let that event not colour my view … Continue reading
Posted in Active Learning, Data engineering
Tagged astronomy, Certified Data Engineering Professional, cycling, Github, Hadoop, Kupka, Paris, vacation
Leave a comment
What I think data engineering is (revisited)
Four years now I’ve been working as a data engineer. And when I started writing about how to enter this field (because people sometimes ask me), I found out it’s beter to start writing about what data engineering actually is. … Continue reading
Tech dossier: pandas
I’m keeping tech dossiers in Evernote on open source products I want to keep track of. And I decided to put them on my blog. My previous ones were on Kubernetes and Elasticsearch. This one is on the Python data … Continue reading
Posted in Data engineering, Python, Tech dossier
Tagged data manipulation, multiindex, pandas, programming, Python, Tech dossier
Leave a comment