Expedition Data

February 2021

Data engineering

Don’t do data management just because you have to

Lately more and more organizations are doing data management. Suddenly there are data owners, data stewards and metadata repositories (in whatever form) everywhere. We all seem to do this mainly because we have to. Because of the GDPR or the California Consumer Privacy Act (CCPA). Or because other institutions demand we can explain where our data comes from.

But in my oppinion there is one important reason that mostly is overlooked. One that nevertheless has an important positive impact on business results, but also doesn’t seem to end up in the KPI’s. And that is how much time it takes to find the right data when building data products. (more…)

By Marcel-Jan Krijgsman, 6 yearsFebruary 3, 2021 ago

Recent Posts

  • Migrating from Evernote to Obsidian
  • Data modelling – the detective work you need to do to understand your source data.
  • Data engineering in the European cloud – Part 3: Adding data and visualisations
  • Data engineering in the European cloud – Part 2: Scaleway
  • Data engineering in the European cloud – Part 1: the plan

Recent Comments

  1. Vincent on inkystarmap – an always up to date starmap on the wall
  2. Data modelling – the detective work you need to do to understand your source data. – Expedition Data on Profiling data with ydata in PySpark
  3. Data engineering in the European cloud – Part 3: Adding data and visualisations – Expedition Data on Data engineering in the European cloud – Part 1: the plan
  4. Data engineering in the European cloud – Part 2: Scaleway – Expedition Data on Data engineering in the European cloud – Part 1: the plan
  5. What I learned from using OCR to get data from my weighing scale | Expedition Data on Using OCR to get data from my Robi scale

Archives

  • June 2026
  • February 2026
  • January 2026
  • November 2025
  • July 2025
  • June 2025
  • May 2025
  • April 2025
  • November 2024
  • May 2024
  • April 2023
  • December 2022
  • October 2022
  • August 2022
  • July 2022
  • May 2022
  • April 2022
  • March 2022
  • January 2022
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • February 2021
  • October 2020
  • November 2019
  • September 2019
  • June 2019
  • April 2019
  • March 2019
  • October 2018
  • September 2018
  • May 2018
  • April 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • February 2017

Categories

  • Active Learning
  • AI and LLMs
  • Apache Atlas
  • Apache Products for Outsiders
  • Azure
  • Cloud
  • Conferences
  • Data engineering
  • Data engineering in the European cloud
  • Data management
  • Events
  • Howto
  • Kubernetes
  • NoSQL
  • Python
  • Spark
  • Tech dossier
  • Things I Learned
  • Uncategorized
  • Weekendlinks
  • Weird experiments

Hestia | Developed by ThemeIsle