Recent Comments
Tag Archives: Python
My experiences with agentic AI
Originally I wanted to write a blogpost about what data engineers are going to do with AI writing their code. But before I can write that, I need to share my experiences so far. Because from this you’ll get an … Continue reading
Profiling data with ydata in PySpark
When you got a dataset to explore, there are several ways to do that in PySpark. You can do a describe or a summary. But if you want something a little more advanced, and if you want to get a … Continue reading
Posted in Data management, Python, Spark
Tagged data profiling, data quality, PySpark, Python
Leave a comment
Things I learned about Azure Data Fabric
Currently I’m helping colleagues to read open data in Azure Data Fabric. Here are some of my experiences with it. I don’t want to do an extensive description of what Data Fabric is. In short, if you have an organisational … Continue reading
Posted in Azure, Cloud, Things I Learned
Tagged azure, Data Fabric, Data Factory, Lakehouse, Notebook, Python, Things I Learned
Leave a comment
A great time at PyCon Ireland 2024
I think it was last year when I announced that I wanted to go back to conferences again. Preferably as a speaker. But what conference is the best for data engineers? I couldn’t quite figure it out. Then the call … Continue reading
Using OCR to get data from my Robi scale
How it started For several years I kept track of my weight and fat with a Soehnle Body Balance, which I bought in 2018. That worked quite well until I saw more and more these weird deviations. Take a look … Continue reading
Showing a gift total on a Raspberry Pi with an e-ink display – how hard could it be?
TL;DR: These Python and Raspberry Pi projects. They are fun aren’t they? And often they look deceptively simple. But you don’t see all the projects that failed and usually not where they struggled. This project got stuck (and almost failed) … Continue reading
Posted in Howto, Python
Tagged chromium browser, e-ink display, failure, Python, Raspberry Pi, requests-html, scraping
Leave a comment
Categorising text with ChatGPT. Results may be messy.
I have a hobby project I’m working on. It’s an astronomy news feed reader. Long story short: I currently gather links to interesting articles about astronomy by hand. And I want to automate this, so that I have more time … Continue reading
A Strava dashboard on a Raspberry Pi (Part 3): The Strava API
This is part 3 of a series of blogposts on how I created a Strava dashboard on a Inky Impression e-ink display with a Raspberry Pi. OAuth2 This was the part that I expected to be the hard part: getting … Continue reading
Posted in Howto, Python
Tagged API, Graziano Fuccio, Oauth2, Python, strava, stravainky_dashboard.py
7 Comments
Using Stable Diffusion to create images for a presentation
Have you heard about text-to-image models like DALL-E 2, Stable Diffusion and MidJourney? These are AI algorithms that take in text (the “prompt”) that describes what kind of picture you want as input and as output the algorithm creates that … Continue reading
Posted in Weird experiments
Tagged Death by Powerpoint, ImaginAIry, Python, Stable Diffusion, text-to-image
Leave a comment
Adding the track of my bike ride on a Folium map
Having markers of videos and photos taken during my bike ride is cool and all, but how about having a track of the bike ride itself? All my bike rides are registered on Strava, the cycling and running app. Strava … Continue reading