Building Data Pipelines with Dagster: Practical
I am always looking for ways to improve my data pipelines, and Dagster has been really good to me so far. I am definitely planning on diving further into it in the future but my initial experience...
I am always looking for ways to improve my data pipelines, and Dagster has been really good to me so far. I am definitely planning on diving further into it in the future but my initial experience...
taking it personally. NYC Restaurant Inspections Data Pull When I was making the DuckDB posts, I wanted to include some code to show how to pull the data from the NYC Open Data portal. In the int...
Hoping for an A. In Part I , we got our feet wet by performing initial data explorations on the NYC restaurant inspection dataset directly from a CSV file. We saw how DuckDB allows for quick insig...
Hoping for an A. Pandas has been my go-to tool for data manipulation in Python for years. So great for me, right? End of blog post. Except… “If the only tool you have is a hammer, you will see ...
If only there was a better way. Tired of anxiously peering down a dark subway tunnel, wondering when your train will actually arrive, or opening an app that asks you to scroll through every line ...
Twas a cookie, with scant but the scent of a lemon. For weeks now, I’ve been on a quiet, personal quest: the search for the perfect lemon cookie. It’s not some grand, dramatic saga; it’s just a s...
Protecting your data is crucial, and having automated backups is a cornerstone of any robust data strategy. In this post, I’ll walk you through a Python script that automatically backs up your SQL ...
Sort of a fairytale… Almost everything about CRISPR sounds magical, even its origins. Some of the first living organisms, are attacked by viruses, few survive. Some evolve an ability that allows t...
The Effective and Unobtrusive ‘uv’ Python Package Manager I really like ‘uv’. I know controversial opinion, but I am not afraid of what the bureaucrats in city hall will say. I never really felt l...
Quick Intro: Web Automation with Selenium It took me a while before I was able to interact with the pop-up on the website I was trying to scrape. I know people swear by Playwright, but I feel like ...