Posts tagged "Python"

Imagine: you corrupt production data and need to recover without backups or downtime. Here's how Delta Lake's version history saves the day.

Plotly's 3D scatter plots with animation frames make sensor data feel alive instead of just numbers in a CSV.

The journey from no tests to data-driven testing with pytest fixtures, mock resources, and proper asset validation.

How I learned to test Dagster assets properly using mock resources and pytest fixtures, moving from brittle tests to reliable ones.

Turns out full table overwrites beat complex merge logic for most real-world data pipelines

Building column-level encryption for healthcare PII taught me that the simplest solution is often dropping the data entirely

I built encryption, then realized anonymization with irreversible hashing was the right answer all along

DuckDB plus delta-rs gives you Delta Lake in pure Python without the JVM overhead

Building a complete data pipeline from legacy Firebird databases to clean analytics with Delta Lake medallion architecture

How Delta Lake's schema merge mode turned schema changes from incidents into non-events