Migrating a Dagster Pipeline from Pandas to Polars and Delta Lake
Why and how I'm migrating a production ETL pipeline from Pandas/SQLite to Polars/Delta Lake with a medallion architecture.
- healthcare-dag
- Dagster
- Polars
- Delta Lake
- Pandas
- data engineering
- medallion architect…