All lessons
Pipeline to Dashboard: ETL, warehouses and BI, step by step
Build the pipelines that move data from email, shared drives and APIs into a warehouse, clean it, model it and put it on dashboards people trust: Python, Polars, DuckDB, Dagster, Azure SQL, dbt and Power BI, with a project at the end of every module.
What you will be able to do
- Get data in from anywhere: shared drives, email attachments, SharePoint and Google Drive, SFTP, APIs and source databases, landed safely and only once.
- Clean it so people trust it: profiling, data contracts, Polars and DuckDB transforms, duplicates and entity matching, and quality gates that quarantine bad rows.
- Run it on its own with Dagster: assets, partitions, backfills, schedules, sensors, retries and alerts.
- Load and model a warehouse: Azure SQL, Postgres, DuckDB and ClickHouse, star schemas, slowly changing dimensions and tested dbt models.
- Deliver dashboards that add up: fast Power BI models, correct DAX, refresh and security, and reconciliation that earns trust.
Every lesson has a step-by-step animation of the key operation, a plain-words meaning box, live problems with fresh numbers, a short quiz and a summary sheet to download. Each module ends with a project you can show an employer. Take pandas and Statistics first if they are new; go on to Data at Scale when you finish.
0 of 49 lessons done
Without the tick, your progress lasts until you close this tab. Either way it stays in this browser: there is no sign-up and nothing is sent to us.