All Articles
Thoughts on data engineering, pipelines, the modern data stack, and lessons learned in production.
3 articles total
Oracle V1 to V2 Connector Migration in ADF — The Parquet Precision Bug That Nearly Broke Production
Everything looked fine — connection worked, preview worked, pipelines validated. Then runtime hit and all hell broke loose. Here's the hidden precision issue Oracle V2 introduced and the exact fixes that work.
Stop Checking Workflows Manually — Build a Centralized Databricks Monitoring Dashboard
If you manage 10–15 Databricks workspaces with hundreds of workflows each, clicking through every job to check status is killing your productivity. Here's the exact step-by-step process to build a fully automated monitoring dashboard using the Databricks Jobs API, Delta tables, and Databricks Dashboards.
I Built a Full Retail Analytics Platform in 1 Week Using Genie Code — Here's Everything That Happened
What would normally take 20–30 days of manual development — ingestion from three sources, Medallion Architecture transformation, semantic layer, dashboards, and natural language analytics — was delivered in one week using Databricks Genie Code, Lakeflow Connect, and Spark Declarative Pipelines. Here's the honest account of how it went.