Work
Case Studies & Engagement Log
Data engineering, streaming, and AI work across source systems, stacks, and cloud providers. Filter by what you are actually looking for.
2 entries
Streaming & CDC5M/day CDC Records Processed in 1h Batches
SAP ECC to Databricks Lakehouse: Enterprise CDC Architecture on Azure
Client: Global Industrial Manufacturer
Architected an enterprise Lakehouse solution migrating 5M daily CDC records from SAP ECC (Oracle) to Azure Databricks. Features ODP/OData ingestion, automated PySpark schema evolution & drift alerting, multi-tier data quality quarantine, and Serverless compute optimization.
SparkPythonSQL
ETL & ELT1M+ Daily Events Processed
Large-Scale Traceability System
Client: Global Logistics Enterprise
Developed a distributed data traceability system with micro-batch incremental transformation models, versioned data contracts, and automated SLA alerting rules.
dbtAirflowSQL