Work

Case Studies & Engagement Log

Data engineering, streaming, and AI work across source systems, stacks, and cloud providers. Filter by what you are actually looking for.

1 entry

Streaming & CDC5M/day CDC Records Processed in 1h Batches

SAP ECC to Databricks Lakehouse: Enterprise CDC Architecture on Azure

Client: Global Industrial Manufacturer

Architected an enterprise Lakehouse solution migrating 5M daily CDC records from SAP ECC (Oracle) to Azure Databricks. Features ODP/OData ingestion, automated PySpark schema evolution & drift alerting, multi-tier data quality quarantine, and Serverless compute optimization.

SparkPythonSQL