Work

Case Studies & Engagement Log

Data engineering, streaming, and AI work across source systems, stacks, and cloud providers. Filter by what you are actually looking for.

This system was built by our founders in senior engineering roles, before Data Sharks was founded. The architecture and outcomes are described as delivered.

3 entries

Streaming & CDC5M/day CDC Records Processed in 1h Batches

SAP ECC to Databricks Lakehouse: Enterprise CDC Architecture on Azure

Engagement: Global Industrial Manufacturer

Architected an enterprise Lakehouse solution migrating 5M daily CDC records from SAP ECC (Oracle) to Azure Databricks. Features ODP/OData ingestion, automated PySpark schema evolution & drift alerting, multi-tier data quality quarantine, and Serverless compute optimization.

SparkPythonSQL
AI Agents10-100 Daily Self-Serve Queries

AI-Powered Analytics Assistant

Engagement: Leading Enterprise Retailer

Built a conversational analytics assistant that converts natural language into cloud SQL, enabling business users to self-serve repeated data pulls in real time.

Enterprise LLMsRAGPythonSQL
ETL & ELT1M+ Cartons / Day

Large-Scale Traceability System

Engagement: Global Logistics Enterprise

Developed a distributed data traceability system with micro-batch incremental transformation models, versioned data contracts, and automated SLA alerting rules.

dbtAirflowSQL