Large finance conglomerate · 5 lending businesses
Disparate sources to an Azure Databricks lakehouse, for regulatory reporting
Disparate source systems→ADF · Azure Databricks · Delta Lake · Unity Catalog
A lender whose largest businesses are vehicle and personal loans. We migrated data from disparate sources across its five lines of business to Azure Databricks, and built the pipelines behind its regulatory reporting.
Multi-TB
medallion lakehouse
1,000s
ETL jobs running smoothly
On time
reliable regulatory reports
NBFC · Financial services
On-prem Hadoop to serverless AWS
Hadoop · Hive · Oozie→Spark · EMR · Step Functions · Lambda
A growing on-prem cluster was missing data SLAs. Hive ETL was lifted and shifted to Spark SQL with our no-code Elastic Data Platform, onto pay-per-use serverless AWS.
City council · Public sector
Oracle to Snowflake, in near real time
Oracle 19c→Kafka · Snowflake
1.2 billion records from HCM and ERP apps moved to a Snowflake reporting warehouse with a custom Kafka-based pipeline: full first load, then incremental sync.
Telecom data solutions provider
Proprietary stack to a petabyte-scale open-source lake
Proprietary hardware & software→Hadoop · Spark · REST query layer
A usage-records platform serving Tier-1 telecoms was missing retrieval SLAs as 4G drove data to multi-petabyte scale. We moved it to an open-source big data lake on commodity hardware.
AdTech platform
MapReduce to Spark, Avro to Parquet
MapReduce · Avro→Spark · Parquet · CI/CD
For a platform serving 70 billion ad impressions a day on a 600-node cluster, we migrated transformation workflows to Spark, moved storage to Parquet and automated deployment.