You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
End-to-end Azure Databricks retail data engineering project using Medallion Architecture (Bronze, Silver, Gold). Implements Auto Loader, Unity Catalog, Delta Lake, SCD Type 1 & 2 dimensions, and Fact Orders for analytics-ready star schema modeling.
End-to-end Metadata-Driven Data Engineering framework built on Azure. Features dynamic SQL/REST API ingestion with range pagination, automated schema mapping, and event-driven orchestration. Implements robust CI/CD via GitHub Actions/YAML and automated failure alerting with Logic Apps. Optimized for scalability and DE best practices.
End-to-end Azure Data Engineering pipeline for migrating retail sales data from AWS S3 to ADLS Gen2, transforming data with Azure Data Factory, and loading curated data into Azure SQL Database.
An automated end-to-end Data Lakehouse on Azure utilizing ADF and Synapse Analytics to ingest, clean, and enrich environmental sensor data via the BrightSky API.
☁️ Serverless CDC pipeline replicating PostgreSQL 🐘 changes to BigQuery 🔍 using Google Cloud Datastream 📄🌊 for real-time operational analytics 📈 and low-latency data synchronization 🔄
Azure medallion lakehouse for NYC 311 service-request analytics using ADF, ADLS Gen2, Databricks/PySpark, Delta Lake, data-quality checks, dimensional modeling, and Power BI-ready marts.
Production-style Slowly Changing Dimension (SCD Type 2) pipeline built with Snowflake, dbt, and AWS S3. Demonstrates secure S3 ingestion, layered bronze/silver/gold modeling, dbt snapshots for historical tracking, and analytics-ready views identifying active vs historical records.
End-to-end Azure data engineering pipeline implementing a medallion architecture — ingesting AdventureWorks sales data via Azure Data Factory, transforming with Databricks/PySpark into Delta Lake bronze/silver/gold layers on ADLS Gen2, served through Synapse Analytics.
Demonstrates modern data engineering with Google Cloud Dataform and BigQuery. Create SQLX views and tables, manage dependencies, apply least-privilege IAM, and execute scalable serverless ELT workflows.