•Designed and deployed a scalable Azure Databricks pipeline using PySpark, DeltaLake, and Autoloader to enable incremental data ingestion following the Medallion architecture. • Orchestrated a star-schema pipelines with SCD Type 1 & 2, surrogate keys, and automated fact tables for robust dimensional modeling. • Integrated Lakeflow/DLT and DBT to deliver declarative ETL workflows with automated data quality validation. • Improved transformation performance by 3x through optimized Spark configurations and adaptive query execution for near real-time analytics.