Hands on experience with Azure data platform stack (Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions) Experience with dimensional modeling and data warehousing concepts Experience with designing, building, optimizing, troubleshooting end-to-end big data pipelines using structured (relational and files) and semi-structured data Experience with building metadata driven data processing frameworks Strong experience in Spark, SQL, python, Pyspark, shell scripting