Principal Data Engineer Consultant – Azure Databricks & Microsoft Fabric

About the role

nexwave is seeking a Principal Data Engineer Consultant to design, build, and operate modern data platforms on Azure Databricks and Microsoft Fabric. The role is client‑facing, requiring end‑to‑end consulting from requirements gathering through delivery and enablement.

Key responsibilities

• Design and implement scalable data platforms using medallion architecture (bronze, silver, gold) on Azure Databricks and Microsoft Fabric.
• Develop metadata‑driven pipelines, reusable notebook patterns, and CI/CD workflows for data ingestion, transformation, and orchestration.
• Integrate source systems such as Salesforce, ERP, and other SaaS platforms into governed, AI‑ready lakehouse environments.
• Apply data governance, quality frameworks, lineage, and security controls using Microsoft Purview, role‑based access, and Azure Key Vault.
• Manage client solutions end‑to‑end, from design and delivery to handover and enablement.

Required profile

• Strong hands‑on experience with Databricks (Spark, Delta Lake, MLflow, Unity Catalog) and Microsoft Fabric components.
• Proficiency in Python, SQL, and PySpark, with solid Git and CI/CD practice.
• Experience delivering data platforms on Azure services (Data Factory, Synapse, Data Lake, Event Hubs) and implementing data governance.
• Ability to communicate clearly with technical teams and business stakeholders and work in agile, cross‑functional teams.

Required skills

• Azure Databricks
• Microsoft Fabric (Data Factory, notebooks, lakehouses, warehouses)
• Spark, Delta Lake, MLflow, Unity Catalog
• Python, SQL, PySpark
• Git, CI/CD for data pipelines
• Azure Data Factory, Azure Synapse, Azure Data Lake, Azure Event Hubs
• Microsoft Purview, Azure Key Vault
• Integration with Salesforce, ERP, SaaS platforms