Principal Data Engineer

About the role

Medibank is looking for a Principal Data Engineer to lead the technical vision and engineering excellence of its next‑generation data platforms. You will operate at the intersection of strategy and hands‑on engineering, partnering with architects, engineers, data scientists and business leaders to design robust, scalable and secure data solutions.

Key responsibilities

• Define and drive the technical roadmap for Databricks, enterprise data pipelines and AI/ML capabilities.
• Lead design and implementation of scalable lakehouse architectures and enterprise‑grade data platforms.
• Establish engineering standards, frameworks and best practices across the organisation.
• Mentor and coach engineers, fostering a culture of continuous learning and technical excellence.
• Contribute to a Data Platform Centre of Excellence and support globally distributed teams.
• Champion modern DataOps and MLOps practices, including CI/CD, automated testing and platform observability.

Required profile

• 10+ years of experience in Data Engineering or Software Engineering.
• 5+ years working with Databricks or large‑scale Spark platforms.
• Proven experience defining technical strategy and influencing enterprise architecture.
• Experience leading engineering teams across multiple regions.

Required skills

• Databricks (Delta Lake, Unity Catalog, MLflow, Databricks SQL)
• PySpark, Spark SQL, lakehouse architecture design
• Data modelling (dimensional, Data Vault, feature store)
• Orchestration tools (Airflow, Databricks Workflows, Azure Data Factory)
• MLOps practices (model monitoring, automated retraining, CI/CD for ML)
• CI/CD tooling (GitHub Actions, Azure DevOps, Jenkins)
• Infrastructure as Code (Terraform, ARM/Bicep, CloudFormation)
• Python, SQL, REST APIs, event streaming (Kafka, Kinesis)
• Azure services (ADLS, Synapse, Event Hub, Key Vault)
• BI tools (Power BI, Tableau)