Data Engineer

About the role

Reporting to the BHF Project Program Manager within the Delivery Services Branch, you will work with delivery teams, support staff and subject‑matter experts to build a modern, cloud‑based business intelligence solution for Queensland Health. The role focuses on creating a centralised data and analytics platform that delivers near‑real‑time patient flow insights and predictive analytics.

Key responsibilities

• Design and implement a scalable, secure data platform on Azure using Databricks, Spark and Delta Lake.
• Develop batch and near‑real‑time ingestion pipelines to consolidate operational health datasets.
• Perform data modelling, conformance and quality validation to support analytics and reporting.
• Apply CI/CD practices for pipeline deployment and release management.
• Document data workflows, transformations and lineage, and communicate with stakeholders.

Required profile

• Strong data‑engineering experience in enterprise environments.
• Proficiency with Databricks (Spark, Delta Lake) and SQL for pipeline development.
• Experience building batch and near‑real‑time ingestion pipelines.
• Hands‑on knowledge of Azure data platform components, MS SQL and Oracle.
• Ability to document data processes and communicate clearly with stakeholders.

Required skills

• Databricks
• Spark
• Delta Lake
• SQL
• Azure data platform
• MS SQL
• Oracle
• CI/CD for data pipelines
• Power BI (semantic models and reporting)