Data Engineer - Databricks

About the role

Ingrity is recruiting an experienced Data Engineer for a major financial services organisation undergoing a significant data modernisation programme. The role is based in Sydney or Brisbane on a hybrid basis, on a 12-month contract, and sits within a modern Databricks environment where you will build scalable data pipelines, transform complex datasets and help migrate legacy data platforms to a cloud-based lakehouse architecture.

Key responsibilities

• Design, develop and optimise data pipelines using Databricks, Python/PySpark and SQL.
• Build and maintain data transformations using dbt and Delta Lake.
• Develop scalable data models across Bronze, Silver and Gold layers.
• Support data migration from legacy platforms, including SAS.
• Implement data quality checks, testing and performance optimisation.
• Collaborate with data engineers, analysts and business stakeholders.

Required profile

• Strong hands-on experience with Databricks, PySpark and SQL.
• Experience with dbt, Delta Lake and lakehouse architecture.
• Proven experience developing and maintaining ETL/ELT pipelines.
• Experience with cloud platforms, ideally Azure or AWS.
• Understanding of CI/CD, data testing and production support.
• Experience in insurance or financial services highly regarded.

Required skills

• Databricks, PySpark, SQL
• dbt, Delta Lake, lakehouse architecture
• ETL/ELT pipelines
• Azure or AWS
• CI/CD, data testing, production support
• AI-assisted development tools such as GitHub Copilot or Databricks Genie are advantageous

What we offer

• Work on a large-scale data transformation program.
• A modern Databricks and cloud technology environment.
• A collaborative engineering team with hybrid flexibility.
• An opportunity to contribute to AI-enabled data engineering practices.