Lead Data Engineer

About the role

Endava is expanding its Australian Data & AI capability and is looking for a Lead Data Engineer in Melbourne. You will help clients design, build and operate reliable data platforms that turn complex data into business insights, working across the data lifecycle from architecture and source integration through to pipelines, semantic models, visualisation and reporting. You will work closely with clients, analysts, data scientists and fellow engineers.

Key responsibilities

• Work directly with clients to translate business requirements into technical solutions and contribute to design decisions.
• Design, build and maintain data pipelines that ingest, transform and deliver data from sources such as APIs.
• Develop solutions using Databricks, Snowflake or Microsoft Fabric, suited to each client's needs and environment.
• Contribute to data architecture, including storage, integration and modelling, and develop data models, ontologies and semantic layers.
• Implement pipeline orchestration, scheduling, monitoring and operational support, and troubleshoot issues to improve performance, scalability and cost.
• Apply data quality controls, automated testing, RBAC and security best practices, and use DevOps practices including version control, CI/CD and automated deployment.
• Build data visualisations and reports, document solutions, review code and share knowledge.

Required profile

• Hands-on experience delivering production data solutions with Databricks, Snowflake or Microsoft Fabric.
• Strong Python and SQL skills.
• Experience designing, developing and operating data pipelines, including ETL/ELT, orchestration and monitoring.
• Understanding of data architecture, analytical and dimensional modelling, and ontologies and semantic modelling.
• Experience with API integration, RBAC, Git, automated testing, CI/CD, and data visualisation.
• Ability to explain technical choices clearly and guide other engineers.

Required skills

• Python and SQL
• Databricks, Snowflake or Microsoft Fabric
• ETL/ELT pipelines, orchestration and monitoring
• Analytical and dimensional modelling
• Git, CI/CD, RBAC
• Useful additional: PostgreSQL, SQL Server, BigQuery or Redshift; R or other languages; Azure, AWS or Google Cloud; Databricks, Snowflake or Fabric certifications

What we offer

• Flexible, hybrid working with 20 work-from-anywhere days per year.
• Monthly lifestyle allowance, loyalty leave and inclusive parental leave.
• Well-being allowance, employee assistance programmes and career pathways with non-linear progression.