Principal Data Engineer

About the role

An established enterprise data team in Sydney is looking for a Principal Data Engineer to lead and own the design and development of scalable, secure data solutions on AWS. The role is described as permanent, with a 50/50 hands-on split, and involves architecting and optimising data pipelines, mentoring engineers and collaborating with stakeholders on high-performance data products. There is also an opportunity to implement SageMaker.

Key responsibilities

• Lead end-to-end data platform architecture
• Design scalable data lake and data mesh solutions
• Build reusable data engineering frameworks and tools
• Partner with stakeholders to deliver effective data solutions
• Drive DataOps, CI/CD, automation and observability
• Embed security, privacy, governance and reliability

Required profile

• 10+ years of data engineering experience
• Proven experience leading data platform design and governance
• Strong knowledge of distributed systems and data architecture

Required skills

• Strong AWS data platform and pipeline experience
• Expertise in Python, Spark, dbt and Airflow
• Experience with Redshift, Iceberg and data lakehouse patterns