Lead Data Engineer

About the role

The Lead Data Engineer will report to the Data Engineering Manager and provide technical leadership for the Data & Analytics platforms at iSelect and Compare the Market. You will shape the enterprise data stack, set engineering standards and deliver secure, high‑performing data solutions that enable reporting, analytics, AI and business innovation.

Key responsibilities

• Provide architectural oversight and technical mentorship across the Data & Analytics function, ensuring alignment with enterprise architecture, security and scalability.
• Own and optimise cloud data platforms, lakehouse environments, data integration, governance and AI readiness.
• Drive engineering excellence through DataOps, SecOps, CI/CD, IaC, automated testing, observability and platform automation.
• Ensure platform reliability, security, compliance and robust controls for data quality, lineage, metadata and privacy.
• Partner with stakeholders to drive innovation, emerging‑technology adoption and data‑AI maturity.

Required profile

• Minimum bachelor’s degree in Computer Science, Analytics, IT or related field.
• 10+ years of experience in Data Engineering, Analytics or related environments, including leadership of enterprise‑scale initiatives.
• Proven ability to define technology roadmaps, engineering standards and strategic platform investments.
• Strong stakeholder management, mentoring and team‑development skills.

Required skills

• Design, build and govern cloud‑based data platforms on AWS, Azure or GCP (data warehouses, lakehouses, data meshes).
• Experience with Databricks, Snowflake, Microsoft Fabric, Synapse, Redshift, BigQuery, Spark and streaming technologies.
• Implementation of DataOps, SecOps, CI/CD, IaC, DevOps, automated testing and observability.
• Deep knowledge of data governance, quality, metadata, lineage, security, privacy and regulatory compliance.
• Design of AI‑centric solutions including Generative AI, RAG, vector search, embeddings, MLOps and AI governance.

What we offer

• Flexible work arrangements – one day remote per week or a 9‑day fortnight.
• Additional leave options such as ‘ME’ leave, Volunteer Day leave and Return‑to‑Work bonus for parents.
• Vibrant community events, family fun days and regular social activities.
• Free coffee on Mondays and option to purchase extra leave.
• Quarterly award and recognition programme.