Principal Data Engineer (AWS)

About the role

The Capital Provisioning Modelling Crew builds and runs the platforms that support credit risk models, which feed group risk management, front-line business processes and regulatory reporting such as loss provisioning and portfolio analysis. As a Principal Engineer you will shape the engineering direction of platforms that enable data consumption, model execution and deployment at scale, within strong governance and control requirements.

Key responsibilities

• Define and drive platform strategy for capital provisioning modelling
• Architect and build cloud-native AWS platforms supporting model and data workloads
• Provide thought leadership on technical solutions, data security and data management
• Design solutions that consume and operationalise enterprise data marketplace assets
• Lead engineering patterns for model and ML deployment, orchestration and monitoring
• Drive migration from legacy platforms to strategic, governed environments
• Ensure alignment with Model Risk Management, regulatory and audit requirements, including data lineage, reproducibility and strong controls
• Partner with modelling teams to productionise models and improve reliability and performance
• Influence architecture and engineering decisions across crews and domains, set engineering standards and mentor engineers

Required profile

• Experience building cloud-native data and model platforms at scale
• Experience productionising models or ML workloads
• Experience building frameworks and tools that improve engineering productivity
• Understanding of data integrity, reconciliation and accuracy in financial systems
• Able to influence across teams and align stakeholders on technical direction
• Comfortable balancing technical debt with long-term platform strategy

Required skills

• AWS (S3, EMR, Glue, Lambda, Redshift, SageMaker or similar)
• Snowflake or enterprise data platforms / data marketplace patterns
• Python, PySpark and distributed data processing
• Batch and streaming pipelines (Airflow, Spark, Glue)
• CI/CD, automated testing and infrastructure-as-code
• Observability, monitoring and reliability practices
• Strong SQL and relational database experience

Commonwealth Bank offers flexible work locations, with at least half the time each month spent in the office, plus part-time and job-share options. Applicants who are already part of the Commonwealth Bank Group must apply through its internal application system.