Jobiglo

No results.

Senior Manager, AI Engineering and Validation

Macquarie Group · Sydney

New
Senior 🇬🇧 English
OWASP AI Testing Guide MITRE ATLAS Git Automated testing

Job description

About the role

The Model and AI Risk team at Macquarie provides independent oversight and challenge so that model and AI risks are well managed across the group. It assesses whether AI systems are fit for purpose, appropriately controlled and aligned with the firm's risk appetite and regulatory expectations. This Senior Manager role leads independent, risk-based validation of advanced AI systems and their control environments, initially focusing on security and risk assessments of agentic tools and frontier AI models used in cyber security, while also supporting other high-impact AI and agentic systems.

Key responsibilities

  • Lead end-to-end validation engagements, from scoping, testing and analysis through to reporting and closure
  • Evaluate reliability, robustness, harmful or erroneous outputs, susceptibility to manipulation, model limitations and control failures
  • Assess AI safety risks such as unsafe agent behaviour, excessive autonomy, unsafe tool usage and containment failures
  • Evaluate guardrails, agent harnesses, containment mechanisms, access and egress controls, monitoring and logging, and human oversight frameworks
  • Help develop validation methodologies for emerging AI risks where established approaches do not yet exist
  • Communicate findings, limitations and residual risks to technical and senior stakeholders
  • Provide technical direction, set testing strategies and quality standards, coach validators, challenge technical assessments and build reusable methodologies and tooling

Required profile

  • Significant hands-on experience engineering, evaluating, securing or assuring GenAI and agentic AI systems, especially in production or security-sensitive environments
  • Ability to lead complex technical engagements, exercise sound risk judgement and drive delivery through ambiguity
  • Strong communication skills, able to turn complex technical issues into clear risks, findings and recommendations
  • A curious, self-directed mindset staying current with evolving AI capabilities, safety risks and cyber threats

Required skills

  • Cyber security fundamentals for AI systems: identity and access management, secrets management, sandboxing and containment, network egress, software supply-chain risk, monitoring and logging
  • Knowledge of AI safety and security frameworks such as the OWASP AI Testing Guide and MITRE ATLAS, and threat modelling
  • Adversarial testing, AI red teaming or security testing, with reproducible tests and defensible evidence
  • Programming skills, Git, automated testing and reproducible development environments

What we offer

  • Wellbeing leave and up to 5 additional service bonus leave days per year
  • Paid parental leave and gender affirmation leave, plus volunteer leave and donation matching
  • Employee Assistance Program and wellbeing benefits
  • Salary packaging options and learning and development opportunities
  • Hybrid and flexible working, and reimbursement for work-from-home equipment

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Macquarie Group.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 10 hours ago

Expires 1 month from now

3 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Macquarie Group

Sydney