Senior Manager, AI Engineering and Validation
Macquarie Group · Sydney
Job description
About the role
The Model and AI Risk team at Macquarie provides independent oversight and challenge so that model and AI risks are well managed across the group. It assesses whether AI systems are fit for purpose, appropriately controlled and aligned with the firm's risk appetite and regulatory expectations. This Senior Manager role leads independent, risk-based validation of advanced AI systems and their control environments, initially focusing on security and risk assessments of agentic tools and frontier AI models used in cyber security, while also supporting other high-impact AI and agentic systems.
Key responsibilities
- Lead end-to-end validation engagements, from scoping, testing and analysis through to reporting and closure
- Evaluate reliability, robustness, harmful or erroneous outputs, susceptibility to manipulation, model limitations and control failures
- Assess AI safety risks such as unsafe agent behaviour, excessive autonomy, unsafe tool usage and containment failures
- Evaluate guardrails, agent harnesses, containment mechanisms, access and egress controls, monitoring and logging, and human oversight frameworks
- Help develop validation methodologies for emerging AI risks where established approaches do not yet exist
- Communicate findings, limitations and residual risks to technical and senior stakeholders
- Provide technical direction, set testing strategies and quality standards, coach validators, challenge technical assessments and build reusable methodologies and tooling
Required profile
- Significant hands-on experience engineering, evaluating, securing or assuring GenAI and agentic AI systems, especially in production or security-sensitive environments
- Ability to lead complex technical engagements, exercise sound risk judgement and drive delivery through ambiguity
- Strong communication skills, able to turn complex technical issues into clear risks, findings and recommendations
- A curious, self-directed mindset staying current with evolving AI capabilities, safety risks and cyber threats
Required skills
- Cyber security fundamentals for AI systems: identity and access management, secrets management, sandboxing and containment, network egress, software supply-chain risk, monitoring and logging
- Knowledge of AI safety and security frameworks such as the OWASP AI Testing Guide and MITRE ATLAS, and threat modelling
- Adversarial testing, AI red teaming or security testing, with reproducible tests and defensible evidence
- Programming skills, Git, automated testing and reproducible development environments
What we offer
- Wellbeing leave and up to 5 additional service bonus leave days per year
- Paid parental leave and gender affirmation leave, plus volunteer leave and donation matching
- Employee Assistance Program and wellbeing benefits
- Salary packaging options and learning and development opportunities
- Hybrid and flexible working, and reimbursement for work-from-home equipment
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Australia.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
2 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Macquarie Group
Sydney
Related job offers
-
Analyste Sécurité Cyber – Rejoignez l’équipe Digital Services d’APM
APM Sydney -
Manager, Applied AI Architects (Australia)
openai Sydney -
Service & Support Engineer - Sydney
Riedel Communications GmbH Sydney -
Senior Business & Data Analyst – Département du Logement et des Travaux (WA)
WA Government Jobs Perth -
Développeur Full Stack – Transformation digitale (H/F)
McMahon Services Careers Melbourne