Senior Data Engineer - Capital Markets

About the role

Macquarie Capital's Technology team supports finance reporting, analytics and business operations within Macquarie Capital, partnering with finance stakeholders to deliver reliable solutions. This Senior Data Engineer role is based in Sydney and involves designing, building, testing, deploying and supporting data pipelines and platform features.

Key responsibilities

• Design, build, test, deploy and support data pipelines and platform features.
• Work with business specialists, technical business analysts and source-system owners to turn finance requirements into technical designs, source-to-target mappings, acceptance criteria and testable transformations.
• Investigate data and apply artificial intelligence-assisted engineering responsibly.

Required profile

• 8+ years' experience in data or software engineering, with strong Python skills and a record of delivering maintainable enterprise solutions.
• Experience building scalable extract, transform and load pipelines, reusable transformations and relational or dimensional models, including incremental loading, schema evolution and batch or streaming integration.
• Experience with Spark or PySpark, including performance optimisation and cloud cost awareness.
• Hands-on experience with Amazon Web Services, including Redshift, S3, Glue, IAM and Kinesis, plus familiarity with Google Cloud and SQS, SNS or Kafka.
• Experience with Airflow, Argo or dbt, including dependency management, scheduling, retries and backfills.
• Experience implementing metadata, lineage, reconciliation and completeness checks, with secure access, data protection and auditability.
• Working knowledge of Docker and Unix or Linux; Kubernetes experience is advantageous.
• Experience with Git, code review, automated testing, CI/CD, controlled releases, observability, recoverable processing and production support.
• Familiarity with AI-assisted engineering tools such as GitHub Copilot, with independent validation and protection of confidential data; exposure to document processing, embeddings, vector search, RAG and Amazon Bedrock is advantageous.
• Strong stakeholder engagement skills; experience in agile teams, knowledge sharing and financial services or trading is advantageous.

What we offer

• Wellbeing leave day per year, up to 5 additional service bonus leave days, and up to 20 weeks' paid parental leave.
• Paid volunteer leave and donation matching, and up to 12 months' gender affirmation leave.
• Employee Assistance Program and wellbeing benefits, including skin and health checks and flu vaccinations.
• Salary packaging options and learning and development opportunities, including professional membership reimbursement.
• Hybrid and flexible working arrangements, dependent on role, and reimbursement for work from home equipment.