Data Engineer

About the role

Eightcap is seeking a Data Engineer who will own and operate critical, regulated data pipelines. You will be the go‑to person for reliable, fast, and secure data delivery across internal, API, streaming and third‑party sources.

Key responsibilities

• Design, build and maintain end‑to‑end pipelines that feed the data lake, using SQL, Python, PySpark, dbt and AWS services.
• Implement validation, cleansing, security and governance frameworks to meet compliance requirements such as ASIC reporting.
• Monitor, troubleshoot and optimise pipelines for performance, cost and reliability, handling production incidents as needed.
• Mentor junior engineers, lead code and design reviews, and drive technical projects.
• Evaluate new data sources and third‑party APIs, keeping tools and practices up‑to‑date.

Required profile

• Minimum 3 years of experience as a Data Engineer with ownership of significant pipelines.
• Degree in Computer Science, Software Engineering or related field.
• Strong communication skills and ability to explain technical concepts to non‑technical audiences.
• Interest in trading, FX or finance and experience with regulated data environments is a plus.

Required skills

• SQL
• Python
• PySpark
• dbt
• AWS Glue, EMR, S3, Redshift, Athena, RDS, DMS, Lambda, Batch
• IAM, VPC, NAT Gateway, ACL, Secrets Manager, EC2, ECS

What we offer

• Career development and technical training.
• Wellness perks such as monthly corporate massages.
• Friday drinks, parental leave, staff referral bonuses.
• Purchased leave and vehicle leasing options.
• CBD location with easy public transport access and a multicultural team culture.