Data Engineer (Hadoop) – Full-time in Sydney

About the role

We are looking for an experienced Data Engineer with a strong focus on Hadoop ecosystems to join our team in Sydney. The role is full-time and can be offered on a permanent or contract basis, providing the opportunity to design and maintain large-scale data platforms.

Key responsibilities

• Design, develop and maintain data pipelines and processing jobs using Hadoop, Teradata and AWS services.
• Write efficient data transformation scripts in Python and PyShark.
• Troubleshoot and support production data solutions to ensure reliability and performance.
• Collaborate with data analysts and architects to deliver end-to-end data solutions.
• Monitor data quality and implement best practices for data engineering.

Required profile

• 5+ years of hands-on experience in data engineering.
• Strong expertise with Hadoop, Teradata and AWS environments.
• Proficient programming skills in Python and PyShark.
• Demonstrated ability to develop, troubleshoot and support large-scale data solutions.
• Excellent analytical and problem-solving abilities.
• Valid Australian work rights (AU visa).

Required skills

• Hadoop
• Teradata
• AWS
• Python
• PyShark
• Data Engineering