Data Engineer – PySpark & Azure Data Factory

About the role

We are looking for a Data Engineer to design, build and maintain large‑scale data processing solutions. The role focuses on leveraging PySpark and Azure Data Factory to create robust ETL/ELT pipelines that support our data‑driven initiatives.

Key responsibilities

• Develop, test and optimise PySpark jobs for high‑volume data transformations.
• Design, schedule and monitor data pipelines using Azure Data Factory.
• Implement and maintain SQL queries and relational database structures.
• Build and support data warehousing and integration solutions following best‑practice ETL/ELT patterns.

Required profile

• Strong hands‑on experience with PySpark for large‑scale data processing.
• Solid experience with Azure Data Factory for pipeline orchestration.
• Proficiency in SQL and relational database concepts.
• Good understanding of ETL/ELT pipelines, data warehousing and data integration patterns.

Required skills

• PySpark
• Azure Data Factory (ADF)
• SQL
• Relational databases
• ETL/ELT pipeline design
• Data warehousing
• Data integration patterns