Data Engineer - Azure & PySpark

About the role

People First Bank is looking for a highly skilled and experienced Data Engineer to join its Data and Insights team. The role is central to administering and improving the Data and Insights platform, keeping it stable, scalable and secure, and building data pipelines for analytics and reporting.

Key responsibilities

• Develop and enhance in-house PySpark frameworks to standardise implementation and reuse.
• Mentor junior team members and help upskill the wider analytics community.
• Build strong relationships with internal and external stakeholders to deliver high-quality, data-driven solutions.
• Carry out exploratory data analysis and design end-to-end data engineering solutions.
• Build, test and implement ETL/ELT pipelines using Azure Data Factory, Azure Databricks, other Azure services and Python/PySpark.
• Deliver quality solutions on time, following best practices for automated testing, documentation, Azure DevOps, Git and Azure pipelines.
• Monitor and support batch operations on the Data and Insights platform.

Required profile

• Extensive experience in a similar role within a complex data environment.
• Hands-on experience with Azure cloud services.
• Ability to act as an expert in crafting, implementing and sustaining resilient data processing pipelines.

Required skills

• Azure Data Factory, Azure Databricks, Azure SQL Server and Azure Storage
• SQL, PySpark and Python
• Azure DevOps, Git and Azure Pipelines
• Power BI and PowerShell

What we offer

• Paid parental leave and special leave provisions
• Flexibility and hybrid working arrangements
• Employee banking benefits and discounted insurance
• Career development, training and coaching
• Employee Assistance Program and paid volunteering days