Senior Data & AI Engineer - Databricks

About the role

Mantel, an Australian-owned IT professional services consultancy focused on AI, digital, cloud, data and security, is hiring a Senior Data & AI Engineer. The role works on complex data solutions for clients, builds and deploys modern data architectures on Databricks, and helps design and scale enterprise-level, fully automated Agentic AI solutions. It is open to Melbourne, Sydney, Brisbane and Perth.

Key responsibilities

• Build and deploy modern data architectures (Medallion/Lakehouse) on Databricks, using AWS, Azure or GCP
• Develop complex code-based ETL/ELT pipelines with performance-optimized data modeling using Spark, Delta Lake and dbt
• Handle big data processing, including PII, data formatting and wrangling
• Apply best practices in coding, monitoring and alerting, using CI/CD, IaC and cloud architectures
• Productionise AI models by building and monitoring pipelines that feed batch or real-time data into live inference applications (e.g. MLflow)
• Lead small teams, act as the most senior technical person on a project, and work with project leadership on scope, dependencies and risk
• Help identify opportunities in projects and client relationships, and take part in community events to promote Mantel's data capability
• Train, coach and mentor colleagues through on-the-job teaching, tutorials and presentations

Required profile

• Expertise in data engineering approaches, Lakehouse architecture and Spark-based processing
• Demonstrable experience building and deploying production data pipelines, including CI/CD automation
• Hands-on experience with Databricks (Workflows, Unity Catalog, Delta Live Tables) and modern cloud ecosystems (AWS/GCP/Azure)
• Medium to large scale enterprise data engineering projects and client engagements, including with senior stakeholders
• Commercial data experience, ideally across different industries
• Collaborative, ownership-driven and clear communicator

Required skills

• SQL and Python (PySpark) or Scala; deep understanding of the Spark engine is a significant plus
• Databricks, Delta Lake, dbt, MLflow

What we offer

• New phone, laptop and swag
• A flexible "My Deal" programme for professional development, leave or side projects
• Flexible personal leave and a certified Family Inclusive Workplace
• Flexible hybrid working
• Access to the Mantel AI Gateway, a monthly experimentation budget and internal career opportunities