Senior Databricks Specialist Lead – AI & Data

About the role

Deloitte’s AI & Data team is seeking a Senior Databricks Specialist Lead to design, build and scale modern data and AI platforms for enterprise clients across Australia and APAC.

Key responsibilities

• Lead technical solution design sessions and architect end‑to‑end Databricks Lakehouse platforms.
• Guide engineering teams on Spark, Delta Lake, and cloud data engineering best practices.
• Drive delivery across multiple workstreams, mentor engineers and improve CI/CD pipelines and IaC.
• Collaborate with business and technology stakeholders to translate requirements into scalable, governed data solutions.

Required profile

• 8‑12 years of experience in data engineering, cloud or software engineering.
• Strong consulting and client‑facing experience with proven delivery of large‑scale data and AI solutions.
• Leadership experience mentoring engineers and defining technical best practices.

Required skills

• Python, PySpark or Scala development.
• Databricks Lakehouse architecture, Delta Lake, Medallion architecture.
• Apache Spark performance tuning and troubleshooting.
• Cloud platforms: AWS, Azure, Google Cloud.
• CI/CD, Infrastructure as Code (Terraform, Git).
• Advanced SQL and distributed data system optimization.

What we offer

• Retail discounts and wellbeing leave.
• Paid volunteering days and flexible working options.
• Market‑leading parental leave and return‑to‑work support.