Databricks Architect

About the role

Unison Group is seeking a Databricks Architect to lead the design and implementation of scalable, high‑performance data platforms. The role involves working closely with data engineers, scientists and business stakeholders to build data lakes, lakehouse architectures and analytics solutions that generate actionable insights.

Key responsibilities

• Architect and implement Databricks‑based data platforms and end‑to‑end pipelines.
• Design solutions for data ingestion, processing and analytics using Databricks, Apache Spark and Delta Lake.
• Establish best practices for data engineering, governance and security within the Databricks environment.
• Optimize compute and storage resources to balance cost and performance.
• Collaborate with cross‑functional teams to translate business requirements into scalable technical solutions.

Required profile

• Strong hands‑on experience with Databricks, Apache Spark and Delta Lake.
• Proficiency in Python, Scala and SQL for big‑data programming.
• Experience designing and deploying data lakes, lakehouse architectures and ETL/ELT pipelines on AWS, Azure or GCP.
• Deep understanding of data architecture, data modeling and data governance.
• Excellent analytical and communication skills, with a proven ability to work in agile, collaborative environments.

Required skills

• Databricks
• Apache Spark
• Delta Lake
• Python
• Scala
• SQL
• AWS
• Azure
• Google Cloud Platform (GCP)