Senior Cloud DevOps Engineer

About the role

We are seeking a Senior Azure Databricks Platform Engineer with 5+ years of experience to join our platform team and accelerate new AI capabilities within Azure Databricks across Australia.

Key responsibilities

• Administer and operate the Azure Databricks platform, enabling AI features such as Model Serving, Vector Search, Lakebase, and MCP Server.
• Design and manage Azure infrastructure including networking, private endpoints, storage, Key Vault, Entra ID, and RBAC, using Terraform as IaC.
• Develop automation and scripting solutions (Bash, PowerShell) and maintain CI/CD pipelines with Azure DevOps and Git.
• Implement enterprise security, governance, monitoring, and operational best practices.
• Work with data platform technologies like Spark, Delta Lake, Unity Catalog, and lakehouse architectures.

Required profile

• 5+ years of experience in Azure Databricks platform administration and operations.
• Strong background in Azure infrastructure engineering and IaC with Terraform.
• Proven ability to automate workflows using Bash and PowerShell.
• Experience with Azure DevOps, Git, and CI/CD pipelines.
• Knowledge of enterprise security, governance, and monitoring practices.

Required skills

• Azure Databricks
• Azure (Networking, Private Endpoints, Storage, Key Vault, Entra ID, RBAC)
• Terraform
• Bash
• PowerShell
• Azure DevOps
• Git
• CI/CD
• Spark
• Delta Lake
• Unity Catalog
• Lakehouse architectures
• AWS to Azure integration (desirable)
• AI/LLM platform experience (highly regarded)