Azure Data Engineer

About the role

Cognizant is seeking an experienced Azure Data Engineer to design, develop, and optimise scalable data pipelines and analytics solutions on Microsoft Azure and Big Data platforms.

Key responsibilities

• Design, develop and maintain data pipelines using PySpark, Spark SQL, Python, SQL and Azure Synapse Analytics.
• Build and optimise ETL/ELT workflows for large‑volume structured, semi‑structured and unstructured data.
• Develop and support Azure Synapse pipelines, notebooks, SQL scripts, stored procedures and data transformation logic.
• Work with Azure Data Lake Storage Gen2, Azure Data Factory, Azure Databricks, Azure SQL Database and related services.
• Implement Big Data solutions using Spark, Hadoop, HDFS, Hive, Sqoop, Kafka, HBase and related components.
• Perform performance tuning of PySpark and SQL workloads and optimise Spark configurations.
• Collaborate with architects, analysts, QA, DevOps and client stakeholders to deliver robust data solutions.

Required profile

• Minimum 3+ years of hands‑on experience with Azure Synapse Analytics and Azure cloud data services.
• Proven ability to design, develop, test, deploy and support production‑grade data engineering solutions.
• Experience mentoring junior engineers and promoting best practices.

Required skills

• PySpark, Spark SQL, Python, SQL
• Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Data Factory, Azure Databricks, Azure SQL Database
• Apache Spark, Hadoop, HDFS, Hive, Sqoop, Kafka, HBase

What we offer

• Opportunities to learn and collaborate with industry‑leading talent.
• Access to professional development, education and dedicated training.
• Competitive compensation, benefits and wellness packages.