Data Engineer

About the role

Infosys Consulting is seeking a highly skilled Data Engineer to design, develop, and maintain scalable data platforms within the AWS ecosystem. The role involves close collaboration with data scientists, analysts, software engineers, and business stakeholders to deliver robust data solutions that support analytics, reporting, and machine‑learning initiatives.

Key responsibilities

• Design, build, and optimise scalable data pipelines and ETL/ELT processes using AWS services.
• Develop and maintain data models, data warehouses, and lakehouse architectures.
• Write, optimise, and troubleshoot complex SQL queries for data extraction, transformation, and analysis.
• Automate deployment processes using CI/CD best practices, preferably with GitHub and GitHub Actions.
• Develop data processing solutions using Python (or Java) and work with Databricks for large‑scale datasets.
• Collaborate with Data Science teams to support machine‑learning workflows and MLOps practices.
• Monitor and improve data quality, reliability, and performance, and implement governance, security, and compliance standards.

Required profile

• Strong expertise in the AWS ecosystem and advanced SQL capabilities.
• Experience with modern data engineering practices, CI/CD pipelines, and cloud‑based data platforms.
• Ability to work collaboratively with cross‑functional teams and business stakeholders.

Required skills

• AWS services
• SQL
• Python (or Java)
• CI/CD (GitHub, GitHub Actions)
• Databricks
• MLOps concepts
• Power BI or Tableau