Data Engineer

About the role

Kogan.com is looking for a Data Engineer to design, build, and operate data and machine‑learning pipelines that empower teams across Marketing, Purchasing, Logistics and Finance to make data‑driven decisions.

Key responsibilities

• Design and maintain scalable ETL/ELT pipelines handling 10M+ daily events.
• Develop and optimise data models in BigQuery or Snowflake for analytics and ML workloads.
• Build and support ML feature stores and MLOps pipelines for model deployment and monitoring.
• Integrate internal APIs and third‑party tools while ensuring data integrity.
• Implement data‑quality, security and documentation best practices.
• Collaborate on AI and LLM experiments to solve business problems.

Required profile

• Strong experience writing and optimising SQL for large‑scale datasets.
• Proven use of pipeline orchestration tools such as Airflow, dbt or AWS Glue.
• Solid Python programming skills for data transformation and scripting.
• Hands‑on experience with cloud data platforms, preferably Google Cloud Platform.
• Familiarity with software engineering best practices (Git, CI/CD, containerisation).

Required skills

• SQL
• Python
• Airflow
• dbt
• AWS Glue
• BigQuery
• Snowflake
• Git
• CI/CD
• Docker
• Kafka (optional)
• Kinesis (optional)
• SageMaker (optional)
• Vertex AI (optional)
• Databricks (optional)
• Looker (optional)
• Tableau (optional)