Software Engineer (.NET, Python, Spark)

About the role

Exigo Tech, a Sydney-based technology solutions provider covering Infrastructure, Cloud and Application verticals, is looking for a full-time Software Engineer / Developer. The role designs, builds and supports scalable backend services and distributed data-processing solutions, combining .NET-based API development with Python and PySpark engineering across Apache Spark, Hadoop-YARN, Trino, Delta Lake, Docker, PostgreSQL and Linux environments.

Key responsibilities

• Design, develop, test, deploy and maintain backend services using C#.NET Core and ASP.NET Web API.
• Build secure RESTful APIs that expose processed reporting data and integrate application and data platforms.
• Develop and optimise high-volume reporting and data-processing pipelines with Python, PySpark and Apache Spark.
• Implement data transformation, validation, reconciliation and error-handling controls.
• Work with Spark in standalone and cluster modes, including driver and executor behaviour, resource allocation and performance tuning.
• Contribute to scalable Hadoop-YARN architectures and support migration or improvement of distributed workloads.
• Use Trino for distributed SQL processing and Delta Lake / Delta Parquet for storage and querying.
• Package and deploy Spark, Trino and related services with Docker, and maintain consistent configuration across environments.
• Deploy, monitor and troubleshoot workloads in production Linux environments, including job scheduling via cron and crontab.

Required profile

• Bachelor's degree in Computer Science, Information Technology, Software Engineering or a related discipline, or equivalent practical experience.
• Minimum 3 years of professional experience in software development, backend engineering, data engineering or a closely related role.
• Strong C# and Python programming, with practical SQL experience.
• Hands-on experience with .NET Core / ASP.NET Web APIs and REST-based integrations.
• Hands-on experience with PySpark and Apache Spark for large datasets.
• Working knowledge of Hadoop and YARN, including cluster execution and resource management.
• Experience with Docker and production Linux (preferably Ubuntu), and with PostgreSQL or a comparable relational database.

Required skills

• C#, Python, SQL.NET Core, ASP.NET Web API, RESTful APIs
• Apache Spark, PySpark, Hadoop, YARN, Trino, Delta Lake / Delta Parquet
• Docker, Linux (Ubuntu), cron / crontab
• PostgreSQL; Angular, Unity (C#) or Unreal Engine (C++) is advantageous but not essential

What we offer

• Award-winning workplace with clear career growth opportunities.
• Competitive salary of AU $100k - AU $140k.
• Collaborative, innovative culture with accountability.