Software Engineer Analyst – AI Model Evaluation (Remote)

About the role

We are seeking a Software Engineer Analyst to help train and evaluate AI chat‑bot models. The role involves creating coding challenges for the bots, measuring their performance, and improving model quality through detailed analysis.

Key responsibilities

• Design and present coding problems to AI chatbots and assess their solutions.
• Evaluate the correctness, performance, and logical soundness of AI‑generated code.
• Provide feedback and suggestions to enhance model accuracy and efficiency.
• Document evaluation results and track progress over time.

Required profile

• Fluent English (native or bilingual level).
• Detail‑oriented with strong analytical mindset.
• Experience with algorithms, data structures, and debugging workflows.
• Current, in‑progress, or completed Bachelor’s degree preferred (not mandatory).

Required skills

• Proficiency in at least one programming language: Python, JavaScript, C#, C++, HTML, SQL, or Swift.

What we offer

• Full‑time or part‑time remote work.
• Flexibility to choose projects and set your own schedule.
• Hourly compensation ranging from $50 to $100+ (AUD) with performance bonuses.
• Payments processed via PayPal, with currency conversion handled automatically.