Subject Matter Expert (SME) – LLM Validation

About the role

We are looking for experienced subject matter experts to evaluate AI‑generated scientific responses across a range of domains. The role involves assessing the quality of content produced by large language models and providing structured feedback.

Key responsibilities

• Review and evaluate scientific AI‑generated responses for accuracy and relevance.
• Rate each response using pre‑determined metrics and scales.
• Provide written feedback that highlights strengths and areas for improvement.
• Complete evaluations within the allocated time frame (approximately 60 minutes per query).

Required profile

• PhD in a relevant subject area (Life & Health Sciences, Physical Sciences, Engineering & Technology, or Social Sciences, Arts & Humanities).
• Currently employed as an academic researcher, corporate researcher, or technical librarian.
• Minimum of 2 years of professional experience after completing the PhD.

Required skills

What we offer

• Full remote work – you can telecommute from anywhere.
• Flexible working hours as long as deadlines are met.
• Access to a learning and discussion platform with articles on industry trends and writing tips.