AI Trainer (Korean) – LLM Quality Analyst – Remote

About the role

This short‑term contract position focuses on evaluating and improving a personalization feature for a large language model. The role is fully remote and requires strong Korean language skills to assess how the model leverages personal information in multi‑turn conversations.

Key responsibilities

• Design and execute multi‑turn conversational prompts that require the AI to use personal information and experiences.
• Assess the model’s ability to incorporate past conversations and activity into relevant, helpful responses.
• Evaluate model outputs for intent alignment, appropriate personalization, and grounding issues such as hallucinations.
• Perform side‑by‑side comparisons and rank model responses based on helpfulness and naturalness.
• Write clear rationales referencing specific conversation turns and verify debug information to confirm correct use of summaries and data sources.
• Maintain data hygiene by deleting evaluation conversations after completion.

Required profile

• Experience in data annotation, AI quality evaluation, content moderation, or related roles.
• Strong Korean proficiency (reading and writing).
• Willingness to use a personal Google account and enable personal data sources for assessment.
• Strong analytical thinking, attention to detail, and ability to work independently in a remote environment.
• Desktop or laptop with a stable internet connection.

Required skills