Position: LLM AI Quality Analyst Personalization - Swedish
Type: Hourly contract
Compensation: $11 - $15/hour
Location: Remote
Commitment: 30–40 hours/week
Role Responsibilities
Evaluate AI model responses for personalization quality, including grounding, integration, and helpfulness.
Design and execute multi-turn prompts based on personal context to test AI capabilities.
Analyze responses for hallucinations, incorrect personalization, and poor inferences.
Perform side-by-side comparison of model outputs to determine quality and effectiveness.
Write clear and structured rationales for response evaluations and rankings.
Collaborate with cross-functional teams to improve AI model performance.
Maintain data hygiene and ensure accurate documentation of evaluations.
Requirements
Strong proficiency in Swedish with excellent reading and writing skills.
Strong experience in data annotation, AI evaluation, or content moderation.
Strong analytical thinking and ability to assess nuanced AI responses.
Ability to design creative prompts and evaluate personalization logic.
Excellent written communication and attention to detail.
Ability to work independently in a remote environment.
Bachelor’s degree or equivalent experience in a relevant analytical field.
#J-18808-Ljbffr