[Remote] Freelance: AI Content Specialist
Note: The job is a remote job and is open to candidates in USA. Uber AI Solutions is a marketplace connecting freelancers with generative AI researchers, seeking analytical thinkers and Junior Linguists for high-level evaluation of GenAI models. The role involves linguistic analysis, safety auditing, and model stress-testing to ensure AI systems are safe, accurate, and natural.
Responsibilities
- Linguistic Analysis: Reviewing prompt context and model responses to analyze the relationship between user intent and AI output
- Safety & Severity Auditing: Evaluating outputs for potential risks (toxicity, bias, misinformation) and categorizing the severity of violations according to strict safety rubrics
- Side-by-Side (SxS) Evaluation: Comparing multiple outputs and using editorial judgment to choose the highest quality response
- Written Justification: Writing short, structured, and technically sound explanations for your ratings based on linguistic and safety principles
- Model Stress-Testing: Identifying model gaps and performing "Red Teaming" to ensure logic and factual accuracy
- Multimodal Evaluation: Assessing AI responses across various formats, including text, audio, and images, to ensure cross-functional model accuracy
Skills
- Bachelor's degree (or currently pursuing one) in Linguistics, English, Journalism, Communications, or a related research-heavy field
- Exceptional writing skills with the ability to explain complex and nuanced reasoning
- A strong pulse on content safety and the ability to identify subtle biases or harmful model behaviors
- Native-level English proficiency is a must
Company Overview
Company H1B Sponsorship