Location: Geography restricted to USA, UK, Canada, EU Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English
Why This Role Exists
Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In physics-related contexts, conversational AI systems must demonstrate strong theoretical grounding, quantitative rigor, and precise reasoning. This project focuses on evaluating and improving how models explain, reason about, and respond to physics-related questions across both foundational and advanced topics.
What You’ll Do
Write and refine prompts to guide model behavior in physics contexts
Evaluate LLM-generated responses to physics-related queries for conceptual accuracy, mathematical correctness, and reasoning quality
Conduct fact-checking using authoritative public sources and domain knowledge
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
Assess clarity, structure, and appropriateness of explanations for different audiences
Ensure model responses align with expected conversational behavior and system guidelines
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Who You Are
You hold a PhD in Physics or closely related field
You have deep expertise in one or more of the following sub-domains:
Classical Mechanics & Dynamics
Electromagnetism, Optics & Signals
Thermodynamics & Statistical Physics
Quantum Physics
Relativity, Cosmology & High-Energy Physics
You have significant experience using large language models (LLMs) and understand how and why people use them
You have excellent writing skills and can clearly explain complex physics concepts
You have strong attention to detail and consistently notice subtle issues others may overlook
Experience reviewing or editing technical or academic writing
Nice-to-Have Specialties
Prior experience with RLHF, model evaluation, or data annotation work
Experience teaching, mentoring, or explaining physics concepts to non-expert audiences
Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
What Success Looks Like
You identify conceptual inaccuracies or weak reasoning in physics-related model outputs
Your feedback improves the rigor, clarity, and correctness of AI explanations
You deliver consistent, reproducible evaluation artifacts that strengthen model performance
Mercor customers trust their AI systems in physics contexts because you’ve rigorously evaluated them
Why Join Mercor
Mercor offers PhD-level scientists the opportunity to directly influence how advanced AI systems reason about complex scientific concepts. This flexible, remote role allows you to apply deep expertise beyond academia while contributing to high-impact AI development work.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Join our team as a Web Developer to build and maintain responsive websites and web applications using modern technologies. Responsibilities...
Apply For This JobWork Locations : Waldorf Astoria Admiralty Arch London The Mall, London London SW1A2WH Waldorf Astoria London – Admiralty Arch is seeking...
Apply For This JobJoin our team as a Field Audit specialist focused on the solar industry. This role involves conducting quality assurance audits...
Apply For This JobRequirements: 1. Hardware Installation & Peripheral Troubleshooting Ability to physically unbox, assemble, mount, and configure receipt printers, barcode scanners, and...
Apply For This JobWho we are is what we do. Deel is the all-in-one payroll and HR platform for global teams. Our vision...
Apply For This Job