Physics Expert Reviewer
We are seeking a skilled Physics Expert Reviewer to join our team of subject-matter experts. As a reviewer, you will be responsible for auditing and improving model reasoning in physics-related tasks.
The ideal candidate will have a strong background in physics and excellent written communication skills. You will be required to review multi-step derivations, equations, units, and assumptions across core topics in physics.
This is a contract position with flexible hours, approximately 20 hours per week, for a duration of 3-6 months. The compensation rate is USD $40 / hour.
About the Role
As a Physics Expert Reviewer, your primary responsibility will be to review and improve model responses in physics-related tasks. This will involve evaluating responses against detailed quality assurance rubrics, assigning ratings, and writing concise rationales.
You will also be required to draft improved prompts, gold-standard solutions, and constructive feedback to help raise the quality and rigor of model responses.
- Audit physics Q&A and model outputs for correctness, clarity, notation, and quantitative / experimental rigor.
- Evaluate responses against detailed QA rubrics ; assign ratings and write concise rationales.
- Draft improved prompts, gold-standard solutions, and constructive feedback (SFT / RLHF / evaluation).
- Run quick validation checks in Python (e.g., sanity checks, symbolic / numerical verification).
- Identify edge cases, propose rubric refinements, and help enforce consistent quality standards .
Requirements
3+ years professional / academic experience in physics or a closely related domain (applied physics, engineering, scientific computing).Bachelor's in Physics or related field (Master's / PhD preferred).Practical Python skills for analysis / simulation / validation scripts.Ability to review multi-step derivations, equations, units, and assumptions across core topics in physics.Strong written English ; comfortable following detailed QA rubrics and writing clear, actionable feedback.Reliable computer / internet ; responsive and detail-oriented.Nice to Have
Teaching / lecturing, tutoring, or problem-set / rubric design experience .Prior LLM QA / RLHF / SFT or scientific content review experience .Contract & Schedule
Type : Contract (independent contractor), remote .Hours : ~20 hours / week (flexible) ;Duration : 3–6 months (potential extension).Compensation : USD $40 / hour .Openings : ~30 roles .