About this role
Preparing for this role? See the best AI tools for lawyers, practise with ready-made prompts for lawyers, read Best AI Tools for Legal Research (2026 Comparison) and take the free 30-day AI challenge.
About the Role our partner is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. This is an evergreen talent pool for experienced US In-House Counsel — by applying, you join a standing bench and are considered for ongoing and upcoming legal-AI projects as they launch. We review applications on a rolling basis and reach out when work that fits your background comes up.
Typical work includes recurring side-by-side evaluations and legal dataset generation: you'll compare AI-generated legal work, judge which response is stronger and why, and create realistic in-house legal tasks and reference answers.
What You'll Do
- Compare pairs of responses to in-house legal tasks (contract review, policy and compliance questions, risk assessments and business-facing legal advice) and decide which is stronger, with clear reasoning
- Write concise justifications grounded in the source documents and applicable US law
- Create realistic legal prompts, fact patterns and model answers drawn from your in-house experience
- Flag errors, gaps and risky advice in AI-generated legal content
- Attend onboarding and calibration sessions
You're a Good Fit If You
- Are admitted to practice in at least one US state (active bar membership)
- Have 3+ years of legal practice, including in-house experience advising a business on contracts, compliance, employment, risk or disputes
- Hold a J.D. from an ABA-accredited law school
- Write clearly and pay close attention to detail
Bonus Qualifications
- 2+ years of experience at an AmLaw 100 firm (strongly preferred)
- Prior work on legal AI projects with our partner
- Prior data annotation, AI evaluation or legal-benchmark experience
Role Highlights
- Evergreen talent pool — apply once and be considered for ongoing projects as they launch
- Fully remote, flexible hours; recurring tasks as new work comes up
- Applications reviewed on a rolling basis
This is a 100% remote contract role. Applicants must be located in: United States.
