About this role
Preparing for this role? See the best AI tools for lawyers, practise with ready-made prompts for lawyers, read ChatGPT for Lawyers: 15 Practical Use Cases (2026) and take the free 30-day AI challenge.
About the Role our partner is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. We're hiring US litigators with federal court experience for a focused motion-brief evaluation project. For each review, you'll read two motion briefs written for the same case, decide which one you prefer, score both on several quality dimensions and mark errors directly in the PDFs.
What You'll Do
Read two motion briefs for the same case and pick the stronger one, with clear reasoning
Score each brief on a set of defined dimensions
Annotate the brief PDFs inline, flagging legal, factual, citation and drafting errors
Complete all the review as per the requirements
Attend a short onboarding session before kickoff
You're a Good Fit If You
Are admitted to practice in at least one US state (active bar membership)
Have 3+ years of US litigation practice with substantial federal court experience, including drafting or opposing motions
Practice primarily in areas governed by federal law or litigated in federal court (practices focused mainly on state law, such as family law, are not a fit)
Hold a J.D. from an ABA-accredited law school
Write clearly and pay close attention to detail
Bonus Qualifications
2+ years of experience at an AmLaw 100 firm (strongly preferred)
Prior work on legal AI projects with our partner
Prior data annotation, AI evaluation or legal-benchmark experience
Role Highlights
Time commitment: about 30–40 hours total, all within a one-week review window
Immediately required
You must complete all required reviews, as the project design depends on every attorney finishing the full set
Location: United States.
