About this role
Preparing for this role? See the best AI tools for scientists & researchers, practise with ready-made prompts for scientists & researchers, read The 12 Best AI Tools for Students in 2026 (Tested & Ranked) and take the free 30-day AI challenge.
Role Title: AI Agent Power User
Role Type: Contractor
Location: Remote (US, CA, UK, IE, AU, NZ)
our partner is engaging AI Agent Power Users to contribute to an enterprise AI training project with a leading customer. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows.
- Document each step, highlighting where AI performance aligns with or diverges from realistic business needs.
- Evaluate and score AI-generated outputs using specified rubrics and criteria, focusing on quality, completeness, and relevance.
- Draft clear, constructive, and actionable feedback based on rubric findings to inform AI research and product teams.
- Identify recurring patterns in AI behavior—strengths, weaknesses, and opportunities for process improvement.
- Connect AI tools to frequently used workplace platforms (e.g., Google Drive, Gmail, Slack, Notion) to mirror authentic use cases.
- Maintain meticulous written records and communicate findings in professional English, ensuring transparency and reproducibility.
Preferred Qualifications
- 5+ years of professional experience in any business function, utilizing technology to solve operational challenges.
- Completed Bachelor’s degree or higher in any discipline.
- Consistent, hands-on daily use of ChatGPT and/or Claude for actual work, not just experimentation.
- Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines (academic, QA, hiring, or annotation experience strongly valued).
- General comfort integrating AI tools with business software and productivity platforms.
- Demonstrated excellence in written English, with a focus on clear, actionable documentation and feedback.
- Authorized for contract work and based in the US, Canada, UK, Ireland, Australia, or New Zealand (US strongly preferred).
This is a 100% remote contract role. Applicants must be located in: United States, United Kingdom.
