We need a hands-on Trust & Safety expert to help provide additional support as we design and run evaluation processes. You’ll support the development of rubrics, you’ll guide and supervise the review process, and you’ll do some manual review and auditing yourself. Ideally, you’ve had experience designing or managing review queues.
The role will work to support our existing team and will require 5-10 hours per week through EOY. We have some flexibility on timing, hours, and the possibility of a longer term contract.
What you’ll do:
- Turn draft criteria into a clear, usable review rubric, with decision guidance and edge-case examples
- Take feedback from our product lead, ethics board, research partners, and internal team to improve processes and output
- Set up and supervise the review workflow, including reviewer onboarding, calibration and escalation paths
- Do hands-on manual review, and audit a sample of decisions for accuracy and consistency
- Recommend improvements to the process and tooling, and share findings with the team
What you'll bring:
- Direct Trust & Safety experience in a product setting, such as policy, review operations, or quality and evaluation
- Experience writing or refining review guidelines or rubrics, and running reviewer calibration
- Passion for mental health support
- Excellent communication skills, you’re just as comfortable expressing complex ideas in an a-sync environment as you are hoping on a call with a partner to explain a methodology
- Comfort doing the review work yourself, with strong attention to detail
- Sound judgment on sensitive topics and a commitment to mental health
- Nice to have: experience reviewing content or services across countries and languages; experience with AI-assisted review or LLM evaluation
Role specifics:
- Part-time contract, 5–10 hours per week, through December 31, 2026 with the possibility of extension
- Remote
- The work involves sensitive mental health topics
Application details:
To apply, fill out this brief form.