Artificial intelligence team · Officer

Prompt & AI Evaluation Specialist

You write the instructions that bring out the best in Claude and ChatGPT, and you prove, with tests, that their results can be trusted.

  • Officer
  • 4 to 6 hours a week
  • Remote
  • English or French, ideally both
  • Until 15 January 2027

Apply for this role

AI in service of the mission

Artificial intelligence team

At YouthShare Initiatives, artificial intelligence is part of everyday work: Claude, first and foremost, and ChatGPT support research, writing, translation and organisation. The AI team makes demanding, useful and responsible use of them, in service of the five labs.

Assignments

  • Build and maintain YouthShare’s prompt library: research, proofreading, translation, summarising, communication
  • Write the system instructions for the team’s Claude projects and GPTs
  • Build test sets that assess answer quality: accuracy, sources, tone, language
  • Compare models regularly and recommend the right tool for each task
  • Develop methods for fact-checking and spotting hallucinations
  • Optimise cost and speed: model choice, prompt caching
  • Run prompt-writing workshops for volunteers

A typical week, at your pace

  • Writing and testing new instructions with a team
  • Running the test set on current models
  • Analysing discrepancies and updating the library
  • A workshop or answering volunteers’ questions

Tools to master

  • Anthropic Console: Workbench, prompt generator, evaluation tool
  • ChatGPT and the OpenAI platform: comparative tests and the team’s GPTs
  • promptfoo or Python scripts: automated evaluations
  • Spreadsheets: tracking test results
  • Anthropic and OpenAI guides: prompt engineering best practice

Profile we are looking for

  • Outstanding prompt-writing skills for Claude and ChatGPT
  • An experimental, methodical mind: hypothesis, test, measurement
  • Excellent written English or French
  • A good understanding of how large language models work and where they fall short

A volunteer role, open to young people

Every role we offer is voluntary. The experience we ask for can come from a course, a student project, an internship, volunteering or a personal project: every skill counts, wherever you gained it. Our roles are designed first and foremost for young people, and we weigh your motivation and potential as carefully as your track record. Want to be part of something big? Apply.

Nice to have

  • A background in linguistics, data science or computer science
  • Python skills
  • Good command of both of the site’s languages

What this role gives you

  • Highly sought-after expertise in prompt engineering and evaluation
  • A prompt library and test protocols to showcase
  • Working directly with researchers and writers

Applications open until 15 January 2027

YouthShare reserves the right to close this listing before that date, as soon as the right person is found. We therefore encourage you to apply now.

The one-year commitment

A non-profit project is built over time. Every volunteer therefore commits for at least one year: time to settle in, carry the assignment through and pass on what they have learned. The weekly time depends on the role and is shown on each role page.

How selection works

  1. Online application

    You choose a role, present your background and attach your CV. A confirmation email gives you your reference.

  2. Profile review

    The Talent team reads every application and matches it with the needs of the role.

  3. Video interview

    A conversation to get to know each other and shape the assignment together.

  4. Decision and arrival

    You receive our answer by email, then your welcome into the team and your first access.

Other roles in this team

Other open roles

Apply for this role

A letter, when there is something worth saying