Exceptional communicator, highly organized, proactive, strong team coordination and feedback skills.

Support existing product / speed up development

ABOUT THE COMPANY A leading European AI lab working on advanced AI models and data annotation projects. They collaborate with Lemon.io to scale their annotation and technical operations teams.

PROJECT DESCRIPTION The project involves managing and scaling a remote team of code annotators who label and review code data for AI model training and evaluation. The team is expected to grow, with new tracks such as cybersecurity annotation and model evaluation being added.

WHAT'S IN IT FOR YOU

• Work at the frontier of AI. You’ll work directly with one of Europe’s leading AI labs. The data your team produces goes straight into training and evaluating their models.
• A clear growth path. You’ll start part-time and grow into the single technical operations lead for all Lemon.io work with this client. Scope and hours will expand as the team does.
• Build it your way. Processes for onboarding, QA, and team coordination are still being formalized, so you’ll design them rather than inherit them.
• Skills that are in high demand. You’ll gain hands-on experience with LLM data annotation, RLHF, and model evaluation, plus new tracks such as cybersecurity annotation.
• Leadership without leaving code behind. You’ll split your time between coordinating a technical team and reviewing and writing code yourself.
• Remote, European hours. The role is fully remote and runs on a schedule aligned with the team’s working hours.

WHY THE CLIENT IS LOOKING FOR A TECH OPERATIONS LEAD The client needs to remove the coordination bottleneck currently handled by a single internal lead, improve scalability, and formalize processes for quality, onboarding, and team management.

WHAT YOU'LL OWN Your first priority is to take day-to-day coordination of the annotation team off the client's plate.

• Task dispatch and scheduling: divide and assign annotation tasks based on who is working which hours, tell annotators what to work on next and what to fall back on when a task is done, and handle schedule changes
• Annotator support: be the first point of contact for daily questions, and escalate to the client only what truly needs their input
• Status reporting: gather progress updates from annotators and deliver a regular status summary to the client
• FAQ and documentation: collect recurring questions and maintain a living FAQ and guidelines for the team
• Update guidelines: apply updates to annotation guidelines based on annotator feedback and changing task needs
• Onboarding: run onboarding for new annotators, formalizing the peer "buddy" support that experienced annotators provide today
• Feedback: share structured feedback with annotators on their work and track improvement over time

QUALITY, REVIEWS AND HIRING SUPPORT This is a hands-on role: you stay close enough to the work to judge it.

• Reviews and annotation: review annotators' output and take on annotation tasks yourself when needed
• Quality assurance: set and run quality checks on delivered work, spot recurring issues early and close the loop with the team
• Hiring support: help coordinate technical screening and live interviews of new annotators, including calibrating interviewers from the current team, so new joiners arrive ready to work

WHAT YOU BRING Must-haves

• Management: Operational load balancing (prioritizing and streamlining) and exceptional communication
• Some software engineering background, with Python as a core language (about 60% of the team's tasks) and the ability to read Java, TypeScript, C#, or C++
• Experience reviewing code critically: spotting major issues fast and writing clear, actionable comments
• Experience coordinating a technical team, such as tech lead, delivery lead, technical PM or ops lead
• Highly organized, with a habit of documenting processes so others can follow them
• Fluent English, written and spoken
• Time zone: European working hours, with enough overlap to support annotators across their shifts

Nice-to-haves

• Hands-on experience with LLM data annotation, RLHF, LLM evaluation or benchmarks
• Cybersecurity background, such as vulnerability analysis or hardening production code
• Experience hiring, onboarding, and mentoring remote contractors

AS THE ACCOUNT GROWS The role is designed to grow into the single technical operations lead for all Lemon.io work with this client.

• Account-wide coordination: act as the coordination layer between the client and all Lemon.io specialists on the account, and dispatch work across teams
• Account-wide quality: extend quality assurance to all Lemon.io activity on the account, including contract engineers, delivered work, and data and eval projects
• New tracks: help launch and run new areas such as the cybersecurity annotation track and model evaluations (evals)

Python (core language), data annotation, Java, TypeScript, C#, C++

2 calls with a potential manager and optionally a panel interview with annotators

Status updates, FAQ/documentation, regular reporting, English (written and spoken), remote coordination

4-10