IT Delivery Project Manager

Company Intro

Toloka AI is a global tech company that offers end-to-end data labeling solutions based on the effective combination of public crowd, domain experts and ML. Toloka has one of the most advanced annotation platforms in the market together with huge experience gathered by the whole team. Our solutions are powered by the most diverse global crowd from 100 countries speaking 40 languages and extensive experience in the practical application of SOTA models.

We bring together talents from all over the world to form our team of professionals. Our team is globally distributed and works from several locations, including the USA, the Netherlands, Switzerland, Czech Republic, Serbia, and more.

About position

We're seeking a Delivery Project Manager who will join our Delivery team and will build, drive and maintain our client’s solutions. Joining us in this role means you will lead a virtual cross-functional team managing successful project implementation. This involves both client communication and internal coordination.

The team consists of talented engineers of different kinds, supply managers and other departments on an ‘as needed’ basis. This is a key role for us to ensure we deliver the best possible experience for our clients and enable us to constantly grow our business.

Example Projects

• SFT (supervised fine tuning) data generation pipeline producing thousands of prompts and completions weekly across several languages and domains of knowledge;
• Evaluation pipeline helping to estimate LLMs’ responses quality and reaching a throughput of hundred thousands weekly;
• A red-teaming project helping to collect malicious prompts of different kinds to ensure models’ safety.

Key Responsibilities

• Take ultimate ownership for all delivery team projects, including data quality, delivery timelines, unit economics and overall transparency for stakeholders;
• Lead a cross-functional delivery team ensuring projects are on track, any issues and risks are highlighted and resolved proactively;
• Own operations of the delivery team: including internal and external communication, activities planning, posting summaries and status updates, conducting retros etc.;
• Drive and motivate the team, seek out change to increase the organization’s efficiency;
• Help roll out improvements to the delivery team focussing on increased adoption and providing feedback for further improvements.

Qualifications

• Experience leading technical cross-functional teams,
• Experience managing complex projects including discovery, decomposition, scope planning, implementation and adoption;
• Experience in ML, good understanding of LLMs and their life cycle in particular;
• Being generally agile, able to switch quickly to new domains and subjects.
• Strong technical background;
• Client facing experience.

Other important points

• Experience in data labeling / generation;
• Experience and proactiveness in suggesting process changes is appreciated;
• Language skills beyond English are a plus;
• Python knowledge is a big plus;
• Engineering / analytics / technical consultancy experience is a big plus;
• We expect that you already live in the US and have US citizenship.

What we can offer

• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;
• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;
• Paid parental leave and sick leave;
• Medical insurance fully covered for the employee 80% of coverage for family members;
• Meal allowance, transportation expenses reimbursement;
• 25 vacation days per year.