560 Data Operations Lead Jobs in San Francisco, CA
Anthropic is Hiring a Data Operations Lead Near San Francisco, CA
About the Role
Anthropic’s Research team is looking for a Data Operations Lead to help us level up our human feedback work and accelerate our ability to develop models. This person will be the ‘first port of call’ for all operational aspects of human feedback data management, including scoping, coordinating, procuring and managing projects and deliverables, ensuring that human data collection operations are running smoothly and that the data collected has high utility, quality, diversity, and volume. They will build and maintain strong relationships with our HF resources and optimize how we do this work on an ongoing basis. It will be important for this person to understand the IC work required for this role so that they can hire for and coach the right skillset on their team.
Note: We are looking for candidates who can start within 3 months.
We have a strong preference to candidates that can come to the SF HQ. We will consider all candidates who can meet the organization's hybrid policy, provided you have significant (60% ) overlap with Pacific Time.
Responsibilities
- Scope, coordinate, and procure data collection and labeling projects and identify and capitalize on opportunities to make them more efficient.
- Monitor ongoing projects to make sure that resources are directed appropriately, adjusting scope and instructions with new information.
- Develop and maintain strong relationships with external vendors and contractors, ensuring that our work together is high-value and low-friction.
- Doing IC work like writing labeling instructions, reviewing data, and making sure we have the right mix of quality, diversity, and volume of data, as well as figuring out how to improve the tooling or instructions to make things more efficient.
- Report out on projects, including dashboards and data analysis.
- Partner with Engineering to maintain and improve our feedback interface.
- Build and manage an in-house team of data labelers to support this process.
You may be a good fit if you
- Are extremely detail-oriented and enjoy poring over information and data line-by-line.
- Have exceptional project and relationship management skills, with both internal and external parties.
- Have a strong understanding of how LLMs work and of prompt engineering.
- Have experience with data collection, labeling, and analysis.
- Have experience using tools like SQL, Python, Tableau, etc.
Strong candidates may also have experience with
- Have experience with human data collection and labeling specific to large language models.
- Have managed a team of external contractors and/or vendors before.
- Have conceived of and launched new technical programs.
- Have worked with researchers and engineers.
Job Summary
Full Time
$126k-165k (estimate)
06/26/2024
08/24/2024
Similar Jobs
Popular Articles
