What are the responsibilities and job description for the Research Engineer, Trust & Safety position at Menlo Ventures Management, L.P?
About the role
We are looking for Research engineers to help design and build safety and oversight algorithms for our AI models and products. As a Trust and Safety Research Engineer, you will work to design and train ML models based on research progress, which detect harmful user / model behaviors and help ensure society's well-being. You will apply your research skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.
What you will be working on :
- Design, iterate and build ML models to detect unwanted or anomalous behaviors from both users and LLM models
- Work with T&S ML engineers to review and iterate experiment ideations. Co-author the experiment success criteria and production deployment roadmaps
- Partner with T&S Policy and Enforcement cross-functional teams to understand emerging and sustained abuse patterns from user prompts and behaviors. Incorporate the insights into T&S research datasets
- Surface abuse patterns to sibling research teams in the company. Collaborate together to harden Anthropic’s LLMs at the pre / post training stages
- Stay current with state-of-the-art research in AI and machine learning, and propose ways to apply these advancements to T&S systems
You may be a good fit if you :
Strong candidates may also :
J-18808-Ljbffr
