What are the responsibilities and job description for the Research Scientist position at Rose International?
This role is for a Research Scientist who will be responsible for designing and implementing robust processes to evaluate and improve LLM-based models. More specifically, they will work on ensuring that we build models that will accelerate the developer work cycle and improve how software is built.
This researcher will :
Work closely with engineers, PMs, designers, and data scientists to align on research goals and build scalable end-to-end evaluation pipelines.
Report on their research and make recommendations to stakeholders.
Work autonomously and mentor other researchers to support the goals of the research organization.
Minimum Qualifications
4 years of experience in an applied research setting, or similar.
Proven experience developing benchmarks and metrics to evaluate AI models, preferably with a focus on code generation or natural language processing (NLP).
Familiarity with software engineering principles (unit tests, CI / CD, version control etc.).
Strong programming skills in 1 or more programming languages (including Python).
2 years or more of experience with machine learning and data science algorithms and tools (e.g., PyTorch).
Ability to produce meaningful visualizations and reports, and effectively present results to different audiences and across multiple media formats.
Ability to work independently as well as collaboratively with minimal direction.
Organized, highly attentive to detail, and manages time well.
Experience working in industry.
Preferred Qualifications
Advanced degree (MS / PhD) in data analytics, statistics, or any engineering or computer science field.
Experience with large language models (LLMs) and knowledge of state-of-the-art code generation techniques.
Publication(s) in the fields of artificial intelligence, machine learning or data science.
Familiarity with code generation-specific benchmarks and metrics.
Ability to modify or fine-tune pre-trained models for specialized tasks.
Familiarity with code scanning tools.
Only those lawfully authorized to work in the designated country associated with the position will be considered.
Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Research Scientist?
Sign up to receive alerts about other jobs on the Research Scientist career path by checking the boxes next to the positions that interest you.
