Senior Principal Applied Scientist

We are seeking a visionary leader to spearhead foundation model research and development efforts. As the lead of the evaluation science team, you will be responsible for driving the development and implementation of cutting-edge evaluation methods and technologies for evaluation of large language models, visual large language models, and agentive workflows that utilize them. You will lead a team of world-class scientists in inventing, implementing, and deploying state-of-the-art generative AI evaluation methods and/or specific domain industry algorithms and systems. You will lead prototyping and exploration of conceptually new solutions. You will work collaboratively with engineering, product, and other science teams  to identify customer needs in order to create and implement solutions, promote innovation, and drive service adoption, developing new intelligence around core products and services through applied research on behalf of our customers. 

As a Senior Principal, you will drive and plan implementation of company policy for achieving business goals, defining the bar for science practices while helping teams achieve those goals. You will develop deep product intuition to influence future product roadmaps and drive decision making, clearly articulating technical work to audiences of all levels and across multiple functional areas in both internal and external settings. You will engage in forward looking research, both internal and with academic institutions globally. You will perform an active role in team hiring, planning, review, and retrospective events. You will ensures experiments are ready for hand-off to Software Developers ship into production. 

Career Level - IC5

Qualifications:

Disclaimer:

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $139,400 to $291,800 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

Responsibilities:

Responsibilities:

• Research and Development: Conduct in-depth research on foundation model evaluation, including traditional NLP/CV metrics, LLMaaJ techniques, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation. Produce production-ready code for handoff of POC applications to counterparts in Engineering.
• Team Leadership: Help build and mentor a high-performing team of scientists and engineers.
• Collaboration: Work closely with cross-functional teams to integrate evaluation capabilities into various applications and products.
• Innovation: Identify new opportunities for evaluation and explore emerging technologies.
• Stay Updated: Maintain a deep understanding of industry trends and advancements in evaluation.

Qualifications and Experience:

• PhD Computer Science, Mathematics, Statistics, Physics, Linguistics or a related field (with a dissertation, thesis or final project centered in Machine Learning/Deep Learning/Generative AI). PhD plus 5 years relevant experience is preferred but not a must; OR Masters or Bachelor’s in related field with 8 years relevant experience
• Strong publication record, including as a lead author or reviewer, in top-tier journals or conferences.
• Extensive experience in generative AI and model/application evaluation.
• Proven track record of leading research and development projects
• Strong understanding of machine learning algorithms and architectures
• Excellent problem-solving and analytical skills
• Strong leadership and communication abilities

Salary : $139,400 - $291,800