What are the responsibilities and job description for the Senior Member of Technical Staff position at Oracle?
Oracle Generative AI Service is an exciting team in Oracle Cloud Infrastructure. We are delivering innovative services at the intersection of artificial intelligence and cloud infrastructure. In Generative AI Service team, you will build and operate massive-scale cloud services leveraging state of art machine learning technologies. We are committed to providing the best in cloud products to meet the needs of our customers who are tackling some of the world’s most challenging problems.
You will be part of a team of smart, hands-on machine learning engineers with the expertise and passion to solve difficult problems in distributed highly available services and virtualized infrastructure. At every level, our engineers have a significant technical and business impact by designing and building innovative new systems to power our customer’s business critical applications. As a machine learning engineer in Generative AI Service team, you will be leading the effort of building distributed, scalable, high-performance AI model training and serving systems in partnership with our applied scientists and software engineers. You will dive deep into model structure to optimize model performance and scalability. You will build state of art systems with cutting-edge technologies in this fast evolving area.
What we offer:
- Being part of one of the most visionary and mission-driven organizations in Oracle, cooperating with talented peers with diverse backgrounds worldwide.
- High visibility to senior leadership, opportunity to make huge impacts across organizations.
- Opportunity to build state-of-the-art technologies in large language models (LLM) and generative AI at scale to solve real business problems.
- Close partnership with applied scientists and software engineers to deploy solutions into production in various business-critical scenarios.
- You are an experienced machine learning engineer with a proven track record of delivering large-scale, high-performance model serving/training systems in production.
- You are obsessed with customers and exceeding their expectations.
- You have excellent communication skills and you can clearly explain complex technical concepts.
- You are a disciplined engineer who understands the importance of high standards, never satisfied with mediocrity and constantly striving for excellence.
- You are passionate about technology and self-motivated to stay updated with latest developments in machine learning related technologies.
Minimum Qualifications
BS in Computer Science or equivalent experience.
3-5 years of experience in building scalable machine learning systems or in relevant MS/PhD research
Proficient in Python, PyTorch, and shell programming.
Hands-on experience in LLM serving and fine-tuning.
Experience with container orchestration technologies such as docker and Kubernetes.
Experience with production operations and best practices for deploying quality code for deep learning models
Ability to work in a collaborative, cross-functional team environment.
Preferred Qualifications
MS in Computer Science
Extensive experience with open-source software for LLM serving, such as vLLM, SGLang, or TensorRT-LLM.
Deep expertise in advanced optimization techniques, including quantization, speculative decoding, etc.
Experience with large-model training using Accelerate, DeepSpeed, or Megatron-LLM.
Proficiency with microservices architecture, containerization and orchestration technologies.
Proven experience deploying large AI models to production.
Strong communication skills, with the ability to effectively convey technical ideas both verbally and in writing
Career Level - IC3
Qualifications:
Disclaimer:Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $79,000 to $178,100 per annum. May be eligible for bonus and equity.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
Salary : $79,000 - $178,100