What are the responsibilities and job description for the Software Engineer - LLM infrastructure position at Snowflake Computing?
Build the future of the AI Data Cloud. Join the Snowflake team.
Snowflake delivers a unified platform for secure development and deployment of LLMs and ML models. Snowflake AI and ML capabilities allow you to create generative AI applications with fully managed and enterprise-grade LLMs while providing full governance.
We are seeking a skilled and experienced Infrastructure Engineer to join our AI / ML organization. In this role, you will be responsible for designing, developing, and maintaining the infrastructure that supports serving large language models with world class performance and availability.
Responsibilities :
- Contribute to the open source vLLM inference engine
- Design and implement scalable infrastructure solutions to support the deployment of large language models.
- Optimize compute, storage, and networking resources to enhance the performance and cost-efficiency of LLM operations.
- Develop and maintain tools for monitoring and managing LLM performance, including resource utilization, latency, and throughput.
- Implement security measures and best practices to protect sensitive data processed by LLMs.
- Troubleshoot and resolve infrastructure issues in a timely manner, ensuring minimal disruption to model deployment and availability.
- Stay updated with advancements in AI infrastructure technologies and contribute to the adoption of new tools and frameworks.
- Document infrastructure designs, processes, and configurations for knowledge sharing and training purposes.
- Provide technical guidance and mentorship to junior members of the infrastructure team.
Requirements :
Every Snowflake employee is expected to follow the company's confidentiality and security standards for handling sensitive data. Snowflake employees must abide by the company's data security plan as an essential part of their duties. It is every employee's duty to keep customer information secure and confidential.
Snowflake is growing fast, and we're scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
