Job Description :
- We are seeking a dedicated and skilled LLM Application Support Engineer to join our technical team responsible for providing L1, L2, and L3 specialized application support for Large Language Model (LLM)-based applications.
- Responsible for implementing automated testing frameworks for both applications and LLMs specifically.
- Application Support :
Provide L1, L2, and L3 support for LLM-based applications, ensuring timely resolution of issues.
Ensure the scalability and performance of LLM-based applications to handle large datasets and complex queries.Identify opportunities for process improvements and implement innovative solutions to enhance the efficiency and effectiveness of LLM deployments.Monitor application performance and proactively identify potential issues.Troubleshoot and resolve application issues, escalating to higher levels of support when necessary.Collaborate with development teams to address and resolve complex technical issues.Maintain detailed documentation of support activities, including issue resolution steps and best practices.Ensure compliance with data security and regulatory requirements during support activities.Conduct root cause analysis for recurring issues and implement preventive measures.Automated Testing Frameworks :Develop and implement automated testing frameworks for LLM-based applications.
Design and execute automated tests to validate the functionality, performance, and reliability of applications and LLMs.Create and maintain test scripts for unit tests, integration tests, and end-to-end tests.Collaborate with development teams to integrate automated testing into the CI / CD pipeline.Monitor and analyze test results, identifying and reporting defects.Continuously improve automated testing processes and frameworks to enhance test coverage and efficiency.Ensure compliance with data security and regulatory requirements during testing activities.Stay updated with the latest trends and best practices in automated testing and LLM technologies.Qualifications :
Bachelor's Degree with 2-4 years of academic / industry experience in application support or development.Preference for candidates with experience in machine learning or LLM-based applications.Proven experience with core AWS services, including but not limited to EC2, S3, and RDS.Demonstrated proficiency with current software engineering methodologies, such as Agile SDLC approaches, distributed source code control, project management, issue tracking, and CI / CD tools and processes.Proficiency in programming languages such as Python, SQL, R, and JavaScript.Strong understanding of machine learning frameworks and libraries (e.g., TensorFlow, PyTorch, scikit-learn).Solid understanding of container strategies such as Docker and ECS.Excellent skills and deep knowledge of databases such as Postgres, Elasticsearch, and Redshift, including distributed database design, SQL vs. NoSQL, and database optimizations.Experience developing web applications in frameworks like Streamlit, Shiny, Vue, React, etc.Proficiency with predictive modeling approaches and / or experience working with large language models.Experience with testing frameworks and automated testing tools (e.g., pytest, Selenium, JUnit).Excellent problem-solving skills and attention to detail.Strong communication and interpersonal skills.Ability to work effectively in a collaborative, fast-paced environment.Must have a strong capacity for independent thinking and the ability to grasp underlying scientific questions.Must be effective in a dynamic environment while adapting to changing priorities and have excellent written and verbal communication and presentation skills.Must have excellent time management and interpersonal skills.BioPharma experience preferredThis role requires a solid understanding of LLMs, application support, and automated testing methodologies.Benefits :
Healthcare Insurance : Synectics offers eligible employees and their dependents healthcare coverage through BlueCross BlueShield of Illinois. Eligibility begins on the 1st day of the calendar month following 60 days of continuous full time employment with Synectics. Premiums are subsidized by Synectics.
Dental Insurance : Synectics offers eligible employees and their dependents a dental plan through MetLife. Eligibility begins on the 1st day of the calendar month following 60 days of continuous full time employment with Synectics.
Vision Insurance : Synectics offers eligible employees vision insurance through VSP. Eligibility begins on the 1st day of the calendar month following 60 days of continuous full time employment with Synectics.401(k) Plan : The Synectics Inc. Investment Savings Retirement Plan. Synectics offers all employees who are 21 years of age or older the opportunity to invest in the 401(k) Plan on the first enrollment date that is at least 30 days after employment begins. Enrollment dates are each January 1st, April 1st, July 1st, and October 1st.
Technical Certification Bonus : Synectics is pleased to award its employees a bonus of up to $500 for an approved professional certification. In determining the bonus amount, Synectics will consider the cost of the test(s) for any certification relating to your current position, achieved during your employment with us. Only one Certification Bonus per calendar year may be awarded per employee. Only current, active employees will be eligible to receive this bonus. It will be awarded 90 days after the Synectics office has received documentation confirming the successful completion of the certification.
Synectics is an equal opportunity employer.
