What are the responsibilities and job description for the Gen AI / LLM Prompt position at Amiti Consulting, Inc?
Job Details
Role:- Gen AI / LLM Prompt and Data Engineer
Location: Santa Clara, CA
Duration: 6-12 month
Client Project Overview/Requirement
The client is working on a Generative AI project using Large Language Models (LLM) to understand and manage their bug tracking system, which includes JIRA. This system logs various requests, enhancements, and issues, often containing extensive text, attachments, images, and log files. The goal is to use LLM to find similarities, generate responses, create reports and dashboards, understand and update tasks, and track the status of bugs. They need a candidate experienced in data engineering and generative AI to handle this complex project.
Job Description
Responsibilities:
- Design Gen AI / LLM Prompt and Data Engineer, develop, and evaluate innovative LLM models to solve diverse challenges and opportunities across multiple use-cases using MS Azure services.
- Understand business problems, and help with defining and implementing a scalable Generative AI platform to solve them.
- Build large-scale production systems utilizing advanced machine learning and big data technologies.
- Develop and optimize data processing workflows for chunking, indexing, ingestion, and vectorization for both text and non-text data
- Benchmark and implement various vector stores, embedding techniques, and retrieval methods
- Create a flexible pipeline supporting multiple embedding algorithms, vector stores, search types (vector search, hybrid search, etc.) and search ranking
- Implement and maintain auto-tagging systems and data preparation processes for LLMs
- Develop tools and pipelines for text and image data cleaning, and refinement
- Integrate and optimize workflows using Azure AI Search, Azure AI Services, Azure PostgreSQL and various vector store technologies
- Use advanced prompting techniques to develop and optimize prompts for LLM to ensure model performance, responses quality and accuracy of the Gen AI platform.
- Contribute to automated model testing and evaluation infrastructure
- Build automations to create and select the best prompts for any given task
