What are the responsibilities and job description for the Gen AI LLM Engineer @ Sunnyvale, CA - Onsite position at Aroha Technologies?
Job Details
Job Title: Gen AI LLM Engineer
Location: Sunnyvale, CA (Work from office 3 days a week)
Role Overview:
We are seeking a Gen AI LLM Associate to refine and enhance a Large Language Model (LLM) for generating DB queries from natural language prompts. You will leverage your expertise in NLP and database technologies to develop a powerful tool for data analysts and engineers.
Key Responsibilities:
Model Tuning & Optimization:
Fine-tune LLMs on DB datasets for accurate and efficient query generation.
Experiment with model architectures, hyperparameters, and training techniques to improve performance and reduce biases.
Curate and clean DB datasets for training and evaluation.
Develop data pipelines and implement data augmentation techniques.
Design scalable systems for LLM deployment and integration with existing data platforms.
Develop user interfaces and APIs for seamless LLM interaction.
Stay updated on advancements in NLP, LLM, and DB technologies.
Research novel approaches to DB query generation and LLM fine-tuning.
Required Qualifications:
Strong foundation in NLP (e.g., transformers, attention mechanisms).
Proficiency in SQL and database concepts.
Strong programming skills in Python and/or Rust.
Experience with distributed systems (e.g., Apache Flink, Apache Spark, AWS/Google Cloud Platform services).
Preferred Qualifications:
Experience fine-tuning and deploying LLMs for tasks like code generation.
Familiarity with AWS services (e.g., S3, EC2, Lambda).