ML Engineer with LLM / NLP

Austin, TX OR Sunnyvale CA

Full-Time

Responsibilities:

•Develop and implement a robust system for converting natural language queries with help of prompt engineering into useful format, which can be further programmatically used for search a set of SQL tables or set of documents.

•Development and application of word embedding techniques (Woprd2vec, Transformer model based encoders, LLM based encoder, BERT based encoders etc)

•Fine Tuning of Large Language Models with custom data sets. Utilize Generative AI techniques, leveraging Large Language models, to accurately interpret and convert natural language queries into SQL statements.

•Use of LLMs for the NLP state of art techniques like Text Classification, NER, Keyword Extraction, Text-to-SQL conversion.

•Check the feasibility of use cases based on Large Language Models, specifically in area chatbot for sales and finance problems.

•Develop mechanism to summarize SQL tables into user-level summary text, providing concise and meaningful insights from the data retrieved.

Skills

•Strong experience in architecting and development of ML, NLP based projects is a must.

•Strong track record of ML led solution development from scratch.

•Strong proficiency in Python Programming (very strong Python credentials only apply) and experience with relevant libraries and frameworks for NLP such as NLTK, spaCy, Hugging Face transformers.

•In-depth knowledge and experience in using Generative AI techniques for NLP tasks, preferable with Large Language models (e.g., GPT-3, GPT-4), GCP PALM models (code bison, text bison) or Hugging Face models.