Lead Data Engineer with GenAI

Senior AI Engineer (Data Engineer),

at client they develop the legal profession s most innovative products for data analysis, visualization, and research. they use the latest techniques in AI, machine learning, and data visualization to uncover insights about legal matters, contracts, and legal spend management.

We are looking for a skilled LLM Application Developer to join our team. You will be working closely with the Data Scientists and be responsible for implementing large language model (LLM) based applications, working with proprietary and open-source models as well as popular frameworks such as LangChain to ensure seamless integration and deployment.

RESPONSIBILITIES

Building standalone applications that interact with LLM models

Building RAG-based applications

Understanding of Vector DBs like Solr for LLM based applications

Integrate models with existing systems and APIs.

Implement production quality ETL jobs

Preprocess and manage data for training and deployment.

Collaborate with cross-functional teams to define, design, and ship new features.

Write clean, maintainable, and efficient code.

Document development processes, code, and APIs.

REQUIREMENTS

Proven experience in building customer facing ML based APIs

Experience in developing applications that are scalable to handle TBs of data

Strong knowledge of API integration (RESTful, GraphQL).

Experience with data preprocessing, SQL, and NoSQL databases as well as vector stores (e.g., Postgres, MySQL, Solr, Elasticsearch/OpenSearch, etc.)

Familiarity with deployment tools (Docker, Kubernetes).

Experience with DevOps tools like Jenkins, Terraform, Cloud Formation templates is highly preferred.

Excellent problem-solving and communication skills.

Experience with Spark/Hadoop, EMR or any other Big Data technology would be a plus

Ability to work collaboratively in an agile team environment.

PREFERRED QUALIFICATIONS

- Degree in Computer Science, Data Science, or a related field. - Certifications in machine learning, data science, or cloud computing. - Portfolio showcasing past projects or contributions to open-source projects.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.