What are the responsibilities and job description for the AI Data Engineer position at Partner's Consulting, Inc.?
Job Details
Title: AI Data Engineer
Location: Folsom, NJ (Hybrid)
Type: Contract
Our client is seeking a highly skilled AI Specialist to design, develop, test, deploy, and monitor standardized or ad hoc reports, dashboards, or data requests. Additionally, this role develops and maintains Artificial Intelligence / Machine Learning (AI / ML) models and routines for end-user access for analytical purposes. The role involves working with databases, data warehouses, queries, and scripts, and reporting information for end-users. Analysts also integrate data from multiple sources to produce requested or required data elements, metrics, Key Performance Indicators (KPIs), reports, or visualizations.
Data Engineer/ Data Scientist will own development standards and be responsible for the quality of all routines developed for the Data Warehouse. This role will also own data engineering operations, troubleshooting data-related issues using SQL and other Integration monitoring tools, and main data-related documentation. Additionally, this role will create requirements and specifications for AI use cases based on business request. This is an individual-contributor role with high visibility that will also require production support and maintenance.
Key Accountabilities:
- Build and maintain data pipelines using Informatica Intelligent Cloud Services ( IICS) / Snowflake
- Integrate various sources into Snowflake for model, validation, and deployment
- Support deployment and monitoring of AI / ML models in production
- Implement best practices for utilization of Cortex and other Snowflake functions
- Partner with Users and Analysts to complete functional specifications and translate the same to technical specifications for development work
- Maintain documentation for all routines developed
Requirements:
- 3-5 years of experience in data engineering with a significant focus on Snowflake
- 3-5 years of expertise with complex SQL
- 3-5 years of expertise in Stored procedures using JavaScript or Python
- 3-5 years of experience supporting AI initiatives in a data engineering or data scientist role
- Proficiency in Pandas, PySpark, Snowpark ML
- Knowledge of Snowflake Cortex Large Language Model (LLM) functions and statistical modeling
- Proficient with configuration of REST / SOAP APIs and parsing of XML / JSON data
- Strong ability to carry out assigned tasks independently with little supervision
- Extensive experience with data warehousing concepts and performance optimization
- Extensive experience in extract, transform, and load (ETL / ELT) tools; IICS platform is a plus
- Proactive with a can-do attitude and willingness to learn new technologies
REQ-331
