Job: Data Engineer

Location: Remote

Duration: Long Term

Summary:

Our AI & Digital Innovations teams bring the latest GenAI techniques plus a deep understanding of industry dynamics and corporate functions to help clients create the most value from data. Involved in specific engagements involving the building of new, bespoke advanced AI solutions for clients and internally. Leveraging your knowledge of algorithms, data structures, and performance optimism and experience with processing and interpreting data sets. Responsible for developing and translating computer algorithms into prototype code and maintaining, organizing, and identifying trends in large data sets. Proficiency in SQL database design and creating process documentation. Familiarity with the computer coding languages python, Azure Synapse to oversee real-time business metric aggregation, data warehousing and querying, schema and data management, and related duties. Develop technical solutions to improve access to data and data usage. Understand data needs and advise company on technological resources. Collaborating closely with other data scientists, machine learning engineers, and stakeholders to understand the project's objectives and translate these into innovative, data-driven solutions.

Skills: We are looking for a Mid-level Data Engineer with a minimum of 5 years of experience preferably GenAI projects.

An ideal candidate will have following qualifications:

Expertise in data ingestion, data transformation (ETL) and data modeling.

Experience with Python.

Experience in Agile/SCRUM enterprise-scale software development.

Demonstrated understanding of enterprise scale Azure cloud architecture.

Linux/Unix experience plus.

Design, develop, and implement a high-performance Python coding with a focus on efficiency, scalability, and performance.

Create a robust and reusable code using Python that can independently generate creative content and directly contribute to the project's goals.

Working Experience on using standard ML libraries such as Numpy and Pandas

Troubleshoot, debug, and resolve any issues that occur within the generative AI system development, ensuring that the models perform optimally.

Background on Unit, Integration, and System testing. Conduct tests and experiments to enhance the performance of overall system and document the results for further improvements.

Knowledge of and ability to apply fundamental concepts, practices, and procedures in related skillsets.

Education:

Bachelor’s degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus

Required Skills:

Data Analysis

MS SQL Azure

Data Architecture

Python

Documenting