What are the responsibilities and job description for the Data Integration Engineer/ 100% Remote/ Only on W2 role position at Stash Talent Services?
Job Title : Data Integration Engineer
Duration : 12 months CTH
Location : Rochester, New York ( 100% Remote
Top Skills Details
1) 5 years of experience in Data with a focus on data integration, data processing, data quality, data migration and data governance.
2) Azure Cloud - Azure Datalake, Databricks, Data Factory
3) 3 years of experience with Oracle, SQL Server and NoSQL databases.(Oracle preferred).
Description
Client is looking to bring in a SME to help with their Data Orchestration, Migrating and Processing. This candidate will help source, extract, and manipulate large data sets to serve the Analytics, Artificial Intelligence, and Machine Learning needs of Client Business.
Responsibilities
- Assemble large, complex data sets that meet business requirements.
- Deliver automation & efficient processes to ensure high quality throughput & performance of the entire data & analytics platform.
- Create and maintain optimal data pipeline architecture
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Ensure data extraction, transformation and loading data meet data security & compliance requirements
- Engage with data source platform leads to gain tactical and strategic understanding of data sources required for consumption.
- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Work closely with architects, solution leads, data owners, Data Scientists as well as key stakeholders to facilitate and coordinate the data platform backlog grooming process, triaging new feature requests in preparation for future project activities.
- Create data tools for data scientist team members that assist them in building and optimizing models for use in Client products.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Ensure data quality compliance to established SLAs.
- Provide guidance on data governance, security, and privacy.
Qualifications
