What are the responsibilities and job description for the Data Integration Specialist (Hybrid) position at Symmetrio?
Symmetrio is actively recruiting for a Data Integration Specialist for our customer, a large government organization in Philadelphia, PA. As a Data Integration Specialist, you will play a crucial role in the seamless migration, integration, and management of large-scale data across Amazon S3 and Redshift environments. This role demands not only technical expertise but also an in-depth understanding of data architecture, data security, and integration strategies to ensure robust data infrastructure.
This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.
Responsibilities
This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.
Responsibilities
- Design, develop, and deploy ETL/ELT data pipelines to facilitate the transfer of complex datasets into Amazon S3, using tools such as Azure Data Factory, optimized for performance, resilience, and scalability
- Implement automated workflows to streamline the continuous data migration process, ensuring that data ingestion and processing run smoothly with minimal manual intervention
- Set up and manage Amazon S3 buckets for optimized data storage solutions, and configure data schemas and tables within Amazon Redshift to accommodate evolving business needs
- Migrate cleaned and preprocessed data efficiently into Amazon S3 and Redshift, ensuring data consistency and integrity throughout the process
- Proactively monitor data pipelines for performance, identifying potential bottlenecks or failures, and implementing solutions to maintain optimal data flow
- Regularly assess and refine data integration processes to enhance system efficiency and scalability, leveraging best practices in cloud and data engineering
- Maintain meticulous documentation for all data integration processes and ensure all activities comply with data governance standards, security protocols, and company policies
- Minimum of 3 years of experience working as a Data Integration Specialist
- Proficiency with cloud platforms, particularly AWS (S3, Redshift, Lambda) and Azure Data Factory
- Strong skills in SQL and experience with ETL tools
- Demonstrated expertise in data security and integrity measures, including encryption and secure data transfer
- Excellent problem-solving and analytical abilities for troubleshooting data integration challenges
- Effective communication and documentation skills, with the ability to clearly document technical processes
- Preferred experience with AWS Glue, Python, C#, and SparkSQL
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Paid Time Off (Vacation, Sick & Public Holidays)
