What are the responsibilities and job description for the Data Engineer position at Robert Half?
Job Description
Job Description
We are inviting applications for a Data Engineer role in Fairfield County, Connecticut, the successful candidate will play a pivotal role in enhancing our data infrastructure and pipelines, ensuring data accuracy and reliability.
Responsibilities :
- Design, develop, and maintain our data infrastructure and pipelines to ensure efficient data processing and storage.
- Incorporate processes and systems for monitoring data quality, ensuring that the data needed for key stakeholders and business processes is always accurate and available.
- Identify and resolve data inconsistencies, errors, and anomalies to ensure data quality and reliability.
- Collaborate with data scientists, analysts, and other stakeholders to comprehend data needs and requirements.
- Enhance internal processes by automating manual processes, optimizing data delivery, and re-designing infrastructure for better scalability.
- Monitor and optimize data performance, troubleshooting, and resolving issues as they arise.
- Stay updated with new technologies and approaches in data engineering, suggesting improvements to our data infrastructure.
- Handle structured, semi-structured, and unstructured data sources effectively.
- Implement cloud-native data pipeline architectures using Azure or AWS.
- Utilize SQL and Python to manage large data sets.
- Minimum of five years of detail-oriented experience as a Data Engineer or in a similar role.
- Specialized knowledge and experience in Cloud Technologies.
- Proficiency in Data Visualization to illustrate data in a comprehensible manner.
- Expertise in Algorithm Implementation to optimize data retrieval and usage.
- Demonstrated ability in Analytics to interpret and manipulate complex data sets.
- Experience in API Development to facilitate efficient data exchange.
- Proficiency in AWS Technologies to manage and analyze data.
- Experience with Snowflake for data warehousing solutions.
- Proficient in Python for scripting and data manipulation.
- Familiarity with Microsoft SQL for database management and operations.
