You haven't searched anything yet.
Role: Sr Data Engineer
Location: Remote
Duration: Long Term
Responsibilities
Software Development: Design, build and maintain robust and scalable software development applications
Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines on AWS, ensuring the efficient and timely transfer of data from various sources to our data warehouse.
Data Integration: Implement and manage third-party data integration tools like Fivetran to streamline data collection and transformation processes.
Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of data throughout the pipeline.
Performance Optimization: Continuously monitor and optimize data pipelines for improved speed, efficiency, and cost-effectiveness.
Security and Compliance: Implement data security best practices and ensure compliance with data protection regulations, such as GDPR, as applicable.
Documentation: Create and maintain comprehensive documentation for data pipelines, workflows, and procedures to facilitate knowledge sharing and collaboration within the team.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and provide support in delivering relevant datasets.
Technology Evaluation: Stay updated on emerging data engineering technologies and best practices, making recommendations for improvements and optimizations.
Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree is a plus.
Proven experience as a Software Engineer, with a minimum of 9 years working on software engineering, data pipelines, data integration, and database management.
Strong expertise in AWS services, including S3, Glue, Redshift, and other relevant data-related services.
Hands-on experience working with data integration tools, preferably Fivetran.
Hands-on experience working with orchestration services, preferably Airflow.
Proficiency in database management systems, such as Amazon Aurora and Snowflake.
Solid programming skills in languages like Python, Java, or Scala.
Knowledge of data modeling, ELT processes, and data warehousing concepts.
Familiarity with data quality and data governance principles.
Strong problem-solving skills and an ability to work independently and as part of a team.
Excellent communication skills to collaborate with cross-functional teams and articulate technical concepts to non-technical stakeholders.
AWS or other relevant certifications are a plus.
Experience working with distributed teams - be a self starter and proactive in communication
YOGI || Alrek Business Solutions Inc.
Senior Bench Sales Recruiter
Email: yogi@absli.com
Ph: (847) 2320480/ EXT - 480
Linkedin: linkedin.com/in/reddipalliyogendra-11b791216
Full Time
$112k-137k (estimate)
06/29/2024
07/14/2024
absli.com
SCHAUMBURG, IL
25 - 50
Private
PRAVEEN KUMAR GOUD
$10M - $50M
IT Outsourcing & Consulting
The following is the career advancement route for Sr Data Engineer positions, which can be used as a reference in future career path planning. As a Sr Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Sr Data Engineer. You can explore the career advancement for a Sr Data Engineer below and select your interested title to get hiring information.