What are the responsibilities and job description for the Data Engineer Position position at Alignity?
Job Description
We are seeking a highly skilled Data Engineer with 8 years of experience in SQL and Python programming to join our team. The ideal candidate will have expertise in writing complex SQL queries, stored procedures, functions, and performance tuning techniques. Additionally, strong experience in Python for data engineering use cases, including data transformation, ETL, and automation is required.
The role involves working on large-scale data platforms, ensuring efficient data processing and ETL workflows. Key responsibilities include developing, optimizing, and maintaining complex SQL queries, functions, and stored procedures to support data processing and analytics workflows. Analyzing and optimizing SQL performance by improving indexing, partitioning, and query execution plans is also crucial.
Key Responsibilities:
We are seeking a highly skilled Data Engineer with 8 years of experience in SQL and Python programming to join our team. The ideal candidate will have expertise in writing complex SQL queries, stored procedures, functions, and performance tuning techniques. Additionally, strong experience in Python for data engineering use cases, including data transformation, ETL, and automation is required.
The role involves working on large-scale data platforms, ensuring efficient data processing and ETL workflows. Key responsibilities include developing, optimizing, and maintaining complex SQL queries, functions, and stored procedures to support data processing and analytics workflows. Analyzing and optimizing SQL performance by improving indexing, partitioning, and query execution plans is also crucial.
Key Responsibilities:
- Develop scalable and efficient data pipelines using Python for data engineering and transformation.
- Implement and manage workflow automation using Apache Airflow, ensuring smooth execution of data pipelines.
- Monitor and troubleshoot SQL and Python scripts to ensure high performance and reliability.
