What are the responsibilities and job description for the Data Engineer(ETL,SQL) position at Anblicks?
Data Engineer
Local to Dallas,TX
C2C
only 10 or above need passport number for genuinty
- Design, develop, and implement ETL processes to extract data from various source systems, transform it according to business requirements, and load it into target systems (e.g., data warehouse, data lake)
- Implement data validation and error handling within ETL pipelines.
- Build and maintain scalable, reliable, and efficient data pipelines.
- Design and implement data quality checks, validations, and transformations within ETL processes.
- Automate data quality monitoring, alerting, and reporting within ETL pipelines.
- Develop and implement data quality rules and standards within ETL processes.
- Integrate data from diverse sources, including databases, APIs, flat files, and cloud-based systems.
- Utilize ETL tools and technologies (e.g., SnapLogic, Informatica PowerCenter, Talend, AWS Glue, Apache Airflow, Azure Data Factory, etc.).
- Write SQL queries to extract, transform, load, and validate data.
- Use scripting languages (e.g., Python) to automate ETL processes, data quality checks, and data transformations.
