What are the responsibilities and job description for the Senior Azure Data Engineer position at Flexton Inc.?
- Hands on with Python, Databricks pipeline, deployment and testing.
- Continue to improve ETL Processes for scalability, quality and performance
- Independently identify and resolve complex technical problems around data pipelines and failures.
- Work with Data Engineers and other stakeholders for deployment, and writing automated test scripts and procedures
- Work on Data quality and data validations.
- Involved in writing automated scripts and testing Databricks notebooks written in python.
- End to End testing and deployment of pipelines.
- Lead quality initiatives around data quality and validation.
- Define testing methodology
Qualifications
- BS / MS S/W Engineering
- Quality assurance and automated testing experience
- Hands on with Python, Databricks pipeline, deployment and testing.
- ETL and Data quality. MS Azure, Python, ETL Processing
- DataWarehouse, Datamodeling background is a plus
