What are the responsibilities and job description for the Data Quality Engineer position at Sparktek?
Need 10 years candidates
Note : Should be strong at Python & AWS
Job Requirements : Must Haves Skills
Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).
Experience in Automating ETL process / Pipelines and AWS Data & Infrastructure with Python.
Extensive experience with AWS components like S3, Athena, EMR, Glue, Redshift, Kinesis and SageMaker.
Extensive Experience with SQL / Unix / Linux scripting.
Developing / testing Experience on Cloud / On Prem ETL Technologies (Ab Initio, AWS Glue, Informatica, Alteryx).
Experience in Data migration from Onprem to Cloud is Plus.
Experienced in large-scale application development testing - Cloud / On Prem Data warehouse, Data Lake, Data Science.
Extensive experience in DevOps / Data Ops space.
Having experience in Data Science platforms like SageMaker / Machine Learning Studio / H2O is plus.
Work Description SDET - Python, AWS, Unix and ETL.
- Work with business stakeholders, Business Systems Analysts and Developers to ensure delivery of Data Applications.
- Building Automation Frameworks using Python.
- Designing and managing the data workflows using Python during development and deployment of data products
- Design, development of Reports and dashboards.
- Analyzing and evaluating data sources, data volume, and business rules.
- Should be well versed with the Data flow and Test Strategy for Cloud / On Prem ETL Testing.
- Interpret and analyses data from various source systems to support data integration and data reporting needs.
- Experience in testing Database Application to validate source to destination data movement and transformation.
- Work with team leads to prioritize business and information needs.
- Develop and summarize Data Quality analysis and dashboards.
- Knowledge of Data modeling and Data warehousing concepts with emphasis on Cloud / On Prem ETL.
- Execute testing of data analytic and data integration on time and within budget.
- Troubleshoot & determine best resolution for data issues and anomalies
- Has deep understanding of data architecture & data modeling best practices and guidelines for different data and analytic platforms
Nice to Have Skills
Soft Skills
Note : We are actively looking for Data Engineering (Python) profiles and good to have Testing experience. We need more Data Engineer skills.
