What are the responsibilities and job description for the Data Engineer :: Hybrid @ (Kansas City, MO or Dallas, TX) position at EnpowerTek?
Job Details
<>
Job Title : Data Engineer
Location : Hybrid (Kansas City, MO or Dallas, TX)
Employment Type : Contract-to-Hire
Job Overview
We are seeking a Data Engineer to design, develop, and optimize ETL pipelines and data warehouse/lake solutions. The ideal candidate will have hands-on expertise with Azure data products, SQL databases, and Python/PySpark. This role offers an exciting opportunity to work in an Agile environment, collaborate with cross-functional teams, and contribute to cloud-based data engineering solutions.
Key Responsibilities
ETL & Data Pipeline Development
- Design, build, and maintain ETL pipelines and data warehouses/lakes.
- Ensure efficient data ingestion, transformation, and storage processes.
Azure Data Engineering
- Work with Azure Data Factory (ADF), Databricks, and ADLS/Delta Lake for data processing and management.
- Optimize data workflows using Azure-native tools and frameworks.
SQL Database Management
- Develop and optimize SQL queries, stored procedures, and database structures.
- Work with SQL Server (SSIS, SSRS, SSMS) for database administration and reporting.
Programming & Big Data Processing
- Utilize Python, PySpark, and SQL for data transformation and analysis.
- Work with large datasets and implement scalable data solutions.
CI/CD & Agile Development
- Manage code repositories and releases using Git and Azure DevOps (ADO) CI/CD pipelines.
- Work in an Agile environment, collaborating with teams to enhance data workflows.
Required Skills & Qualifications <>Must Have:
- 2-5 years of experience in Data Engineering.
- Strong experience with ETL pipeline development and data warehousing/lakes.
- Hands-on expertise with Azure Data Factory (ADF), Databricks, and ADLS/Delta Lake.
- Experience with SQL databases (administration, SSIS, SSRS, SSMS).
- Proficiency in Python, PySpark, and SQL for data processing.
- Familiarity with Git and ADO CI/CD pipelines.
- Experience working in an Agile development environment.
<>Nice to Have:
- Experience with cloud-based data engineering best practices.
- Exposure to data modeling and performance optimization.
- Familiarity with other Azure data services.
