Data Engineer :: Hybrid @ (Dallas, TX or Kansas City, MO)

<>Job Title: Data Engineer
Location: Hybrid (Dallas, TX or Kansas City, MO)
Employment Type: Contract-to-Hire

---

Job Overview

We are seeking a Data Engineer to design, develop, and optimize ETL pipelines and data warehouse/lake solutions. The ideal candidate will have hands-on expertise with Azure data products, SQL databases, and Python/PySpark. This role offers an exciting opportunity to work in an Agile environment, collaborate with cross-functional teams, and contribute to cloud-based data engineering solutions.

---

Key Responsibilities

1. ETL & Data Pipeline Development

   • Design, build, and maintain ETL pipelines and data warehouses/lakes.
   • Ensure efficient data ingestion, transformation, and storage processes.

2. Azure Data Engineering

   • Work with Azure Data Factory (ADF), Databricks, and ADLS/Delta Lake for data processing and management.
   • Optimize data workflows using Azure-native tools and frameworks.

3. SQL Database Management

   • Develop and optimize SQL queries, stored procedures, and database structures.
   • Work with SQL Server (SSIS, SSRS, SSMS) for database administration and reporting.

4. Programming & Big Data Processing

   • Utilize Python, PySpark, and SQL for data transformation and analysis.
   • Work with large datasets and implement scalable data solutions.

5. CI/CD & Agile Development

   • Manage code repositories and releases using Git and Azure DevOps (ADO) CI/CD pipelines.
   • Work in an Agile environment, collaborating with teams to enhance data workflows.

---

Required Skills & Qualifications

<>Must Have:

• 2-5 years of experience in Data Engineering.
• Strong experience with ETL pipeline development and data warehousing/lakes.
• Hands-on expertise with Azure Data Factory (ADF), Databricks, and ADLS/Delta Lake.
• Experience with SQL databases (administration, SSIS, SSRS, SSMS).
• Proficiency in Python, PySpark, and SQL for data processing.
• Familiarity with Git and ADO CI/CD pipelines.
• Experience working in an Agile development environment.

<>Nice to Have:

• Experience with cloud-based data engineering best practices.
• Exposure to data modeling and performance optimization.
• Familiarity with other Azure data services.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.