What are the responsibilities and job description for the Data Engineer position at Oakwood Systems Group Inc.?
Position Overview
As a Data Engineer, you will design, build, and optimize reusable, scalable data pipelines with robust error handling and reporting. Your work will enable advanced analytics and data-driven decision-making for our clients across various industries. This role offers the opportunity to work with state-of-the-art cloud platforms like Microsoft Fabric, as well as industry-leading tools and technologies.
Key Responsibilities
- Develop, maintain, and optimize reusable, scalable data pipelines that include robust error handling and logging mechanisms.
- Implement automated notifications and error reporting using Azure Logic Apps and other tools.
- Collaborate with cross-functional teams to ensure data pipelines align with business objectives and meet performance requirements.
- Ensure data quality by implementing and maintaining frameworks such as Great Expectations or similar tools.
- Design and implement data models and ETL/ELT processes that enable high-performance analytics solutions.
- Support the integration and transformation of diverse data sources into unified and consumable formats.
- Stay up-to-date with the latest advancements in Azure data services, including Microsoft Fabric, to deliver innovative solutions.
- Implement automated notifications and error reporting using Azure Logic Apps and other tools.
- Collaborate with cross-functional teams to ensure data pipelines align with business objectives and meet performance requirements.
- Ensure data quality by implementing and maintaining frameworks such as Great Expectations or similar tools.
- Design and implement data models and ETL/ELT processes that enable high-performance analytics solutions.
- Support the integration and transformation of diverse data sources into unified and consumable formats.
- Stay up-to-date with the latest advancements in Azure data services, including Microsoft Fabric, to deliver innovative solutions.
Required Skills
- 3-5 years of proven experience as a Data Engineer or in a similar role.
- Proficiency in designing and implementing data pipelines with tools such as Azure Data Factory and Azure Synapse.
- Strong programming skills in Python (preferable), Spark, Java, or C#
- Advanced SQL expertise (T-SQL, PL/SQL) for database design and query optimization.
- Hands-on experience with cloud data platforms, particularly Azure (Databricks, Synapse, Data Factory, Logic Apps).
- Familiarity with data quality frameworks such as Great Expectations or equivalent.
- Proficiency in designing and implementing data pipelines with tools such as Azure Data Factory and Azure Synapse.
- Strong programming skills in Python (preferable), Spark, Java, or C#
- Advanced SQL expertise (T-SQL, PL/SQL) for database design and query optimization.
- Hands-on experience with cloud data platforms, particularly Azure (Databricks, Synapse, Data Factory, Logic Apps).
- Familiarity with data quality frameworks such as Great Expectations or equivalent.
Preferred Experience
- Proficiency with Microsoft Fabric for analytics and data processing.
- Advanced knowledge of modern data architectures (Medallion, DataVault, Lambda/Kappa)
- Solid Experience with DevOps practices using Azure DevOps or Git.
- Knowledge of business intelligence tools like Power BI or Tableau.
- Azure certifications (e.g., Azure Fundamentals, Power Platform certifications).
- Advanced knowledge of modern data architectures (Medallion, DataVault, Lambda/Kappa)
- Solid Experience with DevOps practices using Azure DevOps or Git.
- Knowledge of business intelligence tools like Power BI or Tableau.
- Azure certifications (e.g., Azure Fundamentals, Power Platform certifications).
Why Join Oakwood?
- Competitive compensation with bonus potential.
- Comprehensive benefits, including health, dental, and vision coverage.
- Generous PTO and paid holidays.
- Certification support, training programs, and professional growth opportunities.
- Flexible work environment with remote and hybrid options.
- Comprehensive benefits, including health, dental, and vision coverage.
- Generous PTO and paid holidays.
- Certification support, training programs, and professional growth opportunities.
- Flexible work environment with remote and hybrid options.
***We are seeking candidates who can work directly on our W-2. Unfortunately, we cannot accommodate third-party, corp-to-corp arrangements or candidates that need immigration-related sponsorship
(e.g., H-1B, TN, STEM OPT, etc.) now or in the future.