What are the responsibilities and job description for the Senior Data Engineer - CTH - Irving Texas 75039 position at Prudent Technologies and Consulting?
Job Details
Senior Data Engineer
Irving Texas 75039
Contract-to-hire, on-site (not a hybrid role)
Salary Range: $115-$125k (Depending on experience)
Must Have: Python, Azure Data Factory, Data bricks, data modeling/DB architecture, & SQL server
Good to have: automotive/insurance industry experience, NetSuite or other ERP systems (APIs), & relevant certification(s)
Recruiting Process: 1. Assessment, 2. Initial Teams interview with data team, 3. Final in-person or Teams interview
As a member of the Data and Analytics team, the Sr. Data Engineer role will contribute to the success in both the daily operations and long-term strategy of the organization s data assets.
The optimal candidate brings a business-centric mindset to data architecture efforts and has a track record of being a growth enabler.
Job Responsibilities:
- Design, build & maintain scalable data pipelines in Azure to ensure availability, reliability, scalability, security, and privacy.
- Actively contribute to both data & application governance initiatives by designing and implementing policies, procedures, and best practices.
- Implement API-based integrations to support continuing increases in data volume and complexity.
- Collaborate with report developers/analysts and business teams to improve data models that feed BI tools and increase data accessibility.
- Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and APIs.
- Assist in the design of processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Troubleshoot data pipeline related issues and oversee their resolution.
- Identify ways to improve data reliability, efficiency, and quality.
- Collaborate with all business units and development teams to develop strategy for long term data platform architecture.
- Identify and integrate external data sources from various source formats.
Qualifications/Skills:
- Mastery in converting raw data into valuable datasets
- Familiarity with one or more DevOps tools (Git, Jenkins, CI/CD, Jira)
- Process oriented with great documentation skills
- Excellent oral and written communication skills with a keen sense of customer service
Education/Experience:
- BS or MS degree in Computer Science or related field
- 5 years of database architecture and dimensional data modeling
Preferred Experience:
- 5 years of data migration activities
- 5 years of Python and SQL experience
- 3 years working in an Agile development environment pairing DevOps with CI/CD pipelines.
- 3 years with data processing systems in Azure (Data Factory, Data Lake storage, DataBricks, Event Hubs)
Nice to have:
- Experience in assisting Master Data Management efforts, including metadata management.
- Experience in automotive repair and/or insurance industries
- Microsoft DP-203 certification or Cloud certification on any platform
- Experience supporting integrations in/out of ERP systems (ie. NetSuite, SAP).
Salary : $115,000 - $125,000
