What are the responsibilities and job description for the Data Engineer Level 2 position at United Software Group?
Role : Data Engineer Level 2
Location : Remote
Duration : Contract to Hire
W2 position / /
Job Description :
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities :
Design and develop Azure solutions
Implement automated unit and integration testing
Collaborate with architecture and lead engineers to ensure consistent development practices
Participate in retrospective reviews
Participate in the estimation process for new work and releases
Collaborate with other engineers to solve and bring new perspectives to complex problems
Drive improvements in data engineering practices, procedures, and ways of working
Embrace new technologies and an ever-changing environment
Requirements :
5 years proven ability of professional Data Development experience
3 years proven ability of developing with Azure and SQL (Oracle, SQL Server)
3 years of experience with PySpark / Spark
2 years of experience in Azure Data Factory and / or Azure Databricks
Experience in working with large-scale data sets and distributed systems
Full understanding of ETL concepts and Data Warehousing concepts
Exposure to version control software (Git, GitHub SaaS)
Strong understanding of Agile Principles (Scrum)
Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)
Bonus Points for experience in the following
Proficient with Relational Data Modeling
Understanding of Data Mesh Principles
Experience with CI / CD - Continuous Integration / Continuous Delivery
Experience with Python Library Development
Experience with Structured Streaming (Spark or otherwise)
Experience with Kafka and / or Azure Event Hub
Experience with Github SaaS / Github Actions
Experience with Snowflake and Databricks
Exposure to Service Oriented Architecture
Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
Key Responsibilities :
Design and develop Azure solutions
Implement automated unit and integration testing
Collaborate with architecture and lead engineers to ensure consistent development practices
Participate in retrospective reviews
Participate in the estimation process for new work and releases
Collaborate with other engineers to solve and bring new perspectives to complex problems
Drive improvements in data engineering practices, procedures, and ways of working
Embrace new technologies and an ever-changing environment
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Data Engineer Level 2?
Sign up to receive alerts about other jobs on the Data Engineer Level 2 career path by checking the boxes next to the positions that interest you.