What are the responsibilities and job description for the Azure Data Engineer position at TEKsystems c/o Allegis Group?
Job Details
Description
The Databricks Engineer will work with stakeholders to design and develop data-oriented solution architecture involving On-Prem and cloud (Microsoft Azure) technologies. The candidate will collaborate with diverse teams necessitating superb interpersonal, communicative, customer service, time management, planning, and organizational abilities. A strong capacity for analysis and problem-solving is essential. Candidates with Databricks certifications are highly preferred. They are using lake houses that are already set up and creating pipelines to gather data and send it out using an API. They have a developer on the API side they will be paired with. Everything is done on Azure. They will be working on a team for a product that will be empowering a new energy experience. They are packaging data (example he gave was metering data for millions of customers). This product is under a non-disclosure, so he could not give a lot of details Responsibilities: Data Pipeline Development: Design and develop robust data pipelines to ingest, store, and process data from various sources. Data Modeling: Create and maintain data models that support data analysis and reporting. These models help organize and structure data for efficient querying and visualization. ETL Processes: Build and maintain Extract, Transform, Load (ETL) processes. These processes move data between systems, ensuring data quality and consistency. Communicate effectively and timely with customers, team members, and management Provide timely, consistent, effective production application support Ensure required documentation for projects is developed Adhere to Change Management policies and procedures Respond/Resolve quickly & effectively to all operational problems Be a student of the business, taking care to understand the challenges & goals of our company
Skills
Databricks, azure, CosmosDB, etl, ssis, Azure Event Hub, Azure Storage, Azure Key Vault, agile, power bi, devops, ci/cd, architecture
Top Skills Details
Databricks,azure,CosmosDB,etl,ssis,Azure Event Hub,Azure Storage,Azure Key Vault
Additional Skills & Qualifications
Additional Skills (These are "Nice to Haves" but the hiring manager let us know these are borderline requirements): Experience with Agile as well as DevOps, CI/CD methodologies- The team operates in an Agile environements, so having Agile experience while not a MUST have it is a STRONG nice to have. Certifications are a BIG advantage as well: Anything related to Databricks or Azure - Engineering, Architecture, ETL, etc. Experience with PowerBI for data visualization and reporting Data Engineering Tools: Familiarity with tools like Apache Spark and Delta Lake. Python Experience- They operate pretty much fully in this language Additional Skills: Knowledge of cloud PaaS architecture & resources. Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services. Excellent root cause analysis & problem-solving skills Knowledge and understanding of software development technologies, methodology and associated tools Strong project management skills including the ability to effectively organizes tasks, manages multiple priorities/details, and meets tight deadlines Strong oral and written communication skills Effective consulting skills with proven ability to influence others Builds productive relationships with a focus on cooperation & teamwork Experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions. Experience with performance tuning techniques in a lakehouse environment, such as partitioning, aggregations, materialized views, etc. Ability to build relationships and work with all levels of management, vendors, and other internal and external groups Experience leading and managing technology projects including coordinating resources and tasks across multiple teams and business units. Experience developing complex logical and physical data models
Experience Level
Expert Level
Pay and Benefits
The pay range for this position is $80.00 - $92.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
Workplace Type
This is a hybrid position in Atlanta,GA.
Application Deadline
This position is anticipated to close on Mar 18, 2025.
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
The Databricks Engineer will work with stakeholders to design and develop data-oriented solution architecture involving On-Prem and cloud (Microsoft Azure) technologies. The candidate will collaborate with diverse teams necessitating superb interpersonal, communicative, customer service, time management, planning, and organizational abilities. A strong capacity for analysis and problem-solving is essential. Candidates with Databricks certifications are highly preferred. They are using lake houses that are already set up and creating pipelines to gather data and send it out using an API. They have a developer on the API side they will be paired with. Everything is done on Azure. They will be working on a team for a product that will be empowering a new energy experience. They are packaging data (example he gave was metering data for millions of customers). This product is under a non-disclosure, so he could not give a lot of details Responsibilities: Data Pipeline Development: Design and develop robust data pipelines to ingest, store, and process data from various sources. Data Modeling: Create and maintain data models that support data analysis and reporting. These models help organize and structure data for efficient querying and visualization. ETL Processes: Build and maintain Extract, Transform, Load (ETL) processes. These processes move data between systems, ensuring data quality and consistency. Communicate effectively and timely with customers, team members, and management Provide timely, consistent, effective production application support Ensure required documentation for projects is developed Adhere to Change Management policies and procedures Respond/Resolve quickly & effectively to all operational problems Be a student of the business, taking care to understand the challenges & goals of our company
Skills
Databricks, azure, CosmosDB, etl, ssis, Azure Event Hub, Azure Storage, Azure Key Vault, agile, power bi, devops, ci/cd, architecture
Top Skills Details
Databricks,azure,CosmosDB,etl,ssis,Azure Event Hub,Azure Storage,Azure Key Vault
Additional Skills & Qualifications
Additional Skills (These are "Nice to Haves" but the hiring manager let us know these are borderline requirements): Experience with Agile as well as DevOps, CI/CD methodologies- The team operates in an Agile environements, so having Agile experience while not a MUST have it is a STRONG nice to have. Certifications are a BIG advantage as well: Anything related to Databricks or Azure - Engineering, Architecture, ETL, etc. Experience with PowerBI for data visualization and reporting Data Engineering Tools: Familiarity with tools like Apache Spark and Delta Lake. Python Experience- They operate pretty much fully in this language Additional Skills: Knowledge of cloud PaaS architecture & resources. Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services. Excellent root cause analysis & problem-solving skills Knowledge and understanding of software development technologies, methodology and associated tools Strong project management skills including the ability to effectively organizes tasks, manages multiple priorities/details, and meets tight deadlines Strong oral and written communication skills Effective consulting skills with proven ability to influence others Builds productive relationships with a focus on cooperation & teamwork Experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions. Experience with performance tuning techniques in a lakehouse environment, such as partitioning, aggregations, materialized views, etc. Ability to build relationships and work with all levels of management, vendors, and other internal and external groups Experience leading and managing technology projects including coordinating resources and tasks across multiple teams and business units. Experience developing complex logical and physical data models
Experience Level
Expert Level
Pay and Benefits
The pay range for this position is $80.00 - $92.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
Workplace Type
This is a hybrid position in Atlanta,GA.
Application Deadline
This position is anticipated to close on Mar 18, 2025.
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Salary : $80 - $92
