What are the responsibilities and job description for the Azure Data Engineer position at Kforce Technology Staffing?
Job Details
RESPONSIBILITIES:
Kforce has a client that is seeking an Azure Data Engineer in Pittsburgh, PA.
Summary:
The Azure Data Engineer will design, develop, and implement data solutions on the firm's Azure Cloud platform, focusing on Databricks for data processing and analytics. This role involves building scalable, high-performance data pipelines for efficient data extraction, transformation, and loading into the firm's Azure cloud storage solutions.
Duties and Responsibilities:
* Automate data pipeline monitoring, error handling, and performance tuning to ensure data integrity and availability, collaborating with the Digital Data Solutions Team or external consultants as needed
* Design, develop, and implement scalable and high-performance data solutions on the Azure platform, specifically architecting data pipelines and ETL/ELT processes utilizing Azure Data Factory and Azure Databricks to extract, transform, and load data from various sources into Azure data storage solutions
* Optimize data storage and retrieval mechanisms to ensure efficient processing of large datasets, particularly focusing on the capabilities of Databricks
* Develop and maintain data models and schemas to support data analysis and reporting requirements
* Implement data security and privacy measures to protect sensitive data
* Develop and maintain data ingestion processes to acquire data from various sources, including APIs, databases, and streaming platforms
* Implement data quality checks and validation procedures to ensure the accuracy and integrity of data
* Design and implement data transformation and enrichment processes using Azure Databricks, Azure Data Factory, and other relevant tools
* Document technical design, deployment processes, and best practices for data engineering solutions
* Implement data partitioning, indexing, and optimization techniques to improve query performance
REQUIREMENTS:
* Bachelor's degree in Computer Science, Engineering, or a related field
* Azure Certifications, such as Microsoft Certified: Enterprise Data Engineer Associate, are a plus
* Preferred hands-on experience with Azure data services, including Azure Data Lake Storage, Azure SQL Database, Azure Data Factory, and particularly Azure Databricks and Azure Synapse Data Warehouse
* Strong experience in data engineering and architecture, with a focus on Azure cloud technologies
* Proficiency in programming languages such as Python, SQL, and PowerShell
* Knowledge of data integration techniques and tools, such as ETL/ELT processes, data pipelines, and data warehousing concepts
* Familiarity with data modeling and schema design principles
* Understanding of data security and privacy regulations, including GDPR and CCPA
* Excellent problem-solving and analytical skills
* Strong communication and collaboration abilities
The firm offers outstanding benefits that include:
* Hybrid work schedules
* Generous Paid Time Off
* Paid Holidays, including a floating holiday
* WorkWell wellness program, including free use of the Calm App
* Free use of building gym
* Caregiving assistance with Bright Horizons (child, elder, and pet care!)
* Access to a firm-wide emergency assistance fund
* Free full access to LinkedIn Learning
* Insurance - Medical, Dental, Vision
* 401K Program
* Retirement Savings Program
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce has a client that is seeking an Azure Data Engineer in Pittsburgh, PA.
Summary:
The Azure Data Engineer will design, develop, and implement data solutions on the firm's Azure Cloud platform, focusing on Databricks for data processing and analytics. This role involves building scalable, high-performance data pipelines for efficient data extraction, transformation, and loading into the firm's Azure cloud storage solutions.
Duties and Responsibilities:
* Automate data pipeline monitoring, error handling, and performance tuning to ensure data integrity and availability, collaborating with the Digital Data Solutions Team or external consultants as needed
* Design, develop, and implement scalable and high-performance data solutions on the Azure platform, specifically architecting data pipelines and ETL/ELT processes utilizing Azure Data Factory and Azure Databricks to extract, transform, and load data from various sources into Azure data storage solutions
* Optimize data storage and retrieval mechanisms to ensure efficient processing of large datasets, particularly focusing on the capabilities of Databricks
* Develop and maintain data models and schemas to support data analysis and reporting requirements
* Implement data security and privacy measures to protect sensitive data
* Develop and maintain data ingestion processes to acquire data from various sources, including APIs, databases, and streaming platforms
* Implement data quality checks and validation procedures to ensure the accuracy and integrity of data
* Design and implement data transformation and enrichment processes using Azure Databricks, Azure Data Factory, and other relevant tools
* Document technical design, deployment processes, and best practices for data engineering solutions
* Implement data partitioning, indexing, and optimization techniques to improve query performance
REQUIREMENTS:
* Bachelor's degree in Computer Science, Engineering, or a related field
* Azure Certifications, such as Microsoft Certified: Enterprise Data Engineer Associate, are a plus
* Preferred hands-on experience with Azure data services, including Azure Data Lake Storage, Azure SQL Database, Azure Data Factory, and particularly Azure Databricks and Azure Synapse Data Warehouse
* Strong experience in data engineering and architecture, with a focus on Azure cloud technologies
* Proficiency in programming languages such as Python, SQL, and PowerShell
* Knowledge of data integration techniques and tools, such as ETL/ELT processes, data pipelines, and data warehousing concepts
* Familiarity with data modeling and schema design principles
* Understanding of data security and privacy regulations, including GDPR and CCPA
* Excellent problem-solving and analytical skills
* Strong communication and collaboration abilities
The firm offers outstanding benefits that include:
* Hybrid work schedules
* Generous Paid Time Off
* Paid Holidays, including a floating holiday
* WorkWell wellness program, including free use of the Calm App
* Free use of building gym
* Caregiving assistance with Bright Horizons (child, elder, and pet care!)
* Access to a firm-wide emergency assistance fund
* Free full access to LinkedIn Learning
* Insurance - Medical, Dental, Vision
* 401K Program
* Retirement Savings Program
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
