What are the responsibilities and job description for the Azure Data Engineer position at State of South Dakota?
Job ID: 30332
Agency: Bureau of Information & Telecommunications
Location:Pierre, SD; remote work within the State of South Dakota may be possible for highly qualified incumbent.
Salary: $86,986.08-$108,722.16 Annual Salary, depending on qualifications
Pay Grade: 09
Closing Date: 2/10/25
This is a Full-Time 40 Hour Weekly position with the Bureau of Information & Telecommunications (BIT). For more information on BIT, please visit https://www.sd.gov/bit .
The Azure Data Engineer is a specialized professional who works on Microsoft’s cloud platform Azure and will work with the BIT Enterprise Architects and other BIT Architects to design, implement, monitor, and maintain data and analytical solutions on Azure. Their work involves managing, optimizing, monitoring, and troubleshooting data storage and data processing tasks. They are also responsible for developing and maintaining data architecture and processing solutions with Azure. A variety of technologies will be used to provide data to analysts, data scientists, and other stakeholders, including Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics. Additionally, they work with Azure’s security models to ensure that data is properly secured and following industry and best practices. The role will often involve translating business needs into technical specifications, ensuring that data solutions are scalable and performant, and working closely with other IT professionals to integrate Azure data solutions with other systems.
Azure Data Engineers Are Expected To Stay Updated With The Latest Azure Features And Data Technologies And Use This Knowledge To Improve Data Systems And Maintain High Performance. Incumbent Is Expected To Lead And Coordinate Several Aspects Of The Enterprise Architecture (EA) Program And Its Efforts To Develop, Maintain And Govern The Enterprise Architecture Across The Organization Including
Bachelor's degree with 3 years of IT experience focused on applications architecture, infrastructure, or system integrations or 5 years of experience with a focus on data architecture, is preferred. Key qualifications include experience as a Data Engineer, proficiency with Azure and its tools (Azure Data Factory, Data Lake), experience in developing and optimizing big data pipelines, and knowledge of Azure data storage solutions (SQL Database, Cosmos DB, Data Lake Storage).
Additional skills include familiarity with big data tools like Hadoop, Spark, Kafka, and stream-processing systems (Storm, Spark-Streaming). Proficiency in SQL, T-SQL, and PL/SQL is required, as well as a solid understanding of data modeling, schema design, and working with large datasets. Experience with Agile/Scrum methodology, leadership, and project management is beneficial, along with expertise in data migration using ETL tools and familiarity with Microsoft products (Visual Studio, Power BI, Azure DevOps).
The candidate should have strong problem-solving abilities, leadership potential, and a track record of implementing IT best practices and process improvement.
Knowledge
Knowledge, Skills, and Abilities:
This position is eligible for Veterans’ Preference per ARSD 55:10:02:08.
Successful applicant(s) will be required to undergo a background investigation. An arrest/conviction record will not necessarily bar employment.
The State of South Dakota does not sponsor work visas for new or existing employees. All persons hired will be required to verify identity and eligibility to work in the United States and complete an Employment Eligibility Verification, Form I-9. The State of South Dakota as an employer will be using E-Verify to complete employment eligibility verification upon hire.
The State of South Dakota offers $0 premium employee health insurance option plus eleven paid holidays, generous vacation and sick leave accrual, dental, vision, and other insurance options, and retirement benefits. You can view our benefits information at https://bhr.sd.gov/job-seekers/work-for-state-government/ . This position is a member of Class A retirement under SDRS.
Must apply online: https://gen-stateofsouthdako-trn.inforcloudsuite.com/hcm/xmlhttp/shorturl.do?key=11W
You must apply online, emailed resumes or submissions will not be accepted.
South Dakota Bureau of Human Resources
Telephone: 605.773.3148 Email: careers@state.sd.us
http://bhr.sd.gov/workforus
"An Equal Opportunity Employer"
Agency: Bureau of Information & Telecommunications
Location:Pierre, SD; remote work within the State of South Dakota may be possible for highly qualified incumbent.
Salary: $86,986.08-$108,722.16 Annual Salary, depending on qualifications
Pay Grade: 09
Closing Date: 2/10/25
This is a Full-Time 40 Hour Weekly position with the Bureau of Information & Telecommunications (BIT). For more information on BIT, please visit https://www.sd.gov/bit .
The Azure Data Engineer is a specialized professional who works on Microsoft’s cloud platform Azure and will work with the BIT Enterprise Architects and other BIT Architects to design, implement, monitor, and maintain data and analytical solutions on Azure. Their work involves managing, optimizing, monitoring, and troubleshooting data storage and data processing tasks. They are also responsible for developing and maintaining data architecture and processing solutions with Azure. A variety of technologies will be used to provide data to analysts, data scientists, and other stakeholders, including Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics. Additionally, they work with Azure’s security models to ensure that data is properly secured and following industry and best practices. The role will often involve translating business needs into technical specifications, ensuring that data solutions are scalable and performant, and working closely with other IT professionals to integrate Azure data solutions with other systems.
Azure Data Engineers Are Expected To Stay Updated With The Latest Azure Features And Data Technologies And Use This Knowledge To Improve Data Systems And Maintain High Performance. Incumbent Is Expected To Lead And Coordinate Several Aspects Of The Enterprise Architecture (EA) Program And Its Efforts To Develop, Maintain And Govern The Enterprise Architecture Across The Organization Including
- business architecture, which is focused on guiding people, process, and organizational change;
- information architecture, which is focused on the consistent sharing of information across the enterprise;
- solutions architecture, which is focused on developing a direction for managing the portfolio of to-be solutions;
- technical architecture, which is focused on evolving the technical infrastructure; and,
- security architecture, which is focused on managing IT risk through the exchange of information between people, systems, and things inside and outside the organization.
Bachelor's degree with 3 years of IT experience focused on applications architecture, infrastructure, or system integrations or 5 years of experience with a focus on data architecture, is preferred. Key qualifications include experience as a Data Engineer, proficiency with Azure and its tools (Azure Data Factory, Data Lake), experience in developing and optimizing big data pipelines, and knowledge of Azure data storage solutions (SQL Database, Cosmos DB, Data Lake Storage).
Additional skills include familiarity with big data tools like Hadoop, Spark, Kafka, and stream-processing systems (Storm, Spark-Streaming). Proficiency in SQL, T-SQL, and PL/SQL is required, as well as a solid understanding of data modeling, schema design, and working with large datasets. Experience with Agile/Scrum methodology, leadership, and project management is beneficial, along with expertise in data migration using ETL tools and familiarity with Microsoft products (Visual Studio, Power BI, Azure DevOps).
The candidate should have strong problem-solving abilities, leadership potential, and a track record of implementing IT best practices and process improvement.
Knowledge
Knowledge, Skills, and Abilities:
- design, construct, install, test, and maintain data management systems;
- ensure all systems meet business and performance requirements;
- create and maintain optimal data pipeline architecture;
- assemble large, complex datasets that meet functional and non-functional business requirements;
- develop and implement data flows to connect operational systems, data for analytics, and BI systems;
- design, implement, and optimize data models on Azure data platforms; and,
- implement effective metrics and monitoring processes.
- strong communication skills and excellent interpersonal skills to effectively collaborate with stakeholders and colleagues;
- proficient in presenting information and writing cohesive documents for audiences with varying degrees of expertise;
- drive the collection, cleaning, processing, and analysis of new and existing data sources; and,
- work with data and analytics experts to strive for greater functionality in data systems.
- display an exceptional level of integrity and professionalism; and,
- identify, design, and implement internal process improvements (e.g., automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability).
This position is eligible for Veterans’ Preference per ARSD 55:10:02:08.
Successful applicant(s) will be required to undergo a background investigation. An arrest/conviction record will not necessarily bar employment.
The State of South Dakota does not sponsor work visas for new or existing employees. All persons hired will be required to verify identity and eligibility to work in the United States and complete an Employment Eligibility Verification, Form I-9. The State of South Dakota as an employer will be using E-Verify to complete employment eligibility verification upon hire.
The State of South Dakota offers $0 premium employee health insurance option plus eleven paid holidays, generous vacation and sick leave accrual, dental, vision, and other insurance options, and retirement benefits. You can view our benefits information at https://bhr.sd.gov/job-seekers/work-for-state-government/ . This position is a member of Class A retirement under SDRS.
Must apply online: https://gen-stateofsouthdako-trn.inforcloudsuite.com/hcm/xmlhttp/shorturl.do?key=11W
You must apply online, emailed resumes or submissions will not be accepted.
South Dakota Bureau of Human Resources
Telephone: 605.773.3148 Email: careers@state.sd.us
http://bhr.sd.gov/workforus
"An Equal Opportunity Employer"
Salary : $86,986 - $108,722
