Senior Data Engineer

Capstone IT is seeking a strong and experienced Senior Data Engineer. As a Senior Data Engineer, you will develop and maintain data pipelines across multiple platforms and manage our client's data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing our client's future cloud data architecture and technology solutions.

Duties & Responsibilities

• Work with Product Owners to understand and translate business requirements into technical specifications and logical & physical data model requirements.
• Build, implement and test data pipelines using Databricks, Azure Data Factory, SSIS, and other data integration tools.
• Support team members with troubleshooting and resolving complex technical issues and challenges.
• Follow proper coding standards, and conduct code reviews to ensure proper code quality level.
• Follow effective source code management and CI/CD best practices to ensure data pipelines are automatically tested, integrated and deployed to production.
• Contribute to continuously improving existing data architecture and frameworks.
• Assist in the development and implementation of data governance and management solutions.
• Stay abreast with the evolution of cloud data technologies, frameworks, and best practices to continuously evolve data platform and solutions.

Education and Experience Requirements:

Bachelor’s Degree or higher in Computer Science, Engineering, or related field required.

8 years of experience in data engineering and data warehousing.

5 years of data engineering experience in SSIS and/or other data integration technologies.

5 years of cloud data engineering and big data experience.

3 years of building/using cloud data warehouses and data marts.

Required Knowledge, Skills, and Abilities:

• Experience with cloud data engineering and data warehouse technologies in Microsoft Azure, Google, or AWS. Experience in Azure is highly preferred.
• Strong programming skills in Python and SQL for data processing and automation.
• Strong technical skills in big data and Data integration technologies including Spark, Kafka, Databricks, Azure Data Factory, SSIS, and SQL.
• Development experience in Microsoft SQL Server including experience with tuning queries to optimize performance.
• Skilled in Visual Studio with the use of source control applications such as Azure DevOps.
• Experience with CI/CD and Jenkins.
• Experience with delivering data solutions iteratively using the Agile Scrum framework and development processes.
• Demonstrated ability to troubleshoot and resolve complex technical issues related to data processing in a cloud big data infrastructure.
• Exceptional analytical and conceptual thinking skills coupled with strong written and verbal communication skills.
• Passion for solving business problems through using data and creating analytical solutions.
• Excellent interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
• Able to communicate effectively, both written and oral, with internal and external customers, vendors, and partners.
• Ability to interact effectively with co-workers to accomplish daily tasks and to resolve interpersonal conflicts and miscommunications.

Preferred Skills

• Financial industry knowledge
• Development experience with Power BI and SSRS/Power BI Paginated reports.
• Experience with Lake house architecture.
• Experience in data modeling for transactional and analytical needs. Experience with NoSQL databases is preferred.

Details

• Direct-Hire/Full-Time
• Onsite in Lenexa, KS