What are the responsibilities and job description for the Lead Data Engineer position at Software Resources, Inc.?
Job Details
Software Resources has an immediate, direct hire job opportunity for a Lead Data Engineer with a major corporation in Westerville/Columbus, OH. 4 days per week on-site.
What you'll do:
As a Lead Data Engineer, you'll provide SME expertise in your respective domain as well as adjacent domains to ensure solutions are safe, secure, compliant and reliable. You'll identify development and support needs as well as take on large and complex design responsibilities supporting project tasks. You'll also engage with project and business sponsors refining requirements and objectives of targeted solutions. As a Principal Engineer I, you also facilitate dialogue and activities, and work to ensure team collaboration including teams outside of your domain. You'll develop effective presentations and narratives for IT audiences. In this role, you'll also develop the technical skills of one more junior engineers.
You are also the lead engineer in a high-performing centralized team of data engineers, data analysts and QA engineers. The team builds solutions to satisfy the complete data lifecycle management for our enterprise data platforms. You must demonstrate strong technical mastery as well as an ability to technically mentor others. You partner closely with enterprise architects to understand and implement solutions based on the recommended Azure Cloud data architecture and capabilities. You are required to know and/or learn modern automation and integration methods and tools, with Cloud-First design patterns, frameworks, critical thinking, and problem-solving skills.
This position is ONSITE ONLY located in either Phoenix, AZ, Dallas, TX, or Columbus, OH.
- Implement data engineering solutions that satisfy the full data lifecycle including efficient technical hygiene and the use of Azure DevOps for the implementation of the Western Alliance Bank Regulatory Reporting and LFI strategy and roadmap.
- Develop ETL and data pipeline capabilities considering how data is created, transformed, stored, archived, analyzed, and shared across Western Alliance Bank and our partner systems.
- Implement Azure DevOps CI/CD pipelines for all data solutions in adherence to Western Alliance Bank technical standards.
- Apply Test Driven Development methodology to all data solutions designed, built, and implemented.
- Lead the implementation of outcomes, recommendations, and designs from Data Governance and Enterprise Architecture.
- Perform data exploration and data profiling with tools such as SSAS.
- Actively participate in making data architecture decisions.
- Provide technical mentorship to team members and other data professionals.
- Collaborate with product owners and business stakeholders to gain a working understanding of business requirements and operational processes.
- Implement built-in quality and compliance- by-design in all data solutions.
- Implement methods to include unstructured data and big data.
- Review technical plans developed by lower level engineers and analysts to assure quality designs prevail which can support the volumetrics of our business partners objectives.
- Work independently or sometimes with architecture team counterparts to Client out the final documentation required for proper ongoing reference of the given solution, including physical and logical layouts with cross reference to use case models while enforcing standards, as well as assisting in the modification or buildout of procedures that support areas of operations across IT.
What you'll need:
- 8 years' experience with data engineering specifically in Extract, Transform and Load (ETL) concepts and processes, enterprise data warehouse capabilities, database principles, and other related tools and technologies; preferably strong to expert in Azure Data Factory and/or Databricks.
- Bachelor's degree in related field required; Masters or MBA in related field preferred.
- 3 years' experience designing, implementing, and supporting cloud data solutions; Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps experience strongly preferred.
- Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL.
- Expert level experience in conceptual, logical, and physical data design.
- Certifications within Azure such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer.
- Experience with design tools as it relates to creating conceptual architecture diagrams and data flow diagrams such as Visio, Archimate, Lucidchart.
- Excellent communication skills both verbal and written.
- Familiarity with data science and analytics tools such as SAS, Tableau, PowerBI.
- Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks, Snowflake, Matillion, etc.
- Experience in Agile, SAFe, and/or Scrum is preferred.
- Experience integrating with data quality, data catalog and data lineage tools is preferred.
- Additional Cloud Data certifications with any major cloud provides (Azure, AWS, Google Cloud Platform) is preferred.
- Banking or financial services industry experience or other highly regulated industry experience is preferred.
- Previous leadership experience preferred.
- Advanced to expert knowledge of applicable regulatory and legal compliance obligations, rules and regulations, industry standards and practices.
Benefits you'll love:
We offer all the important things you'd want like competitive salaries, an ownership stake in the company, medical and dental insurance, time off, a great 401k matching program, tuition assistance program, an employee volunteer program, and a wellness program. In addition, you'll have the opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands-on experience to help grow your career!
About Software Resources
Software Resources, founded more than 3 decades ago, is a trusted staffing partner specializing in Technology (IT, Creative, & Marketing), Finance, & Accounting placements. We work with companies nationwide that need skilled professionals and connect them with candidates like you looking for the right opportunity.
We are always looking for professionals at all experience levels and in various specialties to meet our clients' hiring needs. As a member of our team, you will have access to benefits including medical, dental, and vision coverage, a 401(k) with company match, short-term disability, life insurance with AD&D.
If this position fits interests you, we encourage you to apply.