Senior Data Engineer

We are seeking an experienced Sr Data Engineer with Data Lake / Warehouse and ELT / ETL experience (Snowflake & DBT preferred). The ideal candidate will have a solid background in data architecture, cloud data warehousing, ETL / ELT, master data management, datamarts, and analytics. Candidates should be proficient in stakeholder management, Azure database platforms, and python or other programming languages related to data warehouse management.

You will be responsible for leading the design, development, and implementation of enterprise data solutions using Snowflake and DBT. You will collaborate closely with cross-functional teams (IT, HR, Finance, Business Operations, Business Development, Sales, and Marketing) to ensure data solutions are accurate, accessible, comprehensive, and secure. You will lead AmSpec in implementing and managing our first Enterprise Data Lake and Datawarehouse as well as mastering of key reference data  for the enterprise.

Responsibility also includes designing, developing, implementing and maintaining data integration solutions to support seamless flow of data between 20 source / target enterprise systems / applications.

Key Responsibilities :

• Working with our business partners to develop data mapping from one system to another. As such the candidate will be expected to manage data mapping from a legacy system to a new system and across 20 enterprise systems with overlapping datasets. The candidate will have a solid attention to detail and be able to manage multiple projects and data streams.
• AmSpec is in the process of onboarding several enterprise software systems across its functions. As we migrate to these new systems, hybrid data feeds will have to be managed for consistency and continuity.
• Manage the data engineering lifecycle including research, proof of concepts, architecture, design, development, test, deployment, and maintenance using tools such as Snowflake, DBT, and Python
• Plan, design and implement framework and systems for the data warehouse. Create data models, data marts and ELT / ETL processes.
• Build a modern analytics stack supporting a variety of Cloud-based Business Systems for potential clients using Snowflake, ADF, and Power BI
• Implement data governance frameworks within Snowflake / DBT, including data quality checks, lineage, and metadata management
• Design solutions to support real-time or near-real-time processing for data transactions and monitoring, enabling timely insights. Optimization of data warehouse models and servers to ensure top level performance and scalability.
• Communicate and demonstrate a clear understanding of client business needs, goals, and objectives
• Optimize Snowflake performance, including query tuning and storage optimization and employing Snowflake / DBT best practices.
• Develop and maintain ETL processes to integrate data from various sources.
• Monitor and troubleshoot data issues and implement solutions.
• Create data marts / views with the objective of supporting dashboards, reports, and other views for corporate KPIs and operational monitoring of the business (revenue, cost, efficiency, pricing, and so on).
• Research and develop POCs to demonstrate business capabilities using Snowflake.
• Develop predictive analytics and ML-based modeling in the long term to drive forward looking business decision making.
• Partner with IT teams to align data solutions with enterprise governance standards.
• Perform thorough testing and validation of data integration process to ensure data integrity and accuracy.
• Work closely with IT team and stakeholders to understand data requirements and deliver integrated solutions to meet our business needs.
• Create and maintain documentation of the data integration process, configuration and best practices.
• Support data integrations through our Datawarehouse for ERP, Finance, HR, Ops, IT, and other enterprise systems.
• Overall responsible for enterprise data integration architecture and governance

Required Skills

Required Experience