What are the responsibilities and job description for the Data Warehouse Engineer position at VC5 Consulting?
About the Role
We are seeking a skilled and passionate Data Warehouse Engineer to join our growing Data and Analytics team. This is a critical role with the opportunity to shape the future of our data infrastructure and empower data-driven decision-making across the organization. You will be a key player in designing, building, and maintaining a robust and scalable data warehouse in Azure, migrating from our current SQL database and flat file system to a modern, integrated environment.
Responsibilities:
- Collaborate with the Data and Analytics team to understand business requirements and translate them into effective data warehouse solutions.
- Design and implement a comprehensive data warehouse architecture in Azure, including data modeling, ETL/ELT processes, and data storage.
- Migrate existing data from SQL Server databases and flat files into the new data warehouse environment.
- Develop and maintain data pipelines for efficient data ingestion, transformation, and loading.
- Ensure data quality, integrity, and security within the data warehouse.
- Optimize data warehouse performance for efficient querying and analysis.
- Work with stakeholders to define data access and governance policies.
- Stay current with industry best practices and emerging technologies in data warehousing.
- Provide guidance and mentorship to other team members on data warehousing principles and techniques.
Qualifications:
- Proven experience in designing, building, and maintaining enterprise-scale data warehouses.
- Strong understanding of data warehousing concepts, methodologies, and best practices (e.g., dimensional modeling, star schema).
- Expertise in SQL and data manipulation languages.
- Hands-on experience with Azure cloud data warehousing services (e.g., Azure Synapse Analytics, Azure Data Factory, Azure SQL Database).
- Experience with ETL/ELT tools and frameworks.
- Proficiency in data modeling tools.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Top 3-5 Must Haves:
- Azure Cloud Data Warehousing Expertise: Deep understanding and hands-on experience with Azure data warehousing services like Azure Synapse Analytics and Azure Data Factory.
- Data Warehouse Design and Architecture: Proven ability to design and implement scalable and efficient data warehouse solutions, including data modeling and ETL/ELT processes.
- SQL and Data Manipulation: Strong SQL skills and experience with data manipulation languages for data transformation and analysis.
- Data Migration Experience: Experience migrating data from on-premises databases and flat files to cloud-based data warehouses.
- Communication and Collaboration: Excellent communication and interpersonal skills to effectively collaborate with stakeholders and team members.
The Project:
This role will be instrumental in leading our data warehouse modernization initiative. We are moving from a fragmented data landscape with a SQL Server database and separate flat files to a unified and robust data warehouse in Azure. You will work closely with the Data and Analytics team to design and implement a phased rollout of the data warehouse, starting with a foundational structure and gradually expanding to incorporate more data sources and advanced analytics capabilities. The goal is to create a centralized and reliable source of truth for data-driven decision-making across the organization.
#10631
