What are the responsibilities and job description for the Data Warehouse Manager position at Purple Fly Solutions?
Job Description
Job Description
- Job Title : Data Warehouse Manager
- Job Duration : Long term Contract
- Job Location : Boston MA (Onsite)
- Responsible for managing data warehouse infrastructure
- Oversee the seamless integration of Databricks
- Lead a team to drive strategic insights from data
- Oversee architecture, development, and maintenance of data warehouse solutions
- Optimize performance of data warehouse and data-driven decision-making
- Lead design, implementation, and maintenance of scalable data warehouse solutions
- Oversee and manage Databricks integration within the data warehouse environment
- Manage a team of data engineers, analysts, and other data professionals
- Design, implement, and optimize ETL processes using Databricks
- Ensure data integrity, consistency, and security across the data warehouse
- Monitor system performance and optimize for speed, scalability, and reliability
- Collaborate with business stakeholders to understand their data needs
- Stay up to date with the latest data warehouse and Databricks features, tools, and best practices
- Required education : Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (Master's preferred)
- Minimum of 10 years of experience in data warehouse management or data engineering
- Strong hands-on experience with Databricks and Apache Spark
- Experience with large-scale data pipeline architecture, ETL processes, and cloud data storage solutions
- Experience managing teams and leading cross-functional projects
- Expertise in SQL, Python, and other data engineering languages
- Familiarity with cloud platforms (AWS, Azure, GCP) and data orchestration tools (e.g., Apache Airflow)
- Excellent understanding of data modeling, schema design, and data optimization techniques
- Strong analytical and problem-solving skills
- Excellent written and verbal communication skills
- Preferred : Databricks Certified Associate Developer for Apache Spark, familiarity with machine learning and advanced analytics workflows in Databricks, experience with DevOps practices for data engineering.
