What are the responsibilities and job description for the Senior Data Engineer position at MW Partners?
Job Description
Responsibilities and duties:
- Build and maintain high-performance data pipelines that enable deeper analysis, reporting, and insights across the business.
- Design and implement large-scale, data structures that support analytics and data science needs, optimizing for speed, scalability, and reliability.
- Create seamless data ingestion processes (both real-time and batch) using modern ETL/ELT practices, leveraging cloud technologies and big data tools to ensure smooth data flow.
- Collaborate with business teams to understand needs, and translate them into flexible, scalable data solutions that grow with the company.
- Work alongside engineers to establish best practices for data system creation, ensuring data quality, integrity, and proper documentation throughout.
- Continuously improve reporting and analysis by automating processes, streamlining workflows and empowering teams with self-service data tools for easy access to insights.
- Partner with senior leadership to stay aligned on business objectives, provide regular updates, and make data-driven decisions to drive progress.
- Be the subject matter expert in your area, understanding the ad tech landscape and identifying ways to leverage Client’s unique position in the market.
- Take the initiative to identify, troubleshoot, and resolve challenges that could hinder progress on strategic goals, ensuring the team remains on track to meet both technical and business objectives.
Requirements:
- Bachelor of Engineering in Computer Science or equivalent preferred.
- 7 years of experience designing and implementing data warehouse solutions, focusing on scalability and performance.
- 7 years of experience writing complex SQL queries and developing robust ETL/ELT pipelines to transform and integrate data.
- 7 years of programming experience in languages like Python, focusing on building scalable and efficient solutions.
- Extensive experience in building and optimizing APIs, containerization, and orchestration with Kubernetes to ensure scalable, high-performance data systems.
- Hands-on experience with Cloud data warehouses (ideally with Snowflake, Google BigQuery, or AWS Redshift).
- Proficient in cloud technologies such as GCP or AWS.
- Experience leading and collaborating with agile teams, utilizing tools like Jira and Confluence, to drive user-centered and iterative development processes.
- Expertise in creating reports and dashboards using tools like Tableau, Looker, or Power BI to enable insightful decision-making.
- Deep knowledge of identity management, data privacy, audience targeting, cross-device graphs, and related technologies.
- Solid understanding of digital advertising technology, including ad serving, analytics, DSP, DMP, SSP, QA, and targeting.
Soft Skills:
- Strong cross-functional collaboration skills, with experience working in complex organizations and aligning teams on data product decisions and trade-offs.
- Exceptional communication skills, capable of breaking down complex technical concepts and clearly communicating them to stakeholders.
- Passionate about working with large datasets, skilled at spotting trends and deriving actionable insights to drive business decisions.
- A quick learner, adept at grasping both business and technical needs to deliver impactful solutions.