What are the responsibilities and job description for the Platform Engineer with DBT and AWS DevOps position at North Star Group?
Platform Engineers focused in AWS / DBT
Role & Responsibilities
Proven experience as a data platform engineer, with a focus on AWS cloud platform & Understanding of data governance, security, and compliance principles.
Strong expertise in Apache Airflow and related AWS services for data orchestration and transformation.
Work with the Data Governance program to update classification text tags across ?10,000 fields within ?700 dbt jobs.
Proficiency with programming languages like Python, SQL, and familiarity with relevant SDKs.
Experience with metadata-driven design approaches, advance software development, and data modeling. Necessary to understand advanced coding concepts such as abstract classes in Python, and ability to develop custom tooling for data platforms and supporting CI / CD processes.
Deep knowledge of AWS services such as ECS, S3, Glue, and IAM.
Deep knowledge of Infrastructure as Code (IaC), Terraform preferred.
Excellent problem-solving skills and the ability to work collaboratively in a team.
Strong communication skills to effectively interact with cross-functional teams.
AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer) are a plus.
Work and collaborate with global teams across North America, EMEA and APAC.
Strong communication skills
Key Responsibilities & Scope :
Data Governance strategy and implementation.
Work with the Data Governance program to update classification and data lineage across Marketing datasets.
Snowflake RBAC redesign.
Open Metadata / Metaspace - All data classification and data lineage available in metaspace.
Data Platform - Build and deliver unit testing framework.
