What are the responsibilities and job description for the Data Engineer position at Spark Tek Inc?
Job Description:
Support identification and implementation of integration, modelling, and orchestration of complex data using relevant coding language(s)
Monitor and troubleshoot data engineering-related incidents
Support development and maintenance of relevant documentation
Participate in knowledge transfer activities, issues, and risks
Additional Job Requirements:
The Marketing Technology Team oversees the technical aspects of the marketing technology stack. Our technology platform enables robust analytics and delivers personalized, engaging interactions to our guests.
As an Engineer for Marketing Technology, you will be responsible for the development, support, configuration, and automation of the data infrastructure that supports our global marketing strategy. You will work closely with other data engineers, analysts, data scientists and marketers to build out new capabilities . The solutions you build will involve large datasets and system integrations in cloud environments.
Responsibilities:
" Technical leadership for the expansion and optimization of data collection and data pipeline architecture
" Subject matter expert in development and integration with Web Services and APIs
" Monitor and support data pipelines and ETL workflows
" Cloud (Azure) infrastructure administration: network configurations, access and permissions, cloud services
" Oversee, participate in and manage production deployments.
" Interface with global vendor and internal teams.
" Ensure cloud environment reliability, availability, performance and security
" Define and implement monitoring and alerting for cloud infrastructure and applications
" Coordinate recovery from incidents utilizing well defined operational procedures, tools, and efficient communication across internal and external stakeholders.
" Actively use and suggest improvements to continuous delivery toolset.
Requirements:
" 3 years (or educational equivalent) building data pipelines using Azure data tools and services (Azure Data Factory, Azure Databricks, Azure Function, Spark, Azure Blob/ADLS, Azure SQL, Snowflake..)
" 2 years and a proven record of success in Azure administration
" 3 years and a proven record of success in monitoring cloud infrastructure, applications, big data pipelines and ETL workflows
" Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.
" Proficient with DevOps tools and environments like Azure DevOps, Jenkins, Gitlab, Ansible, Terraform.
" Proficient in SQL, Spark SQL, Python, PySpark
" Familiarity with agile software delivery methodologies
" Knowledge of Digital Marketing (Email, Search-Engine Marketing, Social, Affiliate) or eCommerce
