Professional Growth : Access to mentorship programs, certifications, and opportunities to advance your career.
Cutting-Edge Tech : Work with state-of-the-art tools and technologies on impactful, high-visibility projects.
Key Responsibilities :
Design and implement scalable, efficient data pipelines using Azure Data Lake , Databricks , Snowflake , and Synapse Analytics .
Develop and optimize workflows with Apache Spark and Scala for batch and streaming data processing.
Build, maintain, and enhance robust ETL / ELT pipelines tailored to big data applications within Azure ecosystems.
Manage and optimize data storage solutions like Azure Data Lake Storage , Snowflake , and Synapse Analytics to ensure peak performance and cost-efficiency.
Partner with data scientists, analysts, and business teams to ensure the reliability and availability of data platforms.
Monitor and fine-tune the performance of data platforms in production environments.
Enforce best practices for data governance, security, and compliance in Azure-based data frameworks.
Stay ahead of the curve by researching and integrating new big data technologies to enhance scalability and performance.
Requirements :
Essential Skills and Experience :
A minimum of 5 years of experience in data engineering or related fields.
At least 3 years of hands-on expertise in Apache Spark using Scala .
Advanced knowledge of Azure data services , including Azure Data Lake , Azure Databricks , Azure Synapse Analytics , and Azure Data Factory .
Proficiency with Snowflake , including schema design, performance optimization, and integration with cloud platforms.
Solid expertise in cloud-based big data solutions , particularly within the Azure ecosystem.
Strong knowledge of data modeling , ETL / ELT pipelines , and database concepts .
Experience with streaming platforms such as Spark Streaming , Kafka , or Event Hubs .
Familiarity with data lake and data warehouse architecture (e.g., Delta Lake , Snowflake , Synapse ).
Proficiency in DevOps practices, including CI / CD pipelines for data engineering workflows.
Preferred Skills :
Knowledge of Python for data engineering tasks.
Experience with Azure Machine Learning or other machine learning platforms integrated with data workflows.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Senior Data Engineer?
Sign up to receive alerts about other jobs on the Senior Data Engineer career path by checking the boxes next to the positions that interest you.
