What are the responsibilities and job description for the Senior Data Engineer position at Edvenswa Tech?
Job Title : Senior Data Engineer
Location : Remote
Need 12 Years experience
Job Description : We are seeking a highly skilled and experienced Senior Azure Synapse Developer / Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and managing data infrastructure and pipelines using Azure Synapse Analytics. This role requires a deep understanding of data engineering principles, cloud services, and data warehousing solutions.
Key Responsibilities :
Data Architecture & Modeling : Design and implement data architecture solutions to address complex business requirements. Create and maintain conceptual, logical, and physical data models.
ETL Development : Develop, maintain, and optimize ETL processes using Azure Synapse Analytics, Azure Data Factory, and other ETL tools. Ensure efficient data extraction, transformation, and loading to support data warehousing and analytics.
Data Integration : Integrate data from various sources including on-premises databases, cloud data sources, and third-party APIs. Build robust data pipelines to ensure seamless data flow across systems.
Data Quality & Governance : Implement data quality checks and ensure data accuracy, completeness, and consistency. Ensure compliance with data governance policies and data protection regulations.
Performance Optimization : Monitor and optimize data processing performance to ensure efficient data operations. Troubleshoot and resolve performance issues related to data ingestion, transformation, and storage.
Collaboration & Support : Collaborate with data scientists, business analysts, and software developers to support data-driven decision-making. Provide technical support and guidance to other team members and stakeholders.
Documentation & Reporting : Document data processes, data models, and data architectures for future reference and knowledge sharing. Generate reports and dashboards to provide insights and support business operations.
Continuous Improvement : Stay updated with the latest advancements in Azure Synapse Analytics, data engineering, and cloud technologies. Identify and implement improvements to existing data systems and processes.
Security & Compliance : Ensure data security and implement measures to protect sensitive information. Adhere to industry standards and best practices for data security and privacy.
Qualifications :
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
5 years of experience in data engineering, data warehousing, or a similar role.
Proficiency in SQL, Python, and other relevant programming languages.
Strong knowledge of Azure Synapse Analytics, Azure Data Factory, and other Azure services.
Experience with ETL tools and data integration platforms.
Familiarity with data modeling, dimensional modeling, and data warehousing concepts.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Ability to work in a fast-paced, Agile environment.
