What are the responsibilities and job description for the Senior Data Engineer position at Edvenswa Enterprises?
Job Title: Senior Data Engineer Location: Remote Need 12 Years experience Job Description: We are seeking a highly skilled and experienced Senior Azure Synapse Developer / Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and managing data infrastructure and pipelines using Azure Synapse Analytics. This role requires a deep understanding of data engineering principles, cloud services, and data warehousing solutions. Key Responsibilities:
- Data Architecture & Modeling: Design and implement data architecture solutions to address complex business requirements. Create and maintain conceptual, logical, and physical data models.
- ETL Development: Develop, maintain, and optimize ETL processes using Azure Synapse Analytics, Azure Data Factory, and other ETL tools. Ensure efficient data extraction, transformation, and loading to support data warehousing and analytics.
- Data Integration: Integrate data from various sources including on-premises databases, cloud data sources, and third-party APIs. Build robust data pipelines to ensure seamless data flow across systems.
- Data Quality & Governance: Implement data quality checks and ensure data accuracy, completeness, and consistency. Ensure compliance with data governance policies and data protection regulations.
- Performance Optimization: Monitor and optimize data processing performance to ensure efficient data operations. Troubleshoot and resolve performance issues related to data ingestion, transformation, and storage.
- Collaboration & Support: Collaborate with data scientists, business analysts, and software developers to support data-driven decision-making. Provide technical support and guidance to other team members and stakeholders.
- Documentation & Reporting: Document data processes, data models, and data architectures for future reference and knowledge sharing. Generate reports and dashboards to provide insights and support business operations.
- Continuous Improvement: Stay updated with the latest advancements in Azure Synapse Analytics, data engineering, and cloud technologies. Identify and implement improvements to existing data systems and processes.
- Security & Compliance: Ensure data security and implement measures to protect sensitive information. Adhere to industry standards and best practices for data security and privacy.
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
- 5 years of experience in data engineering, data warehousing, or a similar role.
- Proficiency in SQL, Python, and other relevant programming languages.
- Strong knowledge of Azure Synapse Analytics, Azure Data Factory, and other Azure services.
- Experience with ETL tools and data integration platforms.
- Familiarity with data modeling, dimensional modeling, and data warehousing concepts.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Ability to work in a fast-paced, Agile environment.