What are the responsibilities and job description for the Azure Data Engineer position at JSR Tech Consulting?
For a major investment firm, contract to hire position.
Knowledge in emerging trends and practices. Be responsible for developing, maintaining, and optimizing data pipelines, architectures, and data sets. You will work closely with a team of analysts and data scientists to ensure that data solutions are robust, scalable, and aligned with business objectives.
Required skills:
What will set you apart:
Knowledge in emerging trends and practices. Be responsible for developing, maintaining, and optimizing data pipelines, architectures, and data sets. You will work closely with a team of analysts and data scientists to ensure that data solutions are robust, scalable, and aligned with business objectives.
- Design and implement highly scalable data ingestion and processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
- Develop and maintain data models and architecture for data warehouse and data lakes in Azure.
- Optimize data retrieval and develop dashboards and reports using Azure Synapse Analytics and Power BI.
- Ensure data integrity and compliance with data governance and security policies using Azure Purview and other security tools.
- Collaborate with stakeholders to gather requirements and provide data-driven insights and solutions.
- Monitor performance and advise on necessary infrastructure changes.
Required skills:
- Bachelor's degree or above in Computer Science, Engineering, or a related field.
- Previous experience as a Data Engineer or similar role is advantageous.
- Strong proficiency with Azure cloud services including Azure Data Factory, Azure Data Lake, Azure SQL Database, and Azure Databricks preferred.
- Experience with SQL and common data science toolkits.
- Proficiency in programming languages such as Python or Scala.
- Strong problem-solving skills and ability to work in a dynamic and agile environment.
- Excellent communication and teamwork skills.
- Knowledge of development methodologies (Agile, Scrum, etc.) is a plus
What will set you apart:
- Azure Fabric knowledge and exposure
- Apache Spark
- Data Lakehouse
- Investment Management Industry experience within an Insurance domain