What are the responsibilities and job description for the Azure Data Engineer position at InfoVision, Inc.?
Job Details
Azure Data Engineer | Hybrid in Boston, MA | Long Term
Roles and Responsibilities:
You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
You participate in early state design and feature definition activities.
Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
Responsible for creating reusable and scalable data pipelines.
You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
You have an experience working collaboratively in cross-functional teams and manage multiple projects simultaneously.
Critical Skills to Possess:
Advanced working knowledge and experience with relational and non-relational databases.
Solid understanding of relational and NoSQL databases, data modeling, and database management systems (DBMS)
Experience building and optimizing Big Data pipelines, architectures, and datasets.
Strong analytic skills related to working with structured and unstructured datasets.
Experience in Python, Kubernetes, Azure, Snowflake, CI/CD
Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
Strong experience in Azure Data Factory, Databricks, Event Hub, Azure Synapse.
Azure DevOps experience to deploy the data pipelines through CI/CD.
