Project Scope :
- Helping with overall data modernization effort specifically focused on Azure Data Lake right now they are using Azure Synapse and Azure Data Factory
HighLevel Individual Duties :
Maintaining current Data Lake using medallion architectureSome L2 and L3 Support mostly related to access and usersConsuming data from blob storage then maintaining those workbooks within our data environmentMustHaves (Concepts & Tools) :
3 years of data engineering experienceAzure data ecosystem experienceSQL experiencePython experienceWhat will Win :
Specific Azure Synapse knowledgeData visualization experience PowerBI preferred open to anythingExperience with Delta Parquet filesAPI Group Data Engineer
Hybrid onsite 3x / week new brighton MN
18 month contract
Job Description :
We are currently seeking a Data Engineer to join our team. This role will support our datadriven decisionmaking processes by analyzing and visualizing complex datasets implementing modern data management tools and collaborating with crossfunctional teams to derive actionable insights. The individual will work closely with business teams to understand data needs manage and improve data pipelines and drive the transformation of our data infrastructure to a modern scalable platform. Additionally this role will support our broader efforts in implementing machine learning and advanced analytics capabilities to enhance business decisionmaking.
Essential Duties & Responsibilities
To include but not limited to the following :
Design implement and maintain data architecture to support business intelligence and reporting needs.Build and manage data pipelines to integrate clean and transform data across systems (ETL processes).Collaborate with business teams to understand data requirements and deliver scalable data solutions.Monitor data quality and optimize data flows to ensure accuracy integrity consistency and compliance with organizational standards.Troubleshoot and resolve datarelated issues promptly.Assist in migrating existing data infrastructure to modern cloudbased platforms ensuring scalability and reliability.Develop and implement business intelligence solutions including reports dashboards and data visualizations.Create and maintain data models and database designs that align with business needs.Support machine learning initiatives by preparing data for analysis and modeling.Provide actionable recommendations based on data analysis to support executive and operational decisionmaking.Lead and participate in data governance and quality initiatives adhering to best practices and standards.Develop training materials and conduct sessions to ensure effective use of data tools across teams.Stay abreast of emerging trends in data analytics and suggest ways to implement innovative solutions.Qualifications
Required :
Bachelors degree in computer science Data Science Information Systems or a related field (or equivalent experience).3 years of experience in data engineering or a similar role.Strong knowledge of data modeling database design and ETL processes.Advanced SQL skills for querying and data manipulation.Proficiency in the Microsoft Azure ecosystem including Azure Data Factory Azure Synapse Analytics Azure Purview and Azure SQL Database.Strong experience with Power BI for data visualization.Experience with data integration tools (e.g. Azure Data Factory SSIS or similar).Handson experience with business intelligence tools.Strong problemsolving skills and ability to work on complex technical challenges.Preferred :
Familiarity with Databricks for data engineering and analytics.Knowledge of data governance privacy and cataloging principles.Familiarity with machine learning workflows and data preparation for predictive analytics.Experience with Python or R for data analysis.Knowledge of cloud architecture and modern data platforms.Excellent communication skills with the ability to convey technical concepts to nontechnical stakeholders.Experience in project management and crossfunctional collaboration.Competencies and Skills
Shows AccountabilityThinks Systematically and AnalyticallyFocuses on Customer NeedsLearns ContinuouslyPlans / Organizes Projects EffectivelySolves Complex ProblemsDrives Innovation and Process ImprovementKey Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Vacancy : 1
