Cloud ETL Developer

Responsibilities:

• Work with the Project team members and business stakeholders to understand business processes and pain points
• Develop expertise in source system datasets and data lifecycle
• Profile source data which may contain a spatial component; review source data and compare content and structure to dataset requirements; identify conflicts and determine recommendations for resolution
• Conduct entity resolution to identify matching and merging and semantic conflicts
• Elicit, record, and manage metadata
• Diagram current processes and proposed modifications using process flows, context diagrams and data flow diagrams
• Decompose requirements into Epics and Features and create clear and concise user stories that are easy to understand and implement by technical staff
• Utilize progressive elaboration; map stories to data models and architectures to be used by internal staff to facilitate master data management
• Identify and group related user stories into themes, document dependencies and associated business processes
• Discover and document requirements and user stories with a focus on improving both business and technical processing
• Assist Product Owner in maintaining the product backlog
• Create conceptual prototypes and mock-ups
• Collaborate with staff, vendors, consultants, and contractors as they are engaged on tasks to formulate, detail and test potential and implemented solutions
• Perform Quality Analyst functions such as defining test objectives, test plans and test cases, and executing test cases
• Coordinate and Facilitate User Acceptance Testing with Business and ensure Project Managers/Scrum Masters are informed of the progress
• Designs and develops systems for the maintenance of the Data Asset Program(Data Hub), ETL processes, ETL processes for spatial data, and business intelligence.
• Develop a new data engineering process that leverage a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed.
• Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data Marts.
• Work closely with data analysts, data scientists, and other data consumers within the business in an attempt together and populate data hub and data warehouse table structure, which is optimized for reporting.

Qualifications

• The candidate must have a minimum of 10 years of experience delivering business data analysis artifacts.
• 5 years of experience as an Agile Business Analyst; strong understanding of Scrum concepts and methodology.
• Experience organizing and maintaining Product and Sprint backlogs Experience translating client and product strategy requirements into dataset requirements and user stories.
• Proficient with defining acceptance criteria and managing acceptance process
• Exceptional experience writing complex sql queries for Sql Server and Oracle
• Experience with Azure Databricks, Azure data factory, snowflake
• Experience with ESRI ArcGIS.
• Experience with enterprise data management.
• Expertise with Microsoft Office products (Word, Excel, Access, Outlook, Visio, PowerPoint, Project Server)
• Experience with reporting systems operational data stores, data warehouses, data lakes, data marts.

Preferred Skills:

• Advanced understanding of data integrations.
• Strong knowledge of database architectures
• Strong analytical and problem solving skills
• Ability to build strong relationships both internally and externally
• Ability to negotiate and resolve conflicts
• Ability to effectively prioritize and handle multiple tasks and projects
• Strong written and verbal communication skills
• Desire to learn, innovate and evolve technology
• Experience with key data warehousing architectures including Kimball and Inmon, and has a broad experience designing solutions using a broad set of data stores (e.g., HDFS, Azure Data Lake Store, Azure Blob Storage, Azure SQL Data Warehouse, Azure Cosmos DB.

Technologies Required:

• Data Factory v2,Data Lake Store, Data Lake Analytics, Azure Analysis Services, AZURE Synapse
• IBM Datastage, Erwin, SQL Server (SSIS, SSRS, SSAS), ORACLE, T-SQL, Azure SQL Database, Azure SQL Datawarehouse.
• Operating System Environments (Windows, Unix, etc.).
• Scripting experience with Windows and/or Python, Linux Shell scripting.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.