What are the responsibilities and job description for the Azure data Factory with Data Bricks position at Ekcel Technologies Inc?
Job Details
Job Title : Azure data Factory with Data Bricks
Please find the JD below:
Azure Data Factory developer(with strong emphasis on Data bricks)
Location: NJ(Local candidate only) F2F
Hybrid role- candidate must go to office once a week.
Job Description :
*4 years of experience in Databricks is must*
IT professional experience in Azure Cloud over 7 years working as Azure Developer
Worked on multiple projects as developer using Datafactory from data receiving, validation, transform and then publish
Worked on Data Factory pipelines and AppLogic after gathering and translating end user requirements
Ability to recreate existing legacy application logic and functionality into Azure Data Factory/Data Lake, SQL Database and SQL Datawarehouse environment
Good to have:
Experience managing databases, Azure Data Platform services (Azure Data Lake (ADLS), Data factory (ADF), Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB), SQL Server, Oracle, Data Warehouse etc.
Experience in implementing hybrid connectivity between Azure and on-premise using
Plan and Develop roadmaps and deliverables to advance the migration of existing solutions on-premise systems/applications to Azure cloud
Experience with Azure transformation projects and Azure architecture decision making Architect and implement ETL and data movement solutions using Azure Data Factory (ADF), SSIS
Experience in developing roadmaps and deliverables to advance the migration of existing solutions on-premise systems/applications to Azure cloud
Experience in establishing Data Factory development standards and best practices
Skill sets needed:
ETL Tools: Azure Data Factory (ADF), Azure Database Migration service (DMS), ETL SQL server integration services (SSIS), SQL server reporting services (SSRS), ETL extract transformation and load, Business Intelligence (BI), BCP.
Azure Cloud: Azure SQL Database, Azure Data Lake, Azure Data Factory (ADF), Azure SQL Data Warehouse, Azure Service Bus, Azure analysis service (AAS), Azure Blob storage, Azure Search, Azure App service, Redis cache using pipeline and SSIS, infrastructure as a service(IaaS), Database as a service (DBaaS), Data Migration service (DMS), Azure SQL Data, Elastic Pools, Geo Replication, Geo restore, JSON, ARM template, SQL Data Synch, Azure Cli, Azure SQL Analytics, Azure Network components (virtual network, network security group, User defined Route, Gateway, Load Balancer etc, Virtual machines, Traffic manager, VPN.
