What are the responsibilities and job description for the Cloud Data Engineer position at Prestige Staffing Information Technology Job?
JobID: 48714
Cloud Data Engineer
Pay: $115-125k based on experience
Location: Durham, NC (Hybrid in office 2-3 days/week)
The Cloud Data Engineer is responsible for leading the design and implementation of Microsoft Fabric-centric data platforms and data warehouses as well as developing and optimizing ETL/ELT processes within the Microsoft Azure ecosystem. Job expectations include providing technical leadership, collaboration with end users and leadership by reviewing business requirements and developing and implementing complex data solutions and interactions across multiple systems and domains.
Duties And Responsibilities
- Ensure best practices in data governance, security, and privacy are adhered to throughout the data lifecycle.
- Perform data profiling, data cleansing, and troubleshooting to ensure high-quality data is available for reporting and analytics to support Data Scientists.
- Leveraging Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric to manage data pipelines and optimize workflows
- Solid understanding of ETL/ELT best practices
- Experience with ETL/ETL Mapping documentation
- Experience with scripting languages like Python, PowerShell
- Managing SQL tables, creating indexes, and querying databases for analysis
- Monitor and evaluate system performance.
- Automating processes and developing workflows to streamline data collection and management.
- Participate in Q&A for software deployment.
- Perform other job-related duties as assigned.
- Stay up to date with emerging technologies and trends in cloud-based data management
- Bachelor’s degree in computer science or related field or directly related experience.
- 5 years of Microsoft SQL experience
- Proficiency with data visualization tools such as Power BI.
- 2 year(s) of Azure experience.
- Experience developing queries/views/stored procedures in Microsoft SQL Server.
- Strong experience working with XML, JSON, Microsoft SQL, C#, and PowerShell
- Preferred candidates should have DP-600 certification
- Proven experience in data engineering and analytics on Azure cloud platforms.
- 2 years developing and consuming APIs.
- Knowledge of Blue Cherry, KWI, VR Link, or RepSpark a plus
- Experience with Salesforce Commerce Cloud or OMS
- Must be authorized to work legally in the United States.
Salary : $115,000 - $125,000
