What are the responsibilities and job description for the Data Engineer position at Cloud BC Labs?
Position : Data Engineer (Azure Data Factory & Snowflake)
Location : Remote
Term : C2C / W2 role
Job Description :
We are seeking a skilled Data Engineer with expertise in Azure Data Factory (ADF) and Snowflake to join our dynamic data team. The candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support business intelligence, analytics, and reporting needs.
Key Responsibilities :
1. Data Integration & Pipeline Development :
Design and develop ETL pipelines using Azure Data Factory to integrate data from multiple sources into Snowflake.
Implement and optimize data workflows to ensure high performance and reliability.
2. Snowflake Database Development :
Develop, optimize, and manage Snowflake databases, schemas, and tables.
Write and tune complex SQL queries to process and analyze large datasets.
3. Cloud Architecture & Collaboration :
Collaborate with architects to design scalable and secure cloud data solutions.
Work with cross-functional teams to gather requirements and translate them into technical solutions.
4. Performance Tuning :
Optimize Snowflake and Azure Data Factory for cost and performance.
Implement best practices for data governance, security, and quality.
5. Monitoring & Troubleshooting :
Monitor data pipelines and resolve issues promptly.
Automate repetitive tasks and improve system reliability.
Qualifications & Skills :
Technical Skills :
Proficiency with Azure Data Factory and Snowflake.
Strong SQL skills and experience with data modeling.
Familiarity with Azure services (e.g., Azure Data Lake).
Experience with programming languages like Python for data processing.
Soft Skills :
Strong analytical and problem-solving abilities.
Excellent communication and teamwork skills.
Preferred Experience :
Hands-on experience with ADF and Snowflake.
Experience working in an Agile environment.
Knowledge of data warehousing and Power BI.
Knowledge of Microsoft Fabric
Cloud BC Labs Inc is a digital transformation organization aimed at creating seamless solutions for clients to effectively manage their business operations. The company specializes in Business and Management Consulting, AI / ML, Data Analytics & Visualization, Cloud Data Warehouse Migration, Snowflake Implementation, Informatica Implementation & Upgrade, Staffing Services and Data Management Solutions