What are the responsibilities and job description for the Sr. Data Engineer position at Prudent Technologies and Consulting, Inc.?
Overview -
We are seeking a highly skilled Sr. Data Engineer with expertise in "SnapLogic, dbt (Data Build Tool), Snowflake, and Python/PySpark, and experience working with the Azure ecosystem."The ideal candidate will play a key role in designing, developing, and optimizing scalable data pipelines and architectures to support our business intelligence and analytics needs. Candidates with experience in the finance industry are strongly preferred.
Required Skills and Qualifications:
- Experience: 8 years of experience in data engineering or related roles.
- Tools & Technologies:
- Expertise in SnapLogic for ETL/ELT workflows.
- Proficiency with dbt for data modeling and transformation.
- Strong knowledge of Snowflake, including performance tuning and best practices.
- Advanced programming skills in Python and PySpark for data engineering tasks.
- Cloud Platforms: Hands-on experience with Azure, including data-related services.
- Database Management: Strong SQL skills and experience working with relational and non-relational databases.
- Problem Solving: Excellent debugging, problem-solving, and analytical skills.
- Communication: Strong verbal and written communication skills to effectively collaborate with cross-functional teams.
Preferred Qualifications:
- Experience with other cloud platforms (AWS, GCP) is a plus.
- Familiarity with CI/CD pipelines for data workflows.
- Certification in Snowflake, Azure, or other relevant technologies.
- Knowledge of data governance and security best practices.
