What are the responsibilities and job description for the Data Engineer position at Princeton IT Services?
Job Details
Job Description
Job Title: Sr Data Engineer
Location: Canada
Job Type : Full-time
Responsibilities:
- Design, develop, and maintain scalable data and file ingestion frameworks.
- Collaborate with cross-functional teams, analysts, and stakeholders to define data requirements and technical solutions.
- Optimize data ingestion frameworks for performance and reliability.
- Implement data governance and security best practices.
- Troubleshoot data integrity and performance issues.
- Conduct code reviews and enforce coding standards.
- Mentor junior engineers and provide guidance on complex projects.
- Participate in architectural and design discussions.
- Work on process automation to mitigate data application issues.
- Stay updated with the latest data engineering trends and technologies.
Requirements:
- 5-6 years of experience in data engineering with a focus on scalable data ingestion frameworks.
- 3-4 years of hands-on experience with AWS services (Redshift, S3, DynamoDB, EMR serverless, Lambdas, Step Functions, etc.).
- Proficiency in ETL development using Python, PySpark, and Big Data technologies (Hadoop, Spark).
- Strong SQL skills and experience with RDBMS (PostgreSQL, Redshift, MySQL, etc.).
- In-depth knowledge of data warehousing concepts, data modeling, and ETL processes.
- Excellent communication skills to explain complex technical concepts to non-technical stakeholders.
- Experience working with Agile methodologies and Scrum processes.
- Strong problem-solving skills with the ability to work independently and mentor junior developers.
- 2-3 years of experience in the financial or other highly regulated industries.
- Familiarity with JIRA, DevOps, and CI/CD best practices.
- Experience with emerging technologies like AWS QuickSight, Amazon Co-Pilot, or similar tools.
Education:
- Bachelor's Degree in Computer Science, Information Systems, Mathematics, Software Engineering, or a related field.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
