What are the responsibilities and job description for the Lead Data Engineer position at Canopy Education, Inc., dba CollegeVine?
A company is looking for a Lead Data Engineer.Key ResponsibilitiesOwn problems end-to-end and deliver results quicklyPartner with subject matter experts across the companyDrive data architecture and engineering decisionsRequired Qualifications10 years of software engineering experience (at least 5 in data)Proficiency in Python, Scala, and SQLDeep expertise with Spark or similar distributed processing frameworksExperience designing and implementing data platformsComfortable managing complex data projects and stakeholder expectations