What are the responsibilities and job description for the Hadoop Lead Developer position at TekJobs?
Hadoop Lead Developer W2 Position
Required Skills: Hadoop, PySpark, Big data architect
Job Description
Responsibilities:
• Technical leadership: Provide technical guidance and mentorship to a team of Hadoop/PySpark developers.
• Architecture design: Design and implement scalable and reliable big data architectures using Hadoop and PySpark.
• Code review and optimization: Review code for quality and performance, and lead efforts to optimize Data pipelines.
• Project management: Plan and manage the development and deployment of data processing projects.
• Stakeholder collaboration: Collaborate with business stakeholders to understand requirements and translate them into technical solutions.
• Innovation: Proactively recommend improvements to the system.
Required Skills and Experience:
• Proven leadership: Experience leading or mentoring technical teams.
• Hadoop/PySpark expertise: Advanced proficiency in Hadoop and PySpark, including experience with complex data processing pipelines.
• Architecture design: Experience designing and implementing scalable big data architectures.
• Performance optimization: Expertise in optimizing Hadoop/PySpark jobs for efficiency and performance.
• Communication: Excellent communication and interpersonal skills to effectively collaborate with stakeholders across departments.
• Other: Retail Banking domain experience and Data Stage knowledge will be good to have.
