What are the responsibilities and job description for the Big Data Tech Lead - W2 only no C2C position at Pyramid Technology Solutions?
Job Description: Big Data Tech Lead
Location: Dallas, TX, Charlotte, NC (Hybrid)
Duration: Long term
KEY: Very Strong:- Spark, Scala, SQL, Hadoop, Bigdata
Position Summary:
We are seeking a dynamic Big Data Tech Lead with exceptional communication skills and a proven ability to lead and develop cutting-edge solutions. This role is ideal for a self-driven individual who thrives in a client-facing environment, effectively balances technical expertise with leadership, and excels in guiding teams to success. The position demands a 50/50 split between hands-on development and leadership responsibilities.
Key Responsibilities:
- Collaborate with clients to understand business needs, define requirements, and deliver tailored Big Data solutions.
- Lead, mentor, and guide a team of developers to ensure efficient project execution, quality code delivery, and adherence to timelines.
- Design and implement scalable, high-performance Big Data applications using Spark, Scala, SQL, and Hadoop technologies.
- Develop and maintain data pipelines, ensuring optimal data flow and transformation across systems.
- Perform code reviews, enforce best practices, and resolve complex technical challenges within the team.
- Analyze and optimize large datasets to ensure performance and reliability of Big Data solutions.
- Maintain strong client relationships, presenting technical solutions and progress updates in a clear and professional manner.
- Stay updated with the latest trends and technologies in Big Data and incorporate them into solutions where appropriate.
Required Skills and Qualifications:
- 10 years of experience in Big Data technologies with a strong emphasis on development and leadership roles.
- Expertise in Apache Spark and Scala, with a deep understanding of distributed data processing.
- Proficiency in SQL for complex queries and data analysis.
- Strong experience with Hadoop ecosystem tools and frameworks.
- Exceptional communication skills, both written and verbal, with a proven track record of successful client-facing engagements.
- Demonstrated ability to lead and mentor development teams, ensuring delivery of high-quality solutions.
- Experience with performance tuning and optimization of Big Data workflows.
- Strong analytical and problem-solving skills, with the ability to manage competing priorities.
Preferred Qualifications:
- Familiarity with cloud platforms such as AWS, Azure, or GCP for Big Data processing.
- Knowledge of additional programming languages like Python or Java is a plus.
- Experience in data governance, security, and compliance in Big Data environments.
