What are the responsibilities and job description for the Senior Big Data Engineer (PySpark & Hadoop) - No C2C position at Mindlance?
Senior Big Data Engineer (PySpark & Hadoop)
Location: Jersey City, NJ 07310 - 3 days onsite required per week
HIRING DRIVE - DAY of INTERVIEW – Thurs, 03/13 and Fri, 03/14 – all interviews will be conducted on these days.
Job Description:
We are seeking an experienced Senior Big Data Engineer with a strong background in PySpark and Hadoop to join our direct client in the banking industry. The ideal candidate will have a deep understanding of large-scale data processing and optimization, along with hands-on experience in building high-performance data solutions.
Key Responsibilities:
- Minimum 8 years of experience in big data development using PySpark within the banking/financial sector.
- Expertise in designing, developing, and optimizing large-scale data processing applications to ensure performance and efficiency.
- In-depth proficiency with PySpark and the Apache Spark ecosystem for distributed data processing.
- Strong programming skills in Python with a focus on PySpark.
- Comprehensive understanding of Hadoop architecture, Hive, and HDFS for data storage and retrieval.
- Advanced proficiency in SQL development, including query optimization and performance tuning for high-volume data processing.
This role is a great fit for someone who thrives in banking and financial environments, handling complex data pipelines and optimizing large-scale big data applications.
“Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.”
Salary : $70
