What are the responsibilities and job description for the PySpark Developer position at Nityo Infotech Corporation?
Job Details
Job Role: Pyspark Developer
Job Location: Irving, TX
Job Type: Full Time
Job Description:
Client is seeking a Pyspark Developer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications:
- Candidate must be located within commuting distance of Irving, TX or be willing to relocate to the areas.
- Bachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 5 years of experience with Information Technology.
- At least 2 years of experience in PySpark
- Strong understanding of distributed computing principles and big data technologies
- At least 2 years of experience working with Apache Spark and Spark SQL
- Knowledge of data serialization formats such as Parquet, Avro, or ORC
- Familiarity with data processing and transformation techniques
Preferred Qualifications:
- Experience with data lakes, data warehouses, and ETL processes
- Good understanding of Agile software development frameworks
- Experience in Banking domain
- Strong communication and Analytical skills
- Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
- Experience and desire to work in a global delivery environment
