What are the responsibilities and job description for the Data Engineer position at Veridian Tech Solutions, Inc.?
Role - PySpark Developer
Location – Irving TX
Fulltime
Job Description
Client is seeking a PySpark Developer . In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications :
- At least 4 years of experience with Information Technology.
- At least 2 years of experience in PySpark
- Strong understanding of distributed computing principles and big data technologies
- At least 2 years of experience working with Apache Spark and Spark SQL
- Knowledge of data serialization formats such as Parquet, Avro, or ORC
- Familiarity with data processing and transformation techniques
Preferred Qualifications :
