What are the responsibilities and job description for the Python PySpark Developer - Full time position at Purple Drive Technologies?
Python PySpark Developer
- 4 years working experience in data integration and pipeline development.
- 2 years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
- Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
- Design, develop test, deploy, maintain and improve data integration pipeline.
- Experience in Python and common python libraries.
- Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
- Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
- Databricks or Apache Spark Experience is a plus.
Python Developer
eNGINE -
Pittsburgh, PA
Python Developer
eNGINE -
Eighty Four, PA
Python Developer
eNGINE -
Washington, PA
