What are the responsibilities and job description for the Lead Developer - Python Pyspark Bigdata Spark Scala position at New York Technology Partners?
Job Title: Lead Developer - Python Pyspark Bigdata Spark Scala
Location: West Chester, PA (Local Candidates)
Position Type: Contract position
Work Authorization: H1B
Job Description:
8 year’s experience in Sql/ETL//Spark/BidgData/Tableau/Python
Language: Python, PySpark, SQL (advanced), Scala (will prefer to have)
Database: Relational (Oracle, Postgres,e tc. ), NoSQL (MongoDB, Cassandra. Etc)
Tools: Spark, Databricks, Hadoop, Kafka, Airflow, Apache NiFi (any 2 – 3)
Cloud Platforms: AWS, or Azure or GCP
Reporting Tools: PowerBI, Tableau, Etc.
Others: CICD, Git, Data Pipelines, Performance Optimization, etc.
AI / ML: Must be trained in AI Augmented development using Copilot & Other LLMs. Should be comfortable adopting GenAI in all phase of SDLC.
Advanced troubleshooting skills & Experience with logging and monitoring tools like Kibana to trace logs of microservices/APIs for interactions between external systems.
Secondary Skills:
Strong Telecom domain expertise for all lead & sr. roles is a must. Knowledge of
Buy-flow processes and various customer journey interactions & system
interactions across different touchpoints.
If you believe you are qualified for this position and are currently in the job market or interested in making a change, please email me the resume along with contact details on tapan@nytpcorp.com or give me a call at 201-604-3998.
