What are the responsibilities and job description for the Python developer- Onsite Interview-Need Local Jersey City, NJ, USA position at Cyber Sphere LLC?
Job Details
Python developer
Hybrid, NJ(Need Local)
3 Months
Contract
Design, develop, and maintain high-performance data pipelines for data ingestion, transformation, and storage.
Work with large-scale data processing frameworks (Apache Spark, Dask, or Pandas) to process big data efficiently.
Develop ETL (Extract, Transform, Load) workflows for structured and unstructured data.
Optimize SQL queries and database performance for analytics and reporting.
Ensure data quality, validation, and governance across pipelines and storage layers.
Implement CI/CD pipelines for automating data pipeline deployment and monitoring.
Required Skills & Qualifications:
Strong Python programming experience with a focus on data engineering.
Hands-on experience in building and optimizing data pipelines for large-scale datasets.
Proficiency with SQL and NoSQL databases (PostgreSQL, BigQuery, MongoDB, etc.).
Familiarity with cloud data solutions and serverless computing (AWS Lambda, Azure Functions, Google Cloud Platform Cloud Functions).
Knowledge of workflow orchestration tools (Apache Airflow, Prefect, or Dagster).
Ability to troubleshoot, optimize, and scale data workflows effectively.
Munesh
,
CYBER SPHERE LLC