What are the responsibilities and job description for the Senior Data Engineer (Pyspark/SQL) position at NucleusTeq?
Job Title: Data Engineer Location: Indore, Bangalore, Raipur Job Type: Full-time Experience: 5 Years
About the Role:
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in PySpark, SQL and will be responsible for designing, developing, and maintaining scalable data pipelines. You will collaborate with cross-functional teams to ensure the availability, reliability, and performance of our data infrastructure, enabling data-driven decision-making across the organization.
Key Responsibilities:
● Design, develop, and optimize large-scale data pipelines using PySpark.
● Write efficient and complex SQL queries for data extraction, transformation, and analysis.
● Perform data extraction, transformation, and loading (ETL) processes from various data sources.
● Ensure data quality, reliability, and security through effective monitoring and validation techniques.
● Automate data workflows and processes to enhance efficiency and reduce manual intervention.
● Troubleshoot and resolve issues related to data processing, storage, and performance.
● Stay up-to-date with the latest trends and technologies in data engineering and implement best practices. Required Skills & Qualifications:
● Proficiency in PySpark for distributed data processing.
● Strong knowledge of SQL and experience with databases such as MySQL, PostgreSQL
● Familiarity with cloud platforms (e.g., AWS, Azure, or Google Cloud) is a plus.
● Strong analytical and problem-solving skills.
● Excellent communication and teamwork abilities.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Excellent problem-solving skills and attention to detail.
- Strong communication and leadership abilities.
NucleusTeq culture
Our positive and supportive culture encourages our associates to do their best work every day. We celebrate individuals by recognizing their uniqueness and offering them the flexibility to make daily choices that can help them to be healthy, centered, confident, and aware. We offer well-being programs and are continuously looking for new ways to maintain a culture where our people excel and lead healthy, happy lives.
