What are the responsibilities and job description for the Python Full Stack Engineer - Professional position at Sage IT Inc?
Job Details
Job Description: We are seeking a highly skilled Python Developer with expertise in Apache Spark to join our dynamic data engineering team. The ideal candidate will play a key role in designing, developing, and optimizing scalable data pipelines and processing frameworks. You will work on large-scale data processing, analytics, and transformation tasks, ensuring the delivery of high-quality data solutions that drive business insights.
Key Responsibilities:
- Develop, optimize, and maintain scalable ETL pipelines using Python and Apache Spark.
- Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Work with structured and unstructured datasets to perform data cleansing, transformation, and enrichment.
- Design and implement distributed data processing solutions on data platforms.
- Write efficient, reusable, and scalable code for data processing and analytics.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Stay updated with the latest trends and advancements in data technologies and incorporate best practices into development processes.
| |||||
| | |||||
| |
| |
| ||||
| |
| |
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
