What are the responsibilities and job description for the Senior Data Engineer with Python, Pyspark and AWS || Hybrid in Charlotte, NC position at InfiCare Technologies?
Role Senior Data Engineer with (PYTHON PYSPARK AWS)
Location Charlotte, NC, (Hybrid - On-site 2 Days/week)
Skills Needed:
Mandatory : Python with Object oriented concepts, Spark, Problem Solving ability, Effective communication
Good to have : AWS.
Detailed Job Description:
Client is currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming.
The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python.
This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.
Responsibilities:
- Design, develop and implement new features to our existing framework using PySpark and Python.
- Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
- Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
- Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.
- Test and debug code to ensure it produces the desired results.
- Document all programming tasks and procedures for future reference and troubleshooting.
Qualifications:
- Proficient in Python, PySpark, and Object-oriented programming concepts.
- Proven experience as a Senior Data Engineer or similar role.
- Strong problem-solving techniques with an ability to troubleshoot complex software issues.
- Experience with AWS is preferred, but not mandatory.
- Excellent communication skills, both written and verbal.
- Self-motivated and able to work independently with minimal supervision.
Salary : $111,800 - $134,300
