What are the responsibilities and job description for the AWS Lead Data Engineer/Architect position at Incedo Inc.?
Job Summary:
We are looking for a highly skilled and motivated Tech Lead - Data Engineering to spearhead the development of scalable and efficient data engineering solutions. The ideal candidate will possess deep expertise in Python, PySpark, AWS services, and streaming data platforms, with a proven ability to integrate complex data sources and develop distributed data processing frameworks. This role requires a strong technical leader who can guide the team, solve complex challenges, and deliver optimal solutions that align with client requirements. Wealth management experience is an added benefit.
Experience:
- 10 years of experience in data engineering, with at least 3 years in a technical lead role.
- Strong hands-on expertise in Python, PySpark, and AWS services for data processing and integration.
- Proven experience designing and developing streaming data solutions using Kafka, AWS Kinesis, or similar technologies.
- Solid experience working with APIs and integrating data from diverse sources.
- Extensive knowledge of distributed data processing frameworks and best practices.
