What are the responsibilities and job description for the Data Architect position at Photon?
Data Architect - Jersey City
Key Responsibilities:
- Develop and optimize Spark ETL pipelines using Scala/Python and Oracle SQL.
- Lead a team of engineers, ensuring best practices and high performance.
- Collaborate with stakeholders to define and implement scalable data solutions.
- Ensure data integrity, security, and performance optimization.
- Stay updated on industry trends and emerging tech to drive continuous improvements.
Required Skills and Qualifications:
- 15 years of experience in data engineering or related fields.
- Strong expertise in Oracle SQL, including query optimization and performance tuning.
- Hands-on experience with Apache Spark for ETL processing.
- Proficiency in Scala and/or Python for data engineering tasks.
- Experience leading teams, managing projects, and mentoring engineers.
- Solid understanding of data warehousing, distributed computing and cloud platform.
- Strong problem-solving skills and the ability to work in a fast-paced environment.
Preferred Qualifications:
- Familiarity with CI/CD pipelines and DevOps practices
- Knowledge of real-time data processing frameworks like Kafka.
