What are the responsibilities and job description for the Azure Data architect position at Seven Hills Group Technologies inc.?
JD :
Lead the architectural design for migration project, leveraging Azure services, SQL, Databricks, and PySpark to create scalable, efficient, and reliable solutions.
Utilize Databricks to design and implement advanced data transformation and processing tasks using Databricks, PySpark and ADF
Design, deploy, and manage Databricks clusters for data processing, ensuring performance and cost efficiency, and troubleshoot cluster performance issues as needed.
Mentor and guide developers on the use of PySpark for data transformation and analysis, sharing best practices and reusable code patterns.
Document architectural designs, migration plans, and best practices to ensure alignment and reusability within the team and across the organization.
Collaborate with stakeholders to translate business requirements into technical specifications and design robust data pipelines, storage solutions, and transformation workflows.
Thanks and Regards
Nick Awasth
Job Type: Full-time
Schedule:
- 8 hour shift
Work Location: In person