What are the responsibilities and job description for the Lead Azure DataBricks Engineer (10+ Years) position at Syren?
Responsibilities / Skills Must have:
Highly Experienced with Azure Databricks features
Deal with some of the Ambiguities in the codebase
Experienced with coding in Python, Pyspark
Must have experience with cluster configurations
Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles, Hoslistic vision on the Data Strategy.
Proficiency in Data Streaming and Data Modeling
Strong understanding of data scaling and its complexities
Data Archiving and Purging mechanisms
Experienced with Sql
Good problem solver
Should have experience mentoring team members.
