What are the responsibilities and job description for the Databricks Architect position at SysMind Tech?
15 years of experience in architecture, design, implementation and analytics solutions. In-depth knowledge Data processing techniques and handling large data sets.
Hands on development Design and Develop applications using Databricks and Experience with Azure cloud technologies.
In-depth knowledge Data processing techniques and handling large data sets
Hands on experience using Azure Blob storage and Azure Data Lake Services for storing data
Hands on experience using Databricks in at least 2 projects, creating notebooks using Scala / Python. Exposure to using Pyspark, Spark SQL & Spark streaming for processing data for various use cases.
In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
Good to have any of programming language experience with Python / SQL or Spark / Scala.
Good understanding of Delta lake and how it can be used in conjunction with Blob or ADLS
Experience using Azure Synapse as source or target for the data pipelines in at least 1 project
Knowledge of Azure Data Factory or Databricks scheduling features to automate Databricks jobs
Self-starter who can pick up any other relevant Azure Services in the Analytics space
Strong understanding of Data Modeling and defining conceptual logical and physical data models.
Ability to design and demonstrate system Architecture with different environments
Ability to to deal with both Onperm and Cloud systems
Problem-solving skills along with good interpersonal & communication skills
Excellent communications, presentation, articulation, and relation building skills
Team player with ability to work in a dynamic environment.
Good-to-Have
Provisioning and managing Databricks cluster and Knowledge of HDInsight, Azure Functions and Azure DevOps is a big plus
Understanding of Data Modeling & Other ETL tools is desirable
On Prem Legacy MSBI tools to Azure platform migration experience is desirable
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Databricks Architect?
Sign up to receive alerts about other jobs on the Databricks Architect career path by checking the boxes next to the positions that interest you.
