Database Architect

Job Title : Databricks Architect

Work Location Raritan NJ

Job Description :

experience in databricks architecture

Hands on experience in deploying Production grade Databricks cluster

Hands on experience in Shell scripting / Perl / Python / Hive / SQL

Sound UNIX abilities involving user management, security & permissions

Sound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.)

Sound knowledge about the clustered deployment Architecture

Exposure to cloud AWS / Azure / GCP

Ability to set up VMs for environment set up

Hands on experience on databricks monitoring & ability to deploy, create plug[1]ins for custom monitoring stats

Excellent analytical and problem solving skills are mandatory

Very good knowledge of Delta Lake and its structure

Create and configure DB clusters and SQL warehouses

Control access to clusters and SQL warehouses

Understanding of Databricks networking

Databricks Integration and Connectivity with other systems

Configure workspace settings

Employ access control to secure workspace assets

Overall should initiate cloud automation and operations

Knowledge of Security implementation and data governance

Secure access to external storage

Experience of Continuous integration & delivery