Databricks Platform Administrator

Databricks Platform Administrator

Primary Skill: Data Analysis

Location: Atlanta, GA

Job Type: W2

Duration: 12 Months

Job Description:

·       Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support. Operational support responsibilities include platform set-up and configuration, workspace administration, resource monitoring, providing technical support to data engineering, Data Science/ML, and Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues.

·       The position will also involve the management of security and changes.

·       The position will work closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts.

·       This position will involve participation in on-call rotation for 24/7 support.

Education:

·       4-year College Degree preferably in Information Systems, Computer Science, Engineering, or related field.

Responsibilities:

·       Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.

·       Collaborate with the data engineering team to ingest, transform, and orchestrate data.

·       Manage privileges over the entire Databricks account, as well as at the workspace level, Unity Catalog level and SQL warehouse level.

·       Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.  

·       Install, configure, and maintain Databricks clusters and workspaces. 

·       Maintain Platform currency with security, compliance, and patching best practices.

·       Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance. 

·       Implement and manage access controls and security policies to protect sensitive data.

·       Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions.

·       Administer interfaces with Azure AD and Amazon AWS.

·       Hadoop admin skills are preferred 

·       Knowledge about Apache Kafka is desirable

Required Skills:

·       3 years of production support of the Databricks platform

Preferred:  

·       2 years of AWS/Azure PaaS

·       2 years of automation frameworks such as Terraform

·       2 years of Hadoop administration (Cloudera/Hortonworks)

·       2 years of Apache Kafka streaming platform administration

Kindly please share your resumes with srikar@isofttekinc.com or 707-435-3471