What are the responsibilities and job description for the Databricks Admin position at JPS Tech Solutions llc?
Role: Databricks Admin
Location – Dallas, TX/LA
Job Description:
Job duties:
- Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support
- Operational support responsibilities include platform set-up and configuration, workspace administration, resource monitoring, providing technical support to data engineering, Data Science/ML, and Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues
- Assist in the deployment and configuration of Databricks environments, ensuring alignment with best practices for security and performance
- Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization
- Install, configure, and maintain Databricks clusters and workspaces
- Maintain Platform currency with security, compliance, and patching best practices
- Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance
- Implement and manage access controls and security policies to protect sensitive data
- Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions
- Manage AWS resources related to Databricks and networking configurations
Technical Competencies:
- Strong understanding of data engineering needs
- Strong understanding of aws infrastructure required by Databricks
- Experience with compliance audits/audit documentation
- Experience using Databricks APIs , system tables for creating admin related queries and dashboards
- Understanding of the Databricks workspace and development environment
- Strong debugging skills
- Proficiency in pySpark, Python, SQL and aws
Skills :
4 years - database admin
2 years - databricks admin
2 years - python, pyspark
Job Type: Contract
Pay: $54.92 - $60.06 per hour
Schedule:
- 8 hour shift
- Monday to Friday
Work Location: In person
Salary : $55 - $60
