What are the responsibilities and job description for the Databricks Technology Specialist position at LatentView Analytics?
LatentView Analytics is a pioneer in data-driven decision-making, and we are seeking a talented Databricks Architect to join our team. In this role, you will be responsible for designing, implementing, and managing cloud-based data solutions using Databricks and associated technologies.
Key Responsibilities
The key responsibilities of this role include:
Designing and Implementing Data Solutions
Collaborate with cloud providers (Azure, AWS) to design and implement cloud-native solutions for data storage, processing, and analytics using Databricks.
Developing Scalable Data Pipelines
Build and maintain efficient data pipelines using Databricks, Apache Spark, and other cloud-based tools to ensure seamless data flow across systems.
Collaborating with Stakeholders
Work closely with data scientists, analysts, and business stakeholders to transform business requirements into actionable data solutions.
Optimizing Performance
Continuously optimize Spark and Databricks workflows for improved performance and cost efficiency.
Requirements
- Proven experience with Databricks and Apache Spark.
- Strong understanding of cloud platforms (Azure, AWS).
- Expertise in SQL, Python, Scala, or Java.
- Familiarity with data storage solutions.
