What are the responsibilities and job description for the Big Data Solutions Expert position at LatentView Analytics?
As a Databricks Architect at LatentView Analytics, you will play a critical role in shaping the future of data-driven decision-making. We are looking for a highly skilled professional with expertise in designing, implementing, and managing cloud-based data solutions using Databricks.
Responsibilities
The key responsibilities of this role include:
Designing and Implementing Data Solutions
Collaborate with cloud providers (Azure, AWS) to design and implement cloud-native solutions for data storage, processing, and analytics using Databricks.
Developing Scalable Data Pipelines
Build and maintain efficient data pipelines using Databricks, Apache Spark, and other cloud-based tools to ensure seamless data flow across systems.
Collaborating with Stakeholders
Work closely with data scientists, analysts, and business stakeholders to transform business requirements into actionable data solutions.
Optimizing Performance
Continuously optimize Spark and Databricks workflows for improved performance and cost efficiency.
Requirements
- Hands-on experience with Databricks (Apache Spark).
- Strong understanding of cloud platforms (Azure, AWS).
- Expertise in SQL, Python, Scala, or Java.
- Familiarity with data storage solutions.
