What are the responsibilities and job description for the Databricks Cloud Data Engineer position at Cynet Systems?
Job Description : Responsibilities :
- Understand technology vision and strategic direction of business needs.
- Understand our current data model and infrastructure, proactively identify gaps, areas for improvement, and prescribe architectural recommendations with a focus on performance and accessibility.
- Partner across engineering teams to design, build, and support the next generation of our analytics systems.
- Partner with business and analytics teams to understand specific requirements for data systems to support both development and deployment of data workloads ranging from Tableau reports to ad hoc analyses.
- Own and develop architecture supporting the translation of analytical questions into effective reports that drive business action.
- utomate and optimize existing data processing workloads by recognizing patterns of data and technology usage and implementing solutions.
- Solid grasp of the intersection between analytics and engineering while maintaining a proactive approach to assure solutions demonstrate high levels of performance, privacy, security, scalability, and reliability upon deployment.
- Provide guidance to partners on effective use of the database management systems (DBMS) platform through collaboration, documentation, and associated standard methodologies.
- Design and build end to end automation to support and maintain software currency.
- Create automation services for builds using Terraform, Python, and OS shell scripts.
- Develop validation and certification process through automation tools.
- Design integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for products.
- Participate in developing solutions by incorporating cloud native and 3rd party vendor products.
- Participate in research and perform POCs (proofs of concept) with emerging technologies and adopt industry best practices in the data space for advancing the cloud data platform.
- Develop data streaming, migration and replication solutions.
- Demonstrate leadership, collaboration, exceptional communication, negotiation, strategic and influencing skills to gain consensus and produce the best solutions.
- Engage with Senior leadership, business leaders at the Client and the Board to share the business value.
Qualifications :
