What are the responsibilities and job description for the Lead Data Bricks Engineer - Cloud Data Platform position at Greymatter Innovationz?
Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.
We are looking for:
Lead DataBricks Engineer - Cloud Data Platform
Location: Princeton, NJ
Duration: Long Term
Skills: AWS and Azure Cloud Engineer / Administrator with knowledge/experience of solution architecting
Data Bricks: Experience on data bricks will be preferred.
Key Responsibilities:
1. Platform Design & Implementation:
o Design, deploy, and manage Databricks workspaces on major cloud platforms (Azure, AWS).
o AWS cloud admin Azure cloud admin
o Provision cloud services
o Architect and implement scalable, reliable, and secure cloud-based data solutions.
2. Collaboration & Support:
o Work closely with cross-functional teams, including DevOps, Data Science, and Business Intelligence, to align platform capabilities with business goals.
o Provide expertise and guidance on Databricks best practices and data architecture.
3. Security & Compliance:
o Implement robust security measures, including access controls, encryption, and data masking.
o Ensure compliance with organizational and regulatory requirements.
4. Automation & Innovation:
o Develop Infrastructure as Code (IaC) scripts (Terraform, CloudFormation) for deploying Databricks and cloud resources.
o Drive automation initiatives for deployment, scaling, and monitoring of cloud-based data platforms.
Required Skills & Qualifications:
• Experience:
o Minimum of 10 years in cloud platform engineering, solution architect or similar roles.
• Technical Expertise:
o Proficiency in at least one cloud platform: AWS or Azure.
o Expertise with Infrastructure as Code (e.g., Terraform, CloudFormation).
• Other Skills:
o Strong understanding of CI/CD pipelines and DevOps practices.
o Knowledge of monitoring and logging tools for cloud-based platforms.
o Ability to troubleshoot and resolve complex technical issues.
Preferred Qualifications:
• Certifications in AWS, or Azure.
• Experience with containerization (Docker, Kubernetes).
• Familiarity with security frameworks like SOC2, GDPR, or HIPAA.
At Greymatter Innovationz,
We offer:
Motivating Work Environment.
Excellent Work Culture.
Help you to upgrade yourself to the next level.
And More!!!
