What are the responsibilities and job description for the Sr. AWS Data Engineer(Databricks SME) position at 3Core Systems, Inc?
Job Details
Title: Sr. AWS Data Engineer(Databricks SME)
Location: Hybrid (Dallas, TX or Miramar, FL)
Duration: 6 Months Contract to Hire
Manager wants a Databricks SME
Sr. Developer ETL, Databricks Platform Admin on AWS
Responsibilities:
Join a growing Databricks team focused on GenAI platform development.
Work within the platform operations team, which currently consists of 7 members.
Manage and ensure the Databricks platform is up and running smoothly.
Leverage advanced Python skills for Databricks development.
Collaborate with the team to manage AWS datasets, primarily from SAP.
Work with APIs, frameworks, and backend components, ensuring optimal functionality and security.
Oversee user provisioning and access management.
Maintain and enhance the cloud infrastructure and data lake house.
Key Requirements:
Experience in Databricks, with an emphasis on platform and cloud management.
Strong background in ETL development, with experience in data engineering.
Advanced Python programming skills, particularly in Databricks.
Proficient with AWS, especially working with datasets from SAP.
Familiarity with Redshift, Informatica, and components API frameworks.
3 years of experience in Framework Development.
Understanding of Data Lake House architecture and best practices.
Additional Notes:
AWS expertise is essential.
Databricks experience, particularly in managing cloud infrastructure, is crucial.
Redshift knowledge is a bonus as it is part of the ecosystem.
The role is focused on platform management, with a key focus on security and control of data.
