Databricks Engineer

Job ID Number

R4906

Employment Type

Full time

Worksite Flexibility

Remote

Job Summary

As a Databricks Engineer, you will be responsible for collaborating with our client’s teams to build quality technical solutions. This involves analyzing, designing, coding, testing and implementation as well as guiding less experienced team members.

Job Description

We are looking for a Databricks Engineer to lead in complex application development services in our client’s Google Cloud Platform environment, typically as part of a project team or in an application support role. This is full-time contract and is 100% remote . The contract is expected to go through the end of 2025 with the possibility of extension.

Candidates must be able to work Monday – Friday normal business hours. Our client is based in EST.

Due to our end client, all candidates must be US Citizens.

The Databricks Engineer will analyze, design, code, test and implement more complex systematic solutions to meet customer requirements that adhere to our client’s IT standards and policies. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance and quality levels required by their customers. The Databricks Engineer must be able to guide and mentor less experienced team members.

What You’ll Do

Take a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects

Utilize and participate in the more complex full system development life cycle, per current client SDLC standards.

Lead collaboration with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs

Perform work in compliance with all client and client IT standards, policies and procedures.

Actively takes a leading role and participates on project teams in various project roles, including, but not limited to : Developer, Technical Lead and Project Manager, based upon level of experience.

Effectively communicates with team members, customers, partners and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions and providing accurate and concise documentation

Other duties as assigned or requested

What You’ll Need

Required :

Bachelor’s degree in Information Technology, Computer Science or closely related field

5 years of experience as a developer

3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows

Deep understanding of Spark and its core concepts. Proficient in Spark programming Python, PySpark

Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. Familiar with ETL and have hands-on experience with data pipelines and data orchestration tools

Expertise with GCP, including services like Google Cloud Storage, Big Query, Pub / Sub, and Dataflow

Problem solving, root cause analysis, and issue resolution

Demonstrated leadership skills

Experience in Healthcare or Health Insurance Industry

Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by our client's enterprise

Preferred :

Master’s degree in Information Technology, Computer Science or closely related field

5 years of experience as a developer with demonstrated skills in : Databricks, Python / PySpark, GCP : Big Query and PostgreSQL

Certifications such as Python, Databricks, GCP

Physical Demands

Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state and local standards

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard and monitor

LI-AL1

Reasonable Accommodation Statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.

Equal Employment Opportunity Policy Statement

It is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.