Supplier Notes:

# 300291-1:Databricks-Advanced

Plano, TX - 3days onsite

12 months contract

Application on mainframes system - written in JAVA - use DB2 database - Modernize on AWS - using data bricks.

Total team - 2 teams in Plano, TX 15 people

2 teams in India 6-7 each

3-4 product analyst

1 agility lead

Must

Mainframe

Hands on coding exp

Expert in data bricks

Python - Apache spark framework

AWS

JAVA - Nice to have.

CI/CD tools

Plus

Financial/ Banking exp preferred.

Background of data engineering - Preferred

2 rounds of interview

1st int will be technical.

2nd int will cover data bricks in detailed.

Both Panel

Will consider Azure data bricks but will go with AWS data bricks if found.

Request ID:

# 300291-1:Databricks-Advanced

Contractor Work Location:

Plano, TX (Only)

Duration:

12-month Contract.

Quantity:

1

Interview style:

2 rounds

Interview days/Times:

Tuesday Friday

Afternoons work best

*Mondays are not good

RTTO Schedule:

Monday/Tuesday/Thursday

Roles and Responsibilities:

Technologies:

Databricks

Apache Spark

Python(and/or Scala)

AWS

SQL

Java

CI/CD Pipeline tools

Minimum Industry experience: 10 years

Job Description:

Bachelor s degree or equivalent work experience

Must have experience implementing at least 2 end to end projects with Databricks which includes components like

- Delta lake

- Unity Catalog

- Databricks Connect

- DataBricks API

- Databricks workflow Orchestration

Must be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environments

Must have good understanding to create complex data pipelines and use of data ingestion tools like nifi

Must be well versed in using Apache Spark framework and strong in SQL and spark-sql

Must have excellent coding skills in Python(and/or Scala), preferably Python

Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing

Must have worked on AWS and should have working experience of AWS services like S3, Lambda,