Role:- Big Data with Iceberg

Location:- Jersey City, NJ

Type:- Full time

Job Description

The duties will include:

1. Developing an overall architecture and design for an Apache Iceberg solution

2. Developing tech specs for all aspects of the solution

3. Deploying Apache Iceberg on top of S3 storage layer

4. Developing a data pipeline to load the data into Iceberg filesystem from an Oracle db

5. Implementing a semantic layer (StarBurst) on top of Iceberg

6. Connecting semantic layer to Tableau for reporting

7. Developing a UT and SIT approach

8. Investigating various data cataloging options available for Iceberg.

The skills required:

1. Big Data implementation experience (any platform)

2. Apache Iceberg implementation experience

3. Big Data data modeling (HIVE, Iceberg)

4. Developing data pipeline for Big Data platforms

5. Semantic layer implementation (DeNodo, Trino, Starburst)

6. Snowflake skills a plus

7. Enterprise architecture