Cloud Data Engineer (AWS) - Hybrid

Title: Cloud Data Engineer (AWS) - Onsite

Mandatory skills:

AWS, Databricks, dynamoDB, Lambda, Redshift, elastic search,
API, Streaming technology, Kinesis, Glue, AI tools, ML tools,
Python, PySpark, Apache Spark, Kafka, Spark,
Data Integration, Streaming, Batch, Error and Replay,
GitHub, Jenkins, Terraform, Teradata, RDBMS, ETL, AWS glue, Databricks,
Software development, Gitlab, Teradata Vantage, agile, scripting,
data analysis, data pipelines, data ingestion, data transformation, data lake,
AWS, S3, Lamda, SNS, SQS, RDS,
performance issues, data skew issues, source code control systems, technical solution, object oriented design,
NoSQL, SQL, relational database, non-relational databases, query optimization, data modelling,
technical architecture, modular, cloud centric, API, streaming driven architecture,
data steams, Cloud, CI, CD, continuous validation, automation tools

Description:

We are looking for a cloud data engineer with AWS expertise and data knowledge. We need hands on data engineer who can deliver the work as required and collaborate with the team

Skillset:
AWS - s3, lamda, SNS, SQS, RDS and other services
RDBMS - Teradata or any DB
Good SQL knowledge
Python and scripting
API exposure

Behaviors:
Drive automation pyramid and integrate with CI/CD tools for continuous validation.
Understands when to automate and when not to.
Drive mentality of building well architected applications for Cloud
Drive the mentality of quality being owned by the entire team.
Can identify code defects and work with other developers to address quality issues in product code.
Passion for finding bottlenecks and thresholds in existing code through the use of automation tools.
Passion for continuing education and improving code quality.

Responsibilities:
Develop technical architecture to achieve more modular, cloud centric, API and streaming driven architecture for agile delivery.
Migrating On-Premise solution to cloud including Teradata Vantage
Develop data pipelines to integrate with enterprise data steams Cloud and on-perm
Collaborate on architecture decisions and develop solutions in AWS Including Python, Databricks, Redshift, elastic search, DynamoDB, Lambda, Kinesis, Glue and AI/ML tools.

Requirements and Skill sets needed:
Bachelor s degree required
Experience with AWS capabilities Databricks, DynamoDB, Lambda, Redshift, elastic search.
Experience with API and Streaming technologies.
Software development experience with Python, PySpark, Apache Spark and Kafka
Strong knowledge of Data Integration (e.g. Streaming, Batch, Error and Replay) and data analysis techniques.
Experience with GitHub, Jenkins, and Terraform.
Experience with Teradata (Vantage) or any RDBMS system/ ETL Tools
Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.
Excellent in trouble shooting the performance and data skew issues.
Deep knowledge in partitioning, bucketing concepts of data ingestion.
Working knowledge on the implementation of data lake ETL using AWS glue, Databricks etc.
Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.
Experience with source code control systems like Gitlab.
Experience with large scale distributed relational and NoSQL database systems.
Expertise in designing technical solutions using object-oriented design concepts

Notes:

onsite/hybrid
3 days onsite a week

VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.

Contact Details :

VIVA USA INC.
3601 Algonquin Road, Suite 425
Rolling Meadows, IL 60008