What are the responsibilities and job description for the Data Engineer position at SysMind Tech?

Requirement :

Big Data - Engineer ( Hive , Spark, SQL, Pyspark, UNIX)
Software development experience and leading teams of engineers and scrum teams
3 years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
Hands-on experience on writing and understanding complex SQL(Hive / PySpark-dataframes), optimizing joins while processing huge amount of data
Experience in UNIX shell scripting

Additional Good to have requirements :

Solid Data warehousing concepts

Knowledge of Financial reporting ecosystem will be a plus

Experience with Data Visualization tools like Tableau, Sisense, Looker

Expert on Distributed ecosystem

Hands-on experience with programming using Python / Scala

Expert on Hadoop and Spark Architecture and its working principle

Ability to design and develop optimized Data pipelines for batch and real time data processing

Should have experience in analysis, design, development, testing, and implementation of system applications

Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows

Aptitude for learning and applying programming concepts.

Ability to effectively communicate with internal and external business partners. Preferred Qualifications :

Knowledge of cloud platforms like GCP / AWS, building Microservices and scalable solutions, will be preferred

2 years of experience in designing and building solutions using Kafka streams or queues

Experience with GitHub and leveraging CI / CD pipelines

Experience with NoSQL i.e., HBase, Couchbase, MongoDB

Apply for this job

Receive alerts for other Data Engineer job openings

Job openings at SysMind Tech

SysMind Tech

Clinton, NJ Full Time

About the Role: SysMind Tech is seeking an Enterprise Imaging Solutions Expert to join our team. As an Enterprise Imagin...

SysMind Tech

Philadelphia, PA Full Time

Must have skills : Exadata Admin, Core DBA, OCI, DB Storage, DB Backup Nice to have skills : Basic knowledge of Linux sy...

SysMind Tech

TX Full Time

Job Title ServiceNow Incident Management Developer Relevant Experience in Yrs) 8 to 10 years Technical / Functional Skil...

SysMind Tech

Phoenix, AZ Full Time

Job Title : Audio Visual Architect Location : NYC, PHX, Sunrise FL, or Sandy UT Job Type : Full Time Employment Roles & ...

Not the job you're looking for? Here are some other Data Engineer jobs in the Phoenix, AZ area that may be a better fit.

Data Engineer