What are the responsibilities and job description for the Senior Data Engineer position at VySystems?

Hi #connections,

We do have a Job Opening for,

Role-Senior Data engineer with Java, Spark & Cloudera

Locations : Austin, TX and Sunnyvale, CA (Hybrid)

Please share the suitable resumes to ram.r@vysystems.com &

Job Description :

We are seeking a Senior Java Spark Developer with expertise in Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ideal candidate will have strong hands-on experience in Java-based Spark development, distributed computing, and performance optimization for handling big data workloads.

Key Responsibilities :

Java & Spark Development :

Develop, test, and deploy Java-based Apache Spark applications for large-scale data processing.
Optimize and fine-tune Spark jobs for performance, scalability, and reliability.
Implement Java-based microservices and APIs for data integration.

Big Data & Cloudera Ecosystem :

Work with Cloudera Hadoop components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.

Design and implement high-performance data storage and retrieval solutions.

Troubleshoot and resolve performance bottlenecks in Spark and Cloudera platforms.

Collaboration & Data Engineering :

Collaborate with data scientists, business analysts, and developers to understand data requirements.

Implement data integrity, accuracy, and security best practices across all data processing tasks.

Work with Kafka, Flume, Oozie, and Nifi for real-time and batch data ingestion.

Software Development & Deployment :

Implement version control (Git) and CI / CD pipelines (Jenkins, GitLab) for Spark applications.

Deploy and maintain Spark applications in cloud or on-premises Cloudera environments.

Required Skills & Experience :

Application development, with a strong background in Java and Big Data processing.

Strong hands-on experience in Java, Apache Spark, and Spark SQL for distributed data processing.

Proficiency in Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.

Experience building and optimizing ETL pipelines for large-scale data workloads.

Hands-on experience with SQL & NoSQL databases like HBase, Hive, and PostgreSQL.

Strong knowledge of data warehousing concepts, dimensional modeling, and data lakes.

Proven ability to troubleshoot and optimize Spark applications for high performance.

Familiarity with version control tools (Git, Bitbucket) and CI / CD pipelines (Jenkins, GitLab).

Exposure to real-time data streaming technologies like Kafka, Flume, Oozie, and Nifi.

Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.

Please attach the Updated Resume :

Please share the suitable resumes to ram.r@vysystems.com &

Kindly fill details,

1. Years of Exp

2. Visa Status

3. Current Location

4. Linkedin ID

5. Share Updated Resume

Thanks & Regards.,

Ramkumar.R || Sr.Technical Recruiter

Email : ram.r@vysystems.com

Linkedin ID :

4701 Patrick Henry Drive Building 16 Santa Clara CA 95054, USA.

Apply for this job

Receive alerts for other Senior Data Engineer job openings

Job openings at VySystems

Data Analyst with A/B testing, SQL, Tableau

VySystems

Mountain View, CA Contractor

Must have : Primarily are A/B testing, SQL, Tableau , and Excel. Working knowledge in Python or Amplitude Qualifications...

Java Architect

VySystems

Princeton, NJ Contractor

Hi #Connections, We do have a Job Opening for Java Architect Role-----Java Architect Locations-----Princeton, NJ (Day 1 ...

Pega Developer

VySystems

Plano, TX Contractor

Required Skills: We are looking for core developers with only 8-10 yrs of exp • Strong experience in Pega development, d...

Senior Frontend Developer

VySystems

Plano, TX Full Time

Minimum Experience 7 years of Genuine USA Work Experience Job Description : Experience developing modular SPA using Micr...

Not the job you're looking for? Here are some other Senior Data Engineer jobs in the Austin, TX area that may be a better fit.

Senior System Engineer

Luna Data Solutions, Inc., Austin, TX

Senior Data Architect

Luna Data Solutions, Inc., Austin, TX

Senior Data Engineer

What are the responsibilities and job description for the Senior Data Engineer position at VySystems?

What is the career path for a Senior Data Engineer?

Job openings at VySystems

Not the job you're looking for? Here are some other Senior Data Engineer jobs in the Austin, TX area that may be a better fit.

We don't have any other Senior Data Engineer jobs in the Austin, TX area right now.

AI Assistant is available now!