What are the responsibilities and job description for the Java developer with Apache spark position at NimbusAITech LLC?
Job Details
Job Title: Java Developer with Strong Spark Experience
Location: Richmond, Virginia (Hybrid)
Job Type: [Contract-W2]
Job Description:
We are seeking a skilled Java Developer with Apache Spark experience to design, develop, and optimize large-scale data processing applications. The ideal candidate should have a strong background in Java, distributed computing, and big data technologies to work on high-performance, scalable solutions.
Key Responsibilities:
- Develop and maintain Java-based big data applications using Apache Spark.
- Design and optimize ETL pipelines for data ingestion, transformation, and processing.
- Implement distributed computing solutions to handle large datasets efficiently.
- Work with Hadoop, Hive, and other big data frameworks to integrate and manage data.
- Optimize Spark jobs for performance tuning and cost efficiency.
- Collaborate with data engineers, analysts, and business teams to deliver scalable solutions.
- Ensure code quality, security, and best practices in software development.
Required Skills & Qualifications:
- 5 years of Java development experience.
- 5 years of hands-on experience with Apache Spark (RDDs, DataFrames, Datasets).
- Strong understanding of Hadoop ecosystem (HDFS, Hive, YARN, etc.).
- Experience with SQL, NoSQL databases, and distributed computing.
- Familiarity with Kafka, Scala, or Python is a plus.
- Knowledge of cloud platforms (AWS, Google Cloud Platform, Azure) is an advantage.
- Excellent problem-solving and communication skills.
If you're passionate about big data processing and distributed systems, we encourage you to apply!