What are the responsibilities and job description for the Java Technical Lead position at Incedo Inc?
Job Details
Position: Java Technical Lead (PySpark Experience)
Location: Dallas, TX/ Pittsburgh, PA
Full Time
Position Overview:
We are looking for a highly skilled Java Lead Developer with PySpark experience to join our team. The ideal candidate will have a strong background in Java development, expertise in big data processing using PySpark, and experience in leading teams and designing scalable solutions. This role involves working on data-intensive applications, cloud-based architectures, and real-time processing pipelines.
Key Responsibilities:
- Lead the design, development, and deployment of scalable Java applications with big data processing capabilities.
- Develop high-performance data pipelines using PySpark on distributed computing environments.
- Optimize, maintain, and enhance big data solutions for large-scale processing.
- Implement best practices for software development, code reviews, and DevOps automation.
- Collaborate with cross-functional teams including data engineers, cloud architects, and DevOps teams.
- Ensure high availability, reliability, and security of applications and data pipelines.
- Work with cloud platforms (AWS, Azure, or Google Cloud Platform) and utilize services like EMR, Glue, Databricks, or BigQuery.
- Lead and mentor junior developers, providing guidance on coding standards and architecture best practices.
Required Skills & Qualifications:
- 10 years of experience in Java development with a strong understanding of Spring Boot, Microservices, and REST APIs.
- 2 years of experience with PySpark for data engineering and distributed computing.
- Hands-on experience with big data technologies such as Hadoop, Spark, Hive, or Kafka.
- Strong understanding of data structures, algorithms, and system design principles.
- Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and DevOps best practices.
- Proficiency in working with relational (MySQL, PostgreSQL) and NoSQL databases (Cassandra, MongoDB).
- Cloud experience with AWS (EMR, Glue, S3, Lambda), Azure, or Google Cloud Platform.
- Strong problem-solving and debugging skills.
- Excellent communication skills and the ability to work in agile development environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
