What are the responsibilities and job description for the Big Data Developer position at KNS IT GROUP?
Requirements
- Bachelor's degree in computer science engineering or a related discipline, or equivalent work experience required, software development, experience in the securities or financial services industry is a plus, should have thorough knowledge of the software development cycle. and employee forums.
- Minimum of 5 years of experience in Python development.
- Minium of 5 years of Apache Spark and its components (Spark SQL, Streaming, MLlib, GraphX) using PySpark.
- 2-3 years of previous Hadoop Big Data (does not have to be recent).
- 2 years of experience with Kafka and/or Impala.
- Experience with GitLab for CI/CD pipelines/deployment.
- Understanding of Microservice Architecture.
- Demonstrated ability to write efficient, complex queries against large data sets.
- Knowledge of data warehousing principles and data modeling concepts.
- Proficient understanding of distributed computing principles.
- Lead Developer provides application software development services or technical support in situations of moderate complexity.
- May also be responsible for requirements gathering and BRD/SRD preparation.
- Has thorough knowledge of the Software Development Life Cycle. Conducts reviews of the test Plan and test Data.
- Designs and codes programs, and creates test transactions and runs tests to find errors and revise programs.
- Prepares the final and detailed versions of system modification requirements, ensures turnovers are done on time and correctly.
- Interfaces with architects to design, code, and test and implement application programs.
- Conducts analysis of organizational needs and goals for the development and implementation of application systems.
- Proposes innovative, creative technology solutions.
- Contributes to the achievement of related teams' objectives.
- Candidate must be proficient on Spark and Python language.
