What are the responsibilities and job description for the BigData Engineer with Spark, Python, Scala and Java position at Jobsbridge?
Company Description
Hello,
Greetings from Jobsbridge!
Jobsbridge, Inc. is a fast growing Silicon Valley based I.T staffing and professional services company specializing in Web, Cloud & Mobility staffing solutions.
Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all.
Job Description
1-2 years of SPARK Streaming experience with Scala, Python and Java in real time production exp. • Total IT around 6yrs to 8yrs is good enough. We don’t need Architects, just need smart coders • Develop and maintain our Big Data pipeline that transfers and processes several terabytes of data using Apache Spark, Python, Apache Kafka, Hive & Impala. • Design and build reports and dashboards using Tableau or other reporting tools • Perform adhoc data analysis, data processing, data visualization using SQL and other scripts • Work directly with product stake holders at the company to help them solve their most difficult problems. • Excellent Programming skills using Python, Scala, Perl, Shell, etc. • Familiarity with SQL and NoSQL technologies. • Experience with Production Hadoop ecosystem. • Proficiency with relational databases and SQL. • Experience with Tableau or other reporting tools. • Well versed in software development principles and processes, including: analysis, design, and continuous delivery. • Good communication skills that can deal with diverse types of people from Data Science, Marketing, Finance, Product Management and QA groups.
Qualifications
Apache Spark, Python, Apache Kafka, Hive & Impala, Scala, Python and Java
Additional Information
Only GC/Citizen,OPT,EAD,H4
