What are the responsibilities and job description for the Big Data Engineer / Hadoop Developer position at Motion Recruitment?
Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer / Hadoop Developer in Iselin, NJ (Hybrid).
Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.
Contract Duration: 10 Months
Required Skills & Experience
Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.
Contract Duration: 10 Months
Required Skills & Experience
- 5 years of application development and implementation experience using Spark, Hadoop, Hive, Python/Scala.
- Strong Experience in T-SQL Development such as complex stored procedures, data load, views.
- Design and develop ETL to move data from various sources preferably from Flat files, JSON, Oracle and experience with FTP, NDM.
- Experience in writing AUTOSYS JIL (Job Information Language) Commands.
- Deployment of Database components from lower environment to UAT/Production environment.
- Strong analytical and problem-solving abilities.
- 3 years of experience with Agile tools.
- 3 years of experience designing and implementing process solutions for automation.
- 3 years of build-deploy automation and configuration experience.
- 3 years of Advanced SQL & Data Development experience.
- 1 year of experience with DevOps environments.
- An industry-standard technology certification.
- Strong verbal, written, and interpersonal communication skills.
- A BS/BA degree or higher in Information technology/Computer Science/ Mathematics.
- Finance industry experience is highly preferred.
- Supporting trade and market surveillance team.
- Will do root cause analysis on production job failures, will run queries, find issues, and fix the issues.
- Needs to have “Advanced SQL," meaning that they are a true expert in SQL queries and can find the gaps.
- Will be doing all development related tasks that they will be assigned.
- Will join daily scrum calls.
- Part of a team of 30 .
- Looking to improve upon the current members in this position who rely on others to write the queries for them.
- Hadoop is where the data is stored, Hive is used to query it, and Spark is the language used for programming.