What are the responsibilities and job description for the Hadoop Developer--Jersey City, NJ/ Chicago, IL position at Pro Integrate?
Job Description
Job Description
Hadoop Developer
Location : Jersey City, NJ / Chicago, IL ( 3 days onsite 2 days remote)
W2 candidates preferred
Years of Experience required : 5 Years
Required (hard) skills / experience
Primary Skill-Hadoop
Secondary Skill- Informatica Powercenter
Tertiary Skill-Cloud Architect
Job Description :
Looking for a Senior Data Engineer / Architect with 5 years experience. This job is responsible for leading data engineering efforts to deliver enterprise-wide capabilities and complex data solutions.
Key responsibilities include directing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems and working with the Project Management team to define outcomes and inform work structures.
Job expectations may include managing teammates and providing technical thought leadership by implementing complex data solutions and interactions across multiple systems and domains.
Assemble large, complex data sets that meet functional and non-functional requirements, ensuring that the design and engineering approach is consistent across multiple systems.
Maintain, improve, clean, and manipulate large data for operational and analytics data systems, build complex processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, and communicate required information for deployment, maintenance and support of business functionality.
Utilize multiple architectural components in the design and development of client requirements and collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement.
Define and build data pipelines to enable data-informed decision making, ensuring adherence to release processes and risk management routines.
Contribute to existing test suites including integration, regression, and performance, analyze test reports, identify any test issues and errors and lead triage of underlying causes.
Lead the identification of gaps in data management standards adherence and work with appropriate partners to develop plans to close gaps, leading concept testing and conducting research to prototype toolsets and improve existing processes.
Mentor Data Engineers in the delivery and release of continuous integration and continuous delivery events and define key performance indicators and internal controls.
- A deep understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) is crucial. Data engineers must choose the right database systems for specific use cases and design efficient data schemas
Thank You, Pratiksha Bhatt Talent Acquisition Specialist Pro Integrate LLC ISO 9001 and ISO 27001 Certified Company Phone : 1 646-349-6335 | Email : pratiksha@prointegrate.net HQ : 347 5th Ave, Suite 1402-344 New York, NY USA 10016
