What are the responsibilities and job description for the Hadoop Developer position at Dexian?
Job Summary:
Dexian is seeking a Hadoop Developer for an opportunity with a client located in Kennesaw, GA.
Responsibilities:
- Utilize multiple architectural components in design and development of client requirements
- Maintain, improve, clean and manipulate data for the operational and/or analytics data systems
- Constantly looking for better ways of solving technical problems and designing the solution without being afraid of challenging the status quo
- Document and communicate required information for deployment, maintenance, support, and business functionality
- Adhere to team delivery/release process and cadence pertaining to code deployment and release
They must have a proven ability to drive business results with their data-based insights
The right candidate will have a passion for discovering solutions hidden in large data sets and working with stakeholders to improve business outcomes - Design, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and Python
- Collaborate with data engineers and data scientists to understand data requirements and translate them into technical specifications
- Develop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources into the Cloudera platform
- Optimize and tune data processing jobs to ensure high performance and scalability
- Implement data governance and security policies to ensure data integrity and compliance
- Monitor and troubleshoot data processing jobs to identify and resolve issues in a timely manner
- Perform unit testing and debugging of data solutions to ensure high quality and reliability
- Document technical specifications, data flows, and data architecture diagrams
- Stay updated with the latest advancements and best practices in Cloudera technologies and big data analytics
Requirements:
- Experience with Agile Methodologies
- Add experience with Python scripting for data engineering to qualifications
- Ability to pick new products quickly to understand their data
- Strong problem solving skills with an emphasis on product development
- Experience working with and creating data architectures
- Excellent written and verbal communication skills for coordinating across teams
- A drive to learn and master new technologies and techniques
- Experience working with AutoSys
- 5-7 years of experience with distributed data/computing tools: Hadoop, Hive, MySQL, etc
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
