What are the responsibilities and job description for the Sr Data Engineer position at NTT DATA?
Job Summary
We are seeking a Sr. Data Engineer - Big Data/Hadoop/Scala to join our team in Tampa, Florida. This is a hybrid position requiring 2-3 days on-site in Tampa and remote work from home. The ideal candidate will have 5 years of experience with data platforms, big data platform design and development, and expertise in Spark, HBase, Hive, and other Hadoop ecosystem technologies.
Responsibilities
- Design and develop methods to connect and collect data from various sources
- Analyze and understand data sources and APIs
- Design and develop methods to filter and cleanse the data
- Develop SQL, Hive queries, and APIs to extract data from stores
- Work with Data Scientists to ensure source data is aggregated and cleansed
- Collaborate with Product Managers to understand business objectives
- Work with Cloud and Data Architects to define robust cloud architecture and workflows
- Partner with DevOps to build automated data pipelines
Requirements
- 5 years of programming experience on data platforms
- Data Engineering experience
- Hands-on design and development of big data platforms
- Expertise in Spark, HBase, Hive, and other Hadoop ecosystem technologies
- Experience with streaming data architectures and technologies for real-time and low-latency data processing
- Awareness of Agile development methods and Continuous Integration/Delivery
- Understanding of relational databases and SQL/PLSQL
Nice to Have
- NoSQL technologies including column family, graph, document, and key-value data storage technologies
About NTT DATA
NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.
