What are the responsibilities and job description for the Data Engineering Lead position at NTT DATA?
About NTT DATA
We are a $30 billion trusted global innovator of business and technology services, serving 75% of the Fortune Global 100. Our mission is to help clients innovate, optimize, and transform for long-term success.
The Job
We are currently seeking a Sr. Data Engineer - Big Data/Hadoop/Scala to join our team in Tampa, Florida (US-FL), United States (US). This is a hybrid position so would require 2-3 days on site in Tampa, FL and remotely from home office for the remainder.
Responsibilities:
- Design and Develop methods to connect & collect data from different data sources
- Analyze and understand data sources & APIs
- Design and Develop methods to filter/cleanse the data
- Design and Develop SQL, Hive queries, APIs to extract data from the store
- Work closely with Data Scientists to ensure the source data is aggregated and cleansed
- Work with Product Managers to understand the business objectives
- Work with cloud and data architects to define robust architecture in cloud setup pipelines and workflows
- Work with DevOps to build automated data pipelines
Qualifications:
- 5 years of programming experience on data platforms
- Hands-on design and development of big data platform
- Data processing technology stacks: Spark, HBase, Hive and other Hadoop ecosystem technologies and development using Scala or Java
- Streaming data architectures and technologies for real-time and low-latency data processing
- Agile development methods including core values, guiding principles, and key agile practices
- Application of Continuous Integration/Delivery
- Relational databases; SQL and PLSQL
Nice to Have:
- NoSQL technologies including column family, graph, document, and key-value data storage technologies
- Financial Industry Education
