What are the responsibilities and job description for the Data Engineer (Developer IV) position at TALENT Software Services?
THE IMPACT YOU WILL MAKE
The Sr. Data Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:
Minimum Required Experiences:
The Sr. Data Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:
- Identify customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
- Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
- Support the integration of data into readily available formats while maintaining existing structures and govern their use according to business requirements.
- Analyze new data sources and monitor the performance, scalability, and security of data.
- Create an initial analysis and deliver the user interface (UI) to the customer to enable further analysis.
Minimum Required Experiences:
- 2 years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)
- 2 years of Python, SQL, SparkSQL, PySpark
- Excellent problem-solving skills and strong verbal & written communication skills
- Ability to work independently as well as part of an agile team (Scrum / Kanban)
- Bachelor degree or equivalent
- 4 years experience with Big Data Hadoop clusters, AWS, and Python
- Knowledge of Spark streaming technologies
- Experience in working with agile development teams
- Familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)
- Knowledge of Environmental, Social, and Corporate Governance (ESG)
- Skilled in cloud technologies and cloud computing
- Programming including coding, debugging, and using relevant programming languages
- Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
- Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
- Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
- Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
- Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
- Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
- Skilled in AWS Analytics such as Athena, EMR, or Glue
- Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
- Skilled in SQL
- Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
- Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
- Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
- Skilled in Python object-oriented programming
