What are the responsibilities and job description for the IT|Software Engineering - Group 2 - Lead II - Software Engineering position at E-Solutions INC?
Title: Lead II - Software Engineering
Location: Bentonville, AR
Duration: 12 months with possible extension
Description:
Client is looking for a highly energetic and collaborative Data Engineer.
Responsibilities:
As a Senior Data Engineer, you will:
- Design and develop big data applications using the latest open-source technologies.
- Desired working in offshore model and Managed outcome.
- Develop logical and physical data models for big data platforms.
- Automate workflows using Apache Airflow.
- Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
- Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
- Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
- Mentor junior engineers on the team.
- Lead daily standups and design reviews.
- Groom and prioritize backlog using JIRA.
- Act as the point of contact for your assigned business domain.
Requirements:
- Recent GCP experience.
- Experience building data pipelines in GCP.
- GCP DATAPROC, GCS & BIG Query experience.
- Hands-on experience with developing data warehouse solutions and data products.
- Hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
- Hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
- Experience with programming languages: Python, Java, Scala, etc.
- Experience with scripting languages: Perl, Shell, etc.
- Practice working with, processing, and managing large data sets (multi-TB/PB scale).
- Exposure to test driven development and automated testing frameworks.
- Background in Scrum/Agile development methodologies.
- Capable of delivering on multiple competing priorities with little supervision.
- Excellent verbal and written communication skills.
- Bachelor's degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following:
- Gitlow
- Atlassian products Bitbucket, JIRA, Confluence etc.
- Continuous Integration tools such as Bamboo, Jenkins, or TFS
