What are the responsibilities and job description for the Senior Data Engineer position at Inabia Software & Consulting Inc.?
Client looking for 12 Years of experience must have.
Title: Senior Data Engineer
Duration: Contract
Location: Sunnyvale, CA(Onsite)
Locals Required
Except OPT and H1T, All Work Authorization is Workable
While sharing the resume, Please do mention the candidate location and Work Authorization.
Job Description :
Looking for 12 Years of experience must have.
Coding must have, Scala and Kafka
As a Senior Data Engineer, you will
* Design and develop big data applications using the latest open source technologies.
* Desired working in offshore model and Managed outcome
* Develop logical and physical data models for big data platforms.
* Automate workflows using Apache Airflow.
* Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
* Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
* Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
* Mentor junior engineers on the team
* Lead daily standups and design reviews
* Groom and prioritize backlog using JIRA
* Act as the point of contact for your assigned business domain
Requirements:
GCP Experience
* 3 years of recent GCP experience
* Experience building data pipelines in GCP
* GCP Dataproc, GCS & BIGQuery experience
* 5 years of hands-on experience with developing data warehouse solutions and data products.
* 5 years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required
* 4 years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
* Experience with programming languages: Python, Java, Scala, etc.
* Experience with scripting languages: Perl, Shell, etc.
* Practice working with, processing, and managing large data sets (multi TB/PB scale).
* Exposure to test driven development and automated testing frameworks.
* Background in Scrum/Agile development methodologies.
* Capable of delivering on multiple competing priorities with little supervision.
* Excellent verbal and written communication skills.
* Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following:
* Gitflow
* Atlassian products – BitBucket, JIRA, Confluence etc.
* Continuous Integration tools such as Bamboo, Jenkins, or TFS
Title: Senior Data Engineer
Duration: Contract
Location: Sunnyvale, CA(Onsite)
Locals Required
Except OPT and H1T, All Work Authorization is Workable
While sharing the resume, Please do mention the candidate location and Work Authorization.
Job Description :
Looking for 12 Years of experience must have.
Coding must have, Scala and Kafka
As a Senior Data Engineer, you will
* Design and develop big data applications using the latest open source technologies.
* Desired working in offshore model and Managed outcome
* Develop logical and physical data models for big data platforms.
* Automate workflows using Apache Airflow.
* Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
* Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
* Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
* Mentor junior engineers on the team
* Lead daily standups and design reviews
* Groom and prioritize backlog using JIRA
* Act as the point of contact for your assigned business domain
Requirements:
GCP Experience
* 3 years of recent GCP experience
* Experience building data pipelines in GCP
* GCP Dataproc, GCS & BIGQuery experience
* 5 years of hands-on experience with developing data warehouse solutions and data products.
* 5 years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required
* 4 years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
* Experience with programming languages: Python, Java, Scala, etc.
* Experience with scripting languages: Perl, Shell, etc.
* Practice working with, processing, and managing large data sets (multi TB/PB scale).
* Exposure to test driven development and automated testing frameworks.
* Background in Scrum/Agile development methodologies.
* Capable of delivering on multiple competing priorities with little supervision.
* Excellent verbal and written communication skills.
* Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following:
* Gitflow
* Atlassian products – BitBucket, JIRA, Confluence etc.
* Continuous Integration tools such as Bamboo, Jenkins, or TFS
