What are the responsibilities and job description for the Big Data Engineer position at Chelsoft Solutions Co?
Experian
Big Data Engineer
12 month contract
Remote
Job description
A Bachelors or masters degree in computer science Engineering or a related field is required.
8 to 10 years of professional development experience in cloudbased distributed systems.
Handson experience with AWS services (such as S3 EMR EC2 Glue DynamoDB RDS) or other cloud platforms.
Proficiency in programming languages such as Python Scala or Java.
Desired experience with Big Data tools including Spark / PySpark Hadoop Hive and NoSQL / SQL as well as scripting languages.
Experience with Snowflake or any relational database management system (RDBMS) including handson skills in writing complex queries.
Practical experience in workflow orchestration tools like Airflow or Oozie.
Proficiency in enterprise security agile methodologies and change management standards.
Good understanding of distributed software applications including system integration testing and troubleshooting.
Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery.
Systems integration experience is essential.
Ability to work with version control systems such as GIT including tasks like branching and merging.
Required Skills : Job description A Bachelors or masters degree in computer science Engineering or a related field is required. 8 to 10 years of professional development experience in cloudbased distributed systems. Handson experience with AWS services (such as S3 EMR EC2 Glue DynamoDB RDS) or other cloud platforms. Proficiency in programming languages such as Python Scala or Java. Desired experience with Big Data tools including Spark / PySpark Hadoop Hive and NoSQL / SQL as well as scripting languages. Experience with Snowflake or any relational database management system (RDBMS) including handson skills in writing complex queries. Practical experience in workflow orchestration tools like Airflow or Oozie. Proficiency in enterprise security agile methodologies and change management standards. Good understanding of distributed software applications including system integration testing and troubleshooting. Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery. Systems integration experience is essential. Ability to work with version control systems such as GIT including tasks like branching and merging.
