What are the responsibilities and job description for the Big Data Engineer position at JobRialto?
Job description-
- A Bachelor's or master's degree in computer science, Engineering, or a related field is required.
- 8 to 10 years of professional development experience in cloud-based distributed systems.
- Hands-on experience with AWS services (such as S3, EMR, EC2, Glue, DynamoDB, RDS) or other cloud platforms.
- Proficiency in programming languages such as Python, Scala, or Java.
- Desired experience with Big Data tools, including Spark / PySpark, Hadoop, Hive, and NoSQL / SQL, as well as scripting languages.
- Experience with Snowflake or any relational database management system (RDBMS), including hands-on skills in writing complex queries.
- Practical experience in workflow orchestration tools like Airflow or Oozie.
- Proficiency in enterprise security, agile methodologies, and change management standards.
- Good understanding of distributed software applications, including system integration, testing, and troubleshooting.
- Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery.
- Systems integration experience is essential.
- Ability to work with version control systems, such as GIT, including tasks like branching and merging.
Education : Bachelors Degree
