What are the responsibilities and job description for the AWS Data Engineer position at ITBMS Inc.?
Job Details
BS/BA degree or equivalent experience
General: Strong organizational, problem-solving, and critical thinking skills; Strong documentation skills
Coding: Proficiency in Python & Java
Cluster Computing frameworks: Proficiency in Spark and Spark SQL
AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda Step Functions Event Bridge
Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, JSON-LD
AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager
Good to Have:
Linux Scripting, Jenkins
DevOps: Git, CI/CD, JIRA, TDD