What are the responsibilities and job description for the Data Engineer With GCP position at The Dignify Solutions, LLC?
- Experience with Big Data Technologies (Hadoop, Spark, RedShift, Big Query, Apache Stack)
- Experience with Google cloud platforms GCP is mandatory
- Understanding of the software development life cycle and associated tools such as Bamboo, JIRA and Git.
- Basic understanding of NoSQL technologies (Splunk, ELK, AWS DynamoDB).
- Streaming/Real-Time data technologies (AWS Kinesis, Kafka, Flume)
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies