What are the responsibilities and job description for the Data Engineer position at hackajob?
hackajob has partnered with a forward-thinking tech-driven business that prioritizes innovation in its digital solutions and leverages extensive industry data to drive impactful results.
Role: AWS Data Engineer
Location: West Lake Hills, TX
Requirements:
• Bachelor’s in computer science or related field with at least 15 years of relevant experience is desired.
• Candidate should also have strong hands-on experience using the following software/tools: Strong experience with AWS cloud services: EC2, EMR, EKS, Snowflake, Elastic-Search Experience with stream-processing systems: Storm, Spark-Streaming, Kafka etc. Experience with object-oriented/object function scripting languages: Python, Java, C , Scala, etc.
• Experience with big data tools: Hadoop, Spark, Kafka, Kubernates etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with devops, data pipeline and workflow management tools: Concourse, Terraform, Luigi, Airflow, etc.
• Experience with data management tools: Collibra, Alation, BigID, Alex Solutions etc.
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Strong analytic skills related to working with unstructured datasets.
• Experience in cloud services such as AWS EMR, EC2, EKS, Jupyter notebooks
hackajob is a recruitment platform that will match you with relevant roles based on your preferences and in order to be matched with the roles you need to create an account with us.
*This role requires you to be based in the US*
