What are the responsibilities and job description for the Data Engineer position at Techruiter?
If data is what excites you, this is the role for you! Process over 350gb an hour, almost half a million incoming events a second and maintain petabytes of storage.
This role will see you join the global leader in location-based data, analytics and advertising. This award winning client helps some of the biggest and best known global brands understand and reach their future customers, driving real business outcomes.
My client is a truly global company, with over 20 offices across 5 continents. The team is currently around 200, spread across all locations. This opportunity will enable you to understand and impact every aspect of their product. Headquartered in London, with a Tech Hub in Edinburgh, they are VC backed, financially successful, and undergoing continued growth.
What tech are they using: Spark, Flink, Kafka, ScyllaDB, Redshift, Druid, BigQuery, and Postgres.. But like any good engineering team, they are always looking for better ways to do things.
Join a team that is passionate about what they do, supporting each other and improving as a team. They are growing their engineering team and are excited about the challenges that lay ahead as they look to reach the next 10x scale and intelligence.
You:
5 years commercial Engineering experience
Expert in Python or Scala
Use of Spark, Hadoop or Kafka
Orchestration frameworks, like Luigi, Airflow, or Oozie
A full understanding of data analytics and ingestion engineering
Hands-on implementation and architectural familiarity with streaming, relational, and non-relational databases and systems
AWS, GCP
Excellent working understanding of server-side Linux
Degree in Computer Science, Software Engineering, or similar
Bonus:
Familiarity with Cassandra, ScyllaDB, HBase, or similar datastores
PostgreSQL, BigQuery, RedShift
Benefits:
An extra bank-holiday
Free eye tests
Childcare vouchers
Cycle scheme
Day off on your birthday!
Competitive packages
Early finish Friday - because you deserve it
Pensions - saving for the future?
Some office-centric perks are being re-evaluated in light of our shift to remote working
\n