What are the responsibilities and job description for the Data Engineer Lead position at HireRightAway.AI?
Job Description
About us
We are a team of skilled coders, creators, and problem solvers who work to solve complex issues our clients face. Our diverse skills and perspectives enable us to transform the way data, systems, and ingenuity are used to help our clients advance in a constantly evolving world.
Our team thrives on the unknown and enjoys tackling our clients' challenges. We cater to various industries and business goals, offering technical expertise, analytical prowess, and creative thinking to help our clients achieve their goals. Our motivation is enabling our clients to use technology, management, and insight to turn their ideas into actionable results.
Job Description
As a Data Engineer, your role is to enable clients to build and maintain advanced data systems that bring together data from disparate sources to enable decision-makers. You will be responsible for building pipelines and preparing data for use by data scientists, data analysts, and other data systems. Working as part of a collaborative environment, you will have many opportunities to learn from and share knowledge with other developers, architects, and clients.
Specific Responsibilities For The Data Engineer
The typical experience for successful candidates includes:
Successful candidates usually have demonstrable experience with technologies in some of these categories:
Languages: SQL, Python, R, Java or C
Database: Databricks, Snowflake, SQL Server, Postgres
DevOps: Git, Docker, Kubernetes, Jenkins
Additional Technologies: AWS Data Stack, Databricks, Spark, Kafka
Job Types: Full-time, Contract
Benefits
About us
We are a team of skilled coders, creators, and problem solvers who work to solve complex issues our clients face. Our diverse skills and perspectives enable us to transform the way data, systems, and ingenuity are used to help our clients advance in a constantly evolving world.
Our team thrives on the unknown and enjoys tackling our clients' challenges. We cater to various industries and business goals, offering technical expertise, analytical prowess, and creative thinking to help our clients achieve their goals. Our motivation is enabling our clients to use technology, management, and insight to turn their ideas into actionable results.
Job Description
As a Data Engineer, your role is to enable clients to build and maintain advanced data systems that bring together data from disparate sources to enable decision-makers. You will be responsible for building pipelines and preparing data for use by data scientists, data analysts, and other data systems. Working as part of a collaborative environment, you will have many opportunities to learn from and share knowledge with other developers, architects, and clients.
Specific Responsibilities For The Data Engineer
- Lead a team of data engineers and data analysts to achieve client objectives.
- Develop data pipelines using cloud-based tools.
- Advise clients on specific technologies and methodologies to efficiently ingest and process data quickly.
- Utilize your engineering skills to solve complex data problems using best practices.
- Collaborate with end-users, development staff, and business analysts to ensure that prospective data architecture plans maximize the value of client data across the organization.
- Articulate the architectural differences between solution methods and the advantages/disadvantages of each.
- Work with some of the hottest new technologies, identify gaps, and opportunities for improving existing client solutions.
- Interact, collaborate, and guide clients, including at the executive level.
- Recommend system architectures that offer the most modern technologies while interfacing with an existing environment.
- Engage clients in fast-paced technical discussions.
The typical experience for successful candidates includes:
- Experience delivering solutions on Data Platforms such as Databricks or Snowflake, AWS cloud native solutions such as EMR, Glue, Redshift e.g.
- Ability to think strategically and relate architectural decisions/recommendations to business needs and client culture
- Experience in the design and implementation of data architecture solutions
- A wide range of production database experience, usually including substantial SQL expertise, database administration, and scripting data pipelines
- Having the ability to deliver production data pipelines and other data products is essential.
Successful candidates usually have demonstrable experience with technologies in some of these categories:
Languages: SQL, Python, R, Java or C
Database: Databricks, Snowflake, SQL Server, Postgres
DevOps: Git, Docker, Kubernetes, Jenkins
Additional Technologies: AWS Data Stack, Databricks, Spark, Kafka
Job Types: Full-time, Contract
Benefits
- 401(k)
- 401(k) matching
- Flexible schedule
- Health insurance
- Paid time off
- Professional development assistance
- 8 hour shift
- Bonus pay
- Hybrid (2 days from Reston Office)