What are the responsibilities and job description for the Scalable Data Solutions Developer position at Elicit?
Job Description:
Elicit is seeking an experienced Data Engineer to join our team. The successful candidate will have 5 years of experience as a data engineer building core datasets and supporting business verticals with high data volumes.
- Strong proficiency in Python (5 years experience)
- Experience with architecting and optimizing large data pipelines with Spark
- Strong SQL skills, including understanding of aggregation functions, window functions, UDFs, self-joins, partitioning, and clustering approaches
- Experience with Parquet file formats and other columnar data storage formats
The ideal candidate will be able to balance technical expertise with creative problem-solving and have a strong passion for working with data infrastructure.
