What are the responsibilities and job description for the Data Curation Engineer position at Crexi?
Job Summary
The Data Curation Engineer helps manage and curate data resources within our organization. This role will also support labeling programs and assist data scientists in integrating data cleaning steps into the data management workflow.
What You'll do:
- Work with the data curation lead and data science team to create labeling experiments in LabelStudio on a variety of different datasets, including image, web, text, and pdf modalities.
- Creates and maintains datasets that are used in these labeling experiments.
- Builds and optimizes 'big data' data pipelines, architectures and data sets using AWS cloud services and SnowFlake.
- Works with data engineers and the data science team on engineering systems/designs/architecture
- Builds processes supporting data transformation, data structures, metadata, dependency and workload management using DBT and Airflow or similar tools.
- Creates a strong test suite, alerting, monitoring and documentation for all the pipelines.
Who You Are:
- Self-starter who independently owns their own success metrics.
- Exceptional communication skills and an ability to provide clear and concise insights to the data science and product teams.
- Responsive, action-oriented, and innovative problem solver.
- Strong and efficient teamwork and cross-department collaboration.
- Excellent organizational and prioritization skills and an ability to demonstrate and handle multiple tasks accurately and efficiently.
- Able to digest complex problems and review related information in order to develop and evaluate options and implement the best solution.
Preferred Education & Experience
- 3 years proven experience in data management, data curation, or a related role.
- BS degree in Computer Science or relevant work experience
- Experience building machine learning labeling systems
- Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of SQL/NoSQL databases and data stores like MSSQL, Dynamodb.
- Proficient in Python
- Experience with Data Engineering best practices including Test Automation, Quality Controls, Reconciliation, Documenting data flows, etc.
- Have thorough knowledge of data structures and algorithms
- Have experience working with customers to understand and capture requirements
- Experience with data stores like Snowflake, Postgres, Feast
- Experience with LabelStudio
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores using Hadoop, Spark, Kafka, etc.
- Experience labeling video or speech content
- Experience with cloud service providers, including AWS, Azure, or Google
- Knowledge of data service and deployment frameworks, including Docker, and Kubernetes
- Experience with data compliance and governance tools like OneTrust or DataGrail
- Experience with the Kafka
Why Crexi?
- Rapidly growing startup with a dynamic work environment
- Flexible team structure with the ability to progress in career
- Health, Dental, and Vision insurance
- Collaborative culture and numerous team activities
The anticipated salary range for candidates who will work in our Playa Vista, California location is $101,000to $136,000. The final salary offered to a successful candidate will depend on several factors, which may include, but are not limited to, the type and length of experience applicable to the role and within the industry, education, geographic location, etc. Commercial Real Estate Exchange, Inc (“Crexi”) is a multi-state employer, and this salary range may not reflect positions that work in other states.
Salary : $101,000 - $136,000
