What are the responsibilities and job description for the Senior Data Engineer position at luminar?
Luminar Technologies is a global automotive technology company ushering in a new era of vehicle safety and autonomy. For the past decade, Luminar has built an advanced hardware and software/AI platform to enable its more than 50 industry partners, including the majority of global automotive OEMs. From consumer vehicle programs with Volvo Cars and Mercedes-Benz to technology partnerships including NVIDIA and Mobileye, Luminar is poised to be the first automotive technology company to enable next-generation safety and autonomous capabilities for global production vehicles.
For more information, please visit www.luminartech.com.
Team Overview
The Data Platform team builds the apps and infrastructure to leverage data from our vehicles and operations. We are building the next generation data lake and pipelines as we scale our offerings. You will develop and implement the systems that power Luminar’s data-driven improvement and growth.
Responsibilities
- Designing, building, and maintaining the infrastructure that transforms data at scale into insights:
- Ingestion of real-world vehicle data.
- Automated labeling and data enrichment.
- Process, index and curate big data into value-driving datasets.
- Generation of ground truth information.
- Analysis of data quality.
- Partnering with engineering and ML teams to define data consumption patterns and establish best practices.
- Establishing robust data integrity and systems monitoring.
Minimum Qualifications
- 4 years of relevant industry experience:
- Building backend / data services at scale.
- Hands-on Big Data software and infrastructure development skills.
- Experience with NoSQL databases and/or Relational databases.
- Accomplished in at least one backend language, preferably Python.
- Strong communication skills, being able to collaborate with the wider software organization.
- Bachelor’s Degree (or higher) in Computer Science.
Preferred Qualifications
- Proficiency in Python
- Experience with Spark / Databricks
- Experience with MongoDB
- Experience with pipeline / workflow frameworks: Argo Workflows or Airflow
- Hands-on experience with cloud computing: AWS / GCP / Azure
- Experience with automation of data infrastructure: Docker / Kubernetes / Terraform
- Experience with SRE practices - running services reliably in production environments:
- Incident management and root cause analysis
- Performance Engineering
- Previous experience in the Automotive / Robotics industry.
Nice-To-Have
- Proficiency in front-end development, preferably using React
- Experience with big data / data warehouse tools like Redshift, Presto/Athena, BigQuery and Snowflake
- Experience with streaming and message queueing technologies: Kafka / Kinesis / RabbitMQ
- Hands-on experience with data storage and transfer schemes like Avro, Parquet and Protobuf
- Experience with rosbags.
Luminar is an equal opportunity employer. All applicants will be considered for employment without regard to race, color, ancestry, national origin, sex, gender, sexual orientation, marital status, religion, age, disability, gender identity, results of genetic testing, service in the military, or any other characteristic protected by applicable federal, state or local laws. We will make a reasonable accommodation for any qualified applicant with a disability, provided that the individual is otherwise qualified to safely perform the essential functions of the job with or without accommodation and that the accommodation would not impose an undue hardship on the operation of our business. Please let us know if you believe you require reasonable accommodation, or if you would like assistance to complete an application or to participate in an interview at the company.
At Luminar, your base pay is one part of your total compensation package. This role pays a base between $148,000 and $195,000* per year. Within this range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. You will also be eligible to receive other benefits including: equity in the form of restricted stock unit awards, comprehensive medical and dental coverage, 401k plan, life and disability benefits, flexible time off, paid parental leave, and tuition reimbursement for formal education related to advancing your career at Luminar. The specific programs and options available to an employee may vary depending on date of hire and schedule type.
Salary : $148,000 - $195,000
