What are the responsibilities and job description for the Data Engineer position at Landbase?
About Landbase
Landbase leverages the experience of 100 world-class sales professionals and AI to deliver targeted, high-quality leads on autopilot. Our mission is to achieve GTM automation so humans no longer need to work for their software, allowing them to reclaim their day. We're building GTM-1 Omni, the world's first action model purpose-built for lead generation.
About the Role
We're seeking a Data Engineer to design and implement scalable data pipelines that power our AI models and analytics.
Required Skills & Experience
- Design and implement ETL pipelines in PySpark and/or Scala Spark.
- Orchestrate complex data workflows in Airflow.
- Advanced SQL skills and experience with BigQuery.
- Hands-on experience with MongoDB, Elasticsearch, and PostgreSQL.
- Proficiency with GCP Dataproc and cluster optimization.
- Experience handling TB-scale unstructured data.
- Optimize database performance and storage strategies.
- Create and maintain data quality monitoring systems.
- Collaborate with ML Engineers on production model deployment.
- Stay current with emerging AI tools and technologies.
- 3 years of experience in large-scale data engineering.
Nice-to-Have Qualifications
- Experience with PyTorch, Hugging Face, or other ML frameworks.
- Background in LLM operations and deployment.
- Familiarity with Ray for distributed computing.
- Experience with real-time data streaming architectures.
- Background in sales/marketing data systems.
- Previous experience in startup or AI-driven environments.
Benefits & Perks
- Competitive compensation.
- Comprehensive health benefits.
- Flexible work arrangements.
- Professional development opportunities.
- Exciting work with cutting-edge AI technology.
- Collaborative and innovative work environment.
- Regular team events and gatherings.