What are the responsibilities and job description for the Data Scientist position at Covetus?
We are seeking a skilled Product Data Scientist with 3-5 years of experience to join our team and drive data-informed decision-making within our Generative AI services. The ideal candidate will have a strong analytical background, proficient in SQL and Python, along with expertise in machine learning and statistics. You will play a pivotal role in defining success metrics, analyzing product performance, and translating business needs into actionable data insights.
Key Responsibilities:
- Metric Definition and Tracking: Define and track success metrics across Generative AI services to measure performance and impact.
- Data Problem Translation: Translate ambiguous business needs into measurable data problems, ensuring alignment between product goals and data analysis.
- Collaboration: Partner with engineers and data scientists to define user workflows, evaluation sets, and queries that support product development and refinement.
- Model Analysis: Analyze model failures, ambiguities, and user logs to provide insights that guide improvements in prompts and retrievers.
- A/B Testing: Design and implement A/B tests to evaluate product features, analyze results, and inform product decisions.
- Communication: Effectively communicate findings and recommendations to both technical and non-technical stakeholders, fostering a data-driven culture within the organization.
- Product Sense: Utilize strong product sense to understand user needs and how data insights can enhance product offerings.
Required Skills:
- Proficient in SQL and Python for data manipulation and analysis.
- Strong understanding of machine learning concepts and statistical analysis.
- Experience with experimentation methodologies, including metric definition and A/B testing.
- Excellent communication skills with the ability to convey complex data insights to diverse audiences.
- Familiarity with Large Language Models (LLMs) and their applications in product development.
Qualifications:
- 3-5 years of experience in data science, product analytics, or a related field.
- Bachelor’s degree in Data Science, Statistics, Computer Science, or a related discipline (or equivalent experience).
- Strong analytical problem-solving skills and attention to detail.
- Ability to work collaboratively in a fast-paced, cross-functional environment.
