What are the responsibilities and job description for the Data Scientist position at Infotree Global Solutions?
Senior Research Data Scientist
Exceptionally strong candidates outside these areas will be considered.
Job Summary
We are seeking a highly skilled and motivated Data Scientist to join our Responsible AI team. In this role, you will be responsible for designing, coordinating, supporting, and executing evaluations of large language model (LLM) features to ensure their safety, fairness, and alignment.
You will work closely with multidisciplinary teams, including Research Scientists, Product Managers, Engineers, and other Data Scientists, to drive human-centric evaluations that inform product decisions and improve model performance.
This position requires a combination of strong technical skills, experience in industry settings, and a deep understanding of human-centered data science. Familiarity with responsible AI principles and practices is a strong plus.
Key Responsibilities
- Design, implement, support, and evaluate experiments for LLM feature safety, including both human and automated evaluations.
- Develop scalable pipelines and tools to process and analyze heterogenous datasets.
- Collaborate with cross-functional teams to operationalize research findings
- Write high-quality, maintainable code, and contribute to shared codebases
- Create and maintain documentation for research processes and evaluation frameworks.
- Communicate findings effectively through presentations and reports, translating technical results into actionable insights for diverse audiences.
Key Qualifications
- Strong programming skills in Python, with experience in writing production-level code and implementing best practices (e.g., unit testing, version control).
- Experience with data engineering, including working with large datasets or heterogenous datasets with mixed provenance.
- Solid understanding of machine learning concepts, particularly related to LLMs, NLP, and model evaluation.
- Experience designing and executing experiments, including human-centered evaluations and automated benchmarking.
- Experience in observational or experimental research with human subjects.
- Familiarity with SQL for data manipulation and analysis.
- Strong analytical and problem-solving skills, with experience applying statistical methods to real-world problems.
- Excellent verbal and written communication skills, with experience in explaining technical concepts to non-technical stakeholders.
Strongly Preferred
- Hands-on, technical experience solving data science or ML problems with LLMs, preferably in an applied industry context
- Experience with responsible AI, including fairness, transparency, and safety in AI systems.
- Background in human-centered data science, HCI, or social science fields relevant to understanding human-AI interactions or measuring human-centered phenomena.
Education
Master’s or PhD in Computer Science, Machine Learning, Data Science, Statistics, Cognitive Science, Psychology, Human-Computer Interaction, or a related field.
