Demo

Lead Research Engineer, Speech Foundation Models (AI Labs)

Krutrim
Palo Alto, CA Full Time
POSTED ON 2/25/2025
AVAILABLE BEFORE 5/19/2025

Location : Palo Alto (CA, US)

Type of Job : Full-time

About Krutrim :

Krutrim is building AI computing for the future. Our envisioned AI computing stack encompasses the AI computing infrastructure, AI Cloud, multilingual and multimodal foundational models, and AI-powered end applications. We are India’s first AI unicorn and built the first foundation model from the country.

Our AI stack is empowering consumers, startups, enterprises and scientists across India and the world to build their end AI applications or AI models. While we are building foundational models across text, voice, and vision relevant to our focus markets, we are also developing AI training and inference platforms that enable AI research and development across industry domains. The platforms being built by Krutrim have the potential to impact millions of lives in India, across income and education strata, and across languages.

The team at Krutrim represents a convergence of talent across AI research, Applied AI, Cloud Engineering, and semiconductor design. Our teams operate from three locations : Bangalore, Singapore & San Francisco.

Job Description :

We are seeking a highly skilled and experienced Senior Research Lead for Speech, Audio, and Conversational AI to join our innovative team. In this role, you will spearhead the research and development of cutting-edge technologies in speech processing, text-to-speech (TTS), audio analysis , and real-time conversational AI. You will push the boundaries of what's possible in automatic speech recognition (ASR), speaker identification, diarization, speech synthesis, voice cloning, dubbing and audio generation . Working closely with a team of talented engineers and researchers, you'll design, implement, and optimize state-of-the-art systems that contribute to creating more natural, human-like, and high-quality speech and audio solutions for a variety of applications.

Key Responsibilities :

  • Bring the state of the art in Audio / Speech and Large Language Models to develop advanced Audio Language Models and Speech Language Models.
  • Research, architect, and deploy new generative AI methods such as autoregressive models, causal models, and diffusion models
  • Design and implement low-latency end-to-end models with multilingual speech / audio as both input and output.
  • Conduct experiments to evaluate and improve the performance of these models, focusing on accuracy, naturalness, efficiency, and real-time capabilities across multiple languages.
  • Stay at the forefront of advancements in speech processing, audio analysis, and large language models, integrating new techniques into our foundation models.
  • Collaborate with cross-functional teams to integrate these foundation models into Krutrim's AI stack and products.
  • Publish research findings in top-tier conferences and journals such as INTERSPEECH, ICASSP, ICLR, ICML, NeurIPS, and IEEE / ACM Transactions on Audio, Speech, and Language Processing.
  • Mentor and guide junior researchers and engineers, fostering a collaborative and innovative team environment.
  • Drive the adoption of best practices in model development, including rigorous testing, documentation, and ethical considerations in multilingual AI.

Qualifications :

  • Ph.D. with 5 years or MS with 8 years of experience in Computer Science, Electrical Engineering, or a related field with a focus on speech processing, audio analysis, and machine learning.
  • Train or finetune speech / audio models for representation (like, W2V-BERT, SONAR, AST ), generation (like, Hi-Fi GAN, VQ-GAN, AudioLDM ), Conformers, multilingual multitask models (like, SeamlessM4T ).
  • Expertise with Audio Language Models like AudioPALM, Moshi and Seamless M4T
  • Proven track record of developing and applying novel neural network architectures such as Transformers, Mixture of Experts, Diffusion Models, and State Space Machines (MAMBA, SAMBA).
  • Extensive experience in developing and optimizing models for low-latency, real-time applications.
  • Strong background in multilingual speech recognition, voice cloning, dubbing and synthesis , with an understanding of the challenges specific to different language families.
  • Proficiency in deep learning frameworks (e.g., TensorFlow, PyTorch ) and experience deploying large-scale speech and audio models.
  • Demonstrated expertise in high-performance computing with proficiency in Python, C / C , CUDA, and kernel-level programming for AI applications.
  • Experience with audio signal processing techniques and their application in end-to-end neural models.
  • Strong track record of publications in top AI conferences and journals, particularly in the areas of speech, audio, and language models.
  • Excellent communication skills, with the ability to explain complex technical concepts to both technical and non-technical audiences.
  • Passion for pushing the boundaries of what's possible in speech and audio AI, with a focus on practical, real-world applications.
  • Join Krutrim to shape the future of AI and make a significant impact on 100s of millions of lives across India and the world. If you're passionate about pushing the boundaries of AI and want to work with a team at the forefront of innovation, we want to hear from you!

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Lead Research Engineer, Speech Foundation Models (AI Labs)?

    Sign up to receive alerts about other jobs on the Lead Research Engineer, Speech Foundation Models (AI Labs) career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $135,356 - $164,911
    Income Estimation: 
    $153,053 - $187,211
    Income Estimation: 
    $153,902 - $198,246
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $172,688 - $210,712
    Income Estimation: 
    $170,589 - $211,671
    Income Estimation: 
    $178,619 - $225,190
    Income Estimation: 
    $86,891 - $130,303
    Income Estimation: 
    $116,330 - $143,011
    Income Estimation: 
    $135,356 - $164,911
    Income Estimation: 
    $153,902 - $198,246
    Income Estimation: 
    $129,363 - $167,316
    Income Estimation: 
    $145,845 - $177,256
    Income Estimation: 
    $147,836 - $182,130
    Income Estimation: 
    $154,597 - $194,610
    Income Estimation: 
    $86,891 - $130,303
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at Krutrim

    Krutrim
    Hired Organization Address Palo Alto, CA Full Time
    Job Title : AI Cloud Platform System Engineer Location : US-San Francisco Bay Area Position Type : Full-Time Job Summary...
    Krutrim
    Hired Organization Address Palo Alto, CA Full Time
    Senior Distributed Training Research Engineer (Frontier LLMs) Location : Palo Alto (CA, US) Type of Job : Full-time Abou...
    Krutrim
    Hired Organization Address Palo Alto, CA Full Time
    Multimodal and Vision AI Research Engineer / Scientist Location : Palo Alto (US) Type of Job : Full-time About Krutrim :...

    Not the job you're looking for? Here are some other Lead Research Engineer, Speech Foundation Models (AI Labs) jobs in the Palo Alto, CA area that may be a better fit.

    AI Assistant is available now!

    Feel free to start your new journey!