Research Engineer (VLM for inspection), IPV, ARTC

Responsibilities:

• Design, develop, and optimize AI models for image-based vision inspection tasks, integrating vision models with LLMs/VLMs for enhanced decision-making.
• Implement and fine-tune state-of-the-art models such as Yolact, DeepLabV3, Vision Transformers, and others.
• Explore and implement LLMs or VLMs (e.g., OpenAI GPT, LLaMA, CLIP, BLIP) to incorporate domain knowledge via text prompts for tasks like final sentencing in inspection workflows.
• Develop and maintain Python-based pipelines for data preprocessing, model training, and evaluation.
• Research and implement innovative algorithms to improve model accuracy and efficiency.
• Collaborate with cross-functional teams to understand project requirements and deliver high-quality integrated solutions.
• Document research findings, experimental results, and software implementations.
• Stay updated with the latest advancements in AI and computer vision technologies.

JOB REQUIREMENTS

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• Strong proficiency in Python programming.
• Expertise in deep learning frameworks like PyTorch (mandatory) and TensorFlow
• Hands-on experience with computer vision models, including, Yolact, DeepLabV3, Vision Transformers, etc.
• Familiarity with LLMs or VLMs, and their integration with vision models (e.g., OpenAI GPT, LLaMA, CLIP, BLIP).
• Familiarity with image processing techniques and libraries such as OpenCV.
• Strong problem-solving and analytical skills.
• Strong communication and excellent writing skills.
• Have a strong work ethic, and able to work on own initiative. Team player, communicate efficiently, be flexible and details oriented.