AI/ML Engineer

Roc Search is currently working with a leading public sector organization that is looking for a AI/ML Engineer to join their team.

As the AI/ML Engineer, you will have a deep understanding of AI/ML infrastructure, MLOps, and cloud AI deployment. In this role, you will architect and deploy AI/ML environments, including GPU clusters and high-performance computing (HPC) resources, while optimizing networking, storage, and compute resources for AI workloads. You will be responsible for implementing scalable storage solutions and setting up both on-premises and cloud-based AI infrastructure.

Must-Have Qualifications:

• Master’s or Ph.D. in Computer Science, Data Science, Machine Learning, or a related field.
• Minimum of 3 years of experience in AI/ML engineering with a focus on infrastructure, MLOps, and cloud AI deployment.
• Proven experience configuring and setting up ML platforms both on-premises and in cloud environments, particularly Oracle Cloud.
• Strong expertise in Linux-based AI/ML environments, including performance optimization, package management, shell scripting, and system troubleshooting.
• Extensive experience working with HPC environments and GPU clusters (e.g., H100, A100, or similar) for large-scale distributed AI workloads.
• Proficient in Python programming, with hands-on experience using AI/ML frameworks such as TensorFlow, PyTorch, or similar.
• Hands-on experience with MLOps, including model training, validation, deployment, and ongoing monitoring.
• Proven ability to integrate AI/ML models into business intelligence platforms such as Power BI, Oracle Analytics, or through APIs.
• Experience working with high-speed networking, storage solutions, and tuning AI/ML system performance for optimal results.

Recap:

• Location – Brooklyn, NY (Hybrid)
• W2 Rate – $52/hr - $60/hr dependent on relevant experience
• Length – Long term Contract

If you think you're the right person for this job, we’d love to hear from you!