Senior Engineer - Enterprise Search Integration

Location: NYC,NY (3 Days a week in the Office is Mandatory (No Exceptions)

Job Title: Senior Engineer - Enterprise Search Integration

We are looking for a highly experienced Senior Engineer to lead the integration of a new enterprise search platform, enabling seamless data exchange and optimized search functionality across our systems. As a Senior Engineer, you will play a key role in integrating and optimizing our new enterprise search product. You will work with both internal teams and the vendor's platform to develop robust APIs, streamline data flow, and ensure high-performance search functionality that supports our business goals. This role requires deep expertise in API development, enterprise data architecture, and a strong understanding of search technologies.

Key Responsibilities

• Lead Integration Initiatives: Oversee the integration of the new enterprise search product with existing data systems and applications, ensuring smooth, secure, and efficient data flow.
• API Development and Management: Design, develop, and manage APIs to support data exchange between the enterprise search platform and various data sources across the organization.
• Data Pipeline and Synchronization: Establish and maintain data pipelines, ensuring real-time or near-real-time data synchronization between internal databases and the vendor platform.
• Collaboration with Stakeholders: Work closely with internal data, IT, and business teams, as well as the vendor, to identify integration needs, design workflows, and resolve any technical issues.
• Monitoring and Troubleshooting: Set up monitoring tools and proactive health checks to ensure the reliability and performance of the search platform integration, troubleshooting issues as they arise.
• Performance Optimization: Continuously improve data ingestion, indexing, and retrieval processes to ensure fast and accurate search results within the platform.
• Documentation and Best Practices: Create and maintain comprehensive technical documentation for all integration processes, APIs, and data flows, and establish best practices for API security, scalability, and maintainability.

Qualifications

Education: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.

Experience:

• 5 years of experience in software engineering, with a focus on data integration, API development, or enterprise search solutions.
• Experience on "AI Agents" and Enterprise Search using RAG/LLM is a must
• Proven experience integrating enterprise software products, ideally with a focus on search platforms (e.g., Elasticsearch, Glean, Coveo, or Lucidworks).
• Technical Skills:
• Programming: Proficiency in backend development languages, such as Python, Java, or Node.js, with a strong focus on RESTful API development.
• Data Management: Expertise in handling data structures, transformation, and integration, including experience with SQL and NoSQL databases.
• Search and Indexing Technologies: Familiarity with enterprise search technologies and data indexing processes.
• Cloud Platforms: Experience with cloud environments (AWS, GCP, or Azure) for scalable data processing.
• Security: Knowledge of API security, including OAuth, SSO, and data encryption best practices.

Soft Skills:

• Strong analytical skills with attention to detail in troubleshooting and problem-solving.
• Excellent communication and documentation skills for both technical and non-technical audiences.
• Ability to lead technical projects and mentor junior engineers in integration best practices.

Preferred Qualifications

• Experience working directly with enterprise search vendors for custom API integrations.
• Familiarity with event-driven architectures and message queue systems (e.g., Kafka, RabbitMQ).
• Knowledge of search relevance tuning, user intent detection, or semantic search capabilities.