Demo

Senior Solutions Architect (AI/ML)

Proximity Works
Santa Clara, CA Full Time
POSTED ON 2/17/2025
AVAILABLE BEFORE 3/15/2025

We are looking for a Senior Solutions Architect to design, develop, and scale innovative AI/ML-driven solutions. You will be responsible for architecting highly scalable, low-latency distributed systems optimized for AI/ML workloads. As a key technical leader, you will solve complex challenges, influence next-generation AI/ML infrastructures, and guide cross-functional teams to deliver state-of-the-art solutions for fast-growing startups and enterprise companies.

Be at the forefront of shaping next-generation AI/ML infrastructures, driving solutions for high-impact products across diverse industries. You'll have the opportunity to influence key architectural decisions and enable real-world applications that scale globally, ensuring innovation and efficiency at every step.

You'll be responsible for —

Driving end-to-end GenAI architecture and implementation:
  • Design and deploy multi-agent systems using modern frameworks (LangGraph, CrewAI, AutoGen)
  • Architect RAG solutions with advanced vector store integration
  • Implement efficient fine-tuning strategies for foundation models
  • Develop synthetic data generation pipelines for training and testing

Leading ML infrastructure and deployment:
  • Design high-performance model serving architectures
  • Implement distributed training and inference systems
  • Establish MLOps practices and pipelines
  • Optimize cloud resource utilization and costs
  • Set up monitoring and observability solutions

Driving technical excellence and innovation:
  • Define architectural standards and best practices
  • Lead technical decision-making for AI/ML initiatives
  • Ensure scalability and reliability of AI systems
  • Implement AI governance and security measures
  • Guide teams on advanced AI concepts and implementations

Overseeing production AI systems:
  • Manage model deployment and versioning
  • Implement A/B testing frameworks
  • Monitor system performance and model drift
  • Optimize inference latency and throughput
  • Ensure high availability and fault tolerance

Fostering collaboration and growth:
  • Mentor engineering teams on AI architecture
  • Collaborate with stakeholders on technical strategy
  • Drive innovation in AI/ML solutions
  • Share knowledge through documentation and training
  • Lead technical reviews and architecture discussions

You need —8 years experience in software engineering or architecture, including:
  • 4 years leading cross-functional GenAI/ML teams
  • Production experience with distributed AI systems
  • Enterprise-scale AI architecture implementation

To lead and architect enterprise-scale GenAI/ML solutions, focusing on:
  • Multi-agent orchestration using LangGraph, CrewAI, and AutoGen
  • Workflow automation with LlamaIndex, LangChain, and LangFlow
  • Agent coordination using LETTA framework
  • Integration of specialized agents for reasoning, planning, and execution

To design and implement sophisticated AI architectures incorporating:Advanced RAG systems using:
  • Vector databases (Chroma, Weaviate, Pinecone, Milvus)
  • Hybrid search with BM25 and semantic embeddings
  • Self-querying and recursive retrieval patterns
Fine-tuning strategies for foundation models:
  • PEFT methods (LoRA, QLoRA, Adapter-tuning)
  • Parameter-efficient training approaches
  • Instruction fine-tuning and RLHF
Multi-agent frameworks integrating:
  • Tool-use and reasoning chains
  • Memory systems (short-term and long-term)
  • Meta-prompting and reflection mechanisms
  • Agent communication protocols

Expertise advanced data generation and synthesis:
  • Synthetic data generation using Arigilla and PersonaHub
  • Privacy-preserving data synthesis
  • Domain-specific data augmentation
  • Quality assessment of synthetic data
  • Data balancing and bias mitigation

To architect high-performance ML serving infrastructure focusing on:
  • Model serving platforms (BentoML, Ray Serve, Triton)
  • Real-time processing with Ray, Kafka, and Spark Streaming
  • Distributed training using Horovod, DeepSpeed, and FSDP
  • vLLM and TGI for efficient inference
  • Integration patterns for hybrid cloud-edge deployments

To drive cloud architecture decisions across:
  • Kubernetes orchestration with Kubeflow and KServe
  • Serverless ML with AWS Lambda, Azure Functions, Cloud Run
  • Auto-scaling using HPA, KEDA, and custom metrics
  • Resource optimization with Nvidia Triton and TensorRT
  • MLOps platforms (MLflow, Weights & Biases, DVC)
Bonus points for —
  • Research publications in AI/ML
  • Open-source project maintenance
  • Technical blog posts on AI architecture
  • Conference presentations
  • AI community leadership

What you get —
  • Best in class salary: We hire only the best, and we pay accordingly.
  • Proximity Talks: Meet other designers, engineers, and product geeks — and learn from experts in the field.
  • Keep on learning with a world-class team: Work with the best in the field, challenge yourself constantly, and learn something new every day.

About us —

We are Proximity — a global team of coders, designers, product managers, geeks, and experts. We solve complex problems and build cutting-edge tech at scale. Here's a quick guide to getting to know us better:

  • Watch our CEO, Hardik Jagda, tell you all about Proximity.
  • Read about Proximity's values and meet some of our Proxonauts here.
  • Explore our website, blog, and the design wing — Studio Proximity.
  • Get behind the scenes with us on Instagram! Follow @ProxWrks and @H.Jagda

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior Solutions Architect (AI/ML)?

Sign up to receive alerts about other jobs on the Senior Solutions Architect (AI/ML) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$117,024 - $149,811
Income Estimation: 
$137,568 - $176,908
Income Estimation: 
$145,845 - $177,256
Income Estimation: 
$172,688 - $210,712
Income Estimation: 
$170,589 - $211,671
Income Estimation: 
$178,619 - $225,190
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$172,688 - $210,712
Income Estimation: 
$132,903 - $169,021
Income Estimation: 
$144,671 - $184,917
Income Estimation: 
$136,361 - $179,761
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$145,845 - $177,256
Income Estimation: 
$147,836 - $182,130
Income Estimation: 
$154,597 - $194,610
Income Estimation: 
$86,891 - $130,303
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Proximity Works

Proximity Works
Hired Organization Address California, CA Full Time
CTO – Proximity Works Location: California, US Travel: Frequent global travel for client meetings, team meetings, and co...
Proximity Works
Hired Organization Address San Francisco, CA Full Time
Content Summary : Social Media Marketing Manager (US) at San Francisco, for Proximity Works Job Description Job Descript...
Proximity Works
Hired Organization Address San Francisco, CA Full Time
Content Summary : Social Media Marketing Manager (US) at San Francisco, for Proximity Works Job Description Job Descript...
Proximity Works
Hired Organization Address San Francisco, CA Full Time
Proximity Inc. (San Francisco) is hiring a Sales Lead who will be looking at Growth, Business Development, and Sales. Re...

Not the job you're looking for? Here are some other Senior Solutions Architect (AI/ML) jobs in the Santa Clara, CA area that may be a better fit.

Senior Networking Solutions Architect

NTT America Solutions, Inc., Santa Clara, CA

Senior Solutions Architect

Calfus Inc., Pleasanton, CA

AI Assistant is available now!

Feel free to start your new journey!