Demo

Generative AI Architect

Yochana IT Solutions
San Jose, CA Full Time
POSTED ON 4/17/2025
AVAILABLE BEFORE 6/17/2025

Job Details

Generative AI Architect

Location : San Jose CA (Onsite)

Contract

We are seeking a highly skilled and visionary Generative AI Architect to lead the design, development, and deployment of advanced GenAI solutions. This role requires deep expertise in machine learning, large language models (LLMs), and cloud-native architecture, along with a strong understanding of enterprise needs and ethical AI considerations. The ideal candidate will drive innovation across the organization by aligning GenAI technologies with strategic business objectives.

Key Responsibilities:

Architecture & Design:

Design scalable, secure, and performant architectures for GenAI systems including LLMs, diffusion models, and multi-modal AI.

Define solution blueprints integrating GenAI into enterprise platforms, workflows, and data ecosystems.

Model Integration & Customization:

Evaluate, fine-tune, and integrate foundation models (e.g., OpenAI, Anthropic, open-source LLMs) for specific business use cases.

Build and manage pipelines for model training, prompt engineering, retrieval-augmented generation (RAG), and continuous learning.

Platform Development:

Collaborate with engineering teams to build GenAI platforms and APIs that support internal and external applications.

Ensure systems are designed for scalability, resilience, observability, and compliance.

Governance & Risk Management:

Establish AI governance frameworks, ensuring responsible AI usage aligned with regulatory, ethical, and privacy standards.

Implement controls for bias detection, explainability, and model monitoring.

Collaboration & Strategy:

Partner with product, data, security, and infrastructure teams to deliver GenAI capabilities across lines of business.

Provide thought leadership and evangelize GenAI strategy to stakeholders and executives.

Required Qualifications:

Bachelor's or master's degree in computer science, Artificial Intelligence, Data Science, or related field.

8 years of experience in AI/ML architecture, with at least 2 years focused on GenAI or LLM-based systems.

Deep understanding of transformer models, tokenization, embeddings, and generative pipelines.

Hands-on experience with frameworks such as Hugging Face, LangChain, PyTorch, TensorFlow, or similar.

Proficient in cloud platforms (AWS, Azure, or Google Cloud Platform), containerization (Docker, Kubernetes), and CI/CD pipelines.

Familiarity with data privacy, intellectual property, and compliance issues surrounding AI.

Preferred Qualifications:

Experience with enterprise-scale AI/ML platforms or MLOps pipelines.

Knowledge of vector databases (e.g., Pinecone, FAISS, Weaviate) and RAG frameworks.

Strong understanding of prompt engineering, few-shot learning, and human-in-the-loop systems.

Industry certifications in AI architecture or cloud architecture are a plus.

Soft Skills:

Strong communication and stakeholder management skills.

Strategic thinking with the ability to bridge technical execution and business outcomes.

Passion for innovation and continuous learning in the evolving field of generative AI.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Generative AI Architect?

Sign up to receive alerts about other jobs on the Generative AI Architect career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
Income Estimation: 
$81,253 - $112,554
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$95,407 - $122,738
Income Estimation: 
$103,114 - $138,258
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$154,597 - $194,610
Income Estimation: 
$172,688 - $210,712
Income Estimation: 
$170,589 - $211,671
Income Estimation: 
$178,619 - $225,190
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$103,114 - $138,258
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$145,845 - $177,256
Income Estimation: 
$147,836 - $182,130
Income Estimation: 
$154,597 - $194,610
Income Estimation: 
$86,891 - $130,303
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Yochana IT Solutions

Yochana IT Solutions
Hired Organization Address Mountain View, CA Full Time
Job Details PCIe Gen5 Validation Engineer Mountain View CA (Onsite) Contract 5 years of industry experience with extensi...
Yochana IT Solutions
Hired Organization Address Columbus, NE Full Time
Job Details Title:Packaging Engineer (R&D) Onsite-Medical Device Location:Columbus, NE VISA: ANY VISA JD: Rich experienc...
Yochana IT Solutions
Hired Organization Address Petersburg, FL Full Time
Job Details Title: Senior Design Engineer Location: St. Petersburg, Florida (Day1 onsite) Education: BE/BS (mechanical E...
Yochana IT Solutions
Hired Organization Address Mountain View, CA Full Time
Company Description Reach me at chaitu AT yochanait DOT com for more information Job Description Job Title: SFDC Develop...

Not the job you're looking for? Here are some other Generative AI Architect jobs in the San Jose, CA area that may be a better fit.

Generative AI Architect

Quantum World Technologies Inc., Fremont, CA

Generative AI Architect

Quantum World Technologies Inc., Sunnyvale, CA

AI Assistant is available now!

Feel free to start your new journey!