What are the responsibilities and job description for the Principal Architect position at Purgo?
Purgo AI delivers LLM based agentic design, development and deployment of data applications over cloud data warehouses.Purgo AI dramatically improves productivity, reduce costs and shortens time to delivery for data engineering teams.Purgo AI is based in Palo Alto, CA and funded byThe Hive andCapital One Growth Ventures . The company’s co-founder and CTO,Sang Kim , has been an engineering leader across VMWare and Blackberry.Early users of the product include leading enterprises in the life sciences, media and financial services verticals. Purgo AI’s in-built Vertical Solutions have saved users months of time, cost and efforts by getting to production within days. Prominent execs from several cloud data warehouse leaders are advisors to Purgo AI. The product integrates with leading cloud data warehouses including Databricks, Snowflake, and others.PurgoAI helps automate the building ETL / ELT pipelines and BI applications on cloud data warehouses.The product offers data engineering teams an end-to-end requirements-to-production design, development, test & deployment of ETL / ELT pipelines.Purgo AI Vertical Solutions come pre-built with comprehensive Process Definition Libraries written by subject matter experts in natural language as easy-to-edit Jira tickets.Business analysts or product owners specify ETL / ELT user requirements as Jira tickets through Purgo AI’s Jira app either by easily editing in-built process definitions or creating new ones.This triggers the generation of a design (Behavior-driven design (BDD)) specification. The design creates test harnesses with test scripts and test data for QA.Purgo AI then generates source code from integrated code-generation LLMs by using the design specifications without needing any human prompting.For enterprise context the product integrates seamlessly withGithuband GitLab (to interpret existing / legacy source code and pipelines), and data warehouse catalogs (for schema).The generated code is subject to pre-generated quality assurance tests, and test fails re-trigger generation of the source code. The final source code is ready for end deployment over the cloud data warehouse after inspection / approval by the business analyst team.The entire process has end-to-end traceability through Purgo AI generated log entries across Jira and GitHub systems. Across the end-to-end development process, Purgo AI produces intermediate development artifacts enabling developers transparent, white-box review.In addition to ETL / ELT pipelines for Business Intelligence applications, in the future Purgo AI will provide a range of requirements-to-production workflows, viz. cloud migration and on-demand machine learning.About the role Purgo AI is seeking an accomplished and hands-on Principal Architect to advance the boundaries of generative AI in designing and developing data applications. This leadership role is at the crossroads of two transformative enterprise technologies : generative AI and cloud data warehouses. The Principal Architect will be pivotal in defining the architectural vision, solving critical technical challenges, and executing Purgo AI’s ambitious roadmap. Reporting to CTO Sang Kim, this role will lead the development of groundbreaking solutions that redefine data application design and deployment.Responsibilities Define and lead the architectural vision for Purgo AI, focusing on generative AI agents and workflows integrated with cloud data warehouses.Develop and execute a technical roadmap to enhance AI Agent accuracy and fidelity in behavior-driven designs generated for cloud data warehouse workflows.Evaluate and integrate advanced generative AI methodologies, such as LangGraph, trees of thoughts, self-reflection, reinforcement learning, and context optimization.Optimize model control (RAG) and extract precise enterprise-specific context from cloud data warehouse schemas, catalogs, pipelines, and applications for AI-driven workflows.Design and implement new workflows as part of Purgo AI’s future roadmap.Participate in coding, code reviews, and development of core platform components, upholding high standards of performance, scalability, and maintainability.Ensure the product scales efficiently across volume, complexity, and human-agent collaboration.Provide mentorship and technical leadership to engineering teams.Benchmark the AI agent’s performance for accuracy, fidelity, efficiency, and productivity.Ensure compliance with enterprise security and regulatory standards.About you Experience : 10 years working with large-scale systems, with expertise in data management and cloud data warehousing.Proven ability to architect and scale web-scale distributed systems, with experience in platforms at the scale of Google, Meta, or PayPal.Strong problem-solving skills grounded in first principles, coupled with a strategic and forward-thinking approach.Demonstrated leadership skills with a history of successfully guiding and mentoring engineering teams.Exceptional communication skills, with the ability to articulate complex technical concepts to diverse audiences.A recognized thought leader in AI, cloud data warehouses, or related fields, with a track record of innovation and impact.Preferred Skills (Bonus) : Direct experience with cloud data warehouse design, including schema, pipelines, lakehouses, ETL / ELT processes, and compute layers.Advanced Python programming skills, particularly for AI workflow development using frameworks like LangChain.In-depth knowledge of integrating multiple LLMs with APIs for dynamic, scalable applications.Purgo AI is an affirmative action employer and welcomes candidates who will contribute to the diversity of the company.#J-18808-Ljbffr