What are the responsibilities and job description for the Supervisory IT Specialist (AI) position at Department Of Commerce?
DutiesZP-IV : You will manage activities focused on evaluating and improving AI systems to ensure their functionality, trustworthiness, and compliance with Executive Order 14110. This grade level involves designing robust evaluations, identifying vulnerabilities, and collaborating across teams to address AI safety challenges while contributing to technical guidelines and best practices. Key duties include : Assess the effectiveness of AI model safeguards and recommend enhancements.Conduct red-team operations to identify failures, vulnerabilities, and potential misuse in AI systems.Develop and refine tools, workflows, and methodologies for red-teaming and safety / security evaluations.Continuously improve evaluation techniques for greater efficiency and scalability.Collaborate with team members and cross-functional teams to develop innovative solutions for AI safety challenges.Clearly communicate complex AI concepts to diverse audiences, including technical and non-technical stakeholders.Contribute to the development of technical guidelines and best practices for AI safety.ZP-V : As a leader and technical expert in AI safety, you will lead and oversee the design and execution of evaluations to ensure the reliability and compliance of AI systems with Executive Order 14110. This grade level involves developing innovative solutions, leading cross-functional teams, refining best practices, and advising senior leadership on complex issues critical to the mission of the AI Safety Institute. Key duties include : Formulate and manage the design and implementation of structured, scientifically sound evaluations of AI systems.Lead the evaluation of existing AI model safeguards to determine their effectiveness and recommend improvements.Plan and execute red-team operations using real-world adversarial tactics to identify failures, vulnerabilities, and potential misuse in AI systems.Develop and refine software, workflows, and tools for red-teaming and safety / security evaluations.Establish and improve coding standards, workflows, and product automation to enhance evaluation efficiency and scalability.Collaborate with cross-functional teams to create innovative solutions to AI safety challenges.Clearly communicate complex AI concepts to diverse audiences, including technical and non-technical stakeholders.Contribute to the development of technical guidelines and best practices for AI safety.Requirements Conditions of EmploymentU.S. citizenshipMales born after 12-31-59 must be registered for Selective ServiceSuitable for Federal employmentCompletion of Confidential Financial Disclosure, Form OGE-450Designated and / or random drug testing requiredBargaining Unit Position : No QualificationsZP-4 : Applicants must have at least one year of specialized experience at the GS-12 (ZP-III at NIST) or equivalent grade level. Specialized experience is defined as experience with Artificial Intelligence (AI) generative models and / or Machine Learning (ML) algorithms; carrying out technical evaluations to identify safety issues or security vulnerabilities; and collaborating and coordinating on AI-related projects.ZP-5 : Applicants must have at least one year of specialized experience at the GS-13 (ZP-IV at NIST) or equivalent grade level. Specialized experience is defined as experience with Artificial Intelligence (AI) generative models and / or Machine Learning (ML) algorithms; planning and designing technical evaluations to identify safety issues or security vulnerabilities; leading cross-functional AI-related teams and projects; and establishing best practices, including specific technical standards and workflows.Experience refers to paid and unpaid experience, including volunteer work done through National Service programs (e.g., Peace Corps, AmeriCorps) and other organizations (e.g., professional; philanthropic; religious; spiritual; community, student, social). Volunteer work helps build critical competencies, knowledge, and skills and can provide valuable training and experience that translates directly to paid employment. You will receive credit for all qualifying experience, including volunteer experience.The qualification requirements in this vacancy announcement are based on the U.S. Office of Personnel Management (OPM) Qualification Standards Handbook.Applicant ReconsiderationEducationQualifications are based upon meeting specialized experience only. Education cannot be used to qualify for this position. Additional informationThis position is covered under NIST's Alternative Personnel Management System (APMS), a pay-for-performance system with excellent HR flexibilities to help NIST recruit and retain top talent. Learn more about the APMS here!Your application package may be shared with other selecting officials at NIST for similar opportunities and additional selections may be made from this vacancy.Click all links in this vacancy announcement to view additional information or instructions.All documents submitted for this announcement must be legible to make qualification or eligibility determinations.A trial period may be required. This appointment may be extended up to four years without further competition.This position requires the passing of a drug testThis position requires filing an OGE-450 Confidential Financial Disclosure Report within 30 days of onboarding and annually thereafter.NIST strives to build a flexible and encouraging work environment to bring out the best in our employees. To help our employees balance responsibilities at home and at work, NIST offers a variety of work-life flexibilities such as : TeleworkFlexible work schedulesPaid parental leavePaid vacationSick leaveFamily-friendly leaveChildcare subsidy program for qualifying familiesBack-up child care programChild and elder-care resourcesOn-site childcare centerLactation spacesWellness programsFitness centerEmployee assistance programs Help A career with the U.S. government provides employees with a comprehensive benefits package. As a federal employee, you and your family will have access to a range of benefits that are designed to make your federal career very rewarding. Opens in a new windowLearn more about federal benefits. Review our benefitsEligibility for benefits depends on the type of position you hold and whether your position is full-time, part-time or intermittent. Contact the hiring agency for more information on the specific benefits offered.How You Will Be EvaluatedYou will be evaluated for this job based on how well you meet the qualifications above.How you will be evaluated : We will review your resume, optional cover letter and supporting documents to assess your qualifications for this position. Please be sure that your resume and supporting documents include detailed information to support your qualifications for this position. Failure to provide sufficient and / or legible evidence in your resume or supporting documents may result in a "not qualified" determination. You MUST select at least ONE eligibility (i.e., how you wish to be considered) to receive consideration for this position.Referral : All applicants who meet the minimum qualifications will be referred to the selecting official for consideration. Under Direct Hire Authority, applicants are not rated and ranked, and veteran preference does not apply.CTAP or ICTAP eligibility : If you are a displaced or surplus Federal employee eligible for the Career Transition Assistance Plan (CTAP) or Interagency Career Transition Assistance Plan (ICTAP), you must be determined eligible and rated as well-qualified to receive special selection priority. "Well Qualified" means that in addition to meeting the minimum qualification requirements and selective placement factor(s), if applicable, you must receive a score of 85 or higher. Please review the following site regarding required documents to support CTAP or ICTAP eligibility and additional information regarding this authority - CTAP / ICTAP Eligibility