What are the responsibilities and job description for the AI Controls Testing Analyst position at Goli Tech?
Responsibilities
- Conduct testing of operational controls and compliance with controls standards and requirements for Gen AI tools in production.
- Analyze, interpret and report on the results of the testing.
- Conduct root cause analysis, identify controls gaps and deficiencies
- Evaluate inherent and residual risk for Gen AI technology reviewed.
- Makes recommendations for remediation.
Qualifications
- Knowledge of AI / ML concepts, especially Gen AI (LLMs)
- Understanding of Gen AI risks, familiarity with AI governance standards and AI ethics principles (bias, fairness, transparency, responsible AI usage)
- Control frameworks expertise (NIST)
- Audit and compliance testing ability to test whether AI tools are compliance with organizational controls policies (access controls, data handling, model explainability)
- Data analysis collect and analyze relevant data to ensure AI tools perform as expected and identifying potential risks and control gaps.
- Problem solving and critical thinking: issue identification, root cause analysis.
Required Skills : AI
Basic Qualification :
Additional Skills : AI Developer
This is a high PRIORITY requisition. This is a PROACTIVE requisition
Background Check : No
Drug Screen : No
