What are the responsibilities and job description for the GenAI LLM Red-Teaming Software Engineer position at DVARN?
Job Details
Day 1 onsite Austin, TX
Long term contract
Hybrid - 3 days onsite / week
candidate must be proficient at Prompt Engineering and familiar with LLM Apps & RAG systems (like SNAP GPT).. Keywords: Safety, guardrails, lots of LLM. Familiarity with automated red-teaming solutions like PyRIT, Garak, Giskard, etc is a big plus. Some Python.
Client is not 'building' the app. It's about red-teaming an app that is already built. [LLM red teaming is a process that simulates real-world attacks on large language. Red team and surface the safety issues. If they can help automate the red-teaming as much as possible. LLM can say things that are inappropriate. Act of red-team is to break guardrails and will generate inapproporiate responses. Blue-teaming / prompt engineering. Do they know how, how would they build? All the possible ways things will break. Goal, combo automating and human.
Python programming background would be good.
Skills - Experience
Gen AI Read - Teaming - Nice to have 1 years
Prompt Engineering - At least 1 years required
LLM - At least 1 years required
