Promptfoo skills for configuring providers and targets, writing eval suites, and setting up or running red team workflows against LLM apps.
Install
- 1Add it in ChatGPT
Open Plugins in the ChatGPT sidebar (web or desktop), search for “Promptfoo” and select +. You'll be asked to sign in to any connected service on first use. Then type @ in a chat to call it.
Skills 4
- Promptfoo Evals
Write and QA Promptfoo eval suites
- Promptfoo Provider Setup
Connect Promptfoo to HTTP, Python, and JS
- Promptfoo Redteam Run
Run and triage red team scans
- Promptfoo Redteam Setup
Plan red team scans from endpoints or code
Things to ask
- “Write a Promptfoo eval for this behavior.”
- “Use Promptfoo to connect my HTTP endpoint to an eval.”
- “Set up or run Promptfoo red teaming for this API.”
Related
SuperpowersPlan, develop, and debug codeplugin · by Jesse Vincent · 294k stars