# Plugin Eval (ChatGPT Plugin)

> Start from chat, then evaluate or benchmark locally

- Type: plugin
- Publisher: OpenAI (official)
- Categories: Development, AI & ML
- Website: https://github.com/openai/plugins/tree/main/plugins/plugin-eval
- Docs: https://learn.chatgpt.com/docs/plugins
- Source: https://github.com/openai/plugins
- Open in ChatGPT: https://chatgpt.com/plugins/plugins~Plugin_a2d7fcc77268819187a5d61e6a1452eb
- GitHub stars: 7248
- Listed: 2026-04-16

## About

Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking. Skills for evaluating plugins and skills, improving skills and designing metric packs, with local-first reports and token budget explanations. Listed in OpenAI's curated Codex marketplace (openai-curated); the manifest declares skills.

## Install

1. **Add it in ChatGPT** Open Plugins in the ChatGPT sidebar (web or desktop), search for “Plugin Eval” and select +. You'll be asked to sign in to any connected service on first use. Then type @ in a chat to call it.

2. **Or install it in Codex**

   Codex CLI:

   ```bash
   codex plugin add plugin-eval@openai-curated
   ```

## Skills

- **Evaluate Plugin**: Evaluate a local Codex plugin
- **Evaluate Skill**: Evaluate a local Codex skill
- **Improve Skill**: Turn plugin-eval findings into a rewrite brief
- **Metric Pack Designer**: Design custom metric packs for plugin-eval
- **Plugin Eval**: Choose the right local evaluation workflow

## Example prompts

- "Give me an analysis of the game studio plugin."
- "Evaluate this plugin."
- "Why did this score that way?"

## Also available as

- app: [MCP App Basics (Apps SDK example)](https://chatgptplugins.directory/apps/apps-sdk-mcp-app-basics.md)
- MCP server: [OpenAI Docs MCP](https://chatgptplugins.directory/mcp/openai-docs.md)

## Related

- [Superpowers](https://chatgptplugins.directory/plugins/superpowers.md): Plan, develop, and debug code
- [Codex Security](https://chatgptplugins.directory/plugins/codex-security.md): Security scanning for your codebase
- [Build Web Apps](https://chatgptplugins.directory/plugins/build-web-apps.md): Build frontend-focused web apps with generated assets, browser testing, payments, and...
- [GitHub](https://chatgptplugins.directory/plugins/github.md): Triage PRs, issues, CI, and publish flows
- [Figma](https://chatgptplugins.directory/plugins/figma.md): Figma design-to-code workflows
- [Shopify](https://chatgptplugins.directory/plugins/shopify.md): Build and manage your store

---
Source: https://chatgptplugins.directory/plugins/plugin-eval · Index: https://chatgptplugins.directory/llms.txt · Independent and community-run. Not affiliated with or endorsed by OpenAI. ChatGPT is a trademark of OpenAI.