Orchestrating LLM Attacks with Pyrit
Build multi-turn, Crescendo, and Tree-of-Attacks-with-Pruning (TAP) automated attack chains against conversational LLM agents using Microsoft PyRIT, with adversarial chat and scorer feedback loops.
Install
npx skills add adriannoes/awesome-agentic-ai --skill orchestrating-llm-attacks-with-pyritgit clone --depth 1 https://github.com/adriannoes/awesome-agentic-ai.git /tmp/awesome-agentic-ai
mkdir -p ~/.claude/skills
cp -r /tmp/awesome-agentic-ai/cursor-claude-codex/skills/anthropic-cybersecurity-skills/skills/orchestrating-llm-attacks-with-pyrit ~/.claude/skills/orchestrating-llm-attacks-with-pyritPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Orchestrating LLM Attacks with PyRIT > **Legal and Authorized-Use Notice:** PyRIT generates adversarial and potentially harmful prompts to test AI systems. Use it only against models and endpoints you own or are explicitly authorized to assess. Multi-turn orchestrators consume large numbers of tokens against both the target and the adversarial/scoring models; account for cost and terms of service. Unauthorized use is prohibited. ## Overview PyRIT (Python Risk Identification Tool for generative AI) is an open-source automation framework from Microsoft's AI Red Team, distributed at github.com/microsoft/PyRIT. Where a single-shot scanner sends one prompt and checks the answer, PyRIT automates *multi-turn* adversarial conversations: an attacker model and a scorer model collaborate in a loop to drive a target model toward a defined objective (for example, eliciting restricted content, leaking a system prompt, or making an agent perform an unauthorized tool call). This mirrors how real adversaries iterate against a chatbot rather than relying on one magic prompt.
Details
- Skill name
orchestrating-llm-attacks-with-pyrit- Repository
- adriannoes/awesome-agentic-ai
- Path
cursor-claude-codex/skills/anthropic-cybersecurity-skills/skills/orchestrating-llm-attacks-with-pyrit/SKILL.md- License
- MIT
- Repo updated
- 2 November 2026
FAQ
What does the Orchestrating LLM Attacks with Pyrit skill do?
Build multi-turn, Crescendo, and Tree-of-Attacks-with-Pruning (TAP) automated attack chains against conversational LLM agents using Microsoft PyRIT, with adversarial chat and scorer feedback loops.
How do I install the Orchestrating LLM Attacks with Pyrit skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add adriannoes/awesome-agentic-ai --skill orchestrating-llm-attacks-with-pyrit. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Orchestrating LLM Attacks with Pyrit popular?
It lives in adriannoes/awesome-agentic-ai, which has 100 GitHub stars and 27 forks, and is included in 2 curated skill lists.
Related skills
Browserstack
100adriannoes/awesome-agentic-ai
Run tests on BrowserStack. Use when user mentions "browserstack", "cross-browser", "cloud testing", "browser matrix", "test on safari", "test on firefox", or "browser compatibility".
Coverage
100adriannoes/awesome-agentic-ai
Analyze test coverage gaps. Use when user says "test coverage", "what's not tested", "coverage gaps", "missing tests", "coverage report", or "what needs testing".
Fix
100adriannoes/awesome-agentic-ai
Fix failing or flaky Playwright tests. Use when user says "fix test", "flaky test", "test failing", "debug test", "test broken", "test passes sometimes", or "intermittent failure".
Paw Cra Agent Creative Director
118pawbytes/skill-suites
Creative director and orchestrator for Pawbytes Creative Suites. Use when the user needs creative direction, campaign planning, brand setup, or help choosing the right creative specialist or workflow. Triggers: 'Aria', 'creative direction', 'campaign planning', 'brand setup', 'which creative agent should I use', 'creative suite'.
Markdown Rendering
100adriannoes/awesome-agentic-ai
How to reliably open a markdown file in a cmux right pane without it rendering blank. Use whenever opening/showing/rendering a .md file in cmux's right pane via `cmux markdown open`. Covers the move-surface blank-render bug and the only two reliable approaches — open it correctly the first time, or close the existing right pane(s) first then open a fresh right pane.
Paw Cra Agent Designer
118pawbytes/skill-suites
Visual production expert for production-ready social posts, carousels, flyers, brand assets, and code-based templates. Trigger when user requests 'create social post', 'design carousel', 'make flyer', 'generate logo', 'resize image', or 'create template'.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.