Orchestrating LLM Attacks with Pyrit

Build multi-turn, Crescendo, and Tree-of-Attacks-with-Pruning (TAP) automated attack chains against conversational LLM agents using Microsoft PyRIT, with adversarial chat and scorer feedback loops.

100 stars 27 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add adriannoes/awesome-agentic-ai --skill orchestrating-llm-attacks-with-pyrit
Manual install
git clone --depth 1 https://github.com/adriannoes/awesome-agentic-ai.git /tmp/awesome-agentic-ai
mkdir -p ~/.claude/skills
cp -r /tmp/awesome-agentic-ai/cursor-claude-codex/skills/anthropic-cybersecurity-skills/skills/orchestrating-llm-attacks-with-pyrit ~/.claude/skills/orchestrating-llm-attacks-with-pyrit

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Orchestrating LLM Attacks with PyRIT

> **Legal and Authorized-Use Notice:** PyRIT generates adversarial and potentially harmful prompts to test AI systems. Use it only against models and endpoints you own or are explicitly authorized to assess. Multi-turn orchestrators consume large numbers of tokens against both the target and the adversarial/scoring models; account for cost and terms of service. Unauthorized use is prohibited.

## Overview

PyRIT (Python Risk Identification Tool for generative AI) is an open-source automation framework from Microsoft's AI Red Team, distributed at github.com/microsoft/PyRIT. Where a single-shot scanner sends one prompt and checks the answer, PyRIT automates *multi-turn* adversarial conversations: an attacker model and a scorer model collaborate in a loop to drive a target model toward a defined objective (for example, eliciting restricted content, leaking a system prompt, or making an agent perform an unauthorized tool call). This mirrors how real adversaries iterate against a chatbot rather than relying on one magic prompt.
Read the full skill on GitHub

Details

Skill name
orchestrating-llm-attacks-with-pyrit
Path
cursor-claude-codex/skills/anthropic-cybersecurity-skills/skills/orchestrating-llm-attacks-with-pyrit/SKILL.md
License
MIT
Repo updated
2 November 2026

FAQ

What does the Orchestrating LLM Attacks with Pyrit skill do?

Build multi-turn, Crescendo, and Tree-of-Attacks-with-Pruning (TAP) automated attack chains against conversational LLM agents using Microsoft PyRIT, with adversarial chat and scorer feedback loops.

How do I install the Orchestrating LLM Attacks with Pyrit skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add adriannoes/awesome-agentic-ai --skill orchestrating-llm-attacks-with-pyrit. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Orchestrating LLM Attacks with Pyrit popular?

It lives in adriannoes/awesome-agentic-ai, which has 100 GitHub stars and 27 forks, and is included in 2 curated skill lists.

Related skills

Browserstack

100

adriannoes/awesome-agentic-ai

Run tests on BrowserStack. Use when user mentions "browserstack", "cross-browser", "cloud testing", "browser matrix", "test on safari", "test on firefox", or "browser compatibility".

Testing & QAIn 2 lists27

Coverage

100

adriannoes/awesome-agentic-ai

Analyze test coverage gaps. Use when user says "test coverage", "what's not tested", "coverage gaps", "missing tests", "coverage report", or "what needs testing".

Testing & QAIn 2 lists27

Fix

100

adriannoes/awesome-agentic-ai

Fix failing or flaky Playwright tests. Use when user says "fix test", "flaky test", "test failing", "debug test", "test broken", "test passes sometimes", or "intermittent failure".

Testing & QAIn 2 lists27

Paw Cra Agent Creative Director

118

pawbytes/skill-suites

Creative director and orchestrator for Pawbytes Creative Suites. Use when the user needs creative direction, campaign planning, brand setup, or help choosing the right creative specialist or workflow. Triggers: 'Aria', 'creative direction', 'campaign planning', 'brand setup', 'which creative agent should I use', 'creative suite'.

AI, LLMs & Agents23

Markdown Rendering

100

adriannoes/awesome-agentic-ai

How to reliably open a markdown file in a cmux right pane without it rendering blank. Use whenever opening/showing/rendering a .md file in cmux's right pane via `cmux markdown open`. Covers the move-surface blank-render bug and the only two reliable approaches — open it correctly the first time, or close the existing right pane(s) first then open a fresh right pane.

AI, LLMs & AgentsIn 2 lists27

Paw Cra Agent Designer

118

pawbytes/skill-suites

Visual production expert for production-ready social posts, carousels, flyers, brand assets, and code-based templates. Trigger when user requests 'create social post', 'design carousel', 'make flyer', 'generate logo', 'resize image', or 'create template'.

AI, LLMs & Agents23

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.