Pilot Map Reduce

Distributed map-reduce over agent swarms for parallel data processing. Use this skill when: 1. You need to process large datasets across multiple workers 2. You want parallel map phase followed by aggregating reduce phase 3. You have embarrassingly parallel tasks with combine step Do NOT use this skill when: - Tasks are not parallelizable (use single worker) - You need streaming results (use pilot-load-balancer)

9 stars 3 forksProductivity & Notes

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add TeoSlayer/pilot-skills --skill pilot-map-reduce
Manual install
git clone --depth 1 https://github.com/TeoSlayer/pilot-skills.git /tmp/pilot-skills
mkdir -p ~/.claude/skills
cp -r /tmp/pilot-skills/skills/pilot-map-reduce ~/.claude/skills/pilot-map-reduce

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# pilot-map-reduce

Implement distributed map-reduce patterns for parallel data processing across agent swarms.

## Commands

### Submit map tasks to workers
```bash
TOTAL_WORKERS=$(pilotctl --json peers --search "role:mapper" | jq 'length')

for i in $(seq 0 $((TOTAL_WORKERS - 1))); do
  WORKER=$(pilotctl --json peers --search "role:mapper" | jq -r ".[$i].address")

  pilotctl --json send-message "$WORKER" \
    --data "{\"type\":\"map_task\",\"job_id\":\"$JOB_ID\",\"chunk_start\":$((i * 1000)),\"chunk_end\":$(((i + 1) * 1000))}"
done
```

### Collect map results
```bash
EXPECTED_RESULTS=$TOTAL_WORKERS
RECEIVED=0

while [ $RECEIVED -lt $EXPECTED_RESULTS ]; do
  RESULTS=$(pilotctl --json received \
    | jq '[.messages[] | select(.payload.type == "map_result" and .payload.job_id == "'$JOB_ID'")] | length')
  RECEIVED=$RESULTS
  sleep 1
done
```

### Shuffle and reduce
```bash
MAP_RESULTS=$(cat /tmp/map-results-$JOB_ID.json)
KEYS=$(echo "$MAP_RESULTS" | jq -r '.[].payload.results | to_entries | .[].key' | sort -u)

for key in $KEYS; do
  VALUES=$(echo "$MAP_RESULTS" | jq -r '[.[].payload.results."'$key'" // empty] | flatten')

  pilotctl --json send-message "$REDUCER" \
    --data "{\"type\":\"reduce_task\",\"job_id\":\"$JOB_ID\",\"key\":\"$key\",\"values\":$VALUES}"
done
```

## Workflow Example

Word count across distributed text corpus:
Read the full skill on GitHub

Details

Skill name
pilot-map-reduce
Path
skills/pilot-map-reduce/SKILL.md
License
AGPL-3.0
Repo updated
9 November 2026

FAQ

What does the Pilot Map Reduce skill do?

Distributed map-reduce over agent swarms for parallel data processing. Use this skill when: 1. You need to process large datasets across multiple workers 2. You want parallel map phase followed by aggregating reduce phase 3. You have embarrassingly parallel tasks with combine step Do NOT use this skill when: - Tasks are not parallelizable (use single worker) - You need streaming results (use pilot-load-balancer)

How do I install the Pilot Map Reduce skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add TeoSlayer/pilot-skills --skill pilot-map-reduce. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Pilot Map Reduce popular?

It lives in TeoSlayer/pilot-skills, which has 9 GitHub stars and 3 forks.

Related skills

Pilot A2a Bridge

9

TeoSlayer/pilot-skills

Bridge A2A (Agent-to-Agent) protocol messages over Pilot tunnels. Use this skill when: 1. You need to connect A2A agents across different networks 2. You want to route A2A messages through Pilot's overlay network 3. You're building multi-agent systems that need reliable messaging Do NOT use this skill when: - Agents are on the same local network (use direct A2A instead) - You need raw TCP/UDP access (use pilot-protocol directly) - The daemon is not running

AI, LLMs & Agents

Pilot Ad Campaign Manager Setup

9

TeoSlayer/pilot-skills

Deploy an ad campaign management system with 4 agents that automate campaign strategy, creative production, real-time bidding, and performance analytics. Use this skill when: 1. User wants to set up an automated ad campaign management pipeline 2. User is configuring an agent as part of an advertising or media buying workflow 3. User asks about automating campaign strategy, creative testing, or bid optimization across agents Do NOT use this skill when: - User wants to track a single metric (use pilot-metrics instead) - User wants a one-off data stream (use pilot-stream-data instead)

Marketing, Sales & Business

Pilot Agent Marketplace Setup

9

TeoSlayer/pilot-skills

Deploy a decentralized agent marketplace with 4 agents. Use this skill when: 1. User wants to set up an agent capability marketplace 2. User is configuring a directory, matchmaker, escrow, or gateway agent 3. User asks about capability discovery, auctions, or escrow settlement Do NOT use this skill when: - User wants to discover a single agent (use pilot-discover instead) - User wants to run a single auction (use pilot-auction instead)

AI, LLMs & Agents

Pilot Meeting Assistant Setup

9

TeoSlayer/pilot-skills

Deploy a meeting assistant system with 3 agents. Use this skill when: 1. User wants to set up an automated meeting assistant system 2. User is configuring an agent as part of a meeting management workflow 3. User asks about automating meeting scheduling, notes, and action tracking Do NOT use this skill when: - User wants to share a single file (use pilot-share instead) - User wants a one-off scheduled task (use pilot-cron instead)

Productivity & Notes

Pilot Expense Tracker Setup

9

TeoSlayer/pilot-skills

Deploy an expense tracking pipeline with 3 agents that automate receipt collection, categorization, and report generation. Use this skill when: 1. User wants to set up an automated expense tracking or receipt processing pipeline 2. User is configuring an agent as part of an expense management workflow 3. User asks about automating receipt-to-report expense workflows Do NOT use this skill when: - User wants to share a single file (use pilot-share instead) - User wants a one-off webhook notification (use pilot-webhook-bridge instead)

Productivity & Notes

Pilot Slack Bridge

9

TeoSlayer/pilot-skills

Bidirectional bridge between Pilot Protocol and Slack channels. Use this skill when: 1. You need to send Slack notifications from Pilot agents 2. You want to receive Slack messages in Pilot event streams 3. You're building agents that interact with Slack workspaces Do NOT use this skill when: - You only need simple webhooks (use curl instead) - Slack is not configured or accessible - The daemon is not running

Productivity & Notes

Browse the most popular Claude skills, all productivity & notes skills, or write your own with the skills generator.