AI Data Extraction

AI Coding Assistant Training Data Extraction Toolkit

Complete toolkit to extract ALL chat, agent, and code context data from AI coding assistants for machine learning training.

🎯 What This Does

Automatically discovers and extracts complete conversation history including:
- ✅ User messages & AI responses
- ✅ Code context (file paths, line numbers, snippets)
- ✅ Code diffs and suggested edits
- ✅ Multi-file contexts
- ✅ Tool use and execution results
- ✅ Timestamps and metadata

Pi and OMP session exports use one shared parser. The default follows the active
branch; python3 extract_pi.py --all-branches and python3 extract_omp.py --all-branches
export separate leaf conversations with their ancestry and branch IDs. String
answers, custom context, reasoning, tool-call IDs, model changes, advisor/subagent
sessions and branch summaries are preserved. OMP also supports --prompt-history
for a separate read-only SQLite snapshot, including committed WAL rows.

extract_droid.py reads Factory/Droid sessions and settings under ~/.factory/sessions.
The aggregate script includes all three. The parser consolidation carries the
Pi/OMP work from PR #26, Joshua Warren's OMP coverage from #17 and Umang Bhalla's
Droid contribution from #7, with regression fixes and attribution.

📦 Included Scripts

1. extract_claude_code.py
Extracts from Claude Code / Claude Desktop
- Searches: ~/.claude, ~/.claude-code, ~/.claude-local, ~/.claude-m2, ~/.claude-zai
- Formats: JSONL session files
- Includes: Messages, tool use, file contexts, diffs

2. extract_codex.py
Extracts from Codex (if installed)
- Searches: ~/.codex, ~/.codex-local
- Formats: Rollout JSONL files
- Includes: User/agent messages, tool results, diffs

3. extract_cursor.py
Extracts from Cursor (Chat + Composer + Agent) - ALL…