Datafog Python

DataFog Python

DataFog is a Python library for detecting and redacting personally identifiable information (PII).

It provides:

- Fast structured PII detection via regex
- An offline PII firewall for AI agents: a Claude Code hook and a LiteLLM
  gateway guardrail (introduced in 4.6)
- Optional NER support via spaCy and GLiNER
- A simple agent-oriented API for LLM applications
- Backward-compatible DataFog and TextService classes

Agent & Gateway Firewall

DataFog includes two ready-made enforcement points that catch PII at the
moment it would leave your machine — offline, in microseconds, with matched
values never echoed into logs or transcripts:

- Claude Code hook (datafog-hook): gates agent tool calls (shell
  commands, web requests, file writes, MCP tools) and warns the model when
  prompts or tool results carry PII. ~70–90ms per invocation including
  process startup. Easiest install is the
  Claude Code plugin:

  Manual hook setup and limitations: examples/claude_code_hook/.

- LiteLLM guardrail (DataFogGuardrail): redacts or blocks PII in
  requests and responses at the gateway, for any LiteLLM-proxied provider.
  In-process (~40µs per message scanned; a request clears the guardrail in
  well under a millisecond), no sidecar service. Setup:
  examples/litellm_guardrail/.

Both default to the high-precision entity set (EMAIL, PHONE,
CREDIT_CARD, SSN); noisier types are opt-in. Known-safe values can be
exempted with an allowlist: scan(text, allowlist=[...]) for exact values,
allowlist_patterns=[...] for full-match regexes (e.g. ^\d{10}$ to stop
unix timestamps matching as phone numbers) — available in both adapters and
the API. Presidio-style entity names (EMAIL_ADDRESS, PHONE_NUMBER,
US_SSN) are accepted as aliases for easy migration.

Every performance number…