S4h Information Entropy

Measures uncertainty, surprise, and information content using Shannon entropy. Use when asked 'how much information does this actually contain', 'how uncertain is this source', 'is this result surprising', 'what should I update on', 'where is the real information in this dataset', or when you need to distinguish high-information from low-information inputs.

242 stars 25 forksWriting & Content

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add human-avatar/skills-for-humanity --skill s4h-information-entropy
Manual install
git clone --depth 1 https://github.com/human-avatar/skills-for-humanity.git /tmp/skills-for-humanity
mkdir -p ~/.claude/skills
cp -r /tmp/skills-for-humanity/skills/s4h-information-entropy ~/.claude/skills/s4h-information-entropy

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Information: Entropy

In 1948, Claude Shannon defined information in terms of surprise. The information content of a message is the degree to which it reduces your uncertainty. A message you could have predicted perfectly carries zero information — it tells you nothing you didn't already know. A completely unexpected message carries maximum information. Shannon called this quantity entropy, borrowing the term from thermodynamics: like physical entropy, it measures disorder and unpredictability.

Shannon entropy is defined as H = −∑ p(x) log₂ p(x) across all possible outcomes. The maximum entropy of a source is achieved when all outcomes are equally likely — pure unpredictability. Minimum entropy is achieved when one outcome is certain — pure predictability. Applied practically: a quarterly report that always says roughly the same thing carries low entropy. A dataset where any measurement could be anything carries high entropy. Neither extreme is ideal — maximum entropy is overwhelming, minimum entropy is uninformative.

Norbert Wiener extended this framework through cybernetics to argue that information is what distinguishes organisation from chaos in any self-regulating system. A thermostat carries information about temperature; the information is what allows the system to maintain order. Wiener's key insight: the entropic arrow runs toward decay unless information is actively used to correct it. Systems without good information channels become entropic — they drift.
Read the full skill on GitHub

Details

Skill name
s4h-information-entropy
Path
skills/s4h-information-entropy/SKILL.md
License
MIT
Repo updated
15 July 2026

FAQ

What does the S4h Information Entropy skill do?

Measures uncertainty, surprise, and information content using Shannon entropy. Use when asked 'how much information does this actually contain', 'how uncertain is this source', 'is this result surprising', 'what should I update on', 'where is the real information in this dataset', or when you need to distinguish high-information from low-information inputs.

How do I install the S4h Information Entropy skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add human-avatar/skills-for-humanity --skill s4h-information-entropy. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is S4h Information Entropy popular?

It lives in human-avatar/skills-for-humanity, which has 242 GitHub stars and 25 forks, and is included in 1 curated skill list.

Related skills

S4h

242

human-avatar/skills-for-humanity

Master orchestration skill. Takes any situation in plain English, identifies the underlying goal, designs a multi-skill reasoning workflow, and executes it sequentially — feeding each skill's output into the next. Use when you say 'help me think through this', 'I need to figure out what to do', 'where do I start', or any time you want structured thinking applied end-to-end rather than routed to a single tool.

Testing & QAIn 1 list25

S4h Aesthetic

242

human-avatar/skills-for-humanity

Entry point for the aesthetic toolkit. Routes to the right aesthetic skill based on your situation. Use when you say 'aesthetic', 'check the design', 'does this feel right', 'is this elegant', 'is this too complex', 'what pattern is this', 'find the simpler version', or want an aesthetic lens applied without knowing which specific tool fits.

OtherIn 1 list25

S4h Aesthetic Coherence Check

242

human-avatar/skills-for-humanity

Tests whether the parts of something form a unified whole — finding the jarring inconsistencies that accumulate when different contributors work without a shared vision. TRIGGERS: 'coherence check', 'does this feel unified', 'something feels off', 'inconsistent', 'check the whole', 'does this hang together'.

Testing & QAIn 1 list25

S4h Linguistics Pragmatics

242

human-avatar/skills-for-humanity

Analyzes what is implied rather than said — the gap between literal content and communicative meaning. Use when you say 'what does this really mean', 'what is this message actually doing', 'is this a threat', 'what is being implied here', 'what does this leave unsaid', 'why does this feel off even though it seems polite', or when a communication seems fine on the surface but something is wrong underneath.

Writing & ContentIn 1 list25

C Clipboard

179

daxaur/openpaw

System clipboard — copy, paste, transform content between clipboard and files.

Writing & ContentIn 1 list13

S4h Logic Consistency Check

242

human-avatar/skills-for-humanity

Surface internal contradictions, conflicting requirements, and edge cases that expose hidden conflicts in a document, spec, plan, design, or set of requirements. Use when something feels off but you can't pinpoint why, before committing to a design, or when requirements have grown incrementally and may have drifted out of sync. TRIGGERS: 'consistency check', 'find contradictions', 'does this spec make sense', 'check for conflicts', 'something feels wrong here', reviewing requirements docs, technical specs, architecture plans, product briefs, or any document where internal coherence matters.

Writing & ContentIn 1 list25

Browse the most popular Claude skills, all writing & content skills, or write your own with the skills generator.