Longitudinal Measurement
Tracking AI product quality over time — drift, degradation, and improvement.
Install
/plugin marketplace add Owl-Listener/ai-design-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add Owl-Listener/ai-design-skills --skill longitudinal-measurementgit clone --depth 1 https://github.com/Owl-Listener/ai-design-skills.git /tmp/ai-design-skills
mkdir -p ~/.claude/skills
cp -r /tmp/ai-design-skills/claude-plugin/evaluation/skills/longitudinal-measurement ~/.claude/skills/longitudinal-measurementPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Longitudinal Measurement AI products change over time — models get updated, usage patterns shift, and quality can drift without anyone noticing. Longitudinal measurement is how you track quality across time and catch degradation before users do. ## What Changes Over Time - **Model updates**: New model versions may improve some capabilities and regress others - **Prompt drift**: System prompts accumulate edits that may interact in unexpected ways - **Usage evolution**: Users discover new use cases that weren't tested for - **Data drift**: The real-world inputs diverge from what was tested - **Expectation drift**: Users' expectations change as they become more experienced ## What to Measure Longitudinally - **Quality scores**: Track rubric scores on a consistent test set over time - **Task success rates**: Monitor whether users are completing tasks at the same rate - **Satisfaction signals**: Track trends in explicit and implicit satisfaction - **Error rates**: Monitor failure frequency and type distribution - **Latency**: Response time changes can indicate degradation - **Engagement patterns**: Changes in usage frequency, depth, and breadth ## Measurement Infrastructure - **Golden test sets**: A fixed set of inputs evaluated regularly to detect quality changes - **Automated evaluation**: Run golden test sets automatically on a schedule - **Dashboards**: Visualise trends and set alerts for significant changes
Details
- Skill name
longitudinal-measurement- Repository
- Owl-Listener/ai-design-skills
- Path
claude-plugin/evaluation/skills/longitudinal-measurement/SKILL.md- License
- MIT
- Repo updated
- 9 June 2026
FAQ
What does the Longitudinal Measurement skill do?
Tracking AI product quality over time — drift, degradation, and improvement.
How do I install the Longitudinal Measurement skill?
Claude Code plugin: /plugin marketplace add Owl-Listener/ai-design-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Longitudinal Measurement popular?
It lives in Owl-Listener/ai-design-skills, which has 207 GitHub stars and 37 forks.
Related skills
Agent Role Design
207Owl-Listener/ai-design-skills
Defining what each agent does, knows, and owns in a multi-agent system.
Behavioral Consistency
207Owl-Listener/ai-design-skills
Ensuring the AI behaves predictably across sessions, edge cases, and modalities.
Bias Detection Design
207Owl-Listener/ai-design-skills
Designing review workflows to surface and mitigate bias in AI outputs.
Model Domain
292danielvm-git/bigpowers
Grilling session that challenges your plan against the existing domain model, sharpens terminology, and updates specs/tech-architecture/tech-stack.md and specs/adr/ inline as decisions crystallise. Use when user wants to stress-test a plan against their project's domain language and documented decisions.
Human in the Loop
207Owl-Listener/ai-design-skills
Designing intervention points where humans review, approve, or redirect agent work.
Progressive Disclosure
207Owl-Listener/ai-design-skills
Revealing AI capability gradually to match user mental models.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.