Harbor

Harbor framework for agent evaluation. Use when: (1) Running harbor commands (harbor run, harbor tasks check), (2) Creating/validating SkillsBench tasks, (3) Understanding task format or debugging failures.

49 stars 5 forksProductivity & Notes

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add UCSB-NLP-Chang/Skill-Usage --skill harbor
Manual install
git clone --depth 1 https://github.com/UCSB-NLP-Chang/Skill-Usage.git /tmp/Skill-Usage
mkdir -p ~/.claude/skills
cp -r /tmp/Skill-Usage/.claude/skills/harbor ~/.claude/skills/harbor

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Harbor

Agent evaluation framework from the creators of Terminal-Bench.

## Official Documentation

- **Docs**: https://harborframework.com/docs
- **Getting Started**: https://harborframework.com/docs/getting-started
- **GitHub**: https://github.com/laude-institute/harbor

## Local Workspace & API Keys

- **`.local-workspace/`** - Git-ignored directory for cloning PRs, temporary files, external repos, etc.
- **`.local-workspace/.env`** - May contain `ANTHROPIC_API_KEY` and other API credentials. Check and use when running harbor with API access.

## Quick Reference

```bash
# Install
uv tool install harbor

# Validate task
harbor tasks check tasks/<task-id>

# Run oracle (must pass 100%)
harbor run -p tasks/<task-id> -a oracle

# Run with agent (specify model with -m)
harbor run -p tasks/<task-id> -a claude-code -m 'anthropic/claude-opus-4-5'

# List datasets
harbor datasets list

# Cloud execution (parallel)
harbor run -d "<dataset@version>" -a "<agent>" -m "<model>" --env "daytona" -n 32
```

## SkillsBench Task Structure

```
tasks/<task-id>/
  task.toml           # Metadata
  instruction.md      # Agent instructions
  environment/
    Dockerfile        # Container + COPY skills to all agent locations
    skills/           # Skills for agents
  tests/
    test.sh           # Runs pytest, writes reward.txt
    test_outputs.py   # Test cases
  solution/
    solve.sh          # Oracle solution (human-written)
```

## Results Location

`jobs/<timestamp>/<task-id>/`:
Read the full skill on GitHub

Details

Skill name
harbor
Path
.claude/skills/harbor/SKILL.md
Repo updated
8 April 2026

FAQ

What does the Harbor skill do?

Harbor framework for agent evaluation. Use when: (1) Running harbor commands (harbor run, harbor tasks check), (2) Creating/validating SkillsBench tasks, (3) Understanding task format or debugging failures.

How do I install the Harbor skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add UCSB-NLP-Chang/Skill-Usage --skill harbor. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Harbor popular?

It lives in UCSB-NLP-Chang/Skill-Usage, which has 49 GitHub stars and 5 forks.

Related skills

Pubchem Database

49

UCSB-NLP-Chang/Skill-Usage

Query PubChem via PUG-REST API/PubChemPy (110M+ compounds). Search by name/CID/SMILES, retrieve properties, similarity/substructure searches, bioactivity, for cheminformatics.

Databases

Pymatgen

49

UCSB-NLP-Chang/Skill-Usage

Materials science toolkit. Crystal structures (CIF, POSCAR), phase diagrams, band structure, DOS, Materials Project integration, format conversion, for computational materials science.

Research & Science

Rdkit

49

UCSB-NLP-Chang/Skill-Usage

Cheminformatics toolkit for fine-grained molecular control. SMILES/SDF parsing, descriptors (MW, LogP, TPSA), fingerprints, substructure search, 2D/3D generation, similarity, reactions. For standard workflows with simpler interface, use datamol (wrapper around RDKit). Use rdkit for advanced control, custom sanitization, specialized algorithms.

Frontend & Design

Lean4 Memories

49

UCSB-NLP-Chang/Skill-Usage

This skill should be used when working on Lean 4 formalization projects to maintain persistent memory of successful proof patterns, failed approaches, project conventions, and user preferences across sessions using MCP memory server integration

Productivity & Notes

Gmail Skill

49

UCSB-NLP-Chang/Skill-Usage

Manage Gmail - send, read, search emails, manage labels and drafts. Use when user wants to interact with their Gmail account for email operations.

Productivity & Notes

Memory Optimization

49

UCSB-NLP-Chang/Skill-Usage

Optimize Python code for reduced memory usage and improved memory efficiency. Use when asked to reduce memory footprint, fix memory leaks, optimize data structures for memory, handle large datasets efficiently, or diagnose memory issues. Covers object sizing, generator patterns, efficient data structures, and memory profiling strategies.

Productivity & Notes

Browse the most popular Claude skills, all productivity & notes skills, or write your own with the skills generator.