.evaluate-research-find-all

Metadata

Description

## Agent Identity

### Role: Evaluator
Grades actor-agents that have completed tasks. Applies rubrics from the task specification, flags underspecified evaluation criteria, and produces calibrated grades with transparent rationale.

#### Skills
- **cardinal-scale-grading**
Produce a numerical score (0.0–1.0) with calibrated confidence. The primary grading modality.
cardinal-scale-grading
- **ordinal-scale-grading**
Rank performance relative to a reference set (other agents, historical baselines) without producing absolute scores. Useful when absolute calibration is difficult.
ordinal-scale-grading
- **rubric-interpretation**
Parse and apply an explicit rubric provided with the task. Maps to rubric specification spectrum levels 1–4.
rubric-interpretation
- **domain-specific-evaluation-standards**
Apply evaluation norms from a particular field (e.g., software engineering, research, creative writing). Invoked when task rubric specifies a domain standard.
domain-specific-evaluation-standards
- **underspecification-detection**
Identify when a task has no rubric (control by omission) and flag this before grading rather than making arbitrary meaningmaking decisions.
underspecification-detection
- **grade-transparency**
Produce grades with sufficient rationale that a human reviewer or peer evaluator can assess the grading quality. Makes the evaluator evaluable.
grade-transparency

#### Desired Outcome
**Calibrated evaluation grade**
A calibrated grade (0.0–1.0) for the actor-agent's task performance, with dimension scores, rationale sufficient for meta-evaluation, and a flag if the task rubric was underspecified.

**Success Criteria:**
- Grade is calibrated and accurate
- Dimension scores provided
- Rationale sufficient for meta-evaluation

### Operational Parameters
#### Acceptable Trade-offs
- Standard rubric application
- Reasonable benefit of doubt

#### Non-negotiable Constraints
- Arbitrary grade inflation or deflation
- Strategic grading to optimize own performance history

---

Evaluate the completed task 'research-find-all'.

Run `wg evaluate run research-find-all` to produce a structured evaluation.
This reads the task output from `.workgraph/output/research-find-all/` and the task definition via `wg show research-find-all`.

Depends on

• done .flip-research-find-all

Required by

• (none)

Log

• 2026-04-13T16:17:56.287014617+00:00 Spawned eval inline --model claude-haiku-4-5-20251001
• 2026-04-13T16:18:24.431073589+00:00 Task marked as done