in reviewhumanPR #369Other

LOOM HW9: agent interface, portal 0.2.1, cold-start tests (builds on #362)

Team LOOM (Qingyun Liu, Jiayi Li, Jason Xuan). This branch starts from the HW8 integration in #362 and adds the HW9 work under examples/loom/. It does not change Town's own code.

Author

Status
In review
Opened on
Nov 18
Branch
hw9-loom-usability

Description

The pitch.

## LOOM HW9: agent usability (builds on #362)

Team LOOM (Qingyun Liu, Jiayi Li, Jason Xuan). This branch starts from the HW8 integration in #362 and adds the HW9 work under `examples/loom/`. It does not change Town's own code.

- **[`AGENT_INTERFACE.md`](examples/loom/AGENT_INTERFACE.md)** is the only document an agent needs. It covers what LOOM offers, access, inputs, outputs, limits, setup and an example.
- **[`portal/`](examples/loom/portal)** is the LOOM portal 0.2.1, mirrored from `jasonpipi/loom-portal`. It adds:
  - **0.2.0:** an unsupported task from an agent working for the person becomes a proposal. The person approves, narrows or declines it with an owner token.
  - **0.2.1:** the audit log is owner-only and never stores delivered data.
  - **`--access-log`**, which records every HTTP exchange.
- **[`hw9/`](examples/loom/hw9)** holds the cold-start tests. Each run had 4 fresh agent sessions that got only the doc, a URL and a task. Each run's plan was committed before it ran. Every run includes:
  - the raw access logs;
  - the agents' deliverables and transcripts;
  - a scorer that reads the portal's log, not what the agents report.

### Results (`examples/loom/hw9/RESULTS.md`)

| Run | Portal | Passed | Note |
|---|---|---|---|
| 1 | 0.1.1 | 4/4 | Coach's task was unsupported: denied, generic plan. It noted that relabelling as `meal_plan` would have worked. |
| 2 | 0.2.0 | 4/4 | Coach got a person-approved grant. Found: `GET /log` returned every agent's delivered data to any caller. |
| 3 | 0.2.1 | 4/4 | Log fixed. |

### Test

```bash
pip install -e '.[dev]' && pip install -e examples/loom/portal
python -m pytest -q examples/loom    # 21 passed: 19 portal tests + both HW8 scenarios
```

Not addressed: an agent that relabels its task as a built-in one still gets that task's data. LOOM checks tier and fields, not purpose.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Try it

Open PR on GitHubView diff

Checkout locally

git fetch origin pull/369/head:pr-369
git checkout pr-369