Proposed / not yet run. Status: backlog.

This is a proposed experiment. No results have been collected yet.

The assignment

Use a small, appropriately shareable set of customer feedback to investigate where people struggle during onboarding. Ask for plausible explanations and evidence that could distinguish them.

What to record

  • The initial request and information available.
  • Questions the agent asks and assumptions it makes.
  • Changes to the task as understanding develops.
  • Sources, intermediate work, and the final contribution.
  • Human interventions and total review effort.

How to judge it

Before starting, define what useful evidence and a useful explanation would look like. Check whether observations are represented faithfully and whether missing information is acknowledged.

What this could teach us

The case may reveal missing context, weaknesses in the assignment, or a better question to ask. It will inform the next experiment without establishing that one method works everywhere.