← Back to home

How the workflows work

All versions repeat the same basic idea: Agent A writes, Agent B reviews, and Agent A revises when needed. The difference is when criteria are created and how Agent B reviews the answer.

V1 — Two agents

Post-hoc Review

Agent A → Agent B → revise or finish

This is the simplest and cheapest version. There is no moderator. Agent B creates the criteria only after Agent A has written the first answer.

V1 author and reviewer graph

Agent A — Author

Receives the original user problem and writes a complete answer. After a rejection, it receives Agent B's criteria, feedback, and required changes, then writes a complete revised answer.

Agent B — Reviewer

Creates three to six checkable criteria from the original problem and reviews the answer in the same call. It gives a score, explains problems, requests changes, and decides whether to approve.

If Agent B approves, the workflow ends. Otherwise Agent A tries again until approval, the round limit, or the stall limit is reached.

V2 — With a moderator

Moderated Review

Moderator → Agent A → Agent B → Moderator

This version creates the criteria before the first answer. The criteria stay fixed, so the reviewer cannot change the goal after seeing the proposal.

V2 moderated author and reviewer graph

Moderator — Intake and final answer

First, it rewrites the user's problem clearly and creates three to six fixed acceptance criteria. At the end, it prepares the final result and clearly reports any criteria that are still not satisfied.

Agent A — Author

Receives the clearer problem and fixed criteria before writing. On later rounds, it also receives the previous review and must return a full revised answer.

Agent B — Reviewer

Checks the answer only against the fixed criteria. It gives a score, explains what is wrong, lists required changes, and approves when the answer is ready.

A deterministic routing rule—not another LLM—chooses whether to return to Agent A or continue to the moderator's final step.

V3 — With an adversarial reviewer

Adversarial Review

Moderator → Agent A → Adversarial Agent B → Moderator

V3 keeps the same moderator and fixed criteria as V2. The difference is Agent B: its main goal is to prove that the answer is not ready.

V3 moderated graph with an adversarial reviewer

Moderator — Intake and final answer

Creates the clear problem and fixed criteria before Agent A starts. At the end, it presents the best result and any remaining blockers.

Agent A — Author

Writes against the fixed criteria. When Agent B finds a blocker, Agent A receives the evidence and requested correction, then writes the complete answer again.

Agent B — Adversarial reviewer

Looks for missing requirements, violated criteria, edge cases, ambiguities, and risks. It must provide evidence for real blockers. It does not give a numeric score and approves only when no blocking defect remains.

The routing rule repeats the author/reviewer loop while blocking findings remain, unless the round or stall limit ends the process.

Evaluation happens after the workflows

The optional experiment evaluator is separate from the moderator and reviewers above. It receives one anonymized final answer at a time and checks it against the evaluation criteria supplied by the user.

Agent prompt