Contributors
Authors
In manuscript order1 University College London2 University of Liverpool3 Imperial College London4 University of Electronic Science and Technology of China5 Peking University6 University of North Carolina at Chapel Hill
Domain Expertise & Task Review
Domain experts author professional assignments and define the criteria used to evaluate them. Each admitted task undergoes automated review and independent review by two human reviewers.
- Expert DesignA domain expert drafts the task from a workflow in their own practice: inputs, deliverable and checklist for every level.
- Agent Review & Real RunA review agent audits the draft with a human-authored review skill, then runs it end to end. Verdict: Strong Accept, Accept, Borderline, Major Revision or Reject.
- Dual Human ReviewTasks rated Accept or higher go to two randomly assigned reviewers, who review independently. Both must accept.
- Admitted to CLEThe 120 tasks that cleared both gates form the benchmark.
Feedback: a rejection at either gate returns the task to its author for revision.
The author list and affiliations above follow the current manuscript. Additional contributor acknowledgements will be added when the list is confirmed.
Contact
For questions about the research, contact the corresponding author, Jun Wang.
jun.wang@cs.ucl.ac.uk ↗