Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft certainty index — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-038/3
Series
Public comment period
Version
1.0
Published
10 Jul 2026
Last reviewed
10 Jul 2026
Next review
10 Jul 2027
Identifier
10.71829/cei.cp.38
Certainty
Not rated
Cycle
2026 Q3
Window
10 Jul 2026 – 07 Aug 2026
Status
Open
Submissions
15

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-CERTAINTY-IN/004Dr Fenella LavrentievAbsence of evidence is presented in a form a reader will take as negative evidenceAccepted
DRAFT-CERTAINTY-IN/001Dr Wilhelmina Wintringham industryTwo factual descriptions of the sponsor's programme are inaccurateAccepted
DRAFT-CERTAINTY-IN/002Dr Matthias Whitmarsh-ObiReferences should carry a persistent identifier for every cited sourceAccepted in part
DRAFT-CERTAINTY-IN/006Dr Hamish Nyquist-ObioraThe front matter delays the reader from reaching the assessmentAccepted in part
DRAFT-CERTAINTY-IN/014Dr Lorcan TrelawneyThe anchor outcome for an indication is not the outcome a decision turns onAccepted in part
DRAFT-CERTAINTY-IN/003Ludmila BrackenridgeIndications for which compounds are supplied are absent from the setAccepted
DRAFT-CERTAINTY-IN/015Dr Theodora TrelawneyAn identifier that encodes the document type will have to change when the type doesAccepted
DRAFT-CERTAINTY-IN/010Dr Quintus RautavaaraThe same quantity is presented differently in two seriesAccepted
DRAFT-CERTAINTY-IN/009Dr Gervase CrickhowellThe index shows ratings without the reasons behind themAccepted
DRAFT-CERTAINTY-IN/012Dr Yaa KettlewellThe registry is published only as pages and not in a form that can be processedAccepted
DRAFT-CERTAINTY-IN/005Dr Marisol Dunmore-EkpoAn index organised by certainty invites comparison between ratings that are not comparableAccepted in part
DRAFT-CERTAINTY-IN/008Dr Frideswide NordhagenThe search date is not on the face of the documentAccepted
DRAFT-CERTAINTY-IN/013Dr Séverin Oppenheimer-AdeA surrogate anchor should not be permitted at allAccepted in part
DRAFT-CERTAINTY-IN/011Vasilisa Sandringham-AduA withdrawn document should not simply disappearAccepted
DRAFT-CERTAINTY-IN/007Dr Valentin Castellanos-ReidThe default ordering of a comparison table carries an implicationAccepted
15 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted10The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part5Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment0The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted0The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. Absence of evidence is presented in a form a reader will take as negative evidence — arising from DRAFT-CERTAINTY-IN/004. A standing formulation has been adopted and is applied wherever an evidence gap is recorded, distinguishing an outcome assessed and not demonstrated from an outcome not assessed. The formulation is identical at every occurrence so that it can be recognised at…
  2. Two factual descriptions of the sponsor's programme are inaccurate — arising from DRAFT-CERTAINTY-IN/001. The trial status now reads as completed at a pre-specified interim analysis, with the analysis identified, and the dose is stated in the unit used in the approved labelling. The submission is identified as an industry submission on its face in accordance with…
  3. References should carry a persistent identifier for every cited source — arising from DRAFT-CERTAINTY-IN/002. Every reference without a persistent identifier now carries an explicit statement that the identifier is not held by the Institute, so that its absence is a recorded fact rather than an apparent oversight.
  4. The front matter delays the reader from reaching the assessment — arising from DRAFT-CERTAINTY-IN/006. Every document now opens with its assessment statement and its certainty rating, with the identifiers, dates and declarations following immediately beneath rather than above, so that the first thing read is the finding and the second is its provenance.
  5. The anchor outcome for an indication is not the outcome a decision turns on — arising from DRAFT-CERTAINTY-IN/014. One anchor outcome is changed to the outcome proposed, and the second is retained with the alternative recorded as the preferred anchor and listed as an evidence gap, so that the reason for the compromise is on the record.
  6. Indications for which compounds are supplied are absent from the set — arising from DRAFT-CERTAINTY-IN/003. Uses observed in supply are now included in the indication set, marked as having no approved status and no anchor outcome, and each carries an explicit statement that no trial evidence was identified where that is the case.
  7. An identifier that encodes the document type will have to change when the type does — arising from DRAFT-CERTAINTY-IN/015. The identifier is now opaque and permanent from first publication, the series and type are recorded as fields that may change, and a reclassified document keeps the identifier it was issued with.
  8. The same quantity is presented differently in two series — arising from DRAFT-CERTAINTY-IN/010. Certainty ratings are now presented identically across every series, using the same badge, the same wording and the same accompanying formulation, and the presentation is specified in the series structure document rather than left to each series.
  9. The index shows ratings without the reasons behind them — arising from DRAFT-CERTAINTY-IN/009. Every index row now carries the downgrade domains alongside the rating, and the index can be filtered by domain so that a reader can see, for example, every outcome downgraded for imprecision across the document set.
  10. The registry is published only as pages and not in a form that can be processed — arising from DRAFT-CERTAINTY-IN/012. The registry fields are now emitted in a structured form alongside the rendered pages, carrying the identifier, series, type, version, dates, certainty rating and status for every document, and the structured record is regenerated with the site so that it…
  11. An index organised by certainty invites comparison between ratings that are not comparable — arising from DRAFT-CERTAINTY-IN/005. The index is now grouped by domain with certainty as the ordering within each group, and a standing statement records that ratings in different domains are not directly comparable and states why.
  12. The search date is not on the face of the document — arising from DRAFT-CERTAINTY-IN/008. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
  13. A surrogate anchor should not be permitted at all — arising from DRAFT-CERTAINTY-IN/013. A surrogate may now serve as an anchor only where the document states the evidence for the surrogate relationship in the population concerned and rates that evidence separately, and every document with a surrogate anchor carries the rating on its face.
  14. A withdrawn document should not simply disappear — arising from DRAFT-CERTAINTY-IN/011. A withdrawn document is now replaced at its own address by a notice recording its identifier, its title, the date and ground of withdrawal, and a link to whatever supersedes it, and the withdrawal is recorded in the corrections log.
  15. The default ordering of a comparison table carries an implication — arising from DRAFT-CERTAINTY-IN/007. The default ordering is now alphabetical, a standing statement above every comparison table records that the ordering is not a ranking, and the sort state is reset on reload so that a shared link does not carry an ordering the sender chose.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.