Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft corrections and versioning policy — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-022/3
Series
Public comment period
Version
1.0
Published
06 Sep 2024
Last reviewed
06 Sep 2024
Next review
06 Sep 2025
Identifier
10.71829/cei.cp.22
Certainty
Not rated
Cycle
2024 Q3
Window
16 Jul 2024 – 13 Aug 2024
Status
Closed
Submissions
19

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-CORRECTIONS-/016Dr Ludmila TollemacheWhat the site collects about a reader is not stated in terms a reader can checkAccepted
DRAFT-CORRECTIONS-/003Dr Ulysses Bellingham-OjoPoint estimates are given without an intervalAccepted in part
DRAFT-CORRECTIONS-/017Dr Liesbeth QuennevilleAnonymous submissions should be accepted where the respondent risks employment consequencesNot accepted
DRAFT-CORRECTIONS-/004Dr Abimbola Sotomayor-EkwuemeThe search date is not on the face of the documentAccepted
DRAFT-CORRECTIONS-/005Dr Quentin ZimmerthalWhether external reviewers are paid is not statedAccepted
DRAFT-CORRECTIONS-/018Dr Dmitri NordhagenThe terms on which the documents may be reused are not statedAccepted
DRAFT-CORRECTIONS-/006Dr Delphine TrelawneyThe position of a contributor who withdraws consent is not statedAccepted
DRAFT-CORRECTIONS-/011Rosalind PetrossianA sortable table implies a comparison the underlying data do not supportNoted, no amendment
DRAFT-CORRECTIONS-/019Dr Hyacinth Oyelaran-SteenReferences should carry a persistent identifier for every cited sourceAccepted in part
DRAFT-CORRECTIONS-/010Dr Quintus KettlewellDisagreement within the assessment committee is not visibleAccepted
DRAFT-CORRECTIONS-/013Dr Georgiana MountstephenThe threshold between a correction and a new version is drawn too highAccepted in part
DRAFT-CORRECTIONS-/009Dr Theodora IngelbrechtWhere a document is generated rather than authored, the reader should be toldAccepted
DRAFT-CORRECTIONS-/012Dr Rukayat Zaleski-MbekiThe same concept is given three different names in one documentAccepted
DRAFT-CORRECTIONS-/008Dr Theodora TrelawneyThe document set should be published in translationNot accepted
DRAFT-CORRECTIONS-/001Dr Wilhelmina QuaresmaFunding should not be accepted from any party the Institute assessesAccepted in part
DRAFT-CORRECTIONS-/015Dr Jolyon Grünbaum-SowandeAbsence of evidence is presented in a form a reader will take as negative evidenceAccepted
DRAFT-CORRECTIONS-/002Ivo MountstephenThe materiality threshold for a declarable holding is set too highAccepted in part
DRAFT-CORRECTIONS-/007Dr Eamon Sandringham-AduThe policy does not say what happens to a document the Institute is asked to removeAccepted
DRAFT-CORRECTIONS-/014Dr Jolanta UttridgeThe document is unreadable without specialist trainingAccepted in part
19 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted10The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part6Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment1The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted2The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. What the site collects about a reader is not stated in terms a reader can check — arising from DRAFT-CORRECTIONS-/016. The statement now enumerates what is collected and what is not, and is written so that a reader can verify it from the page source, which is the only form of the statement that can be checked without trusting the Institute.
  2. Point estimates are given without an interval — arising from DRAFT-CORRECTIONS-/003. Every estimate now carries its interval where the source reported one, and where it did not, the estimate is annotated as reported without an interval rather than left to appear as a precise figure.
  3. The search date is not on the face of the document — arising from DRAFT-CORRECTIONS-/004. The search date is now printed adjacent to every certainty rating and is carried in the document metadata, so that the interval between the search and the reading is visible without reference to the methods section.
  4. Whether external reviewers are paid is not stated — arising from DRAFT-CORRECTIONS-/005. The policy now states whether external review is remunerated, records any payment made in respect of a document in that document's front matter, and treats a payment received from the Institute as a declarable interest in the same way as any other.
  5. The terms on which the documents may be reused are not stated — arising from DRAFT-CORRECTIONS-/018. The reuse terms are now stated explicitly on the legal page and in the document footer, permitting quotation and reproduction with attribution and the document version, and requiring that any reproduction carry the certainty rating that accompanied the quoted…
  6. The position of a contributor who withdraws consent is not stated — arising from DRAFT-CORRECTIONS-/006. The policy now states that a contributor may withdraw from the register at any time and that the register entry is removed, while a signed submission already published remains published, because the consultation record is a record of what was said and by…
  7. References should carry a persistent identifier for every cited source — arising from DRAFT-CORRECTIONS-/019. Every reference without a persistent identifier now carries an explicit statement that the identifier is not held by the Institute, so that its absence is a recorded fact rather than an apparent oversight.
  8. Disagreement within the assessment committee is not visible — arising from DRAFT-CORRECTIONS-/010. A ratification record is now published with every document stating whether the assessment was unanimous, and a member may record a dissenting statement which is published with the document rather than in minutes.
  9. The threshold between a correction and a new version is drawn too high — arising from DRAFT-CORRECTIONS-/013. The versioning threshold is now stated by category: a change to a certainty rating, an effect estimate or a conclusion produces a new version at a new address, and every other change is a logged correction that states the previous wording.
  10. Where a document is generated rather than authored, the reader should be told — arising from DRAFT-CORRECTIONS-/009. Every generated record now carries a notice stating that its prose frame is templated and that its included studies, summary of findings and certainty rating are computed from the underlying records, so that the reader can see which parts were authored and…
  11. The same concept is given three different names in one document — arising from DRAFT-CORRECTIONS-/012. A single term is now used throughout for each defined concept, and the glossary entry is linked at first use within each section rather than once per document.
  12. Funding should not be accepted from any party the Institute assesses — arising from DRAFT-CORRECTIONS-/001. The policy now prohibits funding from an assessed party for any activity bearing on that party's assessment, requires that any other relationship be published on the funding page and on every page it could bear on, and records the sums involved rather than…
  13. Absence of evidence is presented in a form a reader will take as negative evidence — arising from DRAFT-CORRECTIONS-/015. A standing formulation has been adopted and is applied wherever an evidence gap is recorded, distinguishing an outcome assessed and not demonstrated from an outcome not assessed. The formulation is identical at every occurrence so that it can be recognised at…
  14. The materiality threshold for a declarable holding is set too high — arising from DRAFT-CORRECTIONS-/002. The materiality threshold is lowered and is now expressed as a proportion of the declarer's holdings as well as an absolute figure, so that a holding material to the person is declarable whether or not it is large in absolute terms.
  15. The policy does not say what happens to a document the Institute is asked to remove — arising from DRAFT-CORRECTIONS-/007. The grounds for withdrawal are now stated exhaustively, being a factual error that cannot be corrected in place and a legal obligation, a withdrawn document is replaced by a notice recording the fact and the ground rather than removed, and every withdrawal is…
  16. The document is unreadable without specialist training — arising from DRAFT-CORRECTIONS-/014. Every document now opens with a plain-language summary of not more than 150 words, placed above the technical abstract and carrying the same certainty language, so that the two cannot diverge.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.