Independent · non-commercial · publishes on a quarterly cycle|Current cycle 2026 Q3
Compound Evidence InstituteEvidence synthesis · established 2023Graded assessments of compounds, trials, methods and supply
Document set current to 30 July 2026
Public comment period · §3

Draft synthesis: Completeness of certificates of analysis in… — disposition

The disposition of every submission and the amendments that resulted.

Document identifier
CEI-CP-105/3
Series
Public comment period
Version
1.0
Published
12 Dec 2025
Last reviewed
12 Dec 2025
Next review
12 Dec 2026
Identifier
10.71829/cei.cp.105
Certainty
Not rated
Cycle
2025 Q4
Window
06 Oct 2025 – 03 Nov 2025
Status
Closed
Submissions
8

§3Disposition and amendments

§3.1Disposition table

Table 1. Every submission with its disposition. Each row links to the submission in full.

ReferenceRespondentPoint raisedDisposition
DRAFT-COA-COMPLETE/007Dr Jerome PetrossianA funnel plot is presented for a set too small to interpret itAccepted
DRAFT-COA-COMPLETE/008Dr Theodora Ximenes industryA sponsor trial meeting the eligibility criteria was excludedAccepted in part
DRAFT-COA-COMPLETE/005Dr Quintus KettlewellThe document is unreadable without specialist trainingAccepted in part
DRAFT-COA-COMPLETE/006Dr Theodora IngelbrechtBaseline imbalance in a small contributing trial is not remarked onNoted, no amendment
DRAFT-COA-COMPLETE/004Dr Ottoline Oppenheimer-AdeThe review protocol is described but its registration record is not linkedAccepted in part
DRAFT-COA-COMPLETE/003Dr Hortensia Larsson-EkwuemeAnalytical surveys are treated as evidence about suppliers when they establish only what was in a sampleAccepted
DRAFT-COA-COMPLETE/002Dr Quentin Whitmarsh-ObiRisk-of-bias judgements are reported as an overall rating without the domainsAccepted
DRAFT-COA-COMPLETE/001Dr Delphine TrelawneyThe review does not say when it will be updated or what would trigger an updateAccepted
8 submissions in total.

§3.2Summary by disposition

Table 2. Counts by disposition, with the meaning of each.

DispositionCountMeaning
Accepted4The submission is accepted and the draft is amended as proposed. The amendment is recorded in the amendment log of the document it changed and is traceable to the numbered submission.
Accepted in part3Part of the submission is accepted and part is not. The secretariat response states which part is which and on what ground the remainder was declined.
Noted, no amendment1The submission raises a point the Institute accepts but that does not require a change to the draft, most often because the draft already states it elsewhere. The location is given in the response.
Not accepted0The submission is not accepted. The secretariat response gives the reason. A submission that is not accepted remains published in full; the Institute does not remove a submission because it disagrees with it.

§3.3Resulting amendments

  1. A funnel plot is presented for a set too small to interpret it — arising from DRAFT-COA-COMPLETE/007. The funnel plot is removed for every outcome contributed by fewer than ten studies, and replaced by a statement that small-study effects could not be assessed at that number, together with the count of registered trials identified without posted results.
  2. A sponsor trial meeting the eligibility criteria was excluded — arising from DRAFT-COA-COMPLETE/008. The trial is added to the included set, the estimate and the certainty rating have been recomputed, and the screening record now states why the trial was missed, which was a database indexing gap rather than a screening judgement. The submission is identified…
  3. The document is unreadable without specialist training — arising from DRAFT-COA-COMPLETE/005. Every document now opens with a plain-language summary of not more than 150 words, placed above the technical abstract and carrying the same certainty language, so that the two cannot diverge.
  4. The review protocol is described but its registration record is not linked — arising from DRAFT-COA-COMPLETE/004. Each synthesis now links its own protocol with the version in force at screening, and states explicitly where an external registration identifier is not held, so that the absence is a recorded fact.
  5. Analytical surveys are treated as evidence about suppliers when they establish only what was in a… — arising from DRAFT-COA-COMPLETE/003. Provenance is now assessed for every included survey and reported as a study characteristic, surveys without establishable provenance are reported separately rather than pooled with those that have it, and no supplier-level inference is drawn from a…
  6. Risk-of-bias judgements are reported as an overall rating without the domains — arising from DRAFT-COA-COMPLETE/002. Risk of bias is now reported at domain level for every included study, with the text on which each judgement was based quoted and referenced, and the overall judgement derived from the domains rather than asserted alongside them.
  7. The review does not say when it will be updated or what would trigger an update — arising from DRAFT-COA-COMPLETE/001. Every synthesis now records a scheduled review date and a stated update trigger, being the reporting of a trial that would materially change the contributing evidence, and the registered trials capable of triggering an update are listed by name.

References cited on this page

References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.

  1. International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute

Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.

Nothing published by the Institute is medical advice, a diagnosis, a prescription, a treatment recommendation or a purchasing recommendation. Compounds supplied for research use are not approved for human or veterinary use in any jurisdiction, and a favourable analytical assessment of a supplier is not a statement that any product is safe or effective. The Institute publishes certainty ratings and never recommendations. No telephone number, messaging handle or ordering channel appears anywhere on this site.