Draft monograph: KPV — submissions
The 15 submissions received, published in full with declared interests and secretariat responses.
§2Submissions and responses
15 submissions were received. Each is published in full below with its declared interest, the secretariat response and the disposition. The Institute publishes submissions it did not accept in the same form as those it did.
The pharmacokinetic section does not connect half-life to the dosing schedule
The draft reports a half-life and, separately, a dosing interval. The respondent, a clinical pharmacologist, states that the relationship between the two is what determines accumulation and time to steady state, and that the monograph leaves the reader to derive it.
The respondent proposes that time to steady state be stated explicitly, with the assumption from which it was derived.
The secretariat accepts this submission. The derivation is short, it is decision-relevant, and leaving it to the reader invites it to be done wrong.
The pharmacokinetic section now states approximate time to steady state alongside the half-life and dosing interval, with the assumption of first-order elimination stated, and records where the assumption is not supported for this compound.
Absence of evidence is presented in a form a reader will take as negative evidence
Where the Institute has identified no study, the draft states that no evidence was found. In several places that sentence sits immediately after a paragraph describing an adverse outcome, and the juxtaposition invites the reading that the compound was studied and found wanting.
The respondent proposes a standing formulation, used identically wherever the situation arises, distinguishing an outcome that was studied and not demonstrated from an outcome that has not been studied at all.
The secretariat accepts this submission. The two states are different, they support different decisions, and the draft rendered them in language a reader could not reliably separate.
A standing formulation has been adopted and is applied wherever an evidence gap is recorded, distinguishing an outcome assessed and not demonstrated from an outcome not assessed. The formulation is identical at every occurrence so that it can be recognised at a glance.
The analytical section is longer than the clinical assessment it accompanies
The respondent, an academic pharmacologist, states that the analytical section occupies more of the monograph than the assessment of clinical effect, and that the proportions imply the Institute considers the analytical question the more important one.
The respondent proposes that the analytical material be moved to the standards series and referenced rather than reproduced.
The secretariat accepts this submission in part. The general analytical material is moved to the standards series and referenced. The compound-specific material stays, because a reader holding a certificate for this compound needs to know what that certificate does and does not establish for this compound.
The analytical section is reduced to compound-specific content and cross-references the relevant standards for the general procedure, which shortens it substantially without removing what is not available elsewhere.
Mechanistic claims for a peptide fragment are carried without evidence that the fragment acts as described
The respondent states that the draft repeats a mechanistic account originating in supply documentation rather than in the primary literature, and that the account attributes activity to a fragment on the basis of the activity of the parent molecule.
The respondent proposes that any mechanistic claim be traceable to a primary source and removed where it is not.
The secretariat accepts this submission. A mechanism repeated from marketing material has no evidential status regardless of how widely it is repeated.
Mechanistic claims not traceable to a primary source are removed, and those retained carry their source and a statement of whether the underlying work was conducted in vitro, in animals or in humans.
Regulatory status is stated without naming the jurisdiction
The draft states that the compound is approved, or not approved, without saying by whom. The respondent, employed by a health-technology assessment body, states that approval status differs between jurisdictions for several compounds in the series and that an unqualified statement will be wrong somewhere.
The respondent proposes that every status statement name the authority and carry the date on which the status was checked.
The secretariat accepts this submission. An unattributed status statement is a claim the Institute cannot support.
Every regulatory status statement now names the authority, states the date on which the status was verified, and is recorded per jurisdiction rather than as a single global assertion.
What happens when the compound is stopped is not addressed
The draft assesses the effect of the compound while it is being taken. The respondent, who declares having used a compound in the class under prescription, states that the question a person actually faces is what happens afterwards, and that the monograph is silent on it.
The respondent proposes that the trajectory after discontinuation be an assessed outcome wherever any contributing trial measured it, and a recorded evidence gap wherever none did.
The secretariat accepts this submission. The omission was one of framing rather than of evidence, and the framing followed the trials rather than the decision.
Discontinuation trajectory is now an assessed outcome in every monograph where a contributing trial measured it, and a recorded evidence gap in every monograph where none did, so that its absence is visible rather than silent.
Trials are described as terminated where they completed as planned
The respondent states that the draft uses the word terminated for trials stopped at pre-specified interim analyses, for trials stopped for futility and for trials closed for commercial reasons, and that these are three different facts.
The respondent proposes that the status vocabulary be fixed and defined in the glossary.
The secretariat accepts this submission in part. The vocabulary is fixed and defined. The proposal to distinguish commercial closure from futility in every case is accepted only where the Institute holds a document stating the reason.
Trial status now uses a fixed vocabulary defined in the glossary, and where the reason for stopping is not evidenced by a document the Institute holds, the status is recorded as stopped with the reason not established rather than assigned.
A superseded version should remain reachable from the version that replaced it
The respondent states that the draft supersedes an earlier document and that a reader who cited the earlier version has no way to reach it from the new one, which makes it impossible to see what changed.
The respondent asks that every version carry a link both to what it supersedes and to what supersedes it.
The secretariat notes this submission. The corrections and versioning policy already requires bidirectional version links and every superseded document is retained at its own address.
No amendment arises. The requirement is stated in the corrections and versioning policy and the amendment log of this document links to the version it replaced. The respondent is correct that the link was absent from the draft page furnished for consultation, which was a defect of the consultation copy and not of the policy.
The recorded evidence gaps omit outcomes a reader would consider material
The evidence-gap section records what has not been studied. The respondent, a practising clinician, states that the list is drawn from the outcomes the trials chose to measure and therefore reproduces the sponsor's outcome selection rather than correcting for it.
The respondent proposes that the gap list be constructed from the outcomes a prescribing decision turns on, and that outcomes measured by no trial appear in it as such.
The secretariat accepts this submission in part. The gap list is reconstructed from the decision-relevant outcome set rather than from the measured set. The proposal that every unmeasured outcome be listed is declined, because an unbounded list of things not studied is not a finding.
The evidence-gap section is now derived from the anchor and decision-relevant outcomes for the indication, and any such outcome measured by no contributing trial is recorded as not measured rather than omitted.
Registered trials that never reported are absent from the monograph
The respondent states that the trial list appears to be drawn from published reports, and that registered trials which completed without a report are therefore invisible. The proportion of a programme that never reported is itself a finding about the evidence base.
The respondent proposes that every registered trial of the compound be listed, with its reporting status, whether or not a report exists.
The secretariat accepts this submission. A trial list built from publications reproduces publication bias in the shape of the document.
The trial list now includes every registered trial the Institute identified, with its reporting status stated, and the monograph reports the proportion of registered trials for which no result has been posted or published.
Adverse event frequencies are given without the denominator or the exposure period
The draft reports adverse event frequencies as percentages. The respondent states that a percentage without a denominator and without an exposure period cannot be compared with any other figure, including the corresponding figure in the comparator arm.
The respondent proposes that every frequency carry the number of participants and the exposure period over which it was observed.
The secretariat accepts this submission. A frequency detached from its denominator is a number without a quantity.
Every reported frequency now carries the number of participants, the number of events and the exposure period, and comparator-arm figures are reported alongside rather than in a separate table.
References should carry a persistent identifier for every cited source
Several references in the draft carry a journal, a year and a volume but no persistent identifier. The respondent, who works in a library setting, states that retrieval of such a reference is materially slower and that identifiers should be supplied throughout.
The respondent asks in the alternative that where an identifier exists but is not carried, the omission be explained rather than left as a gap the reader must interpret.
The secretariat accepts the second limb of this submission and declines the first. Identifiers are supplied wherever the Institute holds one. Where the Institute does not hold an identifier it will not supply one, because a reconstructed identifier that resolves to the wrong record is a worse defect than an absent one.
Every reference without a persistent identifier now carries an explicit statement that the identifier is not held by the Institute, so that its absence is a recorded fact rather than an apparent oversight.
The document should not describe uses outside the approved indication
The submission is made on behalf of a marketing-authorisation holder. It states that the draft describes uses of the compound that fall outside the approved indication, that such uses are not supported by the sponsor, and that describing them may be read as legitimising them.
The sponsor asks that the sections concerned be removed, or in the alternative that they carry a prominent statement that the sponsor does not support such use.
The secretariat does not accept this submission. The Institute records what is supplied and what is used, because a reader encountering a compound outside a regulated route is the reader most in need of an assessment of the evidence for it.
The sections remain. Every such section already states the regulatory status of the use described and states that the evidence for it is assessed separately from the evidence for the approved indication. The submission is published in full and identified as an industry submission.
The population to which the headline estimate applies is not stated with the estimate
The draft carries a headline effect estimate in the abstract without the eligibility criteria of the trials that produced it. The respondent states that the estimate applies to a trial population with specific age, comorbidity and baseline criteria, and that a reader will apply it to whoever is in front of them.
The respondent proposes a one-line population statement adjacent to every headline estimate.
The secretariat accepts this submission. An estimate detached from its population is an estimate of nothing in particular.
Every headline estimate now carries a one-line statement of the population in which it was observed, and the full eligibility criteria are reported in the included-studies table rather than only in the source.
A sortable table implies a comparison the underlying data do not support
The draft presents a sortable table whose columns are drawn from sources of differing quality. The respondent states that sorting on such a column produces an ordering that looks like a ranking and is not one.
The respondent proposes that sorting be disabled on any column whose values are not commensurable.
The secretariat notes this submission and records that the point is correct in principle.
No amendment arises here because every sortable table in the document set already carries a standing statement above it that the ordering is not a ranking and that the values in each column are commensurable only where the column header says so. The proposal to disable sorting was considered and not adopted, because a reader who cannot sort a table generally sorts it elsewhere and without the statement.
References cited on this page
References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.
- International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute
Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.