Draft monograph: Petrelintide — submissions
The 15 submissions received, published in full with declared interests and secretariat responses.
§2Submissions and responses
15 submissions were received. Each is published in full below with its declared interest, the secretariat response and the disposition. The Institute publishes submissions it did not accept in the same form as those it did.
Trials are described as terminated where they completed as planned
The respondent states that the draft uses the word terminated for trials stopped at pre-specified interim analyses, for trials stopped for futility and for trials closed for commercial reasons, and that these are three different facts.
The respondent proposes that the status vocabulary be fixed and defined in the glossary.
The secretariat accepts this submission in part. The vocabulary is fixed and defined. The proposal to distinguish commercial closure from futility in every case is accepted only where the Institute holds a document stating the reason.
Trial status now uses a fixed vocabulary defined in the glossary, and where the reason for stopping is not evidenced by a document the Institute holds, the status is recorded as stopped with the reason not established rather than assigned.
Absence of evidence is presented in a form a reader will take as negative evidence
Where the Institute has identified no study, the draft states that no evidence was found. In several places that sentence sits immediately after a paragraph describing an adverse outcome, and the juxtaposition invites the reading that the compound was studied and found wanting.
The respondent proposes a standing formulation, used identically wherever the situation arises, distinguishing an outcome that was studied and not demonstrated from an outcome that has not been studied at all.
The secretariat accepts this submission. The two states are different, they support different decisions, and the draft rendered them in language a reader could not reliably separate.
A standing formulation has been adopted and is applied wherever an evidence gap is recorded, distinguishing an outcome assessed and not demonstrated from an outcome not assessed. The formulation is identical at every occurrence so that it can be recognised at a glance.
The monograph does not tell a reader that a stated mass may be substantially counter-ion and water
The draft quotes vial contents in milligrams without stating whether the figure refers to peptide content or to total solids. For an acetate or trifluoroacetate salt of a peptide, the difference between the two can exceed a fifth of the stated mass.
The respondent, an analytical chemist, states that this is the single most consequential misreading in the field and that a monograph that does not address it directly is leaving the reader to discover it.
The secretariat accepts this submission. Moderate certainty evidence from published analytical surveys suggests that content and total solids are routinely conflated in supply documentation, and the draft did not warn the reader.
The monograph now states, at the point where vial contents are first mentioned, that a mass figure is uninterpretable unless it states whether it is peptide content or total solids, and cross-references the content standard in the analytical series.
The certainty rating for the principal assessed outcome cannot be traced to the contributing trials
The draft states a certainty rating for the principal assessed outcome and lists the contributing trials, but does not state which domain drove the downgrade. A reader who disagrees with the rating cannot tell whether the disagreement concerns risk of bias, imprecision, indirectness or inconsistency.
The respondent proposes that each rating carry its downgrade reasons explicitly, in the same row as the rating, so that a reader can accept the evidence assessment while disputing a single domain judgement.
The secretariat accepts this submission. A rating without its reasoning is an assertion, and the draft asserted rather than showed.
Each assessed outcome now carries its downgrade domains in the summary-of-findings row, with a short statement of the judgement made in each, so that the rating can be checked domain by domain against the contributing trials.
The analytical section is longer than the clinical assessment it accompanies
The respondent, an academic pharmacologist, states that the analytical section occupies more of the monograph than the assessment of clinical effect, and that the proportions imply the Institute considers the analytical question the more important one.
The respondent proposes that the analytical material be moved to the standards series and referenced rather than reproduced.
The secretariat accepts this submission in part. The general analytical material is moved to the standards series and referenced. The compound-specific material stays, because a reader holding a certificate for this compound needs to know what that certificate does and does not establish for this compound.
The analytical section is reduced to compound-specific content and cross-references the relevant standards for the general procedure, which shortens it substantially without removing what is not available elsewhere.
The population to which the headline estimate applies is not stated with the estimate
The draft carries a headline effect estimate in the abstract without the eligibility criteria of the trials that produced it. The respondent states that the estimate applies to a trial population with specific age, comorbidity and baseline criteria, and that a reader will apply it to whoever is in front of them.
The respondent proposes a one-line population statement adjacent to every headline estimate.
The secretariat accepts this submission. An estimate detached from its population is an estimate of nothing in particular.
Every headline estimate now carries a one-line statement of the population in which it was observed, and the full eligibility criteria are reported in the included-studies table rather than only in the source.
A purity figure from a certificate is quoted as though it were a content figure
The draft quotes a purity percentage from supply documentation in a sentence about how much compound a vial contains. Chromatographic purity is a relative area within what was detected; it is not a mass fraction and it does not bound vial content.
The respondent, an analytical chemist, proposes that purity and content never appear in the same sentence without an explicit statement that they answer different questions.
The secretariat accepts this submission. The conflation is the error the Institute most often corrects in supply documentation, and it appeared in an Institute draft.
Purity and content are now reported in separate rows with separate definitions, and the monograph states that a purity figure sets no bound on content and that a content figure requires a determination against a standard of assigned content.
Regulatory status is stated without naming the jurisdiction
The draft states that the compound is approved, or not approved, without saying by whom. The respondent, employed by a health-technology assessment body, states that approval status differs between jurisdictions for several compounds in the series and that an unqualified statement will be wrong somewhere.
The respondent proposes that every status statement name the authority and carry the date on which the status was checked.
The secretariat accepts this submission. An unattributed status statement is a claim the Institute cannot support.
Every regulatory status statement now names the authority, states the date on which the status was verified, and is recorded per jurisdiction rather than as a single global assertion.
Point estimates are given without an interval
Several estimates in the draft appear as single figures. The respondent states that a point estimate without an interval invites a precision the underlying data do not support, and that the effect is worst where the estimate is drawn from a small contributing set.
The respondent proposes that no point estimate appear anywhere in the document set without its interval, including in summary tables and in the abstract.
The secretariat accepts this submission in part. Intervals are added wherever the source reports one. The proposal is declined for figures the source published without an interval, because the Institute will not compute an interval a source did not report.
Every estimate now carries its interval where the source reported one, and where it did not, the estimate is annotated as reported without an interval rather than left to appear as a precise figure.
The pharmacokinetic section does not connect half-life to the dosing schedule
The draft reports a half-life and, separately, a dosing interval. The respondent, a clinical pharmacologist, states that the relationship between the two is what determines accumulation and time to steady state, and that the monograph leaves the reader to derive it.
The respondent proposes that time to steady state be stated explicitly, with the assumption from which it was derived.
The secretariat accepts this submission. The derivation is short, it is decision-relevant, and leaving it to the reader invites it to be done wrong.
The pharmacokinetic section now states approximate time to steady state alongside the half-life and dosing interval, with the assumption of first-order elimination stated, and records where the assumption is not supported for this compound.
The monograph should reproduce the approved labelling rather than paraphrase it
The submission is made on behalf of the marketing-authorisation holder. It states that the draft paraphrases the approved indication, the posology and the contraindications, and that any paraphrase risks diverging from the authorised text.
The sponsor asks that the authorised wording be reproduced verbatim in each case, and offers the current summary of product characteristics as the source.
The secretariat accepts this submission in part. The authorised indication and the contraindications are reproduced verbatim and attributed. The posology is not, because the monograph reports what the trials administered as well as what the labelling authorises, and the two are frequently different.
The approved indication and contraindications are now reproduced verbatim from the named authorisation with its version and date, and the posology section reports the labelled schedule and the schedules studied side by side, with the source of each stated.
The recorded evidence gaps omit outcomes a reader would consider material
The evidence-gap section records what has not been studied. The respondent, a practising clinician, states that the list is drawn from the outcomes the trials chose to measure and therefore reproduces the sponsor's outcome selection rather than correcting for it.
The respondent proposes that the gap list be constructed from the outcomes a prescribing decision turns on, and that outcomes measured by no trial appear in it as such.
The secretariat accepts this submission in part. The gap list is reconstructed from the decision-relevant outcome set rather than from the measured set. The proposal that every unmeasured outcome be listed is declined, because an unbounded list of things not studied is not a finding.
The evidence-gap section is now derived from the anchor and decision-relevant outcomes for the indication, and any such outcome measured by no contributing trial is recorded as not measured rather than omitted.
Quantitative claims are reproduced without the method that produced them
Several figures in the draft are quoted from sources that determined them by different methods. A figure obtained by one determination and a figure obtained by another are not comparable, and the draft places them in the same sentence without distinguishing them.
The respondent, an analytical chemist, proposes that every quantitative claim carry the method that produced it at the point of use rather than in the reference.
The secretariat accepts this submission. Placing two figures side by side is an implicit claim that they are the same kind of quantity, and in the cases identified they were not.
Every quantitative claim now carries the determination that produced it at the point of use, and figures obtained by non-comparable methods are no longer presented in the same row or sentence.
The preclinical section is extensive and the clinical section is not
The draft summarises a large animal literature and a small or absent human literature. The respondent states that the resulting document reads as though a great deal is known, when what is known concerns rodents.
The respondent proposes that the preclinical section be reduced to a statement of what has been observed in animals and that the detail be removed entirely.
The secretariat accepts this submission in part. The section is shortened and given a standing statement. The proposal to remove the detail is declined, because a reader encountering claims derived from that literature needs to be able to see what it actually contains.
The preclinical section is reduced in length, placed after the clinical assessment rather than before it, and opens with a standing statement that an effect observed in an animal model is not a clinical outcome and does not support a certainty rating.
The document is unreadable without specialist training
The respondent, a trustee of a patient organisation, states that the draft is written for a reader who already understands certainty grading, and that the people most affected by the subject matter will not reach the assessment at all.
The respondent proposes a plain-language summary at the head of every document, written to the same standard of accuracy as the document itself and not as a promotional abstract.
The secretariat accepts this submission in part. A plain-language summary is added. The proposal that it replace the technical abstract is declined, because the abstract is the part of the document other assessors read and cite.
Every document now opens with a plain-language summary of not more than 150 words, placed above the technical abstract and carrying the same certainty language, so that the two cannot diverge.
References cited on this page
References are numbered in order of first citation in this document. Each superscript in the text links to its entry below.
- International Organization for Standardization. ISO/IEC 17025:2017 General Requirements for the Competence of Testing and Calibration Laboratories. ISO/IEC Standard 2017;3rd edition. identifier not held by the Institute
Identifiers are reproduced only where the Institute holds them. Where a digital object identifier or PubMed identifier is not shown, the Institute has recorded the journal and year and has not constructed an identifier.