A short spoken briefing for each module, read aloud by your browser’s built-in voice. The full text is written out below each one, so you can read instead.
- 1
What HTA is — and where it sits in Saudi Arabia
Definition, domains of value, and who does what between approval and access
Read the script
Module 1. What HTA is — and where it sits in Saudi Arabia. Definition, domains of value, and who does what between approval and access.
HTA informs a decision; it is not the decision. The 2020 HTAi/INAHTA definition describes HTA as a multidisciplinary process that uses explicit methods to determine the value of a health technology at different points in its lifecycle. Its purpose is to inform decision-making that promotes an equitable, efficient and high-quality health system. The output is advice: a structured judgement on clinical benefit, cost and wider consequences compared with what is done today. The decision itself belongs to the payer, ministry or hospital committee that owns the budget. This separation matters in practice. Assessors can be honest about uncertainty because they are not the ones who must say yes or no, and decision-makers can weigh what no analysis captures, such as urgency, fairness or what the system can deliver this year. A good assessment therefore ends with a plain statement of what is known, what is assumed, and what would change the conclusion.
The domains of value. A full assessment looks at more than a trial result. The usual domains are clinical effectiveness and safety, economic evaluation, budget impact, ethical and social issues, organisational impact on services, and the patient and public perspective. Different decisions weight the domains differently. A drug decision leans on clinical and economic evidence. A decision on a new test leans on how results change management, and on workflow. The point of naming the domains is to stop one of them silently deciding everything. When the economic model is the only thing anyone reads, fairness, feasibility and patient experience drop out of the discussion. Listing the domains at the start also shows where evidence is missing, so that an empty box is reported as a gap rather than hidden.
Who does what between approval and access. In simplified terms: the regulator (SFDA) decides whether a product may be marketed. Insurers and public payers decide what is covered; the Council of Cooperative Health Insurance sets the benefit rules for private cover. A national procurement body runs tenders. Health clusters and hospital drugs-and-therapeutics committees decide what is on the local formulary. Professional societies write guidelines. Independent HTA bodies and societies build capacity and can offer advice. Each actor asks a different question and uses different evidence, so a product can clear one gate and stall at the next. Knowing the map lets a clinician put the right argument to the right body at the right time. Mandates change, so confirm current roles before relying on this map.
Process principles: transparency, declared interests and recorded reasons. An assessment is only as credible as the process behind it. Four principles recur in HTA practice. First, transparency: the scope, methods and reasons are published so that others can check them. Second, inclusion: clinicians, patients and the manufacturer can comment on the scope and the draft advice. Third, management of interests: every member declares financial and non-financial interests, such as advisory boards, trial involvement or a strong prior view, and the committee records how each declaration was handled. Fourth, a route to challenge: a stakeholder who thinks a factual error was made can ask for it to be corrected. None of these slows the work much once it becomes routine, and all of them protect the recommendation when it is questioned later.
Choosing what to assess: horizon scanning and prioritisation. No system can assess everything. Horizon scanning identifies technologies likely to reach the health system within a few years, such as new biologics, small molecules or AI tools in endoscopy. Prioritisation then decides which deserve a full assessment. Common criteria are the burden of disease, the size of the expected benefit, the uncertainty that remains, the likely budget impact, and whether a decision is imminent. A technology with a large budget impact and genuine uncertainty is a strong candidate. One that is cheap, well understood and low in risk may need only a rapid review. Prioritisation should itself be transparent, otherwise the choice of topic becomes a hidden decision about which patients matter.
A worked example. A regulator asks: is this advanced therapy for ulcerative colitis safe, effective and well made? A guideline panel asks: where does it sit in the treatment sequence? An HTA asks: compared with what we already fund, is the extra benefit worth the extra cost, for which patients, and what else would that money have done?
- 2
Framing the decision problem
PICO, comparators, perspective, time horizon and patient-relevant outcomes
Read the script
Module 2. Framing the decision problem. PICO, comparators, perspective, time horizon and patient-relevant outcomes.
From a vague wish to a decision problem. Every assessment starts with a decision problem: a precise statement of the population, intervention, comparator, outcomes, time frame and setting (PICOTS). It is written before anyone reads the results, and it is the contract against which the evidence is later judged. A vague question such as “is this biologic good?” cannot be answered; “does drug X improve sustained remission versus current standard therapy in biologic-naive adults with moderate-to-severe UC over one year?” can. Writing it forces the group to agree what they are deciding. It also protects against a common drift in which the question quietly changes to fit whichever trial happens to be available. Each element should be specific enough that two independent reviewers would select the same studies.
The comparator is the most argued-over choice. The comparator should be the best alternative that is actually available to the same patients: usually current standard of care, not placebo. Where practice varies, include the commonly used options. A trial against placebo cannot show whether a new drug beats what patients would otherwise receive. When no head-to-head trial exists, the gap is filled by indirect comparison (Module 3). The choice is argued over because it can swing the answer: a cheap, effective comparator makes a new drug look poor value, while an outdated or expensive one makes it look like a bargain. The defensible rule is to describe what is really used locally, say how that was established, and test the result against the next most likely alternative.
Perspective, time horizon and outcomes that matter. The perspective states whose costs and benefits count: usually the health-system payer, sometimes society. The time horizon must be long enough to capture all important differences. For a chronic disease such as IBD that means years or a lifetime. Outcomes should matter to patients: remission, avoiding surgery, hospitalisation, quality of life. A surrogate such as endoscopic healing is useful only to the extent it predicts those outcomes. These three choices are made together. A payer perspective with a short horizon asks a narrow question: what does this cost us in the next year? A societal perspective with a lifetime horizon asks a broader one that includes lost work and carer time. Neither is wrong, but the choice must be stated and held constant.
Surrogate endpoints: how to test the link to patient outcomes. Trials often report markers because they change quickly and need small samples: faecal calprotectin, endoscopic healing or histological remission. These are useful, but a decision rests on what patients experience, such as symptoms, hospital admission, colectomy and quality of life. The question for an assessor is whether the marker reliably predicts that outcome for this drug class and this population. The strongest evidence is a trial-level association in which treatments that moved the marker more also moved the patient outcome more. Weaker evidence is a cohort showing that patients with the marker at baseline do better. Where the link is uncertain, the marker may be used as supportive evidence, but the model should be driven by patient outcomes, and the assumed link should be varied in sensitivity analysis.
Subgroups, special populations and mismatches. A decision problem often names subgroups: biologic-naive versus experienced, extensive versus left-sided colitis, adults versus adolescents, patients with comorbidity. Subgroups should be specified before the evidence is read, with a biological or clinical reason, because dividing the data after the fact produces false patterns. Post hoc subgroup findings are useful for generating hypotheses, not for supporting a recommendation. When the trial population does not match the question, for example when trials enrolled only biologic-experienced patients, the mismatch should be recorded, and the evidence used only where it plausibly transfers. Special populations such as pregnant women or children are often excluded from trials, so recommendations may be silent for them. Saying so is better than extrapolating without comment.
A worked example. P: adults with moderate-to-severe UC, biologic-naive. I: new advanced therapy. C: infliximab biosimilar (what clusters actually use first). O: clinical remission at week 52, steroid-free remission, colectomy, serious infection, quality of life. T: 52 weeks, with a lifetime model for cost. S: hospital gastroenterology services.
- 3
Clinical evidence: synthesis, indirect comparison and certainty
Systematic review, network meta-analysis, GRADE and the limits of surrogate endpoints
Read the script
Module 3. Clinical evidence: synthesis, indirect comparison and certainty. Systematic review, network meta-analysis, GRADE and the limits of surrogate endpoints.
A review that others could repeat. An HTA starts with a systematic review: pre-specified question, documented searches of several databases, duplicate screening, risk-of-bias assessment and a transparent synthesis. Industry dossiers should be checked against an independent search, because selective inclusion is easy to miss. Meta-analysis pools comparable trials; heterogeneity (I², differing populations or doses) limits how far they can be pooled. The standard of reproducibility is simple: a second team using the same protocol should find the same studies. That is why the search strategy, the screening decisions and the reasons for exclusion are all recorded. Reporting guidance such as PRISMA gives the flow of studies from first record to final inclusion, so a reader can see where evidence was lost.
When there is no head-to-head trial. Most IBD biologics were tested against placebo, not each other. An adjusted indirect comparison (Bucher method) uses a common comparator: the relative effect of A versus B is the ratio of A versus placebo to B versus placebo, and the uncertainty adds on the log scale. Network meta-analysis generalises this across many treatments. Both rest on an assumption that the trials are similar enough in patients and design. Head-to-head trials, such as the VARSITY trial of vedolizumab versus adalimumab in UC, are rare and valuable. Because the interval from an indirect comparison is always wider than either input, decisions that hinge on a small indirect difference are rarely safe.
How certain are we? GRADE. GRADE rates certainty for each outcome as high, moderate, low or very low. Randomised evidence starts high and is downgraded for risk of bias, inconsistency, indirectness, imprecision and publication bias. Observational evidence starts low and can be upgraded for large effects. Certainty is what lets decision-makers know how much to trust the number they are about to put in a model. The rating is made outcome by outcome, because the same review can give high certainty for short-term remission and very low certainty for colectomy. The summary-of-findings table puts the effect, its interval and the rating side by side, so readers cannot see one without the other.
Effect modifiers and transferability. Pooling and indirect comparison both assume that trials are similar in the factors that change the size of the treatment effect, known as effect modifiers. In IBD these include disease severity, prior biologic exposure, concomitant steroids, disease duration and the timing of the endpoint. A trial in biologic-naive patients will usually show a larger effect than one in patients who have failed several drugs, and comparing them without adjustment misleads. Transferability is the related question of whether the results apply to local patients. Trials enrol selected patients and follow them closely, so effects in routine care are often smaller. The assessor’s task is to list the modifiers, tabulate them across trials, compare them with the local patient mix, and state what the differences do to certainty.
Surrogates, real-world evidence and the limits of trials. Randomised trials give the cleanest estimate of efficacy, but they are short, selective and rarely powered for long-term outcomes. Real-world evidence from registries and routine records can show how a treatment performs in the patients actually treated, and over longer follow-up. It carries more risk of confounding, because the people who receive a drug differ from those who do not. A balanced assessment uses trials for relative effects, real-world data for baseline risks, adherence and long-term outcomes, and is explicit about which parameter came from which source. Pragmatic trials sit between the two and are valuable when they exist. Where the evidence is thin and the decision is hard to reverse, a managed entry agreement can fund the collection of better evidence (Module 8).
A worked example. For advanced therapies in UC, an independent search for randomised trials of adults with moderate-to-severe disease, reported clinical remission at induction and maintenance, finds trials the sponsor omitted because they used different dosing. Including them changes the pooled estimate and the confidence interval.
- 4
Economic evaluation: costs, QALYs and the ICER
Cost-effectiveness analysis, thresholds, Markov models and uncertainty
Read the script
Module 4. Economic evaluation: costs, QALYs and the ICER. Cost-effectiveness analysis, thresholds, Markov models and uncertainty.
ICER, QALY and the threshold. Cost-effectiveness analysis compares incremental cost with incremental health gain. With health measured in quality-adjusted life years (QALYs), the incremental cost-effectiveness ratio is ICER = (Cost_new − Cost_comparator) / (QALY_new − QALY_comparator). A technology that costs less and gives more QALYs dominates; one that costs more and gives fewer is dominated. In between, the ICER is compared with a willingness-to-pay threshold, which expresses what the system is prepared to pay for one QALY. Countries set thresholds differently and there is no universal value; older “1 to 3 times GDP per capita” rules of thumb are widely criticised. A threshold is a reference point for deliberation, not a switch: decisions near it usually turn on certainty, severity and what else could be funded.
Modelling a chronic disease: Markov models. Trials are short. A Markov model extends them by moving a cohort between health states in fixed cycles, with each state carrying a cost and a utility. A UC model typically has remission, mild-to-moderate activity, severe activity, post-colectomy and death. Transition probabilities come from the evidence synthesis (Module 3). Future costs and QALYs are discounted to present value, and a half-cycle correction avoids over-counting. A Markov model has no memory: the chance of leaving a state depends only on the state a patient is in now, not on how long they have been there. That simplification is the usual price of tractability, and where it fails, for example when risk rises with time since surgery, a richer structure is needed.
Uncertainty is part of the answer. One-way sensitivity analysis varies parameters one at a time to find which matter. Probabilistic sensitivity analysis (PSA) draws all parameters from their distributions many times and plots the results on the cost-effectiveness plane. A cost-effectiveness acceptability curve (CEAC) shows the probability that the technology is cost-effective at each threshold. Where uncertainty is large and the decision is costly to reverse, value-of-information analysis asks whether more research is worth doing before deciding. The practical use of these tools is to tell a committee how much confidence to place in the base case and where to look first. A tornado diagram ranks parameters by their effect on the ICER, so the committee can ask the sponsor about the few that drive the result rather than all of them.
Counting costs and discounting. The cost side of a model counts the resources used in each state: drug acquisition and administration, monitoring, outpatient visits, hospital stays, surgery and the management of adverse events. Costs come from local sources where possible and are expressed in one price year. Because a riyal or a QALY today is worth more than one in the future, both costs and health gains are discounted to present value: PV = value / (1 + r)^t. Discounting matters most for long horizons and for technologies whose benefits come late. Guidelines set the discount rate, and rates differ between countries, so the rate used should be stated and tested. Applying the same rate to costs and QALYs is the common default, with a different rate explored as a sensitivity analysis.
From ICER to decision: working back to a price. A committee rarely wants only to know that the ICER is too high. It wants to know what would make the technology good value. The answer can be found by working back from the threshold: the maximum incremental cost is the threshold multiplied by the QALY gain, and the maximum total cost is that figure plus the comparator’s cost. The gap between that ceiling and the proposed price is the discount needed. This is a negotiating anchor rather than a verdict, because it inherits every uncertainty in the model and applies to the whole cost over the horizon, not to the list price of one dose. It also shows how sensitive the result is: if the QALY gain falls from 0.45 to 0.30, the affordable price falls with it. Combining the price ceiling with the CEAC gives the committee a range, not a point.
A worked example. Illustrative: the new therapy costs SAR 90,000 more per patient over the horizon and adds 0.45 QALYs. ICER = 90,000 / 0.45 = SAR 200,000 per QALY. Against an illustrative threshold of SAR 150,000, it is above the line. Net monetary benefit = 0.45 × 150,000 − 90,000 = −SAR 22,500, which says the same thing without dividing.
- 5
Budget impact and affordability
Why a good-value technology can still be unaffordable, and how biosimilars change the picture
Read the script
Module 5. Budget impact and affordability. Why a good-value technology can still be unaffordable, and how biosimilars change the picture.
Value is not the same as affordability. Cost-effectiveness asks whether a technology is good value per patient. Budget impact analysis (BIA) asks what it does to total spending for a particular payer over the next few years. The two questions come apart because value is a ratio and affordability is a total. A cheap-per-QALY drug for a common condition can still overwhelm a budget, while an expensive-per-QALY drug for a rare condition may barely register. Both questions are needed, and they are answered by different models. A cost-effectiveness model usually takes a long horizon, discounts future costs and may use a wide perspective. A BIA takes a short horizon of three to five years, does not discount, and counts only what the budget holder actually pays. A decision-maker uses the ICER to decide whether the technology deserves funding in principle, and the BIA to decide how fast, for whom and on what terms.
Building a budget impact estimate. Each year: eligible patients × uptake of the new technology × net incremental cost per patient. Start with the population, because it is the largest source of error: count people with the condition, then those diagnosed and under care, then those who meet the eligibility criteria that the recommendation would set. Net cost is the new technology’s cost minus the cost of what it displaces, minus any downstream savings that fall within the same budget period. Uptake usually ramps up as clinicians gain confidence and services build capacity; ignoring the ramp overstates early cost. The time horizon is typically three to five years. Sensitivity analysis should vary the eligible population and uptake first, as these are usually the most uncertain. Report a base case, a low case and a high case so the committee sees the range, not a single figure.
Biosimilars and what savings can fund. When originator biologics lose exclusivity, biosimilars of the same molecule enter at lower prices. Switching studies, such as the NOR-SWITCH trial of infliximab, support the safety and efficacy of switching from originator to biosimilar in stable patients. The HTA question is then how much is saved, how fast, and what those savings could fund. Savings are real only if the switch actually happens and prices fall, which depends on tenders, clinician confidence and patient communication. The calculation has three moving parts: the discount, the share of patients who switch, and the number on treatment. Each can be wrong. A committee therefore asks for the savings as a range and asks who keeps them. If savings return to the pharmacy budget but the new therapy is paid from another budget, the saving exists on paper and the new therapy still cannot be funded.
Whose budget? Net cost, displacement and the budget holder. The same technology can look cheap or costly depending on whose budget is counted. A hospital pharmacy sees the drug bill. A payer sees drug, administration, monitoring and admissions. The ministry sees everything but cannot move money between silos. Net cost should be calculated from the perspective of the party that decides and pays, and the analysis should say where savings land. Displacement matters: a new oral therapy that replaces an infusion biologic removes drug cost and also infusion chair time, nursing hours and day-case fees, but those savings only count if the capacity is actually released or redeployed. Savings that are spread thinly across many wards cannot be banked. A good BIA therefore separates cash-releasing savings, which reduce spending, from capacity-releasing ones, which create room for other work but leave the budget unchanged.
Levers that make a valuable technology fundable. When a technology is good value but the bill is too large, the answer is rarely a flat yes or no. Several levers change the shape of the bill without changing the evidence. Phasing introduces access by risk group or by region over several years, so the budget can absorb it. Price–volume agreements lower the unit price as the number treated rises. Stopping rules end treatment for non-responders, which trims spending on patients who gain nothing. Targeting restricts use to the subgroup with the largest benefit, which usually improves the ICER as well as the budget. Funding from savings elsewhere, such as biosimilar tenders, pays for new therapy within the same pot. Each lever has a cost: phasing means some patients wait, targeting needs a reliable test, and agreements need administration. The committee should state which lever it used and which patients it leaves out, so the trade-off is visible.
A worked example. Direct-acting antivirals for hepatitis C were cost-effective in many settings even at high launch prices, but the number of eligible patients made the first-year bill a major concern. Elimination programmes needed negotiated prices and phased treatment, not a different ICER.
- 6
Beyond the numbers: values, equity and deliberation
Multi-criteria thinking, patient voice, transparency and conflicts of interest
Read the script
Module 6. Beyond the numbers: values, equity and deliberation. Multi-criteria thinking, patient voice, transparency and conflicts of interest.
What the model cannot see. An ICER treats a QALY as equal whoever gains it. That is a value judgement. Many systems also care about severity of illness, unmet need, age, rarity, access in underserved regions, and effects on carers. These are not errors in the model; they are reasons a committee may reach a different conclusion than a threshold alone would. The model also contains less obvious judgements: which comparator counts as current care, whose costs are included, how future years are discounted, and whether the utility values come from patients or from the general public. Each choice can move the result. The task for a committee is to make those reasons explicit, not to hide them in the discussion, and to apply the same reasons to every product it considers. A decision that cannot say why it differed from the threshold is hard to defend and hard to repeat.
Multi-criteria decision analysis (MCDA). MCDA makes the weighing explicit. The committee agrees criteria (for example: clinical benefit, safety, unmet need, cost-effectiveness, budget impact, feasibility), sets weights before looking at the products, scores each product on each criterion, and computes a weighted total. Criteria should be distinct, so that the same benefit is not counted twice, and each should have a stated scale. MCDA does not replace deliberation: the scores are a structured starting point for discussion, and large disagreements between members are where the useful conversation happens. Always test the result by changing the weights. In the example below, moving 10 points of weight from cost-effectiveness to clinical benefit (clinical 40, safety 20, unmet need 20, cost-effectiveness 10, feasibility 10) gives product A 69 and product B 67, so the ranking flips. A result that flips under reasonable weights should be reported as a close call, not a verdict.
Transparent, accountable deliberation. Trust in HTA depends on process. Members declare financial and non-financial interests each year and for each topic; those with significant conflicts step out. Interests are not only money: a member who led the pivotal trial, or who has published strongly in favour of a product, has a non-financial interest that should be declared and weighed. The committee records abstentions, writes reasons, and publishes the decision with the evidence used. Patients and the public contribute lived experience of the condition and treatment burden. Each recommendation carries a review date and the events that would trigger earlier review. Transparency is a habit, applied to every topic, rather than an extra step added when a decision is controversial. Committees that publish their reasons also learn from them, because they can be compared across years.
Equity and severity: who gains matters. Equity asks who benefits and who is left out. A technology with a good average ICER can widen gaps if its benefit goes to people already well served, for example if it needs a specialist centre in one city. Severity matters because many systems give more weight to a health gain for people who are very ill or who would otherwise lose many years of healthy life. These weights must be stated, not applied quietly. A useful device is to describe two dimensions together: how large the QALY gain is and how severe the starting condition is. Where gain is large and severity high, funding is easy. Where gain is small and severity low, the case is weak. The hard cell is a small gain in a severe condition with few alternatives, and the committee should write down why it accepts or rejects a higher cost there. Equity can also be built into delivery: outreach, telehealth follow-up and regional access for a therapy that would otherwise reach only major cities.
Patients and the public in the process. Patients know what the evidence cannot show: how long an infusion visit takes, what an unpredictable bowel does to a working week, what a stoma means to a young adult. They can contribute at every stage, not only at the end. At topic selection they say which problems matter. At scoping they suggest outcomes that reflect daily life. During evidence review they help interpret patient-reported outcomes. In deliberation they speak for the burden of illness and treatment. After the decision they help explain it. Meaningful involvement needs preparation: plain-language summaries, early notice of meetings, payment of expenses, and more than one voice, because no single patient speaks for everyone. It also needs honesty about what input can change. Involvement that is only for show damages trust faster than none at all. Committees should record how input shaped the reasons and say so when it did not change the outcome.
A worked example. Two candidate technologies: an advanced therapy for paediatric-onset Crohn’s disease and a repeat screening test in low-risk adults. If both have the same ICER, a committee may reasonably favour the one that addresses a severe condition in children with few alternatives. It should say so and give the reason.
- 7
Devices, diagnostics and AI
Why drug-style evidence rules do not fit, with colonoscopy AI, FIT and calprotectin as examples
Read the script
Module 7. Devices, diagnostics and AI. Why drug-style evidence rules do not fit, with colonoscopy AI, FIT and calprotectin as examples.
Devices are not small drugs. Devices change through repeated design iterations, so the version tested may not be the version sold. Trials are often smaller and cannot always be blinded, and a sham procedure may be impractical or unethical. Real-world performance depends heavily on the operator and a learning curve: the same endoscopic device can give different results in expert and novice hands. Many devices reach the market on the strength of technical performance and a modest clinical study, so the evidence base at launch is thinner than for a drug. A fair assessment states which version the evidence describes, does not penalise unavoidable design limits as it would for a drug, and separates the effect of the device from the skill of the person using it. It also asks what training, case volume and service set-up the result depends on, because these costs belong in the decision.
Tests are judged in two steps. A diagnostic test is first judged on analytic validity (does it measure what it claims?) and clinical validity (does the result correspond to the condition, as sensitivity and specificity?). The second step is clinical utility: does using the test change management in a way that improves outcomes or saves resources? Accuracy alone does not establish value. A test can be accurate yet change nothing, because clinicians do not act on it, the treatment it points to does not exist, or the same decision would have been made anyway. A useful framework is the hierarchy of diagnostic efficacy, which runs from technical quality, through diagnostic accuracy and the effect on the clinician’s thinking and on treatment, up to patient outcome and societal value. Evidence at each rung is harder to obtain and more convincing. An assessment should say which rung the evidence reaches, and not treat accuracy studies as if they were outcome studies.
AI that keeps learning. Computer-aided detection (CADe) in colonoscopy is an example: randomised trials show higher adenoma detection, though the benefit for interval cancer or mortality is not yet established, and some effects shrink with experienced endoscopists. Algorithms that continue to learn after deployment raise a new problem: the version assessed is not the version in use, and performance can drift as data, equipment or patient mix change. An assessment should ask whether the algorithm is frozen, require a predetermined change-control plan with agreed limits and triggers for reassessment, and demand performance by subgroup, not only on average. Subgroup performance matters because an algorithm trained mainly on one population can underperform in another, for example with different bowel preparation quality, different equipment, or different age groups. The assessment should also say who owns monitoring after launch, and how problems are reported.
Following a result to an outcome: the test-treat pathway. A test does not act on its own. Its value comes from the whole pathway: who is invited, who takes the test, how many are positive, how many are followed up, and what is done at the end. Every step can leak. If half the people invited never return a stool sample, or one in five with a positive result never has a colonoscopy, the programme delivers much less than the test accuracy suggests. False positives add their own cost: anxiety, procedures and small risks of harm. An HTA therefore maps the pathway and puts a number on each step, from local data where possible. The map also shows where a cheaper intervention might improve more than a better test, for example reminders to increase uptake, or navigation support to increase colonoscopy completion. Pathway evidence is also what is needed to model long-term outcomes, because the model follows the cohort through the same steps.
Costing a technology that changes workflow and volume. The cost of a device or an algorithm is not just the licence. There is hardware, installation, training, the learning-curve period, maintenance, data storage, and extra procedure time. There are also consequences: finding more adenomas means more polypectomies and more surveillance colonoscopies in future years, and these costs fall on the endoscopy unit. Volume matters a great deal because many of the costs are fixed. A licence that costs the same whether the unit performs 2,000 or 8,000 colonoscopies is far cheaper per case in a busy unit. This is why an assessment from one centre may not transfer to another, and why the decision-maker should ask what volume the model assumes. The best presentations give a cost per additional detection, or per case, at several plausible volumes, and show which costs would be avoided and which would be added.
A worked example. Endoscopic bariatric procedures: outcomes depend on operator experience. Trial results from expert centres may not hold in new services, so the assessment asks about training requirements, minimum case volumes and outcomes by operator experience.
- 8
Managed entry, real-world evidence and reassessment
Sharing risk, learning after launch, and revisiting decisions
Read the script
Module 8. Managed entry, real-world evidence and reassessment. Sharing risk, learning after launch, and revisiting decisions.
Managed entry agreements. When benefit is promising but uncertain, or the price is high, a payer and manufacturer can agree terms that share risk. Financial agreements (price–volume, discounts, caps, rebates) manage budget and leave clinical uncertainty where it was. Outcomes-based agreements link payment to results in practice, for example refunds for patients who do not respond, and so share the clinical uncertainty as well. They only work if outcomes are measurable, data collection is funded and the administrative cost is lower than the benefit. Many agreements fail because nobody planned the data: the outcome is vague, the clinician has no time to record it, or the dispute over whether a patient responded costs more than the refund. Agreements should have an end date and an exit, and should be transparent enough to be evaluated, even if exact prices are confidential. A payer should always ask what it will know in two years that it does not know today.
Real-world evidence and registries. Registries and routine data can answer questions trials cannot: how a therapy performs in older patients, with comorbidity, in routine centres, over long periods. To be useful for decisions the data need a defined population, validated outcomes, complete follow-up and a protocol agreed before collection starts. Without these, “real-world evidence” is just uncontrolled observation. The main threat is confounding: patients who receive a new drug are often different from those who do not, so a simple comparison can mislead. Good designs use a clear comparison group, adjust for known differences and are honest about what cannot be adjusted. Data also need to be complete. A registry that loses a third of its patients at one year gives a picture of the people who stayed, not of everyone treated. Funding, governance and data-sharing rules must be settled at the start, because a registry nobody owns stops being updated within a year or two.
Reassessment, disinvestment and horizon scanning. A recommendation is not permanent. Triggers for reassessment include new trial results, safety signals, a large price change, biosimilar or generic entry, a new competitor, or real-world data that contradict the model. Some reviews are scheduled, such as at two years after a conditional listing, and others are triggered by events. Disinvestment means withdrawing or restricting a technology that no longer offers value, which needs the same transparency as adoption. Horizon scanning identifies what is coming (for example new MASH or IBD therapies) so that budgets, diagnostics and training are ready. Scanning looks one to three years ahead, using trial registries, regulatory filings and specialist input, and produces a short list of products with expected timing, likely place in therapy and likely budget effect. The system can then prepare diagnostic capacity, training and funding, rather than reacting after launch.
Designing an outcomes-based agreement. An outcomes-based agreement is a small trial of a contract. The designers need to agree what counts as response, when it is measured, who measures it and what happens if the answer is no. Response should be defined by a measure that routine care already collects, at a time the patient is actually seen. The refund should be big enough to matter and small enough to be paid without dispute. Data should flow without extra clinician effort, ideally from existing records. The agreement should say what happens to patients who stop for reasons other than lack of response, such as side effects, because these are not responders either. Finally, the agreement should be evaluated: did the payment follow the outcomes, was the administrative cost reasonable, and did the system learn what it hoped to? If it did not, end the agreement and say why, rather than renewing it by default.
Disinvestment: finding what no longer earns its place. Systems are good at adding technologies and poor at removing them. Disinvestment is the planned reduction or withdrawal of something that gives little value, so that money and capacity go to something better. Candidates include tests and treatments that newer evidence shows to be ineffective, products whose price has not fallen when cheaper equivalents exist, and low-value routine practices such as repeat investigations that change nothing. A practical screen looks at two things: how much value the technology gives, and how widely it is used. Low value with high use is the first priority, because the savings are large. Low value with low use may be left for later. High value with low use points the other way: access may need to be protected or extended. Disinvestment needs the same transparency as adoption. Clinicians must understand the reasons, and patients must be told what alternatives exist and how decisions are reviewed. Where evidence is mixed, restrict to the subgroups who benefit rather than withdraw entirely.
A worked example. List price SAR 70,000 per patient-year; 45% respond at one year; non-responders’ cost refunded at 50%. Expected net price = 70,000 × (1 − 0.55 × 0.50) = SAR 50,750. Cost per responder = 50,750 / 0.45 ≈ SAR 112,800, against SAR 155,600 without the rebate.
