Embedded Files
Appraisal of: Lister J, Paisley S, Carroll C, Tappenden P. Empirical Testing of Alternative Search Methods to Retrieve Utility Values for Health Economic Modelling. Pharmacoeconomics. 2024 Nov;42(11):1255-1266. doi: 10.1007/s40273-024-01414-7.
Appraisal of: Lister J, Paisley S, Carroll C, Tappenden P. Empirical Testing of Alternative Search Methods to Retrieve Utility Values for Health Economic Modelling. Pharmacoeconomics. 2024 Nov;42(11):1255-1266. doi: 10.1007/s40273-024-01414-7.
Reviewer(s): Julie Glanville, David Kaunelis
Full Reference: Lister J, Paisley S, Carroll C, Tappenden P. Empirical Testing of Alternative Search Methods to Retrieve Utility Values for Health Economic Modelling. Pharmacoeconomics. 2024 Nov;42(11):1255-1266 doi: 10.1007/s40273-024-01414-7.
Short description:
This case study focuses on evaluating the efficiency of three alternative search methods for identifying health economic model input parameters, particularly health state utilities. The case study used one multiple technology appraisal.
The three search methods were (1) "usual practice" meaning the methods reported in the case study report (2) iterative searching where after each search iteration studies are selected and the identified data are tested in the economic model and (3) rapid review where only the final results are screened thoroughly. Efficiency of the three approaches was measured by time, burden (precision and number needed to read) and relevance of studies to the model, and the impact on the results of the model. Two iterations were used in the iterative search and the rapid review involved a search of MEDLINE only, restricting synonyms and searching utility methods only in the title and abstracts.
The study reports that iterative searching was identified as the most efficient method, requiring significantly less time (380 minutes) compared to usual practice (1440 minutes). Iterative searching yielded a higher precision in identifying relevant data (7.32%) compared to usual practice (1.07%) and rapid review (1.55%). However, both iterative searching and rapid review missed some relevant studies that usual practice identified. The main findings and decisions made from the economic model remained consistent across the different search methods. Iterative searching, though more efficient, did not alter the model's conclusions regarding treatment effectiveness.
The study suggests that iterative searching in health economic modeling might improve search efficiency without compromising the quality of retrieved data. Further research is encouraged to validate these findings from a single case study across additional contexts.
Limitations stated by the author(s):
This is a single case study and findings may be different in other cases and research team approaches may vary.
The time to develop the usual practice search strategy was not collected and the authors assumed no additional time was taken to create the strategy, which means that the effort associated with usual practice is likely to be underestimated.
Limitations stated by the reviewer(s):
No other limitations noted.
Study Type:
Case study; relative recall approach
Related Chapters:
None
Tags:
Economics
Utilities
Databases
Searching.
Supplemental publications to the study:
https://link.springer.com/article/10.1007/s40273-024-01414-7#Sec15
Page updated
Report abuse