|
|
||||||||
ORIGINAL RESEARCH |
From the Department of Obstetrics and Gynecology, Center for Clinical Health Policy ResearchEvidence-Based Practice Center, and Division of General Internal Medicine, Duke University Health System and Durham Veterans Affairs Medical Center, Durham, North Carolina; and Health Economics Research, Inc., Boston, Massachusetts.
Address reprint requests to: Evan R. Myers, MD, MPH Duke University Medical Center Department of Obstetrics and Gynecology DUMC 3279 Durham, NC 27710 E-mail: myers008{at}mc.duke.edu
| Abstract |
|---|
|
|
|---|
Methods: Using a Markov model of the natural history of cervical cancer, we estimated the effects of sensitivity, specificity, and screening frequency on cost-effectiveness. Our estimates of conventional Papanicolaou test sensitivity of 51% and specificity of 97% were obtained from a meta-analysis. We estimated the effect of reducing false-negative rates from 4090% and increasing false-positive rates by up to 20%, independently and jointly. We varied the marginal cost of improving sensitivity from $0 to $15.
Results: When specificity was held constant, increasing sensitivity of the Papanicolaou test increased life expectancy and costs. When sensitivity was held constant, decreasing specificity of the Papanicolaou test increased costs, an effect that was more dramatic at more frequent intervals. Decreased specificity had a substantial effect on cost-effectiveness estimates of improved Papanicolaou test sensitivity. Most of those effects are related to the cost of evaluation and treatment of low-grade lesions.
Conclusion: Policies or technologies that increased sensitivity of cervical cytologic screening increased overall costs, even if the cost of the technology was identical to that of conventional Papanicolaou smears. These effects appear to be caused by relatively high prevalence of low-grade lesions and are magnified at frequent screening intervals. Efficient cervical cancer screening requires methods with greater ability to detect lesions that are most likely to become cancerous.
Carcinoma of the cervix is one of the most common malignant conditions in women in many parts of the world. Papanicolaou smears detect preinvasive and early invasive disease and have led to significant reductions in its incidence and associated mortality in many countries.1 In the United States, the incidence of and mortality rate associated with cervical cancer have declined steadily; National Cancer Institute Surveillance, Epidemiology, and End Results registry data show a 43% decrease in incidence and a 46% decrease in mortality from 1973 to 1995.2 No such reductions occurred in countries in which cytologic screening is not widely available.3
In the United States and other countries in which screening is widely available, at least 40% of cases of cervical cancer occur in the 515% of women who have never been screened.46 Despite evidence that many cases are attributable to inadequate screening or inadequate follow-up of abnormal results, attention has been increased toward reducing false-negative results in women who are screened.
Several adjunctive technologies intended to reduce false-negative results of conventional smears have been approved by the U.S. Food and Drug Administration. Recent evaluations by our group7 and the Blue Cross/Blue Shield Technology Evaluation Center8 found that the cost-effectiveness of adjunctive technologies is directly related to frequency of screening. However, limitations in the extant evidence on sensitivity, specificity, and cost of new technologies do not permit reliable estimates of the cost-effectiveness of individual new tests. Therefore, we applied a comprehensive model of cervical cancer to identify circumstances in which new technologies could be cost-effective.
| Methods |
|---|
|
|
|---|
We used a "health system" perspective that considered the direct medical costs associated with the screening, diagnosis, and treatment of low- and high-grade SIL and cervical cancer. We did not include direct nonmedical costs (eg, cost of transportation to screening site).
Our measure of the comparative value of alternative testing strategies was the incremental cost per life-year saved, calculated by dividing the difference in predicted costs between two strategies by the difference in average life expectancy predicted for the strategies.
During each cycle of the Markov model, women were given screening procedures with some degree of sensitivity, specificity, and cost. Adjunctive technologies can be characterized by their reduction in rate of false-negative results (equivalent to the relative rate of true-positive results) compared with that of conventional tests.7 In that analysis, we model the overall test characteristics of a single generic technology (as a single test or in rescreening strategies) and its marginal cost compared with conventional Papanicolaou smears.
Abnormal cytologic results include atypical squamous cells of undetermined significance (ASCUS), low-grade SIL, high-grade SIL, or cancer. We assumed that any cytologic result of high-grade SIL or cancer would mean immediate referral for colposcopy, with biopsy if warranted. We further assumed that endocervical curettage was done routinely as part of colposcopic evaluations. Because not every woman will have endocervical curettage, that assumption might overestimate sensitivity and the average cost of colposcopy. We also assumed that a colposcopic or histologic diagnosis that is significantly less advanced than the cytologic result would lead to further diagnostic testing. For example, a biopsy result of low-grade SIL (or cervical intraepithelial neoplasia [CIN]) in the setting of a cytologic diagnosis of cancer or a biopsy result of normal with cytologic high-grade SIL would result in cone biopsy or loop electrosurgical excision procedure after excluding disease elsewhere in the lower genital tract.11
In the base case, we assumed that all women with low-grade SIL or higher would receive colposcopies, whereas those with ASCUS would receive repeat smears within 6 months, followed by colposcopies if results were abnormal. Because that strategy depends on a test of high sensitivity (because colposcopy depends on persistence of abnormality), we used it in the base case. Although more conservative management of low-grade SIL (such as observation) is being used increasingly, we also assumed that all low-grade SIL would be treated, primarily to be consistent with other models.
We assumed that women who survived 5 years or more were no longer at risk of recurrence, as have other models,1214 and that mortality associated with complications of therapy was included in cancer survival probabilities. Because some uncertainty exists in the literature about whether treatment of SIL results in total eradication of HPV infection, we created a "diagnosed HPV" state to represent women treated for SIL and allowed them to have a reduced progression rate. We assumed that the probability of progression was 5% of the age-specific progression rates, equivalent to a 95% cure rate for SIL treatment in other commonly cited models.1214 In the model, we assumed that adherence to appropriate management protocols would be perfect. Imperfect adherence increases the cost-effectiveness ratio by decreasing the effectiveness of the intervention.
Sources and values for model parameters are described below and are shown in Table 1
, along with plausible ranges. Our sensitivity and specificity estimates for conventional tests were based on a metaanalysis,7,15 that confirmed results of a previous metaanalysis.16 We used a cytologic threshold of ASCUS as a positive result and a histologic diagnosis of low-grade SIL or higher for true-positive results; estimated sensitivity is 51% and specificity is 97%. We assumed that the sensitivity and specificity of conventional smears for low-grade lesions were identical to those for high-grade lesions and cancer, despite evidence that suggested that sensitivity of conventional Papanicolaou smears improves with increased severity of lesions.15,16
|
We varied the reduction in the rate of false-negative results (equivalent to an increase in sensitivity) from 4090%, which incorporates the most effective reported range of improvement in sensitivity for currently approved adjunctive technologies. Without substantial data on relative specificity of new technologies compared with conventional tests, we assumed that the specificity of the hypothetical new test would be equivalent to that of the conventional test and decreased it to 75% of the value of the conventional test in sensitivity analysis. We estimated the marginal cost of the new technology compared with conventional Papanicolaou smears to range from $0 to $15.
For each histologic state, we calculated the proportion of all abnormal results represented by each possible cytologic diagnosis by using published data from the College of American Pathologists.27 Among women with ASCUS or worse on screening tests, some have ASCUS, some have low-grade SIL, some have high-grade SIL, and some have cancer. Those proportions vary depending on the underlying histologic condition. In the model, we combined ASCUS and atypical glandular cells of undetermined significance (AGCUS). The proportion of AGCUS smears with underlying high-grade pathology might be as high as 35%,28 which improves overall sensitivity for any screening strategy because a cytologic diagnosis of ASCUS will detect a higher proportion of clinically significant lesions. We assumed that those conditional probabilities would be similar for new technologies.
Stage-specific survivals for invasive cancer were derived from data from the Patterns of Care program of the American College of Surgeons29 (and A. Fremgen, personal communication).
Cost estimates of conventional smears and diagnosis and treatment of low-grade SIL, high-grade SIL, and various stages of cervical cancer were estimated by using primary claims and secondary data sources (Table 2
). Details were published7 or are available from the authors on request. A comprehensive approach was used to incorporate costs associated with all medical services provided. For instance, the costs associated with physician and pathology services were included in the total cost of screening for cervical cancer. For diagnosis and treatment, all costs of providing outpatient and inpatient services were estimated. However, societal costs or indirect costs, such as those associated with lost wages or waiting time at the physicians office, were not included.
|
Estimates based on episodes of care were consistently higher than estimates based on procedure-specific costs (owing to such factors as complications, comorbid conditions, and varying severity of disease within stages); we therefore used the higher estimates. Compared with previous estimates, our cost estimates for conventional screening were substantially lower, and our cost estimates for cervical cancer diagnosis and treatment substantially higher; this is consistent with our goal of favoring more sensitive strategies in the base case. We discounted costs and years of life at 3% annually in the base case and varied the rate from 0% to 5% in sensitivity analysis.30
We used one-, two-, and three-way sensitivity analysis of all variables to determine the effects of uncertainty surrounding cost and probability estimates on the models results. Because few data exist on specificity of new technologies, we examined potential effects of joint effects (ie, decreasing specificity as sensitivity increases) on a hypothetical new technology with a marginal cost of $0 per slide at 1-, 2-, and 3-year screening intervals. We sought to identify the values (thresholds) for sensitivity, specificity, or cost for which a strategy-involving a new technology would be cost-saving or cost-effective. This was done by using threshold values for incremental cost per life-year saved of $25,000, $50,000, or $75,000 compared with conventional tests at given screening intervals.
| Results |
|---|
|
|
|---|
|
|
|
|
| Discussion |
|---|
|
|
|---|
New tests with improved sensitivity led to substantially greater cost than health benefit, which relates to the natural history of HPV infection and cervical carcinogenesis. Although HPV infection is very common, the proportion of lesions that progress to high-grade SIL and cancer is small. At the population level, most extra lesions detected by reducing the rate of false-negative screening results will be unlikely to ever progress to invasive cancer. Although some improvement in life expectancy is gained, it is relatively small, especially at frequent screening intervals.
We also found that small changes in test specificity can have a great effect on cost-effectiveness estimates. This finding is important because increased sensitivity is unlikely to be achieved without some decrease in specificity. Thus, to improve cytologic screening, documentation of specificity of new technologies relative to conventional tests is essential.
Our analysis had several limitations, as does any model, and there was a high degree of uncertainty surrounding many of our parameters. However, we did extensive sensitivity analyses, varying model parameter estimates over a wide range of values, and found no change in our conclusions about incremental cost-effectiveness. The model used cross-sectional epidemiologic data to validate assumptions about incidence, prevalence, and lifetime risk, and because cross-sectional data reflect the experience of multiple successive cohorts, some parameters may have been overestimated or underestimated for certain age groups or populations. There might be some very high-risk populations (eg, HIV-infected women) for whom more sensitive screening at more frequent intervals would be cost-effective.31 However, given the size of the incremental cost-effectiveness ratios and the robustness of the findings over a wide range of parameter estimates, it seems unlikely that results would differ for most women at average risk in the United States. We did not include direct nonmedical costs, such as lost wages, child care, or travel expenses. With the relative prevalence of low-grade lesions, including such costs would probably cause even higher cost-effectiveness ratios. We did not adjust life expectancy for quality of life. Without some measure of morbidity associated with treatment of invasive cervical cancer, models that focus only on life expectancy might underestimate benefits of improved screening strategies. Early-stage cervical cancer has a high survival rate; therefore, failure to detect premalignant lesions that are later detected as stage I invasive cancers will not decrease life expectancy dramatically. Treatment options for all but the most minimally invasive cervical cancers are limited to radical hysterectomy and radiation, both of which have substantial risks for short-term and long-term morbidity.32 An alternative approach to estimating morbidity is to apply data on various treatments for different stages of cervical cancer to the predictions of the model to generate estimates of numbers and types of treatments of cervical cancer from various screening strategies.7 Quality-of-life issues beyond treatment for cervical cancer also must be considered. Given the high incidence of HPV infection and low-grade lesions compared with cervical cancer, most women are much more likely to receive diagnosis of and treatment for low-grade lesions than cervical cancer. Because any degree of abnormality on Papanicolaou smears can have substantial emotional effects,33 a true estimate of effects of cervical cytologic screening strategies on overall quality of life must include all aspects of screening, not just treatment of cervical cancer. Most of our parameter estimates were derived from United States data and may not be generalizable to other settings.
The main implication of our analysis for policy was that a large proportion of costs associated with new technologies are the consequence of improved sensitivity. New, more sensitive technologies are likely to be cost-effective compared with conventional tests only if they are associated with improved specificity, permit decreased screening frequency, or are used in conjunction with less expensive treatments of low-grade abnormalities. Increased test sensitivity alone is not sufficient to improve tests. New tests based on specific HPV types34,35 or that use biomarkers36 might meet all three requirements.
| Footnotes |
|---|
Received January 11, 2000. Received in revised form May 18, 2000. Accepted June 15, 2000.
| References |
|---|
|
|
|---|
2. Ries L, Kosary C, Hankey B, Miller B, Edwards B. SEER cancer statistics review, 1973-1995. Bethesda, Maryland: National Cancer Institute, 1998.
3. Parkin DM. The epidemiological basis for evaluating screening policies. In: Franco E, Monsonego J, eds. New developments in cervical cancer screening and prevention. Oxford, U.K.: Blackwell Science, 1997.
4. Stenkvist B, Soderstrom J. Reasons for cervical cancer despite extensive screening. J Med Screen 1996;3:2047.[Medline]
5. Pretorius R, Semrad N, Watring W, Fotheringham N. Presentation of cervical cancer. Gynecol Oncol 1991;42:4853.[Medline]
6. Stuart G, McGregor S, Duggan M, Nation J. Review of the screening history of Alberta women with invasive cervical cancer. CMAJ 1997;157:5139.[Abstract]
7. McCrory D, Matchar DB, Bastian L, Datta S, Hasselblad V, Hickey JD, et al. Evaluation of cervical cytology. Evidence Report/ Technology Assessment No. 5. (Prepared by Duke University under contract no. 290-970014). AHCPR publication no. 99-E010. Rockville, Maryland: Agency for Health Care Policy and Research, 1999.
8. Brown AD, Garber AM. Cost-effectiveness of 3 methods to enhance sensitivity of Papanicolaou testing. JAMA 1999;281:34753.
9. Myers ER, McCrory DC, Nanda K, Bastian L, Matchar DB. A model for the natural history of human papillomavirus infection and cervical carcinogenesis. Am J Epidemiol. In press.
10. Gustafsson L, Adami HO. Optimization of cervical cancer screening. Cancer Causes Control 1992;3:12536.[Medline]
11. DiSaia P, Creasman W. Clinical gynecologic oncology. 4th ed. St. Louis, Missouri: MosbyYear Book, 1993.
12. Eddy DM. Screening for cervical cancer. Ann Intern Med 1990;113: 21426.
13. Fahs MC, Mandelblatt J, Schechter C, Muller C. Cost effectiveness of cervical cancer screening for the elderly. Ann Intern Med 1992;117:5207.
14. Luce BR. Allocating costs and benefits in disease prevention programs: an application to cervical cancer screening. Washington, D.C.: Office of Technology Assessment, United States Congress, 1981.
15. Nanda K, McCrory DC, Myers ER, Bastian LA, Hasselblad V, Hickey JD, et al. Accuracy of the Papanicolaou test in screening for and follow-up of cervical cytological abnormalities: A systematic review. Ann Intern Med 2000;132:8109.
16. Fahey MT, Irwig L, Macaskill P. Meta-analysis of Pap test accuracy. Am J Epidemiol 1995;141:6809.
17. Davison JM, Marty JJ. Detecting premalignant cervical lesions. Contribution of screening colposcopy to cytology. J Reprod Med 1994;39:38892.[Medline]
18. Baldauf JJ, Dreyfus M, Lehmann M, Ritter J, Philippe E. Cervical cancer screening with cervicography and cytology. Eur J Obstet Gynecol Reprod Biol 1995;58:339.[Medline]
19. Hockstad RL. A comparison of simultaneous cervical cytology, HPV testing, and colposcopy. Fam Pract Res J 1992;12:5360.[Medline]
20. Roberts J, Gurley A, Thurloe J, Bowditch R, Laverty C. Evaluation of the ThinPrep Pap test as an adjunct to the conventional Pap smear. Med J Aust 1997;167:4669.[Medline]
21. Bolick D, Hellman D. Laboratory implementation and efficacy assessment of the ThinPrep cervical cancer screening system. Acta Cytol 1998;42:20913.[Medline]
22. Jenny J, Isenegger I, Boon M, Husain O. Consistency of a double PAPNET scan of cervical smears. Acta Cytol 1997;41:827.[Medline]
23. Kaufman R, Schreiber K, Carter T. Analysis of atypical squamous (glandular) cells of undetermined significance smears by neural network-directed review. Obstet Gynecol. 1998;91:55660.[Abstract]
24. Colgan T, Patten S, Lee J. A clinical trial of the AutoPap 300 QC system for quality control of cervicovaginal cytology in the clinical laboratory. Acta Cytol 1995;39:11918.[Medline]
25. Patten SF Jr, Lee JS, Wilbur DC, Bonfiglio TA, Colgan TJ, Richart RM. The AutoPap 300 QC System multicenter clinical trials for use in quality control rescreening of cervical smears. I: A prospective intended use study. Cancer 1997;81:33742.[Medline]
26. Stevens M, Milne A, James K, Brancheau D, Ellison D, Kuan L. Effectiveness of automated cervical cytology rescreening using the AutoPap 300 QC System. Diagn Cytopathol 1997;16:50512.[Medline]
27. Jones BA, Novis DA. Cervical biopsy-cytology correlation: A College of American Pathologists Q-Probes study of 22,439 correlations in 348 laboratories. Arch Pathol Lab Med 1996;120:52331.[Medline]
28. Kinney WK, Manos MM, Hurley LB, Ransley JE. Wheres the high-grade neoplasia? The importance of minimally abnormal Papanicolaou diagnoses. Obstet Gynecol 1998;91:9736.[Abstract]
29. Jones WB, Shingleton HM, Russell A, Chimel JS, Fregman A, Clive RE. Patterns of care for invasive cervical cancer: Results of a national survey of 1984 and 1990. Cancer 1995;76 Suppl:193447.[Medline]
30. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in health and medicine. New York: Oxford University Press, 1996.
31. Goldie SJ, Weinstein MC, Kuntz KM, Freedberg KA. The costs, clinical benefits, and cost-effectiveness of screening for cervical cancer in HIV-infected women. Ann Intern Med 1999;130:97107.
32. Bergmark K, Advall-Lundqvist E, Dickman PW, Henningsohn L, Steineck G. Vaginal changes and sexuality in women with a history of cervical cancer. N Engl J Med 1999;340:13839.
33. Paskett ED, Rimer BK. Psychosocial effects of abnormal Pap tests and mammograms: A review. J Womens Health 1995;4:7382.
34. Manos MM, Kinney WK, Hurley LB, Sherman ME, Shiegh-Ngai J, Kurman RJ. Identifying women with cervical neoplasia: Using human papillomavirus DNA testing for equivocal Papanicaloau results. JAMA 1999;281:160510.
35. Ballegooijen M, Marle M, Warmerdam P, Meijer G, Walboomers J, Habbema J. Present evidence on the value of HPV testing for cervical cancer screening: A model-based exploration of the cost-effectiveness. Br J Cancer 1997;76:6517.[Medline]
36. Wisman GB, Hollema H, deJong S, ter Schegget J, Tjong-A-Hung SP, Ruiters MH. Telomerase activity as a biomarker for (pre) neoplastic cervical disease in scrapings and frozen sections from patients with abnormal cervical smear. J Clin Oncol 1998;16:223845.[Abstract]
This article has been cited by other articles:
![]() |
M. Arbyn, C. Bergeron, P. Klinkhamer, P. Martin-Hirsch, A. G. Siebers, and J. Bulten Liquid Compared With Conventional Cervical Cytology: A Systematic Review and Meta-analysis Obstet. Gynecol., January 1, 2008; 111(1): 167 - 177. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. K Ohri HPV Vaccine: Immersed in Controversy Ann. Pharmacother., November 1, 2007; 41(11): 1899 - 1902. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. B. Matchar, E. V. Westermann-Clark, D. C. McCrory, M. Patwardhan, G. Samsa, S. Kulasingam, E. Myers, A. Sarria-Santamera, A. Lee, R. Gray, et al. Dissemination of Evidence-based Practice Center Reports Ann Intern Med, June 21, 2005; 142(12_Part_2): 1120 - 1125. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E. Lafata, J. Simpkins, L. Lamerato, L. Poisson, G. Divine, and C. C. Johnson The Economic Impact of False-Positive Cancer Screens Cancer Epidemiol. Biomarkers Prev., December 1, 2004; 13(12): 2126 - 2132. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Dewilde and R. Anderson The Cost-Effectiveness of Screening Programs Using Single and Multiple Birth Cohort Simulations: A Comparison Using a Model of Cervical Cancer Med Decis Making, October 1, 2004; 24(5): 486 - 492. [Abstract] [PDF] |
||||
![]() |
G. F. Sawaya, K. J. McConnell, S. L. Kulasingam, H. W. Lawson, K. Kerlikowske, J. Melnikow, N. C. Lee, G. Gildengorin, E. R. Myers, and A. E. Washington Risk of Cervical Cancer Associated with Extending the Interval between Cervical-Cancer Screenings N. Engl. J. Med., October 16, 2003; 349(16): 1501 - 1509. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. L. Kulasingam and E. R. Myers Potential Health and Economic Impact of Adding a Human Papillomavirus Vaccine to Screening Programs JAMA, August 13, 2003; 290(6): 781 - 789. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Goldie Chapter 15: Public Health Policy and Cost-Effectiveness Analysis J Natl Cancer Inst Monographs, June 1, 2003; 2003(31): 102 - 110. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Larry Maxwell, J. W. Carlson, M. Ochoa, T. Krivak, G. S. Rose, and E. R. Myers Costs and Effectiveness of Alternative Strategies for Cervical Cancer Screening in Military Beneficiaries Obstet. Gynecol., October 1, 2002; 100(4): 740 - 748. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. F. Sawaya, A. D. Brown, A. E. Washington, and A. M. Garber Current Approaches to Cervical-Cancer Screening N. Engl. J. Med., May 24, 2001; 344(21): 1603 - 1607. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |