|
|
||||||||
ORIGINAL RESEARCH |
From the Division of Adolescent Medicine, Childrens Hospital Medical Center, Cincinnati, Ohio; and the Division of Adolescent/Young Adult Medicine, Childrens Hospital, Boston, Massachusetts.
Address reprint requests to: Jessica A. Kahn, MD, MPH Division of Adolescent Medicine Childrens Hospital Medical Center 3333 Burnet Avenue Cincinnati, OH 45229
| Abstract |
|---|
|
|
|---|
Methods: We conducted a cross-sectional study of 477 female subjects aged 12 to 24 years who attended an adolescent clinic and had a previous Papanicolaou smear. Subjects completed a self-administered survey assessing self-report of Papanicolaou smear results, knowledge about Papanicolaou smears and human papillomavirus (HPV), attitudes about Papanicolaou screening and follow-up, and risk behaviors. The sensitivity, specificity, positive predictive value, and negative predictive value of self-reported results were calculated using the cytology report as the standard. Variables significantly associated with incorrect reporting were entered into logistic regression models controlling for age and race to determine independent predictors for incorrect reporting.
Results: Of the 477 participants, 128 (27%) had abnormal cytology reports and 66 (14%) had incorrect self-reports. Sensitivity of self-report was 0.79, specificity 0.89, positive predictive value 0.72, negative predictive value 0.92, and kappa (
) 0.66. The adjusted odds ratios (OR) and 95% confidence intervals (CI) of the variables comprising a logistic regression model predicting incorrect reporting were an HPV knowledge source of zero (OR 2.4, CI 1.0, 5.8), low perceived communication with the provider (OR 2.1, CI 1.1, 4.0), and no contraception at last intercourse (OR 5.5, CI 2.7, 11.0).
Conclusion: The validity of adolescent and young adult self-reported Papanicolaou smear result is high, except among those who lack knowledge of HPV, perceive poor communication with the provider, and use contraception inconsistently.
The prevalence of abnormal cervical cytology in adolescents and young women is high and might be increasing in the United States.18 Infection with human papillomavirus (HPV) types 16, 18, 31, 33, 35, and 45 is strongly associated with cervical dysplasia,913 and the biologic and behavioral correlates of infection are the focus of active research. These factors include early age at first sexual intercourse, multiple sexual partners, oral contraceptive (OC) use, and smoking.3,1322
Surveys to identify the associations between cervical dysplasia and behavior frequently depend on self-reporting of Papanicolaou smear results. In the clinical setting, self-reporting of previous Papanicolaou smear results might guide treatment because it could be difficult to obtain prior cytology reports. Despite the research and clinical dependence on self-reporting, little is known about its validity in adolescent and young adult populations. Although one study demonstrated fair agreement between adolescent self-reporting and laboratory reports of cervical dysplasia,23 two studies disagreed about the validity of adolescent self-reporting of sexually transmitted diseases (STD).24,25 These studies suggested that incorrect patient reporting might be associated with inadequate patient education and knowledge about the pelvic examination, Papanicolaou smears, and tests for STD.2325 Adolescents and young women at highest risk for HPV and cervical dysplasia might also be the least likely to establish the rapport and communication with health care providers that would enhance their understanding of Papanicolaou smear results.
The objectives of this study were to assess the validity of young womens self-reported Papanicolaou smear result and to determine whether patient knowledge about Papanicolaou smears, attitudes about screening and follow-up, and sexual behaviors are associated with incorrect reporting. We hypothesized that the validity of self-reporting would be low and that incorrect patient reporting would be associated with inadequate knowledge about Papanicolaou smears and HPV, poor communication with the provider, and risky sexual behavior.
| Materials and Methods |
|---|
|
|
|---|
The self-administered, pencil-and-paper survey instrument was administered during the clinic visit and consisted of 116 items assessing three areassocio-demographic and health care characteristics; cognitive variables including knowledge, attitudes, and beliefs about Papanicolaou smear screening and follow-up; and risk behaviors associated with abnormal Papanicolaou smears. Participants were informed that this was a study of gynecologic health but were not aware that the investigators were studying Papanicolaou smear report and follow-up, nor informed that they were eligible because they had had a Papanicolaou smear in the past.
Knowledge about Papanicolaou smears was measured using five items with a possible score range of zero (no correct items) to five (all correct items). Knowledge about HPV was measured using a six-item scale with a possible score range of zero (the participant had never heard of HPV) to six (the patient had heard of HPV and answered all other items correctly). The two subscales measuring Papanicolaou smear and HPV knowledge were dichotomized for analysis at the lowest quartile, corresponding to a scale score of zero, because scores were highly skewed. A research assistant collected the first portion of the survey, which assessed knowledge, then gave subjects the second portion of the survey, which assessed attitudes and beliefs. It was preceded by a paragraph that defined a Papanicolaou smear and gave routine recommendations for screening and follow-up. Preliminary interviews and pilot tests of the survey indicated that knowledge about Papanicolaou smears and HPV was poor; thus, the purpose of the introductory paragraph was to ensure that participants would have baseline knowledge on which to base their responses to questions about beliefs and attitudes.
Items assessing attitudes and beliefs about Papanicolaou smear screening and follow-up appointments were derived from previous work of the investigators26 and literature review.2630 The items assessing attitudes and beliefs were divided into the following seven domains: intention to comply with Papanicolaou smear follow-up appointments (one item); perceived control over returning for a Papanicolaou smear (two items); subjects attitudes about Papanicolaou smear follow-up (14 items); subjects perception of the attitudes of friends, family, and providers regarding Papanicolaou smear follow-up (five items); communication with the provider (seven items); perceived susceptibility to an abnormal Papanicolaou smear (one item); and external cues to obtaining a Papanicolaou smear (six items).
Survey items assessed five risk behaviors and two associated health outcomes, including age at coitarche, number of lifetime sexual partners, contraception use at last sexual intercourse, condom use at last sexual intercourse, smoking in the past 30 days, history of pregnancy, and history of STD. Computerized medical and cytology records were reviewed to assess one additional behavior, evidence of past compliance with Papanicolaou screening and follow-up. The definition of past compliance, which was derived from practices standard in the clinic, was having kept an appointment for a routine Papanicolaou smear within 15 months of the prior test; follow-up Papanicolaou smear within 6 months of a smear demonstrating atypical cells of undetermined significance (ASCUS); colposcopy within 2 months of a second smear demonstrating ASCUS; and colposcopy within 2 months of a smear demonstrating low-grade squamous intraepithelial lesion (SIL), high-grade SIL, or carcinoma.
Abnormal Papanicolaou smear by self-report was defined as an affirmative response to the item: "Have you even been told by a doctor or a nurse that you had an abnormal Papanicolaou smear?" If the respondent answered yes, she was asked if the Papanicolaou smear had been done outside of the hospital. Abnormal Papanicolaou smear by laboratory report was defined as one or more prior reports of ASCUS, low-grade SIL, high-grade SIL, or carcinoma. If a subject reported that she had ever been told by a doctor or nurse that she had an abnormal Papanicolaou smear, her self-report was considered correct if she had at least one abnormal prior Papanicolaou smear by laboratory report. If a subject reported that she had not been told that she had an abnormal Papanicolaou smear, her self-report was considered correct if she had never had an abnormal laboratory report. Although all subjects attended the adolescent clinic, an estimated 10% of the subjects had had one or more prior Papanicolaou smears done in the adolescent gynecology clinic or teen-tot clinic. All clinics are located in the same hospital, and several adolescent clinic staff also provide care in the gynecology clinic and teen-tot clinic. All samples were sent to the same laboratory and results were available on the same computerized cytology result information system; therefore, information on Papanicolaou smear results was the same regardless of the clinic where it was done. Since 1993, all patients with abnormal Papanicolaou smear reports on specimens collected in three clinics have been informed of the abnormality by letter, and letters from the three clinics contain the same information and recommendations for follow-up. Patients with a first Papanicolaou smear demonstrating ASCUS were instructed to have a repeat Papanicolaou smear in 4 months. Patients with a second Papanicolaou smear demonstrating ASCUS or any Papanicolaou smear demonstrating low-grade SIL or high-grade SIL were instructed to make two appointments, one to discuss the result and another for colposcopy. Patients with high-grade SIL also received a phone call from a nurse in the adolescent clinic. Patients who missed their colposcopy appointments were sent a letter advising them to reschedule and were called by a nurse to help them reschedule. Patients who missed two colposcopy appointments were sent a registered letter and again called by a nurse.
Ten patients from the study population participated in a qualitative assessment of the survey to assure understandability of the items. A research assistant interviewed these patients to obtain feedback on any items that were unclear. Test-retest reliability was assessed by comparing scale scores measured at a 2-week interval in an additional 24 subjects. Intraclass correlation coefficients for the scales measuring attitudes, subjective norm, and communication with the provider were 0.86, 0.69, and 0.77 respectively among those subjects.
Sensitivity, specificity, positive predictive value, negative predictive value, and kappa (
) statistic of self-reported Papanicolaou smear results were calculated using the laboratory report as the standard. Subjects with correct versus incorrect self-reports were compared on all variables by using
2, Mann-Whitney U, and Student t tests. Those variables associated with self-report at P < .05 were entered into a series of logistic regression models designed to predict incorrect self-report after controlling for age and race. The first model incorporated knowledge of Papanicolaou smears, knowledge of HPV, and the seven attitudinal variables. The second model incorporated the eight behavioral and health outcome variables. The third model was a composite of the knowledge-attitude and behavior-outcome variables that independently predicted incorrect self-report in the first two models. Adjusted odds ratios (OR) and 95% confidence intervals (CI) are reported for each model.
| Results |
|---|
|
|
|---|
|
statistic was 0.66, indicating substantial agreement between self-report and cytology report.31
|
|
|
| Discussion |
|---|
|
|
|---|
Several studies have investigated the validity of self-reported Papanicolaou smear results by adult women. Most assessed the accuracy with which women recalled having had Papanicolaou smear screening,3242 although the study populations and recall periods varied widely. The sensitivity of reporting previous Papanicolaou smears ranged from 0.90 to 0.95, specificity from 0.37 to 0.55, positive predictive value from 0.46 to 0.77, negative predictive value from 0.82 to 0.88, and
statistic from 0.08 to 0.53.
Two studies examined the validity of self-reported Papanicolaou smear results. Biro et al23 reported that the
statistic reflecting concordance between adolescent self-report of Papanicolaou smear results and laboratory results was 0.396, but the study was limited by a small sample size and low enrollment rate. McKenna et al36 found that a reported history of an abnormal Papanicolaou smear in a sample of 105 women agreed only slightly with documented dysplasia (
= 0.08). In our study the higher
statistic of 0.66 might reflect the shorter recall period for adolescents compared with adults or different definitions of abnormal Papanicolaou smear. In addition, laboratory reports in the Biro et al23 and McKenna et al36 studies were obtained by retrospective study of written medical records, which can be erroneous or limited due to missing data.43,44 We attempted to increase accuracy in assessment of the cytology report by using computerized records and excluding adolescents who reported having a Papanicolaou smear done elsewhere.
The associations between accuracy with which women recall having had a Papanicolaou smear and sociodemographic factors, knowledge, attitudes, and behaviors have been reported in previous studies, but the results were inconsistent.33,36,39 Our study examined the associations between incorrect report of a Papanicolaou smear result and sociodemographic, cognitive, and behavioral variables. Such associations might help clinicians and researchers identify adolescents who are likely to report incorrectly.
There are several limitations to this study. First, it is possible that adolescents who seek care at multiple sites are less likely to be informed of or clear about their test results. If so, the exclusion of adolescents with an abnormal Papanicolaou smear who reported having had a Papanicolaou smear elsewhere would create a selection bias favoring correct reporters. Second, subjects who reported normal Papanicolaou results were not asked whether they had had Papanicolaou smears done elsewhere. If subjects with abnormal Papanicolaou smears done elsewhere incorrectly reported their result, we would have missed false-negative reports. Third, the implications of ASCUS are controversial, and subjects might not know whether to report this result as abnormal. Although the standard clinic letter sent to patients defines ASCUS as abnormal, it is possible that the high rate of incorrect reporting among subjects with ASCUS reflects the subject and professional uncertainty regarding its course and treatment. Fourth, as with any study, our findings might not generalize to entire adolescent and young adult populations with different sociodemographic characteristics. We were particularly interested in studying this clinic population because it is characterized by a high proportion of minority, low-income young women. These young women are at risk for abnormal Papanicolaou smears and are often asked by clinicians or investigators about a history of abnormal Papanicolaou smear. Fifth, only young women who were seen in the adolescent clinic during the study period were eligible for enrollment, which could create a selection bias favoring patients who tend to come to the clinic for urgent care visits or who are compliant with follow-up visits. Finally, the study did not address ability to recall having had a Papanicolaou test, only whether self-reported result was accurate.
| Footnotes |
|---|
The authors gratefully acknowledge the valuable contributions of Frank Biro, MD, for critical review of the manuscript; Victoria Chiou, for subject recruitment, data entry, and assistance with data analysis; and Jonathan Ellen, MD, Lawren Daltroy, PhD, and Karen Emmons, PhD, for assistance with scale development and analysis.
Received January 31, 2000. Received in revised form April 7, 2000. Accepted April 20, 2000.
| References |
|---|
|
|
|---|
2. Economos K, Perez-Veridiano N, Mann M, Delke I, Tancer ML. Abnormal cervical cytology in adolescents: A 15-year experience. J Reprod Med 1994;39:9736.[Medline]
3. Sadeghi S, Hsieh E, Gunn S. Prevalence of cervical intraepithelial neoplasia in sexually active teenagers and young adults. Am J Obstet Gynecol 1984;148:7269.[Medline]
4. Crowther ME. Is the nature of cervical carcinoma changing in young women? Obstet Gynecol Surv 1994;50:7182.
5. Mangan SA, Legano LA, Rosen CM, McHugh MT, Fierman AH, Dreyer BP, et al. Increased prevalence of abnormal Papanicolaou smears in urban adolescents. Arch Pediatr Adolesc Med 1997;151: 4814.[Abstract]
6. Russo JF, Jones DED. Abnormal cervical cytology in sexually active adolescents. J Adolesc Health 1984;5:26971.
7. Moscicki AB, Palefsky JM, Gonzales J, Smith G, Schoolnik GK. Colposcopic and histologic findings and human papillomavirus DNA test variability in young women positive for HPV DNA. J Infect Dis 1992;166:9517.[Medline]
8. Fisher M, Rosenfeld W, Burk R. Cervicovaginal human papillomavirus infection in suburban adolescents and young adults. J Pediatr 1991;119:8215.[Medline]
9. Lungu O, Sun XW, Felix J, Richart RM, Silverstein S, Wright TC. Relationship of human papillomavirus type to grade of cervical intraepithelial neoplasia. JAMA 1992;267:24936.[Abstract]
10. Moscicki AB, Palefsky JM, Gonzalez J, Schoolnik GK. The association between human papillomavirus deoxyribonucleic acid status and the results of cytologic rescreening tests in young, sexually active women. Am J Obstet Gynecol 1991;165:6771.[Medline]
11. Moscicki AB, Broering J, Powell K, Klein J, Clayton L, Smith G, et al. Comparison between colposcopic, cytologic, and histologic findings in women positive and negative for human papillomavirus DNA. J Adolesc Health 1993;14:749.[Medline]
12. Rosenfeld WD, Vermund SH, Wentz SJ, Burk R. High prevalence rate of human papillomavirus infection and association with abnormal Papanicolaou smears in sexually active adolescents. Am J Dis Child 1989;143:14437.[Abstract]
13. Kotloff KL, Wasserman SS, Russ K, Shapiro S, Daniel R, Brown W, et al. Detection of genital human papillomavirus and associated cytological abnormalities among college women. Sex Transm Dis 1998;25:24350.[Medline]
14. Ho GY, Bierman R, Beardsley L, Chang CJ, Burk RD. Natural history of cervicovaginal papillomavirus infection in young women. N Engl J Med 1998;338:4238.
15. Brock K, Berry G, Brinton L, Kerr C, MacLennan R, Mock PA, et al. Sexual, reproductive, and contraceptive risk factors for carcinomain-situ of the uterine cervix in Sydney. Med J Aust 1989;150:12530.[Medline]
16. Ley C, Bauer H, Reingold A, Schiffman MH, Chambers JC, Tashiro CJ, et al. Determinants of genital human papillomavirus infection in young women. J Natl Cancer Inst 1991;83:9971003.
17. Wright VC, Riopelle MA. Age at beginning of coitus versus chronologic age as a basis for Papanicolaou smear screeing: An analysis of 747 cases of preinvasive disease. Am J Obstet Gynecol 1984;149:82430.[Medline]
18. Moscicki A, Winkler B, Irwin C, Schachter J. Differences in biologic maturation, sexual behavior, and sexually transmitted disease between adolescents with and without cervical intraepithelial neoplasia. J Pediatr 1989;115:48793.[Medline]
19. Brisson J, Morin C, Fortier M, Roy M, Bouchard C, Leclerc J, et al. Risk factors for cervical intraepithelial neoplasia: Differences between low- and high-grade lesions. Am J Epidemiol 1994;140:70010.
20. Trevathan E, Layde P, Webster LA, Adams JB, Benigno BB, Ory H. Cigarette smoking and dysplasia and carcinoma in situ of the uterine cervix. JAMA 1983;250:499502.[Abstract]
21. Burk RD, Ho GY, Beardsley L, Lempa M, Peters M, Bierman R. Sexual behavior and partner characteristics are the predominant risk factors for genital human papillomavirus infection in young women. J Infect Dis 1996;174:67989.[Medline]
22. Kataja V, Syrjanen S, Yliskoski M, Hippelinen M, Vayrynen M, Saarikoski S, et al. Risk factors associated with cervical human papillomavirus infections: A case-control study. Am J Epidemiol 1993;138:73545.
23. Biro FM, Rosenthal SL, Rymarquis L, Kollar LM, Hillard PJA. Adolescent girls understanding of Papanicolaou smear results. J Pediatr Adolesc Gynecol 1997;10:20912.[Medline]
24. Hornberger LL, Rosenthal SL, Biro FM, Stanberry LR. Sexual histories of adolescent girls: Comparison between interview and chart. J Adolesc Health 1995;16:2359.[Medline]
25. Clark LR, Brasseux C, Richmond D, Getson P, DAngelo LJ. Are adolescents accurate in self-report of frequencies of sexually transmitted diseases and pregnancies? J Adolesc Health 1997;21:916.[Medline]
26. Kahn JA, Chiou V, Allen J, Harden E, Goodman E, Perlman S, et al. Beliefs about Papanicolaou smears and compliance with Papanicolaou smear follow-up in adolescents: A qualitative analysis. Arch Pediatr Adolesc Med 1999;153:104654.
27. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Processes 1991;50:179211.
28. Janz NK, Becker MH. The health belief model: A decade later. Health Educ Q 1984;11:147.[Medline]
29. Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, New Jersey: Prentice-Hall, 1986:47104.
30. Prochaska JO, DiClemente CC. Transtheoretical therapy: Toward a more integrative model of change. Psychother Theory Res Pract 1982;20:16173.
31. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:15974.[Medline]
32. Bowman JA, Redman S, Dickinson JA, Gibberd R, Sanson-Fisher RW. The accuracy of Papanicolaou smear utilization self-report: A methodological consideration in cervical screening research. Health Serv Res 1991;26:97107.[Medline]
33. Bowman JA, Sanson-Fisher R, Redman S. The accuracy of self-reported Papanicolaou smear utilization. Soc Sci Med 1997;44:96997.
34. McGovern PG, Lurie N, Margolis KL, Slater JS. Accuracy of self-report of mammography and Papanicolaou smear in a low-income urban population. Am J Prev Med 1998;14:2018.[Medline]
35. Gordon NP, Hiatt RA, Lampert DI. Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 1993;85:56670.
36. McKenna MT, Speers M, Mallin K, Warnecke R. Agreement between patient self-reports and medical records for Papanicolaou smear histories. Am J Prev Med 1992;8:28791.[Medline]
37. Walter SD, Clarke EA, Hatcher J, Stitt LW. A comparison of physician and patient reports of Papanicolaou smear histories. J Clin Epidemiol 1988;41:40110.[Medline]
38. Perez-Stable EJ, Otero-Sabogal R, Sabogal F, McPhee SJ, Hiatt RA. Self-reported use of cancer screening tests among Latinos and Anglos in a prepaid health plan. Arch Intern Med 1994;154:107381.[Abstract]
39. Michielutte R, Dignan MB, Wells HB, Bahnson J, Smith M, Wooten R, et al. Errors in reporting cervical screening among public health clinic patients. J Clin Epidemiol 1991;44:4038.[Medline]
40. Howe HL, Bzduch H. Recency of Papanicolaou smear screening: A multivariate model. Public Health Rep 1987;102:295301.[Medline]
41. Hiatt RA, Perez-Stable EJ, Quesenberry C, Sabogal F, Otero-Sabogal R, McPhee SJ. Agreement between self-reported early cancer detection practices and medical audits among Hispanic and non-Hispanic white health plan members in northern California. Prev Med 1995;24:27885.[Medline]
42. Suarez L, Goldman DA, Weiss NS. Validity of Papanicolaou smear and mammogram self-reports in a low-income Hispanic population. Am J Prev Med 1995;11:948.[Medline]
43. Lloyd SS, Rissing JP. Physician and coding errors in patient records. JAMA 1985;254:13306.[Abstract]
44. Romm FJ, Putnam SM. The validity of the medical record. Med Care 1981;19:3105.[Medline]
This article has been cited by other articles:
![]() |
L. B. Fisher, I. W. Miles, S. B. Austin, C. A. Camargo Jr, and G. A. Colditz Predictors of Initiation of Alcohol Use Among US Adolescents: Findings From a Prospective Cohort Study Arch Pediatr Adolesc Med, October 1, 2007; 161(10): 959 - 966. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Kahn, E. Goodman, B. Huang, G. B. Slap, and S. J. Emans Predictors of Papanicolaou Smear Return in a Hospital-Based Adolescent and Young Adult Clinic Obstet. Gynecol., March 1, 2003; 101(3): 490 - 499. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |