|
|
||||||||
ORIGINAL RESEARCH |
From the Department of Obstetrics and Gynecology, and Clinical Research Unit, Kaiser Permanente, Wheat Ridge, Colorado.
Address reprint requests to: Jandel T. Allen-Davis, MD, Department of Obstetrics and Gynecology, Kaiser Permanente, 4803 Ward Road, Wheat Ridge, CO 80033; E-mail: jandel.c.allen-davis{at}kp.org.
| ABSTRACT |
|---|
|
|
|---|
METHODS: Prospective structured telephone nurse interviews of all patients with vulvovaginal complaints who called the Kaiser Permanente Telephone Call Center were conducted. Patients were appointed to a physician, nurse midwife, or physicians assistant for office evaluation. Both groups (nurses and practitioners) made independent diagnosis and treatment decisions.
coefficients were used to evaluate the interexaminer agreement between telephone nurses and practitioners, and practitioners and traditional diagnostic tests.
RESULTS: A total of 485 patients underwent telephone interviews, and 253 (52%) completed the study protocol.
values showed poor agreement between nurses and practitioners for bacterial vaginosis (0.12), candidiasis (0.22), and trichomoniasis (-0.05). Practitioners failed to accurately diagnose vaginitis when
values were analyzed. There was also poor agreement between telephone nurses and practitioners regarding the necessity of an office visit (0.14).
CONCLUSION: This prospective study challenges the notion that the telephone is an effective tool to diagnose and treat vulvovaginal complaints. Moreover, given the poor agreement between practitioners diagnoses and microbiologic and microscopic data, further study into optimal diagnosis of vulvovaginitis is needed.
The telephone is a point of entry in many modern health care delivery systems. In an effort to control costs, to avoid unnecessary appointments, and to maximize efficiency for patients and offices, nurses may diagnose and manage many common conditions via the telephone, usually following established protocols. These systems range from simple office-based phone triage to large generic telephone call centers that operate around the clock. Despite this common practice, there are very few published studies evaluating clinical outcomes of care delivered in this fashion.14 Most published research evaluates patient satisfaction, and there are no studies evaluating either satisfaction or clinical outcomes with phone management of common gynecologic complaints.
Vulvovaginitis is commonly managed by phone, often by office nurses. Vulvovaginitis is the most common reason why women seek gynecologic help. With the introduction of over-the-counter antifungals, treatment of vulvovaginal complaints is more readily available, but relies on a patients self-diagnosis. If this self-assessment is erroneous, several suboptimal outcomes could occur. First, patients may be selecting out more resistant strains of Candida species, while failing to receive the correct diagnosis and treatment in the case where candidiasis is not the cause of the symptoms; this could result in complicating a rather straightforward case of vulvovaginitis. Second, incorrect diagnosis potentially increases costs, results in more office visits, and erodes any efficiency that may be gained by phone management.
Additionally, the diagnostic accuracy of providers has not been scrutinized in an evidence-based fashion. Specifically, no published study has looked at microscopy, pH, and culture and correlated them with final diagnosis or patient outcomes. This prospective study attempts to address these complex issues.
| MATERIALS AND METHODS |
|---|
|
|
|---|
In the office, patients answered the same questions the phone nurse had asked them via a self-administered questionnaire. Practitioners reviewed this questionnaire and performed a physical examination. Cervical cultures for Neisseria gonorrhea were obtained via Thayer Martin plates. Chlamydia trachomatis testing was obtained using Chlamydiazyme enzyme immunoassay (Abbott Laboratories, Diagnostics Division, Abbott Park, IL). Additionally, vaginal pH and microscopic evaluation of vaginal discharge were done. Vaginal fluid was cultured for Trichomonas vaginalis using the In-Pouch system (BioMed Diagnostics, San Jose, CA) (tests were read at 4 days and 7 days). Candida species was cultured using a BAP/MAC Choc Ml Sab plate, and aerobic cultures were also done. The practitioners made a diagnosis and prescribed treatment. They made a judgment regarding whether they would have treated the patient over the phone. Call Center nurses were blinded to this information. An attempt was made to contact patients 2 weeks after treatment to ascertain whether they completed the treatment and whether their symptoms had resolved.
Analyses were done using SAS 6.12 (SAS System, Cary, NC).
coefficients were used to evaluate the interexaminer agreement between phone nurses and providers diagnoses, and between laboratory and provider office diagnoses. The
statistic is a measure of reproducibility between repeated assessments. In general, values of
greater than 0.75 denote excellent agreement beyond chance, values below 0.40 indicate poor agreement beyond chance, and values in between represent fair-to-good agreement beyond chance.5
| RESULTS |
|---|
|
|
|---|
Table 1
and Table 2
present pertinent historic data and clinical findings. There are statistically significant differences between Call Center-elicited responses and patient self-reports of condom use, sexual activity, and symptoms, despite the fact that patients were seen within hours of the phone interview. Moreover, there was a statistically significant difference between patient self-reports and provider descriptions of vaginal discharge color.
|
|
|
|
values for diagnoses (Table 5
) showed poor agreement between nurses and providers for bacterial vaginosis (0.12), vulvovaginal candidiasis (0.22), and trichomoniasis (-0.05). Additionally, poor agreement was seen between providers and clinical findings consistent with bacterial vaginosis (0.31). Office providers accuracy was poor when compared with culture (Table 6
), and was worse for nurses.
|
|
= 0.14). Thirty-six percent of nurses believed phone treatment was appropriate for a given patient versus 28% of providers. One hundred fifteen (45%) patients were reached by phone at 2 weeks post-treatment. Most patients (82%) completed therapy, and 81% reported symptom resolution.
| DISCUSSION |
|---|
|
|
|---|
The current path to the diagnosis of vaginitis relies on accurate reporting of symptoms, coupled with the use of physical examination and microscopy. In this study, eliciting patients symptoms over the phone yielded answers that were different from those self-reported in the office to the same questions, and most of the differences were statistically significant. This has been evaluated in the psychiatric literature, and there appears to be good agreement between the phone and face-to-face interviews; no one has compared the phone and self-assessment of symptoms.68 One must wonder if there are other areas of medicine in general, and gynecology in particular, wherein patients are reluctant to share details. The statistically significant difference between phone-reported sexual activity and what patients disclosed to providers in the office is an example of a reticence to share intimate or seemingly embarrassing details. Non-disclosure of this type could influence a phone triage nurses ability to accurately assess a patients complaints.
Although most women are aware of vulvovaginal candidiasis, few are aware of the symptoms of bacterial vaginosis or trichomoniasis. In this study, most women did not know the cause of their symptoms. There was also a difference between how patients described their discharge (ie, color) and what providers found on examination. If phone nurses use this information to decide triage, there is the possibility that this inaccuracy could affect their treatment decisions. This is a strong reason to argue against self-treatment.
There was a lack of agreement between phone nurses and office practitioners in diagnosing vulvovaginitis. This may reflect a relative lack of knowledge on the part of the nurses, but it may also indicate the nonspecific nature of vulvovaginal symptoms, which renders making accurate diagnoses more difficult. We were unable to point to a specific constellation of symptoms that would allow nurses or providers to arrive at a correct diagnosis with a high degree of certainty. Vulvovagnitis is a nonurgent problem, and Leprohon and Patel,1 in a paper exploring decision-making strategies in emergency medical services, found that decisions tended to be more accurate in high-urgency situations. Conversely, when problems became more complex and less urgent, decisions tended to be inaccurate and to show a decoupling of knowledge and action. The lack of agreement between those making a diagnosis without the benefit of a physical examination and those who see patients and do the examinations is striking, but the lack of agreement between providers and currently widely available laboratory tests to augment the diagnosis of vaginitis indicates that current clinical practice might be lacking as well.
The majority of providers in this study were nurse practitioners, but when we controlled for the knowledge level (assuming physicians would be more highly skilled and therefore would arrive at more accurate diagnoses), we found no difference in results. Given this, one must wonder whether the basic tools for diagnosing vaginitis (ie, microscopy and physical examination) are sufficient or whether there are deficiencies in provider knowledge regarding the use of all available tools, including culture, pH, and amine testing. In teaching programs, microscopy of vaginal fluids is taught early in training by those who may lack clinical experience diagnosing vaginitis, perhaps with the unintentional outcome that students and junior residents assume vaginitis is a simple condition to diagnose and treat. The results of this study question that assumption.
Telephone nurses were more likely than practitioners to be comfortable with treatment over the phone, a finding that questions their perception of their knowledge base, the reliability of protocols, or their assumptions about the connections between symptoms and diagnoses. No prestudy nurse or provider education regarding the diagnosis and management of vaginitis was done, as the purpose of the study was to evaluate typical practice patterns in a system that uses phones extensively for triage and treatment. It is difficult to assess the degree to which this approach affected our results without repeating the study after an intensive educational program in the diagnosis and treatment of vulvovaginitis.
One limitation of the study involves the lack of agreement regarding the optimal way to diagnose vaginitis. Our use of laboratory data might fall short of the definition of a gold standard. Bacterial vaginosis is diagnosed by clinical parameters (eg, Amsels criteria, presence of clue cells, pH, or a positive whiff test). We used pH and microscopy but did not perform the whiff test, which might have changed the agreement data between providers and clinical findings in a more positive direction. Additionally, as pH results were not recorded in 20% of the examinations, pH was excluded from the final analysis.
Candida species can be found as part of the normal vaginal flora, so its presence does not necessarily mean that it is the cause of vaginal complaints. Further, microscopy is a suboptimal way to diagnose vaginitis in this case, especially in the face of extreme inflammation that can obscure the true clinical condition or in the absence of training in the preparation and interpretation of a wet mount.9 Practitioners were treating on the basis of the microscopy, which tended to yield more diagnoses of vulvovaginal candidiasis and trichomoniasis than did culture, which has a higher degree of accuracy. This raises the possibility that providers go to the microscope with a clinical bias based on history and physical findings, so they might be overdiagnosing these two conditions.
Most patients reported symptom improvement after 2 weeks despite the diagnostic incongruence. It might be that the follow-up phone calls should have been done later than they were (ie, 46 weeks) to assess patients for resolution and recurrence. It is doubtful that this symptom resolution would be sustained in the case of improper treatment, although without a greater lag time in follow-up, long-term outcomes are unknown.
Our study points out the need to investigate outcomes of telephone triage systems more intensively and of telephone triage of vulvovaginitis specifically. It might be that, after an intensive training program, accuracy could be improved. However, the lack of accurate diagnosis of vulvovaginal complaints in the office argues against spending a great deal of time training nurses to diagnose over the phone. Focus needs to be on educating providers in the expanded role of culture, pH, and microscopic skills. Research efforts should focus on the development of accurate diagnostic modalities that are efficient, cost-effective, and relatively inexpensive.
| Footnotes |
|---|
We thank James McGregor, MD, for his assistance in this study.
Received May 30, 2001. Received in revised form September 4, 2001. Accepted September 17, 2001.
| REFERENCES |
|---|
|
|
|---|
2. Feldman-Naim S, Myers FS, Clark CH, Turner EH, Leibenluft E. Agreement between face-to-face and telephone-administered mood ratings in patients with rapid cycling bipolar disorder. Psych Res 1997;71:12932.
3. Poole SR, Schmitt BD, Carruth T, Peterson-Smith A, Slusarski M. After-hours telephone coverage: The application of an area-wide telephone triage and advice system for pediatric practices. Pediatrics 1993;92:6709.
4. Sramek M, Post W, Koster RW. Telephone triage of cardiac emergency calls by dispatchers: A prospective study of 1,386 emergency calls. Br Heart J 1994;71:4405.
5. Fleiss JL. Statistical methodology for rates and proportions. 2nd ed. New York: John Wiley and Sons, 1981.
6. Donovan RJ, Holman CD, Corti B, Jalleh G. Face-to-face household interviews versus telephone interviews for health surveys. Aust N Z J Public Health 1997;21:13140.
7. Revicki DA, Tohen M, Gyulai L, Thompson C, Pike S, Davis-Vogel A, et al. Telephone versus in-person clinical and health assessment interviews in patients with bipolar disorder. Harv Rev Psych 1997;5:7581.
8. Rohde P, Lewinsohn PM, Seeley JR. Comparability of telephone and face-to-face interviews in assessing axis I and II disorders. Am J Psych 1997;154:15938.
9. Iglesias EA, Alderman E, Fox AS. Use of wet smears to screen for sexually transmitted diseases. Infect Med 2000;17:17585.
This article has been cited by other articles:
![]() |
A. Cohrssen, M. Anderson, A. Merrill, and D. McKee Reliability of the Whiff Test in Clinical Practice J Am Board Fam Med, November 1, 2005; 18(6): 561 - 562. [Full Text] [PDF] |
||||
![]() |
J. Xu, K. Schwartz, J. Monsur, J. Northrup, and A. V. Neale Patient-clinician agreement on signs and symptoms of 'strep throat': a MetroNet study Fam. Pract., December 1, 2004; 21(6): 599 - 604. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. J. Ledger and G. R. G. Monif A Growing Concern: Inability to Diagnose Vulvovaginal Infections Correctly Obstet. Gynecol., April 1, 2004; 103(4): 782 - 784. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Anderson, K. Klink, and A. Cohrssen Evaluation of Vaginal Complaints JAMA, March 17, 2004; 291(11): 1368 - 1379. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. William Soller, G. M. Peterson, D. G. Ferris, M. S. Litaker, D. Soper, and J. D. Sobel Over-the-Counter Antifungal Drug Misuse Associated With Patient-Diagnosed Vulvovaginal Candidiasis Obstet. Gynecol., August 1, 2002; 100(2): 380 - 382. [Full Text] [PDF] |
||||
![]() |
Vulvovaginal Complaints: Inaccurate Diagnoses over the Telephone and in the Office Journal Watch (General), February 5, 2002; 2002(205): 6 - 6. [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |