Published on 03.09.14 in Vol 16, No 9 (2014): September
The Management of Acute Adverse Effects of Breast Cancer Treatment in General Practice: A Video-Vignette Study
Background: There has been a focus recently on the use of the Internet and email to deliver education interventions to general practitioners (GPs). The treatment of breast cancer may include surgery, radiotherapy, chemotherapy, and/or hormone treatment. These treatments may have acute adverse effects. GPs need more information on the diagnosis and management of specific adverse effects encountered immediately after cancer treatment.
Objective: The goal was to evaluate an Internet-based educational program developed for GPs to advise patients with acute adverse effects following breast cancer treatment.
Methods: During phase 1, participants viewed 6 video vignettes of actor-patients reporting 1 of 6 acute symptoms following surgery and chemotherapy and/or radiotherapy treatment. GPs indicated their diagnosis and proposed management through an online survey program. They received feedback about each scenario in the form of a specialist clinic letter, as if the patient had been seen at a specialist clinic after they had attended the GP. This letter incorporated extracts from local guidelines on the management of the symptoms presented. This feedback was sent to the GPs electronically on the same survey platform. In phase 2, all GPs were invited to manage similar cases as phase 1. Their proposed management was compared to the guidelines. McNemar test was used to compare data from phases 1 and 2, and logistic regression was used to explore the GP characteristics that were associated with inappropriate case management.
Results: A total of 50 GPs participated. Participants were younger and more likely to be female than other GPs in Australia. For 5 of 6 vignettes in phase 1, management was consistent with expert opinion in the minority of cases (6%-46%). Participant demographic characteristics had a variable effect on different management decisions in phase 1. The variables modeled explained 15%-28% of the differences observed. Diagnosis and management improved significantly in phase 2, especially for diarrhea, neutropenia, and seroma sample cases. The proportion of incorrect management responses was reduced to a minimum (25.3%-49.3%) in phase 2.
Conclusions: There was evidence that providing feedback by experts on specific cases had an impact on GPs’ knowledge about how to appropriately manage acute treatment adverse effects. This educational intervention could be targeted to support the implementation of shared care during cancer treatment.
J Med Internet Res 2014;16(9):e204)
Breast cancer was the most common cancer in Australian women in 2009 (excluding nonmelanoma skin cancer) . In Australia, 1 in 11 women will develop breast cancer in their lifetime [ ]; 89% of women with breast cancer survive more than 5 years and die of unrelated causes [ ]. The treatment of breast cancer may include surgery, radiotherapy, chemotherapy, and/or hormone treatment [ ]. Treatment depends on prognosis, stage of disease, treatment options, and adverse effects, as well as the patient and her partner’s preferences [ ].
Following adjuvant treatment, women may experience bowel disturbance, neutropenia, radiation dermatitis, and fatigue [- ]. Posttreatment, brief follow-up is provided in the tertiary settings in some instances. Patients are also encouraged to see their general practitioner (GP) about any new or ongoing problems [ ]. Previous studies have demonstrated that women consult a GP routinely in the months and years after treatment of breast cancer [ ]. Physical adverse effects are a significant feature during breast cancer treatment [ ]. Breast cancer patients are more likely to contact their GP for gastrointestinal symptoms than for other symptoms [ ]. However, there is no evidence that these patients are advised correctly by GPs, and patients experience substantial unmet need for reassurance and advice [ ]. There is also strong interest in the specialist sector to improve the support received by patients who have been treated for cancer [ ]. To address the needs of patients treated for breast cancer, the GP needs to know how to effectively treat the adverse effects of therapy and understand the indications for urgent referral for specialist care. There is some evidence that GPs need more information on the diagnosis and management of specific adverse effects encountered immediately after cancer treatment [ ].
There has been a recent focus on the use of the Internet and email to deliver education interventions to GPs. The use of video vignettes to explore medical decision making and to test other innovations is promising . Preliminary evidence using video vignettes suggests that some innovations are not effective [ ]. The value of letters from specialists about patients currently under the care of a GP is known to have an educational value; therefore, the study reported here incorporates this style of feedback education as an intervention delivered via the Internet in conjunction with video vignettes [ ].
Following approval from the Curtin Human Research Ethics Committee, Perth, Western Australia (RD-68-12), participants were recruited from a previously established network of 150 GPs across Australia . GPs were emailed invitations and nonresponders were followed up with personal invitations. Participants were remunerated with AUD $50 for their contribution.
A total of 12 video vignettes were developed, 1 pair for each potential adverse effect related to treatment of breast cancer (seefor exemplars). Each vignette depicted a patient with clear indications for specific management, including referral, prescription, reassurance, and/or investigation [ ]. The vignettes were developed by 3 GPs, a radiation oncologist, a medical oncologist, and a surgeon with reference to what they considered the most common complication immediately after treatment. The expert panel referenced best practice guidelines in the development of management options for each case with suggestions for prescription, referral for specialist treatment, and laboratory investigation. Each case had more than 1 correct management option (see ).
The vignettes were then prepared as a short video monolog by an actor-patient (see). The video included an off-camera commentary by an actor-doctor describing relevant signs to be found on clinical examination. Each of the 6 pairs was then randomly assigned to phase 1 or phase 2 of the study. Participation in the study was via the Internet. Participants were asked four questions after watching each video vignette:
- What is your diagnosis?
- Would you prescribe something? If so, what?
- Would you refer the patient? If so, to whom?
- Would you order tests? If so, which tests?
The responses were recorded via the Internet platform used to administer the survey. After responding to the first 6 of 12 videos, participants were provided written feedback in the style of a letter from a specialist clinic, highlighting the recommended guidelines for managing the adverse effect in each case.
The project was completed in two phases. In phase 1, participants were invited to view the first set of 6 videos and describe their management of the standardized patient depicted. All participants received expert feedback on the management of the cases viewed within 2 weeks of the project coordinator receiving their proposed management plan. The feedback was in the form of a letter written as if the patient had attended a specialist clinic immediately after consulting the GP. The letters did not refer to the GPs proposed plan for the patient, but stated “For Marion Jones [Consultation 1a], I would recommend the following...”. The letter also outlined the protocol for the general management of her symptoms if they were mild, moderate, or severe. In most cases, there was more than 1 action that the GP could have taken to manage the case as per specialist guidelines. The letters were sent via the Internet using the same Qualtrics survey platform. Once the study coordinator was alerted by the system that the participant had opened the letter for each case, they were sent a link to phase 2. In phase 2, all participating GPs were invited to view the second set of 6 videos and to describe their management of the standardized patient depicted. The phase 2 vignettes matched those in phase 1 by diagnosis (see).
We hypothesized that the proportion of those who managed cases as per the expert recommendations would be greater after feedback (60% vs 30%). Therefore, a sample of 42 participants per group was deemed sufficient in this exploratory study .
The McNemar test was used to determine phase differences in the proportion of cases diagnosed and managed correctly. The phase 1 data offered the opportunity to investigate the GP characteristics that were associated with an incorrect response. GPs’ characteristics associated with inappropriate case management were explored by using logistic regression models using phase 1 data. This helped to identify which groups of practitioners might best be targeted for the intervention and may be different for each of the case types. A full regression model included the following variables: age, sex, country of graduation, years after graduation, years of GP experience, status as established GP or GP registrar (trainee general practitioner), recognized speciality qualification with the Royal Australian College of General Practitioners (Fellow of the Royal Australian College of General Practitioners, FRACGP), the remoteness of their primary practice, the number of GPs at their primary practice, status as a principal (practice owner) within their primary practice, number of patients seen per week, total patient care hours per week, and whether they conducted consultations in languages other than English. Regression models were constructed using both backwards elimination and forward selection. Univariate modeling was performed before the stepwise regressions, and the results were used to guide the reduction of the full models. Variables with a P value less than .05 were retained in the final model and reported. Stata version 12.1 (StataCorp LP, College Station, TX, USA) was used to perform the analysis. Logistic regression models were adjusted for the lack of independence between individual participants by estimating the clustered standard errors to account for intragroup correlation (vce option in Stata). No special technique was used to handle the missing values because there are very few missing values in this study. For participants’ demographics, only the variable “sessions per week” had 2 missing values (4% of total), and there was no missing value for the outcome variables.
A total of 50 GPs consented to participate and completed the study. GPs self-reported their demographic characteristics (see). Those who participated in the study were younger than Australian GPs generally (mean age 43.4 years vs 50.5 years) and a greater proportion were female (52% vs 39.1%), registrars (18% vs 3.8%), and Australian graduates (76% vs 65.9%) [ - ]. Most participants (62%-100%) correctly diagnosed cases in this study, especially in phase 2 (see ). However, there were significant differences in the management of cases between the two phases and between cases (see ).
Regression analysis was carried out to determine the variables associated with management of adverse effects that were not consistent with expert opinion in phase 1. GPs failed to manage the cases as recommended by experts with reference to 2 explanatory variables:
- GP demographics
- Individual vignettes
In phase 1, as shown in, Australian graduates were statistically less likely to offer an inappropriate referral. Male GPs and participants who identified themselves as neither practice owner nor employee (most likely locum practitioners) were less likely to provide an inappropriate prescription. GPs who worked more sessions per week were more likely to offer an inappropriate prescription. Older GPs were less likely to order a unnecessary test. In contrast, those who consulted for more than 20 hours per week were more likely to order an unnecessary test. Compared to managing constipation or diarrhea, participants were less likely to make an inappropriate referral. Patients with radiation dermatitis, postchemotherapy infection, or vomiting were more likely to be given an inappropriate prescription and test.
These variables explained 15%-28% of the differences observed (Pseudo R2=15%, 28%, and 15% for inappropriate referral, prescription, and test order, respectively) (see). Results in are odds ratios and 95% confidence intervals derived from 3 logistic regression models adjusted for clustering of GPs. Only variables with P values <.05 were included in the final model and reported in .
Overall, all three aspects of management had improved significantly in phase 2 as shown in.
These data indicate that although most participants correctly diagnosed the conditions presented throughout the study, limited numbers knew how to manage the acute adverse effects of breast cancer treatment. Australian graduates performed better, but those who worked longer hours were more likely to make questionable decisions in this study. The latter may reflect research that longer hours have a negative impact on job performance . This study did not test performance with real patients or in conditions of varying levels of fatigue; therefore, the comments remain speculative. We also note that practitioners who worked longer hours were more likely to order unnecessary tests. It is possible that this group is more comfortable with trying to manage cases on their own rather than refer back to an oncologist. However, we were unable to explore this hypothesis with the data collected.
The management of radiation dermatitis, postchemotherapy infection, and vomiting proved the most challenging. For almost every case, the management improved following feedback. These differences were marked for seroma, postchemotherapy infection, and diarrhea. This is an important observation which suggests that, if this study had been conducted with real patients, there was scope for significant harm because of diagnostic or management failures. Participants were more likely to diagnose and refer a seroma after feedback. Such differences in the management of acute adverse effects by GPs have not been reported previously because most patients are likely to consult their specialist within days or weeks of treatment rather than a GP .
Some adverse effects, such as persistent vomiting after chemotherapy, are likely to be emergencies; others, such as seromas, are distressing to patients, but unlikely to be life threatening. Some adverse effects, such as a postchemotherapy infection, can cause significant harm if they go unrecognized . It has been suggested that GPs should play a much more active part during the treatment phase of the patient’s cancer journey [ ]. If this is to be the case, then GPs need to be trained to manage the common acute effects of cancer treatment and at the very least these conditions need to feature in the differential diagnosis of patients presenting with symptoms soon after treatment of breast cancer [ , ].
Differences in the proposed management between the participants and the expert panel were less marked in phase 2 (after feedback). Such improvements, if they were noted in actual clinical practice, would lead to a reduction in adverse incidents, and better outcomes and satisfaction for patients. For example, as shown in, in phase 1 only 6% of participants prescribed the appropriate treatment of radiation dermatitis, whereas in phase 2 this proportion increased to 38%. In the case of the possible neutropenia, a significant proportion would arrange appropriate investigations in phase 2. This increases the potential for shared care between health sectors and makes it more likely treatment would be offered sooner rather than later. This is especially the case where patients may suffer avoidable harm if the practitioner in the community is able to recognize the need for urgent specialist advice for someone receiving lifesaving treatment. There were still significant numbers of participants whose proposed management of the vignettes was not consistent with expert opinion. In this study, it was not clear whether this was because participants disagreed with the suggested treatment plans or failed to assimilate the feedback into the phase 2 responses. Although there was a marked improvement in the management of cases, it would be unsafe to assume this was entirely related to the feedback received after phase 1. In the case of chemotherapy-induced vomiting in phase 2, although the participants were more likely to prescribe an antiemetic, they were less likely to refer back to the oncologist or to order the relevant tests after feedback. This was unexpected. It is possible that the scenario presented was considered “mild” because the patient was reported to have vomited only 4 times a day, in which case it may have been deemed unnecessary to refer to the oncologist or arrange laboratory tests to check the renal function. A future study involving this scenario would need to make it clearer that the patient was in need of specialist advice. Therefore, more severe symptoms would need to be presented in the vignette.
A recent literature review reported that two other factors are also likely to be important in the context of a cancer diagnosis: attitudes and beliefs . These issues were not evaluated in this study. For example, we were unable to report the participants’ attitudes toward the management of patients with acute adverse effects and whether they felt this role extended to investigating and treating acute conditions that may have resulted from specialist treatment [ ]. A diversity of opinions in regards to this issue have been described among Australian GPs in previous reviews [ ]. Nor could we confirm that all participants had easy access to the relevant specialists and/or would have had the option to refer a patient urgently with a condition they had not previously encountered to such an expert. The available evidence suggests that this is not a safe assumption and that management plans would be impacted by the clinicians’ experience in their local context [ ].
This pilot study had a modest sample size, which was estimated based on the hypothesis that the participants would be twice as likely to manage patients as per expert opinion following feedback on a similar previous case. This was not true of all management modalities. In some cases, any significant improvement in phase 2, as shown in, was much more modest. Therefore, a much larger study would be required to robustly demonstrate that this mode of education is likely to increase GPs’ knowledge. Because no other educational intervention was offered in a randomized experimental design, the conclusions that can be drawn from these data are also limited.
This study with vignette-based feedback showed promising results that managing the common adverse effects of cancer treatment could be delegated to general practice. Such an intervention could support the application of shared care models of care. A larger study, including management of adverse effects in real patients, needs to be conducted before it can be safely recommended. However, noting that some patients with potentially life-threatening adverse effects may not be managed appropriately suggests a need for safeguards to protect patients in a study with bona fide patients.
This study was funded by a grant from the Royal Australian College of General Practitioners. We would like to thank the experts who assisted in developing the cases and advising on appropriate management.
Conflicts of Interest
Multimedia Appendix 1
Example of video vignette.MOV File, 78MB
- Australian Institute of Health &Welfare Australasian Association of Cancer Registries. Cancer in Australia: an overview, 2012. Canberra: AIHW & AACR; 2012 Jan 01. URL: http://www.aihw.gov.au/cancer/cancer-in-australia-overview-2012/ [accessed 2014-08-28] [WebCite Cache]
- Parkin DM. Global cancer statistics in the year 2000. Lancet Oncol 2001 Sep;2(9):533-543. [CrossRef] [Medline]
- Australian Institute of Health and Welfare & Cancer Australia. Breast cancer in Australia: an overview. Canberra: AIHW; 2012 Jan 01. URL: http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=10737423006 [accessed 2014-08-28] [WebCite Cache]
- Goldhirsch A, Glick JH, Gelber RD, Coates AS, Thürlimann B, Senn HJ, Panel members. Meeting highlights: international expert consensus on the primary therapy of early breast cancer 2005. Ann Oncol 2005 Oct;16(10):1569-1583 [FREE Full text] [CrossRef] [Medline]
- Duric V, Stockler M. Patients' preferences for adjuvant chemotherapy in early breast cancer: a review of what makes it worthwhile. Lancet Oncol 2001 Nov;2(11):691-697. [CrossRef] [Medline]
- Wood AJ, Shapiro CL, Recht A. Side effects of adjuvant treatment of breast cancer. Side effects of adjuvant treatment of breast cancer. N Engl J Med 2008:1997-2008. [CrossRef]
- Srivastava V, Basu S, Shukla VK. Seroma formation after breast cancer surgery: what we have learned in the last two decades. J Breast Cancer 2012 Dec;15(4):373-380 [FREE Full text] [CrossRef] [Medline]
- Raupach JC, Hiller JE. Information and support for women following the primary treatment of breast cancer. Health Expect 2002 Dec;5(4):289-301. [Medline]
- Collins RF, Bekker HL, Dodwell DJ. Follow-up care of patients treated for breast cancer: a structured review. Cancer Treat Rev 2004 Feb;30(1):19-35. [CrossRef] [Medline]
- Carelle N, Piotto E, Bellanger A, Germanaud J, Thuillier A, Khayat D. Changing patient perceptions of the side effects of cancer chemotherapy. Cancer 2002 Jul 1;95(1):155-163 [FREE Full text] [CrossRef] [Medline]
- van den Beuken-van Everdingen MH, de Rijke JM, Kessels AG, Schouten HC, van Kleef M, Patijn J. Quality of life and non-pain symptoms in patients with cancer. J Pain Symptom Manage 2009 Aug;38(2):216-233. [CrossRef] [Medline]
- Rozmovits L, Ziebland S. What do patients with prostate or breast cancer want from an Internet site? A qualitative study of information needs. Patient Educ Couns 2004 Apr;53(1):57-64. [CrossRef] [Medline]
- Jefford M, Rowland J, Grunfeld E, Richards M, Maher J, Glaser A. Implementing improved post-treatment care for cancer survivors in England, with reflections from Australia, Canada and the USA. Br J Cancer 2013 Jan 15;108(1):14-20 [FREE Full text] [CrossRef] [Medline]
- Jiwa M, Meng X. Video consultation use by Australian general practitioners: video vignette study. J Med Internet Res 2013;15(6):e117 [FREE Full text] [CrossRef] [Medline]
- Jiwa M, Halkett G, Meng X, Pillai V, Berg M, Shaw T. Supporting patients treated for prostate cancer: a video vignette study with an email-based educational program in general practice. J Med Internet Res 2014;16(2):e63 [FREE Full text] [CrossRef] [Medline]
- Westerman RF, Hull FM, Bezemer PD, Gort G. A study of communication between general practitioners and specialists. Br J Gen Pract 1990 Nov;40(340):445-449 [FREE Full text] [Medline]
- Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health 2008 Apr;31(2):180-191. [CrossRef] [Medline]
- Australian Institute of Health and Welfare. www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=60129546076. Canberra: AIHW; 2014. Medical Workforce 2010 URL: http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=60129546076 [accessed 2014-08-28] [WebCite Cache]
- General Practice Registrars Australia Ltd. Annual report, 2011-12. URL: http://issuu.com/gprapublications/docs/annual_report_2012_web_resolution_2/1?e=2280775/1564037 [accessed 2014-08-28] [WebCite Cache]
- Britt H, Miller GC, Charles J, Henderson J, Bayram C, Pan Y. General practice activity in Australia 2008-09. Canberra: AIHW; 2009. URL: http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=6442456272 [accessed 2014-08-28] [WebCite Cache]
- Lockley SW, Barger LK, Ayas NT, Rothschild JM, Czeisler CA, Landrigan CP, Harvard Work Hours‚ HealthSafety Group. Effects of health care provider work hours and sleep deprivation on safety and performance. Jt Comm J Qual Patient Saf 2007 Nov;33(11 Suppl):7-18. [Medline]
- Anvik T, Holtedahl KA, Mikalsen H. "When patients have cancer, they stop seeing me"--the role of the general practitioner in early follow-up of patients with cancer--a qualitative study. BMC Fam Pract 2006;7:19 [FREE Full text] [CrossRef] [Medline]
- Crawford J, Dale DC, Lyman GH. Chemotherapy-induced neutropenia: risks, consequences, and new directions for its management. Cancer 2004 Jan 15;100(2):228-237 [FREE Full text] [CrossRef] [Medline]
- Jiwa M, McManus A, Dadich A. The impact of knowledge, attitudes and beliefs on the engagement of primary and community-based healthcare professionals in cancer care: a literature review. Curr Med Res Opin 2013 Nov;29(11):1475-1482. [CrossRef] [Medline]
- Jiwa M, McManus A, Dadich A. Craft based: Continuity of cancer care: Where do primary care practitioners fit in? Cancer Forum 2013 Mar;37(1):31-34.
- Johnson CE, Lizama N, Garg N, Ghosh M, Emery J, Saunders C. Australian general practitioners' preferences for managing the care of people diagnosed with cancer. Asia Pac J Clin Oncol 2014 Jun;10(2):e90-e98. [CrossRef] [Medline]
|ED: emergency department|
|GP: general practitioner|
|BM: bowel movement|
Edited by G Eysenbach; submitted 05.06.14; peer-reviewed by S Cutrona; comments to author 30.06.14; revised version received 10.07.14; accepted 13.08.14; published 03.09.14
©Moyez Jiwa, Anne Long, Tim Shaw, Georgina Pagey, Georgia Halkett, Vinita Pillai, Xingqiong Meng. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 03.09.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.