Background: Traditionally, patients wishing to obtain their prescription medications have had to physically go to pharmacy counters and collect their medications via face-to-face interactions with pharmacy staff. Prescription in Locker Box (PILBOX) is a new innovation allowing patients and their caregivers to collect medication asynchronously, 24/7 at their convenience, from medication lockers instead of from pharmacy staff.
Objective: This study aimed to determine the willingness of patients and caregivers to use this new innovation and factors that affect their willingness.
Methods: This prospective cross-sectional study was conducted over 2 months at 2 public primary health care centers in Singapore. Patients or caregivers aged 21 years and older who came to pharmacies to collect medications were administered a 3-part questionnaire face-to-face by trained study team members after they gave their consent to participate in the study.
Results: A total of 222 participants completed the study. About 40% (89/222, 40.1%) of participants were willing to use PILBOX to collect their medications. Among participants who were keen to use the PILBOX service, slightly more than half (47/89, 53%) were willing to pay for the PILBOX service. Participants felt that ease of use (3.5 [SD 1.2]) of PILBOX was the most important factor affecting their willingness to use the medication pickup service. This was followed by waiting time (3.4 [SD 1.3]), cost of using the medication pickup service (3.0 [SD 1.4]), and 24/7 accessibility (2.6 [SD 1.4]). This study also found that age (P=.01), language literacy (P<.001), education level (P<.001), working status (P=.01), and personal monthly income (P=.01) were factors affecting the willingness of patients or caregivers to use PILBOX.
Conclusions: Patients and caregivers are keen to use PILBOX to collect their medications for its convenience and the opportunity to save time if it is easy to use and not costly.
Many health care systems in the world require patients to physically go to the dispensary or pharmacy to refill or collect their medications. This practice has been ongoing across the globe for a long time [, ].
Dispensing medications to patients usually encompasses the provision of some basic information about the medication such as the indication, dose, frequency, and duration [, ]. The face-to-face encounter at the dispensary or pharmacy to collect the medications provides an opportunity for patients to be counseled on the use of their medications and have their concerns pertaining to their medications addressed [ ].
This long-standing practice prevails because health care providers and patients instinctively associate the collection of medications by patients as constituting a natural end to their visit to the clinic . A problem may arise if patients are faced with time constraints and cannot afford the extended time waiting for their turn to see the doctor followed by waiting to collect their medications. This problem is especially aggravated for polyclinic patients due to the high volume of patients and resulting long wait times for patients. The inconvenience caused by having to physically collect the prescribed medications and the long wait time the process entails have also contributed to a high medication nonadherence rate worldwide [ ].
If one were to adopt a fresh pair of lenses, a visit to the doctor needs not be irreversibly coupled with the medication collection process. It was this out-of-the-box thinking that inspired the study team to envision the development of an innovation that would decouple the medication collection process from the doctor’s visit and allow the patient a choice of collecting their prescribed medication at a separate convenient occasion after having visited their doctor for consultation.
Telecommunications and technological advances such as the invention of the phone, broadband, internet, and mobile apps are potentially game-changers in these modern times [- ]. They enable alternative medication refill or collection modes to be made available to patients [ ]. An example of such an alternative is the delivery of medications to patients via courier service or mail-order pharmacy to their preferred delivery locations with a few button clicks or a phone call to the dispensary or pharmacy.
However, not all alternative medication refill or collection modes are feasible to implement, and some may not prove attractive to patients or their caregivers [- ]. Some solutions are costly to implement and may require dispensaries or pharmacies to pass on some or all of the implementation and operational costs to users (patients or caregivers) [ ] . Others may generate new problems or inconveniences to users such as requiring users to block off a long stretch of their valuable and limited time to await the delivery [ ]. Improper handling of the delivered medications by the courier personnel may also have an adverse impact on medication safety [ ]. Medication safety may present a significant problem to successful implementation of these alternative medication refill or collection modes, particularly in countries with underdeveloped transport networks and infrastructures [ ]. In such countries, the ability of courier personnel to safeguard the quality of the medications during transit may not be a given, even with their best efforts.
The current health care system in Singapore, like many countries worldwide, requires patients to collect their medications physically at the hospital or clinic dispensaries or retail pharmacies. Singapore’s health care services are provided by both private health care providers and public health care institutions. Although there are established medication delivery services run by private operators, patients may not always be prepared to set aside a few hours to wait for the delivery of their medications as they cope with long work hours and many other competing commitments in fast-paced Singapore, such as running errands and taking children to and from classes.
Thus we have envisioned and developed Prescription in Locker Box (PILBOX) as a new innovation to fill the gap. This new innovation is a first in Singapore. The idea is simple. Rather than requiring users to stay in a given location for a long stretch of time to wait for medications to be delivered to them, why not deposit the medications in a secure location for users to pick up at their convenience? Hence, the PILBOX was conceptualized and developed.
The PILBOX station consists of a few columns of lockers of different sizes with one single attached console that allows users to input a unique access code to retrieve their medication parcels from their allocated locker. The locker station is equipped with a security camera, autolock mechanism, and lock-down system to ensure the medication parcels are safely kept until their collection by their rightful owners. The security camera will deter people with malicious intent from targeting the lockers and the medications contained within. Once a medication parcel has been collected, the locker will be autolocked to ensure the locker is inaccessible to unauthorized personnel. Further, the station lock-down system will prevent power outage situations from triggering the unintended opening of lockers and unauthorized retrieval of medication parcels.
The locker station maintains an ambient temperature (ie, at or below 25 ℃ [77 ℉]) due to 24/7 air conditioning of the room housing the station. To ensure the medications will be stored at the suitable temperature until retrieval by the user, ambient environment temperature is monitored continuously using temperature loggers. This is important to preserve the quality of the medications until collection by users.
Suitable lighting has also been installed in the locker station to facilitate easy retrieval of medications. Further, the PILBOX is equipped with an information technology (IT) system that allows easy tracking of use of the locker system and booking of the lockers for collection of medications by users. It can also generate an audit trail to ensure accountability of each occasion of access to the lockers.
As PILBOX is a new innovation in Singapore, a study was conducted to determine the willingness of patients and caregivers to use the medication pickup service and factors that may affect their use. The information gleaned will allow us to develop appropriate strategies to promote the use of the PILBOX service to patients and increase adoption. The study also aimed to test the following hypotheses:
- Participants who are willing to use PILBOX are willing to pay for the medication pickup service.
- Participants are more willing to use the PILBOX if their wait time at the pharmacy is long.
- Participants are more willing to use PILBOX if they are not satisfied with their wait time at the pharmacy.
- Participants are more willing to use PILBOX if they refill their prescriptions or collect medications from the pharmacy frequently.
- Participants are more willing to use PILBOX if the traveling time to the PILBOX (located within the polyclinic) is less.
The prospective cross-sectional study was conducted from December 2015 to January 2016. Participants were convenience sampled at 2 polyclinics situated in the eastern part of Singapore. Polyclinics are public primary health care centers that provide medical care for acute and chronic conditions and provide services such as pharmacy, vaccinations, and health screenings. Prior to the development of PILBOX, patients who needed to collect their prescribed medications or who had prescriptions to refill were required to physically go to the polyclinics’ respective in-house pharmacies where they would be served by pharmacy staff at counters.
Study Participants and Ethical Approval
The recruited participants were aged 21 years and older. Patients or caregivers visiting the in-house pharmacies at the study sites to fill or refill their prescriptions were invited to participate in the study. Potential participants who could not understand or converse in English or Mandarin were excluded from the study. This study was exempted from ethics review by SingHealth centralized institutional review board (SHP 2015/3035).
Using α=.05, a power of 80%, and an expected correlation coefficient of .30, a calculated sample size of at least 85 participants was required to test the hypotheses on willingness to use PILBOX against their (1) willingness to pay to use the service, (2) wait time at the pharmacy, (3) satisfaction with their wait time at the pharmacy, (4) frequency of prescription refills or medication collections at the pharmacy, and (5) traveling time to the PILBOX.
A structured questionnaire developed by the study team was administered face-to-face by trained study team members in a standardized manner (). Each participant completed the questionnaire once. The questionnaire solicited information on the following:
- Demographics (ie, age, sex, language literacy, education level, working status, housing type, and personal monthly income)
- Relevant factors that might affect participant satisfaction with pharmacy services (ie, estimated traveling time to polyclinic, frequency of prescription refills and medication collections at the pharmacy, average waiting time at the pharmacy, and satisfaction with waiting time at the pharmacy)
- Willingness to use PILBOX and pay for its use
A 5-point Likert scale (1=not keen, 5=very keen) was used to assess willingness of the participants to use PILBOX.
Chi-square or Fisher exact tests were used to determine the factors that might affect the willingness of participants to use PILBOX. Pearson correlation tests were used to determine whether participant willingness to use PILBOX correlated with their (1) willingness to pay to use the service, (2) average waiting times at the pharmacy, (3) satisfaction with their waiting times at the pharmacy, and (4) frequency of prescription refills or medication collections at the pharmacy. All analyses were performed using SPSS (version 25.0, IBM Corp) at the 5% significance level.
A total of 222 participants completed the study, with 109 females, 101 males, and 12 unspecified. Among the participants, about half (109/222, 49.1%) were persons aged 65 years and older. Almost 1 in 10 participants (19/222, 8.6%) had no formal education, and 1 in 5 (46/222, 20.7%) had primary education. Almost half (104/222, 46.9%) were not working ().
|Characteristics||Value, n (%)|
|Age group, years (older adult vs adult)|
|Language literacy (self-reported)|
|No formal education||19 (8.6)|
|Above secondary||67 (30.2)|
|Not working||104 (46.9)|
|Public housing||165 (74.3)|
|Private housing||29 (13.1)|
|Personal monthly income (S$)|
|No income||106 (47.7)|
Relevant Factors That May Affect Participant Satisfaction With Pharmacy Services
Among the participants who collected their medications in installments, about half (65/150, 43.3%) refilled their prescriptions or collected their medications every 3 months. About 30% (41/150, 27.3%) refilled their prescriptions or collected their medications more than 4 times a year. The median traveling time among the participants was 15 to 30 minutes. Slightly more than half (116/222, 52.3%) of the participants were satisfied with the waiting time at the pharmacy to collect or refill their prescriptions. The median time participants spent at the pharmacies waiting to collect or refill their prescriptions was 31 to 45 minutes ().
|Factors||Value, n (%)|
|Estimated traveling time to polyclinic (minutes)|
|Collection of medication in installments?|
|Frequency of prescription refills (for patients who collect in installments)|
|>1 time per month||2 (1.4)|
|Once every month||23 (15.3)|
|Once every 2 months||16 (10.7)|
|Once every 3 months||65 (43.3)|
|Once every 4 months and longer||44 (29.3)|
|Average waiting time at pharmacy (minutes)|
|Satisfaction with waiting time at pharmacy|
|Willingness to use PILBOX|
|Not keen at all||65 (29.3)|
|Not keen||25 (11.2)|
|Very keen||42 (18.9)|
|Willingness to pay to use PILBOXa|
|Willing to pay||73 (32.9)|
|Not willing to pay||123 (55.4)|
|Amount willing to pay to use PILBOX (S$)|
aPILBOX: Prescription in a Locker Box.
Willingness to Use PILBOX and Willingness to Pay for the Service
About 40% (89/222, 40.1%) of participants were willing to use PILBOX to collect their medications. A similar proportion (90/222, 40.5%) were not willing to, with the rest (37/222, 16.7%) not sure if they would be keen to do so. More than half (123/222, 55.4%) of the participants were not willing to pay for the service, and about a third (73/222, 32.9%) were willing to pay to use PILBOX. Among those who were willing to pay, the majority (55/73, 75%) preferred to pay S$2 (US $1.50) or less to use PILBOX. In Singapore, this amount can pay for a single-direction bus trip or the fee for courier delivery of online purchases, including ordering of food. It also equates to roughly 5% of a typical polyclinic patient’s medication bill. Among the participants who were keen to use PILBOX, slightly more than half (47/89, 53%) were willing to pay for PILBOX ().
Participants who were not keen to use the medication pickup service were hesitant because they were worried that they could not understand the directions to use the locker station. Concerns over not being able to read and understand the directions for use as indicated on the locker station because of literacy limitations and poor eyesight were reported by participants. Some participants felt that they would need assistance to guide them on the use of the locker station but were at the same time concerned that they might hold up the queue. This deterred them from using the service. A small percentage (3/222, 1.4%) did not own a cellphone, and 3.6% (8/222) felt they were not tech savvy enough to be able to use the automated collection system. Some participants were concerned that the payment kiosks at the locker station would not be able to support the use of their medical benefit cards.
A common reason cited by participants was that they did not mind waiting at the pharmacy for their medications as they were already accustomed to waiting for their medications. Some participants did not feel safe collecting their medications from the locker station because they were worried they might get the wrong medications or wrong quantities of the medications from the lockers. Some preferred to collect their medications in person at the pharmacy as they appreciated the availability of pharmacy staff to address any medication queries or concerns they might have. They also wanted someone to explain the use of their medications to them in person.
On the other hand, reasons motivating participants to use PILBOX include no waiting time at the pharmacy (which would save time for busy people) and being able to collect their medications at a time convenient to them. The medication pickup service would presumably appeal more to tech savvy individuals, as suggested by one participant in the survey.
Factors Affecting Willingness to Use PILBOX
The participants felt that the ease of use (3.5 [SD 1.2]) of PILBOX was the most important factor affecting their willingness to use the medication pickup service. This was followed by no wait time (3.4 [SD 1.3]), cost of using the medication pickup service (3.0 [SD 1.4]), and 24/7 accessibility (2.6 [SD1.4]). Participants ranked the location of the locker station (2.6 [SD 1.5]) as the least important among 5 factors that might affect their willingness to use the medication pickup service.
This study found that age (P=.01), literacy (P<.001), education level (P<.001), working status (P=.01), and personal monthly income (P=.01) were factors affecting the willingness of the patients or caregivers to use PILBOX. The same list of factors was also found to be associated with their willingness to pay for use of the medication pickup service ().
|Factors||Willingness to use PILBOXa||P value||Willingness to pay to use PILBOX||P value|
|Not willing||Willing||Not willing||Willing|
|Age (years), n||—b||—||.01||—||—||<.001|
|Language literacy (self-reported), n||—||—||<.001||—||—||—|
|Illiterate in any language||14||0||<.001||11||0||.01|
|Literate in at least 1 language||70||86||<.001||109||73||.01|
|Education level, n||—||—||<.001||—||—||<.001|
|No formal education||18||0||—||16||0||—|
|Primary and below||45||10||—||44||12||—|
|Secondary and above||38||74||—||75||61||—|
|Working status, n||—||—||.01||—||—||<.001|
|Housing types, n||—||—||.08||—||—||.17|
|Personal monthly income, n||—||—||.01||—||—||<.001|
|Frequency of medication collection (per year), n||—||—||.79||—||—||.17|
|Traveling Time to Polyclinic (minutes), n||—||—||.40||—||—||.94|
aPILBOX: Prescription in Locker Box.
There was weak positive correlation between participant willingness to use PILBOX and their willingness to pay for use of the medication pickup service (159/222, r=.23, P<.001). Participant willingness to use PILBOX correlated weakly and negatively with waiting time at the pharmacy (180/222, r=–.23, P<.001). There was very weak negative correlation between participant willingness to use PILBOX and their satisfaction level with waiting time at the pharmacy (180/222, r=–.06, P=.47). On the other hand, there was very weak positive correlation between willingness to use PILBOX and frequency of prescription refills or collection of medications at the pharmacy (116/222, r=.05, P=.63) among patients who collected their medications in installments. Participant willingness to use PILBOX correlated weakly and negatively with traveling time to the polyclinics where the medication locker stations were located (168/222, r=–.14, P=.07).
This study found that about 40.0% of patients and caregivers were willing to use PILBOX to collect their medications. This acceptance rate of a service innovation is in line with the natural diffusion of any new products or services into use among a population of users, comprising innovators (2.5%), early adopters (13.5%), early majority (34.0%), late majority (34.0%), and laggards (16.0%) .
Willingness to Use PILBOX
The ease of use of PILBOX was the most important factor affecting the desirability of the new medication collection service to users (patients and caregivers). A possible explanation for this observation was that ease of use could elicit positive emotions associated with the use of PILBOX and lead to service satisfaction . Hence, ease of use of PILBOX would intuitively encourage users to opt for the service [ ]. As mentioned in the Results section, participants who were not keen to use PILBOX were hesitant because they were worried they would not be able to understand the directions of use as indicated on the locker stations [ ], whether because of literacy limitations or poor eyesight. Some participants also provided feedback that they felt they would need assistance to guide them with use of PILBOX while others were put off because they felt they were not tech savvy enough. Further, as seen in , willingness to use PILBOX increased with education (P>.99) and literacy levels (P<.001) and decreased with age (P=.01). The working status of participants also influenced whether participants were willing to use PILBOX (P=.01), with working individuals being more willing to use the service presumably due to their greater exposure to and hence greater confidence in interacting with innovative products and services [ ]. Participants living in private housing (versus public housing) and presumably deemed more affluent were also more willing to use PILBOX (P=.08), again likely due to their greater exposure to and confidence in interacting with innovative products and services [ ]. From the survey results, if greater ease of use such as by providing clear and understandable instructions [ ] is designed into PILBOX, there is a higher chance that it will be embraced by more users.
The second most important factor affecting user choice was the zero waiting time advantage offered by the PILBOX option. Previous studies have shown that patient satisfaction levels would reduce with increase in waiting time [, ]. We would intuitively expect that decreased satisfaction levels on the part of patients would then motivate them to use PILBOX, which could potentially offer them the advantage of zero waiting time, since they could choose when to collect their medications.
Surprisingly, our data showed that user willingness to use PILBOX correlated weakly and negatively with waiting time at the pharmacy (180/222, r=–.23, P<.001), which was not what we would intuitively expect. This could be due to users having become accustomed to longer waiting times at the polyclinics and having realistic expectations given that they were receiving subsidized medical care. In view of these data, it was uncertain whether the zero waiting time advantage would be a factor to induce users to use the PILBOX service. However, in view that many studies have shown negative association between increased waiting time and patient satisfaction [, ], no wait time could still be a value proposition for the use of PILBOX.
On the other hand, our results showed that patient willingness to use PILBOX correlated negatively and very weakly with patient satisfaction levels over waiting time at the pharmacies (180/222, r=–.06, P=.47). This was to be expected, given that a patient who was already satisfied with the pharmacy waiting times would be less motivated to use an alternative mode of medication collection (ie, PILBOX) .
The third most important factor affecting patient choice was the cost of using the medication pickup service. Due to price elasticity of demand , it was intuitive to expect that the need to pay for use of PILBOX would deter users from opting to use this innovative service [ ]. This was borne out by our data. From , users who were working or had income were more willing to use and pay for the PILBOX service (159/222, r=.23, P<.001).
The fourth most important factor affecting patient choice was the 24/7 convenience for collection of medications offered to patients by the PILBOX service. This service would be expected to appeal to users as it would allow them to collect their medications at a time convenient to them. Our data showed that there was positive correlation between willingness to use PILBOX and frequency of prescription refills or collection of medications (ie, patients who had to endure more trips to collect their medications would be more willing to explore use of PILBOX to derive greater convenience [116/222, r=.05, P=.63]).
The least important factor affecting patient choice was the location of PILBOX. Previous studies reported mixed findings on the impact of the traveling distance to a pharmacy or dispensary on medication adherence [, ]. Some studies reported some association between traveling distance with motivation of patients to collect and adhere to administration/dosing of their medications, whereas other studies reported minimal association [ , ]. Our result showed that willingness to use PILBOX correlated negatively and weakly with the traveling time of users for collection of medications (168/222, r=–.14, P=.07). This was consistent with previous studies in that the relation between traveling distance and willingness to invest effort to collect prescribed medications was not strong. The weak negative correlation between traveling distance and willingness to use PILBOX can be attributed to PILBOX being located at the polyclinics. Hence, while it provided greater convenience over the medication collection time, patients would still need to travel to the polyclinics to collect their medications. Given the results, there are opportunities to evolve additional options for collection of medications from locations other than polyclinics themselves. This may entail collaboration with suitable partners operating within community hubs located near the residences of patients.
Remodeling the Medication Collection Process
The rapid development of Singapore into a smart nation and advances in IT capabilities disrupting many industries (eg, transport, food and beverage, and retail industries) have also changed the way health care providers interact with patients and their caregivers .
Specifically, in the area of supply of prescribed medications to patients, the conventional norm was to supply prescribed medications to patients face-to-face at pharmacy counters. In the high-patient volume environment in polyclinics , pharmacy staff face many challenges in providing excellent service to patients (ie, high patient volumes and prescription loads and long prescriptions with many items due to an aging population) [ - ], high expectations of a more educated patient population, and the need to fulfill patient waiting time targets [ ].
Due to the high patient volume and limited space at polyclinics, one problem faced by pharmacy staff was congestion in the pharmacy waiting areas, particularly during peak hours . Instead of instinctive solutions such as increasing staff numbers, which would push up costs and reduce productivity, or pressurizing staff into rushing through the dispensing process, which could compromise medication safety [ ], pharmacy staff tried to think outside of the box in coming up with a solution. Breaking from the paradigm that all patients with prescribed medications had to be served within the polyclinic operating hours, pharmacy staff started to think of how some patients could be served asynchronously outside of polyclinic operating hours [ ] (eg, having the medications delivered to them or being given an option to collect their medications after their polyclinic visits). From the latter idea, the staff evolved the idea of a medication pick-up service that was gradually developed and eventually fleshed out into the first-generation PILBOX.
One concern was whether this concept of medication pickup would be embraced by the patient population at large. Hence, we undertook this research study to determine the willingness by patients and caregivers to use this new innovation and find out what factors would affect their willingness to use the innovative service. The research findings provided key insights to develop the first generation PILBOX and would guide the pharmacy team to further streamline the PILBOX innovation to better meet the needs of the users so as to increase uptake of the service and enhance pharmacy overall medication supply service to patients.
Translating Research Findings Into Practice
From the study, the ease of use of PILBOX was a top concern of patients and their caregivers. Hence, when developing the first generation PILBOX service, considerable efforts were devoted to design ease of use into the innovation and assist users with service ambassadors and educational materials . Pictogram decals were pasted on the locker station to provide easy reference to users on use of PILBOX. Educational materials were written at primary 6 level and below and care was taken to ensure that the message content, typography, and visuals of educational materials were designed to promote ease of use [ , ].
To further enhance PILBOX and improve uptake of the innovative service, user inputs will continue to be solicited, either via surveys or focus group discussions . Efforts to educate users on this medication pickup service will continue to be undertaken so that they can confidently use the service [ ].
Another finding from the study was that users were more likely to use PILBOX if they did not have to travel too far. Hence, besides giving patients the option of collecting their prescribed medications from PILBOX located within polyclinics, it may be worthwhile for the polyclinics to explore working with suitable partners operating within community hubs located near the residences of patients to make available to users the option of collecting their prescribed medications from locations nearer their homes [, ].
Future Generations of PILBOX
PILBOX is a new innovation in Singapore that provides a solution to enable patients to pick up their medications at their convenience 24/7. This reduces the need for patients to wait at home to receive their medications via medication delivery service. The waiting time can then be diverted to better uses, translating into better value and experience for the patient. Further, this alternative mode of medication supply enables more efficient use of limited health care resources that every country faces, including Singapore. This modality of supplying medications can still be considered innovative, as the predominant mode of supplying medications to patients is still face-to-face.
Although automated locker stations may be common nowadays, they may not be suitable for medications requiring special considerations (eg, storage, security and compliance with legal requirements). The unique design of PILBOX enables maintenance of ambient temperature at 25 ℃ (77 ℉) and below. This is imperative as medications are required to be stored within the manufacturer’s recommended storage temperatures to maintain their safety and integrity. Further, PILBOX’s autolock mechanism and lock-down system keep the medication parcel safe and ensure public health safety by preventing unauthorized access without 24/7 human supervision or intervention.
Although the current PILBOX model was well received by patients and their caregivers, future models could include self-cooling features so the locker stations need not be placed only in enclosed locations with 24/7 air conditioning to maintain the required ambient temperatures. The future PILBOX could also have self-refrigerating system to provide appropriate storage condition for cold-chain items such as insulins. This would allow the PILBOX option to be extended to patients prescribed thermolabile medications.
Currently, only pharmacy users are able to book the lockers in PILBOX for use via a designated online portal. Future PILBOX models and IT enablers could provide patients or their caregivers and pharmacy operators with even greater convenience by allowing submission of prescription orders via a mobile app, translation of prescription orders into the pharmacy’s system, picking and packing of medications by robots, and automatic placement of picked/packed medications into medication locker stations for collection by the users. The same mobile app could also provide medication use instructions and advice for reference by users [, ].
Limitations of Study
Currently, patients or caregivers can visit private dispensaries or pharmacies and hospital pharmacies in addition to polyclinic pharmacies to fill or refill their prescriptions. A limitation of this study is it was confined to patients and caregivers who visited polyclinics to refill their prescriptions or collect their medications. The results would have been more representative of the population if patients or caregivers who visited private dispensaries or pharmacies and hospital pharmacies had been included in the study. However, this limitation is not of great concern as the proportion of patients who visited polyclinics is significant and it would be reasonable and feasible to extrapolate the findings to the entire local population. Another limitation of this study is that only a pictorial PILBOX prototype was shown to participants during the study. The artist impression and features of PILBOX and the medication collection process involving the PILBOX might have been interpreted or imagined differently by different individuals, thereby potentially creating a visual bias.
With more people becoming digitally savvy and better technology providing an even more seamless experience for the user, we would expect a higher adoption rate for the use of PILBOX. Further, with people now spending more time at work or having other competing priorities such as caring for family, the convenience provided by PILBOX may also entice more to use this service and even to pay to use it. However, we are mindful that there will always be a segment of the population who will not be comfortable with this new modality of supply as they may not be digitally savvy or may just be simply averse to use of technology. They tend to be older patients who incidentally are more significant because they tend to have more medical conditions and consume more medications. Hence, while this technology is innovative and bring benefits to patients, it may require a period of time running into years for widespread subscription to its use. This study has provided a baseline that future studies could use and compare with to determine the change in user expectations and their willingness to adopt more advanced technology or services.
A significant proportion of patients and caregivers are keen to use PILBOX as an alternative mode to collect their medications. Addressing patient concerns such as ease of use and language literacy barriers with regard to PILBOX use will help to increase their adoption of this new service.
We would to thank Ms Huang Yufang, Mrs Lo Fei Ling, Mr Fang Qinan, and Mr Liaw Zi Yang for their contributions to this study. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. Parts of this study were presented in abstract form and as poster presentations at the Healthcare Information and Management Systems Society–Elsevier Digital Healthcare Conference on Aug 24, 2016, the 10th SingHealth Allied Health Innovation Practice Conference on Feb 24, 2017, and the National Health IT Excellence Awards on May 30, 2017.
CLJF and GBK conceptualized and designed the research study. VCWL implemented the study and collected the data. BGQ analyzed the data. CLJF, BGQ, and TWP wrote the first draft of the manuscript. The whole team collectively reviewed and refined the manuscript.
Conflicts of Interest
Questionnaire.DOCX File , 16 KB
- Brar Prayaga R, Agrawal R, Nguyen B, Jeong EW, Noble HK, Paster A, et al. Impact of social determinants of health and demographics on refill requests by Medicare patients using a conversational artificial intelligence text messaging solution: cross-sectional study. JMIR Mhealth Uhealth 2019 Nov 18;7(11):e15771 [FREE Full text] [CrossRef] [Medline]
- Schmittdiel JA, Karter AJ, Dyer W, Parker M, Uratsu C, Chan J, et al. The comparative effectiveness of mail order pharmacy use vs. local pharmacy use on LDL-C control in new statin users. J Gen Intern Med 2011 Dec;26(12):1396-1402 [FREE Full text] [CrossRef] [Medline]
- Paulino E, Thomas D, Lee S, Cooper J. Dispensing process, medication reconciliation, patient counseling, and medication adherence. In: Thomas D, editor. Clinical Pharmacy Education, Practice and Research: Clinical Pharmacy, Drug Information, Pharmacovigilance, Pharmacoeconomics and Clinical Research. Philadelphia: Elsevier; 2019:109-120.
- Embry M. Ensuring good dispensing practices. In: Ryan M, editor. MDS-3: Managing Access to Medicines and Health Technologies. Arlington: Management Sciences for Health; 2012:579-595.
- Liu LST, Goh BQ, Tang WP, Lo FL, Khoo RSY, Lim CJF. Drug information needs and concerns of primary care patients with newly prescribed chronic medications. Proc Singapore Healthc 2018 Jun 13;27(4):294-298. [CrossRef]
- Niska R, Ahmad F, Xu J. National Hospital Ambulatory Medical Care Survey: emergency department summary. Natl Health Stat Rep 2010:1-31. [CrossRef]
- Brown MT, Bussell JK. Medication adherence: WHO cares? Mayo Clin Proc 2011 Apr;86(4):304-314 [FREE Full text] [CrossRef] [Medline]
- Ruiz Morilla MD, Sans M, Casasa A, Giménez N. Implementing technology in healthcare: insights from physicians. BMC Med Inform Decis Mak 2017 Jun 27;17(1):92 [FREE Full text] [CrossRef] [Medline]
- Meneses F, Moreira A. Technology Enablers for Context-Aware Healthcare Applications. Hershey: IGI Global; 2009.
- Ranschaert E. The Impact of Information Technology on Radiology Services: An Overview: Article based on PhD dissertation to obtain the degree of doctor in medical sciences, defended at the University of Antwerp on July 14, 2016. J Belg Soc Radiol 2016 Nov 19;100(1):93 [FREE Full text] [CrossRef] [Medline]
- Palmer J. Drones could be the future of healthcare. Patient Safety Qual Healthc. 2019. URL: https://www.psqh.com/analysis/drones-could-be-the-future-of-healthcare/ [accessed 2020-06-01]
- Scalea J, Restaino S, Scassero M, Bartlett S, Wereley N. The final frontier? Exploring organ transportation by drone. Am J Transplant 2019 Mar;19(3):962-964 [FREE Full text] [CrossRef] [Medline]
- Gordon E, Gallant M, Sehgal A, Conti D, Siminoff L. Medication-taking among adult renal transplant recipients: barriers and strategies. Transpl Int 2009 May;22(5):534-545 [FREE Full text] [CrossRef] [Medline]
- Chawla DS. Poor medicines delivery practices prompt safety review. Pharm J. 2017. URL: https://pharmaceutical-journal.com/article/news/poor-medicines-delivery-practices-prompt-safety-review [accessed 2020-06-01]
- Taylor J. Recommendations on the control and monitoring of storage and transportation temperatures of medicinal products. Pharm J 2001:267.
- Dearing JW. Applying diffusion of innovation theory to intervention development. Res Soc Work Pract 2009 Sep 01;19(5):503-518 [FREE Full text] [CrossRef] [Medline]
- Malik A, Suresh S, Sharma S. Factors influencing consumers' attitude towards adoption and continuous use of mobile applications: a conceptual model. Procedia Comput Sci 2017:106-113. [CrossRef]
- Liu GS, Tai PT. A study of factors affecting the intention to use mobile payment services in Vietnam. Econ World 2019 Jun 28;4(6):249-273. [CrossRef]
- Kassahun A, Gashe F, Mulisa E, Rike W. Nonadherence and factors affecting adherence of diabetic patients to anti-diabetic medication in Assela General Hospital, Oromia Region, Ethiopia. J Pharm Bioallied Sci 2016;8(2):124-129 [FREE Full text] [CrossRef] [Medline]
- Mattila M, Karjaluoto H, Pento T. Internet banking adoption among mature customers: early majority or laggards? J Serv Mark 2003;17:514-528. [CrossRef]
- Tang AKY. Mobile app monetization: app business models in the digital era. Int J Innov Manag Technol 2016;7(5):224-227. [CrossRef]
- Camacho F, Anderson R, Safrit A, Jones AS, Hoffmann P. The relationship between patient's perceived waiting time and office-based practice satisfaction. N C Med J 2006 Nov 01;67(6):409-413. [CrossRef]
- Leddy KM, Kaldenberg DO, Becker BW. Timeliness in ambulatory care treatment: an examination of patient satisfaction and wait times in medical practices and outpatient test and treatment facilities. J Ambul Care Manage 2003;26(2):138-149. [CrossRef] [Medline]
- Huang XM. Patient attitude towards waiting in an outpatient clinic and its applications. Health Serv Manage Res 1994 Feb;7(1):2-8. [CrossRef] [Medline]
- Schappert S, Rechtsteiner E. Ambulatory medical care utilization estimates for 2006. Natl Health Stat Report 2008 Aug 06(8):1-29 [FREE Full text] [Medline]
- Yang Z, Peterson RT. Customer perceived value, satisfaction, and loyalty: the role of switching costs. Psychol Mark 2004 Oct;21(10):799-822. [CrossRef]
- Simon H. Dynamics of price elasticity and brand life cycles: an empirical study. J Mark Res 1979 Nov;16(4):439. [CrossRef]
- Welty TE, Willis SL, Welty EA. Effect of limited transportation on medication adherence in patients with epilepsy. J Am Pharm Assoc 2010 Nov;50(6):698-703. [CrossRef]
- Syed ST, Sharp LK, Kim Y, Jentleson A, Lora CM, Touchette DR, et al. Relationship between medication adherence and distance to dispensing pharmacies and prescribers among an urban Medicaid population with diabetes mellitus. Pharmacotherapy 2016 Jun 28;36(6):590-597 [FREE Full text] [CrossRef] [Medline]
- Ortiz E, Clancy CM, AHRQ. Use of information technology to improve the quality of health care in the United States. Health Serv Res 2003 Apr;38(2):xi-xxii [FREE Full text] [CrossRef] [Medline]
- Top 4 conditions of polyclinic attendances. Singapore Ministry of Health. URL: https://www.moh.gov.sg/resources-statistics/singapore-health-facts/top-4-conditions-of-polyclinic-attendances [accessed 2020-06-01]
- Anderson LA, Goodman RA, Holtzman D, Posner SF, Northridge ME. Aging in the United States: opportunities and challenges for public health. Am J Public Health 2012 Mar;102(3):393-395. [CrossRef] [Medline]
- Wong CY, Lee HC. Healthcare in Singapore: challenges and management. Japan Med Assoc J 2008;51(5):343-346.
- Mafauzy M. The problems and challenges of the aging population of Malaysia. Malaysian J Med Sci 2000;7:1-3.
- Waiting times for registration and consultation at polyclinics. Singapore Ministry of Health. URL: https://www.moh.gov.sg/resources-statistics/healthcare-institution-statistics/waiting-times-for-registration-and-for-consultation-at-polyclinics [accessed 2020-06-01]
- Hall LH, Johnson J, Watt I, Tsipa A, O'Connor DB. Healthcare staff wellbeing, burnout, and patient safety: a systematic review. PLoS One 2016;11(7):e0159015 [FREE Full text] [CrossRef] [Medline]
- Polyclinic locations and operating hours. Polyclinics Singapore. URL: https://polyclinic.singhealth.com.sg/patient-care/our-polyclinics [accessed 2020-06-01]
- Scott SD, Plotnikoff RC, Karunamuni N, Bize R, Rodgers W. Factors influencing the adoption of an innovation: an examination of the uptake of the Canadian Heart Health Kit (HHK). Implement Sci 2008 Oct 02;3(1):41 [FREE Full text] [CrossRef] [Medline]
- Wang L, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm 2013 Sep;9(5):503-516. [CrossRef] [Medline]
- Kirsch IJ, Jungeblut A, Jenkins L, Kolstad A. Adult literacy in America: A first look at the results of the National Adult Literacy Survey. 1993. URL: https://nces.ed.gov/pubs93/93275.pdf [accessed 2022-06-12]
- Choudhury D, Bhattacharjee D. Impact of socio economic factors on adoption of e-banking amongst salaried employees. Int J Res Manag Sci Technol 2015;3(3):37-46.
- Alquran A, Lambert KA, Farouque A, Holland A, Davies J, Lampugnani ER, et al. Smartphone applications for encouraging asthma self-management in adolescents: a systematic review. Int J Environ Res Public Health 2018 Dec 29;15(11):1 [FREE Full text] [CrossRef] [Medline]
- Hui CY, Walton R, McKinstry B, Jackson T, Parker R, Pinnock H. The use of mobile applications to support self-management for people with asthma: a systematic review of controlled studies to identify features associated with clinical effectiveness and adherence. J Am Med Inform Assoc 2017 May 01;24(3):619-632. [CrossRef] [Medline]
|IT: information technology|
|PILBOX: Prescription in Locker Box|
Edited by T Leung; submitted 07.08.20; peer-reviewed by B Johnson, H De Loof; comments to author 18.11.20; revised version received 12.04.21; accepted 16.03.22; published 27.06.22Copyright
©Christina Lim Jit Fan, Goh Boon Kwang, Vivian Chee Wing Ling, Tang Woh Peng, Bandy Goh Qiuling. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.06.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.