Published on 12.05.06 in Vol 8, No 2 (2006)
Who’s Using PDAs? Estimates of PDA Use by Health Care Providers: A Systematic Review of Surveys
Background: Personal digital assistants (PDAs) find many uses in health care. Knowing rates of collective PDA use among health care providers is an important guiding step to further understanding those health care contexts that are most suited to PDA use and whether PDAs provide improved health outcomes.
Objectives: The objectives of this study were to estimate current and future PDA use among health care providers and to discuss possible implications of that use on choice of technology in clinical practice and research.
Methods: This study was a systematic review of PDA usage surveys. Surveys were identified as part of an ongoing systematic review on the use of handheld devices. Reports from eight databases covering both biomedical sciences and engineering (1993-2006) were screened against distinct eligibility criteria. Data from included surveys were extracted and verified in a standardized way and were assessed descriptively.
Results: We identified 23 relevant surveys, 15 of which were derived from peer-reviewed journals. This cohort of surveys was published between 2000 and 2005. Overall, since 1999, there is clear evidence of an increasing trend in PDA use. The current overall adoption rate for individual professional use ranges between 45% and 85%, indicating high but somewhat variable adoption, primarily among physicians.
Conclusions: Younger physicians and residents and those working in large and hospital-based practices are more likely to use a PDA. The adoption rate is now at its highest rate of increase according to a commonly accepted diffusion of innovations model. A common problem with the evaluation of information technology is that use frequently precedes research. This is the case here, in which PDA adoption rates are already high and projections are for rapid growth in the short term. In general, it appears that professional PDA use in health care settings involves more administrative and organizational tasks than those related to patient care, perhaps signaling where the growth in adoption is most likely to occur. We conclude that physicians are likely accustomed to using a PDA, and, therefore, technology expertise will probably not be a barrier to implementing PDA applications. However, there is an urgent need to evaluate the effectiveness and efficiency of specific tasks using handheld technology to inform those developing and those using PDA applications.
J Med Internet Res 2006;8(2):e7)
A handheld computing device, also commonly known as a personal digital assistant (PDA), is a mobile computer about the size of the palm of the hand. More modern devices can access external networks or the Internet through a wireless connection. Since 1993, when Apple launched the first PDA (Newton MessagePad), use of PDAs has increased worldwide, with global PDA sales projected to surpass 17 million in 2008. This represents a compounded annual growth rate of 17.8% between 2002 and 2008 .
Health care has not been immune to this technological advance in handheld computing. In fact, PDAs find many applications in health care. Family physicians and specialists have been using PDAs for general medical reference, such as drug interactions, pharmacopeias, and cardiac risk [- ]. Other important applications of PDAs are those involving data collection and management, as in patient tracking, electronic Case Report Forms in clinical trials, patient diaries, and infection surveillance [ - ]. However, the suitability of PDAs across all health care contexts and whether they benefit health outcomes remain open questions.
Many of us would agree that it is necessary to evaluate a technology before its adoption to allow health care providers to make informed decisions. However, given that technology is a moving target, a common problem with evaluation is that practice frequently precedes research. By the time researchers have obtained funding, completed a study, and published it, the technology is either in widespread use or has been abandoned . As well, the appropriate type of evaluation is not independent of the stage of adoption of the technology. For example, if 90% of the target users have already adopted a technology, then studies evaluating its general utility will no longer inform the adoption decision. In this case, research should focus on optimization of the technology in use. This is a familiar scenario in information technology research, and it underscores the importance of understanding the rates of adoption in helping direct approaches to research [ ].
In a general overview article, Fischer et al (2003) summarized the current literature covering the use of handheld devices in medicine, primarily related to PDA functionality . While implementation issues were discussed, rates of adoption were not addressed. Further, a recent review of PDA use in health care by Baumgart (2005) examined operating systems, basic functionality, security and safety, and limitations of PDA use [ ]. It is a thorough overview of studies published since 2000 that addresses applications of handheld computers for health care professionals, but it touches only briefly on the prevalence of handheld use. Therefore, to our knowledge, there has not been any structured review conducted to date that specifically addresses the extent of use of handheld devices and estimated adoption rates. As such, this paper aims to systematically summarize all available survey data on health care providers’ use of PDAs with the view of presenting the best available estimates of current PDA use. This paper also aims to project expected future adoption based on established technology diffusion models. From this information we draw implications for research and practice.
For the purposes of this systematic review of surveys, the term PDA is used synonymously to refer to any handheld device. Some examples include the following: Blackberry; Palm operating system devices, which include Palm Tungstens, Handspring Visor, and Sony Clie; and Pocket PC devices, which include the Compaq iPAQ and HP Jordana.
Surveys were identified as a subset selected from a broader systematic review examining all studies related to handheld devices in health care settings. Thus, initial search strategies and retrieved articles reflected this more extensive focus. This comprehensive literature search was conducted in consultation with an information specialist. The searched bibliographic databases covered both medical and engineering disciplines, including the following eight databases: Medline, Current Contents, Inspec, BA/RRM, Biotechnology, Biological Abstracts, EI Compendex, and EMBASE. The search was restricted to English-language literature published January 1993 (corresponding to the development of the first palm device) to February 2005. An updated search of Medline (PubMed) and EI Compendex (EI Village 2) was run near the project’s completion (January 30, 2006).
Furthermore, the reference lists from included studies were examined in an effort to identify additional surveys not captured in the reference databases. In addition, surveys identified from Google searches and those known to the authors to have been conducted by private market research firms as well as physician groups were nominated for inclusion in our screening.
Electronic Search Strategy
The intent of searching the biomedical databases was to retrieve all studies related to handheld devices in health care. It is for this reason that the word survey was not included as a specific term in the original search strategy. The search did include the sample search terms detailed in. The search strategy for engineering databases limited retrievals to those articles relating to both handheld computing and health. All bibliographic databases were searched using subject headings tailored to each database and free-text terms in the titles and abstracts.
Surveys were included for this present review if they met the following initial criteria: related to an application in human health care and involved the use of a PDA device; contained original data; written in English (not including abstract or conference proceedings); published after 1993; and specifically reported handheld usage rates (prevalence of PDA use as a metric) in populations of health care professionals who were surveyed about the extent of their PDA use. Although conference proceedings were excluded, if deemed potentially relevant, a cross-check was conducted to see if there was an ensuing journal publication. A survey was not included if the handheld device being evaluated had undergone extensive custom modifications. A final set of unique references was identified and posted to the proprietary Web-based screening system SRS (Systematic Review Software).
The selection process for this present survey review consisted of two phases. First, it began with a screen of full-text articles that had already been retained because their title, abstract, or keywords suggested they contained relevant information on PDA use in health care settings. Therefore, for assessment of relevance, surveys were included if they appeared to contain pertinent study information and if there was no unequivocal reason for exclusion. Second, upon updating the searches, authors returned to the screening of the title, abstract, and keywords for each citation strictly to identify potentially relevant and most recent PDA usage surveys. Eligibility criteria were applied to the full-text surveys, which were reviewed independently by two reviewers (CG and KE). Disagreements were resolved by consensus.provides a modified QUOROM flow chart outlining the process for selecting identified PDA usage surveys.
The contents of each included survey were abstracted by one reviewer (CG), with an additional research assistant providing verification (TR).
The data from all included surveys were extracted in a predefined, standardized fashion with abstraction verified by a second person and assessed descriptively (). Quality assessment methods for descriptive study designs such as surveys have not been established. Although some assessment frameworks exist for assessing survey research [ , ], none of them have been validated or empirically shown to include criteria that are associated with the reduction of bias in empirical surveys. Therefore, survey quality was not formally assessed.
From a total of 816 full-text articles that underwent relevance assessment for a systematic review of the literature examining broad-ranging PDA use in health care, a subset of 18 surveys reporting PDA prevalence rates were identified (see). Additionally, upon updating the search, an additional 959 records were retrieved and screened, from which 5 additional unique surveys were included. Furthermore, a total of 8 surveys were reviewer nominated, 3 of which were identified upon updating. Unfortunately, the authors were not able to obtain access to one Internet market research report. Prevalence numbers from 2 surveys were found too difficult to interpret, and, therefore, these data could not be utilized further in our results; however, we refer to both studies descriptively.
It is from this pool of literature that a total of 23 unique surveys were identified ():15 were published articles in scientific journals, and 8 were nonacademic, reviewer-nominated citations that were either reports available for purchase, press releases, or trade magazine articles and thus not subject to formal peer review. Of these 8 surveys, 5 were conducted by Internet market research firms, 2 were conducted by physician groups, and 1 was conducted by a market research firm in conjunction with a physician group (American Medical Association).
The included surveys were published between 2000 and 2005, with survey data collected between 1999 and 2004. One survey had a four-year lag between data collection and publication, three surveys had a lag of three years, and three surveys had a lag of two years. We were unable to determine publication lag in four surveys as no data collection dates were provided. Surveys were from the United States (16), Canada (4), Australia (1), both the United States and Puerto Rico (1), and both the United States and Canada (1). Survey methodology reflected the following: self-administered questionnaires distributed solely by mail (11); telephone interviews (2); Web-based online surveys (4); and combined distribution by electronic or postal mail as determined by the recipient (4). Two studies did not report the methodology used. Response rates ranged from 5.7% to 92.6% across 13 of the included surveys; 10 surveys did not report such rates.
In presenting the results, we group the PDA users by type of health care provider and personal characteristics (eg, age).
In terms of PDA use, physician specialists were surveyed exclusively in five surveys. Three surveys examined practicing physicians, three included physicians and specialists combined, two included medical residents exclusively, while two surveyed an amalgam of physicians, specialists, medical residents, and/or students. Three surveys targeted physician executives and organizational practice leaders. One survey was directed at directors of family practice residency programs, while a further survey targeting individual PDA use in emergency medicine resident programs was completed at the organizational level.
In addition to physicians as users of technology, one survey targeted practicing hospital pharmacists and another targeted a national sample of nurse practitioner students and faculty. One survey included faculty and residents across several health science disciplines, including medicine, dentistry, nursing, public health, pharmacy, and applied health science.
To more accurately reflect handheld use across time, reported surveys were examined, when possible, from the timepoint when survey data were collected versus when published. When not possible, the publication date was the reported timepoint used. Collectively, the included surveys do indicate that PDA use is high, albeit somewhat variable, across studies. The reported prevalence rates of PDA use lend themselves well to an estimation of trend over time (), and, as such, since 1999, there is evidence of an increase in PDA usage. Results do not include surveys completed at the organizational level. Surveys are presented according to data collection dates, with the exception of the American College of Physicians study (2001) [ ], Stroud (2005) [ ], and Boonn (1995) [ ], which report publication dates only. The noted drop in 2003 is due to the paucity of surveys conducted in that year. Based on the most recent survey statistics (2004/2005), the current overall adoption rate varies between 45% and 85%, as derived from individual level survey data. In addition, of the five surveys completed at the organization level (eg, physician executives or medical program directors speaking on behalf of their individual members), the PDA use of their group members was estimated to be 60% (2001) [ ], 67% (2001) [ ], 64% (2001) [ ], 33% (2002) [ ], and 75% (2003) [ ].
To elaborate on the percentage of overall adoptions rates, a US survey of 769 practicing physicians conducted in 1999 found that only 15% of physicians use a PDA in practice . In a 2000/2001 survey of directors of family practice residency programs in the United States and Puerto Rico, use of handheld computers by either an individual or group was reported in 67% of the residency programs [ ]. In 2001, 47% of 489 US-based internists surveyed were using a PDA [ ]. A subsequent 2001 survey of 834 practicing physicians found that the proportion using PDAs had increased to 26% [ ]. If we only look at professional use, then the increase is from 10% in 1999 to 18% in 2001 [ ]. Among a national sample of practicing physicians surveyed in 2001, 26% reported using PDAs for office-based work [ ]. In 2001/2002, 38% of 696 office-based physicians indicated that they used a PDA in their practice [ ]. Of practicing hospital pharmacists surveyed in 2001, 33% reported using a PDA at work or home, with 28% using one on a daily basis [ ]. These numbers reflect both types of use: personal and professional (ie, as an integral part of everyday practice). In 2001, 75% of residents in a teaching hospital reported using their PDA on a daily basis [ ]. In 2002, 35% of US pediatricians were using a PDA at work, and 40% had one for personal use [ ], and 46% of internal medicine physicians and residents were reporting PDA use [ ].
In Canada, similar PDA use data have been collected since 2001 as part of the annual Physician Resource Questionnaire conducted by the Canadian Medical Association. PDA use among physicians increased from 19% in 2001  to 28% in 2002 [ ] and to a third in 2003 [ ]. These data conclude that, in 2003, a third of Canadian physicians were using PDAs, which marked a 73% increase from 2001. Further, more than 50% of Canadian medical doctors under 35 years of age reported that they were using a PDA or wireless device in clinical practice [ ]. The data did not differentiate type of professional use.
In a PriceWaterhouseCoopers survey in 2001, 60% of the physician executives who responded indicated that their organization had at least one physician with a PDA . Reportedly, this represented an upward trend from 26% in a similar 2000 survey. Further, in 2003, the trend continued, and 75% of respondents reported that their organization’s physicians were using PDAs. This increase in PDA use came after a steep decline to 33% in 2002 [ , ]. A sample of health science faculty and medical residents was surveyed in 2002 about their PDA use. Combined results from the various faculties and residents indicated that 61% used a PDA [ ].
In 2004, 57% of a sample of US physicians indicated that they regularly used a handheld computer in a typical work week . Results obtained in 2004 from a survey of members of the Austalian Society of Anaesthetists indicated that 91% of respondents owned a PDA; 85% reported using it on a daily basis, and 66% were reportedly “dependent” upon the handheld device, although the term dependent was not defined [ ]. In 2005, when physician members of the Radiologicial Society of North America were surveyed, 45.1% reported owning or using a PDA on a daily basis [ ]. However, the survey authors suggested use among this group of specialists appeared to be lower than for other physicians because a radiologist often works in front of a full workstation in clinic and therefore relies less on a mobile device. Further, PDAs are not yet well equipped to handle the tasks radiologists need to perform. In 2005, Stroud et al became the first group of researchers to address the use of PDAs in the field of nursing. Survey results concluded that the majority (67%) of participants used this technology [ ].
While PDA use has clearly increased since 1999, it appears as though only a handful of studies have examined the prevalence and usage patterns of such technology outside of physician groups. Furthermore, when comparing the included surveys in depth, distribution of use is not uniform across selected characteristics of surveyed health care professionals. Therefore, further subgroup analyses from the included surveys are provided below. Patterns of handheld use are also briefly examined.
Patterns of PDA Usage
Based on a survey of 250 family physicians, as far back as 1995, younger physicians (less then 40 years of age) were more likely to consider carrying a handheld computer than older physicians (94% vs 84.5%) . More recent data from this present review also suggest an age differential in usage patterns. A 2001 survey of 834 US practicing physicians found that use of handheld devices was higher among doctors under age 45 (33%) than among older doctors (21%) [ ]. Another study found that pediatricians graduating from medical school in the last five years were more likely to use a PDA in practice than those who graduated more than five years ago [ ]. According to a survey conducted by the American Academy of Pediatricians in 2001, PDA use was highest among those members under 30 years of age, with a reported usage rate of 75% [ ]. Another study found that 60% of US internists below 40 years of age used a PDA, while only 34% older than 51 years did [ ]. McLeod et al (2003) also found that PDA usage captured in 2002 among a sample of internal medicine physicians and residents under 30 years was much higher (68%) versus those over 40 years of age (37%) [ ]. In Canada, 2003 usage was highest among younger physicians, with more than half of those under the age of 35 years (53%) using a PDA, compared with 15% of physicians aged 65 or older [ ]. According to the American Medical Association/Forrester Research 2005 Physician and Technology Study, more doctors under the age of 40 years were reportedly using PDAs (55%) than those over 40 years (45%) [ ]. In 2005, the mean age of nurse practitioners and students who reported using a PDA was 42 years [ ].
Students and Medical Residents
Residents tend to be younger, therefore it follows that they are more likely to use PDAs. This is also substantiated by direct evidence. A survey of directors of family practice in the United States and Puerto Rico conducted in November 2000 (306 responses) found that use of handhelds in residency programs, either by an individual or group, was 67% . A 2001 survey of residents in a teaching hospital reported that more than 75% used their PDA on a daily basis [ ]. Stromski et al (2005) surveyed emergency medicine residency programs in 2001 to identify the methods of procedure documentation to examine the number of programs transitioning to more advanced information technology systems (eg, PDA use). Their results indicated that 13% of the residency programs required the use of PDAs, 15% of programs purchased PDAs for their residents, and a similar proportion reported that PDAs were used by “most or all” of their residents to document procedures. Further, 64% of programs reported that “most or all” of their residents utilized PDAs for clinical purposes. DeGroote et al found that, in 2002, 71% of medical residents reported using PDAs versus 56% of faculty members [ ]. In a 2002 survey, McLeod et al noted that the percent of frequent PDA users among internal medicine residents and fellows in training exceeded 70%, compared to only 50% of attending physicians [ ]. From a survey of the experiences of family resident graduates in obtaining hospital privileges and in documenting procedures and deliveries, Vincent et al (2003) concluded that 36% of the respondents used a PDA alone or in conjunction with a log-card, paper-based system. Unfortunately, this study did not present any other prevalence data on PDA use [ ]. However, from survey data captured in 2004, the handheld technology gap between residents and physicians began to close: a US study concluded that 73% of residents regularly used a handheld computer in a typical work week, followed closely by 71% of family/general practitioners [ ]. In a survey of PDA use by nurse practitioner students and faculty, Stroud et al found that of the total respondents who reported PDA use, 73% were nursing students [ ].
One survey by Joy et al (2004) met our initial criteria but could not be incorporated into the results analysis. Although this study did examine PDA use in obstetrics and gynecology residency programs, it was difficult to interpret the prevalence numbers among the resident respondents. Likewise, the National Physician Survey (2004) did not present overall PDA prevalence rates but did ask Canadian medical students if they had a PDA or wireless device . Of the 2721 respondents, 24% in first year, 40.6% in second year, 70.6% in third year, and 71.6% in fourth year reported having a PDA, representing an overall average of 48.6% among students [ ]. Unfortunately, these 2004 figures provide no information on how medical students were using this technology and in what contexts.
PDA usage among men and women was equal in a 2001 survey of internists . Similarly, McLeod et al (2002) found no significant gender difference in PDA users among a 2002 sample of internal medicine physicians and residents [ ]. However, pediatrician PDA users were most likely male, as reported in 2002 [ ]. As well, the 2003 Physician Resource Questionnaire analysis concluded that male physicians were somewhat more likely to use a PDA in their practice than were females (35% vs 30%) [ ]. More recent data from a 2004 survey of PDA use among US physicians, specialists, and medical residents suggested that male clinicians were slightly more likely than their female counterparts to regularly use handhelds (53% vs 47%) [ ]. On the other hand, nurse practitioner data from 2005 show that men (82%) were notably more likely than women (64%) to use a PDA (P < 0.05) [ ]. However, the authors cautioned that they were unable to determine the significance of this finding given that the actual survey sample of men (n = 38) as opposed to women (n = 188) was small. The authors suggested that if ease with PDA technology is less common in women, then the nursing profession, dominated by females, may need elevated momentum to adopt PDA technology across nursing practice [ ].
Family Physicians versus Specialists
The most recent Physician Resource Questionnaire (2003) analysis concluded that Canadian family physicians were just as likely to use a PDA (33%) when compared to medical (34%) and surgical (32%) specialists . This was the third consecutive year these figures rose consistently across all physician groups in Canada [ , , ]. However, according to a US survey of physicians published in 2005, the biggest adopters of PDAs in professional practice were family and general practitioners (71%) when compared to surgical specialists (54%) [ ]. The above mentioned studies are the only survey data available directly comparing general physician use to that of specialists.
Large and Hospital-Based Practices
A US survey of practicing physicians found that use was higher among those who were wholly or partly hospital-based (33% and 29%, respectively) than among those who were office-based (23%) . Usage was also higher among physicians in large practices (33%) than in solo practice (16%) [ ]. Carroll et al (2004) also found that PDA users tended to not be in private practice [ ]. Additional survey data from 2004 indicated that of US physicians practicing in primary practice offices with fewer than 10 physicians, 49% reported regular use of a handheld computer [ ]. Miller et al (2004), reporting on a national sample of practicing physicians, found that in a group practice consisting of an average of nine physicians, handheld use was approximately 56% [ ].
Urban versus Rural Physicians
From a random sample of US pediatricians in 2002, PDA users were most likely from urban communities . Similarly, results from Canada’s Physician Resource Questionnaire in 2001 indicated PDA use to be higher among physicians practicing in urban centers (19.9%) than in rural centres (13.4%) [ ]. However, by 2002, rural use (29.6%) surpassed urban use (27.7%) among physicians [ ]. In Canada, this trend continued in 2003, with 36.9% of rural respondents indicating PDA use versus 32.5% of urban respondents [ ].
Five surveys considered PDA use in both a professional and personal context; 17 studies exclusively captured professional use. One study reported general prevalence rates for PDA use among pediatricians; however, it did not specify if use was in clinical practice or outside of work.
In order to discern professional use more closely, we explored administrative PDA uses versus direct use in clinical patient care. We found that of the surveys that concern PDA use within a health care setting, 17 of 23 studies (74%) reported use pertaining to administrative or organizational tasks, while 14 of 23 studies (61%) addressed PDA use in patient care. Billing and coding were the most frequently performed administrative PDA functions in 50% of the surveys reporting administrative uses. This was followed by 44% reporting calendar scheduling, 31% reporting Web and email access, 25% reporting address book use, and 25% stating use in charting patient details into an electronic health record. Other reported administrative tasks included the following: word processing, calculator, charge capture, procedure documentation, outpatient tracking, resident hours, telephone message tracking, general time management/personal organizer, patient referrals, procurement of supplies, patient census, order entry, dictation, and passwords and pins.
In terms of patient care, access to drug information was reported in 93% of the surveys reporting clinical PDA use, while 50% reported prescribing, 43% stated accessing patient records, 43% described medical calculator use, and 36% indicated use in reference to laboratory values. Other reported clinical PDA uses included access to medical references, patient tracking and patient reminders, clinical decision pathways and managed care applications, telemedicine, and diagnostic imaging or radiology applications.
Only one survey reported PDA use for patient education, and one referred to PDA use for research purposes.
This paper summarizes the results from surveys examining adoption of PDA use. These survey data are in reasonably good agreement and suggest a sizable proportion of physicians use handheld devices. However, most of the sources of survey data did not distinguish well between types of applications being used most often and whether the PDAs were being used professionally for administrative purposes or for direct clinical work. It is encouraging to note that our findings are similar to those of an analysis of online registrations and downloads of a PDA drug reference guide, which concluded that approximately one fifth of US physicians (150000) and half of medical students in the United States (33000) were PDA users .
Our grouped survey data suggest that there is little information on the PDA usage rates among nonphysician health care providers. However, collectively, these data suggest that use of handheld devices has become a subject that health care professionals need to know about. By systematically gathering this usage information, it is difficult to deny the prevalence of PDAs in health care. With this basic understanding of current handheld usage patterns, we need to consider the impact of this development of mobile handheld technology on both practice and research.
According to a commonly accepted descriptive model of the diffusion of innovations developed by Rogers, when the cumulative rate of users of a new invention is plotted versus time, the result is an S-shaped curve . Interestingly, this appears to be true of most technological innovations, irrespective of the technology. For example, Hall and Khan (2003) reviewed the S-shape adoption patterns of a variety of 20th century consumer products (eg, washing machines, video cassette recorders) [ ], while Teng et al (2002) developed historical diffusion curves for information technologies (eg, personal computers, email) [ ]. Variations in diffusion slopes do exist given that some technologies will diffuse more rapidly than others.
Health care information technologies have also been examined within this diffusion framework. England et al (2000) studied organizational and technological factors determining the rate at which innovations diffuse in the health industry . In 2005, RAND Health completed a report characterizing the diffusion of electronic health records along an S-shaped adoption curve [ ].
Technologies typically go through multiple phases during their adoption life cycle, which may last for many years [, ]. The characteristics of the adopters change over time and so does the nature of suitable evidence to inform their adoption decisions. For example, innovators (the first 2.5% who adopt a new technology) do not need evidence to make an adoption decision. Early adopters (the next 13.5%) are satisfied with case studies and examples of successful adoption and benefits [ ]. Examining the typical technology adoption curve for handheld devices ( ) based on the adoption percentage of PDAs thus far from the most recent available data (2004/2005), it can be concluded that we are now at the steepest stage in the adoption S-curve, with a transition from the early majority to the late majority.
The increase in PDA adoption means a potential reduction in hardware and training costs when using handheld devices in the provision of care and in research. Because of the high probability that target health care professionals may already have a handheld device and will already know how to use one, the overall hardware purchase costs could be reduced, and the end user will not necessarily have to be trained from scratch.
To date, use of PDAs in health care appears to have preceded extensive evaluative research. PDA adoption rates, already high, continue to be a moving mark with projections for rapid growth in the short term. By comparing handheld device diffusion to other health information innovations, and by placing PDA use within existing diffusion models, we are able to better predict the future of handheld growth in health care and therefore develop more timely and appropriate evaluative research to accompany such growth.
Unfortunately, we were unable to include information from two national physician surveys. The first report entitled “Taking the Pulse” was published in October 2004 by Manhattan Research . Information gleaned from a report excerpt stated that 40% of all US physicians surveyed in 2004 were using a PDA, marking an increase from 35% in 2003. Reported top activities performed on a PDA by all US physicians (in order) were personal scheduling, professional scheduling, accessing a drug reference database, accessing online information, writing/entering clinical notes, and mobile email access [ ]. These report findings are similar to our overall findings in this present review.
The second national physician survey not incorporated into our analysis was the Canadian National Physician Survey (NPS) (2004), which provides valuable insight into what information technology, including PDAs, physicians and specialists have in their main patient care settings . However, overall prevalence rates could not be determined from the data provided given the manner in which they were presented. Nonetheless, in reviewing the national data, we can descriptively draw some conclusions. First, it appears as though male physician PDA use is higher than that of females. This appears to be consistent across all tasks involving PDA use although differences do appear to be small. This is consistent with our general findings in which males are only marginally more likely to use a PDA than are females. Interestingly, when examining age-related data from the NPS, it appears as though the age factor may in fact be PDA task-specific. For example, electronic health record usage appears to decrease as the age of physician users decreases. However, PDA use for drug interaction information increases when the age of the physician user decreases. This appears contrary to most other surveys that show younger age is associated with higher general PDA use. Perhaps what this information tells us is that handheld use may be more complex when broken into task-specific strata.
It is worthy to note that, with the exception of one survey focusing on nurse practitioner students, little mention was made in the surveys of PDA use by students across health care disciplines, including medicine. Several universities in Canada and the United States now mandate use of PDAs for medical undergraduate students and residency programs; therefore, it is assumed this could potentially affect prevalence rates. However, because none of the included surveys examined mandated use, we are unable to infer if this is responsible for recent increases. However, this raises an important issue to be considered in future studies related to students and rates of handheld adoption.
To better understand the prevalence rates among the included surveys, it became important to categorize the drivers for PDA use as either professional or personal. We therefore attempted to discern what specific PDA tasks the respective health care professionals were performing. This was done by classifying, whenever possible, the use as administrative versus care. On the surface, it would appear that administrative and organizational tasks on a PDA exceed those related to patient care, perhaps signaling where the growth in adoption is most likely to occur.
In this present review, we can only speak broadly to rates of adoption and patterns of use. Drawing inferences from the survey data was often limited by lack of, or differences in, operational definitions in aspects of handheld use being measured. For example, the term use was often not defined by frequency (eg, specific units of time—day, week, month). Taking these issues into consideration would be a useful exercise for future surveys as well as information technology prevalence studies in health care.
In conclusion, physicians are increasingly accustomed to using a PDA, and, therefore, technology expertise will not likely be a barrier to deploying handheld applications. There is an urgent need to evaluate the effectiveness and efficiency of specific tasks using PDA technology (eg, implementation, searching, reference, data entry, reporting) to inform those persons developing and those using handheld applications. Furthermore, it is not clear why there is a paucity of evidence on the extent of adoption of PDAs by other health care providers: is it that they lag in the use of this technology or is it simply that they have yet to be studied?
This review has a number of limitations. Issues around response bias and inability to draw causal inferences weaken survey methodology. It may be the case that those surveyed feel a stronger affinity to the survey sponsor, who has a greater interest in the questions asked, or are in complete disagreement with the topic at hand. This can skew results in difficult-to-measure ways. Quite possibly, the nonrespondents are the least committed (ie, nonusers of PDAs). As a result, the critical objective of drawing a true random sample of the populations that are the focus of the survey is compromised and the findings somewhat impure.
The reported methodologies across these surveys appear to be heterogeneous, which limits their comparability. As noted, the quality of the included surveys could not be determined given the absence of validated quality assessment instruments, and, therefore, there was no adequate way to assess the influence of bias. A related issue is that some of the included surveys did not go through a rigorous peer-review process. These combined issues made judging the strength of the evidence not possible. One would assume surveys identified from scientific journals would be a source of less biased information. However, in defense of the nonacademic surveys, there is a consistency in results between those peer-reviewed versus those that were not. This may suggest that our main conclusions regarding adoption rates are fairly robust and not disconnected even with the inclusion of non–peer-reviewed evidence.
The objective of this study was to determine the adoption rates of PDAs in health care settings, and to project expected adoption in the future based on established technology diffusion models. Our findings from a systematic review indicate the current overall adoption rate for professional use of PDAs among health care providers, namely physicians, is 45% to 85%. Younger physicians, residents, and those working in large and hospital-based practices are more likely to use a PDA. Professional use in health care settings appears to be more focused on administrative tasks when compared to those related to patient care, although this requires further study. The adoption rate is now at its highest rate of increase according to a commonly accepted diffusion of innovations model. Additionally, the impact of PDA use on practice appears to be immediate in terms of costs and training. Familiarity will not likely be a barrier to deploying handheld applications in health care. However, there is a critical need to evaluate the effectiveness and efficiency of specific tasks using handheld technology within the health care system and across health care provider PDA user groups.
The authors would like to acknowledge the Chalmers Research Group, Children’s Hospital of Eastern Ontario Research Institute for their in-kind support. The authors would also like to acknowledge Dr. Harvey Skinner, Professor and Chair of Public Health Sciences, Faculty of Medicine, University of Toronto, for providing preliminary comments on this project. The authors would also like to extend a thank you to Ms. Tiffany Richards for providing assistance with data extraction.
Conflicts of Interest
Khaled El Emam is a co-founder of and has financial interests in TrialStat Corporation, a software company that develops electronic data collection tools for mobile devices.
Appendix 1Medline Search Strategy
Medline Search History (Silver Platter)
- #19 (#17 and (la=english)) or ((#12 and (la=english)) or (#10 and (la=English)))
- #18 #17 and (la=english)
- #17 (palm or palms) and (microcomputer or computer or software)(157 records)
- #16 palm or palms
- #15 microcomputer or computer or software
- #14 (#12 and (la=english)) or (#10 and (la=English))
- #13 #12 and (la=english)
- #12 hand held computer
- #11 #10 and (la=English)
- #10 (handspring or apple newton or jornada) or (windows ce or pocket pc or clie) or (pda or personal digital assistant or personal digital assistants) or (handheld computer) or (palm pilot or palm os) or (blackberry or ipaq)
- #9 palm pilot or palm os
- #8 (la=english) and #7
- #7 (handspring or apple newton or jornada) or (windows ce or pocket pc or clie) or (pda or personal digital assistant or personal digital assistants) or (palm pilot or palm or palms or palm os) or (handheld computer) or (blackberry or ipaq)
- #6 blackberry or ipaq
- #5 handspring or apple newton or jornada
- #4 windows ce or pocket pc or clie
- #3 pda or personal digital assistant or personal digital assistants
- #2 palm pilot or palm or palms or palm os
- #1 handheld computer
Additional database search histories are available upon request from the authors.
- Worldwide PDA & Smartphone Forecasts Report: 1998-2008. eTForecasts 2003. URL: http://www.etforecasts.com/ [WebCite Cache]
- Martin S. MD's computer, PDA use on the upswing. CMAJ 2002 Oct 1;167(7):794 [FREE Full text] [Medline]
- Adatia F, Bedard PL. "Palm reading": 2. Handheld software for physicians. CMAJ 2003 Mar 18;168(6):727-734 [FREE Full text] [Medline]
- Fischer S, Stewart TE, Mehta S, Wax R, Lapinsky SE. Handheld computing in medicine. J Am Med Inform Assoc 2003;10(2):139-149. [Medline] [PMC] [CrossRef]
- Koop A, Mösges R. The use of handheld computers in clinical trials. Control Clin Trials 2002 Oct;23(5):469-480. [Medline] [CrossRef]
- Johannes CB, Crawford SL, Woods J, Goldstein RB, Tran D, Mehrotra S, et al. An electronic menstrual cycle calendar: comparison of data quality with a paper version. Menopause 2000;7(3):200-208. [Medline]
- Lapinsky SE, Weshler J, Mehta S, Varkul M, Hallett D, Stewart TE. Handheld computers in critical care. Crit Care 2001 Aug;5(4):227-231 [FREE Full text] [PMC] [Medline]
- Lapinsky S, Weshler J, Varkul M, Mehta S, Stewart T. Evaluation of handheld computers in critical care. In: Bruch HP, Kockerling F, Bouchard R, Schug-Pab C, editors. New Aspects of High Technology in Medicine. Bologna, Italy: Monduzzi Editore; 2000:279-284.
- Mclaws ML, Caelli M. Pilot testing standardized surveillance: Hospital Infection Standardised Surveillance (HISS). On behalf of the HISS Reference Group. Am J Infect Control 2000 Dec;28(6):401-405. [Medline] [CrossRef]
- Benbasat I, Zmud RW. Empirical research in information systems: the practice of relevance. MIS Quarterly 1999;23(1):3-16. [CrossRef]
- Baumgart DC. Personal digital assistants in health care: experienced clinicians in the palm of your hand? Lancet 2005 Oct 1;366(9492):1210-1222. [Medline] [CrossRef]
- Gautheir B. Assessing survey research: a principled approach (work-in-progress report). In: Proceedings of the Professional Marketing Research Society Annual Conference. Ottawa, Ontario, Canada; Apr 2001:1-28.
- . CASRO guidelines for survey research quality. 1998. URL: http://www.casro.org/guidelines.cfm [accessed 2006 May 9] [WebCite Cache]
- Bishop L, Brown EG. 2005 Physicians and Technology Study. Usability holds back MD handheld usage. Forrester Research. 2005 Mar 15. URL: http://www.forrester.com/Research/Document/Excerpt/0,7211,36530,00.html [accessed 2006 May 9] [WebCite Cache]
- . 2004 National Physician Survey (NPS). 2005. URL: http://www.cfpc.ca/nps/English/home.asp [WebCite Cache]
- . Taking the pulse. 2004 Oct. URL: http://www.manhattanresearch.com/products/Strategic_Advisory/ttp/ [accessed 2006 May 9] [WebCite Cache]
- Joy S, Benrubi G. Personal digital assistant use in Florida obstetrics and gynecology residency programs. South Med J 2004 May;97(5):430-433. [Medline] [CrossRef]
- Hucko D, Cohen P. Computing in the physician's practice. Harris Interactive 2000.
- . ACP-ASIM survey finds nearly half of US members use handheld computers. ACP-ASIM Press Release. 2001 Oct. URL: http://www.acponline.org/college/pressroom/handheld_survey.htm [WebCite Cache]
- Versel N. 4th annual Modern Physician/PriceWaterhouseCoopers survey of executive opinions on key information systems issues: ready to roll. Modern Physician 2001 Nov;5(14):12-20.
- Martin S. Computer use by Canada's physicians approaches 90% mark. CMAJ 2001;165:632.
- Taylor H, Leitman R. Physicians’ use of handheld personal computing devices increases from 15% in 1999 to 26% in 2001. Harris Interactive 2001 Aug 15;1(25):1-4.
- . AAP Periodic Survey #51: Use of computers and other technologies. Aug. URL: http://www.aap.org/research/periodicsurvey/ps51.htm [WebCite Cache]
- Criswell DF, Parchman ML. Handheld computer use in U.S. family practice residency programs. J Am Med Inform Assoc 2002;9(1):80-86. [PMC] [Medline] [CrossRef]
- Miller RH, Hillman JM, Given RS. Physician use of IT: results from the Deloitte Research Survey. J Healthc Inf Manag 2004;18(1):72-80. [Medline]
- Balen RM, Jewesson PJ. Pharmacist computer skills and needs assessment survey. J Med Internet Res 2004 Mar 29;6(1):e11 [FREE Full text] [Medline] [CrossRef]
- Barrett JR, Strayer SM, Schubart JR. Assessing medical residents' usage and perceived needs for personal digital assistants. Int J Med Inform 2004 Feb;73(1):25-34. [Medline] [CrossRef]
- Versel N. 5th annual Modern Physician/PriceWaterhouseCoopers survey of executive opinions on key information systems issues: wave of the (not-so-distant) future. Modern Physician. 2002 Nov. p. 13 URL: http://healthcare.pwc.com/cgi-local/hcregister.cgi?link=pdf/itspending.pdf [accessed 2006 May 9] [WebCite Cache]
- Mcleod TG, Ebbert JO, Lymp JF. Survey assessment of personal digital assistant use among trainees and attending physicians. J Am Med Inform Assoc 2003;10(6):605-607. [PMC] [CrossRef] [Medline]
- Carroll AE, Christakis DA. Pediatricians' use of and attitudes about personal digital assistants. Pediatrics 2004 Feb;113(2):238-242. [Medline] [CrossRef]
- De Groote SL, Doranski M. The use of personal digital assistants in the health sciences: results of a survey. J Med Libr Assoc 2004 Jul;92(3):341-348. [Medline] [PMC]
- Martin S. More than half of MDs under age 35 now using PDAs. CMAJ 2003 Oct 28;169(9):952. [Medline]
- Vincent C, Kim S, Schneeweiss R, Stevens N. Documenting procedures and deliveries during family practice residency: a survey of graduates' experiences, preferences, and recommendations. Fam Med 2003 Apr;35(4):264-268. [Medline]
- Versel N. 6th annual Modern Physician/PriceWaterhouseCoopers survey of executive opinions on key information systems issues: faith-based spending. Modern Physician. 2003 Nov. p. 20-25 URL: http://www.modernphysician.com/docs/2003techsurvey.pdf [accessed 2006 May 9] [WebCite Cache]
- Wilden J, Riley RH. Personal digital assistant (PDA) use amongst anaesthetists: an Australian survey. Anaesth Intensive Care 2005 Apr;33(2):256-260. [Medline]
- Stromski CJ, Jeffers T, Bean E. Procedure documentation in emergency medicine residencies: a time of change. Acad Emerg Med 2005 Apr;12(4):375-376. [Medline] [CrossRef]
- Stroud SD, Erkel EA, Smith CA. The use of personal digital assistants by nurse practitioner students and faculty. J Am Acad Nurse Pract 2005 Feb;17(2):67-75. [Medline] [CrossRef]
- Boonn WW, Flanders AE. Informatics in radiology (infoRAD): survey of personal digital assistant use in radiology. Radiographics 2005;25(2):537-541. [Medline]
- Ebell MH, Gaspar DL, Khurana S. Family physicians' preferences for computerized decision-support hardware and software. J Fam Pract 1997 Aug;45(2):137-141. [Medline]
- Rothschild JM, Lee TH, Bae T, Bates DW. Clinician use of a palmtop drug reference guide. J Am Med Inform Assoc 2002;9(3):223-229. [PMC] [Medline] [CrossRef]
- Rogers EM. Diffusion of innovations. 5th edition. New York: The Free Press; 2003.
- Hall B, Khan B. Adoption of new technology. UC Berkeley Working Papers No. E03-330. Berkeley, CA: University of California Berkeley, Department of Economics; 2003:1-20.
- Teng J, Grover G. Information technology innovations: general diffusion patterns and its relationship to innovation characteristics. IEEE Transactions on Engineering Management 2002;49(1):13-27. [CrossRef]
- England I, Stewart D, Walker S. Information technology adoption in health care: when organisations and technology collide. Aust Health Rev 2000;23(3):176-185. [Medline]
- Bower A. The diffusion and value of healthcare information technology. Santa Monica, CA: RAND Corporation; 2005:1-101.
- Moore GA. Crossing the chasm. New York: HarperBusiness; 1991.
- Mort D. Portable devices: mobile data could help medicine. Research Information. 2005 Feb 14. URL: http://www.researchinformation.info/rijanfeb05mort.html [accessed 2006 May 9] [WebCite Cache]
|NPS: National Physician Survey|
|PDA: Personal Digital Assistant|
Edited by G. Eysenbach; submitted 10.01.06; peer-reviewed by S Lapinsky, J Barrett; comments to author 21.01.06; revised version received 21.04.06; accepted 22.04.06; published 12.05.06
© Chantelle Garritty, Khaled El Emam. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 12.05.2006. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited, including full bibliographic details and the URL (see "please cite as" above), and this statement is included.