Published on 11.07.18 in Vol 20, No 7 (2018): July
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/9952, first published Jan 26, 2018.
How Online Communities of People With Long-Term Conditions Function and Evolve: Network Analysis of the Structure and Dynamics of the Asthma UK and British Lung Foundation Online Communities
Background: Self-management support can improve health and reduce health care utilization by people with long-term conditions. Online communities for people with long-term conditions have the potential to influence health, usage of health care resources, and facilitate illness self-management. Only recently, however, has evidence been reported on how such communities function and evolve, and how they support self-management of long-term conditions in practice.
Objective: The aim of this study is to gain a better understanding of the mechanisms underlying online self-management support systems by analyzing the structure and dynamics of the networks connecting users who write posts over time.
Methods: We conducted a longitudinal network analysis of anonymized data from 2 patients’ online communities from the United Kingdom: the Asthma UK and the British Lung Foundation (BLF) communities in 2006-2016 and 2012-2016, respectively.
Results: The number of users and activity grew steadily over time, reaching 3345 users and 32,780 posts in the Asthma UK community, and 19,837 users and 875,151 posts in the BLF community. People who wrote posts in the Asthma UK forum tended to write at an interval of 1-20 days and six months, while those in the BLF community wrote at an interval of two days. In both communities, most pairs of users could reach one another either directly or indirectly through other users. Those who wrote a disproportionally large number of posts (the superusers) represented 1% of the overall population of both Asthma UK and BLF communities and accounted for 32% and 49% of the posts, respectively. Sensitivity analysis showed that the removal of superusers would cause the communities to collapse. Thus, interactions were held together by very few superusers, who posted frequently and regularly, 65% of them at least every 1.7 days in the BLF community and 70% every 3.1 days in the Asthma UK community. Their posting activity indirectly facilitated tie formation between other users. Superusers were a constantly available resource, with a mean of 80 and 20 superusers active at any one time in the BLF and Asthma UK communities, respectively. Over time, the more active users became, the more likely they were to reply to other users’ posts rather than to write new ones, shifting from a help-seeking to a help-giving role. This might suggest that superusers were more likely to provide than to seek advice.
Conclusions: In this study, we uncover key structural properties related to the way users interact and sustain online health communities. Superusers’ engagement plays a fundamental sustaining role and deserves research attention. Further studies are needed to explore network determinants of the effectiveness of online engagement concerning health-related outcomes. In resource-constrained health care systems, scaling up online communities may offer a potentially accessible, wide-reaching and cost-effective intervention facilitating greater levels of self-management.
J Med Internet Res 2018;20(7):e238
- chronic obstructive pulmonary disease;
- network analysis;
- online community;
- online forums;
- digital health social network
Online communities have the potential to influence health and health care. Recent studies have suggested that the participation of people with long-term conditions (LTCs) in online communities (1) improves illness self-management , (2) produces positive health-related outcomes [ - ], (3) facilitates shared decision-making with health care professionals [ , ], and (4) may even reduce mortality [ ].
There is also evidence that self-management support interventions can reduce health service utilization [, ].
Online communities have experienced an upsurge in popularity among people with chronic respiratory conditions such as cystic fibrosis , asthma [ ], pulmonary hypertension [ ] and chronic obstructive pulmonary disease (COPD) [ ]. More than 15 million people in England suffer from a long-term condition or disability, and they account for at least 50 percent of all general practitioner appointments [ , ]. Thus, assessing how these online communities function and evolve can have important implications for health care provision.
This form of “user-led self-management” of LTCs bears similarities with the “expert patient” model, an approach to self-management of LTCs produced by the United Kingdom (UK) Department of Health in 2001 . Evidence of the effectiveness of conventional off-line self-management programs based on the expert patient model, though, has been weak [ ]. Clinic-based self-management programs often failed because of: (1) lack of awareness and engagement among patients and staff, (2) failure to consider low health literacy or cultural norms, (3) lack of attention to the need for family and social support, and (4) a fragmented approach to the provision of health and social care [ ]. Although online health communities can be seen as an extension of the expert patient model, network effects, in addition to the online disinhibition effect [ ], make them a distinct and unique complex intervention mechanism.
On average, one in four people with an LTC who use the Internet tries to engage online with others with similar health-related concerns . In particular, it has been suggested that the value of participating in an online community lies in the possibility of gaining access to a range of people and resources quickly, easily [ ], and anonymously [ ], as well as obtaining tailored information and emotional support [ , - ]. However, most of this evidence comes from qualitative studies [ , ], whereas only recent years have witnessed an increasing interest in quantitative assessments of online communities as intervention mechanisms [ - ]. Recent studies have been concerned with the users’ unequal contributions and engagement patterns, and with the role of superusers. However, the contribution of superusers to the sustainability of online health communities and their structural properties remains mostly unclear.
The potential future integration of online health support systems with formal health care provision should be underpinned by a better understanding of how they are used and by evidence of their effectiveness. Indeed, as suggested by the Medical Research Council , integrating online support systems with the more traditional health care provision would require the identification and comparative assessment of potential alternative intervention mechanisms.
An expanding body of literature concerned with social network analysis has examined the structural patterns of relations among interacting actors and the social mechanisms that enable them to gain access to valuable resources . There is also increasing evidence that network approaches can be applied to understanding the users’ “expertise” [ ], their interactions, and network effects on health-related outcomes in online health communities [ , ]. Uncovering the mechanisms underlying the formation of successful social networks requires a study of how online connections among people, namely the social ties or links, emerge and evolve, and how groups of individuals gradually grow in membership and become interconnected with one another. These processes of tie creation and group formation in online patients’ communities are still mostly unexplored [ ].
In this study, we performed a network analysis of the structure and dynamics of two online communities of people with LTCs. We chose the Asthma UK and the British Lung Foundation (BLF) communities as an exemplar of such communities because their users typically suffer from chronic respiratory conditions. In particular, while Asthma UK users typically suffer from a respiratory condition characterized by variable and recurring symptoms, BLF users represent a more heterogeneous population of participants affected by different diseases linked to chronic symptoms of breathlessness (eg, COPD, pulmonary fibrosis, cystic fibrosis, and lung cancer).
We aimed to uncover and understand how these communities function and evolve, and the role that some users have in maintaining integration and cohesion (seefor research questions). Ultimately, this study provides evidence for gauging the effectiveness of different interaction patterns and the users’ structural positions and their potential for enhancing and sustaining health online communities as scalable self-management support interventions.
Data were collected by HealthUnlocked , the online platform provider of the Asthma UK and BLF communities. Registered users can choose to either write posts publicly or send private posts to one another. In the latter case, posts are shared between 2 users only, whereas when posts are written publicly, a large number of users can become connected through threads of posts. Only posts that were shared publicly were collected and analyzed. For this study, user identifiers (IDs) were anonymized by HealthUnlocked, and no demographic information was collected. The data sets included posts and their metadata (ie, the anonymized user ID numbers), user roles (eg, user, administrator, or moderator), date of posting, the hierarchical level of the post within the corresponding thread, and the dates in which the users joined and left the community. Both communities were moderated, and HealthUnlocked moderators (identified through metadata linked to posts) were included in the analysis to assess their contribution and compare it with other users. Online communities on the HealthUnlocked platform benefit from additional functionalities compared to other online forums, such as built-in patient groups that moderate the content. In particular, the content accessed by users is tailored to their interests, and profiles highlight users’ condition, chosen community, medications and treatments they use or find interesting. No data were collected on participants’ characteristics, though only people declaring themselves to be older than 16 years were permitted to create an account and take part in the online communities.
We looked at the number of users, the number of posts and connections per user and posting frequency. A connection (ie, a tie, link, or edge) was established from one user to another when the former replied to a post by the latter (seefor network analysis terminology). The pattern of connections generated over time through the cumulative number of posts and replies was examined. We were interested not just in the number of posts and responses but in who responded to whom, and when. To this end, we used social network analysis [ ] to visualize and study the structure of the relationships between users. Both visualization and analysis were conducted using the Gephi software. The network analysis was carried out through additional custom computer code in python. Descriptive analysis of the networks (ie, number of users, posts, and posting frequency) were calculated using the Pandas library, an open source library providing data structures and analysis tools for the Python programming language.
As a result of the small percentage of users who wrote posts to a disproportionally high number of users, the users’ activity showed long-tailed distributions. Therefore, our analysis was based not only on means and standard deviations but also on medians.
To uncover time patterns in posting activity, we used Fourier transforms of the time series of the users’ activity , a known method used for the analysis of signals. Through Fourier transforms, we identified the frequency components, called harmonics, that together made up the posting activity stream. In other words, we regarded the posting activity over the entire observation period in both communities as a complex signal and identified the frequency components that made up such a signal. This analysis was performed using custom code in Scipy, a Python-based scientific computing library.
The “rich-club” coefficient is a metric designed to measure the extent to which well-connected users tend to connect with one another to a higher degree than expected by chance . To this end, for each value k of a node’s degree (ie, the number of other users a given user is connected with), we computed the ratio between the number of actual connections between nodes with degree k or larger and the total possible number of such connections [ ]. We then divided this ratio by the one obtained on a corresponding random network with the same number of nodes and degree distribution (ie, the probability distribution of the degrees over the whole network) as the real network, but in which links were randomly reshuffled between nodes. Thus, the rich-club coefficients may take values lower or higher than 1, depending on whether the real network has a higher or lower tendency to coalesce into rich clubs than randomly expected. In particular, networks that display a high rich-club coefficient (ie, greater than 1) are also said to show a “rich-club effect,” namely the tendency to organise into a hierarchical structure in which highly connected nodes preferentially create tightly knit groups with one another, thus generating exclusive clubs of (topologically) rich nodes, as illustrated in previous work [ ].
In our study, superusers were defined according to their cumulative activity over the entire observation period. In total, we identified 400 superusers. To uncover how many superusers were active within each week, we detected how many unique users, among the 400 identified over the entire period, were active within that time window.
Following Zhang et al , the “z-score” was used as a proxy for users’ expertise. According to this measure, replying to many questions suggests one’s expertise, while asking questions indicates lack of expertise. In our analysis, we treated anyone starting a thread as a help-seeker, and anyone commenting on the thread as a help-giver [ ]. Accordingly, the proposed z-score aims to capture the combined help-seeking and help-giving patterns. To this end, for each user, we measured how many standard deviations the observed total number of the user’s help-giving posts lies above or below the expected number of help-giving posts for the whole system. We extended the approach proposed by Zhang et al by empirically assessing the probability of posting and answering a question across all users over the entire observation period. In the BLF community, we found that the probability of answering is Pa=2/3, while the probability of posting is Pq=1/3. We assumed a Bernoulli process of posting an answer or a question to the forum, with probabilities defined as above. The z-score for a given user i was calculated according to equation (a) in , where ai refers to the total number of answers user i posted to the forum, qi is the total number of questions user i asked in the forum, and ni=ai +qi is the total number of messages posted by user i.
To obtain Zscorei, let us define a random user that posts the same total number of messages nrandom to the forum as user i (ie, nrandom=ni). We would expect this random user to post an average number of answers to the forum given by equation (b). Plugging in the value of Pa=2/3, we obtained equation (c). Similarly, we would expect the random user to post answers with a standard deviation given by equation (d). Plugging in the value of Pa=2/3, we obtained equation (e). To measure how many standard deviations above or below the expected random value a user i lies, we then computed Zscorei according to equation (f). Plugging in the values of μrandom and σrandom, we obtained equation (g). Finally, by substituting ni=ai +qi, we obtained equation (h).
Permission to research was obtained from Asthma UK and the BLF before starting the study. The research protocol was examined, and permission to research was obtained from Asthma UK, BLF charities and HealthUnlocked. The study was examined by the institutional Research Ethics board at Queen Mary University of London and was exempt from full review.
Descriptions of Data Sets
The data sets span, respectively, 10 years for the Asthma UK and 4 years for the BLF communities (see).
Despite the shorter time span, as a result of the larger number of users, the number of posts in the BLF community was higher than in Asthma UK, namely 875,151 compared to 32,780 respectively. Moreover, BLF users wrote a higher number of posts per user and were connected with a higher number of other users when compared with people in the Asthma UK forum (see). In both communities, 60%-70% of registered users wrote no posts (ie, they were lurkers). Users who wrote more than one post contributed with a median of 8 (range 2-8947) and 5 (range 2-1068) posts in the BLF and Asthma UK communities, respectively.
The number of official moderators among the highly active users was negligible; there were no moderators in the top 5% contributors to BLF and only 2 in the top 5% for Asthma UK. Thus, our network analysis predominantly reflects content originated from registered users.
When classified according to posting activity (ie, number of posts written to the forum), the top 5% users contributed to a substantial proportion of all posts: 58% and 79% in the Asthma UK and BLF communities, respectively. Superusers were those who made a high number of connections with other users in both Asthma UK and BLF communities (see nodes of large size in). Asthma UK superusers made a lower number of connections than BLF ones. The posting activity of these superusers will be analyzed in more detail in subsequent sections.
|Variables||Asthma UK||British Lung Foundation|
|Data set time span (mm/dd/yyyy)||02/03/2006-06/09/2016||13/04/2012-06/09/2016|
|Total time (weeks)||548||230|
|Total number of posts, n||32,780||875,151|
|Number of posts with reply, n (%)||28,615 (87.3)||815,184 (93.1)|
|Number of posts with no reply, n (%)||4165 (12.7)||59,967 (6.9)|
|Total number of users, n||3345||19,837|
|Users who wrote ≥1 post, n (%)||1053 (31.5)||7814 (39.4)|
|Users who wrote 1 post, n (%)||331 (31.4)||1186 (15.2)|
|Users who wrote >1 post, n (%)||722 (68.6)||6628 (84.8)|
|Registered users who never posted (ie, lurkers), n (%)||2292 (68.5)||12,023 (60.6)|
|Number of posts per user, mean (SD)||14.2 (55.0)||66.9 (75.1)|
|Number of posts per users who posted >1, median (range)||5.1 (2-1068)||8.0 (2-8947)|
|Number of posts per users who posted >1, mean (SD)||20.4 (65.6)||88.1 (458.6)|
|Posts contributed by top 1% superusers, n (%)||10,457 (31.9)||426,198 (48.7)|
|Number of connections per user, mean (SD)||2.1 (5.9)||17.6 (69.0)|
|Number of connections per user, median (SD)||1.0 (5.9)||1.0 (69.0)|
|Number of connections per top 1% superuser, mean (SD)||10.5 (16.5)||141.0 (174.0)|
|Number of connections per top 1% superuser, median (SD)||7.0 (16.5)||70.0 (174.0)|
The cumulative number of messages posted grew uniformly over time in the BLF community. By contrast, in 2015, the Asthma UK forum witnessed a substantial increase in posting activity, at a time coinciding with its move to the HealthUnlocked platform (seeA and B). This increase in activity can be attributed to the online community functionalities offered by HealthUnlocked, as described in the Methods.
The number of posts per user per week oscillated around a decreasing and an increasing trend (C and D), while at the same time the number of posts always went up over the study period ( A and B). This suggests that there were intervals of time during which the rate of increase in new users was larger than the rate of increase in total posts. Moreover, in the Asthma UK forum users wrote according to two time patterns—they posted at an interval of 1-20 days or 6 months ( A), while those in the BLF community at an interval of 2 days ( B).
As more users joined the communities and connected to one another through online posts, distinct groups of connected users started to emerge. These groups, called network components (see), have fundamental implications for the effectiveness of processes of network dynamics such as information diffusion [ ]. In a relatively short period, both communities underwent the formation of the “largest component” of connected users, namely a connected subset of users whose size increasingly outgrew the size of all other components (see and , and and ). The largest connected components in both communities included 60%-100% of users.
suggests that, as time went by, the number of forum participants and their posting activity increased, and the proportion of users who were part of the largest components decreased. This finding was expected because the number of posts also rose exponentially, yet at times at a lower rate than the one at which new users joined the communities (see C and D). It, therefore, became more difficult for the network to self-organize into a connected component that would include 100% of the users. A also shows that around week 450, when the forum moved to the HealthUnlocked platform, a larger fraction of users began to join the largest connected component, thus highlighting the role that the new online platform played in strengthening the connectedness of the network (see also A and B).
Superusers represented a small minority (ie, 1%-5%) within both communities but were responsible for a high proportion of the posting activity and the functioning of the communities.
Sensitivity analysis showed that the removal of users with the largest number of connections caused the largest component to collapse (see), thus suggesting that both communities and lines of communication within them were held together precisely by these highly connected users. In online communities, the existence of groups of highly connected users is critical for information diffusion [ ].
suggests that it only takes the removal of the top 5% users by degree of connectivity for the largest connected component to collapse to 10% and 50% of its original size in the Asthma UK and BLF communities, respectively. This corresponds to the removal of about 50 and 400 users in the 2 communities, respectively. These results shed light on how many superusers are needed to sustain discussions and to serve the needs of users in large communities of people with LTCs.
Superusers and the Rich-Club Effect
Both Asthma UK and BLF communities were characterized by a low rich-club coefficient, which was consistently lower than 1 (see). This anti-rich-club behavior, namely the tendency to run counter to the formation of a rich club, suggests that in both communities highly connected superusers preferentially communicated with poorly connected ones or, alternatively, that superusers tended to avoid each other and instead communicated with those who were only connected with very few others.
Anti-rich-club behavior may suggest competition between superusers or merely the organization of the communities into groups of users characterized by different degrees of “expertise” or commitment: one group including the few committed experts and another including the vast majority of those seeking information when needed. It would, therefore, come as no surprise if the former were to communicate with the latter to a greater extent than randomly expected. We shall investigate this hypothesis further below.
Involvement of Superusers Over Time
We have shown that the connectedness of both communities depends crucially on the presence and activities of superusers, who committed a significant amount of their time to writing posts and targeting new users. We now look at whether their activity was concentrated in relatively short periods of time or instead it was uniformly distributed over time. How superusers’ involvement is distributed over time may have fundamental implications for the cohesion of the whole system precisely in light of the role these users play.
suggests that there was no scarcity of superusers throughout the whole period of observation. In particular, the number of superusers in the Asthma UK community remained stable across almost the entire period until it increased substantially when the forum moved to the HealthUnlocked platform in 2015. Since then about twenty superusers have been active in the forum. On the other hand, in the BLF community the number of unique superusers increased steadily over the first 50 weeks (1 year) since inception (2015), and subsequently there were about 80-100 superusers regularly engaged with the community.
Superusers’ Posting Activity
We then investigated whether superusers’ posting activity was frequent and regular over time. To this end, for each of the top 5% users by post contribution, calculated cumulatively over the entire observation period, we measured the time interval separating every two subsequent posts to both communities. We then computed the inter-event time distributions for both communities to assess frequency and patterns of activity.suggests that 70% of interposting times were shorter than 3.1 days in the Asthma UK community, while 65% of interposting times in the BLF community were shorter than 1.7 days.
For each user, a z-score was calculated in both communities to gauge the user’s expertise (see Data Analysis section).suggests that the more users became active in the communities, the more likely they were to write posts (assumed to be “help-giving” posts) [ , ] than to start new threads (assumed to be “help-seeking” posts). Such a finding might indicate that superusers were also those with the necessary degree of expertise to answer a large number of questions.
Thus, superusers not only play a topologically important role in the communities, but they are also likely to provide the expertise needed to answer queries.
Ego Networks of Superusers
Next, we examine whether the ego networks of different types of users were topologically different, and what generated such differences. Users commonly started a discussion thread by writing a root post (ie, the post at level 1 of the thread). Several users could then directly respond to these posts at level 1, thus creating level-2 posts. More generally, according to the design of the communities, by posting a response to a level–(t) post, users created a level–(t+1) post. There was no limitation to how a post thread could evolve, and therefore to the complexity of the thread hierarchy. Information on post levels was made available through the post metadata. In our analysis, any post at level 2 or higher was classified as a level–2+ post. Here the analysis was restricted to the BLF forum, as the Asthma UK community was significantly smaller with simpler hierarchical levels.
A and B show the ego networks of two types of users: one where the help-seeker, called root poster, contributed back multiple times to the thread itself, and the other where this pattern did not happen. In both cases, the thread received similar community engagements in terms of responses from other users. B suggests that the highly active root poster developed a more cohesive network, rich in third-party relationships. In this ego network, many alters indeed connected with one another, thus creating closed triads centered on ego. In simple words, these users’ posting activity had the effect of making other users talk to each other, thus increasing integration and cohesion within the community. By contrast, the ego network developed by the root poster characterized by a lower contribution to the thread ( A) had a star-like shape and was rich in structural cleavages between alters. In this ego network, alters were disconnected from each other, and ego acted as the broker enabling indirect connections between alters. In simple words, these users did not favor connections between other users.
By replying to other users’ posts, superusers contributed significantly to level 2 or above.C shows that there was a significant correlation between the number of triads in an ego network and the number of times ego (the root poster) contributed to the thread itself. The correlation coefficient between the number of triads and the number of posts at level 2 or above written by the top 5% of users by post contribution is 0.44 (P<.001).
When root posters responded back to the posts received, they created a more cohesive network structure. Most of these highly active users were superusers. This suggests that superusers, by posting “help-giving” posts, enabled other users to talk to each other, thus facilitating the formation of ties between them.
Summary of Main Findings
In this study, we applied network analysis to two online communities for patients with chronic respiratory conditions to shed light on potential structural mechanisms underlying the role of these communities as scalable, peer-to-peer self-management support intervention systems. We found that the number of users and posts increased steadily over the years in the period of analysis. The majority of users were mutually reachable, either directly or indirectly, and formed a large connected component, which underlies the strength of the network as a means for widespread diffusion of information.
Superusers played a central role in these communities as a result of the characteristics of their posting activity and their constant online engagement. They preferentially replied to posts from peripheral users who were not equally well connected. In doing so, they additionally facilitated tie formation between users. Sensitivity analysis showed that gradual removal of superusers induced the network to collapse. Thus, superusers were responsible for holding the network together and, in particular, for ensuring the emergence of a large connected component. As a result, without superusers, there would be no effective spread of information within the community. Superusers acted as a continuously available resource over time. As users became more active within the community, they became more likely to reply to posts than to ask questions. This suggests that superusers gradually became “experts” providing others with advice and support, which is in agreement with what has recently been suggested by other qualitative studies [, ].
Strengths and Limitations
Based on social network analysis, this work has started elucidating crucial mechanisms underlying the potential of online health communities to promote effective self-management support interventions, in particular regarding the role of superusers in sustaining and providing integration and cohesion to the network. By analyzing the communities over more than five years, we have shown that superusers are a resource naturally present, able to sustain a network and make it thrive over time. This could prompt future studies to understand their role as a potential scalable health care workforce .
Limitations of this study include the lack of demographic and clinical information of participants as well as verification and validation of the information shared online , although previous qualitative work by the authors has identified Asthma UK superusers as adolescents with asthma [ ]. Moreover, findings were not validated through the semantic analysis of the posts.
We did not investigate the reasons explaining the oscillating number of posts per user per week in the 2 communities, nor the time patterns of posting activity, nor the higher and regular number of posts of BLF users compared with Asthma UK ones. Time patterns of posting activity may reflect the nature of symptoms of the underlying lung conditions (see). In particular, the uniformity of posting activity of BLF users might reflect daily self-management activities, whereas the time patterns uncovered for Asthma UK users might reflect self-management activities triggered by episodic exacerbations of symptoms.
More research is also needed to explore the mechanisms sustaining the effectiveness of health online communities and online engagement  in terms of the users’ quality of life and, more generally, the generation of beneficial health-related outcomes [ ]. The role of superusers in the spread of information within online communities calls for further research to investigate how they can improve quality of information and reduce any potential harm [ ]. Future work along these lines will integrate available evidence that incorrect or misleading information is, in many cases, efficiently corrected by peers [ , ]. Moreover, recent research has suggested that leveraging superusers to promote users’ online engagement may not achieve improved health-related outcomes, at least in connection with smoking cessation [ ]. More qualitative work should, therefore, shed light on the role of superusers as actual providers of help and advice to other users.
Finally, 90% of people accessing patients’ online communities are passive readers who do not engage in online discussions [, ]. This means that the number of registered users who post in the forum may represent only 10% of the people who access the community. However, how this large majority of patients that passively access patients’ online communities can benefit from reading others’ posts requires further investigation [ ]. In particular, it remains unclear whether passive users can improve their self-management and other health-related behaviors, although previous work has shown that participation in online communities can increase passive users’ sense of belonging [ ]. Change in behaviors of passive readers needs to be fully accounted for to examine the cost-effectiveness of peer-based online support interventions, compared with more traditional intervention tools. Moreover, it remains to be investigated whether there are variations in cost-effectiveness across active users and sub-groups of them with different patterns of social ties [ ].
Comparison With Related Work
Previous studies on medical online communities agree that users can benefit from the emotional support as well as the cumulative experiential information provided by others [, , ]. The value of online self-management support lies in the availability of co-created experiential knowledge and the presence of distributed health literacy. This enables users to find the information they require to manage their condition, and thus allows them to benefit from the health literacy of others in the network [ ].
A qualitative study that was performed on a forum of people with stroke has shown that up to 95% of users’ intents for writing posts were met by replies . In agreement with previous reports [ ], we found that superusers represented a small proportion of the users in both communities, though they contributed to a considerable proportion of the overall posts. Superusers were members who assumed leadership roles by providing support, advice, and direction to other members [ , ].
This is in qualitative agreement with recent work on an online community for people with stroke, where superusers were shown to play an essential role in nurturing the ability of the forum to provide feedback and identify inappropriate information and health behaviors in the context of secondary prevention medications . Interestingly, a related study using linguistic analysis showed that as users’ engagement in the community increased, their use of language changed. For example, it has been documented that the frequency of imperative verbs rose steadily through membership length, as superusers explicitly directed new members to do certain things [ ].
Finally, superusers’ engagement with the online community and their daily commitment raise questions about what motivates their behavior. Recent work has suggested that their behavior can be motivated by perceived improvements in sense of well-being . Thus, superusers can themselves profit from their engagement with online health communities. However, what remains to be investigated is whether and to what extent spending so much time in online health communities might be detrimental to superusers’ self-management.
Implications for Policy, Practice, and Research
As a result of the voluntary basis of users' contributions, self-management support through online health communities offers high potential for cost-effectiveness from the perspective of formal services. Current health care challenges  include supporting self-care and management of LTCs. A key to future changes in models of health and social care are the expansion of health services offered locally as well an increasing role for patient self-management of LTCs. Initiatives to improve access to care in the community include expanding health care team to incorporate more allied health care professionals [ ]. The benefits of self-management have not been realized through conventional face-to-face channels [ ]. Could superusers represent an allied health care workforce, providing a means for health and social care integration? The impact and benefit of this novel approach could be huge and include: (a) increasing the confidence of a large number of people to self-care, (b) reducing demand on general practices [ ], emergency care services and hospitals, and (c) saving money within health care systems, and across society as a whole. The potential scale of societal benefits would likely outweigh the opportunity costs associated with the time contributed by users. Understanding the mechanisms underlying effectiveness and uncovering how online communities are organized and evolve are vital preludes to developing and testing effective interventions and are required by the Medical Research Council Complex Interventions Framework [ ]. However, little work has addressed this area to date. Although there is evidence that highly engaged users play a role as active help-providers to other users [ ], this is to our knowledge the first study showing that superusers in online health communities: (1) are responsible for holding the community together, (2) engage with other users with low posting activity, and (3) indirectly contribute to tie formation between other users.
This work has drawn on social network analysis to uncover fundamental mechanisms underlying the potential of online communities to promote effective self-management support interventions. In particular, our study contributes to a better understanding of the role played by superusers in sustaining and providing integration and cohesion to the network. By analyzing the communities over more than five years, we have shown that superusers can sustain and make the network thrive over time. The presence of both a large connected component and superusers is a crucial feature of successful health communities. It is well known that components are critical for information diffusion [, ]. Without a large connected component, users would be members of small isolated islands, and information would be unable to flow from one island to another. An online community needs a large component to function effectively. As edges between users are added over time, a large component is likely to emerge [ ]. Our work has shown not only that superusers play a critical role in the emergence of a connected component, but also that, even without being “appointed” externally, superusers would emerge as the community grows large enough. Our findings will, therefore, prompt and inform future research interested in understanding superusers’ role as a potential scalable health care workforce in online self-management support interventions [ , ].
Moreover, our study has uncovered temporal patterns of posting activity. This will prompt further research aimed at investigating differences in these patterns across communities using qualitative analysis. This would include the analysis of whether users’ intents were met by replies  and the potential correlation between the amount of time spent online and improved disease self-management.
Across a variety of empirical domains, it has been documented that hubs (ie, nodes with a disproportionally large number of connections) are valuable resources that help spread information widely and amplify information cascades , help design effective vaccination campaigns and selective immunization strategies against disease diffusion and epidemics [ , ], and help improve the system’s robustness and vulnerability to random failures [ ]. Here we have shown that health online communities are no exception. Our results suggest that superusers indeed represent a crucial resource for the integration and functioning of such communities, which therefore seem to be governed by the same network mechanisms as other real-world networks. This study will, therefore, inform future research interested in uncovering the common organizing principles underpinning a variety of real-world systems.
This study shows that patients’ online communities share the same network features as other complex networks across a variety of empirical domains. Our analysis highlighted the special role played by superusers, their topological positions and behavior in the communities. In this sense, our results shed light on the topological mechanisms underlying the ability of patients’ online communities to provide self-management support and may, therefore, suggest levers for improving the quality of health care intervention.
At a time when health care services are working beyond capacity and patients are finding it difficult to access care, online communities provide the potential for addressing critical health care challenges. They offer a feasible way for patients with LTCs to find helpful advice and support, and a potentially cost-effective and scalable solution to the vast and rising costs associated with long-term disease management. Even though our results showed that there was no scarcity of superusers throughout the whole period of the study, nonetheless ensuring that such networks will become a core component of illness self-management on a broader scale requires proper research investment leading to randomized control studies and potentially a change in the concept of the health care team.
We would like to thank Asthma UK and British Lung Foundation for granting the permission to conduct the study. This study was funded by a Queen Mary University of London Life Science Initiative grant (supported by the Wellcome Trust Institutional Strategic Support Fund). ADS is funded by a National Institute for Health Research Academic Clinical Lectureship.
ADS conceived the study, contributed to the data analysis and interpretation and wrote the manuscript together with PP and SJ. SJ conducted the social network analysis under the guide of PP and NS. PP, NC, SJCT, AP, AS, RD, AA, and MJE are coinvestigators on the study and contributed to the interpretation of findings. CJG contributed to the design of the analysis and interpretation of findings. All authors commented and agreed on the final draft of the submitted manuscript.
Conflicts of Interest
The views expressed are those of the author(s) and not necessarily those of the National Health Service, the National Institute for Health Research or the Department of Health. The funder had no role in study design, data collection, data analysis, data interpretation, the writing of the manuscript, and decision to submit the manuscript for publication. MJE is the cofounder, and chief medical officer of HealthUnlocked and AA is a research officer at HealthUnlocked.
Multimedia Appendix 1
Asthma UK cumulative activity over the analysis time frame.MP4 File (MP4 Video), 856KB
Multimedia Appendix 2
British Lung Foundation cumulative activity over the analysis time frame.MP4 File (MP4 Video), 5MB
- Allen C, Vassilev I, Kennedy A, Rogers A. Long-Term Condition Self-Management Support in Online Communities: A Meta-Synthesis of Qualitative Papers. J Med Internet Res 2016;18(3):e61 [FREE Full text] [CrossRef] [Medline]
- Nesta. Peer Support: What is it and does it work? Summarising evidence from more than 1000 studies, 2015 URL: https://www.nationalvoices.org.uk/sites/default/files/public/publications/peer_support_-_what_is_it_and_does_it_work.pdf [WebCite Cache]
- Mo PKH, Coulson NS. Developing a model for online support group use, empowering processes and psychosocial outcomes for individuals living with HIV/AIDS. Psychol Health 2012;27(4):445-459. [CrossRef] [Medline]
- Pendry L, Salvatore J. Individual and social benefits of online discussion forums. Computers in Human Behavior 2015;50:211-220.
- Bartlett YK, Coulson NS. An investigation into the empowerment effects of using online support groups and how this affects health professional/patient communication. Patient Educ Couns 2011 Apr;83(1):113-119. [CrossRef] [Medline]
- Izuka NJ, Alexander MAW, Balasooriya-Smeekens C, Mant J, De Simoni A. How do stroke survivors and their carers use practitioners' advice on secondary prevention medications? Qualitative study of an online forum. Fam Pract 2017 Sep 01;34(5):612-620. [CrossRef] [Medline]
- Hobbs WR, Burke M, Christakis NA, Fowler JH. Online social integration is associated with reduced mortality risk. Proc Natl Acad Sci U S A 2016 Dec 15;113(46):12980-12984 [FREE Full text] [CrossRef] [Medline]
- Panagioti M, Richardson G, Small N, Murray E, Rogers A, Kennedy A, et al. Self-management support interventions to reduce health care utilisation without compromising outcomes: a systematic review and meta-analysis. BMC Health Serv Res 2014;14:356 [FREE Full text] [CrossRef] [Medline]
- Taylor SJ, Pinnock H, Epiphaniou E, Pearce G, Parke HL, Schwappach A, et al. A rapid synthesis of the evidence on interventions supporting self-management for people with long-term conditions: PRISMS – Practical systematic Review of Self-Management Support for long-term conditions. Health Serv Deliv Res 2014;2(53):1-580. [Medline]
- Kirk S, Milnes L. An exploration of how young people and parents use online support in the context of living with cystic fibrosis. Health Expect 2015 Feb 17:309-321. [CrossRef] [Medline]
- Stewart M, Letourneau N, Masuda JR, Anderson S, McGhan S. Online solutions to support needs and preferences of parents of children with asthma and allergies. J Fam Nurs 2011;17(3):357-379. [CrossRef] [Medline]
- Matura LA, McDonough A, Aglietti LM, Herzog JL, Gallant KA. A virtual community: concerns of patients with pulmonary hypertension. Clin Nurs Res 2013 May;22(2):155-171. [CrossRef] [Medline]
- Wentzer HS, Bygholm A. Narratives of empowerment and compliance: studies of communication in online patient support groups. Int J Med Inform 2013 Dec;82(12):e386-e394. [CrossRef] [Medline]
- London: Department of Health. 2012. Long Term Conditions Compendium of Information, 3rd ed URL: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/216528/dh_134486.pdf [accessed 2018-06-29] [WebCite Cache]
- De Simoni A, Griffiths CJ, Taylor SJ. Improving access to primary care: can online communities contribute? Br J Gen Pract 2016 Nov;66(652):559 [FREE Full text] [CrossRef] [Medline]
- The expert patient: a new approach to chronic disease management in the 21st century. Londontationery Office, 2001 URL: http://webarchive.nationalarchives.gov.uk/20120511062115/http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/documents/digitalasset/dh_4018578.pdf [accessed 2018-05-13] [WebCite Cache]
- Griffiths C, Foster G, Ramsay J, Eldridge S, Taylor S. How effective are expert patient (lay led) education programmes for chronic disease? BMJ 2007 Jun 16;334(7606):1254-1256 [FREE Full text] [CrossRef] [Medline]
- Greenhalgh T. Patient and public involvement in chronic illness: beyond the expert patient. BMJ 2009 Feb 17;338:b49. [Medline]
- Suler J. The online disinhibition effect. Cyberpsychol Behav 2004 Jun;7(3):321-326. [CrossRef] [Medline]
- Fox S. 2011 URL: http://www.pewInternet.org/Reports/2011/Social-Life-of-Health-Info/Summary-of-Findings.aspx [accessed 2018-05-28] [WebCite Cache]
- Armstrong A, Hagel J. Knowledge and communities. 2000. The real value of online communities URL: https://linkinghub.elsevier.com/retrieve/pii/B9780750672931500093 [accessed 2018-06-29] [WebCite Cache]
- De Simoni A, Shanks A, Balasooriya-Smeekens C, Mant J. Stroke survivors and their families receive information and support on an individual basis from an online forum: descriptive analysis of a population of 2348 patients and qualitative study of a sample of participants. BMJ Open 2016 Apr 06;6(4):e010501 [FREE Full text] [CrossRef] [Medline]
- Coulson NS. Receiving social support online: an analysis of a computer-mediated support group for individuals living with irritable bowel syndrome. Cyberpsychol Behav 2005 Dec;8(6):580-584. [CrossRef] [Medline]
- Shoebotham A, Coulson NS. Therapeutic Affordances of Online Support Group Use in Women With Endometriosis. J Med Internet Res 2016 May 09;18(5):e109 [FREE Full text] [CrossRef] [Medline]
- De Simoni A, Horne R, Fleming L, Bush A, Griffiths C. What do adolescents with asthma really think about adherence to inhalers? Insights from a qualitative analysis of a UK online forum. BMJ Open 2017 Jun 13;7(6):e015245 [FREE Full text] [CrossRef] [Medline]
- Ennis-O’Connor M. BMJ Blog. 2014. How online patient communities are changing the face of cancer care URL: http://blogs.bmj.com/ebn/2014/03/03/how-online-patient-communities-are-changing-the-face-of-cancer-care/ [accessed 2018-01-15] [WebCite Cache]
- Ali K, Farrer L, Gulliver A, Griffiths KM. Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review. JMIR Ment Health 2015;2(2):e19 [FREE Full text] [CrossRef] [Medline]
- Carron-Arthur B, Cunningham J, Griffiths K. Describing the distribution of engagement in an Internet support group by post frequency: A comparison of the 90-9-1 Principle and Zipf's Law. Internet Interventions 2014;1(4):165-168 [FREE Full text]
- van Mierlo T, Hyatt D, Ching AT. Mapping Power Law Distributions in Digital Health Social Networks: Methods, Interpretations, and Practical Implications. J Med Internet Res 2015;17(6):e160 [FREE Full text] [CrossRef] [Medline]
- van Mierlo T, Hyatt D, Ching AT. Employing the Gini coefficient to measure participation inequality in treatment-focused Digital Health Social Networks. Netw Model Anal Health Inform Bioinform 2016;5(1):32 [FREE Full text] [CrossRef] [Medline]
- Carron-Arthur B, Reynolds J, Bennett K, Bennett A, Cunningham JA, Griffiths KM. Community Structure of a Mental Health Internet Support Group: Modularity in User Thread Participation. JMIR Ment Health 2016;3(2):e20 [FREE Full text] [CrossRef] [Medline]
- Gopalsamy R, Semenov A, Pasiliao E, McIntosh S, Nikolaev A. Engagement as a Driver of Growth of Online Health Forums: Observational Study. J Med Internet Res 2017 Aug 29;19(8):e304 [FREE Full text] [CrossRef] [Medline]
- Urbanoski K, van Mierlo T, Cunningham J. Investigating Patterns of Participation in an Online Support Group for Problem Drinking: a Social Network Analysis. Int.J. Behav. Med 2016 Aug 22;24(5):703-712. [CrossRef]
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655 [FREE Full text] [Medline]
- Burt RS. The network structure of social capital. Research in Organizational Behavior 2000;22:345-423.
- Zhang J, Ackerman M, Lada A. Expertise networks in online communities: structure and algorithms. In: Proceedings of the 16th international conference on World Wide Web. 2007 Presented at: WWW 2007; May 8-12 2007; Banff, Alberta, Canada. [CrossRef]
- Zhao K, Wang X, Cha S, Cohn AM, Papandonatos GD, Amato MS, et al. A Multirelational Social Network Analysis of an Online Health Community for Smoking Cessation. J Med Internet Res 2016 Aug 25;18(8):e233 [FREE Full text] [CrossRef] [Medline]
- Song. Collaborative friendship networks in online healthcare communities: an exponential random graph model analysis. In: Smart Health: International Conference, ICSH 2014, July 10-11, 2014. Proceedings (Lecture Notes in Computer Science). Beijing, China: Springer; 2014.
- HealthUnlocked. The social network for health. URL: https://healthunlocked.com/ [accessed 2018-06-29] [WebCite Cache]
- Wasserman S, Faust K, Granovetter M. Social Network Analysis: Methods and Applications. Cambridge: Cambridge University Press; 1994.
- Hawe P, Webster C, Shiell A. A glossary of terms for navigating the field of social network analysis. J Epidemiol Community Health 2004 Dec;58(12):971-975 [FREE Full text] [CrossRef] [Medline]
- Panzarasa P, Bonaventura M. Emergence of long-range correlations and bursty activity patterns in online communication. Phys Rev E Stat Nonlin Soft Matter Phys 2015 Dec;92(6):062821. [CrossRef] [Medline]
- Colizza V, Flammini A, Serrano MA, Vespignani A. Detecting rich-club ordering in complex networks. Nat Phys 2006 Jan 15;2(2):110-115. [CrossRef]
- van Mierlo T. The 1% rule in four digital health social networks: an observational study. J Med Internet Res 2014;16(2):e33 [FREE Full text] [CrossRef] [Medline]
- Carron-Arthur B, Reynolds J, Bennett K, Bennett A, Griffiths KM. What's all the talk about? Topic modelling in a mental health Internet support group. BMC Psychiatry 2016 Oct 28;16(1):367 [FREE Full text] [CrossRef] [Medline]
- Panzarasa P, Bonaventura M. Emergence of long-range correlations and bursty activity patterns in online communication. Phys Rev E Stat Nonlin Soft Matter Phys 2015 Dec;92(6):062821. [CrossRef] [Medline]
- Opsahl T, Colizza V, Panzarasa P, Ramasco JJ. Prominence and control: the weighted rich-club effect. Phys Rev Lett 2008 Oct 17;101(16):168702. [CrossRef] [Medline]
- Zhou S, Mondragon R. The Rich-Club Phenomenon in the Internet Topology. IEEE Commun. Lett 2004 Mar;8(3):180-182. [CrossRef]
- Newman M. Newman. In: Networks: An Introduction. Oxford: Oxford University Press, USA; 2010.
- Yagan O, Qian D, Zhang J, Cochran D. Conjoining Speeds up Information Diffusion in Overlaying Social-Physical Networks. IEEE J. Select. Areas Commun 2013 Jun;31(6):1038-1048. [CrossRef]
- McDonald D, Woodward-Kron R. Member roles and identities in online support groups: Perspectives from corpus and systemic functional linguistics. Discourse & Communication 2016;10(2):157-175 [FREE Full text]
- van Mierlo T, Li X, Hyatt D, Ching AT. Demographic and Indication-Specific Characteristics Have Limited Association With Social Network Engagement: Evidence From 24,954 Members of Four Health Care Support Groups. J Med Internet Res 2017 Feb 17;19(2):e40 [FREE Full text] [CrossRef] [Medline]
- Iriberri A, Leroy G. A life-cycle perspective on online community success. ACM Comput. Surv 2009 Feb 01;41(2):1-29. [CrossRef]
- Park A, Conway M. Longitudinal Changes in Psychological States in Online Health Community Members: Understanding the Long-Term Effects of Participating in an Online Depression Community. J Med Internet Res 2017 Mar 20;19(3):e71 [FREE Full text] [CrossRef] [Medline]
- Mo PKH, Coulson NS. Are online support groups always beneficial? A qualitative exploration of the empowering and disempowering processes of participation within HIV/AIDS-related online support groups. Int J Nurs Stud 2014 Jul;51(7):983-993. [CrossRef] [Medline]
- Esquivel A, Meric-Bernstam F, Bernstam EV. Accuracy and self correction of information received from an internet breast cancer list: content analysis. BMJ 2006 Apr 22;332(7547):939-942 [FREE Full text] [CrossRef] [Medline]
- Graham AL, Papandonatos GD, Cha S, Erar B, Amato MS, Cobb NK, et al. Improving Adherence to Smoking Cessation Treatment: Intervention Effects in a Web-Based Randomized Trial. Nicotine Tob Res 2017 Mar 01;19(3):324-332. [CrossRef] [Medline]
- Burri M, Baujard V, Etter J. A qualitative analysis of an internet discussion forum for recent ex-smokers. Nicotine Tob Res 2006 Dec;8 Suppl 1:S13-S19. [Medline]
- Mo PKH, Coulson NS. Empowering processes in online support groups among people living with HIV/AIDS: A comparative analysis of lurkers and posters. Computers in Human Behavior 2010;26(5):1183-1193 [FREE Full text]
- Nonnecke B, Preece J. Shedding light on lurkers in online communities. In: Ethnographic Studies in Real and Virtual Environments: Inhabited Information Spaces and Connected Communities. Edinburgh: Ed. K. Buckner; 1999:123-128.
- Konchak C, Prasad K. Incorporating social network effects into cost-effectiveness analysis: a methodological contribution with application to obesity prevention. BMJ Open 2012 Oct;2(6):1-11 [FREE Full text] [CrossRef] [Medline]
- Loane SS, D'Alessandro S. Peer-to-peer value through social capital in an online motor neuron disease community. J Nonprofit Pub Sect Mark 2013;25(2):164-185 [FREE Full text]
- Matura LA, McDonough A, Aglietti LM, Herzog JL, Gallant KA. A virtual community: concerns of patients with pulmonary hypertension. Clin Nurs Res 2013 May;22(2):155-171. [CrossRef] [Medline]
- van Mierlo T, Voci S, Lee S, Fournier R, Selby P. Superusers in social networks for smoking cessation: analysis of demographic characteristics and posting behavior from the Canadian Cancer Society's smokers' helpline online and StopSmokingCenter.net. J Med Internet Res 2012;14(3):e66 [FREE Full text] [CrossRef] [Medline]
- Carron-Arthur B, Ali K, Cunningham JA, Griffiths KM. From Help-Seekers to Influential Users: A Systematic Review of Participation Styles in Online Health Communities. J Med Internet Res 2015;17(12):e271 [FREE Full text] [CrossRef] [Medline]
- NHS England. 2017. NHS Five year forward view URL: https://www.england.nhs.uk/wp-content/uploads/2017/03/NEXT-STEPS-ON-THE-NHS-FIVE-YEAR-FORWARD-VIEW.pdf [accessed 2018-05-13] [WebCite Cache]
- Primary Care Workforce Commission. Health Education England. 2015. The future of primary care: creating teams for tomorrow URL: https://www.hee.nhs.uk/sites/default/files/documents/The%20Future%20of%20Primary%20Care%20report.pdf [WebCite Cache]
- Lambiotte R, Panzarasa P. Communities, knowledge creation, and information diffusion. Journal of Informetrics 2009 Jul;3(3):180-190. [CrossRef]
- Leskovec J, Kleinberg J, Faloutsos C. Graphs over time: densification laws, shrinking diameters and possible explanations. 2005 Presented at: KDD '05 Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining; August 21–24, 2005; Chicago p. 177-187 URL: https://www.cs.cornell.edu/home/kleinber/kdd05-time.pdf
- Pagoto S, Waring ME, May CN, Ding EY, Kunz WH, Hayes R, et al. Adapting Behavioral Interventions for Social Media Delivery. J Med Internet Res 2016;18(1):e24 [FREE Full text] [CrossRef] [Medline]
- Bakshy E, Hofman J, Mason A, Watts D. Everyone's an influencer: quantifying influence on Twitter. 2011 Presented at: Proceedings of the fourth ACM International Conference on Web searchdata mining (WSDM 11). New York: ACM; February 09 - 12, 2011; Hong Kong, China p. 65-74. [CrossRef]
- Dezso Z, Barabási A. Halting viruses in scale-free networks. Phys Rev E Stat Nonlin Soft Matter Phys 2002 May;65(5 Pt 2):055103. [CrossRef] [Medline]
- Pastor-Satorras R, Vespignani A. Immunization of complex networks. Phys Rev E Stat Nonlin Soft Matter Phys 2002 Mar;65(3 Pt 2A):036104. [CrossRef] [Medline]
- Paul G, Sreenivasan S, Stanley HE. Resilience of complex networks to random breakdown. Phys Rev E Stat Nonlin Soft Matter Phys 2005 Nov;72(5 Pt 2):056130. [CrossRef] [Medline]
|BLF: British Lung Foundation|
|COPD: chronic obstructive pulmonary disease|
|LTC: long-term condition|
Edited by G Eysenbach; submitted 26.01.18; peer-reviewed by T van Mierlo, G Papandonatos, K Tingay; comments to author 15.02.18; revised version received 10.04.18; accepted 12.05.18; published 11.07.18
©Sagar Joglekar, Nishanth Sastry, Neil S Coulson, Stephanie JC Taylor, Anita Patel, Robbie Duschinsky, Amrutha Anand, Matt Jameson Evans, Chris J Griffiths, Aziz Sheikh, Pietro Panzarasa, Anna De Simoni. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 11.07.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.