Background: This is a case study from an HIV prevention project among young black men who have sex with men. Individual-level prevention interventions have had limited success among young black men who have sex with men, a population that is disproportionately affected by HIV; peer network–based interventions are a promising alternative. Facebook is an attractive digital platform because it enables broad characterization of social networks. There are, however, several challenges in using Facebook data for peer interventions, including the large size of Facebook networks, difficulty in assessing appropriate methods to identify candidate peer change agents, boundary specification issues, and partial observation of social network data.
Objective: This study aimed to explore methodological challenges in using social Facebook networks to design peer network–based interventions for HIV prevention and present techniques to overcome these challenges.
Methods: Our sample included 298 uConnect study respondents who answered a bio-behavioral survey in person and whose Facebook friend lists were downloaded (2013-2014). The study participants had over 180,000 total Facebook friends who were not involved in the study (nonrespondents). We did not observe friendships between these nonrespondents. Given the large number of nonrespondents whose networks were partially observed, a relational boundary was specified to select nonrespondents who were well connected to the study respondents and who may be more likely to influence the health behaviors of young black men who have sex with men. A stochastic model-based imputation technique, derived from the exponential random graph models, was applied to simulate 100 networks where unobserved friendships between nonrespondents were imputed. To identify peer change agents, the eigenvector centrality and keyplayer positive algorithms were used; both algorithms are suitable for identifying individuals in key network positions for information diffusion. For both algorithms, we assessed the sensitivity of identified peer change agents to the imputation model, the stability of identified peer change agents across the imputed networks, and the effect of the boundary specification on the identification of peer change agents.
Results: All respondents and 78.9% (183/232) of nonrespondents selected as peer change agents by eigenvector on the imputed networks were also selected as peer change agents on the observed networks. For keyplayer, the agreement was much lower; 42.7% (47/110) and 35.3% (110/312) of respondent and nonrespondent peer change agents, respectively, selected on the imputed networks were also selected on the observed network. Eigenvector also produced a stable set of peer change agents across the 100 imputed networks and was much less sensitive to the specified relational boundary.
Conclusions: Although we do not have a gold standard indicating which algorithm produces the most optimal set of peer change agents, the lower sensitivity of eigenvector centrality to key assumptions leads us to conclude that it may be preferable. The methods we employed to address the challenges in using Facebook networks may prove timely, given the rapidly increasing interest in using online social networks to improve population health.
Social network interventions have been successful in improving health outcomes [- ], including those related to HIV prevention [ - ]. Our ongoing research aims to design social network interventions to reduce new HIV infections among young black men who have sex with men (YBMSM), defined here as individuals aged between 16 and 29 years. YBMSM are disproportionately impacted by the HIV epidemic in the United States [ ], and traditional individual-level epidemiological interventions have had limited success in reducing HIV infections among YBMSM [ , ]. Peer-based interventions that make use of social networks have improved HIV outcomes in some populations [ - ] and present a promising opportunity to improve HIV outcomes among YBMSM. Here, we study how such a peer network–based intervention, which aims to expand the use of pre-exposure prophylaxis (PrEP)—a novel biomedical intervention with an estimated efficacy of over 90% among adherent individuals [ , ]—can be developed. PrEP remains underutilized among YBMSM, prompting a need to identify creative techniques to increase its use. Our objective here is to use online social network data from Facebook to identify influencers who could most effectively disseminate PrEP-related information among YBMSM in Chicago and to explore the methodological challenges that arise in the identification of these influential agents.
Setting and Context
We use Facebook data from the uConnect cohort—the largest single-site population-based sample of YBMSM—to identify peer change agents (PCAs) who occupy critical positions in the social network. In future work, these PCAs will be invited to participate in training on how to effectively disseminate PrEP information. Although the use of alternate social networking sites has proliferated, Facebook remains an attractive choice because it is the most widely used social platform . To identify PCAs, our population of interest is the potential influencers of YBMSM, who may or may not be YBMSM themselves, and Facebook enables broad characterization of their social networks.
We use a digital platform to characterize the social networks of YBMSM because despite demonstrating early promise, peer-based HIV interventions have had limited effect in some populations . It has been argued that using digital methods to compile more accurate social network data and applying formal network analyses to identify PCAs may improve the efficacy of peer interventions [ ]. As a digital platform, Facebook’s potential for improving health behaviors has been demonstrated in other studies [ - ], and Facebook continues to have high rates of use among sexual and gender minorities [ ], including YBMSM in Chicago. (A more in-depth treatment of peer-based network interventions for HIV prevention is provided in .)
There are a number of challenges, however, in using Facebook data to identify PCAs, including: (1) the large size of the Facebook network, which makes it problematic to identify which individuals are more likely to be influential among YBMSM; (2) difficulty in assessing the relative strengths of methods that can be used to identify PCAs; and (3) partial observation of the Facebook network that increases the uncertainty in identification of individuals in influential network positions. We address the aforementioned problems using a variety of techniques, including imputation to infer the unobserved structure of the Facebook network.
The goal of this paper is thus two-fold: (1) to provide insight into the structure of the Facebook network of YBMSM in Chicago and how that structure relates to the identification of PCAs for an HIV prevention intervention and (2) to provide guidance to researchers considering the use of PCAs on online social networks and the practical difficulties that might arise when applying theory to practice. We use 2 algorithms commonly used to identify candidate PCAs for information diffusion and apply them to observed and imputed networks. We examine the sensitivity and stability (defined in the Methods section below) of PCA sets selected by each algorithm, given the imputation of the unobserved data. This case study is the first step in a broader effort to understand how the effectiveness of peer-based network interventions can be improved. Methods and data presented here might be useful to other researchers using social networking sites for peer-based health interventions.
Recruitment of Study Sample
A detailed description of participant recruitment is provided elsewhere [- ]. In brief, respondent-driven sampling (RDS) was used to recruit eligible YBMSM from the South Side of Chicago and adjacent suburbs between June 2013 and July 2014 (n=618) [ ]. Seeds from diverse social spaces were selected and given coupons to distribute to potential recruits. If the recruits were willing to participate in the study, then they returned the coupons to the study coordinators and were given coupons to recruit study participants themselves. Information in these coupons allowed us to link the recruits with their recruiters. A diverse set of starting seeds for recruitment can produce a study sample that is representative of the population. RDS is a variant of link-tracing schemes, and it provides a design for sampling and a methodology for estimating statistical properties of the target population [ ]. RDS is especially attractive for sampling populations that are hard to reach, and it has been used in a variety of health studies [ - ].
Respondents were eligible for recruitment if they (1) self-identified as African American or black; (2) were assigned male sex at birth; (3) were aged between 16 and 29 years; (4) spent most of their time on the South Side of Chicago or adjacent predominantly black suburbs; (5) were willing and able to provide informed consent at the time of the study visit; and (6) reported oral or anal sex with a male within the past 24 months . These study participants answered a bio-behavioral survey at an in-person study visit and were offered the opportunity to provide Facebook data.
Generation of Facebook Networks
Facebook friend lists of consenting uConnect participants were downloaded, allowing us to enumerate the set of potential influencers of YBMSM. An app within Facebook was developed to enable identification of unique individuals from Facebook friend lists of consenting respondents. With privacy protections in place, the algorithm unambiguously linked friend lists of all consenting uConnect respondents. Of the 618 study respondents, 600 reported using the internet and 490 reported having a profile on Facebook. Of the 322 who consented to provide Facebook data, 24 were not able to log in to their account. An undirected network dataset on 298 uConnect respondents was thus compiled, which included information on friendships between pairs of respondents and between respondents and nonrespondents (ie, friends of respondents who did not participate in the study). This data structure is typical of digitally collected network data [, ].
Following Handcock and Gile , we depict the observed and unobserved partitions of our data in a 2x2 table ( ). All friendships—ties or edges in network terminology—between respondents (n=298), as shown in the bottom left cell, were observed (about 44 thousand observed dyads), as were friendships between respondents and nonrespondents (n=182,998) in the diagonal cells (about 54 million observed dyads). Facebook friendships between the nonrespondent friends of uConnect respondents, shown in the top right cell, were unobserved (about 17 billion unobserved dyads). A schematic for the data structure is provided in .
Boundary Specification for Selection of Nonrespondent Nodes for Imputation
The Facebook network compiled above presumably includes nonrespondents that share variegated relationships with the respondents, including social, familial, and sexual, thus containing a mix of both strong and weak ties. Our goal is to identify critically positioned individuals, including those who were not respondents, and recruit them as candidate PCAs. For our intervention, it is not necessary that the nonrespondents be YBMSM themselves; it is only necessary that nonrespondents be potential influencers of YBMSM. Given the large number of nonrespondents and the amount of unobserved relational data between nonrespondents, we specified a boundary condition that would allow us to select individuals who were well connected to Chicago YBMSM.
We specified a boundary for nonrespondents that focused on the number of friendships with respondents (ie, their relations), as opposed to other individual-level criteria that are commonly used to specify boundaries [, ], for the following 3 reasons. First, usage of the entire sample was infeasible, as there were some 17 billion unobserved dyads, and including all of these in our analyses would have meant that over 99% of our relational data were unobserved. Second, we had limited attribute data for the nonrespondents, and we assumed that those with large numbers of ties to YBMSM in South Chicago were the most likely to also be a potential influencer. Third, our ultimate goal was to select PCAs, and although degree is only one network criterion that determines the potential to influence other actors, it seems reasonable to expect most influential nodes will have moderately high degrees. Thus, we constructed a dataset that included all respondents and the set of nonrespondents who met the threshold specified by our relational boundary. Precise metrics on the relational boundary specification are given in the Results section below.
Characterizing the Nature of Missingness in the Data
Although our Facebook networks were large, the information in our datasets was not complete because we did not observe the friendships between nonrespondents. The large amount of missing data could potentially bias our assessments of candidate PCAs based on their network position. Thus, we chose the approach of applying statistical imputation to reduce the bias induced by partial observation of our data.
To select an appropriate technique to impute the unobserved Facebook friendships, we first needed to define the nature of missingness in our data. We did this following the widely used convention developed by Rubin , who proposed that missingness is of 3 broad types. Data are “missing completely at random” (MCAR) when the missingness depends neither on the observed data nor the unobserved data. They are “missing at random” (MAR) when the probability of missingness does depend on the observed data but not the unobserved data [ , ]. Data are “missing not at random” (MNAR) if the probability of missingness depends on the unobserved data as well [ ].
Our missing data are MNAR. Recall that our study respondents were recruited using an RDS procedure. Nonrespondents were Facebook friends of the respondents, and their data would not have been missing if they had been recruited into the study. However, nonrespondents might not have been recruited for the following unknowable reasons: (1) they were ineligible for the study; (2) they were eligible for the study, but the respondents did not wish to recruit them; (3) they were eligible for the study, but the respondents did not have sufficient coupons for them; and (4) nonrespondents received a coupon but did not participate in the study. Thus, the fact that friendship information for all pairs of nonrespondents is missing is related to their observed friendships with the respondents and also to their unobserved networks, as the nonrespondents’ reason for not being recruited cannot be determined. For reasons explained above, we also specified a degree-based boundary for nonrespondent inclusion. Thus, the respondents and nonrespondents have “differential popularity,” in the terminology of Gile and Handcock , beyond what can be explained by the observed data. Consequently, we suspect that the network structure of nonrespondents is different from that of the respondents. However, a difference in the network structure of respondents and nonrespondents by itself does not violate the MAR assumption, as long as the missingness is due to observed effects, such as whether a particular individual is a respondent or not. In our case, however, the difference in network structure is not entirely due to observed covariates; it may be attributable to a number of nodal covariates that were unobserved, as discussed above. Thus, the missingness in our data is consistent with the MNAR definition.
Fitting a Model for Imputation of Unobserved Friendships
It has been shown that analyses using only the observed subnetwork might not generalize to the larger incomplete network . Hence, an imputation of the unobserved Facebook friendships might provide more reliable indicators of candidate PCAs. To impute these unobserved friendships, we used exponential random graph models (ERGMs) [ ], a class of models commonly used to describe probability distributions of networks, as implemented in the open source statnet [ ] suite of packages. ERGMs were used to estimate the log-odds of ties between actor pairs, relative to a model where all ties are homogeneously distributed across the network. Observed existent ties were coded 1, observed nonexistent ties were coded 0, and unobserved ties were coded as missing (“NA” in R). This approach to imputation is derived from the method proposed by Handcock and Gile [ , ] and has been used to impute unobserved ties in other studies [ , ].
To impute friendships between nonrespondents, we developed a mechanistic model to predict their likelihood. Although there was little information available on individual attributes of nonrespondents (more details are provided in the Results), the number of friendships each of them shared with respondents was completely observed. We also know that Facebook ties tend to have a high mean degree and a high variance. It is, therefore, reasonable to assume that in the context of Facebook, nonrespondents who were more social with respondents might also be more social with each other. (A contrast would be the inverse condition, where observing many ties with respondents may indicate that many of the individual’s fixed tie budget was already used up, and thus, decrease their probability of having ties with other nonrespondents.) However, the procedure for selecting nonrespondents for imputation is biased toward those who are more social. It is, therefore, likely that the friendships between nonrespondents would not simply be in direct proportion to their observed friendships, but might experience a dampening effect. To mechanistically model both of these social forces, we used 2 separate parameters in an ERGM: sociability and selective mixing.
Sociability is a node-level parameter that measures the number of ties a respondent or nonrespondent shares with respondents, and selective mixing was represented as a single parameter measuring the number of ties between respondents and nonrespondents, as represented by either of the diagonal cells in. The sociability term applies to the full adjacency matrix, allowing us to use the observed features to infer the unobserved [ ]. It represents a process where respondents with more respondent friends will also have more nonrespondent friends. The selective mixing term allows us to model the systematic difference between the respondents and the nonrespondents, whereby the nonrespondent-nonrespondent quadrant will have a greater density than either of the other 2 (respondent-respondent and respondent-nonrespondent). This approach allows us to use the observed information to model the unobserved information in the network while accounting for the observed systematic differences between the respondents and nonrespondents directly, as advocated by Gile and Handcock [ ]. Thus, the selective mixing parameter offsets some of the bias induced by selecting the most social nonrespondents as a consequence of the boundary specification defined above.
Simulating Multiple Imputations From the Fitted Model
Once a model to impute missing data is estimated as above, we simulate stochastic realizations of this model. In networks that are fully observed, a simulation from an estimated ERGM fixes the set of nodes and uses a stochastic Markov Chain Monte Carlo (MCMC) algorithm to toggle relationships on and off, resulting in a network that represents a random draw from the probability distribution specified by the ERGM. In this case, we fix the values of the observed dyads, allowing only the unobserved dyads to be selected as candidates for toggling during the MCMC algorithm. This specification was used to impute 100 stochastically generated networks, each with the number of observed and unobserved ties consistent with a random draw from our fitted model described above. The 100 imputations were deemed to be sufficient because the maximum variability in the number of imputed edges was low (<1.8% of the mean, where mean=40,970 and range=40,610-41,340).
Peer Change Agent Identification
Facebook friendships between nonrespondents are imputed in the simulated networks. We use these networks to identify PCAs. It is worth noting that the population that our PCAs are drawn from is not limited to YBMSM only but the potential influencers of YBMSM. Such a PCA identification procedure is arguably most successful when the type of flow process that is of interest is taken into account . Following this argument, we apply 2 computational algorithms that are well suited to situations where the underlying flow process involves diffusion of information: eigenvector centrality [ ] and keyplayer positive [ ]. Eigenvector centrality assumes that the flow process of interest moves through the network via unrestricted walks. It describes a mechanism where 1 node can impact all of its neighbors simultaneously [ ], and it has therefore been used in public health apps that use peer influence [ - ]. The keyplayer positive algorithm—henceforth referred to as keyplayer —is a set-based measure, reflecting the idea that the optimal set may not necessarily be composed of nodes that have the highest individual scores [ ]. Rather, the keyplayer set consists of individuals who are maximally connected to individuals in the network. Thus, passing information through the keyplayer set minimizes the social distance it has to travel to reach the maximum number of individuals in a social network. Keyplayer is thus an ideal choice for scenarios like diffusing PrEP-related information, and it has been used in related public health applications [ , ]. Mathematical definitions and algorithmic descriptions of both measures are given in .
We used eigenvector centrality and keyplayer to identify candidate PCAs on the observed Facebook data, in which all unobserved ties were assumed to be nonexistent, and then on each of the 100 imputed networks. These algorithms are designed to be applied to a given observed network, and the theory works best when the network observation is perfect. When networks are incompletely observed, however, an alternate approach is to apply each algorithm to a sample of imputed networks, rather than optimizing just on the observed dataset . This method provides a set of PCAs that represent a good solution for the case where network data are imperfectly observed [ ]. Thus, we followed this strategy.
We made a programmatic decision to select 300 individuals by each measure on the observed network, and the 300 most commonly occurring PCAs on the imputed networks were selected. The number of PCAs that are recruited and trained is a critical consideration in peer interventions, and it has been argued that a peer intervention is likely to be successful if the number of peer leaders recruited is about 7-8% of the size of the population for whom the intervention is designed . In prior published work [ ], we estimated that there are about 3700 HIV-negative YBMSM in Chicago, 8% of which is approximately 300.
We calculated the distribution of the number of times each individual was identified as a PCA across the imputations for each algorithm to assess which individuals warranted further consideration. These distributions were used to determine cutoff points for PCAs and were defined as a sufficiency condition for each of the algorithms. Of the identified PCAs, those that met this sufficiency condition were referred to as “sPCAs.” Intersection sets of PCAs on the observed network and sPCAs on the imputed network were then computed for each algorithm. We defined the following 2 measures to compare the sets of PCAs and sPCAs on the observed and imputed networks, respectively.
The sensitivity of an algorithm is defined as the overlap in the PCAs identified on the observed network and sPCAs identified on the imputed networks. This measure allows us to assess if a PCA set differs substantially between the observed and imputed networks, providing an indication of the extent to which an individual appears to be a strong candidate for PCA selection, regardless of whether imputation is used. Thus, it helps us to understand the extent to which imputation affects our outcomes. Note that we do not assert that it provides an indication of the accuracy of the imputation, which remains unknowable.
The stability of an algorithm is defined as the tendency of an algorithm to identify the same nodes—that is, sPCAs on the imputed networks—across multiple imputations. This measure allows us to determine the threshold number of imputations for each measure that is required to select PCA sets of the size desired here (n=300).
Note on Computing
All the computation and visualization were performed using software packages in the R programming language . The sna [ ] and igraph [ ] packages were used to manage relational data. The ergm [ ] package was used to fit the ERGMs and simulate the imputed networks. Eigenvector scores were computed using igraph [ ]; keyplayer sets were identified using influenceR [ ]. The Intergraph [ ] package was used to convert data between the formats required for igraph (or influenceR, which uses the same data structure as igraph) and network (or ergm, which uses the same data structure as network). The sna [ ] and GGally [ ] packages were used to visualize networks.
Study Sample, Facebook Networks, and Relational Boundary Specification
The 298 uConnect respondents had 182,998 Facebook friends in total. There were 327,741 observed friendships in the dataset, including 3256 between respondents exclusively, and the remaining friendships existed between respondents and nonrespondents.
As stated above, as the number of nonrespondents was large and limited individual-level information on nonrespondents was available, we specified a boundary for nonrespondent inclusion based on their observed relations: nonrespondents (n=587) who were friends with at least 10.1% (30/298) of the respondents were included in our sample. The number of nonrespondents that would be selected with different boundaries is given in. Specifying a boundary involves tradeoffs; set too low, the amount of missing data increases rapidly (on the order of n2), and the likelihood of including someone not closely connected to Chicago YBMSM increases. By specifying a boundary that is too high, we may exclude someone who is both a YBMSM and a strong PCA candidate based on their network position. We considered the number of nonrespondents who would fall within different boundary specifications ( ) and the amount of missing data that each would imply. We selected 10% as our boundary for the number of respondents a nonrespondent must be friends with because it reduces our sample to a manageable computational size while retaining a broad sample of nonrespondents who could be PCAs. Thus, the final sample consisted of 885 individuals, including 33.6% (298/885) respondents and 66.3% (587/885) nonrespondents.
In this sample, the median reported age for both respondents and nonrespondents was 23 years (with 271 missing reports for nonrespondents). In addition, 96.9% (289/298) respondents and 92.5% (543/587) of nonrespondents identified their current gender as male on their Facebook profiles (2 nonrespondent reports were missing). Approximately 81.5% (243/298) respondents listed Chicago as their city on their Facebook profiles. Of the remaining 55 participants, 52 reported their residence as the South Side/south suburbs of Chicago during their in-person interview and 3 reported their residence as the Southeast side. Moreover, 66.2% (389/587) nonrespondents listed Chicago as their city; approximately 5.9% (35/587) nonrespondents did not report their city. About half of the remaining nonrespondents reported Illinois or another Midwestern State as their primary location, and the rest were scattered across the United States.
|Minimum number of respondents that a nonrespondent has to be connected to (N=298), n (%)||Nonrespondents meeting that boundary specification, n||Observed friendships between respondents and nonrespondents, n||Unobserved dyads between nonrespondents, n|
aShows the case used in our analysis.
|Network parameter||Log odds||Standard error||P value|
|Sociability (measured as degree with respondents)||0.044||0.0002||<.001|
|Mixing between respondents and nonrespondents||0.208||0.022||<.001|
Overall, we observed 29,700 friendships, including 3256 between respondents exclusively and 26,444 between respondents and nonrespondents. Thus, each respondent had an average of 110.5 friendships, including 21.8 friendships on average with other respondents, and an average of 88.7 friendships with nonrespondents. Each nonrespondent who met our boundary specification had an average of 45.1 observed friendships.
The density of friendships—defined as the ratio of the number of observed friendships to the maximum number of possible friendships—between respondents was 7.4%. The density of respondent-nonrespondent friendships was 15.1%. (These densities will help us interpret outputs from our imputation procedure below.)
Fitted Model for Imputation of Unobserved Friendships
Estimates from the fitted ERGM are in. The “edges” term operates analogously to an intercept term in logistic regression models. Our coefficient for it was negative, implying the base probability of a tie, without considering other additive terms, is less than 50%. Coefficients for the other 2 terms were positive and significant. The positive sociability coefficient indicates that individual respondents who have more ties to other respondents also have more ties to nonrespondents. The positive mixing coefficient indicates the dampening effect discussed above. Thus, the number of imputed friendships between nonrespondents was lower than that predicted by a proportional scaling model of the observed friendships between respondents and nonrespondents.
Multiple Imputation of Unobserved Network Data
In, the top panel contains frequency plots of the adjacency matrices across the 100 imputed networks. (The top panel of displays data for all 885 nodes; in the bottom panel, we selected the first 50 respondents and 50 nonrespondents to produce a clearer display.)
The mean density for imputed friendships between nonrespondents, shown in the top right corner of, was 23.8%. The nonrespondent-nonrespondent density is higher than the density of respondent-respondent friendships (7.4%, as stated above) and the density of respondent-nonrespondent friendships (15.1%). This discrepancy in densities is reflective of the fact that a degree-based criterion was used to select nonrespondents for imputation. Had we not included the selective mixing term, however, this density would have been even higher. Three cells—the bottom left and the diagonals—in each panel of consist entirely of observed dyads and required no imputation. The top right cell contains unobserved dyads, and edges in these dyads were stochastically generated in the imputations.
The degree distributions for the respondents and nonrespondents in the observed network and 1 randomly selected imputed network are shown in. The respondents have identical distributions in the observed and imputed graphs because the imputation does not impact respondent ties. We also observed that 11.7% (35/298) of the respondents had no friendships with anyone in the imputation sample, a consequence of excluding nonrespondents who did not meet our boundary specification.
The second consequence of our boundary specification is that we see that the minimum number of friendships for nonrespondents is 30. In addition, on the observed network, we noticed that numbers of friendships between nonrespondents had a much narrower range (30-100). After the imputation, however, we see that the degree distribution of nonrespondents is much more right-skewed, comparable with the degree distribution of the respondents. As we have no reason to believe that the respondents and nonrespondents should have different degree distributions, this correspondence in shape after imputation is a positive sign, indicating that our approach is reasonable in this sense. The left side of the imputed nonrespondent distribution does not resemble that of the respondents, but this is to be expected, given the degree-based boundary specification we imposed for selection of nonrespondents.
Peer Change Agent Identification
Peer Change Agent Identification on the Observed Network
On the observed network, both the PCA sets of size 300 contained a mix of respondents and nonrespondents, with the exact breakdown varying by algorithm; the set for eigenvector centrality contained 62.0% (186/300) nonrespondents and for keyplayer contained 66.0% (197/300) nonrespondents. Recall that nonrespondents comprise 66.3% (587 of 885 nodes) of our sample. Thus, when the unobserved ties were treated as nonexistent, the proportion of nonrespondents in the PCA sets was higher than their proportion in the observed network for eigenvector centrality, and about the same for keyplayer. Although it might seem surprising that the proportion of nonrespondents who were selected as PCAs without the imputation was high, it makes sense in light of our degree-based boundary specification, which selected nonrespondents who had high connectivity with Chicago YBMSM, and were thus likely to be in critical positions. Had we not specified a boundary, nonrespondents would have comprised over 99.9% of the whole sample.
Peer Change Agent Identification on the Imputed Networks
Across the 100 imputed networks,shows the distribution of PCAs identified by each algorithm. For eigenvector and keyplayer, 390 and 885 nodes, respectively, were selected at least once. Thus, we see a fundamental difference between the 2 measures in terms of their stability in node selection. Eigenvector centrality is a node-level algorithm, and it demonstrated a strong tendency to identify the same nodes as critical across all 100 imputations. In other words, the modal number of imputations for nodes that were selected at least once was 100. The keyplayer algorithm showed much less stability; the modal number of imputations for nodes that were selected at least once was 33. Summary statistics of the number of times PCAs were identified across all imputations are given in .
For subsequent analyses, we adopted a sufficiency condition, illustrated as the cutoff point in. For each measure, this cutoff point was a value that yielded the smallest PCA set that was closest in size to our desired value of 300. We refer to PCA sets that meet the sufficiency condition for a given algorithm as sPCAs. With eigenvector centrality, 301 individuals—consisting of 22.9% (69/301) respondents and 77% (232/301) nonrespondents—were selected on at least 50 imputed networks. With keyplayer, 312 individuals—consisting of 35.2% (110/312) respondents and 64.7% (202/312) nonrespondents—were selected on at least 36 imputed networks. There were 115 sPCA individuals (20 respondents and 95 nonrespondents) that met the sufficiency criterion by both algorithms and 498 unique sPCA individuals selected by at least one algorithm (100 respondents and 398 nonrespondents).
We also found that nonrespondent sPCAs selected using eigenvector had a minimum of 44 friendships with respondents, whereas those selected using keyplayer were friends with a minimum of 30 respondents, which is the same as our boundary for nonrespondent inclusion. Thus, eigenvector only selected nonrespondent PCAs who were well above the boundary specification, whereas keyplayer did not. This suggests that eigenvector is less affected by the boundary specification for nonrespondent inclusion.
|PCAa identification algorithm||Number of times a node was identified as a PCA, mean (SD)||Number of times a respondent appeared as a PCA, mean (SD)||Number of times a nonrespondent appeared as a PCA, mean (SD)|
|Eigenvector centrality||76.9 (36.8)||99.3 (5.6)||72.1 (38.9)|
|Keyplayer||33.9 (8.3)||34.9 (11.7)||33.4 (5.9)|
aPCA: peer change agent.
Comparison of Peer Change Agents Identified on the Observed and Imputed Networks
We found that all 69 respondents (100%) selected by eigenvector as sPCAs on the imputed networks were also selected as PCAs on the observed networks (). Eigenvector selected 232 nonrespondent sPCAs on the imputed network, of whom 78.9% (183/232) appeared as PCAs on the observed network. Keyplayer selected 110 respondent sPCAs on the imputed networks, of whom 42.7% (47/110) appeared as PCAs on the observed network. Among nonrespondents, keyplayer selected 202 nonrespondents as sPCAs on the imputed networks, of whom 32.6% (66/202) appeared as PCAs on the observed network. We thus observe that eigenvector is much less sensitive to the imputation, as per our definition above, than keyplayer. Keyplayer’s higher sensitivity to the imputation might be because it is a set-based algorithm, and it attempts to select nodes that collectively span the breadth of the network, making the identification of a given node dependent not just on its local social environment but on the entirety of the network.
Although which of the 2 PCA-identification algorithms provides the true set of individuals in PCA positions (which is unknown) is not known, the contrasts between them among the various measures considered—stability, sensitivity, and effect of the boundary specification—stand out.
This paper presented a novel approach to select candidate PCAs on partially observed Facebook networks of YBMSM in Chicago, with the goal of developing a pipeline in the future that allows data from social networking sites to be used for peer health interventions. We discussed several challenges in operationalizing such an intervention, including methods to address the large amount of unobserved network data, and 2 PCA identification algorithms that are consistent with our goal of diffusing prevention information through individuals situated at critical positions in the network. We found that eigenvector centrality was far less sensitive to the imputation than keyplayer, consistent with a previous result . We also found that relative to keyplayer, eigenvector had a relatively core set of stable PCAs across the imputed networks. Eigenvector centrality was also less affected by the relational boundary for nonrespondent inclusion, which was necessary given the large number of nonrespondents that were sampled. These findings lead us to conclude that eigenvector centrality might be better suited for identifying PCAs in our study. It is worth noting that we cannot know which algorithm produces the correct set of PCAs, but such a systematic evaluation of the properties of each algorithm, given that our data that were MNAR, can guide our intervention planning.
There are several underlying considerations behind this conclusion that merit discussion. Although peer-based interventions have shown promise in public health [- ], their efficacy for HIV prevention has been limited in vulnerable populations [ , ]. The use of digital technologies to compile social network data and the application of formal social network analysis to identify PCAs may improve the efficacy of interventions [ , ]. Despite increased use of newer social network sites among younger people, Facebook use remains high in the general population [ ], including YBMSM in Chicago. Recently collected data in a follow-up study have shown that although almost 100% of recruited YBMSM in Chicago used Facebook, fewer than 40% used Instagram and Snapchat and approximately 20% had profiles on Twitter, Jack’d, or Grindr. Thus, Facebook data enabled us to broadly characterize the social networks of YBMSM to identify their potential influencers. We, however, faced many unanticipated challenges in using Facebook data for identifying PCAs, and researchers using Facebook or alternate social media platforms may experience some of the same challenges we did. A schema to handle the limitations encountered here may benefit peer-based health research; our case study is a step forward in the development of such a schema.
One important limitation of the study is that no explicit homophily parameters were included in the imputation model. Recall that unobserved nonrespondent-nonrespondent friendships have to be imputed from the observed respondent-nonrespondent friendships. Many of the key individual attributes, including age, sex at birth, residence, and race (or ethnicity), either defined or were closely related to the inclusion criteria for respondents. As is described in the Results, nonrespondents who met the boundary specification were of comparable age to the respondents, almost all identified as male on their Facebook profiles, and a majority identified Chicago as their place of residence. Given the extent to which age, gender, and residence overlapped between the respondents and nonrespondents, it was not possible to meaningfully measure homophily with respect to these attributes. In addition, it was not possible to measure homophily on race/ethnicity as this attribute was not available for most nonrespondents. The imputation model also did not include any parameters that measured higher order network structure. Ideally, an ERGM fit to Facebook data would include higher order effects such as triad closure, as Facebook algorithms encourage individuals with common friends to become friends with each other. Our extensive efforts to incorporate terms for triad closure used existing parameters that were developed on sparser networks (eg, shared partner statistics), and they were not successful. (Information on the triad closure models we explored is provided in.) More theoretical work may be needed to identify parameters that can model higher order effects in large networks with missing data. Our efforts, however, did reveal interesting new findings about the potential limits of using existing methods to model triad closure in large networks.
Future Research Directions
Future research directions include modeling analyses to identify PCAs in a follow-up wave and assessing the extent to which PCA sets overlap between the 2 waves. This is important because training PCAs requires considerable upfront investment, and it has been observed in some networks that critically positioned individuals turn over within a year . Therefore, identifying PCAs that persist over time might be more cost-effective, if they can be reliably found. In addition, many online environments besides Facebook are now used for social networking. As peer-based health interventions expand in scope, it may be valuable to consider alternative social media platforms as they may prove to be more effective with specific populations. Not all communication, however, occurs through such online media. Identification of friends and relational kin from offline data remains an important avenue for research. More theoretical work that explicitly accounts for online and natural social environments may improve our understanding of how to identify PCAs more accurately. Follow-up studies that address these considerations are in progress. Finally, Bayesian ERGMs to impute network unobserved data have been proposed [ ] and might provide an alternate method to reconstruct the unobserved networks. (Details on related methodological approaches to impute missing network data, and why we selected the approach used here, are provided in ).
This study is an interdisciplinary examination of a recruitment strategy of individuals located at critical positions in a large social network. Our overarching goal was to find a set of PCAs who maximize the possibility of success of our intervention while understanding the constraints that our data imposed. As Facebook and other online social media are increasingly used in creative ways to influence health behavior, our case study will help researchers anticipate some of the underlying difficulties as they plan their studies. If the challenges we described are unavoidable, our experiences could provide useful heuristics to maximize the potential for peer-based health interventions to succeed.
This study was supported by NIH R01 DA 033875, AI 120700, and P30 AI11794. The authors are grateful for the computing resources provided by the Research Computing Center at the University of Chicago and support provided by research staff at the Chicago Center for HIV Elimination and The Village at the University of Chicago.
Conflicts of Interest
Multimedia Appendix 1
Detailed study background.PDF File (Adobe PDF File), 519KB
- Valente TW, Watkins SC, Jato MN, van der Straten A, Tsitsol LP. Social network associations with contraceptive use among Cameroonian women in voluntary associations. Soc Sci Med 1997 Sep;45(5):677-687. [Medline]
- Valente TW, Pumpuang P. Identifying opinion leaders to promote behavior change. Health Educ Behav 2007 Dec;34(6):881-896. [CrossRef] [Medline]
- Valente TW. Network interventions. Science 2012 Jul 6;337(6090):49-53. [CrossRef] [Medline]
- Valente TW, editor. Social Networks and Health: Models, Methods, and Applications. New York, NY, USA: Oxford University Press; 2010.
- Latkin CA, Knowlton AR. Social network assessments and interventions for health behavior change: a critical review. Behav Med 2015 Sep;41(3):90-97 [FREE Full text] [CrossRef] [Medline]
- Hunter RF, McAneney H, Davis M, Tully MA, Valente TW, Kee F. “Hidden” social networks in behavior change interventions. Am J Public Health 2015 Mar;105(3):513-516. [CrossRef] [Medline]
- Latkin CA, Forman V, Knowlton A, Sherman S. Norms, social networks, and HIV-related risk behaviors among urban disadvantaged drug users. Soc Sci Med 2003 Feb;56(3):465-476. [Medline]
- Latkin C, Knowlton A. Micro-social structural approaches to HIV prevention: a social ecological perspective. AIDS Care 2005 Jun;17 Suppl 1:S102-S113. [CrossRef] [Medline]
- Neaigus A, Friedman SR, Curtis R, Des Jarlais DC, Terry Furst R, Jose B, et al. The relevance of drug injectors' social and risk networks for understanding and preventing HIV infection. Soc Sci Med 1994 Jan;38(1):67-78. [CrossRef]
- Crosby RA, Mena L, Geter A. Are HIV-positive young black MSM having safer sex than those who are HIV-negative? Int J STD AIDS 2017 Apr;28(5):441-446 [FREE Full text] [CrossRef] [Medline]
- Mays VM, Cochran SD, Zamudio A. HIV prevention research: are we meeting the needs of African American men who have sex with men? J Black Psychol 2004;30(1):78-105 [FREE Full text] [CrossRef] [Medline]
- Peterson JL, Jones KT. HIV prevention for black men who have sex with men in the United States. Am J Public Health 2009 Jun;99(6):976-980. [CrossRef] [Medline]
- Wohlfeiler D, Potterat J. Using gay men's sexual networks to reduce sexually transmitted disease (STD)/human immunodeficiency virus (HIV) transmission. Sex Transm Dis 2005 Oct;32(10 Suppl):S48-S52. [Medline]
- Smith LR, Strathdee SA, Metzger D, Latkin C. Evaluating network-level predictors of behavior change among injection networks enrolled in the HPTN 037 randomized controlled trial. Drug Alcohol Depend 2017 Jun 1;175:164-170 [FREE Full text] [CrossRef] [Medline]
- Khumalo-Sakutukwa G, Morin S, Fritz K, Charlebois E, van Rooyen H, Chingono A, NIMH Project Accept Study Team. Project Accept (HPTN 043): a community-based intervention to reduce HIV incidence in populations at risk for HIV in sub-Saharan Africa and Thailand. J Acquir Immune Defic Syndr 2008 Dec 1;49(4):422-431 [FREE Full text] [CrossRef] [Medline]
- Kelly JA, Murphy DA, Sikkema KJ, McAuliffe TL, Roffman RA, Solomon LJ, et al. Randomised, controlled, community-level HIV-prevention intervention for sexual-risk behaviour among homosexual men in US cities. Community HIV Prevention Research Collaborative. Lancet 1997 Nov 22;350(9090):1500-1505. [Medline]
- Amirkhanian YA. Social networks, sexual networks and HIV risk in men who have sex with men. Curr HIV/AIDS Rep 2014 Mar;11(1):81-92 [FREE Full text] [CrossRef] [Medline]
- Koblin BA, Mayer KH, Eshleman SH, Wang L, Mannheimer S, del Rio C, HPTN 061 Protocol Team. Correlates of HIV acquisition in a cohort of Black men who have sex with men in the United States: HIV prevention trials network (HPTN) 061. PLoS One 2013 Jul 26;8(7):e70413 [FREE Full text] [CrossRef] [Medline]
- Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, Vargas L, iPrEx Study Team. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 2010 Dec 30;363(27):2587-2599 [FREE Full text] [CrossRef] [Medline]
- Anderson PL, Glidden DV, Liu A, Buchbinder S, Lama JR, Guanira JV, iPrEx Study Team. Emtricitabine-tenofovir concentrations and pre-exposure prophylaxis efficacy in men who have sex with men. Sci Transl Med 2012 Sep 12;4(151):151ra125 [FREE Full text] [CrossRef] [Medline]
- Anderson A, Smith M. Social Media Use in 2018. Pew Research Center; 2018. URL: http://assets.pewresearch.org/wp-content/uploads/sites/14/2018/03/01105133/PI_2018.03.01_Social-Media_FINAL.pdf [WebCite Cache]
- NIMH Collaborative HIV/STD Prevention Trial Group. Results of the NIMH collaborative HIV/sexually transmitted disease prevention trial of a community popular opinion leader intervention. J Acquir Immune Defic Syndr 2010 Jun;54(2):204-214 [FREE Full text] [CrossRef] [Medline]
- Schneider JA, Laumann EO. Alternative explanations for negative findings in the community popular opinion leader multisite trial and recommendations for improvements of health interventions through social network analysis. J Acquir Immune Defic Syndr 2011 Apr;56(4):e119-e120. [CrossRef] [Medline]
- Herring SJ, Cruice JF, Bennett GG, Rose MZ, Davey A, Foster GD. Preventing excessive gestational weight gain among African American women: a randomized clinical trial. Obesity (Silver Spring) 2016 Jan;24(1):30-36 [FREE Full text] [CrossRef] [Medline]
- Thrul J, Klein AB, Ramo DE. Smoking cessation intervention on Facebook: which content generates the best engagement? J Med Internet Res 2015 Nov 11;17(11):e244 [FREE Full text] [CrossRef] [Medline]
- Phillips G, Ybarra ML, Prescott TL, Parsons JT, Mustanski B. Low rates of human immunodeficiency virus testing among adolescent gay, bisexual, and queer men. J Adolesc Health 2015 Oct;57(4):407-412 [FREE Full text] [CrossRef] [Medline]
- A Survey of LGBT Americans. Washington, DC: Pew Research Center; 2013. URL: http://assets.pewresearch.org/wp-content/uploads/sites/3/2013/06/SDT_LGBT-Americans_06-2013.pdf [WebCite Cache]
- Khanna AS, Michaels S, Skaathun B, Morgan E, Green K, Young L, uConnect Study Team. Preexposure prophylaxis awareness and use in a population-based sample of young black men who have sex with men. JAMA Intern Med 2016 Jan;176(1):136-138 [FREE Full text] [CrossRef] [Medline]
- Khanna AS, Schumm P, Schneider JA. Facebook network structure and awareness of preexposure prophylaxis among young men who have sex with men. Ann Epidemiol 2017 Dec;27(3):176-180 [FREE Full text] [CrossRef] [Medline]
- Schneider J, Cornwell B, Jonas A, Lancki N, Behler R, Skaathun B, et al. Network dynamics of HIV risk and prevention in a population-based cohort of young black men who have sex with men. Net Sci 2017;5(2):247. [CrossRef]
- Schneider JA, Lancki N, Schumm P. At the intersection of criminal justice involvement and sexual orientation: dynamic networks and health among a population-based sample of young black men who have sex with men. Soc Networks 2017 Oct;51:73-87. [CrossRef] [Medline]
- Heckathorn D. Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl 1997 May 01;44(2):174-199. [CrossRef]
- Rudolph AE, Gaines TL, Lozada R, Vera A, Brouwer KC. Evaluating outcome-correlated recruitment and geographic recruitment bias in a respondent-driven sample of people who inject drugs in Tijuana, Mexico. AIDS Behav 2014 Dec;18(12):2325-2337 [FREE Full text] [CrossRef] [Medline]
- Jenness SM, Neaigus A, Wendel T, Gelpi-Acosta C, Hagan H. Spatial recruitment bias in respondent-driven sampling: implications for HIV prevalence estimation in urban heterosexuals. AIDS Behav 2014 Dec;18(12):2366-2373. [CrossRef] [Medline]
- Hakre S, Arteaga G, Núñez AE, Bautista CT, Bolen A, Villarroel M, Panama HIV EPI Group. Prevalence of HIV and other sexually transmitted infections and factors associated with syphilis among female sex workers in Panama. Sex Transm Infect 2013 Mar;89(2):156-164 [FREE Full text] [CrossRef] [Medline]
- McCreesh N, Frost SD, Seeley J, Katongole J, Tarsh MN, Ndunguse R, et al. Evaluation of respondent-driven sampling. Epidemiology 2012 Jan;23(1):138-147 [FREE Full text] [CrossRef] [Medline]
- Morineau G, Bollen LJ, Syafitri RI, Nurjannah N, Mustikawati DE, Magnani R. HIV prevalence and risk behaviours among injecting drug users in six Indonesian cities implications for future HIV prevention programs. Harm Reduct J 2012 Sep 3;9:37 [FREE Full text] [CrossRef] [Medline]
- Malekinejad M, Johnston LG, Kendall C, Kerr LR, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav 2008 Jul;12(4 Suppl):S105-S130. [CrossRef] [Medline]
- Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS 2005 May;19 Suppl 2:S67-S72. [Medline]
- Kapur A, Schneider JA, Heard D, Mukherjee S, Schumm P, Oruganti G, et al. A digital network approach to infer sex behavior in emerging HIV epidemics. PLoS One 2014 Jul;9(7):e101416 [FREE Full text] [CrossRef] [Medline]
- Schneider JA, Kondareddy D, Gandham S, Dude AM. Using digital communication technology fails to improve longitudinal evaluation of an HIV prevention program aimed at Indian truck drivers and cleaners. AIDS Behav 2012 Jul;16(5):1359-1363 [FREE Full text] [CrossRef] [Medline]
- Handcock MS, Gile KJ. Modeling social networks from sampled data. Ann Appl Stat 2010 Mar;4(1):5-25 [FREE Full text] [CrossRef] [Medline]
- Laumann E, Marsden P, Prensky D. The Boundary Specification Problem in Network Analysis. In: Freeman LC, White DR, Romney AK, editors. Research Methods in Social Network Analysis. Fairfax: George Mason University Press; 1989.
- Pappi FU. Boundary specification and structural models of elite systems: social circles revisited. Social Networks 1984 Mar;6(1):79-95. [CrossRef]
- Rubin DB. Inference and missing data. Biometrika 1976 Dec;63(3):581. [CrossRef]
- Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods 2002 Jun;7(2):147-177. [Medline]
- McKnight P, McKnight K, Sidani S, Figueredo AJ, editors. Missing Data: A Gentle Introduction. New York, NY: The Guilford Press; Mar 28, 2007.
- Gile KJ, Handcock MS. Analysis of networks with missing data with application to the national longitudinal study of adolescent health. J R Stat Soc C 2016 Sep 29;66(3):501-519. [CrossRef]
- Shalizi CR, Rinaldo A. Consistency under sampling of exponential random graph models. Ann Stat 2013 Apr;41(2):508-535 [FREE Full text] [CrossRef] [Medline]
- Hunter DR, Handcock MS, Butts CT, Goodreau SM, Morris M. ergm: a package to fit, simulate and diagnose exponential-family models for networks. J Stat Softw 2008 May 1;24(3):nihpa54860 [FREE Full text] [Medline]
- Handcock M, Hunter DR, Butts CT, Goodreau SM, Morris M. statnet: software tools for the representation, analysis, simulation and visualization of network data. 2003. URL: https://cran.r-project.org/web/packages/statnet/index.html [WebCite Cache]
- Wang C, Butts CT, Hipp JR, Jose R, Lakon CM. Multiple imputation for missing edge data: a predictive evaluation method with application to add health. Soc Networks 2016 Mar 1;45:89-98 [FREE Full text] [CrossRef] [Medline]
- Sewell DK, Chen Y. Latent space models for dynamic networks. J Am Stat Assoc 2016 Jan 15;110(512):1646-1657. [CrossRef]
- Borgatti SP. Centrality and network flow. Soc Net 2005 Jan;27(1):55-71. [CrossRef]
- Bonacich P. Power and centrality: a family of measures. AJS 1987 Mar;92(5):1170-1182. [CrossRef]
- Borgatti S. Identifying sets of key players in a social network. Comput Math Organiz Theor 2006 Apr;12(1):21-34. [CrossRef]
- Johnson K, Quanbeck A, Maus A, Gustafson DH, Dearing JW. Influence networks among substance abuse treatment clinics: implications for the dissemination of innovations. Transl Behav Med 2015 Sep;5(3):260-268 [FREE Full text] [CrossRef] [Medline]
- Geissler KH, Lubin B, Marzilli Ericson KM. Access is not enough: characteristics of physicians who treat medicaid patients. Med Care 2016 Apr;54(4):350-358. [CrossRef] [Medline]
- Gyarmathy V, Caplinskiene I, Caplinskas S, Latkin C. Social network structure and HIV infection among injecting drug users in Lithuania: gatekeepers as bridges of infection. AIDS Behav 2014 Mar;18(3):505-510 [FREE Full text] [CrossRef] [Medline]
- Young AM, Jonas AB, Mullins UL, Halgin DS, Havens JR. Network structure and the risk for HIV transmission among rural drug users. AIDS Behav 2013 Sep;17(7):2341-2351 [FREE Full text] [CrossRef] [Medline]
- Cobb NK, Graham AL, Abrams DB. Social network structure of a large online community for smoking cessation. Am J Public Health 2010 Jul;100(7):1282-1289 [FREE Full text] [CrossRef] [Medline]
- Kelly JA. Popular opinion leaders and HIV prevention peer education: resolving discrepant findings, and implications for the development of effective community programmes. AIDS Care 2004 Feb;16(2):139-150. [CrossRef] [Medline]
- Livak B, Michaels S, Green K, Nelson C, Westbrook M, Simpson Y, et al. Estimating the number of young Black men who have sex with men (YBMSM) on the south side of Chicago: towards HIV elimination within US urban communities. J Urban Health 2013 Dec;90(6):1205-1213 [FREE Full text] [CrossRef] [Medline]
- R Core Team. The R Project for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2014. URL: https://www.r-project.org/ [WebCite Cache]
- Butts CT. sna: Tools for Social Network Analysis. 2014. URL: https://cran.r-project.org/web/packages/sna/index.html [WebCite Cache]
- Csardi G. igraph: Network Analysis and Visualization. 2015. URL: https://cran.r-project.org/web/packages/igraph/index.html [WebCite Cache]
- Handcock M, Hunter D, Butts C, Goodreau S, Krivitsky P, Morris M. ergm: Fit, Simulate and Diagnose Exponential-Family Models for Networks. 2017. URL: https://cran.r-project.org/web/packages/ergm/index.html [WebCite Cache]
- Jacobs S, Khanna A, Madduri K, Bader D. influenceR: Software Tools to Quantify Structural Importance of Nodes in a Network. 2015. URL: https://cran.r-project.org/web/packages/influenceR/index.html [WebCite Cache]
- Bojanowski M. intergraph: Coercion Routines for Network Data Objects. 2015. URL: https://cran.r-project.org/web/packages/intergraph/index.html [WebCite Cache]
- Wickham H, Chang W, Henry L, Pederson TL, Takahashi K, Wilke C, Rstudio. ggplot2: Create Elegant Data Visualisations Using the Grammar of Graphics. 2017. URL: https://cran.r-project.org/web/packages/ggplot2/index.html [WebCite Cache]
- Costenbader E, Valente TW. The stability of centrality measures when networks are sampled. Soc Net 2003 Oct;25(4):283-307. [CrossRef]
- Simoni J, Franks J, Lehavot K, Yard S. Peer interventions to promote health: conceptual considerations. Am J Orthopsychiatry 2011 Jul;81(3):351-359 [FREE Full text] [CrossRef] [Medline]
- Aceves-Martins M, Llauradó E, Tarro L, Moriña D, Papell-Garcia I, Prades-Tena J, et al. A school-based, peer-led, social marketing intervention to engage Spanish adolescents in a healthy lifestyle (“We Are Cool”-Som la Pera study): a parallel-cluster randomized controlled study. Child Obes 2017 Aug;13(4):300-313. [CrossRef] [Medline]
- Centola D. The spread of behavior in an online social network experiment. Science 2010 Sep 3;329(5996):1194-1197 [FREE Full text] [CrossRef] [Medline]
- Wirtz AL, Naing S, Clouse E, Thu KH, Mon SH, Tun ZM, et al. The parasol protocol: an implementation science study of HIV continuum of care interventions for gay men and transgender women in Burma/Myanmar. JMIR Res Protoc 2017 May 17;6(5):e90 [FREE Full text] [CrossRef] [Medline]
- Burt RS. Bridge decay. Soc Net 2002 Oct;24(4):333-363. [CrossRef]
- Koskinen JH, Robins GL, Wang P, Pattison PE. Bayesian analysis for partially observed network data, missing ties, attributes and actors. Soc Net 2013 Oct;35(4):514-527. [CrossRef]
|ERGM: Exponential Random Graph Model|
|MAR: missing at random|
|MCAR: missing completely at random|
|MCMC: Markov Chain Monte Carlo|
|MNAR: missing not at random|
|PCA: peer change agent|
|PrEP: pre-exposure prophylaxis|
|RDS: respondent-driven sampling|
|sPCA: peer change agents who met the sufficiency condition for each of the two peer change agent identification algorithms|
|YBMSM: young black men who have sex with men|
Edited by G Eysenbach; submitted 22.07.18; peer-reviewed by J Constantin, K Bond; comments to author 22.08.18; revised version received 27.08.18; accepted 27.08.18; published 14.09.18Copyright
©Aditya Subhash Khanna, Steven Michael Goodreau, Stuart Michaels, John Alexis Schneider. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.09.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.