Published on 29.09.10 in Vol 12, No 3 (2010): Jul-Sep
Consumers’ Use of Web-Based Information and Their Decisions About Multiplex Genetic Susceptibility Testing
Background: Few data exist to inform concerns raised by online direct-to-consumer marketing of genetic susceptibility tests, such as those offered by commercial entities like 23andme, Navigenics, and DNA Direct. The Multiplex Initiative, a population-based study of healthy adults, provides the first opportunity to evaluate how use of a Web-based decision tool that conveyed information about a genetic susceptibility test influenced individuals’ test decisions.
Objective: To inform the ongoing debate over whether individuals offered genetic susceptibility testing without the involvement of a health care provider (eg, through direct-to-consumer testing) can make informed decisions about testing when guided by online decision aids.
Methods: Participants were 526 members of a large health maintenance organization aged 25 to 40 years old who visited a study website. Multivariate logistic regression models were tested to examine the association of website usage with downstream test decisions.
Results: Participants viewed an average of 2.9 of the 4 pages introducing the multiplex test, 2.2 of the 8 pages describing the health conditions, and 3.2 of the 15 pages describing the genes. For each page viewed, participants were more likely to describe their decision-making as easy (odds ratio [OR] 1.04, 95% confidence interval [CI] 1.01-1.07) and to decide to be tested (OR 1.08, 95% CI 1.05-1.11).
Conclusions: Healthy adults in this study perceived Web-based genomic information presented using evidence-based communications approaches to be helpful in supporting both decisions to test and not to test. Continued research is needed to ensure that these results generalize to target groups with lower literacy and less Internet savvy.
J Med Internet Res 2010;12(3):e41
- Genetic testing/methods;
- genetic testing/psychology;
- genetic predisposition to disease/psychology;
- health knowledge, attitudes, practice;
- health surveys;
- polymorphism, single nucleotide;
- public health/methods;
- risk assessment/methods
Several new genetic tests provide individuals with information about their susceptibilities to a wide array of common health conditions. The availability of these tests is expected to increase greatly over the next decade as more gene-disease associations are identified . Despite the lack of data on clinical effectiveness, commercial entities are even now marketing such tests online directly to consumers (eg, 23andme, Navigenics, and DNA Direct), a practice growing in prominence in the United States [ - ]. This report presents data from the Multiplex Initiative [ , ] to inform the ongoing debate over whether individuals offered genetic susceptibility testing without the involvement of a health care provider—that is, direct-to-consumer (DTC)—can make informed decisions about testing when guided by online decision aids.
One of the most hotly contested issues has been focused on the challenges of communicating complex information about genetic risk for common, chronic diseases [, ]. Given the complex etiology of common diseases, critics have expressed concern that the public will not understand genomic information without the assistance of a health care provider and will be unable to make informed decisions about taking genetic susceptibility tests [ , , ]. Of particular concern is whether individuals can understand the limitations of the information generated by these tests and appreciate what cannot be learned from such tests [ ].
Direct-to-consumer companies’ reliance on interactive Web-based approaches adds complexity to these communication issues [, ]. The Internet increases dissemination potential, thereby enabling reach to ever-increasing proportions of the population with health information and genetic testing [ , , ]. However, Web-based approaches also may be inadequate for communicating complex genetic susceptibility information, particularly for individuals with limited computer or health literacy skills, when compared with interpersonal approaches [ , , ]. Indeed, existing DTC marketing websites have been shown to use language that is too difficult for most of the US public to comprehend and to have limited content in areas that may be critical for decision-making [ ].
Most prior research regarding comprehension and uptake of genetic testing has occurred in the context of high-risk familial cancer syndromes. The majority of those who present for such testing have already decided to be tested [, ]. These studies, therefore, have provided little insight into differences among those who decide to be tested and those who considered testing but decided not to test or into whether online information can support such decision-making. To date, there have been no population-based studies evaluating whether or not individuals can use information made available online to make an informed decision about testing. These questions can be examined using data generated by the Multiplex Initiative [ ].
The Multiplex Initiative was designed to develop the infrastructure needed to evaluate a multiplex test (ie, a test that includes multiple genetic variants for multiple health conditions) taken by healthy adults insured through a large managed care organization. The study provided the first opportunity to systematically present genetic susceptibility information based upon best communication practices and then to examine individuals’ responses to the information. Despite the fact that testing was offered at no cost and the target population was insured, we reported previously that those who logged on to a study website to consider testing and subsequently elected to be tested were significantly more likely to be college educated and white than those who did not log on or were not interested in testing .
In this report, we pose three specific research questions: (1) How do participants in the Multiplex Initiative engage with different content areas of information provided on the website? (2) How do participants rate the quality and usefulness of the website information? (3) Is website use associated with decisions about genetic testing?
Study Design and Participants
The Multiplex Initiative has previously been described in detail . In brief, study participants were selected from a pool of 350,000 members of a large Midwestern health maintenance organization. Selection criteria included being between the ages of 25 and 40 years, having been enrolled in the plan for at least two years, and not having any of the health conditions included on the Multiplex test. Groups traditionally underrepresented in genetics research (ie, men, blacks, and those with lower education) were oversampled as described in detail elsewhere [ ]. All procedures were approved by the institutional review boards of the National Human Genome Research Institute and the Henry Ford Health System.
A baseline telephone assessment was attempted with 6348 sampled individuals. Of these, 1930 completed the assessment and were invited to visit the study website. Individuals completed a consent process as part of the initial Web module. Participants were told that they would be asked to complete brief questionnaires and to review Web content. A total of 612 individuals visited the website, and 527 completed all four website-based assessments. Although website visitors who did not complete all four assessments were similar to those who completed all assessments based on age, gender, educational attainment, and marital status, white participants were more likely to complete all assessments than black participants (P = .002). Following completion of the website portion of the study, interested individuals completed an in person clinic visit, and then a blood draw was performed on those individuals who decided to undergo testing. The analyses presented here are based on 526 individuals who visited the website, completed all four website assessments, and for whom data regarding the testing decision were available. These 526 individuals had a mean age of 34.6 years. Half (263/526) were white. A majority were female (297/526 or 56.5%), and most were married or in a partnered relationship (336/526 or 63.9%).
The content of the Multiplex Initiative study website was developed by an interdisciplinary team of researchers, drawing on prior research and best practices in health literacy and risk communication. Health literacy principles were used to develop the information content of the website. For example, the scope of the content was limited to what the team considered the most essential information needed to support participant decision-making . In addition, the information was organized using a layered approach [ , ]. Participants were offered a menu of content topics and could then choose the order and amount of content reviewed, allowing those participants who wanted more detailed content to find that information. We avoided using technical jargon where possible (eg, using “risk version” instead of “risk-increasing gene variant”) and defined jargon where it was used (eg, “a risk factor is anything that increases your chance of getting a health condition”). We drew upon prior risk communication research to convey risk information on the website. For example, risk estimates were given using an “n in 100” format, which prior research has shown to convey risk information best to lay individuals [ , ]. In addition, we selected pictograph graphics to visually convey the risk information, a type of graphic that has been shown to convey this information to lay audiences more effectively than alternative graphic formats [ ].
The website content was organized into four modules: (1) Multiplex Genetic Testing: What it Can and Cannot Tell You; (2) Diseases and Genes on the Multiplex Genetic Test; (3) Your Rights if You Take Part in Multiplex Genetic Research; and (4) Your Decision to be Tested or Not (see). Two examples of website pages are shown in and . The participants received small incentives (gift cards up to US $50 from a national retail chain) for completing the website assessments.
Each study participant was given a unique log-in ID/password pair that enabled their visit to the Multiplex website to be tracked. Each time a page on the website was accessed, a tracking database stored the participant’s unique log-in ID, the session number for that user (ie, whether this was their first, second, or subsequent visit to the Multiplex website), and the date and time that the page was requested. Log-in IDs were randomly generated and created so that the responses of a particular individual could not be identified.
The measures included in the report were collected at three time points: baseline telephone assessment, website assessments (about 1 to 2 weeks after baseline), and whether individuals attended the clinic visit for a blood draw (up to 60 days after baseline).
The primary outcome variable, ease of decision making, was assessed in the fourth website module (see). Participants were asked on a 7-point Likert scale to “tell us how easy or hard it is for you to decide whether or not to get multiplex genetic testing.” Due to the skewed distribution, responses were dichotomized at the midpoint. The second outcome was whether participants had blood drawn for testing.
The primary predictor variable was the number of website pages viewed for each module. Each page was assigned a value of 0 or 1 depending on whether or not participants viewed that page. The number of pages viewed was then summed overall and within content areas.
Individuals’ perceptions of the content of the second module (see), which described the health conditions and genes on the test, were rated with respect to trustworthiness, satisfactoriness, helpfulness, and clarity of the information (eg, “I trusted that the information presented was true”). Participants indicated strength of agreement with each item on 7-point Likert scales ranging from “strongly disagree” to “strongly agree.” Four items were reverse coded so that “strongly agree” reflected more positive perceptions for all items. The standardized Cronbach alpha was .76.
Covariates assessed were based on the Risk Information Seeking and Processing Model . Sociodemographic covariates included gender, age, educational attainment, race, and marital status. Participants also identified which multiplex health conditions ran in their family. A 6-item measure of genetic self-efficacy was adapted from Parrott et al [ ]. The items (eg, “You would be able to explain to others how genes affect health”) were answered on 7-point Likert scales ranging from “strongly disagree” to “strongly agree.” Health information seeking was assessed using the item, “In the past 30 days, how often would you say you have looked for information about ways to stay healthy or to feel better?” Responses were dichotomized as daily or weekly versus less than weekly or never. Importance of genetic information was assessed with the item, “How important is it to you to learn more about how your genes affect your chance of getting certain health conditions?” Response choices ranged from 1, not at all important to 7, very important.
Data were analyzed using SAS Version 9.2 for Windows (SAS Institute Inc, Cary, NC, USA). Descriptive statistics were first examined for all variables. Differences by the predictor variable, possible mediating variable, and covariates in the two outcome variables were assessed using chi-square tests. We then tested multivariate logistic regression models to evaluate the association of number of pages viewed with the two outcome variables, employing forward checking and backward elimination methods to determine which covariates to include in the final models . We used a P < .20 criterion for inclusion of covariates [ , ]. The potential mediator was tested using the approach of Baron and Kenny [ ]. Statistical significance was assessed as P < .05.
Participant Engagement With Website
Of the 27 possible pages in modules 1 and 2 (), participants viewed, on average, about 8 pages (mean 8.2, standard deviation [SD] 7.2), although the number of pages viewed ranged from 1 to 27. On average, participants viewed about 2.9 of the 4 pages introducing the multiplex test, 2.2 of the 8 pages describing the health conditions on the test, and 3.2 of the 15 pages describing the genes. Over 60% (326/526) of participants viewed the Web page for diabetes, which was the first health condition listed on the website menu. However, less than 25% of participants viewed any of the other health condition pages. Similarly, between 40% and 50% viewed the first gene pages listed on the website menu (for KCNJ11, CAPN10, PPARG, and TCN7L2), but less than 20% viewed any of the other genes pages. Education was the only significant sociodemographic predictor of the number of Web pages viewed in the multivariate model. Participants with a high school degree or less viewed about 3 1/2 pages fewer, on average, than participants with a college degree or higher (beta = -3.52, P < .001), while participants with some college viewed about 2 pages fewer than those with a college degree or higher (beta = -2.10, P = .002).
In bivariate analyses, the number of pages viewed was associated with each of the two outcomes (see). The group of participants who rated their decision to test as easy had looked at more pages within each content area than those who rated the decision as difficult. This difference was about a half page for general test information (P = .001) and health condition information (P = .02) and about a page for gene information (P = .003). Similarly, participants who had blood drawn for the test had viewed more website content than those who declined testing, with differences of about 1 page for information about the test and the health conditions and about 2 pages for information about the genes (P < .001).
Participant Ratings of Quality and Usefulness of Information About Health Conditions and Genes
Participants rated the quality and usefulness of the information about the health conditions and genes positively. These ratings were significantly associated with each of the two outcomes (see). Participants who rated their decision as easy perceived the website information more positively overall than those who rated their decision as difficult (P < .001). This general pattern was also true for individual ratings of trustworthiness of the information (P < .001), satisfaction (P < .001), ease of understanding (P < .001), feeling able to understand the information (P < .001), helpfulness of the information (P < .001), needing minimal effort to understand the information (P < .001), and sufficiency of the information (P = .033). Individuals who decided to test rated the website information more positively than those who declined testing (P < .001). In the individual ratings, participants who decided to test rated the trustworthiness (P = .038), satisfactoriness (P < .001), ease of understanding (P = .010), and helpfulness of the information (P = .001) more positively than those who declined the test.
Association of Website Usage With Decision-Making
As shown in, the number of pages viewed was significantly associated with ease of decision-making in multivariate analyses (odds ratio [OR] 1.04, 95% confidence interval [CI] 1.01-1.07). The results of this model showed that for every page viewed, participants were about 4% more likely to describe their decision as easy, on average, controlling for the sociodemographic and psychological covariates. In this model, genetic self-efficacy and involvement with genetic information were significant covariates. Participants with higher genetic self-efficacy (OR 1.27, 95% CI 1.05-1.52) and who placed greater importance on genetic information (OR 1.18, 95% CI 1.03-1.36) were more likely to describe their decision to test or not as easy.
As shown in, the number of pages viewed also was significantly associated with deciding to test (OR 1.08, 95% CI 1.05-1.11). For every page viewed, participants were about 8% more likely to decide to test, controlling for the sociodemographic and psychological covariates. In this model, education, genetic self-efficacy, and involvement with genetic information were also significant covariates. Individuals with a high school degree or less were about half as likely to be tested compared with those with a college degree or higher (OR 0.51, 95% CI 0.29-0.88). Participants with higher genetic self-efficacy (OR 1.24, 95% CI 1.03-1.50) and those who placed greater importance on genetic information (OR 1.24, 95% CI 1.07-1.44) were more likely to test.
We tested whether perceptions of the quality and usefulness of the information about the health conditions and genes mediated the significant associations of number of pages viewed with decision outcomes. In the first step, we found a low correlation between the number of Web pages viewed and perceptions of the information (r = .097). Therefore, we did not proceed to additional steps to test mediation and concluded that perceptions of the website information did not mediate the associations.
This report describes unique data suggesting how individuals respond to Web-based offers of genetic susceptibility tests. This is especially notable because multiplex genetic susceptibility tests currently being offered by many DTC companies have unknown clinical utility. We examined test decisions in a population-based sample where nearly half of participants who visited the website to consider testing ultimately decided not to be tested. This is in contrast to most of the prior genetic testing literature, in which the majority of study participants already had decided to obtain a genetic test [, ].
Individuals generally had positive perceptions of the quality and usefulness of the website information. Viewing more of the information was associated with finding it easier to decide about testing regardless of whether the individual decided to test or not. Thus, patients found the website helpful in supporting their decision-making—both the decision to test and the decision not to test.
In addition, the results presented here shed light on aspects of the online information that might be most useful in supporting individuals’ decision-making. Participants engaged most with the introductory section that described the test, testing procedures, and what could and could not be learned from the results. This suggests that this information may have been most relevant for their test decisions. In contrast, individuals generally did not delve very deeply into content related to health conditions and gene pages. However, it is noteworthy that participants who described their decision to test as easiest had viewed more of the pages describing the health conditions and genes than those who found it harder to decide. This suggests that more extensive processing about the specifics of the genetic test might have made it easier to decide about testing.
The findings observed here underscore the importance of attending to best communication practices such as layering information in website development. For example, we placed the most important information about the test in the introductory module and then supplemented that with detailed information about each health condition and gene on separate pages. We believe that our observation that participants generally viewed little of the detailed information supports using health literacy best practices. Specifically, the results suggest that information thought to be most essential to individual decision-making be presented first [, ]. By contrast, a recent analysis of websites offering genetic tests directly to consumers showed that there is wide variability in the content, language, and organizational structure of these sites [ ], differences likely to greatly influence their usefulness to consumers.
Despite our attention to health literacy issues (such as reducing technical jargon) in the design of this website, the results showed that educational attainment was the primary predictor of how much information participants viewed. Prior Multiplex Initiative analyses also have shown that educational attainment was associated with whether participants logged onto the website . Supplemental or alternative approaches may be needed to facilitate decision-making among participants with more limited educational attainment or health literacy skills. Individuals with limited health literacy may face substantial challenges in using Web-based information about genomics [ , ], and such consumers might face particular difficulties in making decisions about DTC genetic susceptibility testing [ ]. Other factors may also influence the effectiveness of this type of Web-based educational approach, including computer literacy, genetic literacy, and decision-making preferences, all of which are important areas for future research.
Although this population-based study had many strengths, the limitations should also be considered. The observational design did not allow us to examine the effects of individual Web design features or to investigate the effects of the educational material separately from the cognitive characteristics of the participants. For example, some of the observed results may be affected by educational differences in preferences for (or competencies in) reading lengthier text. These are important issues that could be considered in experimental lab-based studies, perhaps with analyses stratified by educational attainment or cognitive characteristics such as information seeking preferences. Similarly, we were not able to drill down to specific information content and decisions about testing. In addition, although we initially drew a population-based sample, participants who logged on to consider genetic testing were more educated and savvier Internet users. Thus, these results may not generalize beyond these early adopters.
The results of this analysis show that consumers perceived a carefully designed website consistent with best practices in communication to be helpful in deciding about genetic susceptibility testing. Critical next steps in this area will be to examine individuals’ understanding and interpretation of such website information and how it affects responses to test feedback. For example, is better understanding of the limitations of genetic susceptibility testing associated with more accurate interpretations of test feedback?
As genomic discovery advances, Web-based delivery likely will continue and expand as an avenue for education and decision support regarding genetic testing. These results suggest that individuals perceive Web-based tools designed based on evidence-based communication approaches as supporting decision-making about genetic testing in some target groups. However, continued research is needed to ensure that these tools or other appropriate decision support approaches are available to all groups including those having lower literacy.
This research was supported by the Intramural Research Program of the National Human Genome Research Institute (NHGRI), National Institutes of Health. In addition, this research was made possible through collaboration with the Cancer Research Network, funded by the National Cancer Institute (U19 CA 079689). Additional resources were provided by Group Health Research Institute and Henry Ford Hospital. Genotyping services were provided by the Center for Inherited Disease Research (CIDR). CIDR is fully funded through a federal contract from the National Institutes of Health to The Johns Hopkins University (HHSN268200782096C). We also thank the members of the Multiplex Steering Committee (Drs Robert Reid, Eric Larson, and Sharon Kardia) who provided their critical review of this paper. David Kanney, Mark Fredriksen, David Farrell, and Gretchen Gibney were invaluable members of the website development team. We also thank Andrea Kalfoglou for her assistance. Our thanks also go to the study participants who were all members of the Henry Ford Health System.
Conflicts of Interest
- McBride CM, Alford SH, Reid RJ, Larson EB, Baxevanis AD, Brody LC. Putting science over supposition in the arena of personalized genomics. Nat Genet 2008 Aug;40(8):939-942 [FREE Full text] [CrossRef] [Medline]
- Collins FS, Green ED, Guttmacher AE, Guyer MS. A vision for the future of genomics research. Nature 2003 Apr 24;422(6934):835-847. [CrossRef] [Medline]
- Topol EJ, Murray SS, Frazer KA. The genomics gold rush. JAMA 2007 Jul 11;298(2):218-221. [CrossRef] [Medline]
- Katsanis SH, Javitt G, Hudson K. Public health. A case study of personalized medicine. Science 2008 Apr 4;320(5872):53-54. [CrossRef] [Medline]
- McBride CM, Alford SH, Reid RJ, Larson EB, Baxevanis AD, Brody LC. Characteristics of users of online personalized genomic risk assessments: implications for physician-patient interactions. Genet Med 2009 Aug;11(8):582-587. [CrossRef] [Medline]
- Hensley Alford S, McBride CM, Reid RJ, Larson EB, Baxevanis AD, Brody LC. Participation in genetic testing research varies by social group. Public Health Genomics 2010 Mar 18. [CrossRef] [Medline]
- Hunter DJ, Khoury MJ, Drazen JM. Letting the genome out of the bottle--will we get our wish? N Engl J Med 2008 Jan 10;358(2):105-107. [CrossRef] [Medline]
- Gollust SE, Hull SC, Wilfond BS. Limitations of direct-to-consumer advertising for clinical genetic testing. JAMA 2002 Oct 9;288(14):1762-1767. [Medline]
- Wasson K, Cook ED, Helzlsouer K. Direct-to-consumer online genetic testing and the four principles: an analysis of the ethical issues. Ethics Med 2006;22(2):83-91. [Medline]
- Ensenauer RE, Michels VV, Reinke SS. Genetic testing: practical, ethical, and counseling considerations. Mayo Clin Proc 2005 Jan;80(1):63-73 [FREE Full text] [Medline]
- Geransar R, Einsiedel E. Evaluating online direct-to-consumer marketing of genetic tests: informed choices or buyers beware? Genet Test 2008 Mar;12(1):13-23. [CrossRef] [Medline]
- Goddard KA, Robitaille J, Dowling NF, Parrado AR, Fishman J, Bradley LA, et al. Health-related direct-to-consumer genetic tests: a public health assessment and analysis of practices related to Internet-based tests for risk of thrombosis. Public Health Genomics 2009;12(2):92-104 [FREE Full text] [CrossRef] [Medline]
- Horrigan J. Home Broadband Adoption 2006. Washington, DC: Pew Internet & American Life Project; 2006 May 27. URL: http://www.pewinternet.org/Reports/2006/Home-Broadband-Adoption-2006.aspx?r=1 [WebCite Cache]
- Sanderson SC, O'Neill SC, White DB, Bepler G, Bastian L, Lipkus IM, et al. Responses to online GSTM1 genetic test results among smokers related to patients with lung cancer: a pilot study. Cancer Epidemiol Biomarkers Prev 2009 Jul;18(7):1953-1961 [FREE Full text] [CrossRef] [Medline]
- Birru MS, Monaco VM, Charles L, Drew H, Njie V, Bierria T, et al. Internet usage by low-literacy adults seeking health information: an observational analysis. J Med Internet Res 2004 Sep 3;6(3):e25 [FREE Full text] [CrossRef] [Medline]
- Kaphingst KA, Zanfini CJ, Emmons KM. Accessibility of web sites containing colorectal cancer information to adults with limited literacy (United States). Cancer Causes Control 2006 Mar;17(2):147-151. [CrossRef] [Medline]
- Johnson JD, Case DO, Andrews JE, Allard SL. Genomics--the perfect information-seeking research problem. J Health Commun 2005 Jun;10(4):323-329. [CrossRef] [Medline]
- Lachance CR, Erby LA, Ford BM, Allen VC J, Kaphingst KA. Informational content, literacy demands, and usability of websites offering health-related genetic tests directly to consumers. Genet Med 2010;12(5):304-312. [CrossRef] [Medline]
- Ropka ME, Wenzel J, Phillips EK, Siadaty M, Philbrick JT. Uptake rates for breast cancer genetic testing: a systematic review. Cancer Epidemiol Biomarkers Prev 2006 May;15(5):840-855 [FREE Full text] [CrossRef] [Medline]
- Hadley DW, Jenkins J, Dimond E, Nakahara K, Grogan L, Liewehr DJ, et al. Genetic counseling and testing in families with hereditary nonpolyposis colorectal cancer. Arch Intern Med 2003 Mar 10;163(5):573-582 [FREE Full text] [Medline]
- Doak C, Doak L, Root J. Teaching Patients with Low Literacy Skills, 2nd edition. Philadelphia, PA: J B Lippincott Company; 1996.
- US Department of Health and Human Services. Usability.gov. 2006. Research-Based Web Design & Usability Guidelines URL: http://www.usability.gov/guidelines/ [WebCite Cache]
- Lipkus IM, Hollands JG. The visual communication of risk. J Natl Cancer Inst Monogr 1999(25):149-163. [Medline]
- Fagerlin A, Ubel PA, Smith DM, Zikmund-Fisher BJ. Making numbers matter: present and future research in risk communication. Am J Health Behav 2007;31 Suppl 1:S47-S56. [CrossRef] [Medline]
- Griffin RJ, Dunwoody S, Neuwirth K. Proposed model of the relationship of risk information seeking and processing to the development of preventive behaviors. Environ Res 1999 Feb;80(2 Pt 2):S230-S245. [CrossRef] [Medline]
- Parrott R, Silk K, Raup Krieger J, Harris T, Condit C. Behavioral health outcomes associated with religious faith and media exposure about human genetics. Health Commun 2004;16(1):29-45. [CrossRef] [Medline]
- Hosmer D, Lemeshow S. Applied Logistic Regression. New York, NY: John Wiley and Sons, Inc; 2000.
- Maldonado G, Greenland S. Simulation study of confounder-selection strategies. Am J Epidemiol 1993 Dec 1;138(11):923-936. [Medline]
- Budtz-Jørgensen E, Keiding N, Grandjean P, Weihe P. Confounder selection in environmental epidemiology: assessment of health effects of prenatal mercury exposure. Ann Epidemiol 2007 Jan;17(1):27-35. [CrossRef] [Medline]
- Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol 1986 Dec;51(6):1173-1182. [Medline]
|CIDR: Center for Inherited Disease Research|
|NHGRI: National Human Genome Research Institute|
Edited by G Eysenbach; submitted 16.06.10; peer-reviewed by C Condit, CMY Yang, J Pramanik; comments to author 06.07.10; revised version received 17.07.10; accepted 04.08.10; published 29.09.10
The substantive content of this work is a U.S. Government work product and not subject to copyright.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.