Letter to the Editor
Comment on: https://www.jmir.org/2021/3/e24870/
We thank all comments and critical insights on our study, “Machine Learning for Mental Health in Social Media: Bibliometric Study” . In this letter, we responded to the discussion points raised by Resnik and colleagues [ ].
First, Resnik et al  pointed out the limited scope of the search query selected in our bibliometric study, which concealed the approaches taken in the clinical research field. We agree that the search query may seem to be lacking in covering clinical research; however, we did not intend to distort the recent trends in machine learning for mental health in social media. Moreover, considering that publication venues including the Journal of Medical Internet Research, BMJ Open, International Journal of Environmental Research and Public Health, Frontiers in Psychiatry, and Frontiers in Psychology were listed as productive publication sources in the analysis results, we believe that the publications employed in our analysis cover the invaluable research methodologies in the medical research area. The completed list of retrieved publications can be found in the appendix [ ].
Moreover, Resnik et al  also stated that the machine learning–related terms in the search query lean toward specific technological methodologies, which may not include solutions including screening, risk assessment, and monitoring. We could not agree more with their point of view on the importance of practical works applied to “real” clinical settings. However, since such approaches directly related to diagnosis or treatment required careful consideration, we had difficulties fully diving into it. Thus, we want to stress that the main focus of our research was to help clinical researchers and field affiliates understand the technical needs of machine learning, which we believe is necessary for the initiation phase of this research field. Besides, we conducted a thorough trend review analysis of highly cited papers to provide a more in-depth understanding of related research fields [ ].
We appreciate the suggestions on keywords for the search query to include “clinical psychology,” “psychiatry,” and “computational linguistics.” This led us to consider interviewing domain experts to set more domain-specific keywords in future research, following the procedure of the previous bibliometric study .
Third, Resnik and colleagues  raised concerns about only using indexing services and excluding search engines such as Google Scholar. Considering the rapidly changing trends in this research area, we employed both Web of Science and Scopus for the analysis to cover not only journal publications but conference proceedings. Nevertheless, we acknowledge Resnik and colleagues’ concern and also mentioned the need to employ other medical-oriented databases, which may provide more significant academic and practical information in the Discussion section. We would also like to take this opportunity to recap the importance of nonpublished work by sharing a preprint paper in this research field [ ], which helped us to take a step toward future research on applying machine learning and social media in mental health counseling.
We hope our analysis may trigger all stakeholders to further consider how to employ machine learning approaches toward mental health in social media and be a support to bridge the gap between technologists and clinicians.
This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ICAN (ICT Challenge and Advanced Network of HRD) program (IITP-2020-0-01816) supervised by the IITP (Institute of Information & Communications Technology Planning & Evaluation). This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (NRF-2020R1C1C1004324).
Conflicts of Interest
- Kim J, Lee D, Park E. Machine Learning for Mental Health in Social Media: Bibliometric Study. J Med Internet Res 2021 Mar 08;23(3):e24870 [FREE Full text] [CrossRef] [Medline]
- Resnik P, De Choudhury M, Schafer Musacchio K, Coppersmith G. Bibliometric Studies and the Discipline of Social Media Mental Health Research. Comment on "Machine Learning for Mental Health in Social Media: Bibliometric Study". J Med Internet Res 2021 Jun;23(6):e28990. [CrossRef]
- Wohlin C. An analysis of the most cited articles in software engineering journals—1999. Information and Software Technology 2005 Dec;47(15):957-964. [CrossRef]
- Kalantari A, Kamsin A, Kamaruddin H, Ale Ebrahim N, Gani A, Ebrahimi A, et al. A bibliometric approach to tracking big data research trends. J Big Data 2017 Sep 29;4(1):1. [CrossRef]
- Harrigian K, Aguirre C, Dredze M. On the State of Social Media Data for Mental Health Research. arXiv. Preprint posted online Nov 10, 2020 2021 [FREE Full text]
Edited by T Derrick; This is a non–peer-reviewed article. submitted 15.04.21; accepted 13.05.21; published 17.06.21Copyright
©Jina Kim, Daeun Lee, Eunil Park. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.06.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.