Bibliographic data for the analysis were all acquired from the Web of Science Core Collection, which includes the Science Citation Index Expanded, Social Science Citation Index, and Emerging Source Citation Index [9]. To perform a comprehensive literature search of immune checkpoint inhibitors in melanoma, we designed a systematic search strategy. Generally, the search strategy was as follows: (TS=(ipilimumab OR pembrolizumab OR nivolumab OR immunotherapy OR “immune checkpoint blockade” OR PD-1 OR PD-L1 OR CTLA-4) OR TI=(ipilimumab OR pembrolizumab OR nivolumab OR immunotherapy OR “immune checkpoint blockade” OR PD-1 OR PD-L1 OR CTLA-4 OR yervoy OR Keytruda OR opdivo) OR AB=(ipilimumab OR pembrolizumab OR nivolumab OR immunotherapy OR “immune checkpoint blockade” OR PD-1 OR PD-L1 OR CTLA-4 OR yervoy OR Keytruda OR opdivo)) AND (TS=(melanoma OR melanocarcinoma) OR TI=(melano* OR melanoma OR melanocarcinoma) OR AB=(melano* OR melanoma OR melanocarcinoma)). The language was restricted to English and the document type was limited to articles and reviews. The time span of the search excluded the year 2022 for clearer annual results.

A total of 24,093 documents were retrieved from the Web of Science Core Collection. After excluding documents that were published as preprints in 2021 and then published as final versions in 2022 and documents with an unknown publication date, 24,086 documents remained in the bibliometric analysis and visualization. The search details are presented as a flowchart (Figure 1). The search was completed on December 6, 2021.

The retrieval characteristics used for publications on ICB for melanoma included the distribution of publication year, country and region, organization, journal, core authors, keywords, and key references. The detailed search strategy is shown in Multimedia Appendix 1. Bibliometric analysis and network visualization were performed with VOSviewer (version 1.6.14, Leiden University), CiteSpace (version 5.7.R5W, Drexel University), and the bibliometrix package in R (version 3.6, R Foundation). The bibliometrix package was used for data extraction and visualization of the distribution of publication year and the top 10 core authors. The keywords citation burst analysis and cocitation network analysis were performed with CiteSpace. The Gunn online world map was used to evaluate the distribution of countries and regions. Ranking was performed using the standard competition ranking method. Other analyses, including the coauthorship analysis, co-occurrence analysis, and visualization, were conducted with VOSviewer.

Figure 2 shows the chronological distribution of publications by year as a bar chart (Figure 2A). From 1999 to 2013, the annual number of publications steadily grew, with no obvious research trends, and remained relatively stable. The annual number of publications then rose sharply from 2015 to 2020. Figure 2B shows the total, cumulative number of publications as a plot. There was a relatively slow increase in the cumulative number of publications from 1999 to 2015, with the number of publications growing sharply from 2015 to 2017 onwards; the peak either occurred in 2020 or has yet to occur.

As for geographical distribution, 24,086 documents were published from 117 different countries and regions. Studies involving multiple countries were included in the analysis, with each country being counted individually. We classified documents by country and visualized the spatial distribution as a heatmap (Figure 3). Table 1 lists the top 12 most prolific countries. In total, the country with the largest number of publications was the United States (11,113/24,086 publications, 46.1%), far surpassing China (2345/24,086 publications, 9.7%) and Germany (2223/24,086 publications, 9.2%). As for citations, America was also far ahead. It is interesting that although China had the second largest number of publications, the number of citations lagged far behind other countries, which made the number of citations per publication rather small.

The information on leading organizations was analyzed with VOSviewer. Generally, 24,086 documents were published by 13,359 different organizations. After merging duplicates and excluding disjointed organizations, a final total of 243 organizations met the inclusion threshold and are shown in the visualization. The top 10 most productive organizations are listed in Table 2. The most prolific organization was the Memorial Sloan Kettering Cancer Center (903/24,086 publications, 3.7%), followed by the University of Texas MD Anderson Cancer Center (859/24,086 publications, 3.6%) and the National Cancer Institute (645/24,086 publications, 2.7%). Among the top 10 institutions, 9 of 10 were from the United States, which corresponded to the distribution by country and region. We also conducted a coauthorship analysis of the organizations (Figure 4). We found that all 243 top published institutions were grouped into clusters, with each cluster representing approximately one country, except for the United States, which dominated 2 clusters and had wide correlations. The red and lower yellow clusters mainly represent American institutions, including Memorial Sloan Kettering Cancer Center, the MD Anderson Cancer Center, and the National Cancer Institution. The blue cluster represents Johannes Gutenberg University, in Germany. The upper yellow cluster represents universities and institutions in France. The green cluster includes other European countries and Australia. Two rather further away clusters mainly represent Japan and Korea, in light blue, and China, in purple, with few links with other clusters. This result suggests that the United States apparently led this topic and that international cooperation among various institutions from different countries should be strengthened, especially for institutions in China, Japan, and Korea.

Core journals were identified by analysis of publication sources. After analyzing bibliographies, we extracted the top 10 most prolific journals along with their impact factor (IF) in 2020 and 2021 in the field of ICB for melanoma (Table 3). We found that the most prolific journal was the Journal of Clinical Oncology (impact factor 44.544), which ranked first, with 1051 documents published. The second and the third most-prolific journals were Cancer Immunology, Immunotherapy (677 publications, IF 6.958) and Cancer Research (627 publications, IF 12.701). IF for the top 10 most prolific journals in 2019 ranged from 4.456 for the Journal of Immunology to 44.544 for the Journal of Oncology. Our findings for the total number of publications and IF suggest that Cancer Research might be the most influential journal in the field of ICB for melanoma.

Information on authors and co-authors was also analyzed with VOSviewer. A total of 24,086 publications were produced by a total of 93,587 authors. The 3 most important evaluation criteria for core authors included the number of published documents, total citations, and the H index. Therefore, we extracted and visualized the top 10 most prolific authors according to these criteria (Table 4 and Figure 5). Paolo A Ascierto, the director of the Unit of Melanoma, Cancer Immunotherapy and Innovative Therapy at the National Tumour Institute, Fondazione G. Pascale, was the most productive author in this field, publishing 312 articles and being cited 10,756 times in general, followed by F Stephen Hodi, the director of the Melanoma Center and Center for Immuno-Oncology of the Dana-Farber/Brigham and Women’s Cancer Center, with 301 publications and 35,302 total citations, and Caroline Robert, from the Institut de Cancérologie Gustave Roussy. Five of the top 10 cited authors were from the United States, and interestingly, the top 10 most productive authors together accounted for 9.1% of the total literature, showing the dominance of the United States in this research field. It is to be noted that Georgina V Long of Australia (190 publications), Dirk Schadendorf of Germany (184 publications), and Reinhard Dummer of Switzerland (152 publications) occupied places 6, 7 and 9 in the table, which, combined with the previous findings on geographical distribution, indicate that these countries also have important research roles in the field of ICB for melanoma.

Figure 5 is an overlay visualization of the coauthorship relationships between authors. A total of 93,587 authors were analyzed, of whom 135 met the inclusion threshold. The visualization suggested that most of the top influential authors, such as Jedd D Wolchok, F Stephen Hodi, and Antoni Ribas, had close collaborations. In addition, we found the average year of publication for these authors was between 2015 and 2016, while other authors, such as Georgina V Long, published more actively after 2018, which may suggest that they have the potential to take the lead in the future.

In total, 30,486 keywords were extracted from 24,086 documents after removing duplicates. We used a network and overlay visualization of author-given keywords to analyze the co-occurrence of keywords. A total of 30,486 keywords were analyzed, of which the 180 most frequently occurring that met the inclusion threshold were grouped into 2 clusters (Figure 6A) and grouped by date of publication (between 2016 and 2018) (Figure 6B). The date range for publication was chosen to correspond to the high-growth phase of publication seen in Figure 2. For the network map, the keywords were mainly distinguished into 2 clusters. One mainly represented keywords related to tumor biology and the early, discovery stages of research into immunotherapy as a potentially promising modality for melanoma. These keywords are shown in red and include “antigen,” “dendritic cells,” “T cells,” “tumor microenvironment,” “immunotherapy,” “immune checkpoint,” “melanoma,” and “metastatic melanoma.” The other cluster, shown in green, generally included terms related to clinical oncology issues, including the names of US Food and Drug Administration (FDA)-proven antibodies, such as “nivolumab,” “pembrolizumab,” “atezolizumab,” and “ipilimumab”; words related to outcomes, such as “efficacy,” “safety,” and “adverse event”; and keywords that appear frequently in phase II and phase III trials, such as “survival,” ”safety,” “double-blind,” “open-label,” and “multi-center.” Interestingly, this cluster included nearly all the keywords related to targeted therapies and radiotherapy, such as “BRAF,” “MEK,” “vemurafenib,” and “dabrafenib,” as well as the names of other types of cancer, the novel usages of immunotherapy words, such as “combination” and “adjuvant therapy,” and multiple indicators for evaluating efficacy and safety. It might be the case that these interventions are now establishing more links with immunotherapy and will potentially become research hot spots in the future. The overlay map of keywords grouped by date of publication showed that research hot spots changed over time, starting with “target therapy” and moving on to “CTLA-4 inhibitor,” “PD-1/PD-L1 inhibitor,” and “FDA-proven ICB,” which is similar to the order in which these technologies developed.

Figure 7 shows the top 25 keywords with the strongest frequency burst, which suggests a keyword that has undergone a great change in a short period of time (as analyzed with CiteSpace). “Dendritic cell,” “in vivo” and other mechanism- and trial-related keywords had rather stronger strength, which continued from 2011 to 2015, suggesting that possible mechanisms and clinical applications were a sustained research hot spot for these years. However, in the most recent 5 months, the burst keywords changed to include terms such as “safety,” “combined therapy,” and “stage III trial”, suggesting that the interests of the researchers changed.

The number of citations of the publications was mainly extracted with bibliometrix. The top 10 most highly cited documents were extracted and are listed in Table 5. Generally, the number of citations ranged from 3037 to 9113. An article published in the New England Journal of Medicine titled “Improved survival with ipilimumab in patients with metastatic melanoma” ranked first, with 9113 total citations. Only one of the top 10 articles was a review (“The Blockade of Immune Checkpoints in Cancer Immunotherapy,” published in Nature Reviews Cancer in 2012). It is likely that this review was cited so often because it was the first comprehensive review of this topic. A total of 7 of the 9 articles were published in the New England Journal of Medicine. This shows the dominant position of this journal in the publication of research in the medical category, especially in the publication of high-quality research.

For a comprehensive analysis of citations, we used CiteSpace (version 5.8R3) to evaluate cocitation references (Figure 8). we performed a cocitation analysis of references from 2010 to 2020. In CiteSpace, the size of a circle indicates the number of documents cited. The purple area of the circle indicates the centrality of a document. The analysis revealed no significant centrality in the documents, indicating that the literature was largely scattered.

This study updates current knowledge on research interests related to ICB for melanoma, providing researchers and physicians an overview of the landscape of the field and potential future research hot spots. We conducted a comprehensive search of literature published on this topic before December 2021 in the Web of Science Core Collection. We retrieved 24,086 bibliographies and performed a bibliometric analysis.

First, using the bibliometric method, we analyzed chronological trends in the publications. The results show that from 1999 to 2013, the annual number of publications was rather small, with a small, linear slope of growth. The number of newly published papers from 1999 to 2013 remained under 200, with rather small growth every year. The next period was from 2014 to 2016, when publications related to ICB grew rapidly. The annual number of publications grew to over 1000, but did not reach 2000, which is consistent with previous research [19]. The third period was from 2017 to 2021, when the annual number of publications grew to over 2000, representing maturity in the theoretical aspect of this field. The number of publications has continued to increase, and the topic has gradually become a hot spot.

The chronological trend was reflected in several critical articles and specific time points, which enables us to reveal the roadmap for this field. The very first research on ICB was on CTLA-4 blockade, which was conduced beginning in 1987 and was first proved in 2011 [20,21]. The recombinant human immunoglobulin G1 and G2 monoclonal antibodies of CTLA-4, known as ipilimumab and tremelimumab, respectively, were trialed in melanoma and other advanced cancers, and both showed good efficacy [10,22-31]. As for PD-1 and PD-L1, since the very first paper on PD-1 was published in 1991, the annual number of publications remained less than 5 for a long period, from 1999 to 2003. The annual number of publications did not reach 300 until a breakthrough on cancer immunotherapy in 2013 [32]. After that, the FDA approved anti-PD-1 antibodies (pembrolizumab and nivolumab) for advanced metastatic melanoma in 2014 and an anti-PD-L1 antibody (atezolizumab) in 2016. After that, the number of publications rapidly increased, reaching the thousands [33-35]. Our results for chronological distribution, unsurprisingly, suggest that the topic of ICB for melanoma has gradually become a research hot spot, and that it is currently in a major development period. Theory developed rapidly during this period, and the number of papers increased rapidly. Moreover, the growth curve was sharp and the gradient of the curve did not slow down during 2020. We predict that this field will continue to develop in the next few years.

As for geographical distribution, among the 80 different countries and regions involved in this bibliometric analysis, the most prolific are listed in Table 2. The United States published most of the documents in this field, and Table 5 indicates that nearly all core documents were produced in partnership with American institutions [10-19]. China is the second most prolific country, but considering the number of citations, China is still far from taking the lead in this area. Other countries with a high number of publications, such as Japan, Australia, and various European counties, have a good scientific base in this field. The situation is also reflected in the most productive organizations and the most productive authors; 9 of the 10 most productive organizations and 6 of the 10 most productive authors are from the United States, which has proven the dominance of the United States in this research field.

For the most productive journals, considering the evidence for the total number of publications and IF, the Journal of Clinical Oncology might be the most influential journal in the topic of immune checkpoint inhibitors in melanoma. Papers published by the Journal of Clinical Oncology in 2021 included several that mainly concentrated on the long-term outcomes of ICB [36], the combination of ICB and other therapies, and expansion of the indications for ICB [37,38]. We also compared the IF in 2020 and 2021 in core journals in the field of ICB for melanoma and found that the IF of all top 10 core journals grew. However, considering that oncology journals generally had increased IFs in these years, we cannot make the conclusion that all journals increased their impact.

In the aspect of cooperation between authors, the network analysis showed that most cooperation took place within countries, and that there was little cooperation between countries. The same phenomenon was also revealed by a coauthorship analysis of organizations, in which clusters showed intricate connections within countries and lesser connections between clusters. These findings suggest that cooperation between states represents an area that should be strengthened.

We also performed analysis of keywords and burst terms to investigate research trends, finding that the change in focus was remarkable. Generally, research trends and the public interest changed in two major aspects: from the laboratory to translational medicine and clinical research, as well as from early ICB developments, such as CTLA-4, to later ones, such as PD-1 and PD-L1 blockades. The focus of research gradually changed from mechanisms to efficacy and adverse events. This indicates that the theory was becoming mature and that the application of ICB therapy was being explored, including enhancing its efficacy, reducing its adverse effects, and expanding its use to other, more specific cancer types [39].

From the initial research on the mechanisms of immunotherapy, including the alteration of immune cells and immune molecules under ICB treatment to subsequent translational, clinical research into the interactions of immune checkpoints with costimulatory molecules, cancer drive genes, and cancer hallmarks, studies investigating the mechanism of ICB have been maturing. In the next several years, screening of biomarkers to predict treatment efficacy and adverse events, improve the efficacy of ICB and reduce adverse events, explore drug combinations, and extend the indications for ICB might become hot spots in this clearly evolving field of research.

As far as we know, this is the first study to use a bibliometric analysis to investigate research trends and public interest in ICB for melanoma. Our bibliometric analysis was much more comprehensive and intuitive than a literature review would have been, because of our use of systematic searching and quantitative statistical analysis. Moreover, we used not only CiteSpace, but also VOSviewer and the R package bibliometrix for better data extraction, bibliometric analysis, and visualization. However, this study still has some limitations. We only extracted literature from the Web of Science Core Collection database, and although this approach left little possibility for ignoring some of the documents, this type of literature might have had fewer citations. Furthermore, the bibliometric analysis methods we used can only be applied to general information, rather than full texts. Thus, we might have lost important information that only existed in the full text of the articles, such as the authors’ points of view and their prospective opinions of the field.

Our bibliometric analysis should help researchers to understand the trends and public interest in ICB for melanoma. The annual number of publications was rather small, without obvious research trends at the beginning of this century, but has gradually matured in the past 6 years. In the past 2 decades, the United States has contributed the most to this field, followed by China and Germany. The top 3 most productive journals were the Journal of Clinical Oncology, Cancer Immunology, and Immunotherapy and Cancer Research. Cooperation between authors and organizations from different countries needs to be strengthened. In summary, ICB for melanoma is a prolific, fast-growing, and high-profile topic and more research is expected to refine knowledge in this field.