A wealth of information on clinical trials has been provided by publicly accessible online registries. Information technology and data exchange standards enable rapid extraction, summarization, and visualization of information and derived knowledge from these data sets. Clinical trials data was extracted in the XML format from the National Library of Medicine ClinicalTrials.gov site. This data includes categories such as 'Summary of Purpose', 'Trial Sponsor', 'Phase of the Trial', 'Recruiting Status', and 'Location'. We focused on 645 clinical trials related to cancer vaccines. Additional facts on cancer types, including incidence and survival rates, were retrieved from the National Cancer Institute Surveillance data.
This application enables rapid extraction of information about institutions, diseases, clinical approaches, clinical trials dates, predominant cancer types in the trials, clinical opportunities and pharmaceutical market coverage. Presentation of results is facilitated by visualization tools that summarize the landscape of ongoing and completed cancer vaccine trials. Our summaries show the number of clinical vaccine trials per cancer type, over time, by phase, by lead sponsors, as well as trial activity relative to cancer type and survival data. We also have identified cancers that are neglected in the cancer vaccine field: bladder, liver, pancreatic, stomach, esophageal, and all of the low-incidence cancers.
We have developed a data mining approach that enables rapid extraction of complex data from the major clinical trial repository. Summarization and visualization of these data represents a cost-effective means of making informed decisions about future cancer vaccine clinical trials.
The World Health Organization's Global Burden of Disease statistics identified cancer as the second largest global cause of death, after cardiovascular disease . Cancer is the fastest growing segment of the disease burden; global cancer deaths are projected to increase from 7.1 million in 2002 to 11.5 million in 2030 . Advances in prevention, diagnostics and treatment of cancer have contributed to the improved prognosis for cancer patients: one third of cancers are preventable and another third are curable through early detection and effective therapy . New cancer therapies are subject of vigorous research including the application of new high-throughput biomedical technologies that generate large amounts of data. The related information explosion mandates the use of biomedical bioinformatics.
Researchers and clinicians need rapid access to multiple types of information, including molecular, clinical, and literature databases, and clinical trials registries, as well as suitable data analysis tools. The National Center for Biotechnology Information (NCBI) hosts resources for retrieval and analysis of bio-molecular data. These are accessible through the NCBI's web site . Clinical trials data are available through clinical trials registries. Since 1971, regulatory efforts on clinical trials registration have resulted in a significant level of compliance by both sponsors and conductors of clinical trials . ClinicalTrials.gov  has emerged as the largest registry in the world . Currently it contains information on 50,000 clinical trials including 16,000 cancer-related entries. The US National Cancer Institute (NCI) provides access to a clinical trials registry within the Physician Data Query (PDQ) database . The PDQ contains (Dec 2007) 21,000 abstracts of cancer-related clinical trials and regularly exchanges data with the ClinicalTrials.gov registry. Data sharing and direct access to resources (researchers, computers, software, data, research participants, and other) are considered critical for the advancement of cancer research and the improvement of health care. The initiatives such as Cancer Research Network  and Cancer Biomedical Informatics Grid  provide the framework for integration of various data types and tools for cancer research. Standardized data formats (e.g. demographics, health plan eligibility, tumor registry, inpatient and ambulatory utilization, medication dispensing, laboratory tests, imaging procedures, others)  facilitate access to and sharing of data and automated analysis.
Knowledge discovery from databases, also known as data mining, is an emerging field that applies techniques from databases, statistics and artificial intelligence to extract high-level information (knowledge) from a large volume of low-level data. Examples of high-level information derived from low-level data include forms that are more compact (e.g., short reports), more abstract (e.g., descriptive models of the process that generated data), or more useful (e.g., predictive models for estimating values of the future cases) than existing low-level data . Mining clinical trials data usually refers to using statistical and modeling tools for analysis and design of clinical trials. If appropriate clinical trials data (e.g. aims, goals, regimens and conditions, end points, sample sizes, and others) are stored in the registry, data mining can help design better, more efficient trials that require smaller patient cohorts. Standardized data formats, such as XML markup language , bring text files into machine-readable form, thus enhancing automated analysis. Both NCI PDQ and ClinicalTrials.gov provide clinical trial registry data in the XML format.
We have developed a data mining approach for rapid summarization and visualization of information from clinical trial registries. This method has been applied to the analysis of cancer vaccine trials and provides convenient means of extraction and presentation of key data about cancer vaccine trials. The significant progress in cancer biology and cancer immunology has not yet been fully translated into successful clinical vaccine applications . Though advances in cancer vaccine development have been reported [e.g. [14, 15]], a wide variety of factors are involved in tumor immune escape, making design and production of effective therapeutic vaccines difficult. Increasing knowledge of possible limiting factors include, among others, dysfunction of the immune system, immunosuppressive effects of tumor microenvironment, production of suppressor T cells, defective antigen processing and presentation, and immunotherapy resistance of established tumors. To utilize the accumulated data and knowledge and translate these into improved clinical trials, integration of basic and clinical immunology and improved data processing capabilities is required. Our data mining approach provides better understanding of the cancer vaccine clinical trials landscape, and enables rapid analysis of the hotspots of cancer vaccine activity, as well as the identification of neglected cancers. This report describes the utility of basic data mining techniques of summarization, tabulation, and visualization applied to the clinical trials repository data.
Cancer vaccine trials data mining questions
A key characteristic of our application is its versatility; questions can be formulated and re-formulated rapidly. A complex, composite question also can be defined directly from the interface using several mouse clicks. This application has been designed to dynamically generate graphs, summarizing data across relevant clinical trials.
Our application supports formulating basic questions and queries. A representative, yet not exhaustive list of basic questions and queries is shown in Table 1. Answers to questions such as "How has the cancer vaccine field evolved in the last ten years?" and "How many cancer vaccine trials have been conducted; how many of them are currently open in the United States?" offer a historical view of the vaccine trials field. Similarly, answers to questions like "What cancer types are currently researched in clinical trials?" and "What phase are these trials?" offer an up-to-date view of the cancer vaccine field. In addition, this application helps answer more specific questions such as "How many breast cancer vaccine trials were conducted by Dana-Farber Cancer Institute's Cancer Vaccine Center and what types of vaccines were used for those trials?"
The versatility of this system enables the analysis of various dimensions of the clinical trials landscape, including clinical trials by timeline, type of cancer, lead institution, patient population, and/or specific vaccine technology.
Trials over time
Figure 1 summarizes the number of clinical cancer vaccine trials conducted in the US each year during the last 30 years. The first autologous tumor cell vaccine was used in a lung cancer trial as early as 1971 at the University of Medicine and Dentistry in New Jersey. Clinical trials using vaccine technology gradually re-emerged in the early 1990s, and the field grew rapidly until 2000, with more than 30 vaccine trials starting in that year. Since then new cancer vaccine trials have shown a steady increase reaching more than 60 new vaccine trials each year. Most of the earlier trials were phase I and II. The number of phase III clinical vaccine trials has increased steadily during the past three years.
Types of cancers most often targeted by vaccine strategy
Clinical vaccine trials by cancer type and trial phase are shown in Table 2. The top five cancers targeted by vaccine therapy in clinical trials are: melanoma, cervical, prostate, breast, and leukemia. Melanoma has attracted by far the most attention among cancers; nearly a quarter of all clinical vaccine trials target melanoma. Cervical cancer is second, with 10% of total vaccine trials. In addition, each of prostate, leukemia, breast, lung, lymphoma, and kidney cancers has been studied in more than twenty clinical vaccine trials. Phase III clinical vaccine trials of cervical cancer vaccines represent the largest group making 47% of the total number trials.
Institutions and corporations most active in developing cancer vaccines
The breakdown of institutions that are major lead sponsors of cancer vaccine trials, the total number of trials, and trial phases, are shown in Figure 2a. The cancer centers that are included in this list are well known for provision of comprehensive cancer care and treatments. The results show that, to date, phase III cancer vaccine trials have been sponsored almost exclusively by pharmaceutical corporations. The exceptions are two phase III trials sponsored by the NCI. The graphs representing various activities and details can be generated by the data mining application. Examples of generated graphs are shown in Figure 2: a) activities by the leading players (institutions that have sponsored more than ten clinical trials each within the vaccine field, b) number of vaccine trials without trial phase information, by technology platform for Dana-Farber Cancer Institute (DFCI), and c) types of cancer with trial phases sponsored by DFCI. Similar graphs depicting the number of cancer vaccine trials can be generated for the following queries: type of cancer, phase of clinical trial, sponsor, and vaccine technology. Other queries can be easily formulated.
Trials by disease prevalence
In the previous section, we have identified the cancer types most often targeted by vaccine strategies, representing actively-supported areas of cancer vaccine trials. We also wanted to know vaccine trial activities for other cancer types. Figure 3 displays the scatter plot of the 5 year survival rate against the incidence rate for various cancer types. This figure shows that most of clinical vaccine trials target cancers with high incidence rates, such as breast, prostate and lung cancers. In addition, most clinical vaccine trials target cancers associated with high rates of 5-year survival. This figure clearly shows the "neglected cancers" within the cancer vaccine landscape, including bladder, liver, pancreatic, stomach, esophageal, and all of the low-incidence cancers.
Technology platforms used by vaccine strategies
The analysis of technology platforms used in the vaccine trials is shown in Figure 4a. It is not surprising to see that the majority of the trials use antigens to directly stimulate host immune response against cancer cells. These antigen vaccines can be full length proteins or truncated (peptide) forms. Cellular vaccine trials are second in number to antigen-based vaccine trials; together they make some 80% of the total. Currently most of the cell vaccines are made from autologous cells harvested from patients. However, allogeneic cell vaccines are becoming more popular in the last three years (data not shown). We also observed that individual institutions preferentially pursue a small number of cancer vaccine strategies. For illustration, DFCI pursues mainly cellular or viral technology strategies in developing their vaccine platforms (Figure 4b), while Sloan Kettering Memorial Cancer Center focuses mainly on antigen-based vaccines (Figure 4c).
A large number of records are available in clinical trial repositories but the analysis is limited to simple queries. This data mining application for summarization and visualization of clinical trials data was developed and applied to the analysis of cancer vaccine clinical trials landscape. It enables complex queries of cancer vaccine trials data through data mining. Data mining revealed hidden patterns, trends and biases in the data. The application enables formulating queries and asking specific questions. It revealed the cancer vaccine trials development over time. The most common cancers targeted by vaccine therapy in clinical trials are: melanoma, cervical, prostate, breast, and leukemia. Neglected cancers include bladder, liver, pancreatic, stomach, esophageal, and all of the low-incidence cancers. Our approach provides a bird's-eye view of the cancer vaccine landscape, and enables rapid analysis of the hotspots of cancer vaccine activity, as well as the identification of neglected cancers.
The landscape of clinical vaccine trials has multiple dimensions. These include an historical timeline of cancer vaccine trials, organizations sponsoring vaccine trials, principal technologies, and types of cancers, all of which we analyzed in this study. Many of the fields in the XML files were not included in this study, for example, "minimum age", "maximum age", "inclusion criteria", "exclusion criteria", and others. The selection of fields was defined by the scope of this study: rapid extraction of clinical trials statistics and identification of major activities in the field.
For studies that focus on other questions, such as patient groups, different sets of questions would be asked and different dimensions would be included for selections of relevant fields from the XML files.
The decision by the US Food and Drug Administration (FDA) to publicize information on clinical trials was made to enable public access to data that address questions about the safety of certain drugs . In addition, public access to this data helps counter publication bias, in which positive results are published more easily and faster than negative results . Though a significant quantity of data and information that describe cancer vaccine clinical trials is available, the existing means of converting these data into knowledge are less advanced.
Our data mining process consisted of data preparation and the application of summarization [see ] and visualization [see ] tools upon extracted specific knowledge from cancer vaccine clinical trials data. By accessing comprehensive clinical trials information using appropriate software tools, several mouse clicks provide access to knowledge that would otherwise require hiring of specialists or consultants. This knowledge is useful for various professionals, including research directors and planners in companies, hospital administrators, researchers and scientists, physicians conducting clinical trials, policy makers, grant officers at funding bodies, and government regulators. By combining public databases of clinical trials, data formatting by XML, and computational analysis and visualization, we have shown that specific knowledge can be extracted, summarized, and presented to the user.
We have implemented a highly flexible system to visualize and mine clinical trial information in the cancer vaccine field. We obtained all data about cancer vaccine trials from ClinicalTrials.gov database. In accordance with the 1997 FDA Modernization Act , information from clinical trials on serious or life-threatening diseases must be registered at ClinicalTrials.gov within 21 days of the trial starting date. The ClinicalTrials.gov has become the world's largest clinical trial database and it contains information from clinical trials performed world-wide. Although some cancer vaccine trials may not necessarily be included, ClinicalTrials.gov repository is comprehensive and representative of the world-wide landscape of clinical trials in the cancer vaccine field. Some fields of interest in this study were not included in the original XML files; for example, fields related to specific vaccine technology. We inspected the records, identified vaccine technology, and manually annotated this field using external data sources. In addition, clinical trials records in the back-end database were enriched with fields containing cancer statistics data. Manual annotation of these data has limitations, principally because subsequent studies also need manual annotation. This shortcoming can be addressed either by automation of annotation, or by inclusion of these fields in the clinical trials records. We envision that the power of this system can only increase with the improvement of the content of public databases.
Of 16,000 cancer trials in ClinicalTrials.gov, some 900 are cancer vaccine or cancer immunotherapy trials. The information provided in the trial descriptions includes "summary of purpose", "trial sponsor", "phase of the trial", "recruiting status", and "location", and other, more specific information. Clinical trials related to cancer vaccines are defined by keywords "cancer" and "vaccine" present in the title or abstract of the trial record. Prior to January 2008, some 642 trials fit this definition. Input primary data consisted of downloaded XML files containing information on cancer vaccine trials.
Additional information on cancer types was retrieved from the Surveillance Epidemiology and End Results (SEER) Cancer Statistics Review (CSR) provided by the National Cancer Institute (NCI). Incidence and survival rates associated with various cancer types were obtained from the SEER/CSR report 2003 .
Our data mining system consists of a back-end XML database, a front-end visualization interface, and the analysis component. The analysis workflow is shown in Figure 5. First, XML files for relevant cancer vaccine trials were downloaded from the ClinicalTrials.gov website and incidence and survival facts were downloaded from the National Cancer Institute (NCI) website. We have defined a series of questions to address using this system. Fields of interest contain information, such as 'Cancer Type', 'Phase of the Trial', and 'Recruiting Status'; these fields were extracted from the primary XML files. Additional fields of interest, such as 'Technology Platform', 'Adjuvant Usage', and 'Therapy type', that provide information in form suitable for database querying, were added manually and associated to each clinical trial record in our back-end database. These data were not available as separate fields in the ClinicalTrials.gov records, but could be derived from the descriptions and mapped. Clinical trial records contain additional fields such as 'Minimum Age', 'Maximum Age', 'Inclusion Criteria', 'Exclusion Criteria', among others. That information was outside the scope of this study and was not included in the back-end database of our system. Nevertheless, these fields can easily be included in the data mining system if needed. The technology platform information is not available as a separate field in ClinicalTrials.gov but can be extracted from the content of other fields and interpreted using data from NCI Drug Dictionary . The list of applicable technologies is shown in Table 3. Cancer statistics data are not available at all in the ClinicalTrials.gov and they were created from external data  [see Additional file 1]. The clinical trial data was merged with cancer statistical facts using "Cancer Type" as the link. Spotfire has the capability of importing additional data from an external file or database and we used this capability. Several graphical views were generated to answer specific questions.
Spotfire DXP Platform Description
We have chosen Spotfire-DXP (version 2.0, spotfire.tibco.com) software to construct the environment for our data mining application. Spotfire-DXP is proprietary software which can be licensed through TIBCO Software Inc. http://www.tibco.com. The Spotfire-DXP is a dynamic tool suitable for summarization and visualization of tabular data. Although other similar tools, such as SAS, Insightful, and others offer more sophisticated statistical power, they are less suitable for summarization, visualization, and tabulation tasks. Spotfire is easy to learn and use because of graphical user interface that allows graphing and tabulation by using drag-and-drop actions.
The software environment consists of four main areas, 'Menu Bar', 'Main Graphing Area', 'Query Filter Panel', and 'Details on Demand'. The top 'Menu Bar' consists of file and data manipulation tools, in addition to icons for generating new graphs. The 'Main Graphing Area' is screen space where user displays results in either graphs or tables. The right 'Query Filter Panel' is automatically populated with column heads when the data table is brought in. The 'Details on Demand' window will only show up when a user wants to investigate a subset of records in more details.
The interface with representative examples is illustrated in Figure 6. When the program is started with a selected data table, the top 'Menu Bar' and the 'Query Filter Panel' appear, along with the default cover page, and a scatter plot is automatically generated in the 'Main Graphing Area'. To change the axis of the graph, the user can simply drag the appropriate field from the filter panel onto the x or y axis. To change the type of graph plotted, the user can click on the "x" symbol at the top right corner of the "Main Graphing Area" to close the default scatter plot and click on another graph icon from the top "Menu Bar" to generate another graph. Axes can then be changed as described previously. Tables can also be generated using a similar drag-and-drop action. The properties of a particular graph can be changed through the property window by adjusting relevant parameters. Parameters that users can select include color, shape, size, and other graphical properties for displaying high dimension data. Once the graph is generated, the user can plot more detailed graphs by selecting a subset of data within 'Query Filter Panel'. The graph will change dynamically upon data filtering and the corresponding records will be displayed in the 'Details on Demand' window. The user can generate several graphs on a single page, as shown in Figure 6. These graphs are linked; records selected in one graph will also be highlighted in all other graphs. Formulated queries are stored as "pages" shown in the tabs under the toolbar ('Cover Page', 'Data Table', 'Lead Sponsors – Players', and others). The user can plot new graphs on a separate page by clicking on the 'New Page' icon on the top 'Menu Bar' and generate graphs as previously described.
Tabular data are constructed from the backend database. Our application uses standard Spotfire-DXP toolbox for extraction and manipulation of data. Fields that we used in this study included 'Cancer Type', 'Incidence Rate', '5-Year Survival (%)', 'Trial ID', 'Brief Summary', 'Lead Sponsor', 'Collaborator', 'Phase', 'Trial Status', 'Vaccine Platform', and 'Trial Start' data.
To illustrate the data mining process, we have used an example in which we answered Question 1 (Table 1) by generating a bar graph shown in Figure 1. The process started by selection of the 'Bar Graph' on the 'Menu Bar'. This generated the default bar graph in the 'Main Graphing Area'. Then, we selected the 'Start Date' field from the 'Query Filter Panel' and dragged it to the x-axis. Similarly, we dragged the 'TrialID' from the 'Query Filter Panel' to the y-axis. We clicked on the y-axis to apply the 'UniqueCount' function to the y-axis. Once this was done, we changed the coloring scheme by clicking the 'Property' icon in the 'Menu Bar' and specified the colors for different phases (green for phase 1, yellow for phase 2 and red for phase 3.). These actions produced the graph on the 'Trials Started per Year' page. Similarly, we constructed other pages that query specific information about lead sponsors, diseases, vaccine technology platform, and geographic locations, as shown in Figure 6. The data sets and application programs are available upon request from the authors.
Mathers CD, Loncar D: Projections of global mortality and burden of disease from 2002 to 2030.PLoS Med 2006,3(11):e442.
Wheeler DL, Barrett T, Benson DA, Bryant SH, Canese K, Chetvernin V, Church DM, Dicuccio M, Edgar R, Federhen S, Feolo M, Geer LY, Helmberg W, Kapustin Y, Khovayko O, Landsman D, Lipman DJ, Madden TL, Maglott DR, Miller V, Ostell J, Pruitt KD, Schuler GD, Shumway M, Sequeira E, Sherry ST, Sirotkin K, Souvorov A, Starchenko G, Tatusov RL, Tatusova TA, Wagner L, Yaschenko E: Database resources of the National Center for Biotechnology Information.Nucleic Acids Res 2007, 35:D5–12.
Hornbrook MC, Hart G, Ellis JL, Bachman DJ, Ansell G, Greene SM, Wagner EH, Pardee R, Schmidt MM, Geiger A, Butani AL, Field T, Fouayzi H, Miroshnik I, Liu L, Diseker R, Wells K, Krajenta R, Lamerato L, Neslund Dudas C: Building a virtual cancer research organization.J Natl Cancer Inst Monogr 2005, (35):12–25.
The Cabig Strategic Planning Workspace: The Cancer Biomedical Informatics Grid (caBIG™): Infrastructure and Applications for a Worldwide Research Community.Stud Health Technol Inform 2007, 129:330–334.
O'Rourke MG, Johnson MK, Lanagan CM, See JL, O'Connor LE, Slater GJ, Thomas D, Lopez JA, Martinez NR, Ellem KA, Schmidt CW: Dendritic cell immunotherapy for stage IV melanoma.Melanoma Res 2007,17(5):316–322.
Inogès S, Rodrìguez-Calvillo M, Zabalegui N, Lòpez-Dìaz de Cerio A, Villanueva H, Soria E, Suárez L, Rodríguez-Caballero A, Pastor F, García-Muñóz R, Panizo C, Pèrez-Calvo J, Melero I, Rocha E, Orfao A, Bendandi M, Grupo Español de Linfomas/Trasplante Autologo de Medula Oseo study group; Programa para el Estudio y Tratamiento de Hemopatias Malignas study group: Clinical benefit associated with idiotypic vaccination in patients with follicular lymphoma.J Natl Cancer Inst 2006,98(18):1292–1301.
Thearling K, Becker B, Dennis DeCoste D, Bill Mawby D, Pilote M, Sommerfield D: Visualizing Data Mining Models.Information Visualization in Data Mining and Knowledge Discovery(Edited by: Fayyad U, Grinstein G, Andreas Wierse A). Morgan Kaufman 2001, 205–222.
The authors declare that they have no competing interests.
XC proposed the original idea and the design of the project, programmed and implemented the system. KBM provided guidance and contributed to the design of the project. VB contributed to the design of the project, and provided direction and technical expertise, and annotated records. The three authors contributed equally to the writing.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.