Data integration in biological research: an overview
© Lapatas et al. 2015
Received: 20 April 2015
Accepted: 10 August 2015
Published: 2 September 2015
Data sharing, integration and annotation are essential to ensure the reproducibility of the analysis and interpretation of the experimental findings. Often these activities are perceived as a role that bioinformaticians and computer scientists have to take with no or little input from the experimental biologist. On the contrary, biological researchers, being the producers and often the end users of such data, have a big role in enabling biological data integration. The quality and usefulness of data integration depend on the existence and adoption of standards, shared formats, and mechanisms that are suitable for biological researchers to submit and annotate the data, so it can be easily searchable, conveniently linked and consequently used for further biological analysis and discovery. Here, we provide background on what is data integration from a computational science point of view, how it has been applied to biological research, which key aspects contributed to its success and future directions.
KeywordsData integration Standards Bioinformatics Data driven Open sciences
Data driven biological research has made data integration strategies crucial for the advancements and discovery in a plethora of fields (e.g. genomics, proteomics, metabolomics, environmental sciences, clinical research to name a few) [1–6]. Technically, solutions for data integration have been developed and applied in both corporate and academic sectors. When it comes to biological research, there are different interpretations and levels of data integration people seem to consider [7–14], ranging from genomic data to protein-protein interactions.
Together with data production, there is no doubt that data management, storage and consequently retrieval, analysis and interpretation are at the core of any biological research project. Moreover, the ability to have access to the actual data sets used in a particular study is often crucial for reproducibility and expansion of such study, hence the emphasis in recent years on Open Science and the various initiatives associated [15–21]. Noticeably, in biological research, the difficulties associated with data integration have only expanded with the advent of high throughput technologies [3, 22, 23]. Anyone working with Next Generation Sequencing (NGS) faces challenges associated with a variety of aspects this type of data brings, one of the major being: the volume of the data [24, 25].
Here, we refer to data integration as the computational solution allowing users, from end user (GUI) to power users (API), to fetch data from different sources, combine, manipulate and re-analyse them as well as being able to create new datasets and share these again with the scientific community.
With this definition in mind, it is clear that data integration solutions are imperative for the advancement of research in biological sciences as well as the mechanisms to make such processes traceable, shareable hence “integrable” [26–28]. Here, we provide an overview of the strategies most commonly adopted by the biological research community, current challenges and future directions.
Key concepts and terminology
Data integration should not just rely on software engineers and computational scientists, but needs to be driven by the actual users whose communities need to define, adopt and use standards, ontologies and annotation best practice. Therefore, it is particularly important for the biological research community to get acquainted with the conceptual basis of data integration, its limitations, challenges and actual terminology.
A structured and “queryable” way of storing data
A single or collection of schemata
A number of databases that contain data. Data that reside in each source can either duplicate and/or complement data from other sources
The process of combining data that reside in different sources, to provide users with a unified view of such data
Agreements on representation, format, and definition for common data
A structured way to represent data and metadata in a file
Model for integrating data where the data from different sources reside on a central repository (aka data warehouse)
Model for integrating data where the data reside on the original sources and users are provided with a unified view of the data based on mapping mechanisms of the information
The network of interlinked data that is available on the web. It is used to automatically share semantically rich information and represents the biggest attempt to convert significant amounts of human knowledge across all fields in a computer readable format
A structured way of describing data, often presented in a computer-readable format. In bioinformatics, ontologies are sets of unambiguous, universally agreed terms used to describe biological phenomena and “entities”, their properties and their relationships
A collection of terms for describing a certain domain of interest
A unique representation for a biological entity (molecule, organism, ontology term, etc.). Usually an alphanumeric string that is used to refer to this entity and distinguishes it from others (much like ID or passport number in humans).
Data describing data, i.e., additional information (e.g., a comment, explanation, attributes, etc.) for a specific biological entity or process. As an example, in the context of an ontology, this is used to specify significant properties of the ontology
The process of attaching relevant information (metadata) to a raw biological entity
Automatic means that the annotation is being done by computer software (often by transferring information from a source to another). This is a way of producing a large amount of metadata
As opposed to automatic annotation, manual means that an actual individual does it
Graphical User Interface. Is the way that a user interacts with a computer by using graphical icons and visual indicators such as buttons, forms etc. In the scope of this paper we are using the term GUI to refer to interfaces that allow biologists to search/read/edit integrated biological data
Application Programming Interface. Set of tool and protocols that a power user can use in order to automatically gain access to functionality and/or data that have been developed/gathered by another individual/organisation
User eXperience. The process of improving user satisfaction by focusing on the usability of a given product.
Applications that help biologists view the data in a more human-friendly way (e.g., Cytoscape for visualising complex networks) like 3D or graph representations of the data
In computational sciences the theoretical frameworks for data integration have been classified into two major categories namely “eager” and “lazy” [29, 30]. The difference between the two approaches is the way the data get integrated. In the eager approach (warehousing), the data are being copied over to a global schema and stored in a central data warehouse; whereas in the lazy approach the data reside in distributed sources and are integrated on demand based on a global schema used to map the data between sources.
Each of the two main categories of data integration has to deal with its own challenges in order to provide the user with a unified view of the data. In the eager approach, researchers face challenges to keep data updated and consistent, and protect the global schema from having corrupted data [31, 32]. In the lazy approach, data are queried at sources and the scientific community is trying to find ways of improving the answering query process [33–38] and source completeness [36, 37, 39, 40]. Which approach should be used and when depends on amount of data, who owns them and the existing infrastructure.
UniProt  and GenBank  are examples of centralised resources (Fig. 1-Data Centralisation), whereas Pathway commons  collects pathways from different databases and stores them to a shared repository that can be used to query and analyse pathway information (Fig. 1-Data Warehousing). Datasets integration can also be made by in-house workflows accessing distributed databases and downloading data to a local repository (Fig. 1-Dataset Integration). ExPASy  is the SIB Bioinformatics Resource Portal through which the user can access databases and tools in different areas of life science (Fig. 1-Hyperlinks). Database links are crucial for interoperability and several efforts have been done in this context . Regarding the federated database model (Fig. 1-Federated Databases), the Distributed Annotation System (DAS)  represents a valuable example. DAS is a client-server system used to integrate and display in a single view annotation data on biological sequences residing over multiple distant servers. In this case, a translation layer is needed to achieve data integration among heterogeneous databases. There are various ways to do this but in general it refers to ways to transform the data from the database to a common format so they can be interpreted in the same way from a mapping service. As for the linked data integration (Fig. 1-Linked Data), the services offered are graphical interfaces (GUI) that provide the user with hyperlinks connecting related data from multiple data providers in a large network of Linked Data. BIO2RDF  is an example of such integration system.
Data integration in biological research has its challenges associated to a variety of factors such as standards adoption or easy conversion between data/file formats .
List of data standards initiatives
The Open Biological and
Establish a set of principles for ontology
development to create a suite of orthogonal
interoperable reference ontologies in
the biomedical domain
Clinical data interchange
Establish standards to support the acquisition,
exchange, submission and archive of
clinical research data and metadata
Human Proteome Organisation-
Defines community standards for data
Proteomics Standards Initiative
representation in proteomics to facilitate
data comparison, exchange and verification
Global Alliance for Genomics
Create interoperable approaches to catalyze
projects that will help unlock the great
potential of genomic data
Coordinate the development of the various
community standards and formats for
Define community-agreed reporting
standards, which provided a clear description
of the biological system studied and
all components of metabolomics studies
Research Data Alliance
Builds the social and technical bridges that
enable open sharing of data across multiple
As mentioned above, one of the most important factors for the biological field to thrive is to standardise the data. In computational science a similar problem was encountered for the web and specifically with the way that browsers parse web pages. This was solved by agreeing on W3C standards  so that all the browsers are forced to comply otherwise they may result in poor user experience and they risk losing market share.
In biology there are many different ways of representing similar data and this makes the data harder to be integrated and processed to obtain unified views of such data. Gene naming is an example of poor uniformity in data representation. Despite full guidelines were issued in 1979 to adopt gene nomenclature standards (see ), an assortment of alternate names is still in use across the scientific literature and databases, posing a challenge to data sharing. When it comes to biological research, it is crucial to create (when non existing), adopt and implement standards. Without these it is (nearly) impossible to achieve data integration [55, 56].
So what do we mean by standards? Standards can be defined as an agreed compliant term or structure to represent a biological entity. Entities are all types of units of biological information. For example we use T, G, A, C as a standard way to refer to the nucleotides that make the DNA, and aa (for amino acids) represented usually by one letter, and consequently, a string of letters to represent a DNA or protein sequence. However, a protein might be known in the scientific literature and referred by researchers by a variety of names, synonyms and abbreviations.
So, which standards exist, who defines them and how are these working? Lots of standard initiatives and efforts seem to exist, sometimes redundant, often non driven by the end users communities. It is out of the scope of this paper (and probably a never ending exercise) to review all of them, which do proliferate but not necessarily in harmonising ways. A snapshot of the variety of standards for metadata can be found at the DCC website  and BioSharing  as an example of the point we are making. Table 2 reports a list of standard initiatives along with their primary goal, URL and key reference in the omics field.
Standards facilitate data re-use. They make data sharing easier, saving overheads and losses of time in data loading, conversion, getting systems to work properly with data. They help overcome interoperability difficulties across different data formats, architectures, and naming conventions, and at infrastructure level, enabling access systems to work together [59–62]. Absence of standards means substantial loss of productivity and less data available to researchers .
Standards are therefore key to the data sharing process since they describe the norms which should be adopted to facilitate interchange and inter-working of information, processes, objects and software. Thus data resources play a major role not just in data management, integration, access, and preservation, but also for providing adequate support to research communities.
Ontologies have been proliferating in biological research, and their importance underlined several times [64–67] also in the specific context of data integration . In order to bring some coordination and consolidation to the proliferation of ontologies across the biological and biomedical research fields, The Open Biological and Biomedical Ontologies (OBO) got together. OBO is a collaborative experiment involving developers of science-based ontologies who are establishing a set of principles for ontology development with the goal of creating a suite of orthogonal interoperable reference ontologies in the biomedical domain. Biological researchers can get involved and provide feedback by getting into the discussion fora OBO provides. Currently there are ten OBO foundry ontologies and more than 120 candidate ontologies or other ontologies of interest .
These efforts need the direct involvement of the actual biologists when it comes to the adoption and implementation of using such ontologies, ensuring these are known and disseminated across communities. Other important initiatives are, the NCBO (National Center for Biomedical Ontology) BioPortal [69, 70], and the OLS (Ontology Lookup Service) .
With a set of unique common compliant standards in place, it will be possible to create tools to integrate the data on the web using an existing infrastructure like linked data. This will enable querying multiple sources without having to re-invent integration techniques for the integration of each source. As an example, one of the efforts currently trying to attempt this is Bio2RDF . This is a major effort to integrate biological data using the linked data infrastructure. So far there are no tools that can utilise these data directly but they are mainly accessible via complex queries or low level GUIs.
Data formats are the concrete way we structure and represent biological information in a file. They are particularly relevant to those who deal with large amount of information such that generated by high throughput experiments. Indeed, a scientist interested in a single or a few genes at a time may extract information about them by manually “parsing” the literature or free-text (i.e. non formatted) documents. The need for storing biological data in formatted files arose from the need for using computers to analyse them. The amounts of genomics and proteomics data, which cannot be manually analysed element by element, are exponentially increasing and the adoption of commonly agreed formats to represent them in computer readable files is nowadays of utter importance. Historically, the scarcity of well structured data standards and schemas, caused the flourishing of many different formats even to represent the same type of data despite the adoption of standards in file formats would be essential to data exchange and integration. Funnily, the Roslin Bioinformatics Law’s First Law declaims: “The first step in developing a new genetic analysis algorithm is to decide how to make the input data file format different from all pre-existing analysis data file formats” .
For the benefit of data integration though, it would be ideal to have well-structured data across few basic formats that would be easily computer readable and therefore easily integrated. In the specific case of NGS data, the lag between the emerging high-throughput screening technologies and the adjusting of the scientific community to settle on a standard format, means time and effort spent on converting raw files across multiple sequencing platforms to make these compatible . Currently, in NGS there are no really “standards” that people adhere to, but a set of commonly used formats (FASTA/Q, SAM, VCF, GFF/GTF, etc.). There are descriptor standards like MIGS , but these might not be generally adopted. More in general, today an exhaustive “atlas” of the formats used in bioinformatics cannot be found on the Internet. One partial list is available at http://genome.ucsc.edu/FAQ/FAQformat.html and the description of many formats can be found in the online forum BioStar .
Mostly commonly used data formats in bioinformatics
Data format class
types (PPI, etc)
PDB, PSF(M), MMCIF(D)
HTML; XML; JSON
Should any of these four data representation classes be preferred over the others? Despite we observe an increasing use of XML and some authors propose to adopt XML for biological data interchange between databases and other sources of data , we believe that there is not an ultimate answer. There are text formats that better suit some specific kind of data and specific computational requirements and purposes. For example, it is difficult to imagine how macromolecule X-ray or NMR coordinates and related annotation, currently stored in PDB files, could fit into the FASTA-like format. On the other hand, if one has to parse big sequence files, the FASTA format, with a single line annotation, will cause them to have a smaller size than differently formatted files and will allow parsing them with just a few lines of code. Notice that some formats (e.g. SAM) can be compressed into a binary version (BAM) for intensive data processing.
Therefore, we believe that the solution is not to urge scientists to conform to a unique “optimal” format but rather to identify a few operational formats and make database and tool developers aware of the importance of sticking to them.
For integration purposes, the scientific community of database and tool developers has begun to adopt some good practices in data file formatting. One example is represented by the FGED Society (http://fged.org/) formed at a meeting on Microarray Gene Expression Databases (EBI, Hinxton, 1999) with the goal, amongst the others, of facilitating the adoption of standards for DNA microarrays and gene expression data representation. We believe, however, that further efforts should be made in order to achieve a more robust and systematic policy in all the areas where data sharing is essential to utilise these data to make new discoveries and the progress of science possible.
The community of scientists concerned by data sharing and integration, including us, should make the effort of 1) compiling a complete and structured (i.e. organised by data type and purpose) list of the currently available formats with their description and 2) developing guidelines and recommendations for the adoption of standards in file formatting, also discussing which data types fit into each different text format and the related performance implications. This list and the guidelines, which might be integrated in a resource such as BioSharing should encourage database and tool developers to present information in a way that a computer program can parse it, suggest that they avoid inventing new computer readable formats but rather comply with one of the existing ones, and only accept new data, for storage purposes, that meet certain formatting criteria. Such guidelines should be ambitious and forward-looking enough to also advice scientists in both academia and industry to keep in mind data representation in developing high throughput technologies and their information services.
The development of converters translating formats in a unified form should be promoted as well. This would actually make it possible to combine the data across all the formats. A rather isolated example of data format translation is represented by the PRIDE Converter , which makes it easy to translate a large variety of input formats into the unique XML [76, 78] format for proteomic data submission to the PRIDE repository . The PRIDE Converter was designed to be suitable for both small and large data submissions and has a very intuitive GUI also for wet-lab scientists without a strong bioinformatics background or informatics support. Format translation faces problems especially with not well-structured data that cannot be translated properly in a computer readable format and therefore rely on human manipulation of the data in order to verify the correctness of the transformation. In the case of NGS data, we rely on tools for conversion between next generation sequencing data formats, such as NGS-FC (http://sourceforge.net/projects/ngsformaterconv/), to ensure each tool in a workflow can work with the right format.
An identifier is a unique representation of a given data entry [80, 81]. For example the Universal Protein Database (UniProt) uses a “unique identifier” to refer to a protein entity which cannot be used in any other case, thus ensuring no redundancy and one agreed unique term that unequivocally identifies a given protein .
In biological research a variety of data repositories exist and each of them is using its own implementation for generating unique identifiers. As an example, for the same protein, UniProt uses the identifier Q9Y6N8 whereas Ensembl  is referring to it as ENSP00000264463 and RefSeq  as NP_006718.2. If all the researchers could use a single unique identifier to refer to a given protein across their publications and work, data integration would be a step ahead of its current state.
An effort to help with the discoverability of the identifiers and assist the researcher with knowledge on how to query data across databases has be done from identifiers.org . This is a registry that facilitates the discovery of resources in life sciences and allows to decouple the identification of records by the physical locations on the web where they can be retrieved.
Many biological concepts are described in several databases using different identifiers. To facilitate discoverability and integration, databases have their data entries cross-referenced with external entries using identifiers. This enables users to find a data entry like a protein in UniProt and then find the same biological concept described in other databases (ie. RefSeq) and gather more relevant data about the same entry. Several initiatives like PICR  or the “DAVID ID conversion tool”  provide mapping of such identifiers. It will be beneficial if such service gets integrated in the major bioinformatics databases.
Some organised efforts including distributed resources like IMEx  are very well organised and, though the independent databases that are part of the consortium like IntAct , MINT  and DIP  use their own identifiers, all their entries get assigned a unique IMEx identifier issued by a central authority. The IMEx identifier is assigned to a single biological entity with the purpose of being reused across databases/systems and always link to the same entity regardless the system. The IMEx Central repository coordinates curation effort, assigns identifiers and facilitates the exchange of completed records on molecular interaction data between the IMEx Consortium partners.
Approaches like these can increase discoverability and shareability of data and even enable publications and scientific studies to use a single identifier to refer to a given entity. This entity could be easily traced and further studied by their audience. With an infrastructure like this in place, it will be possible to enforce researchers to submit the unique identifier of the biological entity that they are studying on their research papers. This is happening already for nucleotide sequence data where researchers have to submit newly obtained/sequenced entities to one of the three major sequencing databases  and refer to it in the paper. Most of other data types can be used in publications without such requirement. This also extends to entire datasets.
Huge steps have been achieved by the creation and adoption of clear recommended guidelines when it comes to depositing and disseminating data and datasets [92–95]. Such guidelines are often the result of several discussions (years of discussions in some occasions) in a field where data efforts for sharing have been maturing. The specification of several standards in life science include documentation and examples of how to use them, but many initiatives additionally include guidelines to agree on what minimum or recommended information should be provided when describing data. Minimum information guidelines have been very popular to ensure that data can be easily interpreted and that results derived from their analysis can be independently verified. These guidelines tend to concentrate on defining the content and structure of the necessary information rather than the technical format for capturing it. A key landmark in the development of guidelines of minimun information in this area comes from the “Minimum Information about a Biomedical or Biological Investigation” (MIBBI) .
It is crucial to have a place where such efforts are listed and shared in order to ensure redundancy is avoided. As an example of reporting guidelines we mention here the efforts done in the topic of protein-protein interactions. Currently we see two reporting guidelines: MIMIx  and IMEx . A key project that is contributing in this area and where one can look for as well as add “reporting guidelines” is the Registry of guidelines in biosharing.org [58, 97].
As we have seen, there are different formats when it comes to data files, and these will always evolve according to the needs of the communities as well as the nature of the data and associated technologies. For example, a format that contains 20 fields for which one researcher might have a subset of information versus another that might opt for prioritising a different set. It is clear that having a minimum agreed set of fields that all comply to report using standards is crucial for data integration and reusability across such data. Similarly, other fields might be crucial and informative to a specific set of users. These can be adopted at the level of recommended. For example a protein-protein interaction database wants to capture domain specific information about interactions versus another one that is not interested in such aspect. One also might have optional fields, for those that want to annotate and enrich further the data record with metadata. Doing this in a standard manner means again allowing future reusability and expansion for others to adopt and exchange, integrate data based on this level of information.
Consortiums and standards initiatives
There are several initiatives coordinating the development of community standards to facilitate data comparison, exchange and verification in bioinformatics. Some of this initiatives are community initiatives or consortia like COMBINE , PSI , GAGH , INSDC , proteomeXchange , IMEx , BioPax  involved in the development of standards in one specific biological domain. Some other community initiatives like RDA are more generic with a potential application in different scientific domains.
Some strategic efforts supported by major service providers and national governments like ELIXIR , BBMRI , BD2K  are also involved in the development of standards in life sciences. Projects supported by specific grants like BioMedBridges , BioSHaRE  do also contribute to this cause but their duration is normally bound to the duration of the grant. All these initiatives play a major role in achieving consensus and agreements which facilitates the development and adoptions of standards.
In biological research, molecular biology has been the field ahead in terms of such efforts and the associated bioinformatics applications. One can only imagine the work yet to be done, learning from existing efforts and initiatives as described here in the field of ecology, biodiversity, marine biology and so on. Examples of large scale efforts that need to talk to each other and ideally apply best practice when it comes to creating an infrastructure that fosters data integration are LifeWatch  and ISBE .
There is a variety of visualisation tools, but often each tool requires a different file format and the task of feeding back the discovered data is not trivial [111, 112]. The field of visualisation has its own challenges given the increasing quantity of data, the integration of heterogeneous data and the need for tools that allow representing multiple aspects of the data (e.g. multiple connections between nodes with diverse biological meanings [113, 114]). There is a myriad of visualisation and analysis tools, ever proliferating, with each tool providing specific features that address different aspects (e.g. genome browsers [115–119]). In 2008 Pavlopoulus et al published a wish list for visualisation of biological data which still remains valid .
Data integration principles are fundamental in providing tools that are user friendly and allow the end users (biologists) to focus their efforts on the actual study of the data instead of being lost in the process of looking for the data they need by querying multiple databases that appear to provide inconsistent results between them. The field of systems biology per se brought substantial advances in visualisations since the ability to analyse and interpret interactions, networks and pathways relies often in the ability of visualising these accurately .
Overcoming some of the challenges associated with visualisation relies on better standards adoption and improvement in annotation and metadata. This is clearly a two directional effort: bottom up, where data and datasets are annotated and stored following a common set of standards, this extends to the data formats as well as a top down level of standards and adoption of compatible formats and output files that allow comparisons and integrations of results [121–123].
Historically, many domains within biology have relied on visualisation as a way to represent the biological information thus creating what are now considered standards in their domains. Plenty of examples can be found in the areas of phylogenetics  and pathways [125, 126]. The advent of next generation sequencing brought genomics as a domain were significant effort has been put to develop new visualisation techniques to represent sequences, alignments, expression patterns and ultimately entire genomes [127–130]. However, biological researchers might lack an understanding and awareness about the range of visualisation techniques available and which is the most appropriate visual representation [131, 132].
An increased dialogue between the computational scientists involved in the creation and development of such tools with the end users (aka the biologists), would be beneficial for the entire community and we hope this paper is one step towards such outcome. Efforts in this direction are also on the way and we cite here the BiVi initiative (http://bivi.co/), which is addressing several challenges in the realm of visualisation as well as trying to reduce the gap between the biology, computational sciences and developers of bioinformatics tools. BiVi has grouped many of the most notable visualisation tools produced by biologists and developers across seven domains (though some of the tools cover more than one of these) and provides information as to their provenance, current status and links to websites (http://bivi.co/visualisations). Other community efforts in this area are VizBI (http://vizbi.org/), SciVis (http://scivis.itn.liu.se/) and CoVis (http://www.iwr.uni-heidelberg.de/groups/CoVis/).
Common visualisation tools in the area of “Interaction Network Visualisation”
Name of resource
What it does
Visualisation of biclusters combined with profile plots and heat maps
Heat map-based bicluster visualisation
Visualisation of 3D transcription data in the central nervous system
Data Matrix Viewer
Simple profile plot visualisation; supports Gaggle
Heat maps, scatter plots and profile plots of cluster averages
Analysis suite; offers several interactive visualisations
Modular suite; heat maps, dendrograms, profile and scatter plots
Hierarchical Clustering Explorer
Linked heat map, profile and scatter plots; systematic exploration
Linked heat maps, karyoscopes, sequence alignments, scatter plots
Modular suite; many linked visualisations; enhanced heat map113
Analysis suite; heat maps, dendrograms, profile and scatter plots
Visualisation of 3D transcription data in Drosophila embryos
Exploration and analysis of time series; advanced profile plots
Karyoscope-style plots and other visualisations
Modular analysis platform; several visualisation modules available
Open source software platform for visualizing molecular interaction networks and biological pathways and integrating these networks with annotations, gene expression profiles and other state data
Data heterogeneity is one of the biggest challenges in biological data integration. This could be solved with standardising the data structures that are being used. Biologists should get more involved with the aspects described here and working with bioinformaticians and computational scientists to achieve uniformity of their data. With this issue resolved, integration of biological data will greatly boost biological research and the field will gain a more robust structure: computational scientists will be responsible for maintaining and improving the infrastructure of the data; bioinformaticians will be able to build upon this infrastructure; biologists will be able to do research with advanced tools without the overhead of getting acquainted with complex topics of database management and programming tools.
We like to thank The Genome Analysis Centre (TGAC, Norwich, UK) and the Biotechnology and Biological Sciences Research Council (BBSRC, UK). AV acknowledges the King Abdullah University of Science and Technology (KAUST) Award No. KUK-I1-012-43 for funding support.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Stamatoyannopoulos JA, Snyder M, Hardison R, Ren B, Gingeras T, Gilbert DM, et al.An encyclopedia of mouse dna elements (mouse encode). Genome Biol. 2012; 13(8):418.PubMedPubMed CentralView ArticleGoogle Scholar
- Gomez-Cabrero D, Abugessaisa I, Maier D, Teschendorff A, Merkenschlager M, Gisel A, et al.Data integration in the era of omics: current and future challenges. BMC Syst Biol. 2014; 8(Suppl 2):1.View ArticleGoogle Scholar
- Ma’ayan A, Rouillard AD, Clark NR, Wang Z, Duan Q, Kou Y. Lean big data integration in systems biology and systems pharmacology. Trends Pharmacol Sci. 2014; 35(9):450–60.PubMedPubMed CentralView ArticleGoogle Scholar
- Ritchie MD, Holzinger ER, Li R, Pendergrass SA, Kim D. Methods of integrating data to uncover genotype-phenotype interactions. Nat Rev Genet. 2015; 16(2):85–97.PubMedView ArticleGoogle Scholar
- Warde-Farley D, Donaldson SL, Comes O, Zuberi K, Badrawi R, Chao P, et al.The GeneMANIA prediction server: biological network integration for gene prioritization and predicting gene function. Nucleic Acids Res. 2010; 38(Web Server issue):214–20.View ArticleGoogle Scholar
- Rieping W, Habeck M, Bardiaux B, Bernard A, Malliavin TE, Nilges M. ARIA2: automated NOE assignment and data integration in NMR structure calculation. Bioinformatics. 2007; 23(3):381–2.PubMedView ArticleGoogle Scholar
- Jansen R, Yu H, Greenbaum D, Kluger Y, Krogan NJ, Chung S, et al.A bayesian networks approach for predicting protein-protein interactions from genomic data. Science. 2003; 302(5644):449–53.PubMedView ArticleGoogle Scholar
- Hwang D, Rust AG, Ramsey S, Smith JJ, Leslie DM, Weston AD, et al.A data integration methodology for systems biology. Proc Natl Acad Sci U S A. 2005; 102(48):17296–301.PubMedPubMed CentralView ArticleGoogle Scholar
- Myers CL, Troyanskaya OG. Context-sensitive data integration and prediction of biological networks. Bioinformatics. 2007; 23(17):2322–30.PubMedView ArticleGoogle Scholar
- Chung SY, Wong L. Kleisli: a new tool for data integration in biology. Trends Biotechnol. 1999; 17(9):351–5.PubMedView ArticleGoogle Scholar
- Letunic I, Copley RR, Schmidt S, Ciccarelli FD, Doerks T, Schultz J, et al.Smart 4.0: towards genomic data integration. Nucleic Acids Res. 2004; 32(suppl 1):142–4.View ArticleGoogle Scholar
- Von Mering C, Jensen LJ, Kuhn M, Chaffron S, Doerks T, Krüger B, Snel B, et al.String 7—recent developments in the integration and prediction of protein interactions. Nucleic Acids Res. 2007; 35(suppl 1):358–62.View ArticleGoogle Scholar
- Cheung K-H, Yip KY, Smith A, Masiar A, Gerstein M. Yeasthub: a semantic web use case for integrating data in the life sciences domain. Bioinformatics. 2005; 21(suppl 1):85–96.View ArticleGoogle Scholar
- Goldovsky L, Janssen P, Ahren D, Audit B, Cases I, Darzentas N, et al.CoGenT++: an extensive and extensible data environment for computational genomics. Bioinformatics. 2005; 21(19):3806–810.PubMedView ArticleGoogle Scholar
- Kauppinen T, de Espindola GM. Linked open science-communicating, sharing and evaluating data, methods and results for executable papers. Procedia Comput Sci. 2011; 4:726–31.View ArticleGoogle Scholar
- Neylon C, Wu S. Open science: tools, approaches, and implications: 2008. p. 540–4. doi:10.1038/npre.2008.1633.1.
- Gentleman R, Temple Lang D. Statistical analyses and reproducible research. In: Bioconductor Project Working Papers. Working Paper 2: 2004. http://biostats.bepress.com/bioconductor/paper2.
- Chamberlain SA, Szöcs E. taxize: taxonomic search and retrieval in R. F1000Res. 2013; 2:191. v1; ref status: indexed, http://f1000r.es/1pv, doi:10.12688/f1000research.2-191.v1.PubMedPubMed CentralGoogle Scholar
- Juty N, Ali R, Glont M, Keating S, Rodriguez N, Swat M, et al.Biomodels: Content, features, functionality, and use. CPT: Pharmacometrics Syst Pharmacol. 2015; 4(2):1–14.Google Scholar
- Kenall A, Edmunds S, Goodman L, Bal L, Flintoft L, Shanahan DR, et al.Better reporting for better research: a checklist for reproducibility. BMC Neurosci. 2015; 16(1):44.PubMedPubMed CentralView ArticleGoogle Scholar
- Garijo D, Kinnings S, Xie L, Xie L, Zhang Y, Bourne PE, et al.Quantifying reproducibility in computational biology: the case of the tuberculosis drugome. PLoS ONE. 2013; 8(11):80278.View ArticleGoogle Scholar
- Saleem M, Kamdar MR, Iqbal A, Sampath S, Deus HF, Ngomo A-CN. Big linked cancer data: Integrating linked tcga and pubmed. Web Semant Sci Serv Agents World Wide Web. 2014; 27:34–41.View ArticleGoogle Scholar
- Kadadi A, Agrawal R, Nyamful C, Atiq R. Challenges of data integration and interoperability in big data. In: Big Data (Big Data), 2014 IEEE International Conference On. IEEE: 2014. p. 38–40.Google Scholar
- Wandelt S, Rheinländer A, Bux M, Thalheim L, Haldemann B, Leser U. Data management challenges in next generation sequencing. Datenbank-Spektrum. 2012; 12(3):161–71.View ArticleGoogle Scholar
- Nekrutenko A, Taylor J. Next-generation sequencing data interpretation: enhancing reproducibility and accessibility. Nat Rev Genet. 2012; 13(9):667–72.PubMedView ArticleGoogle Scholar
- Bravo E, Calzolari A, De Castro P, Mabile L, Napolitani F, Rossi AM, et al.Developing a guideline to standardize the citation of bioresources in journal articles (cobra). BMC Medicine. 2015; 13(1):33.PubMedPubMed CentralView ArticleGoogle Scholar
- Mabile L, Dalgleish R, Thorisson GA, Deschênes M, Hewitt R, Carpenter J, et al.Quantifying the use of bioresources for promoting their sharing in scientific research. GigaScience. 2013; 2(1):1–8.View ArticleGoogle Scholar
- Goble C, Stevens R. State of the nation in data integration for bioinformatics. J Biomed Inform. 2008; 41(5):687–93.PubMedView ArticleGoogle Scholar
- Widom J. Integrating heterogeneous databases: Lazy or eager?ACM Comput Surv. 1996; 28(4es). doi:10.1145/242224.242344.
- Widom J. Research problems in data warehousing. In: Proceedings of the Fourth International Conference on Information and Knowledge Management, CIKM ’95. New York, NY, USA: ACM: 1995. p. 25–30. doi:10.1145/221270.221319.Google Scholar
- Gupta A, Widom J. Local verification of global integrity constraints in distributed databases. In: ACM SIGMOD International Conference on Management of Data (SIGMOD 1993): 1993. http://ilpubs.stanford.edu:8090/20/.
- Zhuge Y, García-Molina H, Hammer J, Widom J. View maintenance in a warehousing environment. SIGMOD Rec. 1995; 24(2):316–27. doi:10.1145/568271.223848.View ArticleGoogle Scholar
- Ives ZG, Florescu D, Friedman M, Levy A, Weld DS. An adaptive query execution system for data integration. SIGMOD Rec. 1999; 28(2):299–310. doi:10.1145/304181.304209.View ArticleGoogle Scholar
- Halevy AY. Answering queries using views: A survey. VLDB J. 2001; 10(4):270–94.View ArticleGoogle Scholar
- Calvanese D, De Giacomo G, Lenzerini M, Vardi MY. Answering regular path queries using views. In: Proc. of the 16th IEEE Int. Conf. on data engineering (ICDE). IEEE: 2000. p. 389–98.Google Scholar
- Abiteboul S, Duschka OM. Complexity of answering queries using materialized views. In: Proceedings of the Seventeenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, PODS ’98. New York, NY, USA: ACM: 1998. p. 254–63. doi:10.1145/275487.275516.Google Scholar
- Levy AY. Obtaining complete answers from incomplete databases. In: Proceedings of the 22th International Conference on Very Large Data Bases, VLDB ’96. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.: 1996. p. 402–12. http://dl.acm.org/citation.cfm?id=645922.673332.Google Scholar
- Grahne G, Mendelzon AO. In: (Beeri C, Buneman P, editors.)Tableau techniques for querying information sources through global schemas. Berlin Heidelberg: Springer; 1999, pp. 332–47. doi:10.1007/3-540-49257-7_21.Google Scholar
- van der Meyden R. Logics for Databases and Information Systems. vol. 10 In: Chomicki J, Saake G, editors. Kluwer: 1998. p. 307–56.Google Scholar
- Etzioni O, Golden K, Weld DS. Sound and efficient closed-world reasoning for planning. Artif Intell. 1997; 89(1–2):113–48. doi:10.1016/S0004-3702(96)00026-4.View ArticleGoogle Scholar
- Smedley D, Haider S, Ballester B, Holland R, London D, Thorisson G, et al.Biomart–biological queries made easy. BMC Genomics. 2009; 10(1):22.PubMedPubMed CentralView ArticleGoogle Scholar
- Etzold T, Argos P. SRS–an indexing and retrieval tool for flat file data libraries. Comput Appl Biosci. 1993; 9(1):49–57.PubMedGoogle Scholar
- Belleau F, Nolin MA, Tourigny N, Rigault P, Morissette J. Bio2RDF: towards a mashup to build bioinformatics knowledge systems. J Biomed Inform. 2008; 41(5):706–16.PubMedView ArticleGoogle Scholar
- Bateman A, Martin MJ, O’Donovan C, Magrane M, Apweiler R, Alpi E, et al.UniProt: a hub for protein information. Nucleic Acids Res. 2015; 43(Database issue):204–12.Google Scholar
- Benson DA, Clark K, Karsch-Mizrachi I, Lipman DJ, Ostell J, Sayers EW. GenBank. Nucleic Acids Res. 2015; 43(Database issue):30–5.View ArticleGoogle Scholar
- Cerami EG, Gross BE, Demir E, Rodchenkov I, Babur O, Anwar N, et al.Pathway Commons, a web resource for biological pathway data. Nucleic Acids Res. 2011; 39(Database issue):685–90.View ArticleGoogle Scholar
- Artimo P, Jonnalagedda M, Arnold K, Baratin D, Csardi G, de Castro E, et al.ExPASy: SIB bioinformatics resource portal. Nucleic Acids Res. 2012; 40(Web Server issue):597–603.View ArticleGoogle Scholar
- Karp PD. Database links are a foundation for interoperability. Trends Biotechnol. 1996; 14(8):273–9.PubMedView ArticleGoogle Scholar
- Dowell RD, Jokerst RM, Day A, Eddy SR, Stein L. The distributed annotation system. BMC Bioinformatics. 2001; 2:7.PubMedPubMed CentralView ArticleGoogle Scholar
- Gehlenborg N, O’Donoghue SI, Baliga NS, Goesmann A, Hibbs MA, Kitano H, et al.Visualization of omics data for systems biology. Nat Methods. 2010; 7:56–68.View ArticleGoogle Scholar
- Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, et al.The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007; 25(11):1251–1255.PubMedPubMed CentralView ArticleGoogle Scholar
- Musen MA, Noy NF, Shah NH, Whetzel PL, Chute CG, Story MA, et al. NCBO team. The National Center for Biomedical Ontology. J Am Med Inform Assoc. 2012; 19(2):190–5. http://bioportal.bioontology.org/, Epub 2011 Nov 10.PubMedPubMed CentralView ArticleGoogle Scholar
- Berjon R, Faulkner S, Leithead T, Pfeiffer S, O’Connor E, Navara ED. HTML5. Candidate recommendation, W3C. 2014. http://www.w3.org/TR/2014/CR-html5-20140731/.
- Gray KA, Yates B, Seal RL, Wright MW, Bruford EA. genenames.org: the HGNC resources in 2015. Nucleic Acids Res. 2015; 43(Database issue):D1079–85. http://www.genenames.org/about/overview. doi:10.1093/nar/gku1071.PMID:25361968.PubMedPubMed CentralView ArticleGoogle Scholar
- Kher S, Dickerson J, Rawat N. Biological pathway data integration trends, techniques, issues and challenges: A survey. In: Nature and Biologically Inspired Computing (NaBIC), 2010 Second World Congress On. IEEE: 2010. p. 177–82.Google Scholar
- Mathew JP, Taylor BS, Bader GD, Pyarajan S, Antoniotti M, Chinnaiyan AM, et al.From bytes to bedside: Data integration and computational biology for translational cancer research. PLoS Comput Biol. 2007; 3(2):12.View ArticleGoogle Scholar
- Higgins S. The dcc curation lifecycle model. Int J Digital Curation. 2008; 3(1):134–40.View ArticleGoogle Scholar
- Field D, Sansone S, Delong EF, Sterk P, Friedberg I, Gaudet P, et al.Meeting Report: BioSharing at ISMB 2010. Stand Genomic Sci. 2010; 3(3):254–8.PubMedPubMed CentralView ArticleGoogle Scholar
- Brazma A. On the importance of standardisation in life sciences. Bioinformatics. 2001; 17(2):113–4.PubMedView ArticleGoogle Scholar
- Brooksbank C, Quackenbush J. Data standards: a call to action. OMICS. 2006; 10(2):94–9.PubMedView ArticleGoogle Scholar
- Piwowar HA, Becich MJ, Bilofsky H, Crowley RS. Towards a data sharing culture: recommendations for leadership from academic health centers. PLoS Med. 2008; 5(9):183.View ArticleGoogle Scholar
- Chervitz SA, Deutsch EW, Field D, Parkinson H, Quackenbush J, Rocca-Serra P, et al.Data standards for Omics data: the basis of data sharing and reuse. Methods Mol Biol. 2011; 719:31–69.PubMedPubMed CentralView ArticleGoogle Scholar
- Charalabidis Y, Gonçalves RJ, Popplewell K. In: (Popplewell K, Harding J, Poler R, Chalmeta R, editors.)Developing a science base for enterprise interoperability. London: Springer; 2010, pp. 245–54. doi:10.1007/978-1-84996-257-5_23.Google Scholar
- Bard JB, Rhee SY. Ontologies in biology: design, applications and future challenges. Nat Rev Genet. 2004; 5(3):213–22.PubMedView ArticleGoogle Scholar
- Smith B. The logic of biological classification and the foundations of biomedical ontology. In: Invited Papers from the 10th International Conference in Logic Methodology and Philosophy of Science. Amsterdam: Elsevier-North-Holland: 2003. p. 19–25.Google Scholar
- Chandrasekaran B, Josephson JR, Benjamins VR. What are ontologies, and why do we need them?IEEE Intell Syst. 1999; 14(1):20–6.View ArticleGoogle Scholar
- Mayer G, Jones AR, Binz P-A, Deutsch EW, Orchard S, Montecchi-Palazzi L, et al.Controlled vocabularies and ontologies in proteomics: overview, principles and practice. Biochim Biophys Acta (BBA) Protein Proteomics. 2014; 1844(1):98–107.View ArticleGoogle Scholar
- Blake JA, Bult CJ. Beyond the data deluge: data integration and bio-ontologies. J Biomed Inform. 2006; 39(3):314–20.PubMedView ArticleGoogle Scholar
- Whetzel PL. NCBO Technology: Powering semantically aware applications. J Biomed Semantics. 2013; 4(Suppl 1):8.View ArticleGoogle Scholar
- Jonquet C, Lependu P, Falconer S, Coulet A, Noy NF, Musen MA, et al.NCBO Resource Index: Ontology-Based Search and Mining of Biomedical Resources. Web Semant. 2011; 9(3):316–24.PubMedPubMed CentralView ArticleGoogle Scholar
- Cote R, Reisinger F, Martens L, Barsnes H, Vizcaino JA, Hermjakob H. The Ontology Lookup Service: bigger and better. Nucleic Acids Res. 2010; 38(Web Server issue):155–60.View ArticleGoogle Scholar
- Corpas M, Fatumo S, Schneider R. How not to be a bioinformatician. Source Code Biol Med. 2012; 7(1):3.PubMedPubMed CentralView ArticleGoogle Scholar
- Baker M. Next-generation sequencing: adjusting to data overload. Nat Methods. 2010; 7(7):495–9.View ArticleGoogle Scholar
- Field D, Garrity G, Gray T, Morrison N, Selengut J, Sterk P, et al.The minimum information about a genome sequence (MIGS) specification. Nat Biotechnol. 2008; 26(5):541–7.PubMedPubMed CentralView ArticleGoogle Scholar
- Parnell LD, Lindenbaum P, Shameer K, Dall’Olio GM, Swan DC, Jensen LJ, et al.BioStar: an online question & answer resource for the bioinformatics community. PLoS Comput Biol. 2011; 7(10):1002216.View ArticleGoogle Scholar
- Achard F, Vaysseix G, Barillot E. Xml, bioinformatics and data integration. Bioinformatics. 2001; 17(2):115–25.PubMedView ArticleGoogle Scholar
- Barsnes H, Vizcaino JA, Eidhammer I, Martens L. Pride converter: making proteomics data-sharing easy. Nat Biotechnol. 2009; 27(7):598–9.PubMedView ArticleGoogle Scholar
- Bray T, Sperberg-McQueen M, Paoli J, Yergeau F, Maler E. Extensible markup language (XML) 1.0 (third edition). W3C recommendation, W3C: (February 2004). http://www.w3.org/TR/2004/REC-xml-20040204.
- Martens L, Hermjakob H, Jones P, Adamski M, Taylor C, States D, et al.Pride: the proteomics identifications database. Proteomics. 2005; 5(13):3537–45.PubMedView ArticleGoogle Scholar
- Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Rapp BA, Wheeler DL. GenBank. Nucleic Acids Res. 2000; 28(1):15–18.PubMedPubMed CentralView ArticleGoogle Scholar
- Karp PD. A protocol for maintaining multidatabase referential integrity. Pac Symp Biocomput. 1996:438–45.Google Scholar
- Apweiler R, Bairoch A, Wu CH, Barker WC, Boeckmann B, Ferro S, et al.Uniprot: the universal protein knowledgebase. Nucleic Acids Res. 2004; 32(Suppl 1):115–9.View ArticleGoogle Scholar
- Cunningham F, Amode MR, Barrell D, Beal K, Billis K, Brent S, et al.Ensembl 2015. Nucleic Acids Res. 2015; 43(Database issue):662–9.View ArticleGoogle Scholar
- Pruitt KD, Tatusova T, Maglott DR. NCBI reference sequences (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic Acids Res. 2007; 35(Database issue):61–5.View ArticleGoogle Scholar
- Juty N, Le Novere N, Laibe C. Identifiers.org and MIRIAM Registry: community resources to provide persistent identification. Nucleic Acids Res. 2012; 40(Database issue):580–6.View ArticleGoogle Scholar
- Cote RG, Jones P, Martens L, Kerrien S, Reisinger F, Lin Q, et al.The Protein Identifier Cross-Referencing (PICR) service: reconciling protein identifiers across multiple source databases. BMC Bioinformatics. 2007; 8:401.PubMedPubMed CentralView ArticleGoogle Scholar
- Huang daW, Sherman BT, Stephens R, Baseler MW, Lane HC, Lempicki RA. DAVID gene ID conversion tool. Bioinformation. 2008; 2(10):428–30.PubMed CentralView ArticleGoogle Scholar
- Orchard S, Kerrien S, Abbani S, Aranda B, Bhate J, Bidwell S, et al.Protein interaction data curation: the International Molecular Exchange (IMEx) consortium. Nat Methods. 2012; 9(4):345–50.PubMedPubMed CentralView ArticleGoogle Scholar
- Chatr-aryamontri A, Ceol A, Palazzi LM, Nardelli G, Schneider MV, Castagnoli L, et al. MINT: the Molecular INTeraction database. Nucleic Acids Res. 2007; 35(Database issue):572–4.View ArticleGoogle Scholar
- Xenarios I, Salwinski L, Duan XJ, Higney P, Kim SM, Eisenberg D. DIP, the Database of Interacting Proteins: a research tool for studying cellular networks of protein interactions. Nucleic Acids Res. 2002; 30(1):303–5.PubMedPubMed CentralView ArticleGoogle Scholar
- Leinonen R, Akhtar R, Birney E, Bower L, Cerdeno-Tárraga A, Cheng Y, et al.The european nucleotide archive. Nucleic Acids Res. 2010:967.Google Scholar
- Brazma A, Hingamp P, Quackenbush J, Sherlock G, Spellman P, Stoeckert C, et al.Minimum information about a microarray experiment (MIAME)-toward standards for microarray data. Nat Genet. 2001; 29(4):365–71.PubMedView ArticleGoogle Scholar
- Taylor CF, Field D, Sansone S-A, Aerts J, Apweiler R, Ashburner M, et al.Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the mibbi project. Nat Biotechnol. 2008; 26(8):889–96.PubMedPubMed CentralView ArticleGoogle Scholar
- Sweet JJ. Editorial. EQUATOR - reporting guidelines for “Enhancing the QUality and Transparency Of health Research”. Clin Neuropsychol. 2014; 28(4):547–8.PubMedView ArticleGoogle Scholar
- Orchard S, Al-Lazikani B, Bryant S, Clark D, Calder E, Dix I, et al.Minimum information about a bioactive entity (MIABE). Nat Rev Drug Discov. 2011; 10(9):661–9.PubMedView ArticleGoogle Scholar
- Orchard S, Salwinski L, Kerrien S, Montecchi-Palazzi L, Oesterheld M, Stumpflen V, et al.The minimum information required for reporting a molecular interaction experiment (MIMIx). Nat Biotechnol. 2007; 25(8):894–8.PubMedView ArticleGoogle Scholar
- Sansone S-A, Rocca-Serra P, Field D, Maguire E, Taylor C, Hofmann O, et al.Toward interoperable bioscience data. Nat Genet. 2012; 44(2):121–6.PubMedPubMed CentralView ArticleGoogle Scholar
- Hucka M, Nickerson DP, Bader GD, Bergmann FT, Cooper J, Demir E, et al.Promoting Coordinated Development of Community-Based Information Standards for Modeling in Biology: The COMBINE Initiative. Front Bioeng Biotechnol. 2015; 3:19.PubMedPubMed CentralView ArticleGoogle Scholar
- Orchard S, Hermjakob H, Apweiler R. The proteomics standards initiative. Proteomics. 2003; 3(7):1374–1376.PubMedView ArticleGoogle Scholar
- Knoppers BM. International ethics harmonization and the global alliance for genomics and health. Genome Med. 2014; 6(2):13.PubMedPubMed CentralView ArticleGoogle Scholar
- Nakamura Y, Cochrane G, Karsch-Mizrachi I. The International Nucleotide Sequence Database Collaboration. Nucleic Acids Res. 2013; 41(Database issue):21–4.View ArticleGoogle Scholar
- Hermjakob H, Apweiler R. The Proteomics Identifications Database (PRIDE) and the ProteomExchange Consortium: making proteomics data accessible. Expert Rev Proteomics. 2006; 3(1):1–3.PubMedView ArticleGoogle Scholar
- Demir E, Cary MP, Paley S, Fukuda K, Lemer C, Vastrik I, et al.The BioPAX community standard for pathway data sharing. Nat Biotechnol. 2010; 28(9):935–42.PubMedPubMed CentralView ArticleGoogle Scholar
- Crosswell LC, Thornton JM. ELIXIR: a distributed infrastructure for European biological data. Trends Biotechnol. 2012; 30(5):241–2.PubMedView ArticleGoogle Scholar
- Yuille M, van Ommen GJ, Brechot C, Cambon-Thomsen A, Dagher G, Landegren U, et al.Biobanking for Europe. Brief. Bioinformatics. 2008; 9(1):14–24.PubMedView ArticleGoogle Scholar
- Margolis R, Derr L, Dunn M, Huerta M, Larkin J, Sheehan J, et al.The National Institutes of Health’s Big Data to Knowledge (BD2K) initiative: capitalizing on biomedical big data. J Am Med Inform Assoc. 2014; 21(6):957–8.PubMedPubMed CentralView ArticleGoogle Scholar
- Klech H, Brooksbank C, Price S, Verpillat P, Buhler FR, Dubois D, et al.European initiative towards quality standards in education and training for discovery, development and use of medicines. Eur J Pharm Sci. 2012; 45(5):515–20.PubMedView ArticleGoogle Scholar
- Doiron D, Burton P, Marcon Y, Gaye A, Wolffenbuttel BH, Perola M, et al.Data harmonization and federated analysis of population-based studies: the BioSHaRE project. Emerg Themes Epidemiol. 2013; 10(1):12.PubMedPubMed CentralView ArticleGoogle Scholar
- Basset A, Los W. Biodiversity e-science: Lifewatch, the european infrastructure on biodiversity and ecosystem research. Plant Biosystems-An Int J Dealing Aspects Plant Biol. 2012; 146(4):780–2.View ArticleGoogle Scholar
- Krajewski P, Chen D, Ćwiek H, van Dijk AD, Fiorani F, Kersey P, et al.Towards recommendations for metadata and data handling in plant phenotyping. J Exp Bot. 2015:271.Google Scholar
- Pettifer S, Thorne D, McDermott P, Marsh J, Villeger A, Kell DB, et al.Visualising biological data: a semantic approach to tool and database integration. BMC Bioinformatics. 2009; 10(Suppl 6):19.View ArticleGoogle Scholar
- Gehlenborg N, O’Donoghue SI, Baliga NS, Goesmann A, Hibbs MA, Kitano H, et al.Visualization of omics data for systems biology. Nat Methods. 2010; 7(3 Suppl):56–68.View ArticleGoogle Scholar
- Thorvaldsdottir H, Robinson JT, Mesirov JP. Integrative Genomics Viewer (IGV): high-performance genomics data visualization and exploration. Brief Bioinformatics. 2013; 14(2):178–92.PubMedPubMed CentralView ArticleGoogle Scholar
- Johnson C, Moorhead R, Munzner T, Pfister H, Rheingans P, Yoo TS. Nih/nsf visualization research challenges report: 2006. http://nrs.harvard.edu/urn-3:HUL.InstRepos:4138744.
- Kent WJ, Sugnet CW, Furey TS, Roskin KM, Pringle TH, Zahler AM, et al.The human genome browser at ucsc. Genome Res. 2002; 12(6):996–1006.PubMedPubMed CentralView ArticleGoogle Scholar
- Hubbard T, Barker D, Birney E, Cameron G, Chen Y, Clark L, et al.The ensembl genome database project. Nucleic Acids Res. 2002; 30(1):38–41.PubMedPubMed CentralView ArticleGoogle Scholar
- Engels R, Yu T, Burge C, Mesirov JP, DeCaprio D, Galagan JE. Combo: a whole genome comparative browser. Bioinformatics. 2006; 22(14):1782–3.PubMedView ArticleGoogle Scholar
- Shannon PT, Reiss DJ, Bonneau R, Baliga NS. The Gaggle: an open-source software system for integrating bioinformatics software and data sources. BMC Bioinformatics. 2006; 7:176.PubMedPubMed CentralView ArticleGoogle Scholar
- Frazer KA, Pachter L, Poliakov A, Rubin EM, Dubchak I. VISTA: computational tools for comparative genomics. Nucleic Acids Res. 2004; 32(Web Server issue):273–9.View ArticleGoogle Scholar
- Pavlopoulos GA, Wegener AL, Schneider R. A survey of visualization tools for biological network analysis. BioData Min. 2008; 1:12.PubMedPubMed CentralView ArticleGoogle Scholar
- Andersson L, Archibald AL, Bottema CD, Brauning R, Burgess SC, Burt DW, et al.Coordinated international action to accelerate genome-to-phenome with FAANG, the Functional Annotation of Animal Genomes project. Genome Biol. 2015; 16:57.PubMedPubMed CentralView ArticleGoogle Scholar
- Howe D, Costanzo M, Fey P, Gojobori T, Hannick L, Hide W, et al.Big data: The future of biocuration. Nature. 2008; 455(7209):47–50.PubMedPubMed CentralView ArticleGoogle Scholar
- Stein L. Genome annotation: from sequence to biology. Nat Rev Genet. 2001; 2(7):493–503.PubMedView ArticleGoogle Scholar
- Phylogeny Programs. http://evolution.genetics.washington.edu/phylip/software.html.
- Haw R, Hermjakob H, D’Eustachio P, Stein L. Reactome pathway analysis to enrich biological discovery in proteomics data sets. Proteomics. 2011; 11(18):3598–613.PubMedView ArticleGoogle Scholar
- Tanabe M, Kanehisa M. Using the KEGG database resource. Curr Protoc Bioinformatics. 2012; Chapter 1:1–12.Google Scholar
- Wang J, Zhang Y, Marian C, Ressom HW. Identification of aberrant pathways and network activities from high-throughput data. Brief Bioinformatics. 2012; 13(4):406–19.PubMedPubMed CentralView ArticleGoogle Scholar
- Mlecnik B, Scheideler M, Hackl H, Hartler J, Sanchez-Cabo F, Trajanoski Z. PathwayExplorer: web service for visualizing high-throughput expression data on biological pathways. Nucleic Acids Res. 2005; 33(Web Server issue):633–7.View ArticleGoogle Scholar
- Gotz S, Garcia-Gomez JM, Terol J, Williams TD, Nagaraj SH, Nueda MJ, et al.High-throughput functional annotation and data mining with the Blast2GO suite. Nucleic Acids Res. 2008; 36(10):3420–435.PubMedPubMed CentralView ArticleGoogle Scholar
- Huang daW, Sherman BT, Lempicki RA. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc. 2009; 4(1):44–57.View ArticleGoogle Scholar
- Stobbe MD, Jansen GA, Moerland PD, van Kampen AH. Knowledge representation in metabolic pathway databases. Brief Bioinformatics. 2014; 15(3):455–70.PubMedView ArticleGoogle Scholar
- Walter T, Shattuck DW, Baldock R, Bastin ME, Carpenter AE, Duce S, et al.Visualization of image data from cells to organisms. Nat Methods. 2010; 7(3 Suppl):26–41.View ArticleGoogle Scholar
- Giardine B, Riemer C, Hardison RC, Burhans R, Elnitski L, Shah P, et al.Galaxy: a platform for interactive large-scale genome analysis. Genome Res. 2005; 15(10):1451–5.PubMedPubMed CentralView ArticleGoogle Scholar
- Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, et al.Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003; 13(11):2498–504.PubMedPubMed CentralView ArticleGoogle Scholar
- Smoot ME, Ono K, Ruscheinski J, Wang PL, Ideker T. Cytoscape 2.8: new features for data integration and network visualization. Bioinformatics. 2011; 27(3):431–2.PubMedPubMed CentralView ArticleGoogle Scholar
- Kohler J, Baumbach J, Taubert J, Specht M, Skusa A, Ruegg A, et al.Graph-based analysis and visualization of experimental results with ONDEX. Bioinformatics. 2006; 22(11):1383–90.PubMedView ArticleGoogle Scholar
- Goff SA, Vaughn M, McKay S, Lyons E, Stapleton AE, Gessler D, et al.The iPlant Collaborative: Cyberinfrastructure for Plant Biology. Front Plant Sci. 2011; 2:34.PubMedPubMed CentralView ArticleGoogle Scholar
- Luo W, Brouwer C. Pathview: an R/Bioconductor package for pathway-based data integration and visualization. Bioinformatics. 2013; 29(14):1830–1.PubMedPubMed CentralView ArticleGoogle Scholar
- Attwood TK, Kell DB, McDermott P, Marsh J, Pettifer SR, Thorne D. Utopia documents: linking scholarly literature with research data. Bioinformatics. 2010; 26(18):568–74.View ArticleGoogle Scholar
- Attwood TK, Kell DB, McDermott P, Marsh J, Pettifer SR, Thorne D. Calling International Rescue: knowledge lost in literature and data landslide!Biochem J. 2009; 424(3):317–33.PubMedPubMed CentralView ArticleGoogle Scholar
- Treloar A. The research data alliance: Globally co-ordinated action against barriers to data publishing and sharing. Learned Publishing. 2014; 27(5):9–13.View ArticleGoogle Scholar