Permalink
Cannot retrieve contributors at this time
Name already in use
A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
wilson-apps/wilson-basic/introduction/format.md
Go to fileThis commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
executable file
116 lines (113 sloc)
5.21 KB
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
--- | |
output: html_document | |
--- | |
# Data Format | |
<p class="font"> | |
<b>CLARION: generiC fiLe formAt foR quantItative cOmparsions of high throughput screeNs</b> | |
<br><br> | |
CLARION is a data format especially developed to be used with WIlsON, which relies on a tab-delimited table with a metadata header to describe the following columns. It is based on the Summarized Experiment format and supports all types of data which can be reduced to features (e.g. genes, transcripts, proteins, probes) with assigned numerical values (e.g. count, score, log2foldchange, zscore, pvalue). Most result tables derived from RNA-Seq, ChIP/ATAC-Seq, Proteomics, Microarrays, and many other analyses can thus be easily reformatted to become compatible, without having to modify the code of WIlsON for each specific experiment. | |
<br><br> | |
<img src="images/clarion_excel_colored.png" width="100%"> | |
<br><br> | |
<p class="font"> | |
The format consists of three blocks of data with distinct structures: | |
<ul class="font"> | |
<li><b>Header</b>: Parameters concerning the global experiment</li> | |
<li><b>Metadata</b>: Parameters describing the content of each data column</li> | |
<li><b>Data</b>: Matrix of data columns bearing textual and numerical information per feature</li> | |
</ul> | |
</p> | |
</p> | |
</br> | |
## <a name="header"></a> Header: | |
<img src="images/header.png"/> | |
<p class="font"> | |
<ul class="font"> | |
<li>Line identifier '!'</li> | |
<li>Syntax: name = value</li> | |
<li>Mandatory columns: *</li> | |
</ul> | |
</p> | |
### Parameters: | |
<p class="font"> | |
<ul class="font"> | |
<li><b>format</b>: Name of the file format (must be Clarion)</li> | |
<li><b>version</b>: Version of the file format (1.0)</li> | |
<li><b>experiment_id</b>: Unique id to be used for the experiment</li> | |
<li><b>delimiter(*)</b>: In-field delimiter for multi-value fields (e.g. multiple kegg pathways). Mandatory for multi-value fields.</li> | |
</ul> | |
</p> | |
</br> | |
## <a name="metadata"></a> Metadata: | |
<img src="images/metadata.png"/> | |
<p class="font"> | |
<ul class="font"> | |
<li>Line identifier '#'</li> | |
<li>Mandatory columns: *</li> | |
</ul> | |
</p> | |
### Columns: | |
<p class="font"> | |
<ul class="font"> | |
<li><b>key</b>*:</li> | |
<ul class="font"> | |
<li>Reference to data matrix (column headline)</li> | |
<li>Must be unique</li> | |
</ul> | |
<li><b>factor1 - factorN</b>:</li> | |
<ul class="font"><li>Denotes experimental factors (e.g. wildtype, mutant, time point) per sample and condition</li></ul> | |
<ul class="font"><li>One or more columns (factor1, factor2, ..., factorN)</li></ul> | |
<ul class="font"><li>Used for grouping</li></ul> | |
<li><b>level</b>*:</li> | |
<ul class="font"> | |
<li>Classifies content of column</li> | |
<li>Must be one of:</li> | |
<ul class="font"> | |
<li><i>sample:</i> Data relating to a single sample</li> | |
<li><i>condition:</i> Data relating to a single condition (combination of all samples; e.g. average count)</li> | |
<li><i>contrast:</i> Data relating to a single contrast (pairwise comparison of conditions)</li> | |
<li><i>feature:</i> Annotation relating to a feature (e.g. gene, transcript, probe, protein, ...)</li> | |
</ul> | |
</ul> | |
<li><b>type(*)</b>:</li> | |
<ul class="font"> | |
<li>Mandatory for multi-value fields</li> | |
<li>Further classify content level</li> | |
<li>Must be one of:</li> | |
<li>For level = feature = values to be filtered for</li> | |
<ul class="font"> | |
<li><i>unique_id:</i> Unique identifier (e.g. ENSMUSG00000023944)</li> | |
<li><i>name:</i> Main feature name / symbol / label (e.g. Hsp90ab1)</li> | |
<li><i>category:</i> Single value per field; categorical data (e.g. protein_coding)</li> | |
<li><i>array:</i> Multiple delimited values per field; categorical data (e.g. Cholinergic synapse|Choline metabolism in cancer)</li> | |
</ul> | |
<li>For levels = sample, condition, contrast = values to be plotted</li> | |
<ul class="font"> | |
<li><i>score:</i> count, intensity, ...</li> | |
<li><i>ratio:</i> foldchange, log2foldchange, ...</li> | |
<li><i>probability:</i> pvalue, padj, ...</li> | |
<li><i>array:</i> Multiple numeric values per field; e.g. coverage/windows, ...</li> | |
</ul> | |
<li>Attention: if the type is not given, the first feature column is expected to hold a unique identifier!</li> | |
</ul> | |
<li><b>label</b>:</li> | |
<ul class="font"> | |
<li>Optional label alternative to column name</li> | |
<li>Can be used for plotting</li> | |
<li>Should be unique</li> | |
<li>For level = contrast delimited by '|' (condition1|condition2)</li> | |
</ul> | |
<li><b>sub_label</b>:</li> | |
<ul class="font"><li>Optional more detailed label to offer a logical subselection of a column using the interface</li></ul> | |
</ul> | |
</p> | |
</br> | |
## <a name="data"></a> Data: | |
<img src="images/data.png"/> | |
<p class="font"> | |
<ul class="font"> | |
<li>Traditional tab-delimited data matrix</li> | |
<li>Minimum: one column with a unique id; one column with a numerical value</li> | |
<li>If types are missing first column will be treated as unique_id</li> | |
</ul> | |
</p> |