Data Files: Difference between revisions

Jump to navigation Jump to search
start of simpler text (WIP)
in progress save
Line 1: Line 1:
== TSG suggested File Format For Dummies (WIP by Arvind for extra readability!) ==
== TSG suggested file format for experiment data ==
The TSG suggests the following file format for data storage for most experiments.
The TSG suggests the following file format for data storage for most experiments.


* Field delimiter: tab (also after last field)
===== Lines =====
* Line delimiter: \r\n (also after last line)
* Lines are separated by the '''\r\n''' line delimiter for better compatibility between operating systems.
* Quoting character: none
* The line delimiter should also be added after the last line, because...
* File extension: "tsv"
* The first line contains a header with column/field names.
* File encoding: ASCII / UTF-8
 
* Magic number: none
===== Fields =====
* First line contains header, not data
* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore require no escaping.
* The field delimiter should also be added after each line's last field, because...
* The last field in a line must not be empty, because... if there is no value, wat do...
* Fields are not surrounded by a quoting character.
* White space between field delimiters are considered part of the field.
* There is no defined escape character. If your data can contain tabs, use a different field delimiter or file format.
 
===== File =====
* The file is encoded as ASCII or UTF-8.
* The file contains no byte order mark (BOM) or other magic number.
 
* Last field must not be empty (what if no data?)
* Last field must not be empty (what if no data?)


Explanation for these choices (also nice for ourselves). In progress..
Explanation for these choices (also nice for ourselves). In progress..


 
#


== File Format ==
== File Format ==