Data Files: Difference between revisions

Jump to navigation Jump to search
← Older edit
No edit summary
 
(3 intermediate revisions by 2 users not shown)
Line 12: Line 12:


===== Fields =====
===== Fields =====
* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore escape characters are often not needed.
* Fields are separated by the '''tab''' field delimiter, because they rarely occur in texts. This allows for the use of comma's and semicolons in sentences without using an escape character.
* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.
* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.
Line 32: Line 32:


</pre>
</pre>
An example file can be downloaded here [[File:Example.zip|thumb]] (sorry, it is zipped).
An example file can be downloaded here {{Download link|media=Example.zip}} (sorry, it is zipped).


== Parsing ==
== Parsing ==
Line 71: Line 71:
{| class="wikitable"
{| class="wikitable"
|-
|-
| file extension || '''tsv''' || csv || '''dat''' || txt
| File Extension || '''tsv''', csv, '''dat''', txt
|-
|-
| file encoding|| '''ascii''' || '''UTF-8''' || UTF-16BE || UTF-16LE || UCS-4/UTF-32
| File Encoding || '''ASCII''', '''UTF-8''', UTF-16BE, UTF-16LE, UCS-4/UTF-32
|-
|-
| magic number || '''None''' || <BOM>
| [[wikipedia:Magic_number_(programming)|Magic Number]] || '''None''', [[wikipedia:Byte_order_mark|BOM]]
|-
|-
| line delimiter || \n || \r || '''\r\n'''
| Line Delimiter || \n, \r, '''\r\n'''
|-
|-
| line delimiter after last line || no || '''yes'''  
| Line Delimiter after Last Line || '''Yes''', No
|-
|-
| field delimiter || '''<tab>''' || , || ;
| Field Delimiter || '''<tab>''', <comma> , <semicolon>
|-
|-
| field delimiter after last field || '''no''' || yes
| Field Delimiter after Last Field || Yes, '''No'''  
|-
|-
| quoting character || '''None''' || " || '
| Quoting Character || '''None''', ', "
|-
|-
| escape qc by doubling || no || yes
| Escape QC by doubling || Yes, No
|-
|-
| escape character || '''none''' || \
| Escape Character || '''None''', \
|-
|-
| first line || '''contains header''' || contains data
| First Line Contains: || '''Header''', Data
|-
|-
| last field in line || '''must not be empty''' || may be empty
| Empty Last Field in Line || Allowed, '''Not Allowed'''
|-
|-
| whitespace following delimiter || '''part of field''' || not part of field
| Whitespace Following Delimiter || '''Part of Field''', Excluded
|-
|-
| decimal separator || '''.''' || ,
| Decimal Separator || '''<dot>''', <comma>
|-
|-
| thousands separator || '''none''' || . || ␣ || U+2009
| Thousands Separator || '''None''', <dot>, <space>, U+2009
|}
|}
Note that tab characters and newlines cannot be present in field content.
Note that tab characters and newlines cannot be present in field content.
Retrieved from "https://tsgdoc.socsci.ru.nl/index.php/Data_Files"