Data Files - Revision history

E.vandenberge: /* Example */

2026-08-10T12:13:43Z

Example

← Older revision		Revision as of 12:13, 10 August 2026
Line 32:		Line 32:

	</pre>		</pre>
	An example file can be downloaded here ~~[[File:~~Example.zip~~\|thumb]]~~ (sorry, it is zipped).		An example file can be downloaded here {{Download link\|media=Example.zip}} (sorry, it is zipped).

	== Parsing ==		== Parsing ==

E.vandenberge: /* Alternatives */

2017-02-20T15:36:45Z

Alternatives

← Older revision		Revision as of 15:36, 20 February 2017
Line 71:		Line 71:
	{\| class="wikitable"		{\| class="wikitable"
	\|-		\|-
	\| ~~file extension~~ \|\| '''tsv''' \|\| csv \|\| '''dat''' \|\| txt		\| File Extension \|\| '''tsv''', csv, '''dat''', txt
	\|-		\|-
	\| ~~file encoding~~\|\| '''~~ascii~~''' \|\| '''UTF-8''' \|\| UTF-16BE \|\| UTF-16LE \|\| UCS-4/UTF-32		\| File Encoding \|\| '''ASCII''', '''UTF-8''', UTF-16BE, UTF-16LE, UCS-4/UTF-32
	\|-		\|-
	\| ~~magic number~~ \|\| '''None''' \|~~\| <~~BOM>		\| [[wikipedia:Magic_number_(programming)\|Magic Number]] \|\| '''None''', [[wikipedia:Byte_order_mark\|BOM]]
	\|-		\|-
	\| ~~line delimiter~~ \|\| \n \|\| \r \|\| '''\r\n'''		\| Line Delimiter \|\| \n, \r, '''\r\n'''
	\|-		\|-
	\| ~~line delimiter~~ after ~~last line \|\| no~~ \|\| '''~~yes~~'''		\| Line Delimiter after Last Line \|\| '''Yes''', No
	\|-		\|-
	\| ~~field delimiter~~ \|\| '''<tab>''' \|\| , ~~\|\| ;~~		\| Field Delimiter \|\| '''<tab>''', <comma> , <semicolon>
	\|-		\|-
	\| ~~field delimiter~~ after ~~last field~~ \|\| '''no''' ~~\|\| yes~~		\| Field Delimiter after Last Field \|\| Yes, '''No'''
	\|-		\|-
	\| ~~quoting character~~ \|\| '''None''' \|\| " ~~\|\| '~~		\| Quoting Character \|\| '''None''', ', "
	\|-		\|-
	\| ~~escape qc~~ by doubling \|\| ~~no \|\| yes~~		\| Escape QC by doubling \|\| Yes, No
	\|-		\|-
	\| ~~escape character~~ \|\| '''~~none~~''' \|\| \		\| Escape Character \|\| '''None''', \
	\|-		\|-
	\| ~~first line~~ \|\| '''~~contains header~~''' ~~\|\| contains data~~		\| First Line Contains: \|\| '''Header''', Data
	\|-		\|-
	\| ~~last field~~ in ~~line~~ \|\| '''~~must not be empty~~''' ~~\|\| may be empty~~		\| Empty Last Field in Line \|\| Allowed, '''Not Allowed'''
	\|-		\|-
	\| ~~whitespace following delimiter~~ \|\| '''~~part~~ of ~~field~~''' ~~\|\| not part of field~~		\| Whitespace Following Delimiter \|\| '''Part of Field''', Excluded
	\|-		\|-
	\| ~~decimal separator~~ \|\| '''.''' \|\| ,		\| Decimal Separator \|\| '''<dot>''', <comma>
	\|-		\|-
	\| ~~thousands separator~~ \|\| '''~~none~~''' ~~\|\| . \|\| ␣ \|\|~~ U+2009		\| Thousands Separator \|\| '''None''', <dot>, <space>, U+2009
	\|}		\|}
	Note that tab characters and newlines cannot be present in field content.		Note that tab characters and newlines cannot be present in field content.

A.datadien at 14:04, 20 February 2017

2017-02-20T14:04:38Z

← Older revision		Revision as of 14:04, 20 February 2017
Line 12:		Line 12:

	===== Fields =====		===== Fields =====
	* Fields are separated by the '''tab''' field delimiter, because they rarely occur in texts and ~~therefore~~ escape ~~characters are often not needed~~.		* Fields are separated by the '''tab''' field delimiter, because they rarely occur in texts. This allows for the use of comma's and semicolons in sentences without using an escape character.
	* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.		* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
	* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.		* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.

A.datadien at 14:01, 20 February 2017

2017-02-20T14:01:20Z

← Older revision		Revision as of 14:01, 20 February 2017
Line 12:		Line 12:

	===== Fields =====		===== Fields =====
	* ~~Field~~ are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore escape characters are often not needed.		* Fields are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore escape characters are often not needed.
	* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.		* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
	* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.		* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.

A.datadien at 14:00, 20 February 2017

2017-02-20T14:00:42Z

← Older revision		Revision as of 14:00, 20 February 2017
Line 12:		Line 12:

	===== Fields =====		===== Fields =====
	* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore ~~require no escaping~~.		* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore escape characters are often not needed.
	* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.		* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
	* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.		* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.
	* Fields are never surrounded by a quoting character.		* Fields are never surrounded by a quoting character.
	* White space before or after field delimiters are considered part of a field.		* White space before or after field delimiters are considered part of a field.
	* There is no defined escape character. If your data can contain tabs, use a different field delimiter or file format.		* There is no defined escape character. If your data can contain tabs or newlines, use a different field delimiter or file format.

	===== Data =====		===== Data =====

A.datadien: changed word extension -> encoding

2017-02-20T13:40:59Z

changed word extension -> encoding

← Older revision		Revision as of 13:40, 20 February 2017
Line 73:		Line 73:
	\| file extension \|\| '''tsv''' \|\| csv \|\| '''dat''' \|\| txt		\| file extension \|\| '''tsv''' \|\| csv \|\| '''dat''' \|\| txt
	\|-		\|-
	\| file ~~extension~~ \|\| '''ascii''' \|\| '''UTF-8''' \|\| UTF-16BE \|\| UTF-16LE \|\| UCS-4/UTF-32		\| file encoding\|\| '''ascii''' \|\| '''UTF-8''' \|\| UTF-16BE \|\| UTF-16LE \|\| UCS-4/UTF-32
	\|-		\|-
	\| magic number \|\| '''None''' \|\| <BOM>		\| magic number \|\| '''None''' \|\| <BOM>

Wilbert.vanham at 13:02, 20 February 2017

2017-02-20T13:02:47Z

← Older revision		Revision as of 13:02, 20 February 2017
Line 8:		Line 8:
	===== Lines =====		===== Lines =====
	* Lines are separated by the '''\r\n''' line delimiter for better compatibility between operating systems.		* Lines are separated by the '''\r\n''' line delimiter for better compatibility between operating systems.
	* The line delimiter should also be added after the last line. This simplifies stream reading since all records (lines) are terminated.		* The line delimiter should also be added after the last line. This simplifies stream reading since all records (lines) are terminated. This allows for the use of a readline() function for acquiring a line.
	* The first line contains a header with column/field names.		* The first line contains a header with column/field names.

Wilbert.vanham: /* Fields */

2017-02-20T13:01:10Z

Fields

← Older revision		Revision as of 13:01, 20 February 2017
Line 13:		Line 13:
	===== Fields =====		===== Fields =====
	* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore require no escaping.		* Field are separated by the '''tab''' field delimiter, because they rarely occur in texts and therefore require no escaping.
	* The field delimiter should ~~also~~ be added after each line's last field~~, because.~~..		* The field delimiter should '''not''' be added after each line's last field. This allows for the use of a split() function for parsing a line.
	* The last field in a line must not be empty, because~~... if there is no value, wat do..~~.		* The last field in a line must not be empty, because it will show to parsers that the previous rule was obeyed.
	* Fields are ~~not~~ surrounded by a quoting character.		* Fields are never surrounded by a quoting character.
	* White space ~~between~~ field delimiters are considered part of ~~the~~ field.		* White space before or after field delimiters are considered part of a field.
	* There is no defined escape character. If your data can contain tabs, use a different field delimiter or file format.		* There is no defined escape character. If your data can contain tabs, use a different field delimiter or file format.

Wilbert.vanham at 12:57, 20 February 2017

2017-02-20T12:57:13Z

← Older revision		Revision as of 12:57, 20 February 2017
Line 8:		Line 8:
	===== Lines =====		===== Lines =====
	* Lines are separated by the '''\r\n''' line delimiter for better compatibility between operating systems.		* Lines are separated by the '''\r\n''' line delimiter for better compatibility between operating systems.
	* The line delimiter should also be added after the last line~~, because.~~..		* The line delimiter should also be added after the last line. This simplifies stream reading since all records (lines) are terminated.
	* The first line contains a header with column/field names.		* The first line contains a header with column/field names.

A.datadien at 11:23, 20 February 2017

2017-02-20T11:23:21Z

← Older revision		Revision as of 11:23, 20 February 2017
Line 4:		Line 4:
	===== File =====		===== File =====
	* File encoding is ASCII or UTF-8.		* File encoding is ASCII or UTF-8.
	* The file contains no byte order mark (BOM) or other magic number.		* The file contains no byte order mark (BOM) or other magic number. This makes it ASCII compatible.

	===== Lines =====		===== Lines =====