...
The O2A component INGEST uses so called drivers (actually simple data converters) to convert your sensor data to a common data format: NRT RAW.
This is not yet the NRT Data Format but an intermediate format which all our tools between INGEST and DASHBOARD of our INGEST-to-DASHBOARD workflow understand.
In order to make INGEST and -to-DASHBOARD work easily for your data it would be very helpful for us that you provide a driver (script in Python, R, ...) able to handle your sensor data and create an NRT RAW file from that.
Afterwards we can easily map your sensor's data columns to actual SENSOR parameters.
...
Plain-text table having columns for each parameter from your raw data files and rows for each individual time record.
A sample file is attached: nrtformat2-sample_adcp_20190217_235334.nrt ferrybox_raw_SVL_20190219_230002_ferrybox-731101.nrtraw
What | How |
---|---|
Character encoding | UTF-8 |
Field / column separator | Tabulator “\t” |
End of record marker | New line “\n” |
Header | The header must consist of a column named “datetime” and 1-n columns having a static name describing your raw parameter.
|
Header - Units | Units may be given in square brackets [], following each |
column name, separated by a space “ “:
Units are optional but really make sense in this very first step because |
the INGEST-to-DASHBOARD workflow |
would |
automatically |
set up these units in databases such as the Dashboard. If you desire to store texts such as sample numbers or comments in your file, you have to append a unit |
[text |
]! Example:
| |
Date time format | Expected time zone: UTC Allowed date formats:
|
Decimal symbol | Dot "." |
Data values |
Allowed are decimal values (scientific format 1E-2 is supported), integer numbers or characters/texts/strings (just no tabulators!)
|
For use of Data-WS only: The Data-WS only accepts numbers as input for each column (including number formats such as About texts (or non-numeric characters): If you want to store texts, the column's unit must be |
[text |
]! |
[text |
] all characters or words (such as “inf”, “NaN”, “SAMPLE1”) will result in an import error. | |
Error values | Empty field (simply give a null string, but do not forget to add |
a tab as data field separator) | |
Missing values | Missing values do not need to be masked in a special way. The table cell just needs to be blank (no NA , null , etc.) |