The O2A component INGEST uses so called drivers (actually simple data converters) to convert your sensor data to a common data format: NRT RAW.
This is not yet the NRT Data Format but an intermediate format which all our tools of our INGEST-to-DASHBOARD workflow understand.
In order to make INGEST-to-DASHBOARD work easily for your data it would be very helpful for us that you provide a driver (script in Python, R, ...) able to handle your sensor data and create an NRT RAW file from that.
Afterwards we can easily map your sensor's data columns to actual SENSOR parameters.
datetime TEMP [°C] SAL [psu]
2019-02-28 15:50:00 -0.5445 34.1234
2019-02-28 15:50:01 -0.5444 34.1345
2019-02-28 15:50:02 -0.5552 34.1456
Plain-text table having columns for each parameter from your raw data files and rows for each individual time record.
A sample file is attached: ferrybox_raw_SVL_20190219_230002_ferrybox-731101.nrtraw
|Field / column separator||Tabulator “\t”|
|End of record marker||New line “\n”|
The header must consist of a column named “datetime” and 1-n columns having a static name describing your raw parameter.
|Header - Units|
Units may be given in square brackets , following each column name, separated by a space “ “:
Units are optional but really make sense in this very first step because the INGEST-to-DASHBOARD workflow would automatically
If you desire to store texts such as sample numbers or comments in your file, you have to append a unit [text]! Example:
|Date time format|
Expected time zone: UTC
Allowed date formats:
|Decimal symbol||Dot "."|
Allowed are decimal values (scientific format 1E-2 is supported), integer numbers or characters/texts/strings (just no tabulators!)
For use of Data-WS only: The Data-WS only accepts numbers as input for each column (including number formats such as
About texts (or non-numeric characters):
If you want to store texts, the column's unit must be [text]!
|Error values||Empty field (simply give a null string, but do not forget to add a tab as data field separator)|
|Missing values||Missing values do not need to be masked in a special way. The table cell just needs to be blank (no |