You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Introduction

The O2A component INGEST uses so called drivers (actually simple data converters) to convert your sensor data to a common data format: NRT RAW.
This is not yet the NRT Data Format but an intermediate format which all our tools between INGEST and DASHBOARD understand.

In order to make INGEST and DASHBOARD work it would be very helpful for us that you provide a driver able to handle your sensor data and create an NRT RAW file from that.
Afterwards we can easily map your sensor's data columns to actual SENSOR parameters.

Example

datetime    TEMP [°C]    SAL [psu]
2019-02-28 15:50:00    -0.5445   34.1234
2019-02-28 15:50:01    -0.5444   34.1345
2019-02-28 15:50:02    -0.5552   34.1456

Format

Plain-text table having columns for each parameter from your raw data files and rows for each individual time record.
A sample file is attached: nrtformat2-sample_adcp_20190217_235334.nrt

WhatHow
Character encoding

UTF-8

Field / column separatorTabulator “\t”
End of record markerNew line “\n”
Header

The header must consist of a column named “datetime” and 1-n columns having a static name describing your raw parameter.
If you convert from a different table-like dataset your driver could also take over the raw column headers.
The “datetime” column must always be the first column.

datetime    TEMP    SAL

Header - Units

Units may be given in square brackets [], following each raw parameter, separated by a space “ “:

datetime    TEMP [°C]    SAL [psu]

Units are optional but really make sense in this very first step because in the INGEST-to-DASHBOARD workflow they would be automatically
appended to the data.



Date time format

Expected time zone: UTC

Allowed date formats:

yyyy-mm-dd HH:MM:SS.fff
yyyy-mm-dd HH:MM:SS
yyyy-mm-ddTHH:MM:SS.fff
yyyy-mm-ddTHH:MM:SS

Decimal symbolDot "."
Data values

Decimal values, integer numbers or characters (just no tabulators!)

34.56556    23    334.43E-2    SAMPLE1

For use of Data-WS only: The Data-WS only accepts numbers as input for each column except when its unit is "text"!
For columns which do not have the unit "text" all characters or words (such as “inf”, “NaN”, “SAMPLE1”) will result in an import error.

Error valuesEmpty field (simply give a null string, but do not forget to add tabs as data field separator)


Recent changes

29.06.2020

  • NRT Format version 2 now supports strings/texts as data values and also the Data-WS does now!
    Pass "[text]" as the column's unit to make it a text column.
  • No labels