Page History

...

What is it used for? We use this data description to create an Ingest template. Your descriptions are used to create Regular Expressions to match your files in your directories. We appreciate you to provide us with such regex repressions directly in your data description if your are familiar with them. Your data description is translated into such a template:

Code Block

language	py

  "_ingest": {
    "_sourceRegex": ".*(?P<campaign>PS[0-9]{2,3})",
    "_columns": [
      {
        "regex": "^((Screenshots|screenshots))\\/.*\\.((JPG|jpg|PNG|png))",
        "column": "Binary Object []",
        "comment": "Screenshots",
        "description": ""
      },
      {
        "regex": "^PHF_ASD_[1-2][0-9][0-9][0-9][0-1][0-9][0-3][0-9].*\\/HS3PHF_(?P<year>[1-2][0-9][0-9][0-9])-(?P<month>[0-1][0-9])-(?P<day>[0-3][0-9])T(?P<hour>[0-2][0-9])(?P<minute>[0-5][0-9])(?P<second>[0-5][0-9]).*Z_[0-9]*\\.asd",
        "column": "Binary Object []",
        "comment": "PHF_ASD files",
        "description": ""
      },
      {
        "regex": "^PHS_ASD_[1-2][0-9][0-9][0-9][0-1][0-9][0-3][0-9].*\\/HS3PHS_(?P<year>[1-2][0-9][0-9][0-9])-(?P<month>[0-1][0-9])-(?P<day>[0-3][0-9])T(?P<hour>[0-2][0-9])(?P<minute>[0-5][0-9])(?P<second>[0-5][0-9]).*Z_[0-9]*\\.asd",
        "column": "Binary Object []",
        "comment": "PHS_ASD files",
        "description": ""
      },
      {
        "regex": "^S7K_[1-2][0-9][0-9][0-9][0-1][0-9][0-3][0-9].*\\/(?P<year>[1-2][0-9][0-9][0-9])(?P<month>[0-1][0-9])(?P<day>[0-3][0-9])_(?P<hour>[0-2][0-9])(?P<minute>[0-5][0-9])(?P<second>[0-5][0-9])_.*\\.((s7k|S7K))$",
        "column": "Binary Object []",
        "comment": "RESON-S7K files",
        "description": ""
      }
    ]
  }

the key "_sourceRegex" can be used to extract campaign or event information from the directory. This is important if you wish to publish data from several campaigns (expedition legs) or events together. The following regex groups are supported by our framework: "campaign", "leg", "science_operation", "device_operation"
each element in the list below "columns" : [ describes one file type. "regex": provides the regular expression to match this certain file. The following reges regex groups are supported to extract information here: "year", "month", "hour", "minute", "second"

...

Versions Compared

Old Version 5

New Version 6

Key