quality-extraction Configuration

quality-extraction Configuration

Warning

The quality-extraction is still in a very early stage of development. The configuration and the outcome is very likely to change in further developments. Any feedback is strongly welcome.

<?xml version="1.0" encoding="UTF-8"?>
<cdmQualityConfig>

<variable name="bla">
   <status_flag_variable name="blub">
      <allowed_values>1,2,...,6</allowed_values>
      <!-- or config by highest valid or lowest valid or all valid values  -->
      <!-- highest and lowest will be retrieved per data-slice, not for the whole variable -->
      <!-- <allowed_values use="(highest|lowest|all|min:xxx.x|max:xxx.x)" /> -->
   </status_flag_variable>
</variable>

<!-- set air_temperature to explicit fillValue -999 (default: implicit fillValue) -->
<variable name="air_temperature" fillValue="-999">
   <status_flag_variable name="altitude">
      <allowed_values use="min:1000" />
   </status_flag_variable>
</variable>

<!-- apply an external land-mask to sea_surface_temperature -->
<variable name="sea_surface_temperature" fillValue="-999">
   <status_flag_variable name="land_mask" file="land.dat" type="felt" config="felt2nc.xml" >
      <allowed_values use="all" />
   </status_flag_variable>
</variable>


</cdmQualityConfig>

In cases where the data should be extracted if certain conditions (qualities) apply, i.e. the status-flag indicates a properly working instrument, or the sea-surface-temperature is above 300K, the MetNoFimex::CDMQualityExtractor allows to add these rules. The cdmQualityConfig.xml file as shown above gives an example of such an configuration.

• The variable "bla" will only be set, if "blub" has integer-values between 1 and 6.
• The variable "air_temperature" will only be extracted for an "altitude" above 1000. The value 1000 is the actual data value in the variable "altitude" without any scaling or unit-conversion applied.
• The variable "sea_surface_temperature" will set the fill-values from the "land_mask" found in "land.dat", which is an external felt file and configured by "felt2nc.xml".

The following use-values can be selected:

• all select all valid values (within valid_max, valid_min or valid_range, without _FillValue)
• highest the highest numerical value found in the data-slice which is valid
• lowest the lowest numerical value fond in the data-slice which is valid
• max:xxx.x all valid-values below or equal xxx.x
• min:xxx.x all valid values above or equal xxx.x

All values which do not match the quality-criteria will be set to the _FillValue of the variable.

See also

MetNoFimex::CDMQualityExtractor