wise-soe-water-quality-wise-4.xsd
Rev. 1.0.0, 2015-11-16

wise-soe-water-quality-wise-4.xsd

ist das zentrale Schema (Level-1) für die Übermittlung von Wasserdaten an die 
EUA. Es wird hier für Grundwasser benötigt.
Das Schema importiert fünf andere Schemata (Level-2), von denen jedes wiederum
ein Container-Schema (Level-3) importiert. Die Level-2-Schemata enthalten die
fachlichen Attribute mit min- und maxOccurs-Angaben, mithin Namen und die
Angabe, ob Pflicht oder Option. Die Typdefinitionen (String, Restriction etc.)
der fachlichen Attribute finden sich in den Level-3-Schemata, die am Ende
-TBL9xxx.xsd heißen.

Das zentrale Schema wurde am 2015-11-10 von der Eionet-Seite
http://dd.eionet.europa.eu/datasets/3163 als "schema-dst-3163.xsd" geladen und
die inkludierten Schemata (mit der "Flatten Schema"-Funktion von oXygen XML) am
2015-11-16 in einem lokalen Verzeichnis gesammelt.

Dabei wurden von ENDA vernünftige, sachbezogene Bezeichner sowohl für das
zentrale Schema als auch für die Sub-Schemata vergeben.

Entwicklerinformationen:
Das originale Eionet-Schema ist syntaktisch nicht konform mit der W3C-Schema-
Spezifikation und wurde von ENDA daher korrigiert, ohne wasserfachliche
Änderungen vorzunehmen. (Fehlerhaft ist unter anderem, dass fünf Import-
Anweisungen auf ein und denselben Namespace ausgeführt werden.)

Die CDATA-Blöcke sind durchweg überflüssig, da sie keine zu expandierenden
Entities enthalten. Sie entstammen dem Originalschema des Eionet Data
Dictionary und wurden nicht entfernt, da das Originalschema so wenig wie
möglich geändert werden sollte. Wird das XML-Markup aus den CDATA-Blöcken bei
der automatisierten Erzeugung der HTML-Dokumentation entfernt, entfallen auch
die Zeilenumbrüche und die Dokumentation wird größtenteils unlesbar.
Daher musste dies unterbleiben. 

2015-11-16, M. Lüttgert, ENDA KG

<dd3:Methodology>
  <![CDATA[OVERVIEW:

Water quality in rivers, lakes and groundwater is reported under WISE-SoE using a harmonised data model. All determinands (nutrients, hazardous substances and supportive determinands) are coded using a unique identifier. The representation of values below the limit of quantification is identical for disaggregated data, data aggregated by monitoring site or data aggregated by water body for all water categories (rivers, lakes, groundwater) and for all determinands.

Raw data (i.e. sample values) is reported in the DisaggregatedData table.

Annually aggregated data, by monitoring site, is reported in the  AggregatedData table. This includes biological determinands that are not reported using Ecological Quality Ratio (EQR) – for example chlorophyll a. 

Biological data reported as EQR values, in river or lake monitoring sites, is reported in the BiologyEQRData table. The BiologyEQRClassificationProcedure table provides information on the ecological status or ecological potential class boundaries for the EQR values.

Annually aggregated data, by water body, is reported in the AggregatedDataByWaterBody table.

The full list of determinands, and the indicative thresholds for "potentially high mean annual value" of selected nutrients (i.e. used to flag potential outliers in the quality control procedures), is available in http://cdr.eionet.europa.eu/help/WISE_SoE/wise4.


1. Coverage and reference period

The data should be derived from existing national or regional monitoring programs within each EEA Member Country.

Submit data collected up to the end of the previous year (e.g. in 2015, submit data collected until the end of 2014).


2. Data content

Reporting of disaggregated data (i.e. sample data) is preferred for all determinands in groundwater, rivers and lakes (except for biological EQR values, please see below). 

If disaggregated data is not available for reporting, then submit annually aggregated data, by monitoring site, using the AggregatedData table (i.e. for nutrients and selected biological determinands in rivers or lakes).

Annually aggregated data is accepted only for groundwater bodies and for selected determinands – nitrate, nitrite, ammonium and dissolved oxygen. Use the table AggregatedDataByWaterBody to report this data.

Use the BiologyEQRData table to report the annual mean value of biological Ecological Quality Ratio (EQR) data in rivers or lakes and report the class boundaries values using the BiologyEQRClassificationProcedure table.


3. Data publication

Disaggregated data is preferred even where reporting of aggregated data is still acceptable (e.g. for hazardous substances in rivers or lakes; nitrate, nitrite, ammonium and dissolved oxygen in groundwater). Disaggregated data will not be published by EEA.

Data will be aggregated prior to publication in Waterbase. Annually aggregated data will be used as the basis of assessment in indicator factsheets or reports. 


4. Spatial reference data

The time series reported under the WISE SoE Water Quality data flow must be linked to a monitoring site (or to a groundwater body, for data aggregated by water body), using a unique identifier. The location, identification and characteristics of the spatial objects must be provided via the WISE Spatial data flow.

If a monitoring site or water body is reported also under the WFD, then use the WFD identifier as the unique identifier.

During the quality control procedures of the data reported under the WISE SoE Water Quality, the consistency of these identifiers will be checked against the spatial data already reported. (Please note that the spatial data does not have to be reported annually. However, updates to the spatial data (e.g. new monitoring sites, changes in the identifiers, etc.) should be reported.  


5. Values below the limit of quantification in disaggregated data

If, for a specific sample value, the measured concentration is below the limit of quantification, then report the limit of quantification value in the "Observed Value" field and report 'True' (or '1') in the boolean "Observed value below LOQ" field.


6. Values below the limit of quantification in annually aggregated data

When preparing annually aggregated data, sample concentrations below the limits of quantification must be treated in accordance to the QA/QC Directive (Commission directive 2009/90/EC of 31 July 2009 laying down, pursuant to Directive 2000/60/EC of the European Parliament and of the Council, technical specifications for chemical analysis and monitoring of water status):

- If a sample concentration value is below the limit of quantification, then it must be replaced with a value equivalent to HALF THE LIMIT OF QUANTIFICATION value;

- If the calculated annual mean value of the measurements results is below the limit of quantification value, then report the limit of quantification value in the "resultMeanValue" field and report 'True' (or '1') in the boolean "resultQualityMeanBelowLOQ" field.

- Use the same rule when calculating and reporting the minimum, maximum and median values.

- If the samples in the calculation had different limits of quantification, then the highest of the different LOQ values must be used. 


7. Reporting data at water body level

The aggregation process should consist of two phases: first, calculate the annual mean value by monitoring site; then use the results to calculate the annual mean value by water body. Using this approach, the influence of different number of samples at monitoring site level is eliminated.


8. Decimal separators and precision of the reported data

Use a decimal point '.' as the decimal separator. Do not use a comma ','.

The general recommendation concerning the decimal precision is as follows:
- Use 1 to 3 decimal places in reporting nutrients (usually in milligrams per litre),
- Use 3 to 4 decimals places in reporting hazardous substances (usually in micrograms per litre).


9. Other recommendations

If disaggregated data is reported, then do NOT report redundant aggregated data.

Please provide long time series without gaps and as complete a geographic coverage as possible. 


10. Reporting format and delivery

Use the reporting templates (MS Excel, XML schemas or MS Access) and these specifications when formatting and collating the data delivery. The templates can be downloaded from the data dictionary.

Data can be delivered in XML files or in MS Excel file format. Please do not use formulas in MS Excel files and do not rename the worksheets or column names. The file name can be renamed.

Delivery can be split into a multiple files if necessary. All the files must, however, be uploaded to the same envelope.

Upload the data files to the Central Data Repository at http://cdr.eionet.europa.eu/.

A WISE SoE Water Quality folder will be created by the EEA under your country’s collection.


If you have any questions about the format and content of the data request please contact WISE-SoE helpdesk, e-mail: wisesoe.helpdesk@eionet.europa.eu]]>
</dd3:Methodology>
<dd3:Version>
  <![CDATA[July 2015]]>
</dd3:Version>
<dd3:ShortDescription>
  <![CDATA[Data on water quality.]]>
</dd3:ShortDescription>
<dd2:Keyword>
  <![CDATA[water quality]]>
</dd2:Keyword>
<dd2:Keyword>
  <![CDATA[Water]]>
</dd2:Keyword>
<dd2:Name>
  <![CDATA[WISE SoE - Water Quality (WISE-4)]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Data on water quality in rivers, lakes and groundwater reported by countries within WISE-SoE reporting.]]>
</dd2:Definition>

<dd2:Keyword>
  <![CDATA[Water]]>
</dd2:Keyword>
<dd2:Keyword>
  <![CDATA[water quality]]>
</dd2:Keyword>
<dd2:Name>
  <![CDATA[Sample data by monitoring site]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Raw disaggregated water quality data on the observed values (e.g. concentrations) of determinands in rivers, lakes and groundwater as reported by EEA Member Countries on an annual basis.
]]>
</dd2:Definition>
<dd3:ShortDescription>
  <![CDATA[Raw disaggregated data on the observed values (e.g. concentrations) of determinands.]]>
</dd3:ShortDescription>
<dd3:Methodology>
  <![CDATA[Disaggregated data should be reported for hazardous substances in rivers or lakes and for all determinands in groundwater.

Each record in this table must have a unique combination of the values in the fields "monitoringSiteIdentifier", "monitoringSiteIdentifierScheme", "observedPropertyDeterminandCode", "procedureAnalysedFraction", "procedureAnalysedMedia" and "phenomenonTimeSamplingDate". 

The monitoring site is uniquely identified by combination of values in the fields "monitoringSiteIdentifier" and "monitoringSiteIdentifierScheme". 
The monitoring site identifier should be present in the list of monitoring sites (http://dd.eionet.europa.eu/vocabulary/wise/MonitoringSite) that is kept updated with the data reported under the WISE Spatial Data and/or the WFD 2016 Spatial data flows.

Select the adequate unit of measure according to the type of the determinand.

If the measured concentration is below the limit of quantification, then report the limit of quantification value in the "Observed Value" field and report 'True' in the boolean "resultQualityObservedValueBelowLOQ" field.

Fields "procedureAnalyticalMethod" and "parameterSampleDepth" are mandatory for rivers and lakes data.]]>
</dd3:Methodology>

<dd3:Methodology>
  <![CDATA[This value is required.

If the site was reported as a WFD monitoring site, enter the WFD identifier of the site.

If the site was reported as an EIONET monitoring site, enter the EIONET international identifier of the site.

The "monitoringSiteIdentifier" is a unique value in the list of monitoring sites for a given "monitoringSiteIdentifierScheme". For each "monitoringSiteIdentifierScheme" value, a list of valid "monitoringSiteIdentifier" values will be kept updated, based on the information reported under the WISE Spatial data flow.

First 2 characters must be the 2-alpha character ISO country code (use 'EL' for Greece and 'UK' for the United Kingdom).

Do not use characters with accents and other diacritical marks (national characters). Do not use spaces or other spatial characters. The hyphen '-' and the underscore '_' characters are allowed.

An EIONET identifier can be created by prefixing the national site identifier with the 2-alpha character ISO country code.
Example: country: Austria, national station identifier : ST_123 => "monitoringSiteIdentifier": ATST_123

Please guarantee that the "monitoringSiteIdentifier" is unique and exists in the applicable "monitoringSiteIdentifierScheme".]]>
</dd3:Methodology>
<ddnull:languageUsed>
  <![CDATA[No]]>
</ddnull:languageUsed>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Monitoring site identifier]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Unique international identifier of the monitoring site in which the data were obtained.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.

If the monitoring site is reported under WFD, use the value 'euMonitoringSiteCode' for the "MonitoringSiteIdentifierScheme" field.

If the monitoring site is NOT reported under WFD (e.g. non-EU countries reporting under WISE SoE only, or countries providing information about monitoring sites that are not WFD monitoring sites), use the value 'eionetMonitoringSiteCode' for the "MonitoringSiteIdentifierScheme" field.

For each identifier scheme, a list of valid "MonitoringSiteIdentifier" values will be kept updated, based on the information reported under the WISE Spatial data flow.]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Monitoring site identifier scheme ]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Specification of whether the monitoring site is a WFD monitoring site ('euMonitoringSiteCode') or not ('eionetMonitoringSiteCode').]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Water body category code]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Water body category code, as defined in the codelist.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.

Please note that CAS numbers are used where applicable. In the other cases a EEA generated code is used. Prefix "CAS_" is used for the unique codes based on the CAS number, prefix "EEA_" for the EEA codes.

The structure of the EEA code is similar to that of the CAS number:
- The first set of digits identifies the WFD quality element
- The second set of digits is a sequential number
- The last digit is a check digit.

This list is also used in the WFD reporting.]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Determinand code]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Unique code of the determinand monitored, as defined in the codelist.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.

Select 'total' if the "procedureAnalysedMedia" value is 'sediment' or 'biota' or if it is 'water' and the unfiltered sample was analysed.

Select 'dissolved' if the "procedureAnalysedMedia" value is 'water' and the filtered fraction of the sample was analysed.

Select 'SPM' if the "procedureAnalysedMedia" value is 'water' and the suspended particulate matter of the sample was analysed.]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Analysed fraction]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Specification of which fraction of the sample was analysed.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.

Identify the analysed media type ('biota', 'sediment' or 'water').

Please use the field "procedureAnalysedFraction" to further specify the fraction of the sample which was analysed ('total', 'dissolved', 'SPM').]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Analysed media]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Type of media monitored.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is a required.

Please check the valid units for each determinand in the reporting guidance documents. Please note the difference between the determinand and the actual unit of measure. For example, the Nitrate should be reported as milligrams of Nitrogen per litre (mg{N}/L).

The codes follow the UCUM syntax (http://unitsofmeasure.org/ucum.html).]]>
</dd3:Methodology>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Unit of measure]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Unit of measure for the reported values.]]>
</dd2:Definition>

<dd3:Methodology>
  <![CDATA[This value is required.

Use the format YYYY-MM-DD.]]>
</dd3:Methodology>
<ddnull:languageUsed>
  <![CDATA[No]]>
</ddnull:languageUsed>
<dd3:PublicOrInternal>
  <![CDATA[Public attribute]]>
</dd3:PublicOrInternal>
<dd2:Name>
  <![CDATA[Sampling time (date)]]>
</dd2:Name>
<dd2:Definition>
  <![CDATA[Date in which the sample was taken.]]>
</dd2:Definition>