[Note by K. Masuda on 2011-June-12] This is a copy of the page http://gain-hub.mri-jma.go.jp/gain_intro.html retrieved on 2006-Nov-07 .

GAIN Hub Introduction

Guideline for Data Exchange and Dissemination


GAME DATA MANAGEMENT


--------- Table of Content ---------


 
 

Overview of strategy - a revisit -

   The main objective of GAME data management is to provide the necessary data for the following research activities under the GAME scientific objectives.
  1. Process studies on the energy and water cycle.
  2. Development of atmospheric and hydolorogical models.
  3. Input to the four dimensional data assimilation model and its verification.
   In order to accomplish the above objective, GAME data management will be designed to satisfy the following conditions.
  1. The necessary data shall be collected in a consistent manner as possible.
  2. The well-documented quality control shall be applied to the collected data.
  3. The data shall be archived under the appropriate condition to keep its integrity.
  4. The data shall be provided to the users in a smooth way and at the nominal cost as possible.
   As a guideline for the data proessing, GAME data management will apply following data levels.
Level 1:
Original, direct instrumental reading. Data may not be referred to earth coordinate and may require conversion to geophysical parameters.
Level 2:
Geophysical parameters obtained from instruments or derived from Level 1 data. Data are referred to earth coordinate, usually as station data. Spatial distribution may not be homogeneous.
Level 3:
Homogeneouos data fields derived from Level 2 data by an analysis or a modelling techniques.
   GAME data management will also apply following quality-control levels.
QC 1:
The identification of obvious observing errors,including human error and insturmental failure.
QC 2:
The identification of errors that become apparent when data from different sources are compared.
QC 3:
The adjustment by the processing designed for the intended use of the data.

e.g. adjustment for biases, change of algorrithms, etc.

GUIDELINE for DATA EXCHANGE and DISSEMINATION

I. International Data Resource and Institutional Holding

    Hereafter "GAME data" are referred to those data which are necessary for achieving GAME scientific objectives.
International data resource:

   "GAME international data resource" is referred to those GAME data obtained under the implementation of GAME science plan, corresponding to the following categories.

  1. All Level-3 data.
  2. Level-2 data from the regional experiment to which the quality control higher than QC-1 level is applied.
  3. Level-2 Operational data provided as a cooperation with GAME IOP.
   The GAME international data resource is subject to the unrestricted disssemination for scientific purposes.
Institutional holdings:

   "Institutional holdings" is referred to those GAME data corresponding to the following categories.

  1. The operational data obtained as a routine observation.
  2. The data obtained under the contract with the other institution.
  3. The raw GAME data which are not satisfy the data level or quality control as an international data resource described above.
   The dissemination of institutional holding data are subject to the policy of each institute.

II. Participating Institutes

   GAME participating institutes are referred to those institutes which;
  1. produce the observational and/or processed data in accordance with the GAME science implementation plan.
  2. agree to provide its GAME data holdings for the international dissemination.
   GAME participating institutes are subject to the following privilege and obligation.
  1. The participating institute can request other participating institute to provide the holding data which are necessary for the data processing at the said institute.
  2. The participating institute should respond to the data request made by other participating institute as quickly as possible.
  3. When providing the GAME data, the participating institute should also provide the necessary informations regarding the data level and quality control.

III. Utilization and Transfer

   The GAME international data resource can be utilized unrestrictedly provided that;
  1. the utilization is for the scientific purpose. and
  2. the utilization is non-commercial/non-profitable.
   Those users who wish to utilize the GAME international data resource for the other purpose should ask for permission to;
  1. GAME International Science Panel. or
  2. the organization entrusted by the Panel.
   Those users who wish to transfer the GAME international data resource to the third party shall be requested to;
  1. acknowledge that the data become available through the GAME project.
  2. notify the existence of the present guideline.

IV. Data Policy(Time Schedule)

   Data obtained as part of the observations during the IOP will be made available according to the following schedule.
  1. By the end of June 1999 (6 months after the IOP), for the participating institutes and scientists.
  2. By the end of June 2000 (one year later), for the international research community.
   Data obtained as part of the GAME observations during the non-IOP will be made available according to the following schedule.
  1. By the end of one year after the observation, for the participating institutes and scientists.
  2. By the end of two years after the observation, for the international research community.

V. Retention

   The GAME participating institute shall be requested to keep its obsereved/processed/obtained GAME data at least for 10 years after the acquisition under the appropriate condition.
   Those institutes shall be requested to;
  1. provide the GAIN-Hub (see GAIN) with the necessary data catalog informations.
  2. respond to the data request/inquiry from the other participating institutes and the user community.
   For those institutes which are unable to keep the above functions, GAIN-Hub shall retain the data on their behalf provided that;
  1. the data are already processed at the level higher than Level-2 category and the quality control higher than QC-1 level is applied.
  2. the said institute agrees to disseminate the data as an GAME international data resource.

VI. Update

   When the participating institute applies the QC-3 level update to its GAME data, such as the change of the algorithm, it shall be requested to;
  1. retain the original data as well as the updated data.
  2. reveal the informations regarding the update.
   When the user update the GAME data following his/her own purpose, he/she will be requested to acknowledge the followings at the time of publication.
  1. The original data become available through the GAME project.
  2. The update is applied under his/her own responsibility.

GAME Archive & Information Network (GAIN)

I. GAIN

   GAME will construct GAIN in order to carry out:
- Data collection
- Data compilation and management
- Data access and analysis
   GAIN consists of:
- GAIN Distributed Active Archive Center (GAIN-DAAC)
- GAIN Hub of Archive & Informatin Network (GAIN-Hub)
- Information Network System

II. GAIN-DAAC

   All observed and processed data should be maintained by the designated archive facilities. GAME will designate multiple facilities as GAIN Distributed Active Archive Center (GAIN-DAAC).
   Each GAIN-DAAC is to provide the following functions.
  1. Maintain the data integrity and all necessary metadata informations to keep track of the applied algorithm and quality control.
  2. Operate an on-line data information system which can communicate with GAIN-Hub and participants in accordance with GAIN guidelines.
  3. Provide access to GAME data in accordance with GAME data policy.
  4. Accommodate the user feedback as to data format/accessibility.

III. GAIN Hub of Archive & Informatin Network (GAIN-Hub)

   GAIN-Hub will be the first access point to obtain a comprehensive data information for the participating and non-participating research communities.
   GAIN-Hub will act as a hub which links with multiple GAIN-DAAC to collect informations and to forward data requests.
   GAIN-Hub will develop and maintain the following functions.
Data Directory/Catalogue (including off-line data catalogue),
Station & Instrument Information,
On-line Data Inventories.

IV. Information Network System

   GAIN-Hub and GAIN-DAAC will prepare anonymous FTP servers to provide access for the research community through the Internet.

   GAIN-Hub and GAIN-DAAC will establish WWW sites to provide capabilities for the multi-media information system.

   Structure :


Schedule for GAIN Initial System (GAIN-IS):

Feb. 1996:

Get informations on FTP servers for possible GAIN-DAAC's. Set up WWW sites.

Mar. 1996:

Discuss "guideline for data exchange and dissemination" draft at GISP.

Oct. 1997:

Finalise the file and information standards.

Jan. 1998:

GAIN-IS set up.

Oct.1998:
Small revision.

July 1999:
Revision up.


Return to gain-hub TOP