You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Next »

The Data Standards Training Course was developed in the framework of the EU FP7 Project MICORE and involves one day in which the participants are taken through a wide range of excercises. Although the schedule can be adapted to better match with the participants' specific needs and background knowledge the schedule of this course generally is as follows:

Programme

  • 9:00-9:25 Open Earth initiative
    • General introduction of the OpenEarth initiative
  • 9:25-9:30 Data management in general
    • Opening and outline of the course
      1. Extract Taking measurements and storing the measured data into files.
      2. Transform Enriching gathered data with metadata and storing in a standard file format.
      3. Load Storing the files in a database - not dealt with in this course.
      4. Provide Giving access to the database.
  • 9:30-10:30 Extract
    • Excercise: getting all the OpenEarthTools with subversion
    • Excercise: modifying and uploading a subversion checkout
  • 10:30-12:00 Transform
    • Excercise: exploring the OpenEarthTools
    • Excercise: loading raw data into OpenEarthRawData
    • Excercise: converting to netcdf while adding meta-data

  • 12:00-13:00 Lunch

  • 13:00-14:00 Load and Provide
    • Excercise: reading netcdf and opendap
    • Excercise: selection of data
  • 14:00-15:30 Hands-on exercises
    • exploring the OpenEarthTools
    • exploring the OpenEarth OPeNDAP server
    • transforming your own data into netCDF
  • 15:30-16:30 Brief introduction into working with wiki's

Table of contents

Data management in general

The EU FP7 Project MICORE defined a data standard and archiving protocol to provide end-users with a comprehensive standardised database. The protocol has become part of the Open Earth Initiative (formerly known as McTools) as developed by Deltares and is available freely. The data standard and archiving protocol provides a four step database guideline for OpenEarth users and developers to:

  • Extract - Taking measurements and storing the measured data into files,
  • Transform - Enriching gathered data with metadata and storing in a standard file format,
  • Load - Storing the files in a database - not dealt with in this course, and
  • Provide - Giving access to the database.

physical data (bathymetries, waves, tides etc.) in a form convenient for the assessment of direct and easy use in research and consultancy projects.

Open Earth Initiative

Download presentation

    • Explanation of the Open Earth Initiative (open source version of McTools/UCIT)
    • Overview of Open Earth building blocks
    • Attention for a few developing conventions

Extract

Download presentation

Transform

Download presentation

    • Excercise: Filling in required fields using the inspire metadata editor
    • Excercise: Storing metadata file on OpenEarthRawData
    • Excercise: Loading raw data in memory
    • Excercise: Converting to netcdf
    • Using CF convention

Provide

Download presentation (in prep.)

    • Reading NetCDF and OPeNDap
    • Selection of data
  • No labels