Versions Compared

Old Version 113

changes.mady.by.user Fedor Baart

Saved on

compared with

New Version 114

changes.mady.by.user Fedor Baart

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Include Page
OET:ContentHeader
OET:ContentHeader
Section
Column
Wiki Markup


!datasetsoverview_small.png|align=right,width=300px! *The OpenEarth philosophy related to data involves that important data sets, rather than working on a
Image Removed The OpenEarth philosophy related to data involves that important data sets, rather than working on a 
project-by-project basis, should be collected and be made available in a project-superseding manner.* intends all datasets to conform with a number of basic quality criteria:

* data is not just numbers and meta-information, but consists of raw data produced by the measuring equipment (e.g. volts) + processing scripts.

* raw data should be stored in the OpenEarthRawData repository enabling version control

* raw data should then be enriched with metadata and processed into useful data products (netCDF) using transformation scripts also put under version control in a repository
 
* resulting data products should conform to the best open source standards available

* data products should be made available easily via webbased interfaces but also with automated procedures for widely-used data processing languages (matlab, IDL, python, fortran, C, java)

* data products are primarily meant for dissemination, raw data and scripts are primarily meant for archiving
.

Image Removed To achieve this international standards are embraced like:

netCDF 
.

!Data Standards Workflow_small.PNG|align=right,width=450px! To achieve this international standards are embraced like:
* [netCDF] (self-describing, open source, widely-used file-format standard)

* [CF parameter meta-data|CF] (vocabulary of quantities)

* [Unidata units|CF] (vocabulary of units)
EPSG spatial 

* [EPSG|http://www.epsg.org/] [spatial meta-data codes|http://www.epsg-registry.org/]  (vocabulary of coordinates)
 
* [INSPIRE owner meta-data
  • Open source Creative Commons philosophy or GNU
  • OPeNDAP (as running operationally for MATROOS)
  • OpenGIS
    • web map services (WMS),
    • web coverage services (WCS), and
    • web feature services (WFS).
  • Fabric For loading data on the opendap server you can use fabric.

    • The data collection procedure and the relation between those standards is explained in the OpenEarth Data Standards document, developed in the framework of the EU FP7 Project MICORE. Currently data sets are being uploaded to the OPeNDAP production servers THREDDS (default) and HYRAX (incl. kml previews for Google Earth/maps, but *.nc access not yet fully operational) and to the OPeNDAP test server THREDDS. Examples from open datasets from the internet on OpenEarth include:

    Image Removed

    Numerous other datasets have been or are being uploaded continually in the MICORE and Building with Nature research programmes.

    OpenEarth is not the only initiative to share and disseminate government-paid Earth science data freely on the web using open standards. We made an inventory of related initiatives.
    |http://www.inspire-geoportal.eu]
* Open source [Creative Commons philosophy|http://creativecommons.org/] or [GNU|http://www.gnu.org/licenses/]
* [OPeNDAP|http://opendap.org/] (as running operationally for [MATROOS|http://matroos.deltares.nl/])
* [OpenGIS|http://www.opengeospatial.org/]
** web map services ([WMS|http://www.opengeospatial.org/standards/wms]),
** web coverage services ([WCS|http://www.opengeospatial.org/standards/wcs]), and
** web feature services ([WFS|http://www.opengeospatial.org/standards/wfs]). 
* [Fabric] For loading data on the opendap server you can use fabric. 

The data collection procedure and the relation between those standards is explained in the [OpenEarth Data Standards|Data Collection Protocol] document, developed in the framework of the EU FP7 Project MICORE. Currently data sets are being uploaded to the [OPeNDAP production servers|http://opendap.deltares.nl:8080] [THREDDS|http://opendap.deltares.nl:8080/thredds/catalog/opendap/catalog.html] (_default_) and [HYRAX|http://opendap.deltares.nl:8080/opendap] (_incl. kml previews for Google Earth/maps, but *.nc access not yet fully operational_) and to the [OPeNDAP test server|http://dtvirt5.deltares.nl:8080] [THREDDS|http://dtvirt5.deltares.nl:8080/thredds/catalog/opendap/catalog.html]. Examples from open datasets from the internet on OpenEarth include:
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] [JarKus|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/jarkus/catalog.html] and [vaklodingen|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/vaklodingen/catalog.html] coastal bathymetry data ([web source|http://www.watermarkt.nl/kustenzeebodem]).
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] coastal [grain size fields|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/grainsize/catalog.html].
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] [sediment atlas Wadden Sea|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/sedimentatlas_waddenzee/catalog.html] ([web source|http://www.waddenzee.nl/Sedimentatlas.729.0.html]).
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] DONAR database subset from www.waterbase.nl [(water levels, salinity, temperature, SPM, chlorofyll)|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/waterbase/catalog.html] ([web source|http://www.waterbase.nl]).
* [KNMI|http://www.knmi.nl] potential [wind|http://opendap.deltares.nl:8080/thredds/catalog/opendap/knmi/potwind/catalog.html] time series ([web source|http://www.knmi.nl/klimatologie/onderzoeksgegevens/potentiele_wind/]).
* [KNMI|http://www.knmi.nl] daily averaged [meteo|http://opendap.deltares.nl:8080/thredds/catalog/opendap/knmi/etmgeg/catalog.html] time series ([web source|http://www.knmi.nl/klimatologie/daggegevens/download.cgi]).
* [TNO|http://www.tno.nl/bouw_en_ondergrond/] / [AHN|http://www.ahn.nl] [digital elevation map of the Netherlands|http://opendap.deltares.nl/thredds/dodsC/opendap/tno/ahn100m/mv100.nc.html].
* Deltares / Rijkswaterstaat [Delta flume experiments|http://opendap.deltares.nl/thredds/catalog/opendap/deltares/deltaflume2006_dune_erosion/catalog.html].

!OpenEarthBuildingBlocks.png|align=right,width=450px!

Numerous other datasets have been or are being uploaded continually in the MICORE and Building with Nature research programmes.

OpenEarth is not the only initiative to share and disseminate government-paid Earth science data freely on the web using open standards. We made an [inventory of related initiatives|Data sharing initiatives].

{html}
<object width="425" height="344"><param name="movie" value="http://www.youtube.com/v/7w2DBazX6g4&hl=en&fs=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/7w2DBazX6g4&hl=en&fs=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="425" height="344"></embed></object>
{html}
    Column
    Wiki Markup
    | {lozenge:icon=!OpenEarth^lozenges.png!|title=Google Earth|link=Google Earth|color=green|width=300px}Visualisation in Google Earth{lozenge}|
| {lozenge:icon=!OpenEarth^lozenges.png!|title=Gallery|link=KML Screenshots|color=green|width=300px}data visualisations in [Google Earth|http://earth.google.com] ^TM^{lozenge} |

| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenDAP server (*production*)|link=http://opendap.deltares.nl:8080|color=green|width=300px} Access using OpenDAP protocol [THREDDS|http://opendap.deltares.nl:8080/thredds/catalog/opendap/catalog.html] (_default_) or  [HYRAX|http://opendap.deltares.nl:8080/opendap]. {lozenge}|
| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenEarthRawData repository|link=https://repos.deltares.nl/repos/OpenEarthRawData|color=green|width=300px}Store your raw data here{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=Data standards|link=Data Collection Protocol|color=green|width=300px}OpenEarth data collection protocol {lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=Tutorials|link=OpenEarth tutorials|color=green|width=300px}OpenEarth Tutorials{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenDAP server (*test*)|link=http://dtvirt5.deltares.nl/thredds|color=green|width=300px}Access using OpenDAP protocol THREDDS only{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=GeoServer (*experimental*)|link=http://dtvirt5.deltares.nl:8080/geoserver |color=green|width=300px}Access data using the WMS and WFS services {lozenge}|