Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Section
Column
Wiki Markup

!datasetsoverview_small.png|align=right,width=300px! *The OpenEarth philosophy related to data involves that important data sets, rather than working on a project-by-project basis, should be collected and be made available in a project-superseding manner.* intends all datasets to conform with a number of basic quality criteria:
* data is not just numbers and meta-information, but consists of raw data produced by the measuring equipment (e.g. volts) + processing scripts.
* raw data should be stored in the OpenEarthRawData repository enabling version control
* raw data should then be enriched with metadata and processed into useful data products (netCDF) using transformation scripts also put under version control in a repository 
* resulting data products should conform to the best open source standards available
* data products should be made available easily via webbased interfaces but also with automated procedures for widely-used data processing languages (matlab, IDL, python, fortran, C, java)
* data products are primarily meant for dissemination, raw data and scripts are primarily meant for archiving.

!Data Standards Workflow_small2.PNG|align=right,width=450px! To achieve this international standards are embraced like:
* [netCDF] (self-describing, open source, widely-used file-format standard)
* [CF parameter meta-data|CF] (vocabulary of quantities)
* [Unidata units|CF] (vocabulary of units)
* [EPSG|http://www.epsg.org/] [spatial meta-data codes|http://www.epsg-registry.org/]  (vocabulary of coordinates) 
* [INSPIRE owner meta-data|http://www.inspire-geoportal.eu]
* Open source [Creative Commons philosophy|http://creativecommons.org/] or [GNU|http://www.gnu.org/licenses/]
* [OPeNDAP|http://opendap.org/] (as running operationally for [MATROOS|http://matroos.deltares.nl/])
* [OpenGIS|http://www.opengeospatial.org/]
** web map services ([WMS|http://www.opengeospatial.org/standards/wms]),
** web coverage services ([WCS|http://www.opengeospatial.org/standards/wcs]), and
** web feature services ([WFS|http://www.opengeospatial.org/standards/wfs]). 
* [Fabric] For loading data on the opendap server you can use fabric. 

The data collection procedure and the relation between those standards is explained in the [OpenEarth Data Standards|Data Collection Protocol] document, developed in the framework of the EU FP7 Project MICORE. Currently data sets are being uploaded to the [OPeNDAP production servers|http://opendap.deltares.nl:8080] [THREDDS|http://opendap.deltares.nl:8080/thredds/catalog/opendap/catalog.html] (_default_) and [HYRAX|http://opendap.deltares.nl:8080/opendap] (_incl. kml previews for Google Earth/maps, but *.nc access not yet fully operational_) and to the [OPeNDAP test server|http://dtvirt5.deltares.nl:8080] [THREDDS|http://dtvirt5.deltares.nl:8080/thredds/catalog/opendap/catalog.html]. Examples from open datasets from the internet on OpenEarth include:
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] [JarKus|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/jarkus/catalog.html] and [vaklodingen|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/vaklodingen/catalog.html] coastal bathymetry data ([web source|http://www.watermarkt.nl/kustenzeebodem]).
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] coastal [grain size fields|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/grainsize/catalog.html].
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] [sediment atlas Wadden Sea|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/sedimentatlas_waddenzee/catalog.html] ([web source|http://www.waddenzee.nl/Sedimentatlas.729.0.html]).
* [Rijkswaterstaat|http://www.Rijkswaterstaat.nl] DONAR database subset from www.waterbase.nl [(water levels, salinity, temperature, SPM, chlorofyll)|http://opendap.deltares.nl:8080/thredds/catalog/opendap/rijkswaterstaat/waterbase/catalog.html] ([web source|http://www.waterbase.nl]).
* [KNMI|http://www.knmi.nl] potential [wind|http://opendap.deltares.nl:8080/thredds/catalog/opendap/knmi/potwind/catalog.html] time series ([web source|http://www.knmi.nl/klimatologie/onderzoeksgegevens/potentiele_wind/]).
* [KNMI|http://www.knmi.nl] daily averaged [meteo|http://opendap.deltares.nl:8080/thredds/catalog/opendap/knmi/etmgeg/catalog.html] time series ([web source|http://www.knmi.nl/klimatologie/daggegevens/download.cgi]).
* [TNO|http://www.tno.nl/bouw_en_ondergrond/] / [AHN|http://www.ahn.nl] [digital elevation map of the Netherlands|http://opendap.deltares.nl/thredds/dodsC/opendap/tno/ahn100m/mv100.nc.html].
* Deltares / Rijkswaterstaat [Delta flume experiments|http://opendap.deltares.nl/thredds/catalog/opendap/deltares/deltaflume2006_dune_erosion/catalog.html].

!OpenEarthBuildingBlocks.png|align=right,width=450px!

Numerous other datasets have been or are being uploaded continually in the MICORE and Building with Nature research programmes.

OpenEarth is not the only initiative to share and disseminate government-paid Earth science data freely on the web using open standards. We made an [inventory of related initiatives|Data sharing initiatives].


{html}
<object width="425" height="344"><param name="movie" value="http://www.youtube.com/v/7w2DBazX6g4&hl=en&fs=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/7w2DBazX6g4&hl=en&fs=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="425" height="344"></embed></object>
{html}

Column
Wiki Markup
| {lozenge:icon=!OpenEarth^lozenges.png!|title=Google Earth|link=Google Earth|color=green|width=300px}Visualisation in Google Earth{lozenge}|
| {lozenge:icon=!OpenEarth^lozenges.png!|title=Gallery|link=KML Screenshots|color=green|width=300px}data visualisations in [Google Earth|http://earth.google.com] ^TM^{lozenge} |

| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenDAP server (*production*)|link=http://opendap.deltares.nl:8080|color=green|width=300px} Access using OpenDAP protocol [THREDDS|http://opendap.deltares.nl:8080/thredds/catalog/opendap/catalog.html] (_default_) or  [HYRAX|http://opendap.deltares.nl:8080/opendap]. {lozenge}|
| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenEarthRawData repository|link=https://repos.deltares.nl/repos/OpenEarthRawData|color=green|width=300px}Store your raw data here{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=Data standards|link=Data Collection Protocol|color=green|width=300px}OpenEarth data collection protocol {lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=Tutorials|link=OpenEarth tutorials|color=green|width=300px}OpenEarth Tutorials{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=OpenDAP server (*test*)|link=http://dtvirt5.deltares.nl/thredds|color=green|width=300px}Access using OpenDAP protocol THREDDS only{lozenge}|

| {lozenge:icon=!OpenEarth^lozenges.png!|title=GeoServer (*experimental*)|link=http://dtvirt5.deltares.nl:8080/geoserver |color=green|width=300px}Access data using the WMS and WFS services {lozenge}|