...
- Verify whether the data are open, and whether you can are allowed to publish them it on interneinternet. (Keep a copy of the email or a hard-copy of the letter, avoid nasty discussions afterward).
- Put the raw data in the OpenEarthRawData repository.
- Make a new directory per institute originator/copyright owner (lower case).
- Add an INSPIRE *.xml file.
- Add a *.url internet shortcut file to the intetnet source (if any).
- Make subdirectories /raw, /cache and /scripts.
- Store the raw data in /raw
- /cache is for data that could in principle be downloaded, so there is no need for version control. However, some sources, notably www.waterbase.nl, are down for a long time, so caching is useful.
- Make a script to transform the data into netCDF files. Store the script in /scripts. Make sure the script only needs tools from /script and OpenEarth tools.
- Always put new netCDF first in your local synchronized local copy of the data in the OPeNDAP server. Make this local copy available to your entire company by making it accessible through your local network. This network copy is for optional fast access within your institute. Within Deltares this is P:\mcdata\opendap\ (ask for write access Gerben de Boer). For users outside Deltares we are working on ftp access to the filer server under OPeNDAP, which enable you to make synchronized local copy (with rsync).
- Make a new directory per institute or consortium originator/copyright owner that owns the copyright of the data. In principle the following sources need exactly the same directory structure:
- the OpenEarthRawData repository
- the OPeNDAP servers,
- your synchronized local copy of the data in the OPeNDAP servers (within Deltares: P:\mcdata\opendap)
- the *.kml direcory (zie beneden)
...