Below we list an overview of the general geonetwork catalogues of EMODnet, CMEMS and ICES. These provide an easy user interface where you can search for interesting data products, datasets or services. Note that not all data or services are available in these catalogues, please check the following sections for more details.
EMODnet |
|
CMEMS |
|
ICES |
The EMODnet catalogues and other partner catalogues (IFREMER, ICES, etc.) offer the ability to search collections of metadata for data, services and related information objects related to the EMODnet Marine Data. The data catalogues offer a CSW endpoint to other client applications to connect to the service and query the metadata held in the catalogue.
EMODnet Central portal |
|
EMODnet Bathymetry |
|
EMODnet Biology |
|
EMODNET Chemistry |
https://sextant.ifremer.fr/geonetwork/srv/eng/csw-EMODNET_Chemistry |
EMODnet Geology |
|
EMODnet Human activities |
|
EMODnet Physics |
|
EMODnet Seabed habitats |
|
The mandatory GetCapabilities operation allows CSW clients to retrieve service metadata from a server. The response to a GetCapabilities request shall be an XML document containing service metadata about the server. This subclause specifies the XML document that a CSW server shall return to describe its capabilities.
Examples of EMODnet CSW GetCapabilities:
https://www.emodnet.eu/geonetwork/emodnet/eng/csw?service=CSW&request=GetCapabilities&version=2.0.2
https://sextant.ifremer.fr/geonetwork/srv/eng/csw?service=CSW&request=GetCapabilities&version=2.0.2
EMODnet central portal GetRecords example:
EMODnet Physics GetRecords example:
GetRecordById requests retrieves catalogue metadata records using their identifier.
EMODnet central portal GetRecordById example
The Web Map Service standard (WMS) provides a simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases. A WMS request defines the geographic layer(s) and area of interest to be processed. The response to the request is one or more geo-registered map images (returned as JPEG, PNG, etc) that can be displayed in a Geographic Information System (GIS) or in your own web application (OpenLayers, Leaflet,...).
The WMS supports the GetCapabilities, GetMap and GetFeatureInfo operations as defined in the Open Geospatial Consortium (OGC) WMS standard.
The EMODnet WMS services are accessible from 7 thematic portals at the Pan-European scale or global scale for some specific data products. Enter one of the following WMS endpoint URLs into your WMS client (QGIS, ArcMap, MapInfo etc.):
|
|
The mandatory GetCapabilities operation allows WMS clients to retrieve service metadata from a server. The response to a GetCapabilities request shall be an XML document containing metadata of the service (proposed layers, associated projections, author ...).
The standard to construct a WMS GetCapabilities request, depending on the version:
(wms endpoint url)?SERVICE=WMS&VERSION=1.3.0&REQUEST=GetCapabilities
or (wms endpoint url)?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetCapabilities
Example of a GetCapabilities request addressed to the EMODnet Physics view service:
Using the information given in the GetCapabilities request, the GetMap request returns a raster map containing the requested data layer selected from all the available layers as defined in the XML document. The elements such as the data layer, region, projection, size of the returned image, image format, etc. are defined in the form of arguments.
Example of a GetMap request that returns an image of the EMODnet Bathymetry Mean depth (DTM) based on source resolution of 1/8 arc minute (~250 meter) in multi colour style: https://ows.emodnet-bathymetry.eu/wms?service=WMS&service=WMS&request=GetMap&version=1.1.1&layers=emodnet%3Amean_multicolour&styles=&format=image%2Fpng&transparent=true&info_format=text%2Fhtml&tiled=false&width=400&height=628&srs=EPSG%3A3857&bbox=-2669794.954627626%2C2250306.11271559%2C4800533.188102208%2C14538934.276066802
Returns:
The EMODnet data layers are available as a Web Feature Service (WFS) or Web Coverage Service (WCS) in accordance with the Open Geospatial Consortium (OGC) specifications (www.opengeospatial.org).
Note that some portals provide other download services too. For example EMODnet Bathymetry offers a REST service, EMODnet Biology allows specific parameters in the WFS requests, EMODnet Chemistry has an OPeNDAP service,... See other web services by thematic portals
WFS defines a standard for exchanging vector data by querying both the data structure and the source data. The basic operations are GetCapabilities, DescribeFeatureType, and GetFeature. WFS supports a variety of WFS output formats (Ex: GML, shapefile, json, geojson, CSV,...). The full list of output formats supported can be found by performing a WFS GetCapabilities request.
The EMODnet WFS services are accessible from following endpoints:
EMODnet Bathymetry |
|
EMODnet Biology |
|
EMODnet Biology - Occurrence data |
|
EMODnet Chemistry - Marine litter |
|
EMODnet Chemistry – Time series location |
|
EMODnet Geology – Sea-floor (bedrock) |
|
EMODnet Geology – Marine Minerals |
|
EMODnet Geology – Seabed Substrate maps |
|
EMODnet Geology – Events and Probabilities |
|
EMODnet Geology – Coastal Behavior |
|
EMODnet Geology – Submerged Landscapes |
|
EMODnet Human activities |
|
EMODnet Physics |
|
EMODnet Seabed Habitats – General datasets and products |
|
EMODnet Seabed Habitats - individual habitat map and model datasets |
https://ows.emodnet-seabedhabitats.eu/emodnet_open_maplibrary/wfs |
A GetCapabilities request generates a metadata document (xml) describing a WFS service provided by server as well as valid WFS operations and parameters.
Example of a EMODnet human activities GetCapabilities request:
https://ows.emodnet-humanactivities.eu/wfs?SERVICE=WFS&VERSION=1.1.0&request=GetCapabilities
A DescribeFeature request returns a description of feature types supported by a WFS service.
Example of a EMODnet Biology DescribeFeature request: http://geo.vliz.be/geoserver/Dataportal/wfs?service=wfs&version=2.0.0&request=DescribeFeatureType&typeName=Dataportal:eurobis&outputFormat=application/json
Example of a EMODnet Human Activities DescribeFeature request:
A GetFeature request returns a selection of features from a data source including geometry and attribute values.
Example of a EMODnet Human Activities GetFeature request:
The EMODnet portals provide Web Coverage Services (WCS) to support requests for coverage data (rasters) or gridded data products. Enter one of the following addresses into your WCS client:
EMODnet Bathymetry |
|
EMODnet Biology |
|
EMODnet Human activities |
|
EMODnet Seabed Habitats - individual habitat map and model datasets |
https://ows.emodnet-seabedhabitats.eu/emodnet_open_maplibrary/wcs |
A WCS GetCapabilities request retrieves a list of the server’s data, as well as valid WCS operations and parameters.
Example of an EMODnet Bathymetry WCS GetCapabilities request:
https://ows.emodnet-bathymetry.eu/wcs?service=wcs&version=1.0.0&request=GetCapabilities
A WCS DescribeCoverage request retrieves a metadata (XML) document that fully describes the requested coverages.
Example of an EMODnet Bathymetry DescribeCoverage request:
A WCS GetCoverage request returns a coverage in a well known format. Like a WMS GetMap request, but with several extensions to support the retrieval of coverages.
Example of an EMODnet Bathymetry GetCoverage request:
EMODnet Bathymetry |
|
EMODnet Biology |
|
EMODNET Chemistry |
|
EMODnet Geology |
|
EMODnet Human activities |
|
EMODnet Physics |
|
EMODnet Seabed habitats |
https://www.emodnet-seabedhabitats.eu/access-data/web-services/ |
The Copernicus Marine Environment Monitoring Service (CMEMS) offers several services and downloads.
For some of the services you need a password and username (e.g. ftp or motu download, see below). Register here if you don’t have a CMEMS account yet.
The CMEMS catalogue offers the ability to search collections of metadata for data, services and related information objects related to the CMEMS Marine Data. The data catalogue offers a CSW access points to other client applications to connect to the service and query the metadata held in the catalogue.
CMEMS CSW |
https://cmems-catalog-ro.cls.fr/geonetwork/srv/eng/csw-MYOCEAN-CORE-PRODUCTS |
The mandatory GetCapabilities operation allows CSW clients to retrieve service metadata from a server. The response to a GetCapabilities request shall be an XML document containing service metadata about the server. This subclause specifies the XML document that a CSW server shall return to describe its capabilities.
Example of CMEMS CSW GetCapabilities:
GetRecords request allows to query the catalogue metadata records.
The recommended outputSchema is http://www.isotc211.org/2005/gmd as it is the one containing all the information.
Example of CMEMS CSW GetRecords:
Example of CMEMS CSW GetRecords with a request on AlternateTitle parameter through an OCG Filter:
GetRecordById requests retrieves catalogue metadata records using their identifier.
The recommended outputSchema is http://www.isotc211.org/2005/gmd as it is the one containing all the information.
Example of a CSW GetRecordById:
The Web Map Service standard (WMS) provides a simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases. A WMS request defines the geographic layer(s) and area of interest to be processed. The response to the request is one or more geo-registered map images (returned as JPEG, PNG, etc) that can be displayed in a Geographic Information System (GIS) or in your own web application (OpenLayers, Leaflet,...).
The WMS supports the GetCapabilities, GetMap and GetFeatureInfo operations as defined in the Open Geospatial Consortium (OGC) WMS standard.
Additionally, there are some specificities on CMEMS WMS services:
The mandatory GetCapabilities operation allows WMS clients to retrieve service metadata from a server. The response to a GetCapabilities request shall be an XML document containing metadata of the service (proposed layers, associated projections, author ...).
Example of a CMEMS GetCapabilities request:
Using the information given in the GetCapabilities request, the GetMap request returns a raster map containing the requested data layer selected from all the available layers as defined in the XML document. The elements such as the data layer, region, projection, size of the returned image, image format, etc. are defined in the form of arguments.
Example of CMEMS WMS GetMap request with some NCWMS parameters:
Returns:
The GetFeatureInfo operation returns the attributes of the requested entities in a map in different formats such as HTML, XML, and plain text.
Example of CMEMS GetFeatureInfo request:
CMEMS proposes several download services to retrieve data:
Motu is a robust web server allowing users to download data through the web. It provides two main functionalities: Subsetter and Direct-Get-File which use an API in line with OGC spirit (close to OGC SPS + OGC WCS). These two interfaces share the same API but have not the same functionalities:
A graphic web interface and machine to machine interfaces allow to access data, information on data and on the usage of the server.
MOTU is an Open source software developed by CLS: https://github.com/clstoulouse/motu.
On CMEMS project there are two ways to access (describe product, getsize) and download (download product) the product data:
The download service provided by the Web-Portal relies on a MOTU request named DescribeProduct. This feature gives all the dataset description including the dataset ID, the time coverage, the geospatial coverage, the variable(s) and potentially the vertical coverage.
Example of MOTU Describe product request:
Returns:
Getsize request permits to recover the size of a download request, through graphic web interface, or through machine to machine interface.
Example of MOTU Getsize request:
Returns:
ProductDownload request permits to download data of dataset, through graphic web interface, or through machine to machine interface.
Example of MOTU ProductDownload request:
A multi-platform command-line matching your data extraction (also referred as data selection or data query), which can be executed from the shell of your system (Windows/MacOS/*nix) thanks to a Python package called motuclient (https://github.com/clstoulouse/motu-client-python).
It's intended for both Beginners and Expert users and is particularly useful to automate retrieval of NearRealTime/Forecast data production and to optimize heavy requests such as long timeseries.
Example of command to download data in Subsetter:
python -m motuclient --motu http://nrt.cmems-du.eu/motu-web/Motu --service-id GLOBAL_ANALYSIS_FORECAST_BIO_001_028-TDS --product-id global-analysis-forecast-bio-001-028-monthly --longitude-min -180 --longitude-max 179.75 --latitude-min -80 --latitude-max 90 --date-min "2019-06-16 00:00:00" --date-max "2019-06-16 00:00:00" --depth-min 0.493 --depth-max 0.4942 --variable chl --variable phyc --variable o2 --variable no3 --variable po4 --variable si --variable fe --variable nppv --variable ph --variable spco2 --out-dir <OUTPUT_DIRECTORY> --out-name <OUTPUT_FILENAME> --user <USERNAME> --pwd <PASSWORD>
Example of command to download data in Direct-Get-File:
python -m motuclient --motu http://nrt.cmems-du.eu/motu-web/Motu --service-id GLOBAL_ANALYSIS_FORECAST_BIO_001_028-DGF --product-id global-analysis-forecast-bio-001-028-monthly --date-min "2019-06-16 00:00:00" --date-max "2019-06-16 00:00:00" --out-dir <OUTPUT_DIRECTORY> --out-name <OUTPUT_FILENAME> --user <USERNAME> --pwd <PASSWORD>
To obtain the describeproduct or getsize answers, use the -- describe-product or --size options in the command above.
The Sensor Observation Service (SOS) is a web service to query real-time sensor data and sensor data time series: https://www.opengeospatial.org/standards/requests/32
A multi-platform command-line matching your data extraction (also referred as data selection or data query), which can be executed from the shell of your system (Windows/MacOS/*nix) thanks to a Python script called sosclient and accessible in the following Zip package: ftp://ftp.ifremer.fr/ifremer/sismer/oceanotron/sosClientPython/sos-client-python.zip
Example of command to download data in SOS
python <PATH_TO_SOSCLIENT_DIR>/sos_client.py --user=<USERNAME> --pwd=<PASSWORD> --quiet --server=http://nrt.cmems-du.eu/oceanotron/SOS/default --offering-id=glo_multiparameter_nrt_profile_latest --longitude-min=-179.967 --longitude-max=179.986 --latitude-min=-78.01 --latitude-max=81.8618 --date-min="2019-07-12T02:58:20.000Z" --date-max="2019-07-12T02:58:20.000Z" --observed-property=sea_water_temperature --observed-property=sea_water_practical_salinity --out-dir=<OUTPUT_DIRECTORY> --out-name=<OUTPUT_FILENAME>
Most of CMEMS products raw data can be downloaded through a FTP server (login required). All CMEMS data are encapsulated in NetCDF3 or NetCDF4 data (https://www.unidata.ucar.edu/software/netcdf/).
Example of FTP data access:
Resulting tree:
All the ICES data portals offer download services. These services are provided in standard formats (Web APIs, Soap etc). A list of those services along with descriptions and guidelines on how to use them can be found in the ices metadata catalogue:
http://gis.ices.dk/geonetwork/srv/eng/catalog.search#/search?facet.q=type%2Fservice
Examples:
Stock assessment data for Herring:
http://sg.ices.dk/StandardGraphsWebServices.asmx/getStockDownloadData?AssessmentKey=7919
List of all stocks in 2013:
http://sg.ices.dk/StandardGraphsWebServices.asmx/getListStocks?year=2013
ICES hosts services for spatial datasets. All of ICES reference layers such as the ICES Areas, ICES Statistical rectangles, ICES Ecoregions can be found there. All of the standard OGC formats (WMS, WFS) are available through a single map server that can be found here:
http://gis.ices.dk/gis/rest/services
A user can navigate through the services directory and get more information on each service by using standard url queries. As an example, the following link is a getCapabilities request for the ICES Areas:
Spatial datasets, just like the other ICES datasets, are accompanied with INSPIRE compliant matadata that can be found on the ICES metadata catalogue.
Global fishing watch offers several datasets for free:
The R tutorials can be found below. The R markdown files are on the EMODnet Github. Found an error? Please open an issue.
Global Fishing Watch has an R tutorial on how to work with their data here
The Python tutorials can be found below. The R markdown files are on the EMODnet Github. Found an error? Please open an issue.