9-11 October 2018
Europe/Lisbon timezone

Supporting ICOS end users with interactive Jupyter Notebooks and on-demand computation services

Not scheduled


ISCTE, University of Lisbon
Poster Posters


Dr Margareta Hellström (Lund University)


ICOS, Integrated Carbon Observation System, is a pan-European research infrastructure with a mission to provide standardized, long term, high precision and high quality observations on the carbon cycle and Greenhouse Gas (GHG) budgets and their perturbations. The ICOS observing network consists of over 130 observation stations, each related to one of the three domains Atmosphere, Ecosystem and Ocean, and operated by its (currently 12) member countries. All collected data are processed and quality controlled at Thematic Centres (one for each domain), before being openly distributed via the ICOS data centre named Carbon Portal (CP). Our main end user communities are scientific users from inside and outside the ICOS community - including other research infrastructures - as well as ICOS station managers and technicians; but also citizen scientists, students, the general public and policy makers are important target users. The CP core activities therefore include our web-based discovery services that allow prospective ICOS end users to search, visualize and download ICOS data products – ensuring that all ICOS data are FAIR: easy to find, available for open access, fully traceable and complete with all relevant metadata, and interoperable with other (environmental) data and services. The Carbon Portal is also intended to function as a community platform for working on elaborated data products that use, or are based on, ICOS observations together with other data, using more or less sophisticated computer models. This poster will present the services now being built up at the CP in order to support these user activities, including provision of on-demand cloud data processing and virtual research environments: * A web-based application to launch on-demand calculations of the “greenhouse gas footprint” for a given location, using the STILT three-dimensional atmospheric transport model, executed in a cloud high-throughput computation environment. The application allows users to view the evolution of the footprint area over time while simultaneously showing time series of GHG emission sources and – if available – measured concentrations. * Jupyter Notebooks tailor-made to support specific end-user-driven research projects, including the Transcom and Eurocom model intercomparison projects – allowing logged-in users to access model output data stored in the Carbon Portal, perform statistics and aggregation calculations and visualizing the outputs up to publication ready results * Interactive user-modifiable apps that allow users to analyze ICOS observational data (such as time series of GHG fluxes and meteorological parameters) in more advanced ways than offered by the standard discovery tools. Capabilities include complex visualizations, such as combining data from several different stations or years, extended choices of graph types and plotting styles, and calculations of aggregations in time and space, as well as evaluation of statistics, such as monthly means, standard deviations, and trends. By providing this broad palette of tools for interacting with ICOS data, it is our hope to support end users across a wide range of backgrounds, scientific disciplines and interests in their discovery of greenhouse gas and environmental data, helping to further their understanding of carbon cycling and climate change.


The Carbon Portal, the data centre of ICOS, is building up a set of interactive services – built on e.g. Jupyter Notebooks - that will allow users to perform analyses on, extract statistics from, and visualize both original ICOS observational data and elaborated data products (model outputs) provided by external researchers. In addition, the portal is also providing an on-demand computation service that allows users to estimate the spatial and temporal greenhouse gas emissions “footprint” at a given location. These services offer a complement to the data discovery services (search, visualize, download) of the web portal.

Type of abstract Poster

Primary authors

Dr Alex Vermeulen (ICOS ERIC) Dr Margareta Hellström (Lund University) Dr Ute Karstens (Lund University)


Mr Andre Bjärby (Lund University) Mr Mitch Selander (Lund University) Dr Oleg Mirzov (Lund University) Mr Roger Groth (Lund University)

Presentation Materials

There are no materials yet.