Automatic QC papers published
"Benchmarking of automatic quality control checks for ocean temperature profiles and recommendations for optimal sets",
Good et al, is available here:
https://doi.org/10.3389/fmars.2022.1075510
"A new automatic quality control system for ocean profile observations and impact on ocean warming estimate",
Tan et al, is available here:
https://doi.org/10.1016/j.dsr.2022.103961
IQuOD v0.1 Machine Learning paper published
"A machine learning approach to quality control oceanographic data"
was published in June, 2021 and is now available here:
https://doi.org/10.1016/j.cageo.2021.104803
IQuOD v0.1 temperature uncertainty specification paper published
"International Quality-Controlled Ocean Database (IQuOD) v0.1: The Temperature Uncertainty Specification"
was published in June, 2021 and is now available via the Ocean Best Practices Repository.
https://repository.oceanbestpractices.org/handle/11329/1592
Sixth IQuOD Workshop Report available.
The Sixth IQuOD workshop report is now available on our Documents and Reports page!
Highlights include planned release of the next version of IQuOD with agreed AutoQC flags and updated uncertainties.
The next release is planned for end 2022.
Sixth IQuOD Workshop to be held in Brest, France October 29-31, 2019.
The Sixth IQuOD workshop has been announced and will be hosted by Ifremer, Brest, France. We encourage registration ASAP. Registration and logistical details are available at https://forms.ifremer.fr/instac/registration-iquod/. An agenda will be made available soon!
IQuODv0.1 released!
The first release of IQuOD database has been completed. IQuODv0.1 is publicly available, and contains uncertainty values for temperature and salinity (where possible), as well as intelligent metadata for XBT probe types (see: https://journals.ametsoc.org/doi/abs/10.1175/JTECH-D-17-0129.1). For v0.1, quality flags on the data are WOD-based flags and originators flags where available.
Information and access to the database can be found here: https://data.nodc.noaa.gov/cgi-bin/iso?id=gov.noaa.nodc:0170893
MEOP-CTD database updated!
The MEOP-CTD database of seal CTD profiles has just been updated. It is publicly available, and includes almost 300,000 hydrographic profiles in the Southern Ocean, North Pacific and North Atlantic sectors. The data is available in a format similar to the Argo netCDF format, or in ODV Spreadsheet format.
Information on the format is available here: http://www.meop.net/database/format.html
Data can be downloaded from here: http://www.meop.net/database/data-access.html
General information on the MEOP consortium here: http://www.meop.net/
For any questions or support, please contact info@meop.net
Ocean Sciences, 2016
Catia Domingues, Matt Palmer, Toru Suzuki and Tim Boyer will be chairing the following session at Ocean Sciences in 2016
Session Topic: Ocean Observing and Data Management
Session ID: 9327
Session Title: Towards a Subsurface Ocean Climate Record and Applications that Improve Understanding of Climate Variability and Change
Abstract submissions open mid July via the session viewer and the deadline for submissions is Wednesday, 23 September 23:59 EDT/03:59 +1 GMT. We encourage your participation!
3rd IQuoD Workshop scheduled!
The third IQuOD workshop is scheduled to be held in Hamburg, Germany from the 3-5 December, 2015. The workshop is kindly sponsored by Hamburg University.
topWorkshop Video Conferencing details
Participants willing to use video conferencing should contact Viktor Gouretski in advance
Mac users may connect using Jitsi
The ‘International Quality Controlled Ocean Dataset Validation Suite’ project has begun.
The code is open-sourced and you can participate here: https://github.com/IQuOD
Here is the project brief:
topRecent studies suggest that changes to global climate as have been seen at the Earth's land and ocean surface are also making their way into the deep ocean, which is the largest active storage system for heat and carbon available on the timescale of a human lifetime. Historical measurements of subsurface ocean temperature are essential to the scientific research investigating the changes in the amount of heat stored in the ocean and also to other climate research activities such as combining observations with numerical models to provide estimates of the global ocean's and Earth's climate state in the past and predictions for the future. Unfortunately, as with all observations, these measurements contain errors and biases that must be identified to prevent a negative impact on the applications and investigations that rely on them. Various groups from around the world have developed quality control tests to perform this important task. However, this has led to duplication of effort, code that is not easily available to other researchers and the introduction of climate model differences solely due to the varying performance of these software systems whose nuances relative to one another are poorly known. Recently, an international team of researchers has decided to work together to break down the barriers between the various groups and countries through the formation of the IQuOD (International Quality Controlled Dataset) initiative. One of the key aims is to intercompare the performance of the various automatic quality control tests that are presently being run to determine a best performing set. This work has started. However, it currently involves individuals running test datasets through their own systems and is being confounded by complications associated with the differences in the file formats and systems that are in use in the various labs and countries. The IQuOD proposal is to set up an open quality control benchmarking system. Work will begin by developing an open-source Python testing framework to run a battery of checks developed by the researchers over a body of user-supplied data; this framework should be built with ease of extension to further tests in mind. Further goals include helping researchers either wrap their existing C, Fortran and Matlab test functions in Python for use in this test suite, or re-implementing those tests in native Python.
2nd IQuOD Workshop held in Silver Spring, MD
The workshop was hosted by NOAA in Silver Spring, MD, USA. A common theme in several presentations and subsequent discussions was the value of providing a standardised data-set that quantifies known biases for particular instrument types and provides measurement uncertainties. It was noted such data would be invaluable for use in research focused on model and observation intercomparisons and initialization for ocean reanalysis products. Temperature will be the initial focus for IQuOD, moving to salinity and other variables as the project develops. An initial priority list of instrument types was constructed based on the number and importance of these instruments in the global database and the groups’ expertise. It is expected the list will be revised as the project develops. The technical aspects of developing the QC methods, assigning QC flags and uncertainties were reviewed, with a goal to refine, finalise and report on automatic QC benchmarking tests in 2015. The 2nd IQuOD workshop report is now available here and summarises the presentations and discussions held over the 3 days.
topThe 2nd IQuOD Workshop is being planned
The workshop will be hosted by NODC/NOAA, and will take place on Silver Spring/Washington DC, USA between June 4th – 6th, 2014.
The topics of the meeting include:
- Evaluation of auto QC benchmarking tests/results. (potential scientific/technical papers resulting from this activity)
- Development of goals for the subgroup on manual QC (potential scientific/technical papers resulting from this activity)
- Attaching uncertainties to observations - forming a sub-group on data formats, flagging and uncertainty estimates.
- Discuss and refine the importance of the project to data assimilation/climate forecasting efforts.
- Review funding opportunities.
Expected Meeting Outcomes
- Review the first workshop goals and revise as required
- Review the structure of the project. Steering team, working groups, expert groups etc
- Review action items from the last meeting
- Review the scientific implementation plan
- Set goals and action items for the next year
- Workshop report
- Technical papers as decided on at the workshop
For more information, please click here
topIQuOD attends the Ocean Sciences meeting, Honolulu, Hawaii
IQuOD members Rebecca Cowley, Catia Domingues, Tim Boyer, Steve Diggs, Alison Macdonald and Gustavo Goni were panel members at a Town Hall session on Monday 24th February.
- Town Hall flyer
- Town Hall presentation
- Town Hall report [members only]
Catia Domingues presented on the IQuOD project in the "Big Data" Session on Friday, 28th February. The presentation can be found here
topThe 1st IQuOD workshop was held June 12-14, 2013 in Hobart, Australia.
IQuOD members Rebecca Cowley, Catia Domingues, Tim Boyer, Steve Diggs, Alison Macdonald and Gustavo Goni were panel members at a Town Hall session on Monday 24th February.
- Workshop Agenda
- Workshop report [to come]
- Biographies document
- Workshop presentations [members only]
