EAD2 - Data Rescue

Project overview

A large part of the Environment Agency’s work, including both flooding and drought, relies on hydrometric data, for example river levels and flows, groundwater levels and rainfall depths. However, not all of our hydrometric records are fully digitised, with some data prior to the 1970s only existing in non-digital format; often just as lines or numbers on a paper chart or film, or holes in strips of punch tape.

Non-digital data are currently being stored in archives, only accessible in a limited way. In some areas, poor storage conditions are leading to deterioration and potential loss of data. We are also losing the skills and expertise to interpret the data as staff retire. This data is an invaluable resource which once lost, cannot be regained.

This pilot project will digitise approximately 120 years of data for several sites whilst contributing to making a business case to get the remaining thousands of years rescued more widely across the country. Although paper charts form the main focus of the pilot project, we are exploring opportunities to digitise microfilm/ microfiche and punch tape data as well.



Our project will:

  • Provide an inventory of our paper hydrometric data holdings within the Environment Agency.
  • Contribute towards guidance and procedures for quality assurance/quality control of hydrometric data.
  • Provide an Options Appraisal of the costs and benefits of data rescue.
  • Engage with retired and experienced existing staff, universities and other organisations to glean knowledge.
  • Identify common pitfalls and lessons in digitising historic chart data and make available to the wider hydrological community.
  • Explore alternative sources of digitising, for example, AI/machine learning, citizen science, and MSc programmes.


How our project is improving flood hydrology

  • Will extend flow records back for the whole record so not just improving our understanding of historical high flows but low flows as well.
  • Capturing the knowledge of retired staff before it is lost.
  • Contributing to our reputation as trusted custodians of the nation’s strategic hydrometric data.


How our project is contributing to the UK Flood Hydrology Roadmap

The UK Flood Hydrology Roadmap will be realised through 31 actions grouped into 4 thematic work areas of ways of working, data, methods and scientific understanding. Six actions have been identified to improve methods in U.K. flood hydrology related to improving long term data quality, quantity and accessibility.


This project will contribute to the data strand actions:

  • D2 - Assess gaps in hydrometric data for flood hydrology through consideration of how data rescue (of data that exists but is not easily available) could fill in gaps in hydrometric data records.

Project overview

A large part of the Environment Agency’s work, including both flooding and drought, relies on hydrometric data, for example river levels and flows, groundwater levels and rainfall depths. However, not all of our hydrometric records are fully digitised, with some data prior to the 1970s only existing in non-digital format; often just as lines or numbers on a paper chart or film, or holes in strips of punch tape.

Non-digital data are currently being stored in archives, only accessible in a limited way. In some areas, poor storage conditions are leading to deterioration and potential loss of data. We are also losing the skills and expertise to interpret the data as staff retire. This data is an invaluable resource which once lost, cannot be regained.

This pilot project will digitise approximately 120 years of data for several sites whilst contributing to making a business case to get the remaining thousands of years rescued more widely across the country. Although paper charts form the main focus of the pilot project, we are exploring opportunities to digitise microfilm/ microfiche and punch tape data as well.



Our project will:

  • Provide an inventory of our paper hydrometric data holdings within the Environment Agency.
  • Contribute towards guidance and procedures for quality assurance/quality control of hydrometric data.
  • Provide an Options Appraisal of the costs and benefits of data rescue.
  • Engage with retired and experienced existing staff, universities and other organisations to glean knowledge.
  • Identify common pitfalls and lessons in digitising historic chart data and make available to the wider hydrological community.
  • Explore alternative sources of digitising, for example, AI/machine learning, citizen science, and MSc programmes.


How our project is improving flood hydrology

  • Will extend flow records back for the whole record so not just improving our understanding of historical high flows but low flows as well.
  • Capturing the knowledge of retired staff before it is lost.
  • Contributing to our reputation as trusted custodians of the nation’s strategic hydrometric data.


How our project is contributing to the UK Flood Hydrology Roadmap

The UK Flood Hydrology Roadmap will be realised through 31 actions grouped into 4 thematic work areas of ways of working, data, methods and scientific understanding. Six actions have been identified to improve methods in U.K. flood hydrology related to improving long term data quality, quantity and accessibility.


This project will contribute to the data strand actions:

  • D2 - Assess gaps in hydrometric data for flood hydrology through consideration of how data rescue (of data that exists but is not easily available) could fill in gaps in hydrometric data records.
Discussions: All (1) Open (1)
  • You need to be signed in to add your comment.

    As part of any future data rescue work, we could pose specific chart queries like this one to engage as part of a forum.

    What is this duplex trace recording at Long Bridge Weir, River Derwent, Derby? Is it measuring above and below a weir, a secondary channel, movement/subsidence in the gauging station, flow and level, or none of the above? It would be great to hear your thoughts. 

    Quick Reply
Page last updated: 05 Nov 2024, 07:02 PM