Introduction

The Department for Environment, Food and Rural Affairs (DEFRA) is a UK government department responsible for safeguarding our natural environment, supporting our food and farming industry and sustaining a thriving economy. They have around 3,500 staff, including policy makers, scientists and research specialists, based in London, Bristol, York and other offices throughout England.

Challenges

Defra is a ministerial department supported by 33 agencies and public bodies. Managing data between and across these various departments is challenging and Defra had a strategic issue with data visibility: there was no single system for handling data across constituent agencies, and searching for and being able to effectively use different data sets between departments was incredibly difficult.

The central Data and Information team wanted to help staff find data more easily from across the entire Defra estate. As a secondary goal, they were also keen to highlight problems with data (such as quality issues) to shape future work.

Register Dynamics was asked to help find and build a solution these challenges. Alongside a multidisciplinary team, drawing on the expertise of a product manager, delivery manager, lead developer, business analyst, user researcher and UX designer, we designed and built an internal data catalogue.

Solutions

We used an agile sprint-based model and a Kanban board to track progress. We held planning and retrospective sessions, with several Defra stakeholders, which encouraged the sharing of knowledge, and enabled interested staff to be involved throughout.

With this insight, we developed a prototype for a metadata catalogue which all departments would have access to. It offered domain-specific search experiences, various dataset visualisation features and was developed using CKAN and GDS design patterns. Our use of well-supported open software delivered rapid value without needing expensive suppliers.

Iterative user testing helped refine it. We extended the design to show the most helpful information in search results and to harvest more locations, including Sharepoint, to provide better search coverage. We also designed integration with Azure.

To make finding data easier we developed consistent data standards for metadata and schemas.

Results

The centralised metadata catalogue continues to be highly regarded by the business and policy teams. We were praised across the business for focusing on real users and for the easy search experience that the data catalogue offers.

Our support and technical recommendations have also been well received and have helped to enhance data visibility and the overall data management strategy across the organisation. Our research laid the groundwork for further improvement on data governance and management.

We also ran a Discovery that researched the needs of authoritative data publishers and consumers. From this, we developed a roadmap and model for increasing the maturity of Defra’s linked reference data use.