Workflow:Workflow for preserving research data using Archivematica, Fedora, Hydra and PURE

From COPTR
Revision as of 12:20, 6 September 2018 by Prwheatley (talk | contribs)
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.


Workflow for preserving research data using Archivematica, Fedora, Hydra and PURE
Status:Experimental
Tools:
  • Archivematica
    Fedora_Commons
    Hydra
    PURE
  • Property "Tools" (as page type) with input value "ArchivematicaFedora_CommonsHydraPURE" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process.
Input:Corpus of PDF/A files
Output:CSV with validationresult and metadata
Organisation:Digital Preservation Coalition


Workflow description

Upload file (Toolbox on left) and add a workflow image here or remove
This workflow uses Archivematica, Fedora, Hydra and PURE to preserve and provide access to academic research data. The workflow includes a high level of automation.

  • PURE is the Current Research Information System at the University of York. This is where researchers enter metadata about the dataset they are depositing
  • Once metadata is entered into PURE, library staff contact the researcher to request that the data is uploaded
  • Upload is carried out via an online form - this upload form is part of the Research Data York application (a bespoke hydra based application)
  • Uploaded data goes into a directory that is watched by Archivematica and here it is arranged into a SIP structure
  • Archivematica picks up the SIP and processes it - the creation of an AIP is fully automated
  • The AIP is stored. A DIP is not created by default
  • Metadata about the dataset is available in the data catalogue
  • If the dataset is requested, there is a manual approval step (within the Research Data York application) and then Archivematica automatically creates a DIP
  • This DIP is passed to Fedora
  • The user is notified when the data is ready
  • Data is available for download

The workflow was created as part of the Filling the Digital Preservation Gap project and is heavily based on an implementation plan included in the Phase 2 project report which can be found on Figshare. A description of how the workflow was implemented as a proof of concept is included in the Phase 3 project report which is also on Figshare.

Purpose, context and content

The purpose of this workflow is to preserve and disseminate research data in an automated fashion. Research data is a valuable asset produced by academic institutions and should be retained so that findings can be validated. Some of this data may have longer term re-use potential, particularly where it can not be replicated. At the University of York our Research Data Management policy states that research data should be retained for ten years from date of last access. This means that even for datasets that are only occasionally accessed, the retention period may be much longer than ten years.

Evaluation/Review

This workflow has been created as a proof of concept at the University of York. It is due to move into production in May 2017.


Jenny mitcham (talk) 16:29, 3 March 2017 (UTC)