Editing Workflow:Digital archiving workflow (high-level)
Jump to navigation
Jump to search
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
{{Infobox COW | {{Infobox COW | ||
|status=Experimental | |status=Experimental | ||
− | |tools=Archivematica, Bagger, BitCurator | + | |tools=Archivematica, Bagger, BitCurator, DROID (Digital Record Object Identification), TeraCopy, PAIMAS |
|input=Request for deposit of digital materials by transfer, donation, or purchase to the University Archives. | |input=Request for deposit of digital materials by transfer, donation, or purchase to the University Archives. | ||
|output=AIPs stored in Archival storage and/or DIPs uploaded to an Access system; or a Re-evaluation process in cases where digital materials are not deemed appropriate for acquisition. | |output=AIPs stored in Archival storage and/or DIPs uploaded to an Access system; or a Re-evaluation process in cases where digital materials are not deemed appropriate for acquisition. | ||
Line 11: | Line 11: | ||
<!-- To add an image of your workflow, open the "Upload File" link on the left in a new browser tab and follow on screen instructions, then return to this page and add the name of your uploaded image to the line below - replacing "workflow.png" with the name of your file. Replace the text "Textual description" with a short description of your image. Filenames are case sensitive! If you don't want to add a workflow diagram or other image, delete the line below --> | <!-- To add an image of your workflow, open the "Upload File" link on the left in a new browser tab and follow on screen instructions, then return to this page and add the name of your uploaded image to the line below - replacing "workflow.png" with the name of your file. Replace the text "Textual description" with a short description of your image. Filenames are case sensitive! If you don't want to add a workflow diagram or other image, delete the line below --> | ||
− | [[File: | + | [[File:2021-11_ASC_UofGlasgow_Digital-archiving-workflow_v0-3-sm.png|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br> |
<!-- Describe your workflow here with an overview of the different steps or processes involved--> | <!-- Describe your workflow here with an overview of the different steps or processes involved--> | ||
; START | ; START | ||
: A request for deposit of digital materials (by transfer, donation, or purchase) is submitted to the University Archives.<br/> | : A request for deposit of digital materials (by transfer, donation, or purchase) is submitted to the University Archives.<br/> | ||
− | |||
; PRE-ACQUISITION APPRAISAL | ; PRE-ACQUISITION APPRAISAL | ||
− | : Processes for evaluating whether a deposit request will be accepted by the University Archives. | + | : Processes for evaluating whether a deposit request will be accepted by the University Archives. |
− | |||
# Prepare a records survey and/or pre-accession assessment of the proposed deposit. | # Prepare a records survey and/or pre-accession assessment of the proposed deposit. | ||
# Evaluate the results of the records survey against the Appraisal & Retention policy, which: | # Evaluate the results of the records survey against the Appraisal & Retention policy, which: | ||
#* addresses issues pertaining to selection and long-term retention of digital objects | #* addresses issues pertaining to selection and long-term retention of digital objects | ||
− | #* extends the | + | #* extends the [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Archives & Special Collections collection development policy] |
− | #* | + | #* Ensures that retention decisions are balanced between value and capacity to preserve for the long-term; and |
#* provides clarity to avoid assumptions over digital storage costs and availability. | #* provides clarity to avoid assumptions over digital storage costs and availability. | ||
− | # Decide whether the requested deposit aligns with | + | # Decide whether the requested deposit aligns with policy: |
#* If not, re-evaluate acquisition and/or reject deposit. | #* If not, re-evaluate acquisition and/or reject deposit. | ||
#* If yes, proceed to Acquisition. | #* If yes, proceed to Acquisition. | ||
− | |||
; ACQUISITION | ; ACQUISITION | ||
: Processes for acquiring digital materials by transfer, donation, or purchase. | : Processes for acquiring digital materials by transfer, donation, or purchase. | ||
− | # Follow | + | # Follow methodology in the Space data and information transfer systems — Producer-archive interface — Methodology abstract standard (PAIMAS) ISO 20652:2006 standard. The standard "identifies, defines and provides structure to the relationships and interactions between an information producer and an archive. It defines the methodology for the structure of actions that are required from the initial time of contact between the producer and the archive until the objects of information are received and validated by the archive." ([https://www.iso.org/standard/39577.html ISO]). For more information, see [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)]. |
+ | # Check digital materials for viruses. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/1-select-and-transfer/ Select and transfer] section 1.3 for a reasonable process. Depending on the results of virus checks: | ||
+ | #* if virus is found, quarantine and attempt removal; and/or request clean versions from source. If all these fail, prepare a report documenting actions and re-evaluate acquisition. | ||
+ | #* if virus-free, proceed to Accessioning. | ||
+ | ; ACCESSIONING | ||
+ | :Process of formally accepting material into the University Archives, which enables intellectual control over the digital materials. | ||
+ | # Follow standard accessioning practices as per non-digital acquisitions. | ||
# Follow the Accepted file formats/media procedure, which: | # Follow the Accepted file formats/media procedure, which: | ||
#* Specifies decisions on file formats and/or storage media that the University Archives will accept. | #* Specifies decisions on file formats and/or storage media that the University Archives will accept. | ||
#* Aligns with preservation planning decisions for format normalisation; and capability to access storage media (esp. legacy media, e.g. floppy or zip disks). | #* Aligns with preservation planning decisions for format normalisation; and capability to access storage media (esp. legacy media, e.g. floppy or zip disks). | ||
#* For a summary table of options, see the Acquisition workflow section in [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)]. | #* For a summary table of options, see the Acquisition workflow section in [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)]. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
# Proceed to Transfer. | # Proceed to Transfer. | ||
− | |||
; TRANSFER | ; TRANSFER | ||
: Processes for transferring digital materials to the University Archives. | : Processes for transferring digital materials to the University Archives. | ||
Line 62: | Line 47: | ||
#* Create a disk image from source storage media. OR | #* Create a disk image from source storage media. OR | ||
#* Request that digital materials are submitted as a BagIt container. | #* Request that digital materials are submitted as a BagIt container. | ||
− | # | + | # In all cases, generate checksums to verify data integrity during transmission and/or storage: |
#* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios. | #* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios. | ||
#* Transfer digital materials to Process store (e.g. network drive). | #* Transfer digital materials to Process store (e.g. network drive). | ||
− | # Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Appraisal | + | # Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Appraisal |
− | |||
; APPRAISAL | ; APPRAISAL | ||
− | : Processes for selecting digital materials from | + | : Processes for selecting digital materials from an acquisition, which are deemed as appropriate for lo-term preservation and archiving. |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
==Purpose, Context and Content== | ==Purpose, Context and Content== | ||
Line 96: | Line 63: | ||
==Evaluation/Review== | ==Evaluation/Review== | ||
− | The workflow has been successful in guiding tests of the University Archives' current digital preservation capability; and evaluating the suitability of our current setup for production-level digital preservation. Currently in version 0. | + | The workflow has been successful in guiding tests of the University Archives' current digital preservation capability; and evaluating the suitability of our current setup for production-level digital preservation. Currently in version 0.3, it is continuously amended until reaching version 1.0 after which it will be reviewed on an annual basis. |
==Further Information== | ==Further Information== | ||
Line 103: | Line 70: | ||
* [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Collections development policy, Archives & Special Collections, University of Glasgow] | * [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Collections development policy, Archives & Special Collections, University of Glasgow] | ||
* [https://www.dpconline.org/handbook Digital Preservation Handbook, DPC] | * [https://www.dpconline.org/handbook Digital Preservation Handbook, DPC] | ||
− | |||
* [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/ Digital preservation workflows, The National Archives] | * [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/ Digital preservation workflows, The National Archives] | ||
<!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address so that people can contact you if they want to discuss your workflow --> | <!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address so that people can contact you if they want to discuss your workflow --> | ||
− | + | ||
<!-- Note that your workflow will be marked with a CC3.0 licence --> | <!-- Note that your workflow will be marked with a CC3.0 licence --> |