Workflow:Digital archiving workflow (high-level) - Revision history

Lkon115 at 12:12, 26 May 2023

2023-05-26T12:12:30Z

Lkon115 at 12:05, 26 May 2023

2023-05-26T12:05:12Z

Lkon115 at 14:38, 24 May 2023

2023-05-24T14:38:01Z

Lkon115: Information updated to v0.7 of the workflow

2023-05-24T14:34:54Z

Information updated to v0.7 of the workflow

Lkon115: Information updated to v0.6 of the workflow

2022-11-07T16:46:34Z

Information updated to v0.6 of the workflow

Lkon115 at 11:58, 7 November 2022

2022-11-07T11:58:04Z

Lkon115 at 11:39, 7 November 2022

2022-11-07T11:39:16Z

Lkon115 at 16:13, 1 March 2022

2022-03-01T16:13:53Z

Lkon115 at 16:09, 1 March 2022

2022-03-01T16:09:55Z

Lkon115: Information updated to v0.5 of the workflow

2022-03-01T16:06:18Z

Information updated to v0.5 of the workflow

@@ Line 106: / Line 106: @@
 * [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/ Digital preservation workflows, The National Archives]
 <!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address so that people can contact you if they want to discuss your workflow -->
-[[User:Lkon115|Lkon115]] ([[User talk:Lkon115|talk]]) 12:05, 26 May 2023 (UTC)
+[[User:Lkon115|Leo Konstantelos]] ([[User talk:Lkon115|talk]]) 12:12, 26 May 2023 (UTC)
 <!-- Note that your workflow will be marked with a CC3.0 licence -->

@@ Line 103: / Line 103: @@
 * [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Collections development policy, Archives & Special Collections, University of Glasgow]
 * [https://www.dpconline.org/handbook Digital Preservation Handbook, DPC]
-* [https://coptr.digipres.org/index.php/Workflow:Archival_Forensics_workflow_(storage_media_deposit) Archival Forensics workflow]
+* [https://coptr.digipres.org/index.php/Workflow:Archival_Forensics_workflow_(storage_media_deposit) Archival Forensics workflow, University of Glasgow]
 * [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/ Digital preservation workflows, The National Archives]
 <!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address so that people can contact you if they want to discuss your workflow -->
-[[User:Lkon115|Lkon115]] ([[User talk:Lkon115|talk]]) 16:46, 7 November 2022 (UTC)
+[[User:Lkon115|Lkon115]] ([[User talk:Lkon115|talk]]) 12:05, 26 May 2023 (UTC)
 <!-- Note that your workflow will be marked with a CC3.0 licence -->

@@ Line 11: / Line 11: @@
 <!-- To add an image of your workflow, open the "Upload File" link on the left in a new browser tab and follow on screen instructions, then return to this page and add the name of your uploaded image to the line below - replacing "workflow.png" with the name of your file. Replace the text "Textual description" with a short description of your image. Filenames are case sensitive! If you don't want to add a workflow diagram or other image, delete the line below  -->
-[[File:22022-11 ASC UofGlasgow Digital-archiving-workflow v0-7-web.png|1000px|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
+[[File:2022-11 ASC UofGlasgow Digital-archiving-workflow v0-7-web.png|1000px|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
 <!-- Describe your workflow here with an overview of the different steps or processes involved-->
@@ Line 47: / Line 47: @@
 :Process of formally registering deposit into the University Archives, which enables intellectual control over the digital materials.
 # Generate a unique accession number, based on the University Archives' archival processing guidelines.
 # Check digital materials for viruses. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/1-select-and-transfer/ Select and transfer workflow in the TNA guide] (section 1.3) for a reasonable process. Depending on the results of virus checks:
 #* if virus is found, quarantine and attempt removal; and/or request clean versions from source. If all these fail, prepare a report documenting actions and re-evaluate acquisition.
@@ Line 63: / Line 62: @@
 #* Create a disk image from source storage media. OR
 #* Request that digital materials are submitted as a BagIt container.
 # Generate checksums to verify data integrity during transmission and/or storage:
 #* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios.

@@ Line 11: / Line 11: @@
 <!-- To add an image of your workflow, open the "Upload File" link on the left in a new browser tab and follow on screen instructions, then return to this page and add the name of your uploaded image to the line below - replacing "workflow.png" with the name of your file. Replace the text "Textual description" with a short description of your image. Filenames are case sensitive! If you don't want to add a workflow diagram or other image, delete the line below  -->
-[[File:2022-02 ASC UofGlasgow Digital-archiving-workflow v0-6a-web.png|1000px|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
+[[File:22022-11 ASC UofGlasgow Digital-archiving-workflow v0-7-web.png|1000px|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
 <!-- Describe your workflow here with an overview of the different steps or processes involved-->
@@ Line 47: / Line 47: @@
 :Process of formally registering deposit into the University Archives, which enables intellectual control over the digital materials.
 # Generate a unique accession number, based on the University Archives' archival processing guidelines.
-# Compare the file manifests generated during Acquisition to make sure that the transfer includes everything that was deposited by the source.
 # List the accession number into the University's Collections Management System for cataloguing. Cataloguing processes include decisions over the system of arrangement and level of description that will be used for the deposited materials; definition of access and reproduction conditions; and documentation via descriptive metadata.
 # Decide whether archival forensic processing is required:
@@ Line 59: / Line 63: @@
 #* Create a disk image from source storage media. OR
 #* Request that digital materials are submitted as a BagIt container.
-# Check digital materials for viruses. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/1-select-and-transfer/ Select and transfer workflow in the TNA guide] (section 1.3) for a reasonable process. Depending on the results of virus checks:
 # Generate checksums to verify data integrity during transmission and/or storage:
 #* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios.

@@ Line 50: / Line 50: @@
 # List the accession number into the University's Collections Management System for cataloguing. Cataloguing processes include decisions over the system of arrangement and level of description that will be used for the deposited materials; definition of access and reproduction conditions; and documentation via descriptive metadata.
 # Decide whether archival forensic processing is required:
-#* If Yes, follow the Archival Forensics workflow.
+#* If Yes, follow the [https://coptr.digipres.org/index.php/Workflow:Archival_Forensics_workflow_(storage_media_deposit) Archival Forensics workflow].
 # Proceed to Transfer.
@@ Line 103: / Line 103: @@
 * [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Collections development policy, Archives & Special Collections, University of Glasgow]
 * [https://www.dpconline.org/handbook Digital Preservation Handbook, DPC]
 * [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/ Digital preservation workflows, The National Archives]
 <!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address so that people can contact you if they want to discuss your workflow -->
+[[User:Lkon115|Lkon115]] ([[User talk:Lkon115|talk]]) 16:46, 7 November 2022 (UTC)
 <!-- Note that your workflow will be marked with a CC3.0 licence -->

@@ Line 11: / Line 11: @@
 <!-- To add an image of your workflow, open the "Upload File" link on the left in a new browser tab and follow on screen instructions, then return to this page and add the name of your uploaded image to the line below - replacing "workflow.png" with the name of your file. Replace the text "Textual description" with a short description of your image. Filenames are case sensitive! If you don't want to add a workflow diagram or other image, delete the line below  -->
-[[File:2022-02 ASC UofGlasgow Digital-archiving-workflow v0-6a-web.png|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
+[[File:2022-02 ASC UofGlasgow Digital-archiving-workflow v0-6a-web.png|1000px|Digital archiving workflow (high level, overview) produced by Archives and Special Collections at the University of Glasgow.]]<br>
 <!-- Describe your workflow here with an overview of the different steps or processes involved-->
@@ Line 40: / Line 40: @@
 #* Place all incoming items in quarantine area on arrival, inspect for pest infestation and mould; and follow handling and moving procedures.
 #* Create physical conservation and preservation report, documenting all actions on the acquired media.
-#* Proceed to Transfer.
+#* Proceed to Accessioning.
 # For acquisitions deposited digitally (e.g. file transfer):
-#* Proceed to Transfer.
+#* Proceed to Accessioning.
 ; TRANSFER
@@ Line 56: / Line 65: @@
 #* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios.
 #* Transfer digital materials to Process store (e.g. network drive).
-# Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Accessioning.
+# Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Appraisal.
 ; APPRAISAL

@@ Line 19: / Line 19: @@
 ; PRE-ACQUISITION APPRAISAL
 : Processes for evaluating whether a deposit request will be accepted by the University Archives.
-	# Check the deposit request against the [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Archives & Special Collections collection development policy] - does the request align with the core collecting areas?
+# Check the deposit request against the [https://www.gla.ac.uk/myglasgow/archivespecialcollections/collectionsdevelopmentpolicy/ Archives & Special Collections collection development policy] - does the request align with the core collecting areas?
-	# Prepare a records survey and/or pre-accession assessment of the proposed deposit.
+# Prepare a records survey and/or pre-accession assessment of the proposed deposit.
-	# Evaluate the results of the records survey against the Appraisal & Retention policy, which:
+# Evaluate the results of the records survey against the Appraisal & Retention policy, which:
-		#* addresses issues pertaining to selection and long-term retention of digital objects
+#* addresses issues pertaining to selection and long-term retention of digital objects
-		#* extends the collections development policy
+#* extends the collections development policy
-		#* ensures that retention decisions are balanced between value and capacity to preserve for the long-term; and
+#* ensures that retention decisions are balanced between value and capacity to preserve for the long-term; and
-		#* provides clarity to avoid assumptions over digital storage costs and availability.
+#* provides clarity to avoid assumptions over digital storage costs and availability.
-	# Decide whether the requested deposit aligns with policies:
+# Decide whether the requested deposit aligns with policies:
-	#* If not, re-evaluate acquisition and/or reject deposit.
+#* If not, re-evaluate acquisition and/or reject deposit.
-	#* If yes, proceed to Acquisition.
+#* If yes, proceed to Acquisition.
 ; ACQUISITION
 : Processes for acquiring digital materials by transfer, donation, or purchase.
-	# Follow the methodology in the Space data and information transfer systems — Producer-archive interface — Methodology abstract standard (PAIMAS) ISO 20652:2006 standard. The standard "identifies, defines and provides structure to the relationships and interactions between an information producer and an archive. It defines the methodology for the structure of actions that are required from the initial time of contact between the producer and the archive until the objects of information are received and validated by the archive." ([https://www.iso.org/standard/39577.html ISO]). For more information, see [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)].
+# Follow the methodology in the Space data and information transfer systems — Producer-archive interface — Methodology abstract standard (PAIMAS) ISO 20652:2006 standard. The standard "identifies, defines and provides structure to the relationships and interactions between an information producer and an archive. It defines the methodology for the structure of actions that are required from the initial time of contact between the producer and the archive until the objects of information are received and validated by the archive." ([https://www.iso.org/standard/39577.html ISO]). For more information, see [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)].
-	# Follow the Accepted file formats/media procedure, which:
+# Follow the Accepted file formats/media procedure, which:
-		#* Specifies decisions on file formats and/or storage media that the University Archives will accept.
+#* Specifies decisions on file formats and/or storage media that the University Archives will accept.
-		#* Aligns with preservation planning decisions for format normalisation; and capability to access storage media (esp. legacy media, e.g. floppy or zip disks).
+#* Aligns with preservation planning decisions for format normalisation; and capability to access storage media (esp. legacy media, e.g. floppy or zip disks).
-		#* For a summary table of options, see the Acquisition workflow section in [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)].
+#* For a summary table of options, see the Acquisition workflow section in [https://www.dpconline.org/handbook/organisational-activities/acquisition-and-appraisal Acquisition and appraisal, Digital Preservation Handbook (DPC)].
-	# For acquisitions deposited in physical storage media:
+# For acquisitions deposited in physical storage media:
-		#* Place all incoming items in quarantine area on arrival, inspect for pest infestation and mould; and follow handling and moving procedures.
+#* Place all incoming items in quarantine area on arrival, inspect for pest infestation and mould; and follow handling and moving procedures.
-		#* Create physical conservation and preservation report, documenting all actions on the acquired media.
+#* Create physical conservation and preservation report, documenting all actions on the acquired media.
-		#* Proceed to Transfer.
+#* Proceed to Transfer.
-	# For acquisitions deposited digitally (e.g. file transfer):
+# For acquisitions deposited digitally (e.g. file transfer):
-		#* Proceed to Transfer.
+#* Proceed to Transfer.
 ; TRANSFER
 : Processes for transferring digital materials to the University Archives.
-	# Choose a method for transferring files:
+# Choose a method for transferring files:
-		#* Copy files from source media. OR
+#* Copy files from source media. OR
-		#* Create a disk image from source storage media. OR
+#* Create a disk image from source storage media. OR
-		#* Request that digital materials are submitted as a BagIt container.
+#* Request that digital materials are submitted as a BagIt container.
-	# Check digital materials for viruses. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/1-select-and-transfer/ Select and transfer workflow in the TNA guide] (section 1.3) for a reasonable process. Depending on the results of virus checks:
+# Check digital materials for viruses. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/1-select-and-transfer/ Select and transfer workflow in the TNA guide] (section 1.3) for a reasonable process. Depending on the results of virus checks:
-		#* if virus is found, quarantine and attempt removal; and/or request clean versions from source. If all these fail, prepare a report documenting actions and re-evaluate acquisition.
+#* if virus is found, quarantine and attempt removal; and/or request clean versions from source. If all these fail, prepare a report documenting actions and re-evaluate acquisition.
-		#* if virus-free, proceed with transfer.
+#* if virus-free, proceed with transfer.
-	# Generate checksums to verify data integrity during transmission and/or storage:
+# Generate checksums to verify data integrity during transmission and/or storage:
-			#* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios.
+#* For digital acquisitions <i>in situ</i>, it might be appropriate to first store files in a temporary location for virus and/or integrity checks, before transferring to process store. Not applicable to all scenarios.
-			#* Transfer digital materials to Process store (e.g. network drive).
+#* Transfer digital materials to Process store (e.g. network drive).
-	# Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Accessioning.
+# Use tools to identify file types and validate file formats (e.g. DROID, JHOVE), then proceed to Accessioning.
 ; ACCESSIONING
 :Process of formally registering deposit into the University Archives, which enables intellectual control over the digital materials.
-	# Generate a unique accession number, based on the University Archives' archival processing guidelines.
+# Generate a unique accession number, based on the University Archives' archival processing guidelines.
-	# Compare the file manifests generated during Acquisition and Transfer to make sure that the transfer includes everything that was deposited by the source.
+# Compare the file manifests generated during Acquisition and Transfer to make sure that the transfer includes everything that was deposited by the source.
-	# List the accession number into the University's Collections Management System for cataloguing. Cataloguing processes include decisions over the system of arrangement and level of description that will be used for the deposited materials; definition of access and reproduction conditions; and documentation via descriptive metadata.
+# List the accession number into the University's Collections Management System for cataloguing. Cataloguing processes include decisions over the system of arrangement and level of description that will be used for the deposited materials; definition of access and reproduction conditions; and documentation via descriptive metadata.
-	# Proceed to Appraisal.
+# Proceed to Appraisal.
 ; APPRAISAL
 : Processes for selecting digital materials from a transfer, which are deemed as appropriate for long-term preservation and archiving.
-	# Perform appraisal actions that have been deemed necessary (if any), including at a minimum:
+# Perform appraisal actions that have been deemed necessary (if any), including at a minimum:
-		#* Selecting which files from a transfer should be added to a SIP and how these files should be arranged within the SIP.
+#* Selecting which files from a transfer should be added to a SIP and how these files should be arranged within the SIP.
-		#* Removing duplicates, e.g. by comparing checksums. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/2-ingest/ Ingest workflow in the TNA guide] (section 2.5) for a reasonable process.
+#* Removing duplicates, e.g. by comparing checksums. See [https://www.nationalarchives.gov.uk/archives-sector/projects-and-programmes/plugged-in-powered-up/digital-preservation-workflows/2-ingest/ Ingest workflow in the TNA guide] (section 2.5) for a reasonable process.
-	# Complete legal checks, including:
+# Complete legal checks, including:
-		#* Checks against GDPR principles and possible exemptions for archiving in the public interest. The National Archives provide key information in their [https://www.nationalarchives.gov.uk/archives-sector/legislation/archives-data-protection-law-uk/gdpr-faqs/ Archives and GDPR: frequently asked questions] page.
+#* Checks against GDPR principles and possible exemptions for archiving in the public interest. The National Archives provide key information in their [https://www.nationalarchives.gov.uk/archives-sector/legislation/archives-data-protection-law-uk/gdpr-faqs/ Archives and GDPR: frequently asked questions] page.
-		#* Checks for Personal Identifiable Information and other restricted/confidential information included in the deposited files that should not be made puclicly accessible.
+#* Checks for Personal Identifiable Information and other restricted/confidential information included in the deposited files that should not be made puclicly accessible.
-	# Proceed to Ingest.
+# Proceed to Ingest.
 ; INGEST
-: Processes for generating SIPs from tranferred digital objects, normalising for preservation and/or access; packaging into AIPs for archival storage; and/or DIPs for access systems.
+: Processes for generating SIPs from transferred digital objects, normalising for preservation and/or access; packaging into AIPs for archival storage; and/or DIPs for access systems.
-	# Add any descriptive metadata (created in Cataloguing) and rights metadata (created during Appraisal) in the SIP.
+# Add any descriptive metadata (created in Cataloguing) and rights metadata (created during Appraisal) in the SIP.
-	# Choose a normalisation strategy for file formats (based on preservation planning).
+# Choose a normalisation strategy for file formats (based on preservation planning).
-	# Archival storage solutions should follow the [https://www.dpconline.org/handbook/organisational-activities/storage Principles for using IT storage systems for digital preservation] defined in the DPC Handbook.
+# Archival storage solutions should follow the [https://www.dpconline.org/handbook/organisational-activities/storage Principles for using IT storage systems for digital preservation] defined in the DPC Handbook.
-	# Periodic monitoring should include:
+# Periodic monitoring should include:
-		#* File integrity checks by monitoring checksum changes.
+#* File integrity checks by monitoring checksum changes.
-		#* Format obsolescence checks, by monitoring changes to preservation planning and normalisation strategies.
+#* Format obsolescence checks, by monitoring changes to preservation planning and normalisation strategies.