Workflow:PDF/A validation and metadata extraction - Revision history

Prwheatley at 08:36, 28 April 2021

2021-04-28T08:36:57Z

Rcdeboer at 13:52, 23 April 2021

2021-04-23T13:52:23Z

Prwheatley at 10:55, 6 September 2018

2018-09-06T10:55:28Z

Prwheatley at 10:54, 6 September 2018

2018-09-06T10:54:39Z

Prwheatley at 10:54, 6 September 2018

2018-09-06T10:54:19Z

Prwheatley at 10:53, 6 September 2018

2018-09-06T10:53:08Z

Prwheatley at 10:52, 6 September 2018

2018-09-06T10:52:01Z

Prwheatley at 10:51, 6 September 2018

2018-09-06T10:51:19Z

81.100.233.73 at 10:06, 6 September 2018

2018-09-06T10:06:13Z

Prwheatley at 16:00, 6 March 2017

2017-03-06T16:00:02Z

@@ Line 1: / Line 1: @@
 {{Infobox COW
 |status=Experimental
 |tools=GNU Wget, VeraPDF, UKWA search interface, XMLstarlet, Excel
 |input=Corpus of PDF/A files
-|output=CSV with validationresult and metadata
+|output=CSV with validation result and metadata
 |organisation=Digital Preservation Coalition
 |organisationurl=http://dpconline.org/
 }}
 ==Workflow description==

@@ Line 1: / Line 1: @@
-{{Infobox_COW
+{{Infobox COW
 |name=PDF/A validation and metadata extraction
 |status=Experimental
-|tools=UKWA search interface<br />[[GNU_Wget]]<br />[[veraPDF]]<br />XMLstarlet<br />Excel
+|tools=GNU Wget, VeraPDF, UKWA search interface, XMLstarlet, Excel
-|input= Corpus of PDF/A files
+|input=Corpus of PDF/A files
-|output= CSV with validationresult and metadata
+|output=CSV with validationresult and metadata
-|organisation=[http://dpconline.org/ Digital Preservation Coalition]
+|organisation=Digital Preservation Coalition
 }}
 ==Workflow description==
 <!-- Describe your workflow here. If necessary add a diagram -->

@@ Line 1: / Line 1: @@
 {{Infobox_COW
 |name=PDF/A validation and metadata extraction
-|status=Productive
+|status=Experimental
 |tools=UKWA search interface<br />[[GNU_Wget]]<br />[[veraPDF]]<br />XMLstarlet<br />Excel
 |input= Corpus of PDF/A files

← Older revision		Revision as of 10:54, 6 September 2018
Line 18:		Line 18:

	The workflow begins with creation of a corpus of test files which is constructed using the UK Web Archive search interface (for example see [https://www.webarchive.org.uk/shine/search?query=content_type:%22application/pdf%22%20content_type_version:%221b%22 this]). The result is a list of URLs. These are fetched with Wget to create a large test corpus of predominantly PDF/A files. VeraPDF is then used to validate and extract metadata for each file. XMLstarlet is applied to extract fields of interest from the resulting XML creating a CSV. The CSV is then imported to Excel for analysis.		The workflow begins with creation of a corpus of test files which is constructed using the UK Web Archive search interface (for example see [https://www.webarchive.org.uk/shine/search?query=content_type:%22application/pdf%22%20content_type_version:%221b%22 this]). The result is a list of URLs. These are fetched with Wget to create a large test corpus of predominantly PDF/A files. VeraPDF is then used to validate and extract metadata for each file. XMLstarlet is applied to extract fields of interest from the resulting XML creating a CSV. The CSV is then imported to Excel for analysis.
−
−	~~==List of Tools==~~
−	~~<!-- List the tools in your workflow in a bulleted list (begin each line with an asterisk). Link to tool entries in COPTR where possible -->~~
−	*UKWA search interface
−	*[[GNU_Wget]]
−	*[[veraPDF]]
−	*XMLstarlet
−	*Excel

	==Purpose, context and content==		==Purpose, context and content==

@@ Line 26: / Line 26: @@
 *XMLstarlet
 *Excel
 ==Purpose, context and content==
@@ Line 39: / Line 35: @@
 <!-- How effective was the workflow? Was it replaced with a better workflow? Did it work well with some content but not others? What is the current status of the workflow? Does it relate to another workflow already described on the wiki? Link, explain and elaborate -->
 The workflow was useful in that it helped to identify a number of bugs in veraPDF that have since been fixed. The workflow as is provides a very basic method of investigating PDF files, perhaps where some troubleshooting is required.
 <!-- Add four tildes below ("~~~~") to create an automatic signature, including your wiki username. Ensure your user page (click on your username to create it) includes an up to date contact email address -->
 [[User:Prwheatley|Prwheatley]] ([[User talk:Prwheatley|talk]]) 11:51, 8 February 2017 (UTC)

@@ Line 11: / Line 11: @@
 [[Category:COW Workflows]]
 ==Workflow description==
 <!-- Describe your workflow here. If necessary add a diagram -->
 *UKWA search interface (create URL list of PDF/A files in UKWA) ->

← Older revision		Revision as of 10:06, 6 September 2018
Line 1:		Line 1:
		+	{{Infobox_COW
		+	\|name=PDF/A validation and metadata extraction
		+	\|category=File format validation, Metadata extraction
		+	\|status=Productive
		+	\|tools=UKWA search interface<br />[[GNU_Wget]]<br />[[veraPDF]]<br />XMLstarlet<br />Excel
		+	\|input= Corpus of PDF/A files
		+	\|output= CSV with validationresult and metadata
		+	\|organisation=[http://dpconline.org/ Digital Preservation Coalition]
		+	}}
		+
	[[Category:COW Workflows]]		[[Category:COW Workflows]]
	==Workflow description==		==Workflow description==