Difference between revisions of "Workflow:PDF/A validation and metadata extraction"

From COPTR
Jump to navigation Jump to search
 
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{Infobox_COW
+
{{Infobox COW
 +
|status=Experimental
 +
|tools=GNU Wget, VeraPDF, UKWA search interface, XMLstarlet, Excel
 +
|input=Corpus of PDF/A files
 +
|output=CSV with validation result and metadata
 +
|organisation=Digital Preservation Coalition
 +
|organisationurl=http://dpconline.org/
 
|name=PDF/A validation and metadata extraction
 
|name=PDF/A validation and metadata extraction
|status=Productive
 
|tools=UKWA search interface<br />[[GNU_Wget]]<br />[[veraPDF]]<br />XMLstarlet<br />Excel
 
|input= Corpus of PDF/A files
 
|output= CSV with validationresult and metadata
 
|organisation=[http://dpconline.org/ Digital Preservation Coalition]
 
 
}}
 
}}
 
[[Category:COW Workflows]]
 
 
==Workflow description==
 
==Workflow description==
 
<!-- Describe your workflow here. If necessary add a diagram -->
 
<!-- Describe your workflow here. If necessary add a diagram -->

Latest revision as of 08:36, 28 April 2021

PDF/A validation and metadata extraction
Status:Experimental
Tools:
Input:Corpus of PDF/A files
Output:CSV with validation result and metadata
Organisation:Digital Preservation Coalition

Workflow description[edit]

  • UKWA search interface (create URL list of PDF/A files in UKWA) ->
  • GNU_Wget (download files from IA, to create the test corpus) ->
  • veraPDF (validates and extracts metadata from test corpus) ->
  • XMLstarlet (process XML, extract useful fields into a CSV) ->
  • Excel (view and analyse results in spreadsheet form)

The workflow begins with creation of a corpus of test files which is constructed using the UK Web Archive search interface (for example see this). The result is a list of URLs. These are fetched with Wget to create a large test corpus of predominantly PDF/A files. VeraPDF is then used to validate and extract metadata for each file. XMLstarlet is applied to extract fields of interest from the resulting XML creating a CSV. The CSV is then imported to Excel for analysis.

Purpose, context and content[edit]

This is a basic workflow for ad-hoc investigation of a set of PDF/A files. This is a very simple, manual, workflow that was used for testing purposes as part of the development of veraPDF, and is described further in this blog post: http://dpconline.org/blog/pdf-eh-redux-putting-verapdf-into-practice

Evaluation/Review[edit]

The workflow was useful in that it helped to identify a number of bugs in veraPDF that have since been fixed. The workflow as is provides a very basic method of investigating PDF files, perhaps where some troubleshooting is required.

Prwheatley (talk) 11:51, 8 February 2017 (UTC)