KOST-Val

From COPTR
Jump to: navigation, search


KOST-Val
KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
Homepage:http://kost-ceco.ch/cms/index.php?kost_val_de
License:GNU General Public License 3+
Platforms:should run under Java 1.6 on Windows
Input Formats:TIFF, SIARD, PDF/A, JP2, JPEG and SIP

Contents

[edit] Description

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val supersedes the format validation tools SIARD-VAL, TIFF-Val and SIP-Val by KOST-CECO.


[edit] Funtional Principle

KOST-Val complies with the following requirements.

  • TIFF validation: KOST-Val reads a TIFF file and uses JHOVE to validate the structure, the content, and ExifTool to validate the key properties such as compression, colour space, and multipage. These properties can be configured.
  • SIARD validation: KOST-Val reads a SIARD (eCH-0165 v1 and v2-2017) file and validates the structure and the content.
  • PDF/A validation: KOST-Val reads a PDF or PDF/A file (ISO 19005-1 and 19005-2) and uses 3-Heights™ PDF/A Validator by PDF-Tools or pdfaPilot by callas to validate the structure and the content of the PDF file. KOST-Val organises the different error messages into main categories such as fonts, graphics, and metadata. KOST-Val supplies only a limited version from 3-Heights™ PDF/A Validator by PDF-Tools and pdfaPilot by callas. Module J extracts (with iText) and validates the JPEG and JP2 images contained in the PDF file (depending on the configuration). It is also possible to configure whether the JBIG2 compression is accepted or not.
  • JP2 validation: KOST-Val reads a JP2 file (ISO 15444) and uses Jpylyzer to validate the structure and the content.
  • JPEG validation: KOST-Val reads a JPEG file (ISO 10918-1) and uses Bad Peggy to validate the structure and the content.
  • SIP validation: KOST-Val reads an SIP (eCH-0160 v1 and v1.1 ) and validates the mandatory requirements of the SIP specification. The validated requirements are organised into groups such as folder structure, schema validation, and checksum validation. At the outset, a file format validation is performed.

The results (including information on inconsistencies and errors) are output for every step and written into a validation log. The validation steps are executed sequentially. Whenever possible the validation shall continue after an error has been detected in order to reduce the number of correction cycles.

KOST-Val FuntionalPrincipleFormatValidation.JPG


[edit] Third-party applications

KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.

  • The TIFF validation module uses JHOVE and ExifTool and evaluates its output further.
  • For the PDF/A validation module pdfaPilot or 3-Heights™ PDF/A Validator are used.
  • The JP2 validation module uses Jpylyzer and translates the failed tests into appropriate error messages (DE/FR/EN).
  • The JPEG validation module uses Bad Peggy and evaluates the error message "Not a JPEG file" further.
  • To extract the JPEG and JP2 images from PDF/A the iText library is used.
  • For the file format identification DROID is used. For performance and granularity reasons an own SignatureFile is used instead of the official PRONOM registry.


[edit] Read Me & Download

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val, Copyright (C) 2012-2017 Claire Roethlisberger (KOST-CECO), Christian Eugster, Olivier Debenath, Peter Schneider (Staatsarchiv Aargau), Markus Hahn (coderslagoon), Daniel Ludin (BEDAG AG)

This program comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions; see GPL-3.0_COPYING.txt for details.

You can download KOST-Val under http://github.com/KOST-CECO/KOST-Val/releases. For installation instructions please check the manual (DE/FR/EN).


[edit] SIARD format

SIARD stands for Software Independent Archiving of Relational Databases. Originally the Swiss Federal Archives (SFA) have developed the SIARD format as a sustainable solution for the archiving of relations databases.

In early 2013 SIARD format has been adopted as an eCH Standard (eCH-0165: SIARD format specification http://www.ech.ch/vechweb/page?p=dossier&documentNumber=eCH-0165).

eCH is the Swiss organization for standardization in the field of e-government. eCH Standards define guidelines for recurring applications and their results, as for example format definitions or procedural standards. The aim of those standards is to unify and thus facilitate the electronic collaboration between authorities as well as between authorities and organizations, educational and research institutions, firms and private organizations.


[edit] Future

See http://github.com/KOST-CECO/KOST-Val/issues


[edit] Feedback & Issues

Feedback about KOST-Val is very welcome at http://github.com/KOST-CECO/KOST-Val/issues or kost-val[at]kost-ceco.ch

.

[edit] User Experiences

  • ZBW:
    • KOST-Val v1.6.0
    • The tool is very easy to install and to handle.
    • The output in xml-Format (open in a browser to have a table) is easy to understand
    • Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
    • The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.

.

[edit] Development Activity

All development activity is visible on GitHub: http://github.com/KOST-CECO/KOST-Val/commits


[edit] Release Feed

Below the last 3 release feeds:

2018-02-15 16:30:48
[tag:github.com,2008:Repository/10448958/v1.8.3 v1.8.3]
by Chlara
2017-11-01 10:41:24
[tag:github.com,2008:Repository/10448958/v1.8.2 v1.8.2]
by Chlara
2017-09-18 13:43:17
[tag:github.com,2008:Repository/10448958/v1.8.1 v1.8.1]
by Chlara


[edit] Activity Feed

Below the last 5 commits:

2018-02-15 12:19:43
[tag:github.com,2008:Grit::Commit/3a902d04b7251593cf2ce5e8888c196c53b35ea9 KOST-Val v1.8.3]
by Chlara https://github.com/Chlara
2018-01-16 15:35:10
[tag:github.com,2008:Grit::Commit/72389a9364034c0a30f16acfd7af0f58735b2c5d callas pdfaPilot v7.2.276]
by Chlara https://github.com/Chlara
2018-01-16 13:00:23
[tag:github.com,2008:Grit::Commit/eba11b9bc4958cac98f1d7add605518a944c26f2 VALA Release 4.10.26]
by Chlara https://github.com/Chlara
2017-11-01 10:46:27
[tag:github.com,2008:Grit::Commit/48248564ae4b10375790e3f2975ca08d3c72f5a8 resources pdfaPilot verkleinert]
by Chlara https://github.com/Chlara
2017-11-01 09:25:42
[tag:github.com,2008:Grit::Commit/609838c80aa9936a9fec0ba9adf274d94e2649d9 Aktualisierung]
by Chlara https://github.com/Chlara


Contributors

Yfriese (18.1%), Chlara (81.9%)