KOST-Val

From COPTR
Revision as of 11:17, 7 April 2016 by Chlara (Talk | contribs)

Jump to: navigation, search


KOST-Val
KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
Homepage:http://kost-ceco.ch/cms/index.php?kost_val_de
License:GNU General Public License 3+
Platforms:should run under Java 1.6 on Windows
Input Formats:TIFF, SIARD, PDF/A, JP2, JPEG and SIP

Contents

Description

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val supersedes the format validation tools SIARD-VAL, TIFF-Val and SIP-Val by KOST-CECO.


Funtional Principle

KOST-Val complies with the following requirements.

  • TIFF validation: KOST-Val reads a TIFF file and uses JHOVE to validate the structure, the content, and ExifTool to validate the key properties such as compression, colour space, and multipage. These properties can be configured.
  • SIARD validation: KOST-Val reads a SIARD (eCH-0165 v1 ) file and validates the structure and the content.
  • PDF/A validation: KOST-Val reads a PDF or PDF/A file (ISO 19005-1 and 19005-2) and uses 3-Heights™ PDF/A Validator by PDF-Tools or PDF/A Manager by PDFTron to validate the structure and the content of the PDF file. KOST-Val organises the different error messages into main categories such as fonts, graphics, and metadata. KOST-Val supplies only a limited version from 3-Heights™ PDF/A Validator by PDF-Tools. Module J extracts (with iText) and validates the JPEG and JP2 images contained in the PDF file (depending on the configuration). It is also possible to configure whether the JBIG2 compression is accepted or not.
  • JP2 validation: KOST-Val reads a JP2 file (ISO 15444) and uses Jpylyzer to validate the structure and the content.
  • JPEG validation: KOST-Val reads a JPEG file (ISO 10918-1) and uses Bad Peggy to validate the structure and the content.
  • SIP validation: KOST-Val reads an SIP (eCH-0160 v1 as well as Swiss Federal Archives SFA v1 and v4 ) and validates the mandatory requirements of the SIP specification. The validated requirements are organised into groups such as folder structure, schema validation, and checksum validation. At the outset, a file format validation is performed.

The results (including information on inconsistencies and errors) are output for every step and written into a validation log. The validation steps are executed sequentially. Whenever possible the validation shall continue after an error has been detected in order to reduce the number of correction cycles.

KOST-Val FuntionalPrincipleFormatValidation.JPG


Third-party applications

KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.

  • The TIFF validation module uses JHOVE and ExifTool and evaluates its output further.
  • For the PDF/A validation module PDF-A Manager or 3-Heights™ PDF/A Validator are used.
  • The JP2 validation module uses Jpylyzer and translates the failed tests into appropriate error messages (DE/FR/EN).
  • The JPEG validation module uses Bad Peggy and evaluates the error message "Not a JPEG file" further.
  • To extract the JPEG and JP2 images from PDF/A the iText library is used.
  • For the file format identification DROID is used. For performance and granularity reasons an own SignatureFile is used instead of the official PRONOM registry.


Read Me & Download

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val, Copyright (C) 2012-2015 Claire Roethlisberger (KOST-CECO), Christian Eugster, Olivier Debenath, Peter Schneider (Staatsarchiv Aargau), Markus Hahn (coderslagoon), Daniel Ludin (BEDAG AG)

This program comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions; see GPL-3.0_COPYING.txt for details.

You can download KOST-Val under http://github.com/KOST-CECO/KOST-Val/releases. For installation instructions please check the manual (DE/FR/EN).


SIARD format

SIARD stands for Software Independent Archiving of Relational Databases. Originally the Swiss Federal Archives (SFA) have developed the SIARD format as a sustainable solution for the archiving of relations databases.

In early 2013 SIARD format has been adopted as an eCH Standard (eCH-0165: SIARD format specification http://www.ech.ch/vechweb/page?p=dossier&documentNumber=eCH-0165).

eCH is the Swiss organization for standardization in the field of e-government. eCH Standards define guidelines for recurring applications and their results, as for example format definitions or procedural standards. The aim of those standards is to unify and thus facilitate the electronic collaboration between authorities as well as between authorities and organizations, educational and research institutions, firms and private organizations.


Future

See http://github.com/KOST-CECO/KOST-Val/issues


Feedback & Issues

Feedback about KOST-Val is very welcome at http://github.com/KOST-CECO/KOST-Val/issues or kost-val[at]kost-ceco.ch

.

User Experiences

  • ZBW:
    • KOST-Val v1.6.0
    • The tool is very easy to install and to handle.
    • The output in xml-Format (open in a browser to have a table) is easy to understand
    • Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
    • The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.

.

Development Activity

All development activity is visible on GitHub: http://github.com/KOST-CECO/KOST-Val/commits


Release Feed

Below the last 3 release feeds:

2017-11-01 10:41:24
[tag:github.com,2008:Repository/10448958/v1.8.2 v1.8.2]
by Chlara
2017-09-18 13:43:17
[tag:github.com,2008:Repository/10448958/v1.8.1 v1.8.1]
by Chlara
2017-07-19 09:20:16
[tag:github.com,2008:Repository/10448958/v1.8.0 v1.8.0]
by Chlara


Activity Feed

Below the last 5 commits:

2017-11-01 10:46:27
[tag:github.com,2008:Grit::Commit/48248564ae4b10375790e3f2975ca08d3c72f5a8 resources pdfaPilot verkleinert]
by Chlara https://github.com/Chlara
2017-11-01 09:25:42
[tag:github.com,2008:Grit::Commit/609838c80aa9936a9fec0ba9adf274d94e2649d9 Aktualisierung]
by Chlara https://github.com/Chlara
2017-11-01 07:55:13
[tag:github.com,2008:Grit::Commit/c7f24bfd9f584b8061325d6017529e77709307ab gitignore hinzugefuegt]
by Chlara https://github.com/Chlara
2017-11-01 07:50:19
[tag:github.com,2008:Grit::Commit/de85ef3877f45147f3513653a1c32f1be9ec7ae4 diverse kleinere Korrekturen]
by Chlara https://github.com/Chlara
2017-11-01 07:43:27
[tag:github.com,2008:Grit::Commit/7bd607de22328c70b7f4ba27aec4da8aeb0e9337 Update PDF/A-Validierung]
by Chlara https://github.com/Chlara



Contributors

Yfriese (18.2%), Chlara (81.8%)