Difference between revisions of "KOST-Val"

From COPTR
Jump to navigation Jump to search
m (Link to manual)
m (Update: Description)
Line 35: Line 35:
 
   
 
   
 
=== Funtional Principle ===
 
=== Funtional Principle ===
−
KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.
 
−
 
 
KOST-Val complies with the following requirements.
 
KOST-Val complies with the following requirements.
  
Line 53: Line 51:
 
   
 
   
 
=== Third-party applications ===
 
=== Third-party applications ===
 +
KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.
 +
 
* The TIFF validation module uses [[JHOVE (Harvard Object Validation Environment)| JHOVE]] and evaluates its output further.
 
* The TIFF validation module uses [[JHOVE (Harvard Object Validation Environment)| JHOVE]] and evaluates its output further.
 
* For the PDF/A validation module [[PDFTron PDF-A Manager|PDF-A Manager]] or [[3-Heights(TM) PDF Validator|3-Heights™ PDF/A Validator]] are used.
 
* For the PDF/A validation module [[PDFTron PDF-A Manager|PDF-A Manager]] or [[3-Heights(TM) PDF Validator|3-Heights™ PDF/A Validator]] are used.
Line 61: Line 61:
 
   
 
   
 
   
 
   
−
===Read Me===
+
===Read Me & Download===
 
The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).
 
The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).
  
Line 88: Line 88:
 
.
 
.
  
−
== User Experiences ==
+
= User Experiences =
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->* '''ZBW:'''
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->* '''ZBW:'''
 
** KOST-Val v1.6.0
 
** KOST-Val v1.6.0
Line 95: Line 95:
 
** Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
 
** Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
 
** The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.
 
** The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.
 +
 +
.
  
 
= Development Activity =
 
= Development Activity =

Revision as of 08:13, 4 June 2015



KOST-Val
KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
Homepage:http://kost-ceco.ch/cms/index.php?kost_val_de
License:GPL V3
Platforms:should run under Java 1.6 on Windows
Input Formats:Template:Format, Template:Format, Template:Format/AProperty "Input format" (as page type) with input value "Template:Format]]/A" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process., Template:Format, Template:Format and SIPProperty "Input format" (as page type) with input value "Template:Format]] and SIP" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process.

Description

The KOST-Val application is used to validate Template:Format, Template:Format, Template:Format/A, Template:Format, Template:Format files and Submission Information Package (SIP).

KOST-Val supersedes the format validation tools SIARD-VAL, TIFF-Val and SIP-Val by KOST-CECO.


Funtional Principle

KOST-Val complies with the following requirements.

  • TIFF validation: KOST-Val reads a TIFF file and uses JHOVE to validate the structure, the content, and key properties such as compression, colour space, and multipage. These properties can be configured.
  • SIARD validation: KOST-Val reads a SIARD (eCH-0165 v1 ) file and validates the structure and the content.
  • PDF/A validation: KOST-Val reads a PDF or PDF/A file (ISO 19005-1 and 19005-2) and uses 3-Heights™ PDF/A Validator by PDF-Tools or PDF/A Manager by PDFTron to validate the structure and the content of the PDF file. KOST-Val organises the different error messages into main categories such as fonts, graphics, and metadata. KOST-Val supplies only a limited version from 3-Heights™ PDF/A Validator by PDF-Tools. Module J extracts (with iText) and validates the JPEG and JP2 images contained in the PDF file (depending on the configuration). It is also possible to configure whether the JBIG2 compression is accepted or not.
  • JP2 validation: KOST-Val reads a JP2 file (ISO 15444) and uses Jpylyzer to validate the structure and the content.
  • JPEG validation: KOST-Val reads a JPEG file (ISO 10918-1) and uses Bad Peggy to validate the structure and the content.
  • SIP validation: KOST-Val reads an SIP (eCH-0160 v1 as well as Swiss Federal Archives SFA v1 and v4 ) and validates the mandatory requirements of the SIP specification. The validated requirements are organised into groups such as folder structure, schema validation, and checksum validation. At the outset, a file format validation is performed.

The results (including information on inconsistencies and errors) are output for every step and written into a validation log. The validation steps are executed sequentially. Whenever possible the validation shall continue after an error has been detected in order to reduce the number of correction cycles.

KOST-Val FuntionalPrincipleFormatValidation.JPG


Third-party applications

KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.

  • The TIFF validation module uses JHOVE and evaluates its output further.
  • For the PDF/A validation module PDF-A Manager or 3-Heights™ PDF/A Validator are used.
  • The JP2 validation module uses Jpylyzer and translates the failed tests into appropriate error messages (DE/FR/EN).
  • The JPEG validation module uses Bad Peggy and evaluates the error message "Not a JPEG file" further.
  • To extract the JPEG and JP2 images from PDF/A the iText library is used.
  • For the file format identification DROID is used. For performance and granularity reasons an own SignatureFile is used instead of the official PRONOM registry.


Read Me & Download

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val, Copyright (C) 2012-2015 Claire Roethlisberger (KOST-CECO), Christian Eugster, Olivier Debenath, Peter Schneider (Staatsarchiv Aargau), Markus Hahn (coderslagoon), Daniel Ludin (BEDAG AG)

This program comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions; see GPL-3.0_COPYING.txt for details.

You can download KOST-Val under http://github.com/KOST-CECO/KOST-Val/releases. For installation instructions please check the manual (DE/FR/EN).


SIARD format

SIARD stands for Software Independent Archiving of Relational Databases. Originally the Swiss Federal Archives (SFA) have developed the SIARD format as a sustainable solution for the archiving of relations databases.

In early 2013 SIARD format has been adopted as an eCH Standard (eCH-0165: SIARD format specification http://www.ech.ch/vechweb/page?p=dossier&documentNumber=eCH-0165).

eCH is the Swiss organization for standardization in the field of e-government. eCH Standards define guidelines for recurring applications and their results, as for example format definitions or procedural standards. The aim of those standards is to unify and thus facilitate the electronic collaboration between authorities as well as between authorities and organizations, educational and research institutions, firms and private organizations.


Future

See http://github.com/KOST-CECO/KOST-Val/issues


Feedback & Issues

Feedback about KOST-Val is very welcome at http://github.com/KOST-CECO/KOST-Val/issues or kost-val[at]kost-ceco.ch

.

User Experiences

  • ZBW:
    • KOST-Val v1.6.0
    • The tool is very easy to install and to handle.
    • The output in xml-Format (open in a browser to have a table) is easy to understand
    • Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
    • The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.

.

Development Activity

All development activity is visible on GitHub: http://github.com/KOST-CECO/KOST-Val/commits


Release Feed

Below the last 3 release feeds:

2024-09-05 09:50:54
[tag:github.com,2008:Repository/10448958/v1.1.2 KOST-Tools v1.1.2]
by Chlara
2024-07-30 06:34:04
[tag:github.com,2008:Repository/10448958/KOST-Tools_v1.1.2 KOST-Tools v1.1.2 (alpha-Release)]
by Chlara
2024-05-06 09:19:31
[tag:github.com,2008:Repository/10448958/KOST-Tools_v1.1.1 KOST-Tools v1.1.1]
by Chlara


Activity Feed

Below the last 5 commits:

2024-07-16 06:13:50
[tag:github.com,2008:Grit::Commit/83ba678dea01746074e9695868104794a1d66208 Add files via upload]
by Chlara https://github.com/Chlara
2024-02-29 06:38:22
[tag:github.com,2008:Grit::Commit/a1c6d75a2bd0c99f1bda6a7cdf20c6639f0d274c Merge pull request #90 from KOST-CECO/v1.1.0]
by KostCeco https://github.com/KostCeco
2024-02-29 06:15:29
[tag:github.com,2008:Grit::Commit/0f6873a4d691ea6ec7fb929d44b8fa6877d4f7c3 KOST-Tools v1.1.0.0 Teil 17]
by Chlara https://github.com/Chlara
2024-02-26 08:55:19
[tag:github.com,2008:Grit::Commit/981deaa62c8e7af97e8055ea07e65117301f54e7 KOST-Tools v1.1.0.0 Teil 16]
by Chlara https://github.com/Chlara
2024-02-26 08:21:13
[tag:github.com,2008:Grit::Commit/c3180d66ea69dc47cea85437cf6a3b62f2718078 KOST-Tools v1.1.0.0 Teil 15]
by Chlara https://github.com/Chlara

Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt675011a54f2407_46631037


Retrieved from ‘https://coptr.digipres.org/index.php?title=KOST-Val&oldid=2712’