Difference between revisions of "KOST-Val"

From COPTR
Jump to navigation Jump to search
m (eCH link)
Line 1: Line 1:
<!-- Use the structure provided in this template, do not change it! -->
+
{{Infobox tool
 
+
|image=KOST-Val.JPG
{{Infobox_tool
 
 
|purpose=KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
 
|purpose=KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
|image=KOST-Val.JPG
 
|formats_in={{Format|TIFF}}, {{Format|SIARD}}, {{Format|PDF}}/A, {{Format|JP2}}, {{Format|JPEG}} and SIP
 
 
|homepage=http://kost-ceco.ch/cms/index.php?kost_val_de
 
|homepage=http://kost-ceco.ch/cms/index.php?kost_val_de
 
|license=[http://www.gnu.org/licenses/quick-guide-gplv3.html GNU General Public License 3+]
 
|license=[http://www.gnu.org/licenses/quick-guide-gplv3.html GNU General Public License 3+]
|platforms= should run under Java 1.6 on Windows
+
|platforms=should run under Java 1.6 on Windows
 +
|formats_in={{Format|TIFF}}, {{Format|SIARD}}, {{Format|PDF}}/A, {{Format|JP2}}, {{Format|JPEG}} and SIP
 +
|function=Validation, Quality Assurance, Preservation System
 +
|content=Database, Image, Document
 
}}
 
}}
 
+
{{Infobox tool details}}
<!-- Add one ore more categories to describe the function of the tool. Choose carefully, and view the list of existing categories first (see the Navigation sidebar on the left). The following are common category examples, remove those that don't apply -->
+
<!-- Use the structure provided in this template, do not change it! -->
[[Category:Validation]]
 
[[Category:Quality Assurance]]
 
[[Category:Database]]
 
[[Category:Image]]
 
[[Category:Document]]
 
[[Category:Preservation System]]
 
 
 
 
 
<!-- Add relevant categories to describe the content type that the tool addresses. Choose carefully, and view the list of existing categories first (see the Navigation sidebar on the left). If the tool works on any content type, do not add a category. The following are common category examples, remove those that don't apply -->
 
[[Category:Validation]]
 
[[Category:Quality Assurance]]
 
[[Category:Database]]
 
[[Category:Image]]
 
[[Category:Document]]
 
[[Category:Preservation System]]
 
 
 
 
= Description =
 
= Description =
 
<!-- Describe the what the tool does, focusing on it's digital preservation value. Keep it factual. -->
 
<!-- Describe the what the tool does, focusing on it's digital preservation value. Keep it factual. -->
Line 109: Line 93:
 
Below the last 5 commits:
 
Below the last 5 commits:
 
<rss max=5>https://github.com/KOST-CECO/KOST-Val/commits/master.atom</rss>
 
<rss max=5>https://github.com/KOST-CECO/KOST-Val/commits/master.atom</rss>
{{Infobox_tool_details
 
|ohloh_id=
 
}}
 

Revision as of 09:41, 23 April 2021


KOST-Val
KOST-Val is an open source validator for different file formats (TIFF, SIARD, PDF/A, JP2, JPEG) and Submission Information Package (SIP).
Homepage:http://kost-ceco.ch/cms/index.php?kost_val_de
License:GNU General Public License 3+
Platforms:should run under Java 1.6 on Windows
Input Formats:Template:Format, Template:Format, Template:Format/AProperty "Input format" (as page type) with input value "Template:Format]]/A" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process., Template:Format, Template:Format and SIPProperty "Input format" (as page type) with input value "Template:Format]] and SIP" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process.
Function:Validation,Quality Assurance,Preservation System
Content type:Database,Image,Document




Description

The KOST-Val application is used to validate Template:Format, Template:Format, Template:Format/A, Template:Format, Template:Format files and Submission Information Package (SIP).

KOST-Val supersedes the format validation tools SIARD-VAL, TIFF-Val and SIP-Val by KOST-CECO.


Functional Principle

KOST-Val complies with the following requirements.

  • TIFF validation: KOST-Val reads a TIFF file and uses JHOVE to validate the structure, the content, and ExifTool to validate the key properties such as compression, colour space, and multipage. These properties can be configured.
  • SIARD validation: KOST-Val reads a SIARD (eCH-0165 v1 and v2-2017) file and validates the structure and the content.
  • PDF/A validation: KOST-Val reads a PDF or PDF/A file (ISO 19005-1 and 19005-2) and uses 3-Heights™ PDF/A Validator by PDF-Tools or pdfaPilot by callas to validate the structure and the content of the PDF file. KOST-Val organises the different error messages into main categories such as fonts, graphics, and metadata. KOST-Val supplies only a limited version from 3-Heights™ PDF/A Validator by PDF-Tools and pdfaPilot by callas. Module J extracts (with iText) and validates the JPEG and JP2 images contained in the PDF file (depending on the configuration). It is also possible to configure whether the JBIG2 compression is accepted or not.
  • JP2 validation: KOST-Val reads a JP2 file (ISO 15444) and uses Jpylyzer to validate the structure and the content.
  • JPEG validation: KOST-Val reads a JPEG file (ISO 10918-1) and uses Bad Peggy to validate the structure and the content.
  • SIP validation: KOST-Val reads an SIP (eCH-0160 v1 and v1.1 ) and validates the mandatory requirements of the SIP specification. The validated requirements are organised into groups such as folder structure, schema validation, and checksum validation. At the outset, a file format validation is performed.

The results (including information on inconsistencies and errors) are output for every step and written into a validation log. The validation steps are executed sequentially. Whenever possible the validation shall continue after an error has been detected in order to reduce the number of correction cycles.

KOST-Val FuntionalPrincipleFormatValidation.JPG

Third-party applications

KOST-Val uses unmodified components of other manufacturers by embedding them directly into the source code. Users of KOST-Val are requested to adhere to these components ‘terms of licence.

  • The TIFF validation module uses JHOVE and ExifTool and evaluates its output further.
  • For the PDF/A validation module pdfaPilot or 3-Heights™ PDF/A Validator are used.
  • The JP2 validation module uses Jpylyzer and translates the failed tests into appropriate error messages (DE/FR/EN).
  • The JPEG validation module uses Bad Peggy and evaluates the error message "Not a JPEG file" further.
  • To extract the JPEG and JP2 images from PDF/A the iText library is used.
  • For the file format identification DROID is used. For performance and granularity reasons an own SignatureFile is used instead of the official PRONOM registry.


Read Me & Download

The KOST-Val application is used to validate TIFF, SIARD, PDF/A, JP2, JPEG files and Submission Information Package (SIP).

KOST-Val, Copyright (C) 2012-2017 Claire Roethlisberger (KOST-CECO), Christian Eugster, Olivier Debenath, Peter Schneider (Staatsarchiv Aargau), Markus Hahn (coderslagoon), Daniel Ludin (BEDAG AG)

This program comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions; see GPL-3.0_COPYING.txt for details.

You can download KOST-Val under http://github.com/KOST-CECO/KOST-Val/releases. For installation instructions please check the manual (DE/FR/EN).


SIARD format

SIARD stands for Software Independent Archiving of Relational Databases. Originally the Swiss Federal Archives (SFA) have developed the SIARD format as a sustainable solution for the archiving of relations databases.

In early 2013 SIARD format has been adopted as an eCH Standard (eCH-0165: SIARD format specification https://www.ech.ch/ech/ech-0165).

eCH is the Swiss organization for standardization in the field of e-government. eCH Standards define guidelines for recurring applications and their results, as for example format definitions or procedural standards. The aim of those standards is to unify and thus facilitate the electronic collaboration between authorities as well as between authorities and organizations, educational and research institutions, firms and private organizations.

Future

See http://github.com/KOST-CECO/KOST-Val/issues


Feedback & Issues

Feedback about KOST-Val is very welcome at http://github.com/KOST-CECO/KOST-Val/issues or kost-val[at]kost-ceco.ch

.

User Experiences

  • ZBW:
    • KOST-Val v1.6.0
    • The tool is very easy to install and to handle.
    • The output in xml-Format (open in a browser to have a table) is easy to understand
    • Running the JPEG-Module against almost 2,400 JPEGs has only lasted 7 minutes
    • The tool recognises fake-JPEGs (jpeg-extension, but no jpeg inside) and issues with jpegs and can differentiate easily between these two cases.

.

Development Activity

All development activity is visible on GitHub: http://github.com/KOST-CECO/KOST-Val/commits


Release Feed

Below the last 3 release feeds:

2022-05-30 07:26:23
[tag:github.com,2008:Repository/10448958/v2.1.2.0 v2.1.2.0]
by Chlara
2022-05-04 12:30:05
[tag:github.com,2008:Repository/10448958/v2.1.1.0b v2.1.1.0 MSI-Installer with Java]
by Chlara
2021-12-16 16:39:59
[tag:github.com,2008:Repository/10448958/v2.1.1.0 v2.1.1.0 Security Patch]
by Chlara


Activity Feed

Below the last 5 commits:

2022-07-05 08:28:39
[tag:github.com,2008:Grit::Commit/b351c869f7e634bd35c51142745b4fec669d8b1a KOST-Tools - CodeStyle]
by Chlara https://github.com/Chlara
2022-06-30 12:31:27
[tag:github.com,2008:Grit::Commit/b889edede2cc107ba25b7317f77121b888a715de KOST-Tools - KOST-Val v2.1.2.0]
by Chlara https://github.com/Chlara
2022-05-19 10:33:19
[tag:github.com,2008:Grit::Commit/214d511256c045070a2e2e41e5310a4b85bef7c4 KOST-Tools - simplify j & KOST-Val SIPv1.2]
by Chlara https://github.com/Chlara
2022-02-03 09:46:33
[tag:github.com,2008:Grit::Commit/0becd5c514c2d47bfa95db977f614986e11bcbc8 KOST-Tools - SIARDexcerpt p1]
by Chlara https://github.com/Chlara
2021-12-16 16:09:11
[tag:github.com,2008:Grit::Commit/81e43e8655315bc5cc80c33f152a6b8bbfb536a4 Security Patch (KOST-Val v2.1.1.0)]
by Chlara https://github.com/Chlara