Difference between revisions of "FITS (File Information Tool Set)"

From COPTR
Jump to navigation Jump to search
 
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
{{Infobox_tool
+
{{Infobox tool
 
|purpose=FITS allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository.
 
|purpose=FITS allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository.
−
|image=
 
 
|homepage=http://fitstool.org
 
|homepage=http://fitstool.org
 
|license=[http://www.gnu.org/licenses/lgpl.html GNU Lesser General Public License]
 
|license=[http://www.gnu.org/licenses/lgpl.html GNU Lesser General Public License]
 
|platforms=Windows or Unix
 
|platforms=Windows or Unix
 +
|function=File Format Identification, Validation, Metadata Extraction, Encryption Detection
 +
}}
 +
{{Infobox tool details
 +
|ohloh_id=fits
 
}}
 
}}
−
 
−
<!-- Delete the Categories that do not apply -->
 
−
[[Category:File Format Identification]]
 
−
[[Category:Validation]]
 
−
[[Category:Metadata Extraction]]
 
−
[[Category:Encryption Detection]]
 
−
 
 
= Description =
 
= Description =
−
[http://fitstool.org FITS] allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository. It does this by encorporating a range of mostly third-party open source tools, normalising and consolidating their output.
+
The File Information Tool Set ([http://fitstool.org FITS]) identifies, validates and extracts technical metadata for a wide range of file formats. It acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file.
 
   
 
   
 
=== Provider ===
 
=== Provider ===
Line 20: Line 16:
  
 
=== Platform and interoperability ===
 
=== Platform and interoperability ===
−
FITS is written in Java and is compatible with Java 1.6 or higher.  
+
FITS is written in Java and is compatible with Java 1.7 or higher.  
−
It uses six external tools:  
+
The tools used in version 1.3.0 of FITS are:
 +
* [[ADL Tool]]
 +
* [[Apache Tika]]
 +
* [[DROID_(Digital_Record_Object_Identification)|DROID]]
 +
* [[ExifTool]]
 +
* [http://web.archive.org/web/20061106114156/http://schmidt.devlib.org/ffident/index.html FFIdent] (no longer maintained)
 +
* [[http://unixhelp.ed.ac.uk/CGI/man-cgi?file File Utility] (windows port)
 
* [[JHOVE (Harvard Object Validation Environment)| JHOVE]]
 
* [[JHOVE (Harvard Object Validation Environment)| JHOVE]]
−
* [[ExifTool]]
+
* [[MediaInfo]]
−
* [[Metadata Extraction Tool]]
+
* [[Metadata_Extraction_Tool]]
−
* [[DROID_(Digital_Record_Object_Identification)|DROID]]
+
* [[OIS Audio Information]]
−
* [http://web.archive.org/web/20061106114156/http://schmidt.devlib.org/ffident/index.html FFIdent]
+
* [[OIS File Information]]
−
* [http://unixhelp.ed.ac.uk/CGI/man-cgi?file File Utility]
+
* [[OIS XML Information]]
  
−
A few Harvard Library-created tools; and many open source libraries.
 
 
Instructions for command line use are given for Windows and Unix.
 
Instructions for command line use are given for Windows and Unix.
 
   
 
   
Line 37: Line 38:
 
=== Documentation and user support ===
 
=== Documentation and user support ===
 
Documentation exists in the form of a user manual and more technical developer manual.  
 
Documentation exists in the form of a user manual and more technical developer manual.  
−
The project actively uses the fits-users google group has 30 members, and is active as of January 2012.  
+
The project actively uses the fits-users google group has 78 (Sept. 24, 2018) members, and is active as of January 2012.  
 
The FITS web site links to a [https://github.com/harvard-lts/fits github site] that includes the source code and an issues tracker.
 
The FITS web site links to a [https://github.com/harvard-lts/fits github site] that includes the source code and an issues tracker.
 
   
 
   
 
=== Usability ===
 
=== Usability ===
−
FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience.
+
FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience. In January 2016, version 1.0.0 of the FITS [https://projects.iq.harvard.edu/fits/downloads#fits-servlet web service] was released, giving the ability to deploy FITS as a service.
 
   
 
   
 
=== Expertise required ===
 
=== Expertise required ===
Line 55: Line 56:
 
= User Experiences =
 
= User Experiences =
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->
 +
* '''National Archives of the Netherlands:'''
 +
** How [http://openpreservation.org/blog/2017/05/17/preservation-impact-assessments-how-preservation-tools-support-naneths-connection-projects/ FITS] supports pre-ingest impact assessments at the National Archives of the Netherlands.
 
* '''DNB (German National Library):'''
 
* '''DNB (German National Library):'''
 
** FITS v0.6.1 with modified [[JHOVE (Harvard Object Validation Environment)| Jhove 1.11]], Gentoo Linux, Java-Environment, Tomcat-Application Server
 
** FITS v0.6.1 with modified [[JHOVE (Harvard Object Validation Environment)| Jhove 1.11]], Gentoo Linux, Java-Environment, Tomcat-Application Server
Line 63: Line 66:
 
*** A further adjustment, which the DNB has made, is the integration of a DNB tool to analyse files in ePub format.
 
*** A further adjustment, which the DNB has made, is the integration of a DNB tool to analyse files in ePub format.
  
−
* '''ZBW (German National Library of Economics):'''
+
* '''ZBW (German National Library of Economics):''' [https://wiki.dnb.de/display/NESTOR/ZBW+user+experience+with+FITS Link to the user experience of the ZBW]
−
[https://wiki.dnb.de/display/NESTOR/ZBW+user+experience+with+FITS Link to the user experience of the ZBW]
 
  
 
= Development Activity =
 
= Development Activity =
Line 71: Line 73:
 
   
 
   
 
All development activity is visible on GitHub: http://github.com/harvard-lts/fits/commits
 
All development activity is visible on GitHub: http://github.com/harvard-lts/fits/commits
 +
 +
 +
=== Release Feed ===
 +
Below the last 3 release feeds:
 +
<rss max=3>https://github.com/harvard-lts/fits/releases.atom</rss>
 
   
 
   
 
   
 
   
Line 76: Line 83:
 
Below the last 5 commits:
 
Below the last 5 commits:
 
<rss max=5>https://github.com/harvard-lts/fits/commits/master.atom</rss>
 
<rss max=5>https://github.com/harvard-lts/fits/commits/master.atom</rss>
−
 
−
{{Infobox_tool_details
 
−
|ohloh_id=fits
 
−
}}
 

Latest revision as of 14:35, 22 April 2021



FITS allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository.
Homepage:http://fitstool.org
License:GNU Lesser General Public License
Platforms:Windows or Unix
Function:File Format Identification,Validation,Metadata Extraction,Encryption Detection
Appears in COW:Workflow for ingesting digitized books into a digital archive


Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt66221884ccde53_93888055


Description[edit]

The File Information Tool Set (FITS) identifies, validates and extracts technical metadata for a wide range of file formats. It acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file.

Provider[edit]

Harvard Library

Platform and interoperability[edit]

FITS is written in Java and is compatible with Java 1.7 or higher. The tools used in version 1.3.0 of FITS are:

Instructions for command line use are given for Windows and Unix.

Functional notes[edit]

FITS acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file. Technical metadata is only output (and a part of the consolidation process) for tools that were able to identify the file. All other output is discarded.

Documentation and user support[edit]

Documentation exists in the form of a user manual and more technical developer manual. The project actively uses the fits-users google group has 78 (Sept. 24, 2018) members, and is active as of January 2012. The FITS web site links to a github site that includes the source code and an issues tracker.

Usability[edit]

FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience. In January 2016, version 1.0.0 of the FITS web service was released, giving the ability to deploy FITS as a service.

Expertise required[edit]

Installation and configuration require deep systems administration and application design knowledge, as well as familiarity with file format and metadata standards.

Standards compliance[edit]

FITS outputs in XML format. A detailed description of the FITS-XML can be found here and an analysis of the output data here.

Influence and take-up[edit]

The FITS website shows over 2000 downloads of the software. The tool was designed for and is in use at the Harvard Library Digital Repository Service.

User Experiences[edit]

  • National Archives of the Netherlands:
    • How FITS supports pre-ingest impact assessments at the National Archives of the Netherlands.
  • DNB (German National Library):
    • FITS v0.6.1 with modified Jhove 1.11, Gentoo Linux, Java-Environment, Tomcat-Application Server
    • Since the end of 2012, DNB uses the FITS library as a part of its risk management within the automated ingest process. At present more than 1500 files are daily examined by FITS.
      • The purpose of the risk management and its implementation with metadata tools like FITS or JHOVE is to facilitate automatic technical quality checking (bitstream integrity and validation) of each digital publications. Furthermore, the analysis is aimed at recognising technical restrictions such as DRM at an early stage, which hinder or even prevent the task of long-term preservation and use of the digital objects.
      • The extracted technical metadata (the FITS output) are used further for future long-term preservation measures such as format migration and are stored and managed in the metadata management of the long-term archive of the DNB. The capture of these metadata is essential in order to execute targeted migration measures of files in endangered formats.
      • FITS also offers significant benefit in the form of easily configurable standardisation of the different tool outputs into the FITS format using XSLT. The DNB has used this function to adapt the FITS output to its own requirements, e.g. incorporating other metadata elements not included in the FITS distribution into the standardisation.
      • A further adjustment, which the DNB has made, is the integration of a DNB tool to analyse files in ePub format.

Development Activity[edit]

FITS 0.2.0 was first released as open source in July 2009. As of April 2014 the latest release was version 0.8, released in January 2014. The tool was created to be used in Harvard's Digital Repository Service, and development is active and ongoing.

All development activity is visible on GitHub: http://github.com/harvard-lts/fits/commits


Release Feed[edit]

Below the last 3 release feeds:

2023-01-16 19:17:00
[tag:github.com,2008:Repository/8527901/1.6.0 Release 1.6.0]
by awoods
2022-11-30 00:57:23
[tag:github.com,2008:Repository/8527901/1.6.0a-snapshot Pre-Release 1.6.0-SNAPSHOT]
by awoods
2022-10-31 21:54:38
[tag:github.com,2008:Repository/8527901/1.5.5 Release 1.5.5]
by daveneiman


Activity Feed[edit]

Below the last 5 commits: Failed to load RSS feed from https://github.com/harvard-lts/fits/commits/master.atom: There was a problem during the HTTP request: 404 Not Found

Retrieved from ‘https://coptr.digipres.org/index.php?title=FITS_(File_Information_Tool_Set)&oldid=4301’