Difference between revisions of "Duke Data Accessioner"

From COPTR
Jump to navigation Jump to search
m (Added PREMIS as output format.)
(9 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{Infobox_tool
+
{{Infobox tool
|purpose=Duke Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer.
+
|purpose=Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer.
|image=
 
 
|homepage=http://dataaccessioner.org/
 
|homepage=http://dataaccessioner.org/
 +
|sourcecode=https://github.com/DataAccessioner/DataAccessioner
 
|license=Free
 
|license=Free
 +
|cost=Free
 
|platforms=Java
 
|platforms=Java
 +
|function=File Copy, File Format Identification, Metadata Extraction, Transfer, Validation
 +
|formats_out=PREMIS (Preservation Metadata Implementation Strategies)
 +
}}
 +
{{Infobox tool details
 +
|ohloh_id=Data Accessioner
 
}}
 
}}
 
<!-- Delete the Categories that do not apply -->
 
[[Category:Preservation System]]
 
[[Category:Metadata Processing]]
 
 
 
= Description =
 
= Description =
The Duke Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer. The software also offers a way to integrate metadata tools into the migration workflow. The tool is primarily designed for use by technical services librarians in small institutions with little or no IT support.
+
The Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer. The software also offers a way to integrate metadata tools into the migration workflow. The tool is primarily designed for use by technical services librarians in small institutions with little or no IT support.
 
====Provider====
 
====Provider====
Duke University Libraries
+
Data Accessioner website and POWRR.
 
====Licensing and cost====
 
====Licensing and cost====
The software is free and available for non-commercial, educational and research purposes under an open-source, Duke-written license.
+
The software is free and licensed under the GNU Lesser General Public License (v 2.1).
 
====Platform and interoperability====
 
====Platform and interoperability====
The software is written in Java, which renders it platform independent. Plugins are used via the Java Plugin Framework (JPF); a noted issue is that the JPF plugins do not work when running in a Mac OSX environment.
+
The software is written in Java, which renders it platform independent. (Requires Java 6.)
Existing plugins for [http://www.dcc.ac.uk/resource/external/jstorharvard-object-validation-environment-jhove JHOVE]&nbsp;and [http://www.dcc.ac.uk/resource/external/droid DROID]&nbsp;are available on the Accessioner webpage.
+
 
 +
For versions 0.3.1 and earlier plugins are used via the Java Plugin Framework (JPF); a noted issue is that the JPF plugins do not work when running in a Mac OSX environment.
 
====Functional notes====
 
====Functional notes====
The Data Accessioner is comprised of four main components; a graphical interface, a migrator, a metadata manager, and optional adapters. The migrator recursively navigates a file tree, copying it to a given destination with the option of skipping specified files and directories. It also creates a MD5 checksum for both the original file and the new copy, comparing the two to detect and notify the user of any errors. The project has thus far created two adapters; the JHOVE and DROID plugins allow users to insert these outside tools directly into their accessioning workflow. Using a custom metadata manager, the Data Accessioner can also be used as an ingest interface to repository systems such as Fedora.
+
The Data Accessioner is comprised of three main components; a graphical interface, a migrator, and a metadata manager. The migrator recursively navigates a file tree, copying it to a given destination with the option of skipping specified files and directories. It also creates a MD5 checksum for both the original file and the new copy, comparing the two to detect and notify the user of any errors. As of version 1.0 the migrator also runs each file through FITS and sends the results to the metadata manager. The metadata manager, by default, transforms the FITS output to PREMIS (v 2.2) object metadata although this can be changed by updating an XSLT. Previous versions used Jhove, Droid, and custom metadata manager plugins.
 
While the software&rsquo;s website does not give any information on volume or file format limitations, a [http://e-records.chrisprom.com/?p=1809 University of Illinois case study]&nbsp;encountered both. Overall, the user was extremely happy with the software; however, the project was unable to migrate information in CDA format and encountered a JVM error when attempting to migrate a large backup disk.
 
While the software&rsquo;s website does not give any information on volume or file format limitations, a [http://e-records.chrisprom.com/?p=1809 University of Illinois case study]&nbsp;encountered both. Overall, the user was extremely happy with the software; however, the project was unable to migrate information in CDA format and encountered a JVM error when attempting to migrate a large backup disk.
 
====Usability====
 
====Usability====
 
The Data Accessioner uses a simple and straightforward Graphical User Interface.
 
The Data Accessioner uses a simple and straightforward Graphical User Interface.
 
If the user wishes to exclusively run the migratory element of the software it must be done through command-line; however, this should not be necessary in the vast majority of uses.
 
If the user wishes to exclusively run the migratory element of the software it must be done through command-line; however, this should not be necessary in the vast majority of uses.
 +
 +
The Sustainable Heritage Network has [https://vimeo.com/142888727 created a video tutorial] that provides an overview of how to use the tool.
 +
 
====Expertise required====
 
====Expertise required====
The project&rsquo;s goal was to create software for technical services librarians, able &ldquo;to be easily adopted by smaller institutions with little or no IT staff.&rdquo; Metadata customisation, however, entails the construction of a separate plugin, which requires solid knowledge of application design.
+
The project&rsquo;s goal was to create software for technical services librarians, able &ldquo;to be easily adopted by smaller institutions with little or no IT staff.&rdquo; Metadata customization, however, entails either editing the FITS to PREMIS XSLT or modifying the application's source-code, which requires solid knowledge of application design.
 
====Standards compliance====
 
====Standards compliance====
The software includes a PREMIS metadata manager. Incorporation of other metadata standards requires a custom-built module.
+
The software includes a PREMIS metadata manager.
 
====Influence and take-up====
 
====Influence and take-up====
The Duke University Library uses the Data Accessioner in its accessioning workflow. No statistics are available on outside use.
+
No statistics are available although it has been featured in various conference presentations and workshops.
 
====Other====
 
====Other====
 
The old home page can be found here:http://library.duke.edu/rubenstein/uarchives/about/data-accessioner
 
The old home page can be found here:http://library.duke.edu/rubenstein/uarchives/about/data-accessioner
 
= User Experiences =
 
= User Experiences =
 +
[https://saaers.wordpress.com/2016/04/26/keeping-track-of-time-with-data-accessioner/ Keeping Track of Time With Data Accessioner]
  
 +
[http://e-records.chrisprom.com/dataaccessioner/ Practical e-Records: Data Accessioner Review]
  
 
= Development Activity =
 
= Development Activity =
 
+
https://github.com/seth-shaw/DataAccessioner/
{{Infobox_tool_details
 
|ohloh_id=Duke Data Accessioner
 
}}
 
 
 
<rss max=5>https://github.com/seth-shaw/DataAccessioner/commits/master.atom</rss>
 

Revision as of 15:36, 4 June 2022


Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer.
Homepage:http://dataaccessioner.org/
Source Code:https://github.com/DataAccessioner/DataAccessioner
License:Free
Cost:Free
Platforms:Java
Output Formats:PREMIS (Preservation Metadata Implementation Strategies)
Function:File Copy,File Format Identification,Metadata Extraction,Transfer,Validation
Appears in COW:Archival Forensics workflow (storage media deposit)


Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt661dfff81251c2_90149159


Description

The Data Accessioner provides a graphical user interface to aid in migrating data from physical media to a dedicated file server, documenting the process and using MD5 checksums to identify any errors introduced in transfer. The software also offers a way to integrate metadata tools into the migration workflow. The tool is primarily designed for use by technical services librarians in small institutions with little or no IT support.

Provider

Data Accessioner website and POWRR.

Licensing and cost

The software is free and licensed under the GNU Lesser General Public License (v 2.1).

Platform and interoperability

The software is written in Java, which renders it platform independent. (Requires Java 6.)

For versions 0.3.1 and earlier plugins are used via the Java Plugin Framework (JPF); a noted issue is that the JPF plugins do not work when running in a Mac OSX environment.

Functional notes

The Data Accessioner is comprised of three main components; a graphical interface, a migrator, and a metadata manager. The migrator recursively navigates a file tree, copying it to a given destination with the option of skipping specified files and directories. It also creates a MD5 checksum for both the original file and the new copy, comparing the two to detect and notify the user of any errors. As of version 1.0 the migrator also runs each file through FITS and sends the results to the metadata manager. The metadata manager, by default, transforms the FITS output to PREMIS (v 2.2) object metadata although this can be changed by updating an XSLT. Previous versions used Jhove, Droid, and custom metadata manager plugins. While the software’s website does not give any information on volume or file format limitations, a University of Illinois case study encountered both. Overall, the user was extremely happy with the software; however, the project was unable to migrate information in CDA format and encountered a JVM error when attempting to migrate a large backup disk.

Usability

The Data Accessioner uses a simple and straightforward Graphical User Interface. If the user wishes to exclusively run the migratory element of the software it must be done through command-line; however, this should not be necessary in the vast majority of uses.

The Sustainable Heritage Network has created a video tutorial that provides an overview of how to use the tool.

Expertise required

The project’s goal was to create software for technical services librarians, able “to be easily adopted by smaller institutions with little or no IT staff.” Metadata customization, however, entails either editing the FITS to PREMIS XSLT or modifying the application's source-code, which requires solid knowledge of application design.

Standards compliance

The software includes a PREMIS metadata manager.

Influence and take-up

No statistics are available although it has been featured in various conference presentations and workshops.

Other

The old home page can be found here:http://library.duke.edu/rubenstein/uarchives/about/data-accessioner

User Experiences

Keeping Track of Time With Data Accessioner

Practical e-Records: Data Accessioner Review

Development Activity

https://github.com/seth-shaw/DataAccessioner/