COPTR - User contributions [en-gb]

Main Page

2013-09-16T10:26:57Z

MediaWiki default:

<big>'''MediaWiki has been successfully installed.'''</big>

Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.

== Getting started ==
* [http://www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]
* [http://www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]

DART (Digital Archivist's Resource Tool)

2020-02-20T23:39:56Z

MediaWiki default:

{{Infobox_tool
|purpose=Provides both a GUI and a command-line interface for packaging files and uploading them to remote repositories.
|homepage=https://aptrust.github.io/dart-docs/
|license=TBC
|platforms=Windows/Mac/Linux
}}


[[Category:Storage]]
[[Category:File Management]]
[[Category:Fixity]]
[[Category:Transfer]]

[[Category:Binary Data]]

== Description ==


<blockquote>
DART is the Digital Archivist's Resource Tool. Its primary purpose is to package digital materials and send them off to long-term preservation storage. DART's initial release focuses on packaging materials in BagIt format and uploading them to S3 buckets for ingest in APTrust. DART can be extended through plugins to produce other packaging formats and to communicated via additional network protocols.

DART runs in both graphical and command-line modes on Windows, Mac, and Linux.
</blockquote>

== User Experiences ==


== Development Activity ==


{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=
}}

DART (Digital Archivist's Resource Tool)

2020-02-20T12:16:25Z

MediaWiki default: Outline entry for DART

{{Infobox_tool
|purpose=Provides both a GUI and a command-line interface for packaging files and uploading them to remote repositories.
|homepage=https://aptrust.github.io/dart-docs/
|license=TBC
|platforms=Windows/Mac/Linux
}}




<blockquote>
DART is the Digital Archivist's Resource Tool. Its primary purpose is to package digital materials and send them off to long-term preservation storage. DART's initial release focuses on packaging materials in BagIt format and uploading them to S3 buckets for ingest in APTrust. DART can be extended through plugins to produce other packaging formats and to communicated via additional network protocols.

DART runs in both graphical and command-line modes on Windows, Mac, and Linux.
</blockquote>

== User Experiences ==


== Development Activity ==


{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=
}}

MDB/ACCDB Viewer

2020-02-05T16:49:07Z

MediaWiki default: Added format info and link to tweet of usage.

{{Infobox_tool
|purpose=MDB Viewer opens Microsoft Access 1997-2013 databases on your Macintosh, and views and exports all tables in Access databases.
|homepage=https://eggerapps.at/mdbviewer/
|license=
|platforms=
|formats_in={{Format|MDB}}, {{Format|ACCDB}}
|formats_out={{Format|CSV}}, {{Format|DB}}, {{Format|SQL}}, {{Format|XLS}}
}}



[[Category:File Format Migration]]


[[Category:Database]]

== Description ==

MDB Viewer opens Microsoft Access 1997-2013 databases on your Macintosh, including .ACCDB and .MDB files. Data can be exported to many different formats including .csv, .db, .sql and .xls.

It is read-only - files cannot be edited within the viewer. It only show tables, not other objects such as forms or queries. It cannot open encrypted files or files created in Access 1.0 or 2.0.

== User Experiences ==

* https://eggerapps.at/mdbviewer/reviews.php
* [https://twitter.com/anjacks0n/status/1106192047764131840 Tweets showing example of usage] by [[User:Andy Jackson]].

== Development Activity ==


* https://eggerapps.at/mdbviewer/docs/en/whats-new.html

Wish list of tools to add to COPTR

2018-09-26T11:01:01Z

MediaWiki default: /* Tools to add */

This is a scratch space for adding lists of tools that should be added to COPTR. Please add your wish list of tools below. If anyone subsequently adds tool entries for tools listed here, please indicate that by adding strike tags around them on this page!

==Tools to add==
*Forensics tools wish list from Cal Lee (more to come):
**Guymager, fiwalk, bulk_extractor, BitCurator environment
*Other misc tools to add:
**<strike>Siegfried [http://www.openplanetsfoundation.org/blogs/2014-09-27-siegfried-pronom-based-file-format-identification-tool]</strike>
**Two tools to add here: http://www.itforarchivists.com/
**<s>Web recorder https://webrecorder.io/</s>
**http://sox.sourceforge.net/
**http://www.mplayerhq.hu/
**https://hashcat.net/oclhashcat/ and https://hashcat.net/forum/thread-3818.html
**http://www.videolan.org/
**http://www.squared5.com/
**http://docrefinery.org/
**http://disktype.sourceforge.net/ stub at [[Disktype]]
**<strike>https://github.com/pericles-project/pet and http://pericles-project.eu/blog/post/metadata%20extraction,%20environment%20information/&utm_source=dlvr.it&utm_medium=twitter</strike>
**http://lifehacker.com/5992991/infogram-generates-beautiful-infographics-from-custom-data
**http://mpc-hc.org/ Referenced briefly here: https://groups.google.com/d/msg/digital-curation/k-B7g80lOfQ/45oXNw-CUrkJ
**http://viewshare.org/ and http://blogs.loc.gov/digitalpreservation/2014/10/new-season-new-viewshare/
**There are a number of tools listed at the bottom of this page: http://wiki.dpconline.org/index.php?title=Institutional_readiness and this page: http://wiki.dpconline.org/index.php?title=Digital_preservation_risks that should be added to COPTR in the [[:Category:Organisational Audit|Organisational Audit category]]
**There are a number of tools listed at the bottom of this page: http://wiki.dpconline.org/index.php?title=Benefits that should be added to COPTR in the [[:Category:Benefits|Benefits category]]
**Lots of tools listed here http://wiki.opf-labs.org/display/CDP/Home that could be added in the [[:Category:Costs|Costs category]]. There is probably also a lot of overlap with this list: http://4cproject.eu/community-resources/related-projects
**https://github.com/F-Secure/Sulo
**<strike>http://verapdf.org/home/</strike>
*DOCX and other document related stuff:
**http://www.documentliberation.org/projects/
**https://www.openhub.net/p/officeotron (no longer maintained as of 2011)
**http://ooxmlvalidator.codeplex.com/ (no longer maintained as of 2009)
**http://www.microsoft.com/en-us/download/details.aspx?id=5124 (Microsoft SDK includes validation support), also see http://blogs.msdn.com/b/ericwhite/archive/2010/03/04/validate-open-xml-documents-using-the-open-xml-sdk-2-0.aspx
**http://packageexplorer.codeplex.com/
**http://johnmacfarlane.net/pandoc/index.html
**https://python-docx.readthedocs.org/en/latest/
**http://textract.readthedocs.org/en/latest/#
*More tools....
**http://minezy.org/
**http://www.avalonmediasystem.org/project

==Stubs to fix, expand or remove==
*This seems to reference different tools so should be expanded into a number of tool entries http://coptr.digipres.org/Windows_IR/CF_Tools

==User experience links to add==
*[http://www.mnhs.org/preserve/records/tools.php http://www.mnhs.org/preserve/records/tools.php]
*[https://www.lib.umn.edu/dp/guides https://www.lib.umn.edu/dp/guides]

Category:Web

2018-09-24T15:48:22Z

MediaWiki default: links to related efforts

[[Category:Content Type]]
{{Infobox_content
|definition=Tools that support the preservation of live web data and archived web data (such as ARC and WARC formats).
}}

Related tool lists:

* The [http://netpreserve.org/ International Internet Preservation Consortium] also offers a [http://netpreserve.org/web-archiving/tools-and-software/ list of tools]
* ArchiveTeam's [https://www.archiveteam.org/index.php?title=The_WARC_Ecosystem page on the WARC Ecosystem]

Web Archive Discovery

2018-09-24T15:33:13Z

MediaWiki default: /* Description */

{{Infobox_tool
|purpose=Indexing and discovery tools for web archives.
|homepage=https://github.com/ukwa/webarchive-discovery
|license=Mixed
|platforms=Java
}}


[[Category:Metadata Extraction]]
[[Category:File Format Identification]]
[[Category:Content Profiling]]
[[Category:Discovery]]


[[Category:Web]]
[[Category:Web_Archive]]

== Description ==

Full-text indexing system, using Apache Solr as the search back-end. Supports command-line or large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.

It runs format identification using both [[Apache Tika]] and [[DROID]], and also extracts filename extensions and the first few bytes of each resource, to enable analysis of formats unknown to those tools.

If can also be configured to use [[Apache PDFBox]]'s Preflight tool to scan PDF's for PDF/A violations, and record them in the index for analysis.

It also records any parsing errors or other access problems it discovers, which can help find problematic resources.

For more information, see the [https://github.com/ukwa/webarchive-discovery/wiki/Features Features page of the tool's wiki].

== User Experiences ==

* Used by the [http://www.webarchive.org.uk/ UK Web Archive] to provide access to their collections. Some details [http://blogs.bl.uk/webarchive/2017/06/revitalising-the-uk-web-archive.html in this blog post]. Feel free to contact [https://twitter.com/UKWebArchive @UKWebArchive] for more information.
* Also used by a number of other web archives, and by the [https://github.com/archivesunleashed/warclight WARCLight] project.

= Development Activity =

All development activity is visible on GitHub: http://github.com/ukwa/webarchive-discovery

There is also a #webarchive-discovery channel on the IIPC Slack service. Contact https://twitter.com/NetPreserve for details.

=== Release Feed ===
Below the last 3 release feeds:
<rss max=3>https://github.com/ukwa/webarchive-discovery/releases.atom</rss>

=== Activity Feed ===
Below the last 5 commits:
<rss max=5>https://github.com/ukwa/webarchive-discovery/commits/master.atom</rss>

{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=Heritrix
}}

Web Archive Discovery

2018-09-24T15:32:28Z

MediaWiki default:

{{Infobox_tool
|purpose=Indexing and discovery tools for web archives.
|homepage=https://github.com/ukwa/webarchive-discovery
|license=Mixed
|platforms=Java
}}


[[Category:Metadata Extraction]]
[[Category:File Format Identification]]
[[Category:Content Profiling]]
[[Category:Discovery]]


[[Category:Web]]
[[Category:Web_Archive]]

== Description ==

Full-text indexing system, using Apache Solr as the search back-end. Supports command-line or large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.

It runs format identification using both [[Apache Tika]] and [[DROID]], and also extracts filename extensions and the first few bytes of each resource, to enable analysis of formats unknown to those tools.

If can also be configured to use [[Apache PDFBox Preflight]] to scan PDF's for PDF/A violations, and record them in the index for analysis.

It also records any parsing errors or other access problems it discovers, which can help find problematic resources.

For more information, see the [https://github.com/ukwa/webarchive-discovery/wiki/Features Features page of the tool's wiki].

== User Experiences ==

* Used by the [http://www.webarchive.org.uk/ UK Web Archive] to provide access to their collections. Some details [http://blogs.bl.uk/webarchive/2017/06/revitalising-the-uk-web-archive.html in this blog post]. Feel free to contact [https://twitter.com/UKWebArchive @UKWebArchive] for more information.
* Also used by a number of other web archives, and by the [https://github.com/archivesunleashed/warclight WARCLight] project.

= Development Activity =

All development activity is visible on GitHub: http://github.com/ukwa/webarchive-discovery

There is also a #webarchive-discovery channel on the IIPC Slack service. Contact https://twitter.com/NetPreserve for details.

=== Release Feed ===
Below the last 3 release feeds:
<rss max=3>https://github.com/ukwa/webarchive-discovery/releases.atom</rss>

=== Activity Feed ===
Below the last 5 commits:
<rss max=5>https://github.com/ukwa/webarchive-discovery/commits/master.atom</rss>

{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=Heritrix
}}

Web Archive Discovery

2018-09-24T15:27:32Z

MediaWiki default: /* Description */

{{Infobox_tool
|purpose=Indexing and discovery tools for web archives.
|homepage=https://github.com/ukwa/webarchive-discovery
|license=Mixed
|platforms=Java
}}


[[Category:Metadata Extraction]]
[[Category:File Format Identification]]
[[Category:Content Profiling]]
[[Category:Discovery]]


[[Category:Web]]
[[Category:Web_Archive]]

== Description ==

Full-text indexing system, using Apache Solr as the search back-end. Supports command-line or large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.

It runs format identification using both [[Apache Tika]] and [[DROID]], and also extracts filename extensions and the first few bytes of each resource, to enable analysis of formats unknown to those tools.

If can also be configured to use [[Apache PDFBox Preflight]] to scan PDF's for PDF/A violations, and record them in the index for analysis.

It also records any parsing errors or other access problems it discovers, which can help find problematic resources.

For more information, see the [https://github.com/ukwa/webarchive-discovery/wiki/Features Features page of the tool's wiki].

== User Experiences ==

* Used by the [http://www.webarchive.org.uk/ UK Web Archive] to provide access to their collections. More details TBA.

= Development Activity =

All development activity is visible on GitHub: http://github.com/ukwa/webarchive-discovery

There is also a #webarchive-discovery channel on the IIPC Slack service. Contact https://twitter.com/NetPreserve for details.

=== Release Feed ===
Below the last 3 release feeds:
<rss max=3>https://github.com/ukwa/webarchive-discovery/releases.atom</rss>

=== Activity Feed ===
Below the last 5 commits:
<rss max=5>https://github.com/ukwa/webarchive-discovery/commits/master.atom</rss>

{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=Heritrix
}}

Web Archive Discovery

2018-09-24T14:16:07Z

MediaWiki default: Added activity feeds.

{{Infobox_tool
|purpose=Indexing and discovery tools for web archives.
|homepage=https://github.com/ukwa/webarchive-discovery
|license=Mixed
|platforms=Java
}}


[[Category:Metadata Extraction]]
[[Category:File Format Identification]]
[[Category:Content Profiling]]
[[Category:Discovery]]


[[Category:Web]]
[[Category:Web_Archive]]

== Description ==

Full-text indexing system, using Apache Solr as the search back-end. Supports command-line or large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.

== User Experiences ==

* Used by the [http://www.webarchive.org.uk/ UK Web Archive] to provide access to their collections. More details TBA.

= Development Activity =

All development activity is visible on GitHub: http://github.com/ukwa/webarchive-discovery

There is also a #webarchive-discovery channel on the IIPC Slack service. Contact https://twitter.com/NetPreserve for details.

=== Release Feed ===
Below the last 3 release feeds:
<rss max=3>https://github.com/ukwa/webarchive-discovery/releases.atom</rss>

=== Activity Feed ===
Below the last 5 commits:
<rss max=5>https://github.com/ukwa/webarchive-discovery/commits/master.atom</rss>

{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=Heritrix
}}

Heritrix

2015-09-22T15:51:46Z

MediaWiki default: /* Development Activity */ Adding activity sources

{{Infobox_tool
|purpose=Heritrix is an open-source web crawler, allowing users to target websites they wish to include in a collection and to harvest an instance of each site.
|image=
|homepage=http://crawler.archive.org
|license=GNU Lesser General Public License 2.1
|platforms=Written in Java. Must have Java Runtime Environment (JRE, http://www.java.com/en/download/index.jsp) and at least Java version 5.0 installed. Default heap size is 256MB RAM.
}}


[[Category:Web Crawl]]
[[Category:Web]]

= Description =
[https://webarchive.jira.com/wiki/display/Heritrix/Heritrix Heritrix] is an open-source web crawler, allowing users to target websites they wish to include in a collection and to harvest an instance of each site. The software is most often used as a powerful back-end tool incorporated into a web archiving workflow.
====Provider====
Internet Archive
====Licensing and cost====
[http://www.apache.org/licenses/LICENSE-2.0.html Apache License, Version 2.0] – free. Some individual source code files are subject to or offered under other licenses.
====Development activity====
Version 3.1.1 was released in May 2012.
Heritrix powers the Internet Archive, and so receives ongoing support.
====Platform and interoperability====
As a Java application, Heritrix is theoretically platform agnostic; however, only Linux is supported.  The software requires Java Runtime Environment 1.6 or higher, and at least 256MB of available RAM.
====Functional notes====
Web crawls are carried out by configuring a ‘job,’ which itself is an instance of a crawl template called a ‘profile.’ Although they contain the same configurations, these two entities have different functions; profiles record the set of configurations and act as a starting point for shaping a new job, but only the job itself can excecute a crawl.
The software will crawl FTP sites in addition to HTTP. Users can examine the results of a crawl by opening its log files, which include information about crawl problems and errors, each URI that was collected, and statistics about the job as a whole. Users can also create reports showing a summary of the crawl’s activity.
Heritrix stores the web resources it crawls in an Arc file. The software includes a command-line tool called arcreader which can be used to extract the contents.
====Documentation and user support====
The [https://webarchive.jira.com/wiki/display/Heritrix/Heritrix+3.0+and+3.1+User+Guide User Guide for versions 3.0 and 3.1] is in the form of a wiki, which at time of writing is not structured in any obvious narrative order; while detailed, it is very difficult to navigate.  The [http://crawler.archive.org/articles/user_manual/ User Manual for version 2.0] is structured and can be used as a reference for navigation.  Extensive documentation is available, including release notes, Javadoc API documentation, and FAQs linking within the wiki.
Heritrix’s website links to two active mailing lists: a yahoo discussion group and a sourceforge list distributing source code commits. The project also uses a public JIRA for bug, feature, and issue tracking.
====Usability====
Heritrix is installed via a command line interface, but once installed the user can launch a web-based interface for configuration. Setting up a crawl requires a significant number of adjustments.
====Expertise required====
Installation requires solid knowledge of Linux and command line interfaces. As with any web archiving software, deep understanding of the project’s scope and collections policy is essential in order to set up appropriate targets.
====Standards compliance====
Heritrix does not offer metadata support. The software is designed to respect robots.txt exclusion directives and META robots tags.
====Influence and take-up====
Heritrix is extremely influential; as of March 2012 the sourceforge site reports nearly 240,000 downloads. [https://webarchive.jira.com/wiki/display/Heritrix/Users+of+Heritrix Users] include the Internet Archive, The British Library, the United States Library of Congress, and the French National Library. The software powers [http://www.dcc.ac.uk/node/9380 Netarchive Suite] and the [http://www.dcc.ac.uk/node/9394 Web Curator Tool].

= User Experiences =

= Development Activity =

{{Infobox_tool_details
|releases_rss=https://github.com/internetarchive/heritrix3/commits/master.atom
|issues_rss=https://webarchive.jira.com/sr/jira.issueviews:searchrequest-rss/temp/SearchRequest.xml?jqlQuery=project+%3D+HER&tempMax=100
|mailing_lists=https://groups.yahoo.com/neo/groups/archive-crawler/info
|ohloh_id=Heritrix
}}

Bulk Rename Utility

2015-07-29T16:25:17Z

MediaWiki default: Another test edit.

{{Infobox_tool
|purpose=Bulk Rename Utility is a free file renaming software for Windows. Bulk Rename Utility allows you to easily rename files and entire folders based upon extremely flexible criteria.
|image={{PAGENAMEE}}.png
|homepage=http://www.bulkrenameutility.co.uk
|license=Freeware
|platforms=Windows
}}



[[Category:File Management]]



== Description ==


== User Experiences ==


== Development Activity ==


{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=
}}

Bulk Rename Utility

2015-07-29T16:16:07Z

MediaWiki default: A test edit.

{{Infobox_tool
|purpose=Bulk Rename Utility is a free file renaming software for Windows. Bulk Rename Utility allows you to easily rename files and entire folders based upon extremely flexible criteria.
|image={{PAGENAMEE}}.png
|homepage=http://www.bulkrenameutility.co.uk
|license=Freeware
|platforms=Windows
}}



[[Category:File Management]]



== Description ==

TBA

== User Experiences ==


== Development Activity ==


{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=
}}

User:Andy Jackson

2015-07-29T16:03:10Z

MediaWiki default: /* Ideas */

[https://twitter.com/anjacks0n @anjacks0n]

== Ideas ==
* [[User:Andy_Jackson/DigiPresHack|DigiPresHack]]
* [[User:COPTR_Bot]]
* Test edit

== Related ==

* https://groups.google.com/forum/#!forum/digipres
* https://twitter.com/digipresnews & https://twitter.com/justsolvedfmts
* http://qanda.digipres.org/
* http://anjackson.github.io/zombse/
* http://fileformats.archiveteam.org/

== Other Possible Sources ==

* [http://netpreserve.org/web-archiving/tools-and-software IIPC Tools and Software page]
* 100 Open Source Replacements for Audio and Video Tools:
** [http://www.datamation.com/applications/100-open-source-replacements-for-audio-and-video-tools-1.html Page 1: Animation, Audio Players]
** [http://www.datamation.com/applications/100-open-source-replacements-for-audio-and-video-tools-2.html Page 2: Audio Recorders and Editors, Audio Ripping and Conversion, Audio Mixing/DJ Tools, CD/DVD Burning, File Sharing]
** [http://www.datamation.com/applications/100-open-source-replacements-for-audio-and-video-tools-3.html Page 3: Multimedia File Conversion, Multimedia Players]
** [http://www.datamation.com/applications/100-open-source-replacements-for-audio-and-video-tools-4.html Page 4: Multimedia Library Management, Music Composition and Production, Music Composition and Production, Screen Video Capture]
** [http://www.datamation.com/applications/100-open-source-replacements-for-audio-and-video-tools-5.html Page 5: Server Software, Subtitles, Video Editing]

2014-11-09T20:44:58Z

MediaWiki default:

{{Infobox_tool
|purpose=A brief description
|image={{PAGENAMEE}}.png
|homepage=url
|license=
|platforms=
}}






== Description ==


== User Experiences ==


== Development Activity ==


{{Infobox_tool_details
|releases_rss=
|issues_rss=
|mailing_lists=
|ohloh_id=
}}

2014-10-31T12:14:39Z

MediaWiki default:

{{#widget:Ohloh Project
|id={{{ohloh_id}}}
|type=basic_stats
}}
{{#if:{{{releases_rss|}}}|
=== Release Feed ===
<rss max=5>{{{releases_rss}}}</rss>
}}