WCT (Web Curator Tool)

Revision as of 16:38, 26 November 2021 by Prwheatley (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

WCT (Web Curator Tool)
Web Curator Tool (WCT) is a workflow management application for selective web archiving.
Source Code:https://github.com/WebCuratorTool/webcurator
License:Apache License 2.0
Platforms:Apache Tomcat
Function:Metadata Processing,Web Capture
Content type:Web

Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt669cdcac10dd30_65499970


The Web Curator Tool (WCT) is a workflow management application for selective web archiving. WCT allows users to target websites that they wish to include in their collection, create and manage schedules to automatically harvest those sites, and package the collected files to easily submit them to a digital archive.


Developed by the National Library of New Zealand and the British Library, initiated by the International Internet Preservation Consortium. Currently maintained by Oakleigh Consulting Ltd.

Platform and interoperability[edit]

WCT was written in Java and designed to run in Apache Tomcat. It has been tested on Red Hat Linux, Solaris, and (to a lesser extent) Microsoft Windows. Three relational databases are officially supported: Oracle, MySQL and PostgreSQL. The software itself makes use of part or all of several other open-source components, including: Heritrix; Wayback; Acegi Security System; Apache Axis; Apache Commons Logging; Hibernate; Quartz; and Spring Application Framework.

Functional notes[edit]

An important functionality of the software is the ability to collect, store, and abide by harvest authorisations, i.e. permissions to download from the copyright holders. WCT also creates separate administrative levels, so that those who set up the harvests do not necessarily have the authority to have the system actively begin them. All material is captured in ARC format; since WCT incorporates Wayback, access within the system is not a problem. However, those who collect material with the ultimate goal of archiving it in a separate system must take the format into account.

Documentation and user support[edit]

The project site includes a well written quick-start guide and user manual, although the manual includes heading sections missing the corresponding text. The site also includes a developer guide, published with release version 1.5.2. Links to the advertised wiki and FAQ sections are currently broken, forwarding to the sourceforge developer page instead.  More information about the project can be found in an informative article published in Ariadne Issue 50. The primary forum for technical support appears to be an active “webcurator-users” mailing list. While bugs continue to be posted on the SourceForge bug/ feature request tracker, the last addressed item was in February 2011.


WCT is specifically designed to be operated by non-technical users such as librarians, with a simple and relatively intuitive GUI. Installation, however, is difficult and most likely requires tech support.

Expertise required[edit]

Setup, especially if it includes links to an archival repository, requires system administration knowledge. Users must have a comprehensive understanding of their institution’s collections policies when designing harvests.

Standards compliance[edit]

WCT allows users to add basic Dublin Core metadata to the material.

Influence and take-up[edit]

WCT is used by the National Library of New Zealand, the National Library of Norway, and the British Library. The SourceForge site lists nearly 8,300 downloads as of December 2011.

User Experiences[edit]

Development Activity[edit]

No information is available on the current funding status for development, although the SourceForge site’s bugtracker continues to list new entries and responses. WCT encourages developer participation, publishing a Developers Guide with the latest release.

All development activity is visible on GitHub: http://github.com/DIA-NZ/webcurator/commits

Release Feed[edit]

Below the last 3 release feeds:

2020-03-17 15:17:26
[tag:github.com,2008:Repository/38218145/v2.0.2 v2.0.2]
by hannakoppelaar
2019-04-03 20:29:16
[tag:github.com,2008:Repository/38218145/v2.0.1 wct-v2.0 GA]
by obrienben
2018-12-20 09:55:03
[tag:github.com,2008:Repository/38218145/v2.0.0 v2.0.0]
by obrienben

Activity Feed[edit]

Below the last 5 commits:

2020-11-22 20:52:47
[tag:github.com,2008:Grit::Commit/61cb76ce045e1ca6ef64c8be46abac0d00e2da53 Merge pull request #118 from DIA-NZ/feature/117_copy_h1_to_h3_profile…]
by obrienben https://github.com/obrienben
2019-07-26 10:22:29
[tag:github.com,2008:Grit::Commit/87606210df4abf8d2d72a01ea32c1e8d15967a18 Merge pull request #119 from DIA-NZ/docs/add-workshop-tutorials]
by hannakoppelaar https://github.com/hannakoppelaar
2019-07-25 23:01:43
[tag:github.com,2008:Grit::Commit/2a4d3e8834c757f6123565c5c7800e80537fe9dc Tutorial page added to Support section in documentation, with 2019 II…]
by obrienben https://github.com/obrienben
2019-07-23 16:11:42
[tag:github.com,2008:Grit::Commit/da83678ae708dd5970725a06bf6f1dd48254665f #117: Removed superfluous update statements]
by hannakoppelaar https://github.com/hannakoppelaar
2019-07-23 16:02:08
[tag:github.com,2008:Grit::Commit/d3cfc3ed9f60ed2a968d4aa83bb6cc6d69414e7b #117: Copy h1 fields to h3 fields in profile_overrides (MySQL upgrade…]
by hannakoppelaar https://github.com/hannakoppelaar