WCT (Web Curator Tool)
Description
The Web Curator Tool (WCT) is a workflow management application for selective web archiving. WCT allows users to target websites that they wish to include in their collection, create and manage schedules to automatically harvest those sites, and package the collected files to easily submit them to a digital archive.
Provider
Developed by the National Library of New Zealand and the British Library, initiated by the International Internet Preservation Consortium. Currently maintained by Oakleigh Consulting Ltd.
Licensing and cost
Apache License – free.
Development activity
No information is available on the current funding status for development, although the SourceForge site’s bugtracker continues to list new entries and responses. WCT encourages developer participation, publishing a Developers Guide with the latest release.
Platform and interoperability
WCT was written in Java and designed to run in Apache Tomcat. It has been tested on Red Hat Linux, Solaris, and (to a lesser extent) Microsoft Windows. Three relational databases are officially supported: Oracle, MySQL and PostgreSQL. The software itself makes use of part or all of several other open-source components, including: Heritrix; Wayback; Acegi Security System; Apache Axis; Apache Commons Logging; Hibernate; Quartz; and Spring Application Framework.
Functional notes
An important functionality of the software is the ability to collect, store, and abide by harvest authorisations, i.e. permissions to download from the copyright holders. WCT also creates separate administrative levels, so that those who set up the harvests do not necessarily have the authority to have the system actively begin them. All material is captured in ARC format; since WCT incorporates Wayback, access within the system is not a problem. However, those who collect material with the ultimate goal of archiving it in a separate system must take the format into account.
Documentation and user support
The project site includes a well written quick-start guide and user manual, although the manual includes heading sections missing the corresponding text. The site also includes a developer guide, published with release version 1.5.2. Links to the advertised wiki and FAQ sections are currently broken, forwarding to the sourceforge developer page instead. More information about the project can be found in an informative article published in Ariadne Issue 50. The primary forum for technical support appears to be an active “webcurator-users” mailing list. While bugs continue to be posted on the SourceForge bug/ feature request tracker, the last addressed item was in February 2011.
Usability
WCT is specifically designed to be operated by non-technical users such as librarians, with a simple and relatively intuitive GUI. Installation, however, is difficult and most likely requires tech support.
Expertise required
Setup, especially if it includes links to an archival repository, requires system administration knowledge. Users must have a comprehensive understanding of their institution’s collections policies when designing harvests.
Standards compliance
WCT allows users to add basic Dublin Core metadata to the material.
Influence and take-up
WCT is used by the National Library of New Zealand, the National Library of Norway, and the British Library. The SourceForge site lists nearly 8,300 downloads as of December 2011.
User Experiences
Development Activity
All development activity is visible on GitHub: http://github.com/DIA-NZ/webcurator/commits
Release Feed
Below the last 3 release feeds:
- 2020-03-17 15:17:26
- [tag:github.com,2008:Repository/38218145/v2.0.2 v2.0.2]
- by hannakoppelaar
- 2019-04-03 20:29:16
- [tag:github.com,2008:Repository/38218145/v2.0.1 wct-v2.0 GA]
- by obrienben
- 2018-12-20 09:55:03
- [tag:github.com,2008:Repository/38218145/v2.0.0 v2.0.0]
- by obrienben
Activity Feed
Below the last 5 commits:
- 2020-11-22 20:52:47
- [tag:github.com,2008:Grit::Commit/61cb76ce045e1ca6ef64c8be46abac0d00e2da53 Merge pull request #118 from DIA-NZ/feature/117_copy_h1_to_h3_profile…]
- by obrienben https://github.com/obrienben
- 2019-07-26 10:22:29
- [tag:github.com,2008:Grit::Commit/87606210df4abf8d2d72a01ea32c1e8d15967a18 Merge pull request #119 from DIA-NZ/docs/add-workshop-tutorials]
- by hannakoppelaar https://github.com/hannakoppelaar
- 2019-07-25 23:01:43
- [tag:github.com,2008:Grit::Commit/2a4d3e8834c757f6123565c5c7800e80537fe9dc Tutorial page added to Support section in documentation, with 2019 II…]
- by obrienben https://github.com/obrienben
- 2019-07-23 16:11:42
- [tag:github.com,2008:Grit::Commit/da83678ae708dd5970725a06bf6f1dd48254665f #117: Removed superfluous update statements]
- by hannakoppelaar https://github.com/hannakoppelaar
- 2019-07-23 16:02:08
- [tag:github.com,2008:Grit::Commit/d3cfc3ed9f60ed2a968d4aa83bb6cc6d69414e7b #117: Copy h1 fields to h3 fields in profile_overrides (MySQL upgrade…]
- by hannakoppelaar https://github.com/hannakoppelaar
Mailing List(s)
See here for more information.
Issues Feed
Failed to load RSS feed from https://sourceforge.net/p/webcurator/legacy-bugs/feed.rss: There was a problem during the HTTP request: 404 Not Found