Web Archive Discovery

From COPTR
Jump to: navigation, search



Indexing and discovery tools for web archives.
Homepage:https://github.com/ukwa/webarchive-discovery
License:Mixed
Platforms:Java

[edit] Description

Full-text indexing system, using Apache Solr as the search back-end. Supports command-line and large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.

[edit] User Experiences

  • Used by the UK Web Archive to provide access to their collections. More details TBA.

[edit] Development Activity


Contributors

Andy Jackson (100.0%)