Web Archive Discovery
Revision as of 14:16, 24 September 2018 by MediaWiki default (talk | contribs) (Added activity feeds.)
Description
Full-text indexing system, using Apache Solr as the search back-end. Supports command-line or large-scale map-reduce (Hadoop) processing of ARC and WARC files. Also integrates file format analysis and scans for some known preservation risks.
User Experiences
- Used by the UK Web Archive to provide access to their collections. More details TBA.
Development Activity
All development activity is visible on GitHub: http://github.com/ukwa/webarchive-discovery
There is also a #webarchive-discovery channel on the IIPC Slack service. Contact https://twitter.com/NetPreserve for details.
Release Feed
Below the last 3 release feeds:
- 2024-04-02 09:25:58
- [tag:github.com,2008:Repository/7257232/warc-discovery-3.3.1 Revert of source_file_path]
- by GilHoggarth
- 2023-06-02 11:04:22
- [tag:github.com,2008:Repository/7257232/warc-discovery-3.3.0 warc-discovery-3.3.0]
- by anjackson
- 2020-11-27 12:25:29
- [tag:github.com,2008:Repository/7257232/warc-discovery-3.1.0 warc-discovery-3.1.0]
- by anjackson
Activity Feed
Below the last 5 commits:
- 2025-11-21 19:20:54
- [tag:github.com,2008:Grit::Commit/2eb4f08257d31f64faab7d5a4e8f19bad5ca1fdf Moved .github/workflows to was.github/workflows to disable incurring …]
- by GilHoggarth https://github.com/GilHoggarth
- 2025-07-24 10:32:36
- [tag:github.com,2008:Grit::Commit/d398e1f90ebc1f95a0a01a2bf5235b30a6efd47d Added warc-indexer announcement, redirection]
- by GilHoggarth https://github.com/GilHoggarth
- 2025-07-01 15:28:19
- [tag:github.com,2008:Grit::Commit/229eac3df79527ae359112f8bbd5f11ab4406dbf Merge pull request #321 from inonwir/patch-1]
- by GilHoggarth https://github.com/GilHoggarth
- 2025-06-25 07:41:18
- [tag:github.com,2008:Grit::Commit/5bb7c38c53270aa7ca5ad8e90f3d736020caf0fa Update CallableTest.java]
- by inonwir https://github.com/inonwir
- 2025-03-11 12:48:48
- [tag:github.com,2008:Grit::Commit/4898ed804b3edaa3bdff84f46b2d1d3b71325660 Merge pull request #320 from bnfleb/issue-319]
- by GilHoggarth https://github.com/GilHoggarth