The DeDuplicator (Heritrix add-on module)

From COPTR
Revision as of 21:26, 13 November 2013 by COPTR Bot (talk | contribs) (Import from spreadsheet via script.)
Jump to navigation Jump to search
The DeDuplicator is an add-on module for Heritrix to reduce the amount of duplicate data collected in a series of snapshot crawls.
Homepage:http://deduplicator.sourceforge.net/


Description

The DeDuplicator is an add-on module for Heritrix to reduce the amount of duplicate data collected in a series of snapshot crawls.

User Experiences

Development Activity

Error in widget Ohloh Project: unable to write file /var/www/html/extensions/Widgets/compiled_templates/wrt67438978a7e271_32676987


Retrieved from ‘https://coptr.digipres.org/index.php?title=The_DeDuplicator_(Heritrix_add-on_module)&oldid=1317’