Difference between revisions of "Linkstat"

From COPTR
Jump to navigation Jump to search
(Add linkstat)
 
(Add example output)
 
Line 14: Line 14:
  
 
Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's [https://web.archive.org/save/ SaveNow] capabilities to enable saving a current snapshot via the command line.
 
Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's [https://web.archive.org/save/ SaveNow] capabilities to enable saving a current snapshot via the command line.
 +
 +
=== Output ===
 +
 +
Given a URL linkstat will output a set of statistics about a page that can be recorded to help maintain information about the state of a link at the time it was received or extracted from documentary heritage to be triaged.
 +
 +
E.g. https://example.com:
 +
 +
<pre>
 +
{
 +
  "AnalysisVersionNumber": "0.0.20",
 +
  "AnalysisVersionText": "exponentialdecay-httpreserve/0.0.20",
 +
  "SimpleRequestVersion": "httpreserve-simplerequest/0.0.4",
 +
  "Link": "http://example.com/",
 +
  "Title": "example domain",
 +
  "ContentType": "text/html",
 +
  "ResponseCode": 200,
 +
  "ResponseText": "OK",
 +
  "SourceURL": "http://example.com/",
 +
  "ScreenShot": "snapshots are not currently enabled",
 +
  "InternetArchiveLinkEarliest": "https://web.archive.org/web/20020120142510/http://example.com/",
 +
  "InternetArchiveEarliestDate": "2002-01-20 14:25:10 +0000 UTC",
 +
  "InternetArchiveLinkLatest": "https://web.archive.org/web/20260712020557/https://example.com/",
 +
  "InternetArchiveLatestDate": "2026-07-12 02:05:57 +0000 UTC",
 +
  "InternetArchiveSaveLink": "https://web.archive.org/save/http://example.com/",
 +
  "InternetArchiveResponseCode": 302,
 +
  "InternetArchiveResponseText": "Found",
 +
  "RobustLinkEarliest": "<a href='https://web.archive.org/web/20020120142510/http://example.com/' data-originalurl='http://example.com/' data-versiondate='2002-01-20'>HTTPreserve Robust Link - simply replace this text!!</a>",
 +
  "RobustLinkLatest": "<a href='https://web.archive.org/web/20260712020557/https://example.com/' data-originalurl='http://example.com/' data-versiondate='2026-07-12'>HTTPreserve Robust Link - simply replace this text!!</a>",
 +
  "PWID": "urn:pwid:archive.org:2026-07-12T02:05:57Z:page:http://example.com/",
 +
  "Archived": true,
 +
  "Error": false,
 +
  "ErrorMessage": "",
 +
  "StatsCreationTime": "1.456610735s"
 +
}
 +
</pre>
 +
 +
The information includes:
 +
 +
* Earliest and latest saves in the Internet Archive
 +
* A URL to save the page in its current state.
 +
* Example [https://github.com/iipc/robustlinks robust links].
 +
* [https://id.kb.dk/pwid/index_UK.html Persistent Web Identifier] (PWID)
 +
 +
The information can also be retrieved via linkstat's sister page [https://httpreserve.info/ httpreserve.info]
  
 
== User Experiences ==
 
== User Experiences ==

Latest revision as of 21:17, 12 July 2026


Save a URL in the Internet Archive (IA) or retrieve earliest and latest statistics via the command line.
Homepage:https://httpreserve.info
Status: Maintained ✅
Source Code:https://github.com/httpreserve/linkstat
License:GPL 3.0
Platforms:Windows, Linux, MacOS
Language:English
Function:Web Capture
Content type:Web

Description

Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's SaveNow capabilities to enable saving a current snapshot via the command line.

Output

Given a URL linkstat will output a set of statistics about a page that can be recorded to help maintain information about the state of a link at the time it was received or extracted from documentary heritage to be triaged.

E.g. https://example.com:

{
   "AnalysisVersionNumber": "0.0.20",
   "AnalysisVersionText": "exponentialdecay-httpreserve/0.0.20",
   "SimpleRequestVersion": "httpreserve-simplerequest/0.0.4",
   "Link": "http://example.com/",
   "Title": "example domain",
   "ContentType": "text/html",
   "ResponseCode": 200,
   "ResponseText": "OK",
   "SourceURL": "http://example.com/",
   "ScreenShot": "snapshots are not currently enabled",
   "InternetArchiveLinkEarliest": "https://web.archive.org/web/20020120142510/http://example.com/",
   "InternetArchiveEarliestDate": "2002-01-20 14:25:10 +0000 UTC",
   "InternetArchiveLinkLatest": "https://web.archive.org/web/20260712020557/https://example.com/",
   "InternetArchiveLatestDate": "2026-07-12 02:05:57 +0000 UTC",
   "InternetArchiveSaveLink": "https://web.archive.org/save/http://example.com/",
   "InternetArchiveResponseCode": 302,
   "InternetArchiveResponseText": "Found",
   "RobustLinkEarliest": "<a href='https://web.archive.org/web/20020120142510/http://example.com/' data-originalurl='http://example.com/' data-versiondate='2002-01-20'>HTTPreserve Robust Link - simply replace this text!!</a>",
   "RobustLinkLatest": "<a href='https://web.archive.org/web/20260712020557/https://example.com/' data-originalurl='http://example.com/' data-versiondate='2026-07-12'>HTTPreserve Robust Link - simply replace this text!!</a>",
   "PWID": "urn:pwid:archive.org:2026-07-12T02:05:57Z:page:http://example.com/",
   "Archived": true,
   "Error": false,
   "ErrorMessage": "",
   "StatsCreationTime": "1.456610735s"
}

The information includes:

The information can also be retrieved via linkstat's sister page httpreserve.info

User Experiences

Development Activity

All development activity is visible on GitHub: https://github.com/httpreserve/linkstat/commits

Release Feed

Below the last 3 release feeds:

2026-07-05 15:43:16
[tag:github.com,2008:Repository/176600526/0.0.8 0.0.8]
by ross-spencer
2026-07-05 15:31:05
[tag:github.com,2008:Repository/176600526/0.0.7 0.0.7]
by ross-spencer
2026-07-03 16:26:07
[tag:github.com,2008:Repository/176600526/0.0.6 0.0.6]
by ross-spencer

Activity Feed

Below the last 5 commits:

2026-07-05 15:50:26
[tag:github.com,2008:Grit::Commit/67a96ca4d52d9521337f4dac44c8b3b232c1d642 Update README]
by ross-spencer https://github.com/ross-spencer
2026-07-05 15:41:45
[tag:github.com,2008:Grit::Commit/c25e5a670cae1972ea9e595c6022ee80d16d69ae Update version number]
by ross-spencer https://github.com/ross-spencer
2026-07-05 15:41:03
[tag:github.com,2008:Grit::Commit/97c1efe15e5ccfd55b6cf53bbaa1c641d2dcea9f Disable screenshot output from results]
by ross-spencer https://github.com/ross-spencer
2026-07-05 15:26:58
[tag:github.com,2008:Grit::Commit/a41ab5b03f993b912830b285f9805a3080bf3ab7 Update version]
by ross-spencer https://github.com/ross-spencer
2026-07-05 15:25:52
[tag:github.com,2008:Grit::Commit/6d146f3c6952ffa158050ed2b9761098d0f2b5b4 Update go.mod and go.sum]
by ross-spencer https://github.com/ross-spencer