Difference between revisions of "Linkstat"
Ross-spencer (talk | contribs) (Add linkstat) |
Ross-spencer (talk | contribs) (Add example output) |
||
| Line 14: | Line 14: | ||
Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's [https://web.archive.org/save/ SaveNow] capabilities to enable saving a current snapshot via the command line. | Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's [https://web.archive.org/save/ SaveNow] capabilities to enable saving a current snapshot via the command line. | ||
| + | |||
| + | === Output === | ||
| + | |||
| + | Given a URL linkstat will output a set of statistics about a page that can be recorded to help maintain information about the state of a link at the time it was received or extracted from documentary heritage to be triaged. | ||
| + | |||
| + | E.g. https://example.com: | ||
| + | |||
| + | <pre> | ||
| + | { | ||
| + | "AnalysisVersionNumber": "0.0.20", | ||
| + | "AnalysisVersionText": "exponentialdecay-httpreserve/0.0.20", | ||
| + | "SimpleRequestVersion": "httpreserve-simplerequest/0.0.4", | ||
| + | "Link": "http://example.com/", | ||
| + | "Title": "example domain", | ||
| + | "ContentType": "text/html", | ||
| + | "ResponseCode": 200, | ||
| + | "ResponseText": "OK", | ||
| + | "SourceURL": "http://example.com/", | ||
| + | "ScreenShot": "snapshots are not currently enabled", | ||
| + | "InternetArchiveLinkEarliest": "https://web.archive.org/web/20020120142510/http://example.com/", | ||
| + | "InternetArchiveEarliestDate": "2002-01-20 14:25:10 +0000 UTC", | ||
| + | "InternetArchiveLinkLatest": "https://web.archive.org/web/20260712020557/https://example.com/", | ||
| + | "InternetArchiveLatestDate": "2026-07-12 02:05:57 +0000 UTC", | ||
| + | "InternetArchiveSaveLink": "https://web.archive.org/save/http://example.com/", | ||
| + | "InternetArchiveResponseCode": 302, | ||
| + | "InternetArchiveResponseText": "Found", | ||
| + | "RobustLinkEarliest": "<a href='https://web.archive.org/web/20020120142510/http://example.com/' data-originalurl='http://example.com/' data-versiondate='2002-01-20'>HTTPreserve Robust Link - simply replace this text!!</a>", | ||
| + | "RobustLinkLatest": "<a href='https://web.archive.org/web/20260712020557/https://example.com/' data-originalurl='http://example.com/' data-versiondate='2026-07-12'>HTTPreserve Robust Link - simply replace this text!!</a>", | ||
| + | "PWID": "urn:pwid:archive.org:2026-07-12T02:05:57Z:page:http://example.com/", | ||
| + | "Archived": true, | ||
| + | "Error": false, | ||
| + | "ErrorMessage": "", | ||
| + | "StatsCreationTime": "1.456610735s" | ||
| + | } | ||
| + | </pre> | ||
| + | |||
| + | The information includes: | ||
| + | |||
| + | * Earliest and latest saves in the Internet Archive | ||
| + | * A URL to save the page in its current state. | ||
| + | * Example [https://github.com/iipc/robustlinks robust links]. | ||
| + | * [https://id.kb.dk/pwid/index_UK.html Persistent Web Identifier] (PWID) | ||
| + | |||
| + | The information can also be retrieved via linkstat's sister page [https://httpreserve.info/ httpreserve.info] | ||
== User Experiences == | == User Experiences == | ||
Latest revision as of 21:17, 12 July 2026
Description
Retrieve Internet Archive (IA) statistics about URLs found in documentary heritage collections. Returns earliest and latest links and provides a wrapper to the IA's SaveNow capabilities to enable saving a current snapshot via the command line.
Output
Given a URL linkstat will output a set of statistics about a page that can be recorded to help maintain information about the state of a link at the time it was received or extracted from documentary heritage to be triaged.
E.g. https://example.com:
{
"AnalysisVersionNumber": "0.0.20",
"AnalysisVersionText": "exponentialdecay-httpreserve/0.0.20",
"SimpleRequestVersion": "httpreserve-simplerequest/0.0.4",
"Link": "http://example.com/",
"Title": "example domain",
"ContentType": "text/html",
"ResponseCode": 200,
"ResponseText": "OK",
"SourceURL": "http://example.com/",
"ScreenShot": "snapshots are not currently enabled",
"InternetArchiveLinkEarliest": "https://web.archive.org/web/20020120142510/http://example.com/",
"InternetArchiveEarliestDate": "2002-01-20 14:25:10 +0000 UTC",
"InternetArchiveLinkLatest": "https://web.archive.org/web/20260712020557/https://example.com/",
"InternetArchiveLatestDate": "2026-07-12 02:05:57 +0000 UTC",
"InternetArchiveSaveLink": "https://web.archive.org/save/http://example.com/",
"InternetArchiveResponseCode": 302,
"InternetArchiveResponseText": "Found",
"RobustLinkEarliest": "<a href='https://web.archive.org/web/20020120142510/http://example.com/' data-originalurl='http://example.com/' data-versiondate='2002-01-20'>HTTPreserve Robust Link - simply replace this text!!</a>",
"RobustLinkLatest": "<a href='https://web.archive.org/web/20260712020557/https://example.com/' data-originalurl='http://example.com/' data-versiondate='2026-07-12'>HTTPreserve Robust Link - simply replace this text!!</a>",
"PWID": "urn:pwid:archive.org:2026-07-12T02:05:57Z:page:http://example.com/",
"Archived": true,
"Error": false,
"ErrorMessage": "",
"StatsCreationTime": "1.456610735s"
}
The information includes:
- Earliest and latest saves in the Internet Archive
- A URL to save the page in its current state.
- Example robust links.
- Persistent Web Identifier (PWID)
The information can also be retrieved via linkstat's sister page httpreserve.info
User Experiences
- Shortened Links? Expand them and save the URLs
- Links all the way down - HTTPreservation of documentary heritage
Development Activity
All development activity is visible on GitHub: https://github.com/httpreserve/linkstat/commits
Release Feed
Below the last 3 release feeds:
- 2026-07-05 15:43:16
- [tag:github.com,2008:Repository/176600526/0.0.8 0.0.8]
- by ross-spencer
- 2026-07-05 15:31:05
- [tag:github.com,2008:Repository/176600526/0.0.7 0.0.7]
- by ross-spencer
- 2026-07-03 16:26:07
- [tag:github.com,2008:Repository/176600526/0.0.6 0.0.6]
- by ross-spencer
Activity Feed
Below the last 5 commits:
- 2026-07-05 15:50:26
- [tag:github.com,2008:Grit::Commit/67a96ca4d52d9521337f4dac44c8b3b232c1d642 Update README]
- by ross-spencer https://github.com/ross-spencer
- 2026-07-05 15:41:45
- [tag:github.com,2008:Grit::Commit/c25e5a670cae1972ea9e595c6022ee80d16d69ae Update version number]
- by ross-spencer https://github.com/ross-spencer
- 2026-07-05 15:41:03
- [tag:github.com,2008:Grit::Commit/97c1efe15e5ccfd55b6cf53bbaa1c641d2dcea9f Disable screenshot output from results]
- by ross-spencer https://github.com/ross-spencer
- 2026-07-05 15:26:58
- [tag:github.com,2008:Grit::Commit/a41ab5b03f993b912830b285f9805a3080bf3ab7 Update version]
- by ross-spencer https://github.com/ross-spencer
- 2026-07-05 15:25:52
- [tag:github.com,2008:Grit::Commit/6d146f3c6952ffa158050ed2b9761098d0f2b5b4 Update go.mod and go.sum]
- by ross-spencer https://github.com/ross-spencer