DROID Siegfried Sqlite Analysis Engine - Revision history

Ross-spencer: Updated summary information and introduction

2022-01-21T11:54:23Z

Updated summary information and introduction

Ross-spencer: Update Github link

2022-01-21T11:51:05Z

Update Github link

Ross-spencer: /* Activity Feed */

2021-06-14T16:51:15Z

Activity Feed

Rcdeboer: Added links to Function and/or Content Type

2021-04-20T19:54:27Z

Added links to Function and/or Content Type

Ross-spencer: Corrected URLS

2018-06-09T17:36:25Z

Corrected URLS

Ross-spencer: Ross-spencer moved page DROID sqlite analysis to DROID Siegfried Sqlite Analysis Engine: Title changed to reflect tool's capabilities.

2017-05-12T03:53:00Z

Ross-spencer moved page DROID sqlite analysis to DROID Siegfried Sqlite Analysis Engine: Title changed to reflect tool's capabilities.

Ross-spencer: Changing repository location,

2017-05-12T03:51:52Z

Changing repository location,

Chlara: Development Activity

2016-07-12T06:49:59Z

Development Activity

Ross-spencer: Added more detailed information about the tool's capabilities.

2016-06-13T03:14:07Z

Added more detailed information about the tool's capabilities.

Prwheatley at 12:59, 3 June 2014

2014-06-03T12:59:54Z

@@ Line 1: / Line 1: @@
 {{Infobox tool
-|purpose=Analysis and automatic generation of summary information from DROID output
+|purpose=Format Identification Analysis and Reporting
 |homepage=https://github.com/exponential-decay/demystify
 |license=Open source (see URL above)
@@ Line 9: / Line 9: @@
 == Description ==
 <!-- Describe the what the tool does, focusing on it's digital preservation value. Keep it factual. -->
-Engine for analysis of [https://github.com/digital-preservation/droid DROID] CSV export files, [https://github.com/richardlehane/siegfried Siegfried] YAML export files, and Siegfried 'DROID compatible' output. The tool has three purposes, break the exports into their components and store them within a table in a SQLite database; create additional columns to augment the output where useful; and query the SQLite database, outputting results in a readable form useful for analysis by researchers and archivists within digital preservation departments in memory institutions.
+Now known as "Demystify" with thanks to Joshua Ng for the suggestion to rename it. Demystify is an engine for the analysis of [https://github.com/digital-preservation/droid DROID] CSV export files, [https://github.com/richardlehane/siegfried Siegfried] YAML export files, and Siegfried 'DROID compatible' output. The tool has three purposes, break the exports into their components and store them within a table in a SQLite database; create additional columns to augment the output where useful; and query the SQLite database, outputting results in a readable form useful for analysis by researchers and archivists within digital preservation departments in memory institutions.
-The tool provides archivist definitions for each of the sections output; these definitions are customisable. The tool also supports output of statistics about files that may require further triage or may not be appropriate for long-term preservation based on institutional rules, in the form of a blacklist. The tool also analyses file names and directory names for non-ascii characters, and also characteristics that may present problems cross-file-system based on known Microsoft rules: http://msdn.microsoft.com/en-us/library/aa365247(VS.85).aspx
+The tool provides archivist definitions for each of the sections output; these definitions are customizable. The tool also supports output of statistics about files that may require further triage or may not be appropriate for long-term preservation based on institutional rules, in the form of a blacklist. The tool also analyses file names and directory names for non-ascii characters, and also characteristics that may present problems cross-file-system based on known Microsoft rules: http://msdn.microsoft.com/en-us/library/aa365247(VS.85).aspx
 The engine can be used to generate a list of file paths for files that may present digital preservation risks (Rogues) or files which on the surface i.e. via identification alone, look okay (Heroes) and these listings can be used in conjunction with [http://manpages.ubuntu.com/manpages/trusty/man1/rsync.1.html rsync] to isolate these sets from one-another to be more flexible to work with.

@@ Line 1: / Line 1: @@
 {{Infobox tool
 |purpose=Analysis and automatic generation of summary information from DROID output
-|homepage=https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine
+|homepage=https://github.com/exponential-decay/demystify
 |license=Open source (see URL above)
 |platforms=sqlite + Python + text/html

@@ Line 33: / Line 33: @@
 === Activity Feed ===
 Below the last 5 commits:
-<rss max=5>https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine/commits/master.atom</rss>
+<rss max=5>https://github.com/exponential-decay/demystify/commits/main.atom</rss>
 <!-- Add the Ohloh.com ID for the tool, if known. -->

@@ Line 1: / Line 1: @@
-<!-- Use the structure provided in this template, do not change it! -->
+{{Infobox tool
 |purpose=Analysis and automatic generation of summary information from DROID output
 |homepage=https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine
 |license=Open source (see URL above)
 |platforms=sqlite + Python + text/html
 }}
+{{Infobox tool details}}
 == Description ==
 <!-- Describe the what the tool does, focusing on it's digital preservation value. Keep it factual. -->
@@ Line 45: / Line 36: @@
 <!-- Add the Ohloh.com ID for the tool, if known. -->

@@ Line 38: / Line 38: @@
 === Release Feed ===
 Below the last 3 release feeds:
-<rss max=3>https://github.com/ross-spencer/droid-sqlite-analysis/releases.atom</rss>
+<rss max=3>https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine/releases.atom</rss>
 === Activity Feed ===
 Below the last 5 commits:
-<rss max=5>https://github.com/ross-spencer/droid-sqlite-analysis/commits/master.atom</rss>
+<rss max=5>https://github.com/exponential-decay/droid-siegfried-sqlite-analysis-engine/commits/master.atom</rss>
 <!-- Add the Ohloh.com ID for the tool, if known. -->

@@ Line 26: / Line 26: @@
 == User Experiences ==
 <!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. -->
-Blog entries from the tool author, Ross Spencer:
+*Blog entries from the tool author, Ross Spencer:
-*'''[2014-06-03]''' [http://www.openplanetsfoundation.org/blogs/2014-06-03-analysis-engine-droid-csv-export Describing the creation and purpose of the tool.]
+**'''[2014-06-03]''' [http://www.openplanetsfoundation.org/blogs/2014-06-03-analysis-engine-droid-csv-export Describing the creation and purpose of the tool.]
-*'''[2015-08-25]''' [http://openpreservation.org/blog/2015/08/25/hero-or-villain-a-tool-to-create-a-digital-preservation-rogues-gallery/ Using the output of the tool to create a digital preservation rogues gallery.]
+**'''[2015-08-25]''' [http://openpreservation.org/blog/2015/08/25/hero-or-villain-a-tool-to-create-a-digital-preservation-rogues-gallery/ Using the output of the tool to create a digital preservation rogues gallery.]
-*'''[2016-05-23]''' [http://openpreservation.org/blog/2016/05/23/whats-in-a-namespace-the-marriage-of-droid-and-siegfried-analysis/ The integration of Siegfried output for consistent and repeatable reporting.]
+**'''[2016-05-23]''' [http://openpreservation.org/blog/2016/05/23/whats-in-a-namespace-the-marriage-of-droid-and-siegfried-analysis/ The integration of Siegfried output for consistent and repeatable reporting.]
-*'''[2016-05-24]''' [http://openpreservation.org/blog/2016/05/24/while-were-on-the-subject-a-few-more-points-of-interest-about-the-siegfrieddroid-analysis-tool/ Creating a multi-lingual consistent, digital preservation dialect and exploring alternative methods of format identification using Siegfried's capabilities.]
+**'''[2016-05-24]''' [http://openpreservation.org/blog/2016/05/24/while-were-on-the-subject-a-few-more-points-of-interest-about-the-siegfrieddroid-analysis-tool/ Creating a multi-lingual consistent, digital preservation dialect and exploring alternative methods of format identification using Siegfried's capabilities.]
-== Development Activity ==
+= Development Activity =
 <!-- Provide *evidence* of development activity of the tool. For example, RSS feeds for code issues or commits. -->
-<rss max=7>https://github.com/ross-spencer/droid-sqlite-analysis/commits/master.atom</rss>
+All development activity is visible on GitHub: http://github.com/ross-spencer/droid-sqlite-analysis/commits
-−
 <!-- Add the Ohloh.com ID for the tool, if known. -->
 {{Infobox_tool_details
 |ohloh_id=
 }}