Difference between revisions of "Store"

From COPTR
Jump to navigation Jump to search
(Created page with "{{Infobox stage |definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards." }}")
 
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
 
{{Infobox stage
 
{{Infobox stage
 
|definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards."
 
|definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards."
 +
|order=6
 
}}
 
}}

Latest revision as of 10:14, 9 June 2021

Lifecycle stage definition: Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards."
Lifecycle order: 6

Functions within this lifecycle stage

FuntionDefinition
Active Data StorageTools that support the storage, management, and ultimately the preservation, of evolving research data.
BackupTools that support the backing up of digital data to another storage location, typically in a scheduled manner.
File ManagementTools that support general file management activities such as viewing or renaming
FixityTools that support the verification of file fixity, typically through the generation and validation of checksum based manifests.
Managing Active Research DataTools that enable researchers to manage data from its point of creation, facilitating its productive use in the present, but also establishing the support structures necessary to ensure its future survival.
Passive Data StorageTools that support the passive preservation of digital resources on storage media such as paper, film or DNA.
Persistent IdentificationTools that support the unique and persistent identification of files or intellectual entities.
StorageTools that support the storage of digital resources, possibly in multiple locations to avoid loss of data due to hardware or other failures.

Tools for this lifecycle stage

ToolFunctionPurpose
7-ZipFixity
Rendering
Transfer
7-Zip is a file archiver with a high compression ratio, and encryption and fixity check capabilities
ACE (Audit Control Environment)FixityThe Auditing Control Environment is a mature set of software designed to help libraries and archives prove their holdings are intact and trustworthy.
ADIGRESAccess
File Management
Storage
ADIGRES is a powerful cross-platform Document Management System written in Java.
ALTAG3DFile Management
Metadata Extraction
Personal Archiving
Storage
An open source archive software
ARK plugin for OmekaPersistent IdentificationGenerating and resolving ARK identifiers for resources in Omeka
AVP FixityFixityFixity monitoring for digital collections
Aaru Data Preservation SuiteBackup
Disk Imaging
Metadata Extraction
Media dump software and disc image manager
Advanced RenamerFile ManagementAdvanced Renamer is a program for renaming multiple files and folders at once. By configuring renaming methods the names can be manipulated in various ways.
Amazon CloudStorage
Service
Amazon Cloud is an internet-based storage location designed to hold files indefinitely.
ArchiFiltreFile Management
Appraisal
Overview of folder trees with fine diagrams
Archive::BagItFixity
File Copy
BagIt API for Perl
Ark servicePersistent IdentificationARK identifiers generator in python
AudacityFile Management
Personal Archiving
Redaction
The open source audio editor
AudiAnnotateAcademic Social Networking
Access
Annotation
Discovery
Managing Active Research Data
Metadata Processing
Persistent Identification
Personal Archiving
Preservation System
Rendering
Version Control
Workflow
Service
To make audio and its interpretations more discoverable and usable by extending the use of the newest IIIF (International Image Interoperability Framework) standard for audio with the development of the AudiAnnotate web application, documented workflows and workshops that will facilitate the use of existing best-of-breed, open source tools for audio annotation (Sonic Visualiser), for public code and document repositories (GitHub), and audio presentation (Universal Viewer) to produce, publish, and sustain shareable W3C Web Annotations for individual and collaborative audio projects.
AvccFile ManagementAVCC is an open source application that enables collaborative, efficient item-level cataloging of audiovisual collections.
BAT: BnfArcToolsFile ManagementBAT is a Perl package for processing Internet Archive ARC, DAT and CDX file format.
BIL (BagIt Library)Fixity
File Copy
BagIt Library is a Java software library that supports the creation, manipulation and validation of bags.
BagIt Transfer UtilitiesFixity
File Copy
BagIt transfer Utilities are a collection of tools developed for the purpose of validation and transfer of bags.
BaggerFixity
Transfer
GUI application to facilitate the creation and verification of BagIt bags.
BitCuratorFixity
Validation
File Management
Metadata Extraction
Metadata Processing
Quality Assurance
Workflow
The BitCurator Environment is an Ubuntu Linux distribution geared to the needs of archivists and librarians. It includes a suite of open source digital forensics and data analysis tools to help collecting institutions process born-digital materials.
Bulk Rename UtilityFile ManagementBulk Rename Utility is a free file renaming software for Windows. Bulk Rename Utility allows you to easily rename files and entire folders based upon extremely flexible criteria.
CASTOR (CERN Advanced STORage manager)StorageCASTOR, which stands for the CERN Advanced STORage manager, is a hierarchical storage management (HSM) system developed at CERN used to store physics production files and user files.
CND3DActive Data Storage
Data capture and Deposit
Managing Active Research Data
Storage
Store, Preserve and publish 3D objects produced in Digital Humanities Research
CRunchManaging Active Research Data
Workflow and Lab Notebook Management
cRunch provides an infrastructure for exploratory data analysis with the statistical programming language and environment R
CarboniteBackup
Storage
Service
an online backup service that automatically backs up documents, e-mails, music, photos, and settings. Info gathered early March 2013.
Checksum (by Corz)FixityFast hashing tool using a GUI interface
ChronopolisBackup
Storage
Service
"Chronopolis digital preservation network provides services for the long-term preservation and curation of America's digital holdings"
Cksum Unix commandFixitycksum computes a cyclic redundancy check (CRC) checksum for each given file, or standard input if none are given
CyberChefBinary & Hexidecimal Editing
Decryption
Discovery
Encryption Detection
File Management
Metadata Extraction
Personal Archiving
A forensic tool with workflow capabilities to analyse files and containers
CzkawkaDe-Duplication
File Management
Appraisal
Czkawka is a simple, fast and free app to remove unnecessary files from your computer.
D-Net Software KitData Management Planning
Managing Active Research Data
Planning
Software Kit creates a network of repositories that share the infrastructure services necessary to process and provide access to digital content.
DART (Digital Archivist's Resource Tool)Fixity
File Management
Storage
Transfer
Provides both a GUI and a command-line interface for packaging files and uploading them to remote repositories.
DCape (ingest only)Preservation System
Storage
"The goal of the DCAPE project is to build a distributed production preservation environment that meets the needs of archival repositories for trusted archival preservation services." (Note: This is a work in progress, see notes for more information)
DIMAGAccess
File Format Migration
Metadata Extraction
Preservation System
Storage
Workflow
A software suite supporting archives with preservation of digital information for eternity
DMPToolData Management Planning
Managing Active Research Data
Planning
DMPTool is an online service to enable researchers to create data management plans now required by many funding agencies, and to receive tailored institutional guidance to help them in the process.
DMPonlineData Management Planning
Managing Active Research Data
Planning
Service
DMPonline is the DCC's data management planning tool.
Data VaultBackup
Managing Active Research Data
Storage
A storage broker and front end for archiving research data that is no longer active but that does not have a need for open publication
DataCiteCitation and Impact Tracking
Managing Active Research Data
Persistent Identification
DataCite works with data centres to assign persistent identifiers to datasets using the Digital Object Identifier (DOI) infrastructure.
DataFlowManaging Active Research Data
Storage
DataFlow is a two-stage data management infrastructure that is designed to allow researchers to work with, annotate, publish, and permanently store research data.
DataStageActive Data Storage
Managing Active Research Data
DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility.
DataverseActive Data Storage
Managing Active Research Data
Preservation System
Storage
The Dataverse is an open source web application to share, preserve, cite, explore and analyze research data.
DcflddFile Copy
File Management
Forensic
dcfldd is an enhanced version of GNU dd with features useful for forensics and security.
DetoxFile ManagementThe detox utility renames files to make them easier to work with under Unix and Unix-like operating systems.
DiPS (Digital Preservation Solution)Secure Deletion
Access
Active Data Storage
Validation
File Format Identification
File Format Migration
File Management
Metadata Extraction
Preservation System
Storage
Transfer
Workflow
Service
DiPS (OAIS compliant Digital Preservation Solution)
Directory List & PrintFile Management
Metadata Extraction
A universal metadata extractor
Disk2FDIBackup
Disk Imaging
Forensic
Personal Archiving
Disk2FDI is a professional disk imaging software designed to create binary images of floppy disks to the Formatted Disk Image (FDI) file format, as well as sector-based standard formats.
DiskViewFile ManagementDiskView shows you a graphical map of your disk, allowing you to determine where a file is located or, by clicking on a cluster, seeing which file occupies it.
Docuteam cosmosFile Format Migration
Preservation System
Storage
Workflow
Service
docuteam cosmos is a comprehensive, modular software solution for the operation of digital long-term archives based on the OAIS standard (Open Archival Information System, ISO 14721:2012).
Docuteam packerFixity
Data capture and Deposit
File Management
Metadata Processing
Appraisal
Creates and edits SIPs
Double CommanderFixity
De-Duplication
File Copy
File Management
Batch Rename
Open source file manager with two panels side by side
DropboxBackup
Storage
Service
Dropbox is a free service that lets you bring all your photos, docs, and videos anywhere. This means that any file you save to your Dropbox will automatically save to all your computers, phones and even the Dropbox website. Dropbox also makes it super easy to share with others, whether you're a student or professional, parent or grandparent. Even if you accidentally spill a latte on your laptop, have no fear! You can relax knowing that Dropbox always has you covered, and none of your stuff will ever be lost.
EZARKPersistent IdentificationARK identifiers management tool and sub-publishers registry
EZIDPersistent IdentificationEZID (easy-eye-dee) makes it easy to create and manage unique, persistent identifiers.
EmailchemyDe-Duplication
File Format Migration
File Management
File Recovery
Converts proprietary emails to standard portable formats
ExactFileFixityMaking sure that what you hash is what you get
Explore2fsFile ManagementExplore2fs is a GUI explorer tool for accessing ext2 and ext3 filesystems.
FCIVFixity
Transfer
Generates and compares MD5 values stored in an XML file.
File Analyzer and Metadata Harvester V2Fixity
Validation
File Management
Metadata Extraction
Metadata Processing
Quality Assurance
Workflow
The File Analyzer is a general purpose desktop (and command line) tool designed to automate simple, file-based operations. The File Analyzer assembles a toolkit of tasks a user can perform. The tasks that have been written into the File Analyzer code base have been optimized for use by libraries, archives, and other cultural heritage institutions.
FileVerifier++Fixity
De-Duplication
Windows utility for verifying file contents
FixiFixityFixi is a command-line utility that indexes, verifies, and updates checksum information for collections of files.
Fixity ProFixityFixity Pro is a desktop application for Windows and Mac that provides simple automated monitoring and reporting on the data integrity of your files that are stored on your computer, removable storage devices, and mounted network storage locations. Use Fixity Pro to schedule routine scans that will tell you if your files have been changed and if any files have been added, removed, or moved/renamed since the last scan that was performed.
Free Video Cutter JoinerFile Management
Personal Archiving
Redaction
It cuts and joins video streams without altering the codecs.
FreeCommanderFixity
De-Duplication
File Copy
File Management
Split-screen file manager with desirable extras
FslintDe-Duplication
File Management
Set of utilities to find and clean various forms of lint on a filesystem, such as duplicate files, empty directories, and bad file names.
Glacier (Amazon)Backup
Storage
Amazon Glacier is a secure, durable, and extremely low-cost cloud storage service for data archiving and long-term backup.
Google CloudStorageGoogle Cloud Storage allows users to store, access, and manage their data.
GreensPersistent IdentificationARK identifiers minter and resolver
HopplaPreservation System
Storage
Hoppla is an archiving solution that combines back-up and fully automated migration services for data collections in small office environments.
IRODS (integrated Rule Oriented Data Systems)StorageiRODS software was designed to allow curators utilising heterogeneous storage and computing facilities to define policies without being concerned with the technical detail of how the system implements those policies and without having to respond to changes in technical infrastructure.
IngestrBackup
File Format Migration
ingestr is a command-line application that allows ingesting or copying data from any source into any destination database.
Java library implementing PairtreeDe-Duplication
File Management
The PAIRTREE LIBRARY is a software library that supports the mapping between identifiers and filepaths according to the Pairtree Specification.
KeplerManaging Active Research Data
Workflow and Lab Notebook Management
Kepler is a scientific workflow modelling and management system that enables users, regardless of programming experience, to set up data analysis pipelines.
LOCKSS (Lots of Copies Keep Stuff Safe)Access
Preservation System
Storage
LOCKSS software allows libraries to create preserved digital collections out of materials that would otherwise be accessible only through a licensed academic subscription.
LabTroveManaging Active Research Data
Workflow and Lab Notebook Management
LabTrove is a blogging platform specifically designed for use in a research environment.
Legacy LockerStorageLegacy Locker is a safe, secure repository for your vital digital property that lets you grant access to online assets for friends and loved ones in the event of loss, death, or disability.
Library (xklb)File Management
Quality Assurance
Web Capture
Media indexing multi-tool with more than 70 CLI subcommands
MD5CheckerFixityLightweight Windows Desktop application to create and check MD5 Digests for one or several files.
MailStore HomeDiscovery
File Management
Metadata Extraction
Metadata Processing
Unifies your private emails into one searchable, platform-independent repository
MakeStaticSiteWeb Capture
Personal Archiving
Data capture and Deposit
Managing Active Research Data
Rendering
MakeStaticSite is a command-line tool for generating and deploying refined static versions of both existing websites — typically dynamic, i.e. depend on server-side scripting and databases — and sites archived by the Wayback Machine.
Md5deep and hashdeepFixitymd5deep is a set of programs to compute MD5, SHA-1, SHA-256, Tiger, or Whirlpool message digests on an arbitrary number of files. hashdeep is a program to compute, match, and audit hashsets.
Md5sum Unix commandFixitymd5sum computes a 128-bit checksum (or fingerprint or message-digest) for each specified file.
Md5summerFixityMD5summer is an application for Microsoft Windows 9x, NT, ME, 2000 and XP which generates and verifies md5 checksums.
Mets-bag-checkerFixity
Validation
METS Bag checker is a simple python tool to check the validity of METS Information Packages (XML validity, completeness, Data Objects fixity, absence of unreferenced files).
Micr'OlonysAccess
Backup
File Recovery
Storage
Transfer
Passive Data Storage
Micr’Olonys is the software solution for long-term passive digital archiving on film and paper.
Minimum Preservation ToolFixity
Preservation System
The Minimum Preservation Tool (MPT) can be used to create an interim preservation storage environment for files awaiting preservation in a longer term repository solution. It supports checksum generation, fixity checking, and replication across two or more storage nodes.
MyExperimentAcademic Social Networking
Managing Active Research Data
Workflow
Workflow and Lab Notebook Management
myExperiment is an online social networking service aimed at scientific researchers; the site fosters collaboration by allowing members to share scientific workflows, experiment plans, and other digital objects.
NARA File Analyzer and Metadata HarvesterFixity
File Format Identification
Metadata Extraction
NARA File Analyzer and Metadata Harvester allows a user to analyze the contents of a file system or external drive and generates statistics about the contents of the contained directories.
NOID (Ruby)Persistent IdentificationA version of NOID in Ruby
Nice Opaque Identifiers (NOID)Persistent IdentificationIdentifiers management tool to generate, bind and resolve different kinds of identifiers
NoidsPersistent IdentificationIdentifiers management tool
Omeka Identity pluginPersistent IdentificationPlugin for Omeka to assign ARK identifiers
Package HandlerValidation
File Management
Metadata Processing
Personal Archiving
Appraisal
View, create, edit, and validate Swiss archival packages
Proofpoint Enterprise ArchiveDiscovery
Storage
Service
Proofpoint Enterprise Archive is a SaaS email archiving solution that addresses three key challenges eDiscovery, regulatory compliance and email storage management without the headaches of managing archiving in-house.
Python checkm packageFixityThis is a Python implementation of the checkm specification.
RE (Rename Expert)File Management
Metadata Processing
Controlled renaming of file collections
RODA-InFixity
Transfer
Appraisal
The tool creates SIPs from files and folders available on the local file system.
RackSpaceStorage
Service
RackSpace provices cloud based services to businesses of all sizes through the world.
RcloneActive Data Storage
File Management
Rclone is a command-line program to manage files on cloud storage.
ReACT (Resource Audit and Comparison Tool)File Management
Quality Assurance
A file audit and comparison tool using Microsoft Excel and VBA.
ReDBoxManaging Active Research Data
Metadata Processing
ReDBox and Mint are two complimentary applications designed to create, store, and provide access to research metadata.
... further results