Difference between revisions of "Store"
Jump to navigation
Jump to search
Prwheatley (talk | contribs) |
Prwheatley (talk | contribs) |
||
Line 1: | Line 1: | ||
{{Infobox stage | {{Infobox stage | ||
|definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards." | |definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards." | ||
− | |order= | + | |order=6 |
}} | }} |
Latest revision as of 10:14, 9 June 2021
Functions within this lifecycle stage
Function | Definition |
---|---|
Active Data Storage | Tools that support the storage, management, and ultimately the preservation, of evolving research data. |
Backup | Tools that support the backing up of digital data to another storage location, typically in a scheduled manner. |
File Management | Tools that support general file management activities such as viewing or renaming |
Fixity | Tools that support the verification of file fixity, typically through the generation and validation of checksum based manifests. |
Managing Active Research Data | Tools that enable researchers to manage data from its point of creation, facilitating its productive use in the present, but also establishing the support structures necessary to ensure its future survival. |
Passive Data Storage | Tools that support the passive preservation of digital resources on storage media such as paper, film or DNA. |
Persistent Identification | Tools that support the unique and persistent identification of files or intellectual entities. |
Storage | Tools that support the storage of digital resources, possibly in multiple locations to avoid loss of data due to hardware or other failures. |
Tools for this lifecycle stage
Tool | Function | Purpose |
---|---|---|
7-Zip | Rendering Transfer Fixity | 7-Zip is a file archiver with a high compression ratio, and encryption and fixity check capabilities |
ACE (Audit Control Environment) | Fixity | The Auditing Control Environment is a mature set of software designed to help libraries and archives prove their holdings are intact and trustworthy. |
ADIGRES | Storage File Management Access | ADIGRES is a powerful cross-platform Document Management System written in Java. |
ALTAG3D | File Management Storage Metadata Extraction Personal Archiving | An open source archive software |
ARK plugin for Omeka | Persistent Identification | Generating and resolving ARK identifiers for resources in Omeka |
AVP Fixity | Fixity | Fixity monitoring for digital collections |
Aaru Data Preservation Suite | Backup Disk Imaging Metadata Extraction | Media dump software and disc image manager |
Advanced Renamer | File Management | Advanced Renamer is a program for renaming multiple files and folders at once. By configuring renaming methods the names can be manipulated in various ways. |
Amazon Cloud | Storage Service | Amazon Cloud is an internet-based storage location designed to hold files indefinitely. |
ArchiFiltre | File Management Appraisal | Overview of folder trees with fine diagrams |
Archive::BagIt | Fixity File Copy | BagIt API for Perl |
Ark service | Persistent Identification | ARK identifiers generator in python |
Audacity | Redaction Personal Archiving File Management | The open source audio editor |
AudiAnnotate | Access Annotation Preservation System Workflow Academic Social Networking Personal Archiving Service Version Control Metadata Processing Rendering Discovery Persistent Identification Managing Active Research Data | To make audio and its interpretations more discoverable and usable by extending the use of the newest IIIF (International Image Interoperability Framework) standard for audio with the development of the AudiAnnotate web application, documented workflows and workshops that will facilitate the use of existing best-of-breed, open source tools for audio annotation (Sonic Visualiser), for public code and document repositories (GitHub), and audio presentation (Universal Viewer) to produce, publish, and sustain shareable W3C Web Annotations for individual and collaborative audio projects. |
Avcc | File Management | AVCC is an open source application that enables collaborative, efficient item-level cataloging of audiovisual collections. |
BAT: BnfArcTools | File Management | BAT is a Perl package for processing Internet Archive ARC, DAT and CDX file format. |
BIL (BagIt Library) | Fixity File Copy | BagIt Library is a Java software library that supports the creation, manipulation and validation of bags. |
BagIt Transfer Utilities | Fixity File Copy | BagIt transfer Utilities are a collection of tools developed for the purpose of validation and transfer of bags. |
Bagger | Fixity Transfer | GUI application to facilitate the creation and verification of BagIt bags. |
BitCurator | File Management Fixity Metadata Extraction Metadata Processing Quality Assurance Validation Workflow | The BitCurator Environment is an Ubuntu Linux distribution geared to the needs of archivists and librarians. It includes a suite of open source digital forensics and data analysis tools to help collecting institutions process born-digital materials. |
Bulk Rename Utility | File Management | Bulk Rename Utility is a free file renaming software for Windows. Bulk Rename Utility allows you to easily rename files and entire folders based upon extremely flexible criteria. |
CASTOR (CERN Advanced STORage manager) | Storage | CASTOR, which stands for the CERN Advanced STORage manager, is a hierarchical storage management (HSM) system developed at CERN used to store physics production files and user files. |
CND3D | Active Data Storage Storage Managing Active Research Data Data capture and Deposit | Store, Preserve and publish 3D objects produced in Digital Humanities Research |
CRunch | Workflow and Lab Notebook Management Managing Active Research Data | cRunch provides an infrastructure for exploratory data analysis with the statistical programming language and environment R |
Carbonite | Storage Backup Service | an online backup service that automatically backs up documents, e-mails, music, photos, and settings. Info gathered early March 2013. |
Checksum (by Corz) | Fixity | Fast hashing tool using a GUI interface |
Chronopolis | Storage Backup Service | "Chronopolis digital preservation network provides services for the long-term preservation and curation of America's digital holdings" |
Cksum Unix command | Fixity | cksum computes a cyclic redundancy check (CRC) checksum for each given file, or standard input if none are given |
CyberChef | Encryption Detection File Management Decryption Metadata Extraction Personal Archiving Binary & Hexidecimal Editing Discovery | A forensic tool with workflow capabilities to analyse files and containers |
Czkawka | De-Duplication File Management Appraisal | Czkawka is a simple, fast and free app to remove unnecessary files from your computer. |
D-Net Software Kit | Planning Data Management Planning Managing Active Research Data | Software Kit creates a network of repositories that share the infrastructure services necessary to process and provide access to digital content. |
DART (Digital Archivist's Resource Tool) | Storage File Management Fixity Transfer | Provides both a GUI and a command-line interface for packaging files and uploading them to remote repositories. |
DCape (ingest only) | Preservation System Storage | "The goal of the DCAPE project is to build a distributed production preservation environment that meets the needs of archival repositories for trusted archival preservation services." (Note: This is a work in progress, see notes for more information) |
DIMAG | Metadata Extraction Preservation System Access File Format Migration Storage Workflow | A software suite supporting archives with preservation of digital information for eternity |
DMPTool | Planning Data Management Planning Managing Active Research Data | DMPTool is an online service to enable researchers to create data management plans now required by many funding agencies, and to receive tailored institutional guidance to help them in the process. |
DMPonline | Planning Data Management Planning Managing Active Research Data Service | DMPonline is the DCC's data management planning tool. |
Data Vault | Backup Storage Managing Active Research Data | A storage broker and front end for archiving research data that is no longer active but that does not have a need for open publication |
DataCite | Persistent Identification Managing Active Research Data Citation and Impact Tracking | DataCite works with data centres to assign persistent identifiers to datasets using the Digital Object Identifier (DOI) infrastructure. |
DataFlow | Managing Active Research Data Storage | DataFlow is a two-stage data management infrastructure that is designed to allow researchers to work with, annotate, publish, and permanently store research data. |
DataStage | Active Data Storage Managing Active Research Data | DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility. |
Dataverse | Active Data Storage Preservation System Managing Active Research Data Storage | The Dataverse is an open source web application to share, preserve, cite, explore and analyze research data. |
Dcfldd | File Management Forensic File Copy | dcfldd is an enhanced version of GNU dd with features useful for forensics and security. |
Detox | File Management | The detox utility renames files to make them easier to work with under Unix and Unix-like operating systems. |
DiPS (Digital Preservation Solution) | Access Active Data Storage File Format Identification File Format Migration File Management Metadata Extraction Preservation System Secure Deletion Service Storage Transfer Validation Workflow | DiPS (OAIS compliant Digital Preservation Solution) |
Directory List & Print | Metadata Extraction File Management | A universal metadata extractor |
Disk2FDI | Backup Disk Imaging Forensic Personal Archiving | Disk2FDI is a professional disk imaging software designed to create binary images of floppy disks to the Formatted Disk Image (FDI) file format, as well as sector-based standard formats. |
DiskView | File Management | DiskView shows you a graphical map of your disk, allowing you to determine where a file is located or, by clicking on a cluster, seeing which file occupies it. |
Docuteam cosmos | File Format Migration Preservation System Service Storage Workflow | docuteam cosmos is a comprehensive, modular software solution for the operation of digital long-term archives based on the OAIS standard (Open Archival Information System, ISO 14721:2012). |
Docuteam packer | Appraisal Data capture and Deposit File Management Fixity Metadata Processing | Creates and edits SIPs |
Double Commander | Fixity File Copy Batch Rename File Management De-Duplication | Open source file manager with two panels side by side |
Dropbox | Storage Backup Service | Dropbox is a free service that lets you bring all your photos, docs, and videos anywhere. This means that any file you save to your Dropbox will automatically save to all your computers, phones and even the Dropbox website. Dropbox also makes it super easy to share with others, whether you're a student or professional, parent or grandparent. Even if you accidentally spill a latte on your laptop, have no fear! You can relax knowing that Dropbox always has you covered, and none of your stuff will ever be lost. |
EZARK | Persistent Identification | ARK identifiers management tool and sub-publishers registry |
EZID | Persistent Identification | EZID (easy-eye-dee) makes it easy to create and manage unique, persistent identifiers. |
Emailchemy | De-Duplication File Format Migration File Management File Recovery | Converts proprietary emails to standard portable formats |
ExactFile | Fixity | Making sure that what you hash is what you get |
Explore2fs | File Management | Explore2fs is a GUI explorer tool for accessing ext2 and ext3 filesystems. |
FCIV | Fixity Transfer | Generates and compares MD5 values stored in an XML file. |
File Analyzer and Metadata Harvester V2 | File Management Fixity Metadata Extraction Metadata Processing Quality Assurance Validation Workflow | The File Analyzer is a general purpose desktop (and command line) tool designed to automate simple, file-based operations. The File Analyzer assembles a toolkit of tasks a user can perform. The tasks that have been written into the File Analyzer code base have been optimized for use by libraries, archives, and other cultural heritage institutions. |
FileVerifier++ | Fixity De-Duplication | Windows utility for verifying file contents |
Fixi | Fixity | Fixi is a command-line utility that indexes, verifies, and updates checksum information for collections of files. |
Fixity Pro | Fixity | Fixity Pro is a desktop application for Windows and Mac that provides simple automated monitoring and reporting on the data integrity of your files that are stored on your computer, removable storage devices, and mounted network storage locations. Use Fixity Pro to schedule routine scans that will tell you if your files have been changed and if any files have been added, removed, or moved/renamed since the last scan that was performed. |
Free Video Cutter Joiner | Redaction Personal Archiving File Management | It cuts and joins video streams without altering the codecs. |
FreeCommander | File Management De-Duplication Fixity File Copy | Split-screen file manager with desirable extras |
Fslint | De-Duplication File Management | Set of utilities to find and clean various forms of lint on a filesystem, such as duplicate files, empty directories, and bad file names. |
Glacier (Amazon) | Backup Storage | Amazon Glacier is a secure, durable, and extremely low-cost cloud storage service for data archiving and long-term backup. |
Google Cloud | Storage | Google Cloud Storage allows users to store, access, and manage their data. |
Greens | Persistent Identification | ARK identifiers minter and resolver |
Hoppla | Preservation System Storage | Hoppla is an archiving solution that combines back-up and fully automated migration services for data collections in small office environments. |
IRODS (integrated Rule Oriented Data Systems) | Storage | iRODS software was designed to allow curators utilising heterogeneous storage and computing facilities to define policies without being concerned with the technical detail of how the system implements those policies and without having to respond to changes in technical infrastructure. |
Ingestr | Backup File Format Migration | ingestr is a command-line application that allows ingesting or copying data from any source into any destination database. |
Java library implementing Pairtree | File Management De-Duplication | The PAIRTREE LIBRARY is a software library that supports the mapping between identifiers and filepaths according to the Pairtree Specification. |
Kepler | Workflow and Lab Notebook Management Managing Active Research Data | Kepler is a scientific workflow modelling and management system that enables users, regardless of programming experience, to set up data analysis pipelines. |
LOCKSS (Lots of Copies Keep Stuff Safe) | Storage Preservation System Access | LOCKSS software allows libraries to create preserved digital collections out of materials that would otherwise be accessible only through a licensed academic subscription. |
LabTrove | Workflow and Lab Notebook Management Managing Active Research Data | LabTrove is a blogging platform specifically designed for use in a research environment. |
Legacy Locker | Storage | Legacy Locker is a safe, secure repository for your vital digital property that lets you grant access to online assets for friends and loved ones in the event of loss, death, or disability. |
Library (xklb) | File Management Quality Assurance Web Capture | Media indexing multi-tool |
Lunas | Storage File Copy | A syncing cli tool that can handle more than two directories locally and remotely |
MD5Checker | Fixity | Lightweight Windows Desktop application to create and check MD5 Digests for one or several files. |
MailStore Home | Metadata Extraction Metadata Processing File Management Discovery | Unifies your private emails into one searchable, platform-independent repository |
Md5deep and hashdeep | Fixity | md5deep is a set of programs to compute MD5, SHA-1, SHA-256, Tiger, or Whirlpool message digests on an arbitrary number of files. hashdeep is a program to compute, match, and audit hashsets. |
Md5sum Unix command | Fixity | md5sum computes a 128-bit checksum (or fingerprint or message-digest) for each specified file. |
Md5summer | Fixity | MD5summer is an application for Microsoft Windows 9x, NT, ME, 2000 and XP which generates and verifies md5 checksums. |
Mets-bag-checker | Validation Fixity | METS Bag checker is a simple python tool to check the validity of METS Information Packages (XML validity, completeness, Data Objects fixity, absence of unreferenced files). |
Micr'Olonys | Storage Access Passive Data Storage Backup Transfer File Recovery | Micr’Olonys is the software solution for long-term passive digital archiving on film and paper. |
Minimum Preservation Tool | Fixity Preservation System | The Minimum Preservation Tool (MPT) can be used to create an interim preservation storage environment for files awaiting preservation in a longer term repository solution. It supports checksum generation, fixity checking, and replication across two or more storage nodes. |
MyExperiment | Workflow and Lab Notebook Management Managing Active Research Data Academic Social Networking Workflow | myExperiment is an online social networking service aimed at scientific researchers; the site fosters collaboration by allowing members to share scientific workflows, experiment plans, and other digital objects. |
NARA File Analyzer and Metadata Harvester | Fixity Metadata Extraction File Format Identification | NARA File Analyzer and Metadata Harvester allows a user to analyze the contents of a file system or external drive and generates statistics about the contents of the contained directories. |
NOID (Ruby) | Persistent Identification | A version of NOID in Ruby |
Nice Opaque Identifiers (NOID) | Persistent Identification | Identifiers management tool to generate, bind and resolve different kinds of identifiers |
Noids | Persistent Identification | Identifiers management tool |
Omeka Identity plugin | Persistent Identification | Plugin for Omeka to assign ARK identifiers |
Package Handler | File Management Metadata Processing Personal Archiving Validation Appraisal | View, create, edit, and validate Swiss archival packages |
Proofpoint Enterprise Archive | Discovery Service Storage | Proofpoint Enterprise Archive is a SaaS email archiving solution that addresses three key challenges eDiscovery, regulatory compliance and email storage management without the headaches of managing archiving in-house. |
Python checkm package | Fixity | This is a Python implementation of the checkm specification. |
RE (Rename Expert) | Metadata Processing File Management | Controlled renaming of file collections |
RODA-In | Transfer Fixity Appraisal | The tool creates SIPs from files and folders available on the local file system. |
RackSpace | Storage Service | RackSpace provices cloud based services to businesses of all sizes through the world. |
ReACT (Resource Audit and Comparison Tool) | File Management Quality Assurance | A file audit and comparison tool using Microsoft Excel and VBA. |
ReDBox | Metadata Processing Managing Active Research Data | ReDBox and Mint are two complimentary applications designed to create, store, and provide access to research metadata. |
ReNamer | File Management | ReNamer is a very powerful and flexible file renaming tool. |
... further results |