Difference between revisions of "Store"
Jump to navigation
Jump to search
Prwheatley (talk | contribs) |
Prwheatley (talk | contribs) |
||
| Line 1: | Line 1: | ||
{{Infobox stage | {{Infobox stage | ||
|definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards." | |definition=Functions that support the DCC Lifecycle stage defined as "Store the data in a secure manner adhering to relevant standards." | ||
| − | |order= | + | |order=6 |
}} | }} | ||
Latest revision as of 10:14, 9 June 2021
Functions within this lifecycle stage
| Funtion | Definition |
|---|---|
| Active Data Storage | Tools that support the storage, management, and ultimately the preservation, of evolving research data. |
| Backup | Tools that support the backing up of digital data to another storage location, typically in a scheduled manner. |
| File Management | Tools that support general file management activities such as viewing or renaming |
| Fixity | Tools that support the verification of file fixity, typically through the generation and validation of checksum based manifests. |
| Managing Active Research Data | Tools that enable researchers to manage data from its point of creation, facilitating its productive use in the present, but also establishing the support structures necessary to ensure its future survival. |
| Passive Data Storage | Tools that support the passive preservation of digital resources on storage media such as paper, film or DNA. |
| Persistent Identification | Tools that support the unique and persistent identification of files or intellectual entities. |
| Storage | Tools that support the storage of digital resources, possibly in multiple locations to avoid loss of data due to hardware or other failures. |
Tools for this lifecycle stage
| Tool | Function | Purpose |
|---|---|---|
| 7-Zip | Fixity Rendering Transfer | 7-Zip is a file archiver with a high compression ratio, and encryption and fixity check capabilities |
| ACE (Audit Control Environment) | Fixity | The Auditing Control Environment is a mature set of software designed to help libraries and archives prove their holdings are intact and trustworthy. |
| ADIGRES | Access File Management Storage | ADIGRES is a powerful cross-platform Document Management System written in Java. |
| ALTAG3D | File Management Metadata Extraction Personal Archiving Storage | An open source archive software |
| ARK plugin for Omeka | Persistent Identification | Generating and resolving ARK identifiers for resources in Omeka |
| AVP Fixity | Fixity | Fixity monitoring for digital collections |
| Aaru Data Preservation Suite | Backup Disk Imaging Metadata Extraction | Media dump software and disc image manager |
| Advanced Renamer | File Management | Advanced Renamer is a program for renaming multiple files and folders at once. By configuring renaming methods the names can be manipulated in various ways. |
| Amazon Cloud | Storage Service | Amazon Cloud is an internet-based storage location designed to hold files indefinitely. |
| ArchiFiltre | File Management Appraisal | Overview of folder trees with fine diagrams |
| Archive::BagIt | Fixity File Copy | BagIt API for Perl |
| Ark service | Persistent Identification | ARK identifiers generator in python |
| Audacity | File Management Personal Archiving Redaction | The open source audio editor |
| AudiAnnotate | Academic Social Networking Access Annotation Discovery Managing Active Research Data Metadata Processing Persistent Identification Personal Archiving Preservation System Rendering Version Control Workflow Service | To make audio and its interpretations more discoverable and usable by extending the use of the newest IIIF (International Image Interoperability Framework) standard for audio with the development of the AudiAnnotate web application, documented workflows and workshops that will facilitate the use of existing best-of-breed, open source tools for audio annotation (Sonic Visualiser), for public code and document repositories (GitHub), and audio presentation (Universal Viewer) to produce, publish, and sustain shareable W3C Web Annotations for individual and collaborative audio projects. |
| Avcc | File Management | AVCC is an open source application that enables collaborative, efficient item-level cataloging of audiovisual collections. |
| BAT: BnfArcTools | File Management | BAT is a Perl package for processing Internet Archive ARC, DAT and CDX file format. |
| BIL (BagIt Library) | Fixity File Copy | BagIt Library is a Java software library that supports the creation, manipulation and validation of bags. |
| BagIt Transfer Utilities | Fixity File Copy | BagIt transfer Utilities are a collection of tools developed for the purpose of validation and transfer of bags. |
| Bagger | Fixity Transfer | GUI application to facilitate the creation and verification of BagIt bags. |
| BitCurator | Fixity Validation File Management Metadata Extraction Metadata Processing Quality Assurance Workflow | The BitCurator Environment is an Ubuntu Linux distribution geared to the needs of archivists and librarians. It includes a suite of open source digital forensics and data analysis tools to help collecting institutions process born-digital materials. |
| Bulk Rename Utility | File Management | Bulk Rename Utility is a free file renaming software for Windows. Bulk Rename Utility allows you to easily rename files and entire folders based upon extremely flexible criteria. |
| CASTOR (CERN Advanced STORage manager) | Storage | CASTOR, which stands for the CERN Advanced STORage manager, is a hierarchical storage management (HSM) system developed at CERN used to store physics production files and user files. |
| CND3D | Active Data Storage Data capture and Deposit Managing Active Research Data Storage | Store, Preserve and publish 3D objects produced in Digital Humanities Research |
| CRunch | Managing Active Research Data Workflow and Lab Notebook Management | cRunch provides an infrastructure for exploratory data analysis with the statistical programming language and environment R |
| Carbonite | Backup Storage Service | an online backup service that automatically backs up documents, e-mails, music, photos, and settings. Info gathered early March 2013. |
| Checksum (by Corz) | Fixity | Fast hashing tool using a GUI interface |
| Chronopolis | Backup Storage Service | "Chronopolis digital preservation network provides services for the long-term preservation and curation of America's digital holdings" |
| Cksum Unix command | Fixity | cksum computes a cyclic redundancy check (CRC) checksum for each given file, or standard input if none are given |
| CyberChef | Binary & Hexidecimal Editing Decryption Discovery Encryption Detection File Management Metadata Extraction Personal Archiving | A forensic tool with workflow capabilities to analyse files and containers |
| Czkawka | De-Duplication File Management Appraisal | Czkawka is a simple, fast and free app to remove unnecessary files from your computer. |
| D-Net Software Kit | Data Management Planning Managing Active Research Data Planning | Software Kit creates a network of repositories that share the infrastructure services necessary to process and provide access to digital content. |
| DART (Digital Archivist's Resource Tool) | Fixity File Management Storage Transfer | Provides both a GUI and a command-line interface for packaging files and uploading them to remote repositories. |
| DCape (ingest only) | Preservation System Storage | "The goal of the DCAPE project is to build a distributed production preservation environment that meets the needs of archival repositories for trusted archival preservation services." (Note: This is a work in progress, see notes for more information) |
| DIMAG | Access File Format Migration Metadata Extraction Preservation System Storage Workflow | A software suite supporting archives with preservation of digital information for eternity |
| DMPTool | Data Management Planning Managing Active Research Data Planning | DMPTool is an online service to enable researchers to create data management plans now required by many funding agencies, and to receive tailored institutional guidance to help them in the process. |
| DMPonline | Data Management Planning Managing Active Research Data Planning Service | DMPonline is the DCC's data management planning tool. |
| Data Vault | Backup Managing Active Research Data Storage | A storage broker and front end for archiving research data that is no longer active but that does not have a need for open publication |
| DataCite | Citation and Impact Tracking Managing Active Research Data Persistent Identification | DataCite works with data centres to assign persistent identifiers to datasets using the Digital Object Identifier (DOI) infrastructure. |
| DataFlow | Managing Active Research Data Storage | DataFlow is a two-stage data management infrastructure that is designed to allow researchers to work with, annotate, publish, and permanently store research data. |
| DataStage | Active Data Storage Managing Active Research Data | DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility. |
| Dataverse | Active Data Storage Managing Active Research Data Preservation System Storage | The Dataverse is an open source web application to share, preserve, cite, explore and analyze research data. |
| Dcfldd | File Copy File Management Forensic | dcfldd is an enhanced version of GNU dd with features useful for forensics and security. |
| Detox | File Management | The detox utility renames files to make them easier to work with under Unix and Unix-like operating systems. |
| DiPS (Digital Preservation Solution) | Secure Deletion Access Active Data Storage Validation File Format Identification File Format Migration File Management Metadata Extraction Preservation System Storage Transfer Workflow Service | DiPS (OAIS compliant Digital Preservation Solution) |
| Directory List & Print | File Management Metadata Extraction | A universal metadata extractor |
| Disk2FDI | Backup Disk Imaging Forensic Personal Archiving | Disk2FDI is a professional disk imaging software designed to create binary images of floppy disks to the Formatted Disk Image (FDI) file format, as well as sector-based standard formats. |
| DiskView | File Management | DiskView shows you a graphical map of your disk, allowing you to determine where a file is located or, by clicking on a cluster, seeing which file occupies it. |
| Docuteam cosmos | File Format Migration Preservation System Storage Workflow Service | docuteam cosmos is a comprehensive, modular software solution for the operation of digital long-term archives based on the OAIS standard (Open Archival Information System, ISO 14721:2012). |
| Docuteam packer | Fixity Data capture and Deposit File Management Metadata Processing Appraisal | Creates and edits SIPs |
| Double Commander | Fixity De-Duplication File Copy File Management Batch Rename | Open source file manager with two panels side by side |
| Dropbox | Backup Storage Service | Dropbox is a free service that lets you bring all your photos, docs, and videos anywhere. This means that any file you save to your Dropbox will automatically save to all your computers, phones and even the Dropbox website. Dropbox also makes it super easy to share with others, whether you're a student or professional, parent or grandparent. Even if you accidentally spill a latte on your laptop, have no fear! You can relax knowing that Dropbox always has you covered, and none of your stuff will ever be lost. |
| EZARK | Persistent Identification | ARK identifiers management tool and sub-publishers registry |
| EZID | Persistent Identification | EZID (easy-eye-dee) makes it easy to create and manage unique, persistent identifiers. |
| Emailchemy | De-Duplication File Format Migration File Management File Recovery | Converts proprietary emails to standard portable formats |
| ExactFile | Fixity | Making sure that what you hash is what you get |
| Explore2fs | File Management | Explore2fs is a GUI explorer tool for accessing ext2 and ext3 filesystems. |
| FCIV | Fixity Transfer | Generates and compares MD5 values stored in an XML file. |
| File Analyzer and Metadata Harvester V2 | Fixity Validation File Management Metadata Extraction Metadata Processing Quality Assurance Workflow | The File Analyzer is a general purpose desktop (and command line) tool designed to automate simple, file-based operations. The File Analyzer assembles a toolkit of tasks a user can perform. The tasks that have been written into the File Analyzer code base have been optimized for use by libraries, archives, and other cultural heritage institutions. |
| FileVerifier++ | Fixity De-Duplication | Windows utility for verifying file contents |
| Fixi | Fixity | Fixi is a command-line utility that indexes, verifies, and updates checksum information for collections of files. |
| Fixity Pro | Fixity | Fixity Pro is a desktop application for Windows and Mac that provides simple automated monitoring and reporting on the data integrity of your files that are stored on your computer, removable storage devices, and mounted network storage locations. Use Fixity Pro to schedule routine scans that will tell you if your files have been changed and if any files have been added, removed, or moved/renamed since the last scan that was performed. |
| Free Video Cutter Joiner | File Management Personal Archiving Redaction | It cuts and joins video streams without altering the codecs. |
| FreeCommander | Fixity De-Duplication File Copy File Management | Split-screen file manager with desirable extras |
| Fslint | De-Duplication File Management | Set of utilities to find and clean various forms of lint on a filesystem, such as duplicate files, empty directories, and bad file names. |
| Glacier (Amazon) | Backup Storage | Amazon Glacier is a secure, durable, and extremely low-cost cloud storage service for data archiving and long-term backup. |
| Google Cloud | Storage | Google Cloud Storage allows users to store, access, and manage their data. |
| Greens | Persistent Identification | ARK identifiers minter and resolver |
| Hoppla | Preservation System Storage | Hoppla is an archiving solution that combines back-up and fully automated migration services for data collections in small office environments. |
| IRODS (integrated Rule Oriented Data Systems) | Storage | iRODS software was designed to allow curators utilising heterogeneous storage and computing facilities to define policies without being concerned with the technical detail of how the system implements those policies and without having to respond to changes in technical infrastructure. |
| Ingestr | Backup File Format Migration | ingestr is a command-line application that allows ingesting or copying data from any source into any destination database. |
| Java library implementing Pairtree | De-Duplication File Management | The PAIRTREE LIBRARY is a software library that supports the mapping between identifiers and filepaths according to the Pairtree Specification. |
| Kepler | Managing Active Research Data Workflow and Lab Notebook Management | Kepler is a scientific workflow modelling and management system that enables users, regardless of programming experience, to set up data analysis pipelines. |
| LOCKSS (Lots of Copies Keep Stuff Safe) | Access Preservation System Storage | LOCKSS software allows libraries to create preserved digital collections out of materials that would otherwise be accessible only through a licensed academic subscription. |
| LabTrove | Managing Active Research Data Workflow and Lab Notebook Management | LabTrove is a blogging platform specifically designed for use in a research environment. |
| Legacy Locker | Storage | Legacy Locker is a safe, secure repository for your vital digital property that lets you grant access to online assets for friends and loved ones in the event of loss, death, or disability. |
| Library (xklb) | File Management Quality Assurance Web Capture | Media indexing multi-tool with more than 70 CLI subcommands |
| MD5Checker | Fixity | Lightweight Windows Desktop application to create and check MD5 Digests for one or several files. |
| MailStore Home | Discovery File Management Metadata Extraction Metadata Processing | Unifies your private emails into one searchable, platform-independent repository |
| MakeStaticSite | Web Capture Personal Archiving Data capture and Deposit Managing Active Research Data Rendering | MakeStaticSite is a command-line tool for generating and deploying refined static versions of both existing websites — typically dynamic, i.e. depend on server-side scripting and databases — and sites archived by the Wayback Machine. |
| Md5deep and hashdeep | Fixity | md5deep is a set of programs to compute MD5, SHA-1, SHA-256, Tiger, or Whirlpool message digests on an arbitrary number of files. hashdeep is a program to compute, match, and audit hashsets. |
| Md5sum Unix command | Fixity | md5sum computes a 128-bit checksum (or fingerprint or message-digest) for each specified file. |
| Md5summer | Fixity | MD5summer is an application for Microsoft Windows 9x, NT, ME, 2000 and XP which generates and verifies md5 checksums. |
| Mets-bag-checker | Fixity Validation | METS Bag checker is a simple python tool to check the validity of METS Information Packages (XML validity, completeness, Data Objects fixity, absence of unreferenced files). |
| Micr'Olonys | Access Backup File Recovery Storage Transfer Passive Data Storage | Micr’Olonys is the software solution for long-term passive digital archiving on film and paper. |
| Minimum Preservation Tool | Fixity Preservation System | The Minimum Preservation Tool (MPT) can be used to create an interim preservation storage environment for files awaiting preservation in a longer term repository solution. It supports checksum generation, fixity checking, and replication across two or more storage nodes. |
| MyExperiment | Academic Social Networking Managing Active Research Data Workflow Workflow and Lab Notebook Management | myExperiment is an online social networking service aimed at scientific researchers; the site fosters collaboration by allowing members to share scientific workflows, experiment plans, and other digital objects. |
| NARA File Analyzer and Metadata Harvester | Fixity File Format Identification Metadata Extraction | NARA File Analyzer and Metadata Harvester allows a user to analyze the contents of a file system or external drive and generates statistics about the contents of the contained directories. |
| NOID (Ruby) | Persistent Identification | A version of NOID in Ruby |
| Nice Opaque Identifiers (NOID) | Persistent Identification | Identifiers management tool to generate, bind and resolve different kinds of identifiers |
| Noids | Persistent Identification | Identifiers management tool |
| Omeka Identity plugin | Persistent Identification | Plugin for Omeka to assign ARK identifiers |
| Package Handler | Validation File Management Metadata Processing Personal Archiving Appraisal | View, create, edit, and validate Swiss archival packages |
| Proofpoint Enterprise Archive | Discovery Storage Service | Proofpoint Enterprise Archive is a SaaS email archiving solution that addresses three key challenges eDiscovery, regulatory compliance and email storage management without the headaches of managing archiving in-house. |
| Python checkm package | Fixity | This is a Python implementation of the checkm specification. |
| RE (Rename Expert) | File Management Metadata Processing | Controlled renaming of file collections |
| RODA-In | Fixity Transfer Appraisal | The tool creates SIPs from files and folders available on the local file system. |
| RackSpace | Storage Service | RackSpace provices cloud based services to businesses of all sizes through the world. |
| Rclone | Active Data Storage File Management | Rclone is a command-line program to manage files on cloud storage. |
| ReACT (Resource Audit and Comparison Tool) | File Management Quality Assurance | A file audit and comparison tool using Microsoft Excel and VBA. |
| ReDBox | Managing Active Research Data Metadata Processing | ReDBox and Mint are two complimentary applications designed to create, store, and provide access to research metadata. |
| ... further results | ||