DataStage - Revision history

Prwheatley at 11:47, 13 May 2021

2021-05-13T11:47:28Z

Rcdeboer: Added links to Function and/or Content Type

2021-04-20T19:31:53Z

Added links to Function and/or Content Type

Andreas Romeyke: /* Standards compliance */

2020-08-17T08:35:52Z

Standards compliance

COPTR Bot: Trial import from script.

2013-11-13T21:05:55Z

Trial import from script.

New page

{{Infobox_tool
|purpose=DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility.
|image=
|homepage=http://www.dataflow.ox.ac.uk/index.php/datastage
|license=
|platforms=
}}


[[Category:Active Data Storage]]
[[Category:Preservation System]]
[[Category:Managing Active Research Data]]
[[Category:Research Data]]

= Description =
[http://www.dataflow.ox.ac.uk/index.php/datastage DataStage] is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility. Designed for research groups, the system appears as a mapped drive on the end-user’s computer.
====Provider====
Oxford University Bodleian Libraries, as part of the wider DataFlow project
====Licensing and cost====
Free – [http://www.opensource.org/licenses/MIT open source MIT license]
====Development activity====
DataStage version 0.3 was released in May 2012.
While the DataFlow project will end in May 2012, the Bodlean Library has decided to trial the software for its own use and will support development until at least May 2013.
====Platform and interoperability====
DataStage is designed for the Ubuntu Linux 11.10 Oneiric Ocelot operating system, and the Virtual Machines work with VMWare Fusion 4.x. While it is intended to integrate with [http://www.dcc.ac.uk/resource/external/databank DataBank], the software offers an API so that it can package datasets for submission to any SWORD-2-compliant repository.
End-users can connect to DataStage through a web interface or as a mapped drive on Mac, Linux or Windows machines.
====Functional notes====
The software gives three levels of password-controlled access: a "private" area only accessible to the file owner and the group leader, a "shared" area giving read-only access to the group, and a "collaborative" area giving read- and write-access. The administrator can invite outside collaborators into the group, pinpointing their level of access. Users can also access and annotate the files through a web interface.
DataStage can be deployed on a local server, or on an institutional or commercial cloud; users can also dynamically invoke additional cloud storage as required. Users can integrate the system into existing backup procedures. The repository interface also allows researchers to push selected files into a more permanent archive facility.
While users can add free-text metadata via the web interface, DataStage also automatically captures a number of general file attributes: date uploaded; file name; last modified; type; owner; location; and size.
====Documentation and user support====
Documentation is available in the form of an [http://http://www.dataflow.ox.ac.uk/index.php/datastage/users/test-users Information for Test Users] page and the DataStage [https://github.com/dataflow/DataStage/wiki documentation wiki], which is very much a work in progress, but does offer information for installation and use. The project has an active mailing list at [http://dataflow-devel@googlegroups.com http://dataflow-devel@googlegroups.com] and links to a JIRA [http://dataflow-jira.bodleian.ox.ac.uk/jira/secure/IssueNavigator.jspa issue tracker]. Installation instructions are included in a README file, which comes zipped with the installation package.
The project is creating video walkthroughs for installation, configuration and use of DataStage, to be available from the website by the end of May 2012.
====Usability====
End-users interact with the system either as a mapped drive on their computer, implicitly integrating with their operating system’s current navigation structure, or through a web interface.
====Expertise required====
Installation and configuration would greatly benefit from knowledge of system administration, and use of the Linux command line. Walkthrough videos should make it possible to get DataStage running without expertise, but novice users may not be able to get maximum functionality and customisability from the system.
====Standards compliance====
Metadata automatically gathered by the system is in RDF format.
The system uses the BagIt specification when transferring files to a permanent archive, which must be SWORD-2 compliant.
====Influence and take-up====
DataStage is used at the Oxford Bodleian Libraries; information about wider use is unavailable.

= User Experiences =

= Development Activity =

{{Infobox_tool_details
|ohloh_id=DataStage
}}

@@ Line 2: / Line 2: @@
 |purpose=DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility.
 |homepage=http://www.dataflow.ox.ac.uk/index.php/datastage
-|function=Active Data Storage, Preservation System, Managing Active Research Data
+|function=Active Data Storage, Managing Active Research Data
 |content=Research Data
 }}

@@ Line 1: / Line 1: @@
-{{Infobox_tool
+{{Infobox tool
 |purpose=DataStage is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility.
 |homepage=http://www.dataflow.ox.ac.uk/index.php/datastage
-|license=
+|function=Active Data Storage, Preservation System, Managing Active Research Data
-|platforms=
+|content=Research Data
 }}
 = Description =
 [http://www.dataflow.ox.ac.uk/index.php/datastage DataStage] is a flexible data storage system that provides controlled access, secure backup, and the ability to transfer selected files to a more permanent archiving facility. Designed for research groups, the system appears as a mapped drive on the end-user&rsquo;s computer.
@@ Line 48: / Line 42: @@
 = Development Activity =

@@ Line 39: / Line 39: @@
 ====Standards compliance====
 Metadata automatically gathered by the system is in RDF format.
-The system uses the BagIt specification when transferring files to a permanent archive, which must be SWORD-2 compliant.
+The system uses the [[BagIt]] specification when transferring files to a permanent archive, which must be SWORD-2 compliant.
 ====Influence and take-up====
 DataStage is used at the Oxford Bodleian Libraries; information about wider use is unavailable.