COPTR - User contributions [en-gb]

Workflow:Long Term Archiving at the CINES

2022-02-21T14:02:56Z

Xgranier:

{{Infobox COW
|status=Draft
|tools=aLTAG3D, CND3D, FACILE a Format validation service
|input=All data identified as to be retained in the 3D data life cycle
|output=PLY, DAE
|organisation=Consortium "3D for Humanities"
|organisationurl=https://3dhumanities.hypotheses.org/
}}
==Workflow Description==
[[File:Ssk 2 graph.png|800px|thumb|right|]]
The long-term preservation of 3D digital objects raises some critical issues. Indeed, firstly, different kind of data can be archived: the original files depending on the method used to digitize; the final version, depending on the goal (simple acquisition or modelisation) and any relevant information (text, images, pdf , scenarios ...) added for a better comprehension of the 3D object (see [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle] )

Secondly it is important that metadata accompany the archive to ensure that the 3D object will be human-readable in the long-term. These metadata have to be completed in distinct files.

The Consortium "3D for Humanities" of [https://www.huma-num.fr/about-us/ Huma-Num] developed a tool, [https://altag3d.huma-num.fr/ aLTAG3D] to easily produce metadata file for the full 3D archive. Lastly, a place to preserve 3D data in the long term has to be found. Many solutions exist, depending on the countries. In France, there are solutions such as [https://3d.humanities.science/ 3D National Data Repository] for 3D data research for mid-term preservation, and the [https://www.cines.fr/en/ CINES] in the continuity for long-term preservation.

 

'''BUILDING THE CINES ARCHIVE
'''
# Procedure to build the metadata
#
# Procedure to build the paradata
#
# Finalize a deposit





==Purpose==
This workflow is a use case scenario designed to illustrate best pratices in the long term preservation of
3D digital objects with a final deposit at the CINES (National Computing Center for Higher Education), a
public institution supervised by the French ministry for Higher Education and Research which offers
services to the scientific community in the long term digital preservation.

Long term preservation of digital documents has three main objectives:

* Keep the document
* Make it accessible
* Preserve intelligibility

==Context==
This use case scenario was produces by the team of the consortium “3D for Humanities” for [http://ssk.huma-num.fr/# (SSK) the Standardization Survival Kit (SSK)], a toolkit for Humanities developed within [https://www.parthenos-project.eu/ the PARTHENOS project] in order to stabilize knowledge on standards and good research practices, giving access to them in a meaningful way, by the mediation of research scenarios.



==Evaluation/Review==

The workflow has been extensively tested since 2016 by members of the Consortium " 3D for Humanities", and is regularly improved. For any questions or suggestions, please contact contact@humanities.science

==Further Information==

* A. Alaoui M'Darhri, V. Baillet, B. Bourineau, A. Calantropio, G. Carpentiero, et al.. [https://hal.archives-ouvertes.fr/PARTHENOS/hal-02155055v1 Share - Publish - Store - Preserve. Methodologies, Tools and Challenges for 3D Use in Social Sciences and Humanities. PARTHENOS. Share — Publish — Store — Preserve. Methodologies, Tools and Challenges for 3D Use in Social Sciences and Humanities], Feb 2019, Marseille, France. 2019. ⟨hal-02155055⟩

* Preserving 3D digital objects (2019) [online] https://ssk.parthenos-project.eu/ssk/#/scenarios/SSK_sc_Preservation3DObjects/ [consult: 10-02- 2022]
* Long term preservation concept (2020) [online] https://www.cines.fr/en/long-term-preservation/a-concept-problems-2/long-term-preservation-concept/ [consult: 10-02- 2022]
* A 3D National Data Repository (2016 ) [online] https://3d.humanities.science/ [consult: 10-02- 2022]

Workflow:How to preserve your 3D data with the French National 3D Repository?

2022-02-20T20:24:42Z

Xgranier:

{{Infobox COW
|status=Draft
|tools=aLTAG3D, CND3D, FileZilla
|input=All data identified as to be retained in the [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle]
|output=A SIP stored in the French National 3D Repository (Conservatoire National des Données 3D)
|organisation=Consortium "3D for Humanities"
|organisationurl=https://shs3d.hypotheses.org/
}}
==Workflow Description==

[[File:WorkflowCND3D.png|550px|thumb]]

There are two ways to create a repository on the CND3D - the final objective being to keep the data on the servers of the National 3D Data Conservatory.

* Online SIP's creation and manual documentation (1): the data files are uploaded directly to the repository, and all the metadata must then be filled online. This approach is not recommended for large projects with numerous data. (need for Sarah's confirmation).
* Offline SIP's creation and semi-automatic documentation (2): the data files are first organized and documented in the aLTAG3D software - to be installed on the computer. A large part of the required metadata is retrieved automatically: only the descriptive metadata remains to be documented. Once all the information is filled in, aLTAG3D checks the validity of the deposit, and generates a tree structure with the metadata (XML file). This package can be sent via ftp, with Filezilla for example. This second option is therefore preferable because it allows better documentation of the repositories. Furthermore, when the file formats are recognized by the archiving infrastructure CINES, the same SIP can be deposited here.

===First method (online SIP's creation)===

Don't know the process...

===Second method (offline SIP's creation)===
'''Step 1: Create the SIP'''
# Identify the data you want to preserve (see [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle] for more information)
# Open aLTAG3D, create a new project and save it on your working folder (probably in the folder of the 3D data you want to preserve)
## If you are using the software for the first time, it may be necessary to activate all plugins
# A tree structure of nodes appears. Each box corresponds to a type of information.
## By selecting a box, the metadata appears in the side panel on the right. All required information is framed in red; other information is optional. When information is entered, the red box turns green. The aim of the game is that all boxes turn green to generate the SIP.
## If a node is pulled, a new box is added. Depending on the data to be stored, it is possible to customize the output.
# You can drag and drop the files to be preserved on the box, a huge amount of technical metadata is automatically extracted. You only have to fill a little amount of information.
# Verify the integrity of the project.
# You can generate a rapport of the project ready to be exported
# You can proceed to the creation of the SIP. A few extra information are required, and the the software will copy every files in a new folder, and create some xml file containing metadatas

'''Step 2: Upload the SIP'''
# The SIP must be loaded onto the CND3D servers via the FTP protocol. Filezilla can be used.
# If this is the first time, you can request an account and login details from [contact@humanities.science contact@humanities.science]

==Purpose==
This workflow is designed to preserve 3D data produced in the framework of cultural heritage documentation, and to semantically enrich them so that they can be harvested in the ecosystem created by the 3D for Humanities Consortium and the HumaNum service.

==Context==
The concepts of ''archiving'' and ''preservation'' of digital data should not be confused. Preservation implies that data is stored and populated with a set of metadata on a medium. Archiving brings an additional constraint: as file formats evolve, the files must also be updated to ensure the long-term readability of the content. This costly operation can only be done if the file format is documented and has a [https://facile.cines.fr/ validator]. As a consequence, only a few file formats can be accepted. Preservation, on the other hand, means keeping the files as they were received, without maintaining the file formats, which is a lighter solution. Although there is no obligation concerning the file formats that can be deposited, we can only recommend that the most universal possible formats be used, which are documented and can be opened with software that is accessible in the medium term.

Preserving files does not only mean putting them on a server or a hard disk, as several dangers can arise. Over time, one can forget that they exist. Then, one can also forget how they were produced, for what purpose. This is important information that allows you to have confidence in the data: this is a key aspect in the reuse of data for scientific research. All this information should be transcribed in the form of metadata. The main advantage of the proposed workflow (compared to archiving) is to format the information so that it can be recognized by the tools developed by the [https://3d.humanities.science/ French National 3D Repository (aka "Conservatoire National des Données 3D") and several other search engines ([https://isidore.science/ Isidore], [https://ariadne-infrastructure.eu/ ARIADNE+] and [https://www.gotriple.eu/ GoTriple]) when it will be in place. Thus, from a single point of deposit, data can be retrieved on other platforms.

==Evaluation and Review==
The workflow has been extensively tested since 2016 by members of the 3D SHS Consortium, and is regularly improved. For any questions or suggestions, please contact contact@humanities.science

==Further Information==
For an extensive documentation about the scheme of metadata behind aLTAG3D and the National 3D Repository (in French):
* Dutailly B., Eusèbe S., Grimaud V., Lefèvre N., Quantin M., Tournon S., 2019. L’archivage pérenne des modèles numériques 3D pour les SHS. ''Consortium 3D SHS'', dir. Granier X. [https://hal.archives-ouvertes.fr/hal-02195914 hal-02195914]

For a more detail approach of the workflow (in French):
* Tournon S., Grimaud V., Dutailly B., Granier X., 2020. Le Conservatoire National des Données 3D SHS. ''Humanistica 2020'', May 2020, Bordeaux, France. [https://hal.archives-ouvertes.fr/hal-02733470/ hal-02733470]

Workflow:How to preserve your 3D data with the French National 3D Repository?

2022-02-20T20:16:56Z

Xgranier:

{{Infobox COW
|status=Draft
|tools=aLTAG3D, CND3D, FileZilla
|input=All data identified as to be retained in the [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle]
|output=A SIP stored in the French National 3D Repository (Conservatoire National des Données 3D)
|organisation=Consortium "3D for Humanities"
|organisationurl=https://shs3d.hypotheses.org/
}}
==Workflow Description==

[[File:WorkflowCND3D.png|550px|thumb]]

There are two ways to create a repository on the CND3D - the final objective being to keep the data on the servers of the National 3D Data Conservatory.

* Manual documentation (1): the data files are uploaded directly to the repository, and all the metadata must then be filled online. This approach is not recommended for large projects with numerous data. (need for Sarah's confirmation).
* Semi-autormatic documentation (2): the data files are first organized and documented in the aLTAG3D software - to be installed on the computer. A large part of the required metadata is retrieved automatically: only the descriptive metadata remains to be documented. Once all the information is filled in, aLTAG3D checks the validity of the deposit, and generates a tree structure with the metadata (xml file). This package can be sent via ftp, with Filezilla for example. This second option is therefore preferable because it allows better documentation of the repositories. Furthermore, when the file formats are recognized by the archiving infrastructure CINES, the same SIP can be deposited here.

===First method (online SIP's creation)===

Don't know the process...

===Second method (offline SIP's creation)===
'''Step 1: Create the SIP'''
# Identify the data you want to preserve (see [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle] for more information)
# Open aLTAG3D, create a new project and save it on your working folder (probably in the folder of the 3D data you want to preserve)
## If you are using the software for the first time, it may be necessary to activate all plugins
# A tree structure of nodes appears. Each box corresponds to a type of information.
## By selecting a box, the metadata appears in the side panel on the right. All required information is framed in red; other information is optional. When information is entered, the red box turns green. The aim of the game is that all boxes turn green to generate the SIP.
## If a node is pulled, a new box is added. Depending on the data to be stored, it is possible to customize the output.
# You can drag and drop the files to be preserved on the box, a huge amount of technical metadata is automatically extracted. You only have to fill a little amount of information.
# Verify the integrity of the project.
# You can generate a rapport of the project ready to be exported
# You can proceed to the creation of the SIP. A few extra information are required, and the the software will copy every files in a new folder, and create some xml file containing metadatas

'''Step 2: Upload the SIP'''
# The SIP must be loaded onto the CND3D servers via the FTP protocol. Filezilla can be used.
# If this is the first time, you can request an account and login details from [contact@humanities.science contact@humanities.science]

==Purpose==
This workflow is designed to preserve 3D data produced in the framework of cultural heritage documentation, and to semantically enrich them so that they can be harvested in the ecosystem created by the 3D for Humanities Consortium and the HumaNum service.

==Context==
The concepts of ''archiving'' and ''preservation'' of digital data should not be confused. Preservation implies that data is stored and populated with a set of metadata on a medium. Archiving brings an additional constraint: as file formats evolve, the files must also be updated to ensure the long-term readability of the content. This costly operation can only be done if the file format is documented and has a [https://facile.cines.fr/ validator]. As a consequence, only a few file formats can be accepted. Preservation, on the other hand, means keeping the files as they were received, without maintaining the file formats, which is a lighter solution. Although there is no obligation concerning the file formats that can be deposited, we can only recommend that the most universal possible formats be used, which are documented and can be opened with software that is accessible in the medium term.

Preserving files does not only mean putting them on a server or a hard disk, as several dangers can arise. Over time, one can forget that they exist. Then, one can also forget how they were produced, for what purpose. This is important information that allows you to have confidence in the data: this is a key aspect in the reuse of data for scientific research. All this information should be transcribed in the form of metadata. The main advantage of the proposed workflow (compared to archiving) is to format the information so that it can be recognized by the tools developed by the [https://3d.humanities.science/ French National 3D Repository (aka "Conservatoire National des Données 3D") and several other search engines ([https://isidore.science/ Isidore], [https://ariadne-infrastructure.eu/ ARIADNE+] and [https://www.gotriple.eu/ GoTriple]) when it will be in place. Thus, from a single point of deposit, data can be retrieved on other platforms.

==Evaluation and Review==
The workflow has been extensively tested since 2016 by members of the 3D SHS Consortium, and is regularly improved. For any questions or suggestions, please contact contact@humanities.science

==Further Information==
For an extensive documentation about the scheme of metadata behind aLTAG3D and the National 3D Repository (in French):
* Dutailly B., Eusèbe S., Grimaud V., Lefèvre N., Quantin M., Tournon S., 2019. L’archivage pérenne des modèles numériques 3D pour les SHS. ''Consortium 3D SHS'', dir. Granier X. [https://hal.archives-ouvertes.fr/hal-02195914 hal-02195914]

For a more detail approach of the workflow (in French):
* Tournon S., Grimaud V., Dutailly B., Granier X., 2020. Le Conservatoire National des Données 3D SHS. ''Humanistica 2020'', May 2020, Bordeaux, France. [https://hal.archives-ouvertes.fr/hal-02733470/ hal-02733470]

File:WorkflowCND3D.png

2022-02-20T20:09:32Z

Xgranier:

Workflow:How to preserve your 3D data with the French National 3D Repository?

2022-02-20T17:44:48Z

Xgranier:

{{Infobox COW
|status=Draft
|tools=aLTAG3D, CND3D, FileZilla
|input=All data identified as to be retained in the [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle]
|output=A SIP stored in the French National 3D Repository (Conservatoire National des Données 3D)
|organisation=Consortium "3D for Humanities"
|organisationurl=https://shs3d.hypotheses.org/
}}
==Workflow Description==

There are two ways to create a repository on the CND3D - the final objective being to keep the data on the servers of the National 3D Data Conservatory.

* Either the files are loaded directly from the web browser, and all the metadata must then be filled online. This approach is not recommended for large projects with numerous data. (need for Sarah's confirmation).
* Or the files are filled in through the aLTAG3D software - to be installed on the computer. The files are loaded into the software and a large part of the metadata is then retrieved automatically: only the descriptive metadata remains to be documented. Once all the information is filled in, aLTAG3D checks the validity of the deposit, and generates a tree structure with the metadata (xml file). This package can be sent via ftp, with Filezilla for example. This second option is therefore preferable because it allows better documentation of the repositories. Furthermore, when the file formats are recognized by the archiving infrastructure CINES, the same SIP can be deposited here.

===First method (online SIP's creation)===

Don't know the process...

===Second method (offline SIP's creation)===
'''Step 1: Create the SIP'''
# Identify the data you want to preserve (see [https://coptr.digipres.org/index.php/Workflow:Life_Cycle_of_3D_Data_for_Cultural_Heritage 3D data life cycle] for more information)
# Open aLTAG3D, create a new project and save it on your working folder (probably in the folder of the 3D data you want to preserve)
## If you are using the software for the first time, it may be necessary to activate all plugins
# A tree structure of nodes appears. Each box corresponds to a type of information.
## By selecting a box, the metadata appears in the side panel on the right. All required information is framed in red; other information is optional. When information is entered, the red box turns green. The aim of the game is that all boxes turn green to generate the SIP.
## If a node is pulled, a new box is added. Depending on the data to be stored, it is possible to customize the output.
# You can drag and drop the files to be preserved on the box, a huge amount of technical metadata is automatically extracted. You only have to fill a little amount of information.
# Verify the integrity of the project.
# You can generate a rapport of the project ready to be exported
# You can proceed to the creation of the SIP. A few extra information are required, and the the software will copy every files in a new folder, and create some xml file containing metadatas

'''Step 2: Upload the SIP'''
# The SIP must be loaded onto the CND3D servers via the FTP protocol. Filezilla can be used.
# If this is the first time, you can request an account and login details from [contact@humanities.science contact@humanities.science]

==Purpose==
This workflow is designed to preserve 3D data produced in the framework of cultural heritage documentation, and to semantically enrich them so that they can be harvested in the ecosystem created by the 3D for Humanities Consortium and the HumaNum service.

==Context==
The concepts of ''archiving'' and ''preservation'' of digital data should not be confused. Preservation implies that data is stored and populated with a set of metadata on a medium. Archiving brings an additional constraint: as file formats evolve, the files must also be updated to ensure the long-term readability of the content. This costly operation can only be done if the file format is documented and has a [https://facile.cines.fr/ validator]. As a consequence, only a few file formats can be accepted. Preservation, on the other hand, means keeping the files as they were received, without maintaining the file formats, which is a lighter solution. Although there is no obligation concerning the file formats that can be deposited, we can only recommend that the most universal possible formats be used, which are documented and can be opened with software that is accessible in the medium term.

Preserving files does not only mean putting them on a server or a hard disk, as several dangers can arise. Over time, one can forget that they exist. Then, one can also forget how they were produced, for what purpose. This is important information that allows you to have confidence in the data: this is a key aspect in the reuse of data for scientific research. All this information should be transcribed in the form of metadata. The main advantage of the proposed workflow (compared to archiving) is to format the information so that it can be recognized by the tools developed by the [https://3d.humanities.science/ French National 3D Repository (aka "Conservatoire National des Données 3D") and several other search engines ([https://isidore.science/ Isidore], [https://ariadne-infrastructure.eu/ ARIADNE+] and [https://www.gotriple.eu/ GoTriple]) when it will be in place. Thus, from a single point of deposit, data can be retrieved on other platforms.

==Evaluation and Review==
The workflow has been extensively tested since 2016 by members of the 3D SHS Consortium, and is regularly improved. For any questions or suggestions, please contact contact@humanities.science

==Further Information==
For an extensive documentation about the scheme of metadata behind aLTAG3D and the National 3D Repository (in French):
* Dutailly B., Eusèbe S., Grimaud V., Lefèvre N., Quantin M., Tournon S., 2019. L’archivage pérenne des modèles numériques 3D pour les SHS. ''Consortium 3D SHS'', dir. Granier X. [https://hal.archives-ouvertes.fr/hal-02195914 hal-02195914]

For a more detail approach of the workflow (in French):
* Tournon S., Grimaud V., Dutailly B., Granier X., 2020. Le Conservatoire National des Données 3D SHS. ''Humanistica 2020'', May 2020, Bordeaux, France. [https://hal.archives-ouvertes.fr/hal-02733470/ hal-02733470]

Workflow:Life Cycle of 3D Data for Cultural Heritage

2022-02-16T15:59:51Z

Xgranier: /* Purpose, Context and Content */

{{Infobox COW
|status=Production
|input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an object from Cultural Heritage.
|output=The ouput of this workflow are scientifically validated 3D data.
|organisation=Consortium "3D for Humanities"
}}
==Workflow Description==



[[File:GrapheSequetiel_anglais_png.png|400px]]
 



==Purpose, Context and Content==

It presents the steps of the production process in a simplified way. The system of the graph has been defined to follow a logical path with notably the use of loops to express the recursive aspect of the work on data, especially during the hypothesis and restitution stages.

==Evaluation/Review==


==Further Information==





Xavier Granier, Laurent Bergerot, Mehdi Chayani, Bruno Dutailly, Pascal Mora, et al. 3D lexicon for Human and Social Sciences. Recommendations of the "Consortium 3D for Humanities", 2021. [https://hal.archives-ouvertes.fr/hal-03187979 ⟨hal-03187979⟩]

Workflow:Life Cycle of 3D Data for Cultural Heritage

2022-02-16T15:58:21Z

Xgranier: /* Further Information */

{{Infobox COW
|status=Production
|input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an object from Cultural Heritage.
|output=The ouput of this workflow are scientifically validated 3D data.
|organisation=Consortium "3D for Humanities"
}}
==Workflow Description==



[[File:GrapheSequetiel_anglais_png.png|400px]]
 



==Purpose, Context and Content==


==Evaluation/Review==


==Further Information==





Xavier Granier, Laurent Bergerot, Mehdi Chayani, Bruno Dutailly, Pascal Mora, et al. 3D lexicon for Human and Social Sciences. Recommendations of the "Consortium 3D for Humanities", 2021. [https://hal.archives-ouvertes.fr/hal-03187979 ⟨hal-03187979⟩]

Workflow:Life Cycle of 3D Data for Cultural Heritage

2022-02-16T15:56:53Z

Xgranier:

{{Infobox COW
|status=Production
|input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an object from Cultural Heritage.
|output=The ouput of this workflow are scientifically validated 3D data.
|organisation=Consortium "3D for Humanities"
}}
==Workflow Description==



[[File:GrapheSequetiel_anglais_png.png|400px]]
 



==Purpose, Context and Content==


==Evaluation/Review==


==Further Information==

Workflow:Life Cycle of 3D Data for Cultural Heritage

2022-02-16T15:55:53Z

Xgranier:

{{Infobox COW
|status=Production
|input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an object from Cultural Heritage.
|output=The ouput of this workflow are scientifically validated 3D data.
|organisation=Consortium "3D for Humanities"
}}
==Workflow Description==



[[File:GrapheSequetiel_anglais_png.png]]
 



==Purpose, Context and Content==


==Evaluation/Review==


==Further Information==

Workflow:Life Cycle of 3D Data for Cultural Heritage

2022-02-16T15:55:27Z

Xgranier: Created page with "{{Infobox COW |status=Production |input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an obje..."

{{Infobox COW
|status=Production
|input=As inputs, we take all documents from any formats and raw acquired data that will be used to create a digital 3D restitution of an object from Cultural Heritage.
|output=The ouput of this workflow are scientifically validated 3D data.
|organisation=Consortium "3D for Humanities"
}}
==Workflow Description==

[[File:GrapheSequetiel_anglais_png.png]]



[[File:GrapheSequetiel_anglais_png.png]]
 



==Purpose, Context and Content==


==Evaluation/Review==


==Further Information==

File:GrapheSequetiel anglais png.png

2022-02-16T15:50:54Z

Xgranier: Sequential Graph for 3D Data Production in Cultural Heritage

== Summary ==
Sequential Graph for 3D Data Production in Cultural Heritage