User: Guest  Login
Title:

Data profiling and migration processes

Document type:
Forschungsdaten
Publication date:
16.02.2024
Responsible:
Hussain Shah, Syed Ashfaq
Authors:
Hussain Shah, Syed Ashfaq; Petzold, Frank
Author affiliation:
TUM
Publisher:
TUM
Identifier:
doi:10.14459/2024mp1735421
End date of data production:
16.02.2023
Subject area:
DAT Datenverarbeitung, Informatik; INF Informationswesen, Bibliotheks-, Dokumentations-, Archiv-, Museumswesen; WIR Wirtschaftswissenschaften; WIS Wissenschaftskunde
Resource type:
Textdokumente / text documents
Data type:
Texte / texts
Other data type:
Code, JSON
Description:
In large research projects participants are required to migrate data to the official information infrastructure and adopt that for subsequent research activities. This package contains migration plan and corresponding data which were created to migrate data and users of large Collaborative Research Centres (CRC) e.g. TRR277 AMC (a CRC funded by German Research Council).

In this data package there are two code packages, an example of data profile, data profile templates and a plan of data and users’ migration. One of the code packages is an example of framework for data profiling to migrate data. The current implementation of this package is based on the example of WebDAV interface offered by PowerFolder. The other code package creates directory structures together with corresponding metadata files in bulk quantity for data to be placed in Data Science Storage (DSS). It creates all the entities based on the specified naming convention for projects, work packages, storages and folders as well as corresponding metadata templates. For details about templates and structures, please refer to the data package “Simplified DataCite compliant metadata templates and directory structures to manage research data” available at https://doi.org/10.14459/2024mp1735150. The naming convention in this case maintains the contextual information and facilitates the integration of data in TUM Workbench. The profile templates are in tabular forms which are also suitable for spreadsheet format and Web/ digital form. Example of data profile, generated by the data profiling application, is in JSON format. It has been truncated to remove redundant information and edited to replace personal information e.g. values are replaced with ###

The contents of this data package are based on the AMC specific policy, information infrastructure, project distribution and organisation, nature of data etc. For details about policy, please refer to the data package “Research data Management policy for large CRC projects” available at https://doi.org/10.14459/2024mp1734393. The defined strategy and procedures may be adapted by the target groups as per their own policy, information infrastructure, the distribution of tasks and data organisation schemes etc.
Key words:
Data profiling, Data migration, User migration, Plan, PowerFolder, WebDAV, Framework, Metadata, Template, Data organisation, Data package generator, Project packaging, Digital object packaging, Data bundle, Scheme, RDM, Research data management, CRC, Collaborative research centre
Technical remarks:
View and download (12 MB total, 4 Files)
The data server also offers downloads with FTP
The data server also offers downloads with rsync (password m1735421):
rsync rsync://m1735421@dataserv.ub.tum.de/m1735421/
Language:
en
Rights:
by, http://creativecommons.org/licenses/by/4.0
Horizon 2020:
DFG, Project Number 414265976 - TRR 277
 BibTeX