Chapter 5. Data Management

Table of Contents

5.. What is Data Management?
5.. Why Worry?
5.. Storage Logistics
Data Format
Storage Providers
Managing Your Own Storage
5.. Data Storage on the Cluster
5.. Data Transfer
5.. Practice

What is Data Management?

Data management, in the context of research computing, refers to how research data is stored, formatted, and disseminated over the long term.

Researchers who generate new data need to plan ahead in order to ensure that any data supporting their research conclusions will be available in the future. The data could be used to reproduce or otherwise verify the research results, or could be analyzed in new ways for completely different purposes.