Storage research data (Faculty of Science)

From ICT science
Jump to navigation Jump to search

Large volume group storage facility. This documentation replaces the Bètastor documentation for (migrated) storage projects after 22-05-2018. For other large volume research data storage solutions also see IT-solutions matrix for university services (RDM-website)

Storage characteristics

Project storage is a UU (ITS) facilitated network storage with a functional layer provided by the Science Faculty (ICT-Beta). This means in-house developed and maintained network storage located in the Netherlands (Almere datacenter and UMC-Science Park). For data policy guidelines see: Storage_research_data_(general)

data types

  • suitable for privacy sensitive data only when the data is encrypted (no default provision), always consult RDM-support when in doubt
  • suitable for large volume research data, sharing data with UU-employees/students only (solisID required)

functionality

  • choice between single (NetApp RAID triple parity) or double storage (disaster recovery)
  • default 24 x hourly data snapshots current day + 1 daily snapshot kept for 60 days (snapshots use up additional space depending on amount of file changes)
  • auto compression and de-duplication of data (resulting in lower data use depending on file type)
  • usage can be maximized by quota system: possibility to set folder quota
  • self service user management provided (see below)
  • available protocols: smb/cifs, sftp, default mount on Gemini HPC (Linux interactive shell)

price

  • cost 2 euro/TB/month for single storage or 4 euro for double storage (aka backup or disaster recovery)
  • costs are charged on basis of the reserved volume size (expandable at any time)

service level

weekdays from 8 to 17:30, contact the servicedesk

Request storage

A request can be placed through this form. In an intake we will determine the most appropriate solution. What is needed to complete the request:

  • name of the Principle Investigator or project manager
  • project name
  • in case of website: url friendly web name
  • WBS of the project (this number will be billed)
  • initial Volume size (in TB's, can be enlarged at any time)
  • name of a data contact (user management)
  • solis-id's of the initial user group

Getting started

How to mount the network drive on your computer:

  • Use the OS finder to connect, not an internet browser!
  • Replace projectname with your own project or leave out (you will be presented with a list)
  • Login using: soliscom\[solisID] and [solispassword]

Windows OS: \\soliscom.uu.nl\science\projects\<projectname> Mac OS: smb://soliscom.uu.nl/science/projects/<projectname>

Details can be found on the Project_storage:_how_to page

Structure of a project

What do you see when mounting your project?

By default you will see just that: a blank project space that can be structured by creating (sub)folders as you need them.

Functional folders that can be added to a project on request

  • a personal userfolder (personal storage for each authorised user in a project). These are shared read only within a project. Subfolder private can be added if sharing is undesirable
  • an archive folder. This folder typically contains immutable historical data and is readonly for project users (can be configured otherwise by data-manager)
  • a project folder. This folder is open to all project users to share data between all users (the same as a default blank project, then create your own sub-folders)
  • a subproject folder. This creates a folder with its own user management (to facilitate a restricted group within a project).

Contact your groups data-manager to request functional folders

How to manage Users and roles

See Beta Self Service Provider for user-access management, datamanagers only. A user can be anyone with a solis-id; both students and employees.

Additional services

Project website

Data: \\soliscom.uu.nl\science\wwwprojects\<projectname> Website: https://www.projects.science.uu.nl/<projectname>

For more info see: Project_storage:_how_to

Measurement service

When collecting data from imagers or other local lab systems, usually a lot of manual copying of the resulting data files is involved. We can help you set up a service that will do the copying for you. It can also make sure the lab system doesn't fill up with old data runs. This has to be tailored to your situation. Inquiries may be sent to: Rob van den Broek

Example of a measurement service (before and after): diagram

Also see