Project storage: how to: Difference between revisions

From ICT science
Jump to navigation Jump to search
(Created page with "This how to relates to the Project storage Faculty of Science page __TOC__ ==How to connect to a project space?== ===Using Windows 7=== Connect to <code>\\projects.scienc...")
 
 
(77 intermediate revisions by 3 users not shown)
Line 1: Line 1:
This how to relates to the [[Project storage Faculty of Science]] page
This ''how to'' relates to the [[Storage_research_data_(Betastor)]] page
__TOC__
==How to mount the network drive on your computer?==
===Introduction===
'''''Use the OS finder(Mac) or explorer(windows) to connect, not an internet browser! Replace ''projectname'' with your own project or leave out'''''
 
'''Outside the UU-network (which is either wired at the Science Parc or ''Utrecht University'' Wifi) you need to open a VPN session to connect'''
 
<code>Windows OS: \\soliscom.uu.nl\science\projects\<projectnaam>
Mac OS: smb://soliscom.uu.nl/science/projects</code>
 
If you don't know your exact projectname, you can leave it out. You will be presented with a directory listing of all projects. It is recommended to map your network drive to a fixed drive-letter for future use ('''Windows''') or mark the network address as a favourite ('''Mac OS''').
 
'''View'''
 
Depending on the way your project is set up you will see:
: - your personal user folder (read/write/delete) or all user folders (read only, optional)
: - a project folder (read/write/delete) intended to exchange data for all users within project
: - a subproject folder (read/write/delete) intended to exchange data for specific users within project
: - an archive folder (read or read/write, optional)
 
===When to use SMB, WebDav or SFTP?===
: -SMB is by far the fastest and most stable protocol, but needs a VPN connection with a science profile outside the UU-network (i.e. at home) [https://handleidingen.uu.nl/handleiding/vpn-op-macos/ VPN for MacOS] - [https://handleidingen.uu.nl/handleiding/u-en-o-schijf-op-windows-10-vpn/ VPN for Windows]
:-WEBDAV does not function well and is deprecated. Does not work without a science profile. Use SFTP instead


__TOC__
===Using SMB Windows 7-10===
==How to connect to a project space?==
Connect to <code>\\soliscom.uu.nl\science\projects\<projectname></code>
===Using Windows 7===
Connect to <code>\\projects.science.uu.nl\<projectname></code>


To map a project space to a drive:
To map a project space to a drive:
Line 10: Line 31:
* Select a drive letter.
* Select a drive letter.
* Enter the project folder you want to connect to.
* Enter the project folder you want to connect to.
* you cannot login with your email address, so choose: ''more choices'' - ''use a different account'' and enter soliscom\yoursolisID and then your password
* You may wish to check the ''Reconnect at logon'' option: this will ensure the mapping persists when restarting your system.
* You may wish to check the ''Reconnect at logon'' option: this will ensure the mapping persists when restarting your system.
* Click ''Finish''; you may be asked for your Solis-id and password.
* Click ''Finish''; you may be asked for your Solis-id and password.
* The new drive will appear in the list of available drives and can be accessed.
* The new drive will appear in the list of available drives and can be accessed.


===Using SSL Windows 7-10===
'''You can also use the  <code>net use</code> command to connect to a project space'''
'''You can also use the  <code>net use</code> command to connect to a project space'''
* Open ''Start &rarr; All Programs &rarr; Accessories &rarr; Command Prompt''.  Execute the following command:
* Open ''Start &rarr; All Programs &rarr; Accessories &rarr; Command Prompt''.  Execute the following command:
:<code>net use <drive> \\intercon.science.uu.nl\<projectname> /user:soliscom\<solisid></code>
:<code>net use <drive> \\soliscom.uu.nl\science\projects\<projectname> /user:soliscom\<solisid></code>
* For <code><drive></code> substitute an available drive letter, e.g. <code>z:</code>.<br>For <code><projectname></code> substitute the project name.<br>For <code><solisid></code> substitute your own Solis-id.<br>After you have supplied your password, the connection is established.
* For <code><drive></code> substitute an available drive letter, e.g. <code>z:</code>.<br>For <code><projectname></code> substitute the project name.<br>For <code><solisid></code> substitute your own Solis-id.<br>After you have supplied your password, the connection is established.
* Use the parameter <code>/persistent:yes</code> to establish a connection that persists after you have re-logged in on your system.
* Use the parameter <code>/persistent:yes</code> to establish a connection that persists after you have re-logged in on your system.
* Use <code>net use /help</code> for a list of further possibilities.
* Use <code>net use /help</code> for a list of further possibilities.
===Using SMB for MacOSX===
Choose Finder menu: - Go - connect to server and enter address (use your solisID/password): <code>smb://netapp1.science.uu.nl/science/projects</code>
:-Click + to bookmark this address
:- you should make this address available in your OSX finder as a '''Favourite'''. After mounting: drag the project folder to the favourite column on the left side.
'''Note:''' the soliscom mount that appears in the Finder under ''Locations'' cannot be used to acces your project folder.


===Using WebDAV (Windows and OSX, works outside the UU-network, no VPN needed)===
'''Note:''' if you have trouble connecting with SMB or your connection is unstable, please upgrade to at least 10.12
Connect to  <code><nowiki>https://intercon.science.uu.nl/projects</nowiki></code>.
You will be shown all project spaces as directories, but you may open only those spaces to which you have been granted access rights.


====Windows 7====
If the problem persists, you can use the webdav-protocol (see below)
The faculty file server can be reached using WebDAV over https; no VPN connection is needed.
* Open ''My Computer'' (or a ''Windows Explorer''), then select ''Tools &rarr; Map Network Drive...''
* Select a drive-letter.
* For address enter <code><nowiki>https://intercon.science.uu.nl/projects</nowiki></code> and ''connect''.


====OSX====
<!-- ===Using WebDAV (works outside the UU-network, no VPN needed)===
The faculty file server can be reached using WebDAV over https; no VPN connection is needed. ''OSX Finder'' can be used to this end, but it does not grant writing rights. Alternatively, use ''Cyberduck'':
'''Note:''' WebDav file upload is limited to 300Mb max per file
* Download [http://cyberduck.ch/ Cyberduck] and establish a WebDAV (http) connection.
====Windows====
* For the address, enter <code><nowiki>https://intercon.science.uu.nl/projects</nowiki></code> and ''connect''.
Use the windows finder to connect to  <code><nowiki>https://intercon.science.uu.nl/science/projects</nowiki></code>
You will be shown all project spaces as directories, but you may open only those spaces to which you have been granted access rights. See ''Using SMB Windows 7-10'' above for info on how to map to a drive letter.
====Mac OSX====
Due to incompatibilities in the OSX webdav protocol, we recommend using a third party app to set up this connection. See the ITS manual on how to [https://handleidingen.uu.nl/handleiding/webdav-met-cyberduck-osx/ set up Cyberduck]
Use the following parameters:
:Protocol: choose WebDAV (HTTPS)
:Nickname: Betastor (or choose your own name)
:Server: intercon.science.uu.nl
:Port: 443
:Username: solis-id
:Path: /science/projects/
:You can append the path with  a specific ''projectname'' (optional) otherwise you get a listing of all your projects under Betastor -->


===Using Windows 7 over SSL (works outside the UU-network, no VPN needed)===
===Using (s)FTP===
On Windows 7 u can establish a connection through SSL, using the <code>net use</code> command.
See under [[Personal_storage#sFTP_and_SCP|personal storage]].
* Open ''Start &rarr; All Programs &rarr; Accessories &rarr; Command Prompt''.  Execute the following command:
:<code>net use <drive> \\intercon.science.uu.nl@SSL\webdav.projects\<projectnaam> /user:soliscom\<solisid></code>
* For <code><drive></code> substitute an available drive letter, e.g. <code>z:</code>.<br>For <code><projectname></code> substitute the project name.<br>For <code><solisid></code> substitute your own Solis-id.<br>After you have supplied your password, the connection is established.
* Use the parameter <code>/persistent:yes</code> to establish a connection that persists after you have re-logged in on your system.
* Use <code>net use /help</code> for a list of further possibilities.


===Using Linux===
===Using Linux===
Login to a [[Linux interactive shell]], then change directory to the project tree <code>/home/projects/<projectname></code>.  The project tree is mounted read only on all Linux student PC's as <code>/home/projects</code>.
Login to a [[Linux interactive shell]], then change directory to the project tree <code>/science/projects/<projectname></code>.  The project tree is currently not yet mounted on all Linux student PC's.
 
'''When using a local Ubuntu/Linux OS'''
:-start a unix VPN session
:-mount.cifs  //soliscom.uu.nl/science/projects/PROJECTNAME  /LOCALDIR -o 'username=SOLISID,password=SOLISPASSWORD ' (replace caps with your data, LOCALDIR is the name of the dir on your local system: choose your own)


===Using (s)FTP===
==How to synchronise your local data to the network storage==
See under [[Personal_storage#sFTP_and_SCP|personal storage]].
===Setting up an automated sync===
You can of course copy your local data to the network storage by hand, but this becomes cumbersome after a while and prone to mistakes. To set up an automated sync from Windows or Mac OS read:
[[Storage_synchronize_data]]
 
===Prevent Mac OS from .DS_Store file creation on network volumes===
The creation of .DS_Store files is frequently the source of complaints against Mac users, who often leave a trail of these files scattered throughout the filesystem when "visiting" a Windows computer. Even with this fix in place, the .DS_Store files will continue to be created on local volumes (which is a good thing).
 
To prevent the creation of these files, open the Terminal and type:
<pre>defaults write com.apple.desktopservices DSDontWriteNetworkStores true</pre>
It may be necessary to log out and back in, or even to restart the computer, for the change to take effect.
 
==How to restore previous versions of a file (Windows and Linux only)==
===Windows===
You can use previous versions to restore files and folders that you accidentally modified or deleted, or that were damaged. Depending on the type of file or folder, you can open, save to a different location, or restore a previous version. ''Snapshots are not kept indefinitely. 10% of storage space is reserved for previous versions, so the desired version might not be available depending on time passed and total read/write activity''
 
*''How do I restore previous versions of a file or folder?''
Right-click the file or folder, and then click Restore previous versions.
You’ll see a list of available previous versions of the file or folder.
 
Before restoring a previous version of a file or folder, select the previous version, and then click Open to view it to make sure it’s the version you want.
 
NOTE: You can’t open or copy previous versions of files that were created by Windows Backup, but you can restore them.
 
To restore a previous version, select the previous version, and then click Restore.
 
WARNING: The file or folder will replace the current version on your computer, and the replacement cannot be undone.
 
NOTE: If the Restore button isn’t available, you can’t restore a previous version of the file or folder to its original location. However, you might be able to open it or save it to a different location.
 
*''Can I restore a file or folder that was deleted or renamed?''
If you accidentally delete or rename a file or folder, you can restore a previous version of that file or folder, but you need to know the location where the file or folder was saved. To restore a file or folder that was deleted or renamed, follow these steps:
 
:- Click the Computer icon on your desktop to open it up. Navigate to the folder that used to contain the file or folder, right-click it, and then click Restore previous versions. If the folder was at the top level of a drive, for example H:\, right-click the drive and then click Restore previous versions.
:- Double-click a previous version of the folder that contains the file or folder you want to restore. (For example, if a file was deleted today, choose a version of the folder from yesterday that contains the file.)
:- Drag the file or folder that you want to restore to another location, such as your desktop or another folder.
 
The version of the file or folder is saved to the location that you selected.
 
''If you cannot find the deleted file or you have to restore an entire folder, it is best to start a support call in the [https://topdesk.ictsc.uu.nl/tas/public/login/form UU-servicedesk]''
===Linux (Gemini)===
For Linux on Gemini (rsh):
:cd /science/projects/''projectname''/
:cd .snapshot
:ls
:-daily.listing of daily backups
:-hourly.listing of hourly backups
'''choose backup:''' cd ''choose backup dir''
:ls
'''restore a file:''' cp Book1.txt /science/projects/projectname/Book1.txt


==Web interface on a project space==
==Project Website interface==
{{floatbox|{{parheader|The best web platform for your project}}ICT-B&egrave;ta offers [[Web sites on faculty servers|several web platforms]], and can advise you in your choice for a platform.<br>If you request a web interface for your project, this advise will also be given.}}
{{floatbox|{{parheader|The best web platform for your project}}ICT-B&egrave;ta offers [[Web sites on faculty servers|several web platforms]], and can advise you in your choice for a platform.<br>If you request a web interface for your project, this advise will also be given.}}
Part of a project space can be used to build and present a web site.  To this end, you should put a directory '<code>www</code>' in the root of the project space.  The project web site works like a [[personal web site]], with the following modifications:
In addition to project storage, you can request storage to facilitate a website interface.  The project web site works like a [[personal web site]], with the following modifications:
* The web interface is ''not'' automatically shown after defining the <code>www</code> directory, unless you have explicitly applied for it (see below).
* A project website must be requested separately from (or in addition to) the project storage
* The web interface is shown on the web address <code><nowiki>http://www.projects.science.uu.nl/<projectname></nowiki></code>
* the source data address:
<code>\\soliscom.uu.nl\science\wwwprojects\<projectname></code>
* The website address:
<code><nowiki>https://www.projects.science.uu.nl/<projectname></nowiki></code>
* Please note that some limitations apply to project web names: spaces are not allowed, nor special characters; ideally a project web name contains only letters a-z and digits 0-9.
* Please note that some limitations apply to project web names: spaces are not allowed, nor special characters; ideally a project web name contains only letters a-z and digits 0-9.
==Applying for a project space==
A project space can be applied for through {{topdesk|lan=en}}.
When applying, please state the following:
* simple name for the project space directory;
* who should be granted read/write access (preferably as a list of Solis-ids);
* who should be granted read-only access (preferably as a list of Solis-ids);
* if the project space should have a web interface, what should be the project web name (preferably containing only letters a-z and digits 0-9).


==See also==
==See also==

Latest revision as of 18:31, 9 March 2023

This how to relates to the Storage_research_data_(Betastor) page

How to mount the network drive on your computer?

Introduction

Use the OS finder(Mac) or explorer(windows) to connect, not an internet browser! Replace projectname with your own project or leave out

Outside the UU-network (which is either wired at the Science Parc or Utrecht University Wifi) you need to open a VPN session to connect

Windows OS: \\soliscom.uu.nl\science\projects\<projectnaam> Mac OS: smb://soliscom.uu.nl/science/projects

If you don't know your exact projectname, you can leave it out. You will be presented with a directory listing of all projects. It is recommended to map your network drive to a fixed drive-letter for future use (Windows) or mark the network address as a favourite (Mac OS).

View

Depending on the way your project is set up you will see:

- your personal user folder (read/write/delete) or all user folders (read only, optional)
- a project folder (read/write/delete) intended to exchange data for all users within project
- a subproject folder (read/write/delete) intended to exchange data for specific users within project
- an archive folder (read or read/write, optional)

When to use SMB, WebDav or SFTP?

-SMB is by far the fastest and most stable protocol, but needs a VPN connection with a science profile outside the UU-network (i.e. at home) VPN for MacOS - VPN for Windows
-WEBDAV does not function well and is deprecated. Does not work without a science profile. Use SFTP instead

Using SMB Windows 7-10

Connect to \\soliscom.uu.nl\science\projects\<projectname>

To map a project space to a drive:

  • Open My Computer (or a Windows Explorer, then select Tools → Map Network Drive...
  • Select a drive letter.
  • Enter the project folder you want to connect to.
  • you cannot login with your email address, so choose: more choices - use a different account and enter soliscom\yoursolisID and then your password
  • You may wish to check the Reconnect at logon option: this will ensure the mapping persists when restarting your system.
  • Click Finish; you may be asked for your Solis-id and password.
  • The new drive will appear in the list of available drives and can be accessed.

Using SSL Windows 7-10

You can also use the net use command to connect to a project space

  • Open Start → All Programs → Accessories → Command Prompt. Execute the following command:
net use <drive> \\soliscom.uu.nl\science\projects\<projectname> /user:soliscom\<solisid>
  • For <drive> substitute an available drive letter, e.g. z:.
    For <projectname> substitute the project name.
    For <solisid> substitute your own Solis-id.
    After you have supplied your password, the connection is established.
  • Use the parameter /persistent:yes to establish a connection that persists after you have re-logged in on your system.
  • Use net use /help for a list of further possibilities.

Using SMB for MacOSX

Choose Finder menu: - Go - connect to server and enter address (use your solisID/password): smb://netapp1.science.uu.nl/science/projects

-Click + to bookmark this address
- you should make this address available in your OSX finder as a Favourite. After mounting: drag the project folder to the favourite column on the left side.

Note: the soliscom mount that appears in the Finder under Locations cannot be used to acces your project folder.

Note: if you have trouble connecting with SMB or your connection is unstable, please upgrade to at least 10.12

If the problem persists, you can use the webdav-protocol (see below)


Using (s)FTP

See under personal storage.

Using Linux

Login to a Linux interactive shell, then change directory to the project tree /science/projects/<projectname>. The project tree is currently not yet mounted on all Linux student PC's.

When using a local Ubuntu/Linux OS

-start a unix VPN session
-mount.cifs //soliscom.uu.nl/science/projects/PROJECTNAME /LOCALDIR -o 'username=SOLISID,password=SOLISPASSWORD ' (replace caps with your data, LOCALDIR is the name of the dir on your local system: choose your own)

How to synchronise your local data to the network storage

Setting up an automated sync

You can of course copy your local data to the network storage by hand, but this becomes cumbersome after a while and prone to mistakes. To set up an automated sync from Windows or Mac OS read: Storage_synchronize_data

Prevent Mac OS from .DS_Store file creation on network volumes

The creation of .DS_Store files is frequently the source of complaints against Mac users, who often leave a trail of these files scattered throughout the filesystem when "visiting" a Windows computer. Even with this fix in place, the .DS_Store files will continue to be created on local volumes (which is a good thing).

To prevent the creation of these files, open the Terminal and type:

defaults write com.apple.desktopservices DSDontWriteNetworkStores true

It may be necessary to log out and back in, or even to restart the computer, for the change to take effect.

How to restore previous versions of a file (Windows and Linux only)

Windows

You can use previous versions to restore files and folders that you accidentally modified or deleted, or that were damaged. Depending on the type of file or folder, you can open, save to a different location, or restore a previous version. Snapshots are not kept indefinitely. 10% of storage space is reserved for previous versions, so the desired version might not be available depending on time passed and total read/write activity

  • How do I restore previous versions of a file or folder?

Right-click the file or folder, and then click Restore previous versions. You’ll see a list of available previous versions of the file or folder.

Before restoring a previous version of a file or folder, select the previous version, and then click Open to view it to make sure it’s the version you want.

NOTE: You can’t open or copy previous versions of files that were created by Windows Backup, but you can restore them.

To restore a previous version, select the previous version, and then click Restore.

WARNING: The file or folder will replace the current version on your computer, and the replacement cannot be undone.

NOTE: If the Restore button isn’t available, you can’t restore a previous version of the file or folder to its original location. However, you might be able to open it or save it to a different location.

  • Can I restore a file or folder that was deleted or renamed?

If you accidentally delete or rename a file or folder, you can restore a previous version of that file or folder, but you need to know the location where the file or folder was saved. To restore a file or folder that was deleted or renamed, follow these steps:

- Click the Computer icon on your desktop to open it up. Navigate to the folder that used to contain the file or folder, right-click it, and then click Restore previous versions. If the folder was at the top level of a drive, for example H:\, right-click the drive and then click Restore previous versions.
- Double-click a previous version of the folder that contains the file or folder you want to restore. (For example, if a file was deleted today, choose a version of the folder from yesterday that contains the file.)
- Drag the file or folder that you want to restore to another location, such as your desktop or another folder.

The version of the file or folder is saved to the location that you selected.

If you cannot find the deleted file or you have to restore an entire folder, it is best to start a support call in the UU-servicedesk

Linux (Gemini)

For Linux on Gemini (rsh):

cd /science/projects/projectname/
cd .snapshot
ls
-daily.listing of daily backups
-hourly.listing of hourly backups

choose backup: cd choose backup dir

ls

restore a file: cp Book1.txt /science/projects/projectname/Book1.txt

Project Website interface

The best web platform for your project
ICT-Bèta offers several web platforms, and can advise you in your choice for a platform.
If you request a web interface for your project, this advise will also be given.

In addition to project storage, you can request storage to facilitate a website interface. The project web site works like a personal web site, with the following modifications:

  • A project website must be requested separately from (or in addition to) the project storage
  • the source data address:

\\soliscom.uu.nl\science\wwwprojects\<projectname>

  • The website address:

https://www.projects.science.uu.nl/<projectname>

  • Please note that some limitations apply to project web names: spaces are not allowed, nor special characters; ideally a project web name contains only letters a-z and digits 0-9.

See also