Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
disk:disksusage [2011/04/27 15:02] aprain |
disk:disksusage [2021/03/24 11:46] urgias |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== SISSA's Computing FAQ: Space disks usage====== | ====== SISSA's Computing FAQ: Space disks usage====== | ||
- | **<color teal>This page is reserved for the users who have an account on the SISSA main cluster and use:</color>**\\ | + | **<color teal>This page is reserved to the users who have an account on SISSA and use:</color>**\\ |
- | * **<color teal>a linux workstations at Santorio </color> **or | + | * **<color teal>a linux workstation at Santorio </color> **or |
- | *** <color teal>a terminal connection</color> **(for example using the ssh command)** <color teal> on the access server </color>//<color teal> ssh.sissa.it </color>//** .\\ | + | * **<color teal>an ssh connection</color> on a linux workstation or ssh.sissa.it**.\\ |
+ | * About the HPC cluster please refer to the [[services:computing:hpc|High Performance Computing: Ulysses v2]] page. | ||
\\ | \\ | ||
- | ===== YOUR MAIN DIRECTORY (home) ===== | + | ===== YOUR HOME DIRECTORY ===== |
- | ==== Your main directory (home) on the SISSA main cluster: ==== | + | ==== Your home directory in SISSA: ==== |
+ | |||
+ | After login (when your username and password are accepted) you have access to your home directory: \\ | ||
+ | **/u///your_surname_initial/your_username//** For example:// /u/a/atena // \\ | ||
+ | If you change your working directory, you can return to your home directory using the **cd** command without any additional option or name.\\ | ||
+ | You can use the **pwd** command to view which is your home directory (the **pwd** command prints the path of your working directory, the directory where you are currently in).\\ | ||
- | After login (when your username and password are accepted) you have access to your main directory (home): \\ | ||
- | **/u///yoursector/yourusername//** For example:// /u/ap/atena // \\ | ||
- | If you change your working directory, you can return to your main directory using the **cd** command without any additional option or name.\\ | ||
- | You can use the **pwd** command to view which is your main directory (the **pwd** command prints the path of your working directory, the directory where you are currently in).\\ | ||
- | The main directories (of the SISSA main cluster) of all users are stored on a central filesystem. \\ | ||
- | {{ :disk:diskusageimage-a.jpg?270x150|diskusageimage}}\\ | ||
- | == Your main directory: == | + | == Your home directory: == |
- | * is regularly saved ("backed up"); | + | * is regularly saved ( " backed up " ); |
\\ | \\ | ||
- | * **has a space limit**: You can check your space usage and limit using the **quota** command; | + | * **has a space limit**: each user has 50GB of disk space; |
\\ | \\ | ||
- | * is reachable from outside SISSA using the **ssh** command (a Secure Shell remote terminal connection) on **//ssh.sissa.it//** (for example: // ssh //ssh.sissa.it//// ); | + | * is reachable from outside SISSA using the **ssh** command (a Secure Shell remote terminal connection) on **//ssh.sissa.it//** (for example: // ssh //ssh.sissa.it//// ); |
\\ | \\ | ||
+ | * is also reachable from outside SISSA using a [[services:network:vpnclient|VPN connection]] on your workstation. Your workstation name is: <hostname>/<area_name>.sissa.it (for example: host.phys.sissa.it or host.maths.sissa.it); | ||
+ | \\ | ||
+ | * SAMBA connection: <code>smb://nas-users.sissa.it/USERNAME</code> | ||
+ | \\ | ||
+ | \\ | ||
+ | ---- | ||
+ | Using the **//SFTP service//**, the path of your home directory is a bit different. For more information, please read the section on [[on-line_resources:faq:server-ssh-sftp#SFTP access: sftp.sissa.it|SFTP access: sftp.sissa.it]] of the [[on-line_resources:faq:server-ssh-sftp|Common Access server]]. | ||
- | {{ :disk:vpn4.jpg?270x150|vpnimage}}\\ | ||
- | * is also reachable from outside SISSA using a [[services:network:vpnclient|VPN connection]] on your workstation. | + | ==== Backup (snapshot) ==== |
- | ---- | + | Your home directory is automatically backed up, and all recent backups are now freely accessible for reading. |
- | Using the **//SFTP service//**, the path of your main directory (home) is a bit different. For more information, please read the section on [[on-line_resources:faq:server-ssh-sftp#SFTP access: sftp.sissa.it|SFTP access: sftp.sissa.it]] of the page [[on-line_resources:faq:server-ssh-sftp|ssh.sissa.it the new Common Access server instead of shannon.sissa.it]]. | + | |
- | ---- | + | To look for a previous version of a file, simply go via terminal or by forcing the location to the file manager to the subdirectory .snapshot. |
- | ---- | + | |
- | ==== Quota ==== | + | You can use the command |
- | Using the **quota** command you can check your space usage on your main directory (or use **quota -s** to see the values in MB).\\ | + | <code> |
- | For example:\\ | + | ls .snapshot |
- | Disk quotas for user yourusername (uid yourUIDnumber): | + | </code> |
- | Filesystem blocks quota limit grace files quota limit grace | + | |
- | filesrv-ap.sissa.it:/u/ap | + | |
- | 64100 950000 1000000 2381 0 0 | + | |
- | - The //first number// of the last line is the space which you are using.\\ | + | Note that the .snapshot is completely hidden, so you can't see even if you enable hidden files. But if you change to that directory, you can do and you'll find the previous versions of the parent directory. From a file manager typing CTRL+L and adding /.snapshot to the current location might help. |
- | == Soft limit == | + | |
- | - The //second number// (950000) is your soft limit. If your usage exceeds this limit, you will receive an e-mail notification. You have 7 days to reduce your disk space occupation back under the soft limit. \\ | + | |
- | If you do not bring your usage back within the soft limit within 7 days:\\ | + | |
- | * you will not be able to create or save files... | + | |
- | * you will not be able to login in graphical mode or ... | + | |
- | * the windows will appear different. | + | |
- | == Hard limit == | + | Usually you can find 6 backups at different hours for the last day, one week of daily backups, and some older backups up to a couple of weeks. Older backups are available via a special helpdesk request and can take some time to get your data. |
- | - The //third number// (1000000) is your hard MAXIMUM limit, if you overtake this limit: | + | |
- | * you will not be able to create o save files... | + | |
- | * you will not be able to login in graphical mode or ... | + | |
- | * the windows appear different. | + | |
- | When you are overquota - message: **Disk quota exceeded** - you have to clean your main directory from unneeded files. | + | On a windows client, all you need is to right click on the file, select **Properties** and then the **Previous versions** tab. From there you can restore the file to its original content. |
- | To avoid this situation, we suggest to compress regularly the files, which you are not using often and to remove the unneeded files. Be careful, "Haste makes waste". | + | |
---- | ---- | ||
Line 65: | Line 54: | ||
===== Useful COMMANDS to CLEAN YOUR AREA ===== | ===== Useful COMMANDS to CLEAN YOUR AREA ===== | ||
- | ==== Check files and directories size ==== | + | ==== Check files and directory sizes ==== |
- | To see how many blocks are used by your directories and files (start first from your main directory): | + | To see how many blocks are used by your directories and files (start first from your home directory): |
- | * to see information about normal directories and files: **du -sk * ** | + | * including only normal directories and files: **du -sk * ** |
- | * to see information about hidden directories and files: **du -sk .[a-z]* ** | + | * including also hidden directories and files: **du -sk .[a-z]* ** |
* and then **du -sk .[A-Z]* ** | * and then **du -sk .[A-Z]* ** | ||
- | Alternatively to see the space occupied by all subdirectories of your current " position " | + | Alternatively, to see the space occupied by all subdirectories of your current "position" |
(please note, there are two " - " before// max-depth//):\\ | (please note, there are two " - " before// max-depth//):\\ | ||
**du --max-depth=1 -k .**\\ | **du --max-depth=1 -k .**\\ | ||
Line 82: | Line 71: | ||
\\ | \\ | ||
=== Change directory === | === Change directory === | ||
- | To " go inside " a sub-directories to check better the size of its sub-directories and files, hidden or not, use the command:\\ | + | To "go inside" a sub-directory to check the size of its subsequent sub-directories and files, hidden or not, use the command:\\ |
**cd //subdirectoryname//** \\ | **cd //subdirectoryname//** \\ | ||
- | To return in you main directory: **cd **\\ | + | To return in you home directory use **cd **\\ |
\\ | \\ | ||
=== Remove files === | === Remove files === | ||
- | Use //carefully// the **rm** command to remove your files //especially if use the wildcard characters such as (*) and (?)// .\\ | + | Use //carefully// the **rm** command to remove your files //especially if used in conjunction with the wildcard characters such as (*) and (?)// .\\ |
Please note:\\ | Please note:\\ | ||
- | the asterisk sign " ** * ** " can be used to substitute zero or more characters, and question mark (?) a single character.\\ | + | The asterisk sign " ** * ** " can be used to substitute zero or more characters, and question mark (?) a single character.\\ |
- | If you are not sure, PLEASE try using **ls** command. Some example: \\ | + | If you are not sure, PLEASE try using the **ls** command. Some examples: \\ |
- | to remove a file: **rm //filename//**\\ | + | To remove a file: **rm //filename//**\\ |
- | to remove files which start with //omega//:// ls omega//<html>   </html> then, ONLY if you are sure: //rm omega*// \\ | + | To remove files which start with //omega//:// ls omega//<html>   </html> then, ONLY if you are sure: //rm omega*// \\ |
- | If you are very sure about files to remove, you can use " **-f** " option to remove all files in a directory without prompting confirmation before removing any files. For example: //rm -f omega*// | + | If you are very sure about the files you wish to remove, you can use " **-f** " option to remove all files in a directory without prompting confirmation before removing any files. For example: //rm -f omega*// |
---- | ---- | ||
Line 109: | Line 98: | ||
- | ===== SCRATCH area on ssh.sissa.it is reachable from outside SISSA ===== | ||
- | The common SCRATCH area on ssh.sissa.it is reachable from outside SISSA through [[on-line_resources:faq:server-ssh-sftp|ssh.sissa.it and sftp.sissa.it ]]\\ | ||
- | |||
- | The scratch area on ssh.sissa.it is useful when: | ||
- | * you have not enough space on your main directory of the SISSA main cluster due to your quota, **and** | ||
- | * you can not use a VPN connection to reach the local scratch area of your workstation **and** | ||
- | * you need to copy on this area some files (for example from the local scratch area of your workstation) in order to use these files outside internal SISSA network. | ||
- | |||
- | {{ :disk:scratchshannonusage-a.jpg?270x150|An image with the previous explanation.}}\\ | ||
- | This is an example of a typical usage of ssh.sissa.it scratch area:\\ | ||
- | * **1)** do not put your files on /scratch of //ssh.sissa.it// directly; create first a subdirectory with your username using on ssh.sissa.it this command: **mkdir /scratch///yourusername//** | ||
- | * **2)** then copy your files from the local scratch area of your workstation to the common scratch area /scratch///yourusername// on //ssh.sissa.it// using **scp** command.\\ | ||
- | <note i> | ||
- | Keep on /scratch directory of ssh.sissa.it only copies, **do not keep original files, because files older than 30 days will be deleted. All the files in /scratch areas are never saved**!!!!!!!! | ||
- | </note> | ||
\\ | \\ | ||