Institute for Advanced Simulation (IAS)
Servicemeu
- Deutsch
- English
-
Search
What data quotas do exist and how to list usage?
For all data repositories the disk quota managing is enabled. The values are set to default values (defined by JSC) or depend on special requirements by the projects.
Default data quota per user/project within GPFS file systems
File System | Disk Space | Number of Files | ||
|---|---|---|---|---|
| Soft Limit | Hard Limit | Soft Limit | Hard Limit | |
| $HOME | 10 GB | 11 GB | 40.000 | 44.000 |
| $SCRATCH | 90 TB | 95 TB | 4 Mio | 4.4 Mio |
| $PROJECT | 16 TB | 17TB | 3 Mio | 3.1 Mio |
| $FASTDATA | as granted to project | soft limit + up to 10% additional | as granted to project | soft limit + up to 10% additional |
| $DATA | as granted to project | soft limit + up to 10% additional | as granted to project | soft limit + up to 10% additional |
| $ARCHIVE | as granted to project | soft limit + up to 10% additional | as granted to project | soft limit + up to 10% additional |
File size limit
Although the file size limit on operation system level e.g. at JUWELS or JURECA is set to unlimited (ulimit -f) the maximum file size can only be the GPFS group quota limit for the corresponding file system. The actual limits can be listed by jutil.
List data quota and usage by project or user
Members of a group/project can display the hard limits, quotas (soft limit) and usage by each user of the project using the jutil command.
jutil project dataquota -p <project name>
The quota information for the users are updated every 8 hours.
Recommendation for users with a lot of small files
Users with applications that create a lot of relatively small files should reorganize the data by collecting these files within tar-archives using the
tar -cvf archive-filename ...
command. The problem is really the number of files (inodes) that have to be managed by the underlying operating system and not the space they occupy in total. On the other hand please keep in mind the recommendations under File size limit.
