Back to Main Page

File System Layouts & Policy

User File Systems
GPFS File Systems
NFS Mounted File Systems
Remote GPFS File Systems
Space Allocations
/ptmp Scrubber Policy

User File Systems

The Data Analysis & Visualization Lab utilizes high performance shared file system technology, GPFS, to support most work spaces on the hosts. The GPFS file system allows all systems within the Lab to see the same file space, therefore users can work on any host with the same view of their data. Other file systems are NFS from the appropriate server.

NOTE: NFS file systems are mounted dynamically when a user changes to a valid directory. Therefore, they will not show up in df output unless they are currently being utilized.

GPFS File Systems

Filesystem	Total Size	Backup	Description
/ptmp/username	30 TB	no	scatch space, 150 GB quota
/gpfs/proj0	59 TB	no	project file spaces
/gpfs/NRCM	18 TB	no	project file system
/gpfs/hacker	4.4 TB	no	project file system

NFS File Systems

Filesystem	Total Size	Backup	Description
/fs/home/username	98 GB	yes	login directory, general work space, 500MB quota
/contrib	20 GB	no	software contribution area

Remote GPFS File Systems

Filesystem	Backup	Description
/biptmp	no	bluefire /ptmp directories, scrubbed
/gfps/blhome	yes	bluefire /home/bluefire/username directory
/mmm/users	no	MMM divisional file system
/mmm/mmmtmp	no	MMM divisional file system
/cgd	no	CGD divisional file system
/acd	no	ACD divisional file system
/hao	no	HAO divisional file system
/rap	no	RAP divisional file system
/ccsm	no	CCSM project file system
/waccm	no	WACCM project file system
/fis01/cgd	yes	CGD backed up project space
/fis01/cgd/home	yes	CGD backed up project space
/fis02/scd/home	yes	SCD backed up project space
/fis02/other/home	yes	backed up project space
/fis02/hao/home	yes	HAO backed up project space
/fis02/hao/tgcm	yes	HAO backed up project space
/fis02/mmm/projects/mesouser	yes	MMM backed up project space
/fis02/mmm/projects/wrfhelp	yes	MMM backed up project space

Space Allocation

/fs/home/username

all users are given a home directory which is common to all hosts
the default quota will be 500MB per user
there is NO scrubber
all files will be backed up on a regular basis

/ptmp

all users get an allocation when they get a account
the default quota will be 150GB quota per user
we will run a scrubber
there will be NO backups of this file system

/ptmp Scrubber Policy

The /ptmp file system will be scrubbed on a regular basis to ensure that enough free space is available for all users. In order to balance this need with the need to have data resident for a reasonable amount of time, scrubbing will be done according to the following policy.

The file system will be scrubbed when it becomes 95% full
Files will be scrubbed based on age with the oldest files going first
The file system will be reduced to 90% full
Files newer than three months will not be scrubbed automatically

If we can not reach the 90% mark, we will contact users with the largest number of files and ask them to clean up. If the file system reaches 99% full, we will scrub to return to 95% even if files are newer than three months.

We ask that all users be aware of what data they have on the system. By removing data that you don't need any longer we can potentially avoid having to scrub newer files. Always keep in mind that this data is not backed up, so when it is removed it is gone.