Data Den Policies

Small File Limitation and Optimal Size

Data Den’s underlying technology does not work well with small files. Because of this design, each 1TB of Data Den capacity provides only 10,000 files and only migrates files 100MB or larger. The optimal file size ranges from 10–200GB.

Maximum File Size

The maximum file size is 8TB, but files should optimally not be larger than 1TB. Larger archives can be split before uploading to Data Den with the split -b 200G filename command.

System Abuse

Abuse, generally by excessive recalls of data better suited for active storage, of Data Den intentionally or not, may result in performance or access being limited to preserve performance and access for other users. In the event this happens, staff will be in contact with users to engineer more appropriate solutions.