National Center for Computational Sciences

Data Transfer Nodes

Two dedicated data transfer nodes are provided to NCCS users. The nodes have been tuned specifically for wide area data transfers, and also perform well on the local area. They are recommended for data transfers as they will, in most cases, improve transfer speed and help decrease load on computational systems’ login and service nodes. More information on these nodes can be found on the Data Transfer Nodes page.

BBCP

For larger files, the multistreaming transfer utility BBCP is recommended. The BBCP utility is capable of breaking up your transfer into multiple simultaneously transferring streams, thereby transferring data much faster than single-streaming utilities such as SCP and SFTP. More information can be found on the BBCP page.

GridFTP

GridFTP is a high-performance data transfer protocol based on FTP and optimized for high-bandwidth wide-area networks. More information can be found on the GridFTP page.

SFTP and SCP

The SSH-based SFTP and SCP utilities can be used to transfer files to and from NCCS systems. Because these utilities can be slow, we recommend using them to transfer small numbers of smaller files. More information on these utilities can be found on the SFTP/SCP page.

SPDCP

spdcp is a parallel Lustre aware copy tool. The tool can be used to copy large datasets between Lustre filesystems. More information can be found on the spdcp page.

HSI

Access to the HPSS is accomplished through the Hierarchical Storage Interface (HSI) utility. More information can be found on the HSI page.