Google drive for educational users has unlimited cloud storage. You may want to archive your datasets there. Although you can do this through a web browser, that is very awkward when you have large amounts of files or are on a remote system where you don’t have a web browser.
Here are some instructions to get going on remote drive access:
Set up rclone
- Download rclone. Note that on bigmac, prism and aurora, rclone is available at /usr/local/bin/rclone
- Configure rclone to see your google drive account. During this process, you will select a name for your remote drive. Below, I will refer to this as GoogleDrive.
Once you have set up rclone, you should play around with some of the commands such as:
rclone lsd GoogleDrive:
lists the contents in the root of your drive.
rclone lsd GoogleDrive:[path]
lists the contents of [path]
rclone ls GoogleDrive:[path]
recursively lists all of the contents of [path]
rclone mkdir GoogleDrive:[path]
Make the path if it doesn’t already exist
rclone can do many things, but what you will usually use it for is copying files to/from drive or synchronizing files with drive.
Copying Files to Drive
rclone <src> GoogleDrive:<dest>
where drive is what you named your remote filesystem in rclone.
Copying Files from Drive
rclone GoogleDrive:<src> <dest>
From the rclone documentation:
rclone sync source:path dest:path
Sync the source to the destination, changing the destination
only. Doesn’t transfer unchanged files, testing by size and
modification time or MD5SUM. Destination is updated to match
source, including deleting files if necessary. Since this can
cause data loss, test first with the –dry-run flag.