View Source

General information

You will be able to upload files to the buckets you've created (see How to Create Buckets). After your content has been uploaded, it will be mirrored in Glacier Deep Archive in the bucket that duplicates your bucket names with the-repl suffix. You will not be able to do anything with the content in the -repl bucket. You will be able to see filenames, as a reassurance that your content has been mirrored, but if you attempt to download or get information about the files, you will likely encounter "Access denied" or "Failure to read attributes of [filename]. Forbidden. Request Error" or other errors. Files in these -repl buckets will only be accessed in the event of checksum failure in your active file structures, so those files can be replaced by this Glacier Deep Archive copy.

Note: DuraCloud is intended primarily for the long-term storage and preservation of digital assets. Frequent or repeated access to private files within the system may lead to increased operational costs and could potentially compromise data integrity. Users are advised to limit such access and use DuraCloud in accordance with its preservation-focused purpose.

CLI option

Refer to https://docs.aws.amazon.com/cli/latest/userguide/cli-services-s3-commands.html

Upload files (entire folder)

aws s3 sync ./local-folder s3://{stackname}-bucket

Upload a single file

aws s3 cp myfile.txt s3://{stackname}-bucket

Cyberduck option

Cyberduck documentation on File Transfers

Uploading folders or individual files is as simple as clicking and dragging from a folder in File Explorer / Finder into Cyberduck client. Alternatively, you can click on the "Upload" button in the Cyberduck client to browse which files or folders you wish to upload.
Cyberduck will provide a pop-up log regarding whether or not upload was successful; there will be another pop-up message if there are any errors or issues with the upload process (such as if you are not authorized to upload to that bucket).

SFTPGo option

Uploading folders or individual files is as simple as clicking and dragging from a folder in File Explorer / Finder into the web application. Alternatively, you can click in the "drop files here to upload" message to browse which files or folders you wish to upload.
You cannot upload an empty folder, but you can create folder structures within your -private and -public folders before you begin uploading content.
Uploading very large files will take a long time and may time out if the file is too large. If you have files larger than 1-2GB in size to upload, you may need to download Cyberduck or another tool to connect to your S3 account in order to upload that content.

Duracloud 2.0 > Uploading files > how_to_create_folders_in_sftpgo.png

Use the "New Folder" button to create your folder structure(s) before you begin uploading content.

The web application will show you a file list of all files you are planning to upload so you can confirm you've copied over the right items by filename and immediate filepath. After uploading content, do not forget to hit the save button in the bottom right corner! Otherwise your content will not be uploaded.
After your upload is complete, you will see your preserved file structure with files. You can change how many search results appear on the screen if you like; the default is 10 results at a time, but you can increase up to 500.

Duracloud 2.0 > Uploading files > folder_structures_change_display_results.png

Screen display showing preserved folder structure and the option to change the number of displayed results.

Reminder: you will not see the replicated file structure in the SFTPGo web application, but your files are still being replicated in Glacier with this option.

We have noticed sometimes getting a generic "Error uploading files" message from SFTPGo. When closing the error and attempting to upload files again, this has so far worked successfully (sometimes we have had to X out the error 2 times in order to upload). We are not yet certain where that error message is coming from, perhaps from attempting to upload files when your session has expired. This is an area for more exploration and feedback.