Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • audit: there will be a folder for each of the buckets you created; this data is mostly machine-readable and provides details about activities performed on your data.
  • exports: folders in this bucket will provide checksums data organized by date. Within each of those folders will be two sub-folders, one labeled AWSDynamoDB and another labeled CSV. We recommend ignoring the data in the AWSDynamoDB folder unless you are an advanced user, which is highly technical data generated by AWS, and focusing instead on the file manifests with individual checksums for each file in the CSV folder.
    • Header columns in the CSV exports include
      • BucketName (where you uploaded content)
      • ObjectKey (filename)
      • Checksum (the file's checksum)
      • LastChecksumSuccess (will be either TRUE or FALSE)
      • LastChecksumDate
      • LastChecksumMessage ("ok" unless there was a checksum failure)

Note: individual CSV files in this folder structure likely will include data for multiple, but not necessarily all, buckets you have created; you will likely need to download multiple CSVs to get a complete manifest of all files with checksums that can be found in your S3 account.


  • inventory: again, there will be a folder for each of the buckets you created; this folder structure provides a listing of all files in each bucket with a small amount of metadata about the files. Most of this data is technical; you likely will want to review the CSV data in the inventory/$bucket/inventory/data folder structure.
    • Header columns in these CSV exports include
      • BucketName (where you uploaded content)
      • ObjectKey (filename; this CSV includes any folder structure/directories you have uploaded to a bucket)
      • version_id (the latest ID of the object)
      • is_latest (TRUE or FALSE)
      • delete_marker (TRUE or FALSE; probably FALSE unless you have deleted the object)
      • size (size of the uploaded object in bytes; folders or directories will show 0 in size and deleted items will have an empty cell)
      • last_modified (timestamp)
      • storage_class (either STANDARD or GLACIER) - objects remain in standard storage for 7 days before moving to Glacier, unless they are in a -public bucket
    • Also in the inventory folder is a stats folder, which will contain .json files from which the HTML reports are generated in the reports folder.
  • logs: .txt files regarding actions taken; check this folder for error messages when creating buckets and during other steps.
  • reports: Storage reports regarding your DuraCloud usage, saved as HTML files. These reports are the most human-readable and include number of files and storage size broken down by bucket, as well as your overall usage.

...