...
| Tip |
|---|
Using the single-file configuration ingest and retrieval of files up to the size of 300 GB using Fedora 4's REST API were tested successfully. The files were ingested sequentially, retrieved and a bitwise comparison with the original data has been performed. Larger sizes have not been tested, due to HDD size limitations. |
Large File Upload/Download Roundtrip via REST API Tests
- Platform: lib-devsandbox1.ucsd.edu (all data on NAS to handle large files)
- Repository Profile: Minimal
- Workflow Profile: Upload/Download Roundtrip
| File Size | Upload | Download |
|---|---|---|
| 256GB | 15,488,156ms (16.9MB/sec) | 3,306,756ms (79.3MB/sec) |
| 512GB | 31,262,610ms (16.77MB/sec) | 5,386,542ms (97.33MB/sec) |
| 1TB | 59,631,142ms (17.58MB/sec) | 15,120,135ms (69.35MB/sec) |
- Conclusion: Arbitrarily-large files can be ingested via the REST API. The only apparent limitations are disk space available to store the file, and sufficiently large Java heap size (tested with -Xmx2048m).
Large File Upload/Download Roundtrip Tests
- Platform: Linux 3.12.1-1-ARCH #1 SMP PREEMPT x86_64 GNU/Linux 16GB RAM
- Repository Profile: Single-File
- Workflow Profile: Upload/Download Roundtrip
...