...
- Storage environment: for the purposes of this test (and for our real migration), we are migrating from one CIFS-mounted remote filesystem to another CIFS-mounted remote filesystem.
- Datastream index: takes about 1h10m minutes to build, and occupies 327MB of disk space.
- CPU time. Consumes about x% on average.
- Source layout. Akubra hash storage, using the pattern "#/##/##" for both datastreams and objects.
...
Number | Execution | Average seconds per object | OCFL repository size | Source | Migration | Notes |
---|---|---|---|---|---|---|
1000 | Datastream index: 1h17m OCFL repo: 4h36m | 16.3 sec | 184GB | Akubra |
| with param --pid-file=1000pids.txt datastream index cleared after run |
10,000 | Datastream index: 1h5m OCFL repo: 11h48m | 4.3 sec | 688GB | Akubra | (81586bf ) | with param --pid-file=10000pids.txt |
100,000 | Datastream index: 1h9m OCFL repo: 3d20h16m | 3.3 sec | Akubra | | with param --pid-file=100000pids.txt datastream index cleared after run | |
All 561,000 | Akubra |
...