...
- Thread Test: Run the same test on the same hardware with increasing numbers of client threads
- Fedora 3/4 Comparison: Run the same tests on the same hardware with both Fedora 3 and 4
Ingest Test Matrix
Fedora 3/4 Comparison
| Objects | Datastream | Fedora 3 Time (ms) | Fedora 4 | Notes | ||
|---|---|---|---|---|---|---|
| 100 | 50MB | 389,034 | 281,301 | Performance evaluation on the SCC Cluster #A & #C | ||
| 100 | 50MB | 881,883 | Performance evaluation on AWS #C | |||
| 100 | 50MB | 8,200 | 70,728 | Test - Cluster Setup - Yale #A & #C | ||
| 100 | 50MB | 134,471 | Test - Platform Profile: Single VM at UNC Chapel Hill | |||
| 25,000100 | 100KB50MB | 231,663 | 131,143 | Platform: Test - Platform Profile: lib-devsandbox1.ucsd.edu, average of 100 ingest batches |
Thread Test
| Objects | Datastream | 1 Thread | 2 Threads | 3 Threads | 4 Threads |
|---|---|---|---|---|---|
| 100 | 50MB | ||||
| 25,000 | 100KB |
...
| Code Block |
|---|
git clone git@github.com:futures/benchtool.git
cd benchtool
mvn install
java -cp target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC4 http://localhost:8080 1000 1024 5 ingest |
To run against Fedora 3 (creating 1000 objects with 1KB datastreams):
| Code Block |
|---|
java -cp target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC3 http://localhost:8983/fedora fedoraAdmin fedoraAdmin 1000 1024 ingest |
While running benchtool will output a running progress percentage, and then output the time to perform the ingest:
| Code Block |
|---|
Complete ingest of 1000 files took 23301 ms |
Read Test Matrix
| Objects | Datastream | Fedora 3 Time (ms) | Fedora 4 | Notes |
|---|---|---|---|---|
| 1,000 | 50MB | 470,466 | 527,349 | Platform: Test - Platform Profile: lib-devsandbox1.ucsd.edu, average of 10 read batches |
Update Test Matrix
| Objects | Datastream | Fedora 3 Time (ms) | Fedora 4 | Notes |
|---|---|---|---|---|
| 1,000 | 50MB | Platform: Test - Platform Profile: lib-devsandbox1.ucsd.edu, average of 10 read batches |
Delete Test Matrix
| Objects | Datastream | Fedora 3 Time (ms) | Fedora 4 | Notes |
|---|---|---|---|---|
| 1,000 | 50MB | Platform: Test - Platform Profile: lib-devsandbox1.ucsd.edu, average of 10 read batches |