Platform Profile:
Repository Profile:
- Fcrepo4 Git commit: https://github.com/futures/fcrepo4/commit/2afdcf07f701fb4026acbe93fe256fc43a5883ee
Setup Profile:
Benchtool
The benchmarking tool is available on github: https://github.com/futures/benchtool
...
Create Property Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Property Create
Benchtool command (one thread):
...
Read Property Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Property Read
Benchtool command (one thread):
...
Update Property Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Property Update
Benchtool command (one thread):
...
Delete Property Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Property Delete
Benchtool command (one thread):
...
| Threads | Objects | Datastream | Delete Property Time (ms) |
|---|---|---|---|
| 1 | 10000 | 1KB | 1,998,672 ms |
| 2 | 10000 | 1KB | 1,850,666 ms |
| 4 | 10000 | 1KB | 2,064,493 ms |
| 8 | 10000 | 1KB | 1,890,930 ms |
CRUD Concurrent Integration Test
Running CRUD integration tests (FedoraCrudConcurrentIT.java in fcrepo-http-api) for simple objects and small content files CREATE, UPDATE, DELETE and RETRIEVE with 2, 4, 8, 16, 32 concurrent threads.
Average CRUD response time (ms) for simple objects
Test result started with threads [2, 4, 8, 16, 32]:
| Threads | Create | Update | Retrieve | Delete |
|---|---|---|---|---|
| 2 | 2421 | 483 | 58 | 33 |
| 4 | 34 | 32 | 20 | 21 |
| 8 | 44 | 31 | 17 | 17 |
| 16 | 27 | 31 | 15 | 18 |
| 32 | 28 | 33 | 12 | 130 |
Test result started with threads [32, 16, 8, 4, 2]:
| Threads | Create | Update | Retrieve | Delete |
|---|---|---|---|---|
| 32 | 136 | 83 | 17 | 18 |
| 16 | 38 | 27 | 12 | 15 |
| 8 | 18 | 23 | 14 | 14 |
| 4 | 18 | 23 | 11 | 13 |
| 2 | 22 | 177 | 10 | 143 |
Average CRUD response time (ms) for content files
Test result started with threads [2, 4, 8, 16, 32]:
| Threads | Ingest | Update | Retrieve | Delete |
|---|---|---|---|---|
| 2 | 248 | 74 | 12 | 29 |
| 4 | 82 | 53 | 12 | 24 |
| 8 | 57 | 52 | 8 | 21 |
| 16 | 61 | 39 | 8 | 29 |
| 32 | 71 | 699 | 35 | 194 |
Test result started with threads [32, 16, 8, 4, 2]:
| Threads | Create | Update | Retrieve | Delete |
|---|---|---|---|---|
| 32 | 81 | 56 | 8 | 23 |
| 16 | 68 | 56 | 8 | 17 |
| 8 | 55 | 30 | 5 | 21 |
| 4 | 48 | 34 | 6 | 16 |
| 2 | 110 | 838 | 5 | 297 |
