...
- Without Authorization Enabled: Test - Repository Profile: Basic
With Authorization Enabled: Test - Repository Profile: Basic with authorization
- Fcrepo4 Git commit: https://github.com/sprater/fcrepo4/commit/5aae3e199931a76d611da9400aff55e7f48d4c22fa517f25580372784cbd015c13a69e941a3955d1
Setup Profile:
...
The benchmarking tool is available on github: https://github.com/futuresfcrepo4-labs/benchtool
| Code Block |
|---|
git clone git@github.com:futuresfcrepo4-labs/benchtool.git cd benchtool mvn install |
...
Benchtool command (one thread):
no authz: java -cpjar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jarorg.fcrepo.bench.BenchToolFC4-f http://saez:8080 -s 1048576 -n 1000 -t 1 -a ingest
with authz: java -jar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar -f http://saez:8080 -s 1048576 -n 1000 1048576-t 1 -a ingest -u adminuser -p turnip2
| Threads | ObjectsContainers | BinaryDatastream | AuthZ Time (ms) | No AuthZ Time (ms) | |
|---|---|---|---|---|---|
| 1 | 1000 | 1MB | 535,091 ms | 510,248 1072145 ms | |
| 2 | 1000 | 1MB | 464,909 ms | 408,316 853485 ms | |
| 4 | 1000 | 1MB | 402,695 ms | 387,168 854603 ms | |
| 8 | 1000 | 1MB | 393,567 ms | 384,786 ms801720 ms |
Read Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Read
Benchtool command (one thread):
no authz: java -cpjar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC4jar -f http://saez:8080 -s 1048576 -n 1000 -t 1 -a read
with authz: java -jar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar -f http://saez:8080 -s 1048576 -n 1000 1048576-t 1 -a read -u adminuser -p turnip2
| Threads | ObjectsContainers | BinaryDatastream | AuthZ Time (ms) | No AuthZ Time (ms) |
|---|---|---|---|---|
| 1 | 1000 | 1MB | 8504 ms | 21937 6481 ms |
| 2 | 1000 | 1MB | 4343 ms | 12387 3299 ms |
| 4 | 1000 | 1MB | 4409 ms | 7499 3463 ms |
| 8 | 1000 | 1MB | 3910 ms | 6793 3472 ms |
Update Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Update
Benchtool command (one thread):
no authz: java -cpjar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC4jar -f http://saez:8080 -s 1048576 -n 1000 -t 1 -a update
with authz: java -jar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar -f http://saez:8080 -s 1048576 -n 1000 1048576-t 1 -a update -u adminuser -p turnip2
| Threads | ObjectsContainers | BinaryDatastream | AuthZ Time (ms) | No AuthZ Time (ms) | |
|---|---|---|---|---|---|
| 1 | 1000 | 1MB | 200,431 ms | 174,545 709007 ms | |
| 2 | 1000 | 1MB | 137,125 ms | 124,240 ms579997 ms | |
| 4 | 1000 | 1MB | 141,977 ms | 128,048 438686 ms | |
| 8 | 1000 | 1MB | 135,004 ms | 149,371 321657 ms |
Delete Test Matrix
Workflow profile: Test - Workflow Profile: Benchtool Delete
Benchtool command (one thread):
no authz: java -cpjar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC4jar -fdeletehttp://saez:8080-s 1048576 -n 1000 -t 1 -a
with authz: java -jar target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar -f http://saez:8080 -s 1048576 -n 1000 1048576-t 1 -a delete -u adminuser -p turnip2
| Threads | ObjectsContainers | BinaryDatastream | AuthZ Time (ms) | No AuthZ Time (ms) | |
|---|---|---|---|---|---|
| 1 | 1000 | 1MB | 126,261 ms | 112,387 228857 ms | |
| 2 | 1000 | 1MB | 96,281 ms | 92,130 196305 ms | |
| 4 | 1000 | 1MB | 100,309 ms | 92,542 195874 ms | |
| 8 | 1000 | 1MB | 101,414 ms | 92,472 204004 ms |