...
- Many Objects: 25K objects with small datastreams (100KB): 2.5GB total data size
- Large Datastreams: 100 objects with larger datastreams (100MB): 9.8GB total data size
In addition to varying the number of objects and datastream size, it is particularly important to perform some tests on the same hardware in order to have directly-comparable data:
- Thread Test: Run the same test on the same hardware with increasing numbers of client threads
- Fedora 3/4 Comparison: Run the same tests on the same hardware with both Fedora 3 and 4
Test Matrix
Fedora 3/4 Comparison
| Objects | Datastream | Fedora 3 Time | Fedora 4 |
|---|---|---|---|
| 100 | 100MB | ||
| 25,000 | 100KB |
Thread Test
| Objects | Datastream | 1 Thread | 2 Threads | 3 Threads | 4 Threads |
|---|---|---|---|---|---|
| 100 | 100MB | ||||
| 25,000 | 100KB |
Using Benchtool
The ingest benchmarking tool is available on github: https://github.com/futures/benchtool
To build and run benchtool (creating 1000 objects with 1KB datastreams using 5 client threads):
| Code Block |
|---|
git clone git@github.com:futures/benchtool.git
cd benchtool
mvn install
java -cp target/bench-tool-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.fcrepo.bench.BenchToolFC4 http://localhost:8080 1000 1024 5 |
While running benchtool will output a running progress percentage, and then output the time to perform the ingest:
| Code Block |
|---|
Complete ingest of 1000 files took 23301 ms |