Performance tests using benchtool were performed using two machines:
- Desktop: 2010 MacPro (dual 2.26GHz Quad-core Xeon, 6GB RAM, 3GB/s SATA disk)
- Laptop: 2013 Macbook Air (1.3GHz Core i5, 8GB RAM, 10GB/s SSD disk)
- Connected via 802.11n wifi
Depending on which machine was used as the client and which was used as the server, I get dramatically different results:
| Client | Server | F3 time (ms) | F3 throughput (mb/s) | F4 single time (ms) | F4 single | F4 minimal time (ms) | F4 minimal thoughput (mb/s) | Comparison |
|---|---|---|---|---|---|---|---|---|
| desktop | laptop | 1,103,646 | 4.64 | 1,218,615 | 4.20 | 554,228 | 9.24 | F4 minimal 2x faster |
| laptop | desktop | 1,245,344 | 4.11 | 2,963,019 | 1.73 | 635,166 | 8.06 | F4 minimal 2x faster |
| laptop | laptop | 64,250 | 78.69 | 693,911 | 7.37 | 63,870 | 80.16 | approx. equal |
| desktop | desktop | 215,586 | 23.75 | 2,510,928 | 2.04 | 102,774 | 49.82 | F4 minimal 2x faster |
The hardware used for these tests is not the typical server hardware I would normally expect to be used for running repository software. But the differences suggest that some aspect of my setup (network latency, slower disk, etc.) impacts F4 much more dramatically than F3.
Ingesting 25,000 Objects
On the laptop detailed above, I ingested 25,000 objects using benchtool, with one 100KB datastream per object. Below are the times (in milliseconds) to process each batch of 1,000 objects). Fedora 3 processed successive batches at constant speed, but each Fedora 4 batch took longer than the previous batch. Switching to leveldb storage produced the same trend, but at a slightly slower starting point.
| batch | Fedora 3 | Fedora 4 (minimal) | Fedora 4 (minimal/leveldb) |
|---|---|---|---|
| 1 | 49847 | 33795 | 40453 |
| 2 | 36740 | 36815 | 49240 |
| 3 | 34369 | 39375 | 62152 |
| 4 | 33280 | 47404 | 71717 |
| 5 | 32756 | 53092 | 81081 |
| 6 | 32433 | 61366 | 89874 |
| 7 | 32441 | 66524 | 97485 |
| 8 | 31839 | 73329 | 106713 |
| 9 | 32016 | 79913 | 115740 |
| 10 | 32038 | 84424 | 123734 |
| 11 | 31628 | 92909 | 133757 |
| 12 | 31356 | 96724 | 138626 |
| 13 | 31478 | 105221 | 150474 |
| 14 | 31166 | 114825 | 163861 |
| 15 | 30993 | 119416 | 170712 |
| 16 | 30922 | 127985 | 180907 |
| 17 | 30700 | 130925 | 189496 |
| 18 | 30920 | 140059 | 201232 |
| 19 | 30706 | 143905 | 205339 |
| 20 | 30820 | 153584 | 219809 |
| 21 | 30635 | 156370 | 229460 |
| 22 | 30943 | 166349 | 238547 |
| 23 | 30814 | 174377 | 249617 |
| 24 | 31340 | 183079 | 257109 |
| 25 | 31603 | 208978 | 281443 |
