...
What are the migration times from Fedora 3 to an OCFL representation for a variety of corpus sizes (number of objects, number of petabytes)? What are the rebuild times for Fedora 6 layered over the OCFL representation?
Rebuild performance
What is the speed of the rebuild with different data profiles, database engines, and instance types?
How is rebuild performance affected by instance size (cpu count), database engine, database instance size?
Test Tooling
- Bash scripts used for measuring timing of fixed-scope operations.
- https://github.com/fcrepo4-labs/fcrepo-performance-test-scripts
- Relevant for: Ingest performance, Read performance, Versioning performance, Search performance
- Detailed usage documentation
- JMeter scripts used for measuring limits of scale and stress. These tests run until the application dies.
- https://github.com/fcrepo4-labs/fcrepo4-jmeter
- Relevant for: Ingest performance, Read performance, Versioning performance
- Detailed usage documentation
- Fedora API Test Suite is used to measure compliance of the Fedora application with the Fedora API specification.
- https://github.com/fcrepo/Fedora-API-Test-Suite
- Relevant for: API specification compliance
- Detailed usage documentation
- Python OCFL validator used to measure compliance of an OCFL structure with the OCFL specification.
- https://github.com/zimeon/ocfl-py
- Relevant for: OCFL compliance, Migration performance and validation
- Detailed usage documentation
- Fedora 3 to 6 migration tooling used for migrating F3 objects into OCFL over which F6 can be layered.
- https://github.com/fcrepo4fcrepo-exts/migration-utils
- Relevant for: Migration performance and validation
- Detailed usage documentation
Test Results
Current test results can be found on the Fedora 6 Test Results page.
Historical Results
One of the benefits of running these tests is to measure the change in performance characteristics in relation to previous versions of Fedora. Ideally, one of the products of this testing initiative will be to have a clear depiction, across the test categories, of performance result summaries from the past and present.
Although a consolidated summary of previous tests is not available in a single location, the following references point to the locations where previous test results can be found:
- Results from "bash scripts"
- Results from "JMeter scripts"
- Results from "Fedora API Test Suite"
- Results from very early, ad hoc testing