A harness to evaluate performance for Fedora Futures platform candidates.
Test Data
Set 1: Digital Corpora govdocs
Set 2: OpenPlanets
Set 3: Random binary data created from a stable set of filesizes
The govdocs dataset includes (…), (…some characteristics, e.g. N PDF documents, varying in size from X to Y)
The OpenPlanets dataset …
(Description of fixture processing, generation of bagits)
The Random binary data
The set is created by the script https://github.com/futures/ff-fixtures/blob/master/create_random_files.sh which writes the files to objects/random
and creates the necessary manifest-md5.txt
file for the JMeter Tests at https://github.com/futures/ff-jmeter-madness
It works by using some standard GNU commands including dd, rm and md5sum and iterates over er the filesizes in https://github.com/futures/ff-fixtures/blob/master/random_sizes.data in order to create one file of the given size in megabyte.
Ingest Test
1. For each "bag", create an "object" (i.e. whatever the equivalent is for the platform candidate)
2. For each resource described in the bag's manifest, add a "datastream" (again, whatever the equivalent is for the platform candidate).
Update Test