A harness to evaluate performance for Fedora Futures platform candidates.
https://github.com/futures/ff-jmeter-madness
Test Process
1. Delete each test "object"
2. Create an object
3. Retrieve the object
4. Add "datastreams"
5. Modify the datastreams a specified number of times
6. Read the datastreams
Test Software
Apache Jmeter version 2.9 installed on futures1 (see Test Platform for details)
The jmeter test script fedora.jmx implements the above process for a fedora rest API.
Test Data
The test data is generated at run time to produce a random binary data created from a stable set of file sizes, as explained in Test corpora - The generated binary dataset
The generation of files has been included in the jmeter test plan and does not need to be generated separately.
Test Platform
Test Results
The Jmeter test produces a csv file (one for each repeat) containing the columns ----
Analyzing the Test Results
Analysing the test results
The stats visualizations were done using R (http://www.r-project.org/).
The code used to produce the graphs is in fedora-jmx.r.
- To execute the code,
$ R
> source('/path/to/the/file/fedora-jmx.r') - The program will ask you to choose the directory which contains the test results (csv format)
- It will run through all the files, gather the data and produce 3 graphs and a summary of the data. These will be saved in your current working directory. (See Fedora's test results for an example of the plots generated)
The plots are used to measure the robustness of the software and the time it takes to respond to requests. This is tested for increasing loads to the system.
