Test System

Fedora webapp version 4 installed on an AWS test server (see Test AWS Platform for details)

System information: 'systemInfo.txt' has information about the system on which the tests were performed, gathered using the script 'gatherSystemInfo.sh'

• Tests as of 2013-06-17
  
  • systemInfo.txt
  • gatherSystemInfo.sh

Test Harness

1. Start server with puppet script

2. Clone git repositories into /opt

   cd /opt
   sudo git clone https://github.com/futures/ff-jmeter-madness.git ff-jmeter-madness
   sudo git clone https://github.com/futures/ff-jmeter-testResults.git ff-jmeter-testResults

3. Update fcrepo webapp logging to INFO

   sudo vi /var/lib/tomcat7/webapps/fcrepo/WEB-INF/classes/logback.xml

4. Run default (async config) tests

   cd /opt/ff-jmeter-testResults/2013-06-17-Fedora4Tests
   sudo ./fedora4Test.sh

5. Run sync config tests

   sudo vi /etc/default/tomcat7
   # Change to: 
   JAVA_OPTS="${JAVA_OPTS} -Dfcrepo.modeshape.configuration="classpath:/config/single/repository.json"
    
   # Stop tomcat
   sudo service tomcat7 stop
    
   # Clear data dir
   sudo rm -rf /opt/fcrepo4-data/*
    
   # Start tomcat
   sudo service tomcat7 start
    
   # Run tests
   cd /opt/ff-jmeter-testResults/2013-06-17-Fedora4Tests
   sudo ./fedora4Test.sh

Test Results

• The test was run a total of 7 times (1 value of thread count:1, 7 values of file size) for each modeshape configuration
  
  • synchronous indexing configuration
  • asynchronous indexing configuration
• The results are logged to csv files and have been placed in the log directory
• Graphs were generated using R for statistical computing and graphics and the this [script]

A box plot of Thread count vs Time taken to complete a response

Async	Sync

A box plot of Thread count vs Time taken to complete a response, for each of the operations

Async	Sync