Testing Blocker Tickets

External Projects

Samvera

Project

Tested by

Success? RC-1

Notes

ActiveFedora




CurationConcerns




Hyrax


Valkyrie

(tick)


Sufia




Islandora

 Project

Tested by

Success? RC-1

Notes

Islandora 8(tick)

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout <version>-RC

Sanity Builds

Scripts

https://github.com/awoods/fcrepo-build-scripts

ProjectCommandPlatformTested bySuccess?Notes
fcrepo4mvn clean install

linux




fcrepo4mvn clean install mac (tick)
fcrepo4mvn clean installwindows


One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess? Notes
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarLinux


java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarMac(tick)

java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar

Windows


Manual Tests

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions
PlatformTested bySuccess?Notes
OS X(tick)




Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess?Notes
MySQL



PostgreSQL



fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources


Tested by

Platform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora 
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)

Success?

Notes                  


Linux








NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

Vagrant Tests

vagrant destroy
vagrant up


Test stepsTested bySuccess?Notes

FEDORA_AUTH=true




FEDORA_AUTH=false




Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

Backwards Compatibility Tests

  1. Start 5.1.0 one-click
  2. Load sample datasets via /fcr:restore
  3. Run test scripts on 5.1.0
  4. Stop 5.1.0
  5. Start RC one-click
  6. Run test scripts on RC
  7. ReStart RC
  8. Run test scripts on RC
Tested bySuccess RC2Notes






Resources

[1] Testing scripts

[2] Fedora 4 Release Test Suite