Testing Blocker Tickets

• RC-1
  • Reverting inadvertent breaking-change commit: https://github.com/fcrepo4/fcrepo4/commit/a1fb5ae3944122584a1a808f0ea811a701793370
• RC-2
  •  - non-blocker

External Projects

Hydra (instructions)

Project	Tested by	Success? RC-1	Success RC-2	Notes
ActiveFedora	Jennifer Smith
CurationConcerns
Hyrax	Jennifer Smith
Sufia	Jennifer Smith			Tested sufia 7.3-stable branch.  Had to change i18n gem to version 0.8.1.
Plum	Esmé Cowles
Valkyrie	Esmé Cowles
Avalon 6.0	Carrick Rogers			Also currently running on our AWS based staging environment. Plans to do load testing and performance testing as well.

Islandora

Project	Tested by	Success? RC-1	Success? RC-2	Notes
CLAW	Daniel Lamb			Tested basic CRUD and "relaxed" system properties.

API-X

Project	Tested by	Success? RC-1	Success? RC-2	Notes
fcrepo-api-x-integration	Aaron Birkland
fcrepo-api-x-demo (Docker)	Aaron Birkland			Previous versions of Fedora had to be patched due to unreleased bugfixes. 4.7.4-RC2 worked OK out of the box.

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.4-RC

Sanity Builds

Project	Command	Platform	Tested by	Success RC1?	Success RC2?	Notes
fcrepo4	mvn clean install	linux	Andrew Woods
fcrepo4	mvn clean install	mac	Jared Whiklo
fcrepo4	mvn clean install	windows	Aaron Birkland
fcrepo-module-auth-rbacl	mvn clean install	linux	Andrew Woods
fcrepo-module-auth-rbacl	mvn clean install	mac	Jared Whiklo
fcrepo-module-auth-rbacl	mvn clean install	windows	Aaron Birkland
fcrepo-module-auth-xacml	mvn clean install	linux	Andrew Woods
fcrepo-module-auth-xacml	mvn clean install	mac	Jared Whiklo
fcrepo-module-auth-xacml	mvn clean install	windows	Aaron Birkland
fcrepo-module-auth-webac	mvn clean install	linux	Andrew Woods
fcrepo-module-auth-webac	mvn clean install	mac	Jared Whiklo
fcrepo-module-auth-webac	mvn clean install	windows	Aaron Birkland
fcrepo-mint	mvn clean install	linux	Andrew Woods
fcrepo-mint	mvn clean install	mac	Jared Whiklo
fcrepo-mint	mvn clean install	windows	Aaron Birkland
fcrepo-audit	mvn clean install	linux	Andrew Woods
fcrepo-audit	mvn clean install	mac	Jared Whiklo
fcrepo-audit	mvn clean install	windows	Aaron Birkland
fcrepo-webapp-plus	mvn clean install	linux	Andrew Woods
fcrepo-webapp-plus	mvn clean install	mac	Jared Whiklo
fcrepo-webapp-plus	mvn clean install	windows	Aaron Birkland
fcrepo-webapp-plus	mvn clean install -Pwebac	linux	Andrew Woods
fcrepo-webapp-plus	mvn clean install -Pwebac	mac	Jared Whiklo
fcrepo-webapp-plus	mvn clean install -Pwebac	windows	Aaron Birkland

One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click

Command	Platform	Tested by	Success RC1?	Success RC2?	Notes
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar	Linux	Andrew Woods
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar	Mac	Danny Bernstein
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar	Windows	Aaron Birkland

Manual Tests

1. Create nested containers
2. Create binary resources
3. Run fixity on binary
4. Update Properties:  Perform SPARQL-Update on container
5. Update Properties:  Perform SPARQL-Update on binary
6. Delete container
7. Delete binary
8. Use transactions
9. Create versions
10. View versions
11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

Database	Platform	Tested by	Success RC2?	Notes
MySQL	osx	Danny Bernstein	except issue with #9	Should versioning the root node be a problem? Issue has nothing to do with mysql or database use.
PostgreSQL	linux	Jared Whiklo		Postgres 9.3.14

fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources

• These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
• This script can be used to walk your repository, failing if a non-success response is encountered.

Tested by	Platform	Container (Tomcat/Jetty)	Database Backend	From Fedora Version	To Fedora  Version	Number of RDF Resources	Number of Binaries	Size of Backup (du -h .)	Success?	Notes
Andrew Woods	Linux	Jetty	File-simple	4.7.4	4.7.4	100	100	58M

NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

Vagrant Tests

vagrant destroy
vagrant up

Test steps	Tested by	Success RC1?	Success RC2?	Notes
FEDORA_AUTH=true FEDORA_AUDIT=false	Andrew Woods
FEDORA_AUTH=false FEDORA_AUDIT=false	Andrew Woods
FEDORA_AUTH=true FEDORA_AUDIT=true	Andrew Woods
FEDORA_AUTH=false FEDORA_AUDIT=true	Andrew Woods

Manual Tests

Same as above, plus:

1. Verify audit events are in triplestore
2. Verify resources are in triplestore
3. Verify resources are in Solr
4. Verify authorization works for the two auth-enabled configurations
5. Verify reindexing to triplestore works

Backwards Compatibility Tests

1. Start 4.7.0 one-click
2. Load sample datasets via /fcr:restore
3. Run test scripts on 4.7.0
4. Stop 4.7.0
5. Start RC one-click
6. Run test scripts on RC
7. ReStart RC
8. Run test scripts on RC

Tested by	Success RC2	Notes
Andrew Woods

Resources

[1] Testing scripts

[2] Fedora 4 Release Test Suite