Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Testing Blocker Tickets

  • ...

External Projects

...

Samvera

Project

Tested by

Success? RC-1

Notes

ActiveFedora




CurationConcerns




Hyrax


Plum




Islandora

 Project

Tested by

Success? RC-1

Notes

Islandora 8

...




Testing Plan

Code Block
git clone https://github.com/fcrepo4fcrepo/fcrepo4fcrepo
cd fcrepo4fcrepo
git checkout <version>-RC

Sanity Builds

Scripts

https://github.com/awoods/fcrepo-build-scripts

ProjectCommandPlatformTested bySuccess?Notes
fcrepo4mvn clean install

linux

   fcrepo4mvn clean install mac    fcrepo4mvn clean installwindows  
 
fcrepo
-module-auth-rbacl
mvn clean install

linux

 

  



fcrepo
-module-auth-rbacl
mvn clean install 
mac   
mac 


fcrepo
-module-auth-rbacl
mvn clean installwindows
   fcrepo-module-auth-xacmlmvn clean install linux

 

  fcrepo-module-auth-xacmlmvn clean install mac   fcrepo-module-auth-xacmlmvn clean installwindows   fcrepo-module-auth-webacmvn clean install linux

 

  fcrepo-module-auth-webacmvn clean install mac   fcrepo-module-auth-webacmvn clean installwindows   fcrepo-mintmvn clean install linux   fcrepo-mintmvn clean install mac   fcrepo-mintmvn clean installwindows   fcrepo-transformmvn clean install linux

 

  fcrepo-transformmvn clean install mac   fcrepo-transformmvn clean installwindows   fcrepo-auditmvn clean install linux

 

  fcrepo-auditmvn clean install mac   fcrepo-auditmvn clean installwindows   fcrepo-webapp-plusmvn clean install linux

 

  fcrepo-webapp-plusmvn clean install mac   fcrepo-webapp-plusmvn clean install windows   fcrepo-webapp-plusmvn clean install -Prbacl mac  

 

fcrepo-webapp-plusmvn clean install -Prbaclwindows   fcrepo-webapp-plusmvn clean install -Prbacllinux   fcrepo-webapp-plusmvn clean install -Pxacmlmac  

 

fcrepo-webapp-plusmvn clean install -Pxacmlwindows   fcrepo-webapp-plusmvn clean install -Pxacmllinux   

One-Click Run




One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess? Notes
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar
 Linux   
Linux


java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarMac
   



java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar

Windows
  
 



Manual Tests

Info

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess?Notes
MySQL



PostgreSQL



fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 

...


# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources

  • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
  • This script can be used to walk your repository, failing if a non-success response is encountered.


Tested by

Platform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora 
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)

Success?

Notes                  


Linux








NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

Vagrant Tests - Outdated, needs docker replacement.

...

Code Block
vagrant destroy
vagrant up


Test stepsTested bySuccess?Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true

 

 

 

 

 

FEDORA_AUTH=

false
FEDORA_AUDIT=

true

  

 

FEDORA_AUTH=true
FEDORA_AUDIT=false

   




FEDORA_AUTH

=false
FEDORA_AUDIT

=false

   



Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] https://github.com/fcrepo4-labs/fcrepo4-release-tests

Backwards Compatibility Tests

  1. Start 4.7.0 one-click
  2. Load sample datasets via /fcr:restore
  3. Run test scripts on 4.7.0
  4. Stop 4.7.0
  5. Start RC one-click
  6. Run test scripts on RC
  7. ReStart RC
  8. Run test scripts on RC
Tested bySuccess RC2Notes






Resources

[1] Testing scripts

[2] Fedora 4 Release Test Suite