Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Testing Blocker Tickets

  • RC-1

    External Projects

    Hydra (instructions)

    Project

    Tested by

    Success? RC-1

    Success RC-2

    Notes

    ActiveFedora



    CurationConcerns





    Hyrax



    Sufia



    Plum




     
    Valkyrie



    Avalon 6.0






    Islandora

     Project

    Tested by

    Success? RC-1

    Success? RC-2

    Notes

    CLAW






    API-X

     Project

    Tested by

    Success? RC-1

    Success? RC-2

    Notes

    fcrepo-api-x-integration





    fcrepo-api-x-demo (Docker)



    Testing Plan

    Code Block
    git clone https://github.com/fcrepo4/fcrepo4
    cd fcrepo4
    git checkout 4.7.

...

  • 5-RC

    Sanity Builds

    ProjectCommandPlatformTested ByRC 1Notes
    fcrepo4mvn clean install

    linux



     
    fcrepo4mvn clean install mac 

     
    fcrepo4mvn clean installwindows

     
    fcrepo-module-auth-rbaclmvn clean installlinux

     
    fcrepo-module-auth-rbaclmvn clean install mac

     
    fcrepo-module-auth-rbaclmvn clean installwindows

     
    fcrepo-module-auth-xacmlmvn clean install linux

     
    fcrepo-module-auth-xacmlmvn clean install mac

     
    fcrepo-module-auth-xacmlmvn clean installwindows

     
    fcrepo-module-auth-webacmvn clean install linux

     
    fcrepo-module-auth-webacmvn clean install mac

     
    fcrepo-module-auth-webacmvn clean installwindows

     
    fcrepo-mintmvn clean install linux

     
    fcrepo-mintmvn clean install mac

     
    fcrepo-mintmvn clean installwindows

     
    fcrepo-auditmvn clean install linux

     
    fcrepo-auditmvn clean install mac

     
    fcrepo-auditmvn clean installwindows

     
    fcrepo-webapp-plusmvn clean install linux

     
    fcrepo-webapp-plusmvn clean install mac

     
    fcrepo-webapp-plusmvn clean install windows

     
    fcrepo-webapp-plusmvn clean install -Pwebac linux

     

    fcrepo-webapp-plusmvn clean install -Pwebacmac

     
    fcrepo-webapp-plusmvn clean install -Pwebacwindows

     

    One-Click Run

    cd fcrepo-webapp; mvn clean install -Pone-click
    CommandPlatformTested ByRC-1Notes
    java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarLinux

     
    java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarMac

     

    java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar

    Windows

     

    Manual Tests

    Info

    All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

    1. Create nested containers
    2. Create binary resources
    3. Run fixity on binary
    4. Update Properties:  Perform SPARQL-Update on container
    5. Update Properties:  Perform SPARQL-Update on binary
    6. Delete container
    7. Delete binary
    8. Use transactions
    9. Create versions
    10. View versions
    11. Rollback versions

    Database Tests

    With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

    DatabasePlatformTested bySuccess RC1?Notes
    MySQL osx

     





    PostgreSQL linux


    fcr:backup/fcr:restore Functionality

    These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

    If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

    See: RESTful HTTP API - Backup and Restore

    # Backup
    curl -X POST localhost:8080/rest/fcr:backup
     
    # Restore
    curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

    Resources

    • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
    • This script can be used to walk your repository, failing if a non-success response is encountered.

     

    Tested by

    Platform

    Container

    (Tomcat/Jetty)

    Database

    Backend

    From Fedora
    Version

    To Fedora 
    Version

    Number of

    RDF Resources

    Number of

    Binaries

    Size of Backup (du -h .)

    Success?

    Notes                  


    LinuxJettyFile-simple4.7.54.7.5
    100


    NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

    Vagrant Tests

    Code Block
    vagrant destroy
    vagrant up


    Test stepsTested BySuccess RC1?Notes

    FEDORA_AUTH=true
    FEDORA_AUDIT=false



     

    FEDORA_AUTH=false
    FEDORA_AUDIT=false



     

    FEDORA_AUTH=true
    FEDORA_AUDIT=true




    FEDORA_AUTH=false
    FEDORA_AUDIT=true




    Manual Tests

    Same as above, plus:

    1. Verify audit events are in triplestore
    2. Verify resources are in triplestore
    3. Verify resources are in Solr
    4. Verify authorization works for the two auth-enabled configurations
    5. Verify reindexing to triplestore works

    Backwards Compatibility Tests

    1. Start 4.7.4 one-click
    2. Load sample datasets via /fcr:restore
    3. Run test scripts on 4.7.4
    4. Stop 4.7.4
    5. Start RC one-click
    6. Run test scripts on RC
    7. ReStart RC
    8. Run test scripts on RC
    Tested bySuccess RC2Notes







    Resources

    [1] Testing scripts

    [2] Fedora 4 Release Test Suite