Versions Compared

Old Version 19

changes.mady.by.user Joshua Westgard

Saved on

compared with

New Version Current

changes.mady.by.user Danny Bernstein

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Testing

...

Tickets

  • RC-1
    • blocker - 
      Jira
      serverDuraSpace JIRA
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2664
    • non-blocker - 
      Jira
      serverDuraSpace JIRA
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2666
    • non-blocker - 
      Jira
      serverDuraSpace JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2665
  • RC-2
    • blocker -
      Jira
      serverDuraSpace JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2667


External Projects

Hydra (instructions)

Project

Tested by

Success? RC-1

Success RC-2

Notes

ActiveFedora

Esmé Cowles

Stuart Kenny

(tick)


(tick)


Hyrax

Esmé Cowles

(tick)



SufiaJennifer Smith(tick)
Tested 7.3-stable branch
Valkyrie

Esmé Cowles

Stuart Kenny

(tick)


(tick)


Avalon 6.0






Islandora

 Project

Tested by

Success? RC-1

Success? RC-2

Notes

CLAW

Jared Whiklo

(tick)(tick)


API-X

 Project

Tested by

Success? RC-1

Success? RC-2

Notes

fcrepo-api-x-integration

Aaron Birkland


(tick)


fcrepo-api-x-demo (Docker)

(tick)

Testing Plan

Code Block
git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.5-RC

Sanity Builds

Scripts

https://github.com/awoods/fcrepo-build-scripts

ProjectCommandPlatformTested ByRC 1

RC 2

Notes
fcrepo4mvn clean install

linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo4mvn clean install mac 

Joshua Westgard

Danny Bernstein (rc-2)

(tick)

(tick)

Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
fcrepo4mvn clean installwindows

Ben Pennell

Aaron Birkland

(error)

(tick)


(tick)


 I wasn't able to perform a sanity build in Windows 10 due to some integration tests in fcrepo-kernel-modeshape failing.  A few of them were failing because the last modified date for binaries was not updating all of the time (tests were flapping).

Jira
serverDuraSpace JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
keyFCREPO-2665

Danny Bernstein: NB - apparently this has been an ongoing issue. Apparently Windows 10 on hyper-v works, but is failing/flapping on direct windows install. Aaron Birkland and Yinlin Chen worked on resolving this a while back but did not crack it.

fcrepo-module-auth-rbaclmvn clean installlinux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo-module-auth-rbaclmvn clean install mac

Peter Eichman

Danny Bernstein(rc2)

(tick)

(tick)

Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

fcrepo-module-auth-rbaclmvn clean installwindows
 fcrepo-module-auth-xacmlmvn clean install linuxAndrew Woods
Aaron Birkland(tick)(tick) 
fcrepo-module-auth-xacmlmvn clean install mac

Peter Eichman

Danny Bernstein (rc2)

???(tick)No 4.7.5-RC branch or tag
fcrepo-module-auth-xacmlmvn clean installwindows


 
fcrepo-module-auth-webacmvn clean install linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo-module-auth-webacmvn clean install mac

Peter Eichman

Danny Bernstein (rc2)

(tick)(tick)

Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

fcrepo-module-auth-webacmvn clean installwindowsAaron Birkland(tick)(tick) 
fcrepo-mintmvn clean install linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo-mintmvn clean install mac

Peter Eichman

Danny Bernstein (rc-2)

(tick)(tick)

Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

fcrepo-mintmvn clean installwindowsAaron Birkland(tick)(tick) 
fcrepo-auditmvn clean install linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo-auditmvn clean install mac

Peter Eichman

Danny Bernstein (rc-2)

(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
fcrepo-auditmvn clean installwindowsAaron Birkland(tick)(tick) 
fcrepo-webapp-plusmvn clean install linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 
fcrepo-webapp-plusmvn clean install 

mac

Danny Bernstein (rc-2)

Peter Eichman

(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
fcrepo-webapp-plusmvn clean install windowsAaron Birkland(tick)(tick) 
fcrepo-webapp-plusmvn clean install -Pwebac linux

Andrew Woods

(tick)

(tick) Jared Whiklo

 

fcrepo-webapp-plusmvn clean install -Pwebac

mac

Danny Bernstein (rc-2)

Peter Eichman

(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
fcrepo-webapp-plusmvn clean install -PwebacwindowsAaron Birkland(tick)(tick) 

Note (18 January 2018): The victims database warnings are due to the victi.ms site currently returning a 503 error. Jared Whiklo has reported this issue upstream: https://github.com/victims/victims-web/issues/155

...

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatformTested ByRC-1RC-2Notes
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarLinux

Andrew Woods

Jared Whiklo (RC 2)

(tick)(tick) 
java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarMac

Joshua Westgard

Danny Bernstein (rc2)

(tick)(tick) 

java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar

Windows

Aaron Birkland

(tick)(tick) 

Manual Tests

Info

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

...

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess RC1?Success RC2?Notes
MySQL osx

 Danny Bernstein

Joshua Westgard

(tick)

(error)

(tick)

(tick)

Danny Bernstein:

(error)

Restoring v1 after creating v2 does not seem to work:

Steps to reproduce: 1. Create a binary with fileA.jpg

2. Create version v1.

3. Update binary with fileB.jpg

4. Create version v2.

5. Click on versions link and click on v1 link.

6. Click "Revert to this Version"

7. Return to binary resource metadata page. Notice the file associated with the version fileB.jpg rather than the expected fileA.jpg. It does not appear that the version was reverted.

Joshua Westgard: Hey Danny Bernstein, when I tested the versioning I was just making changes to metadata not binaries and didn't notice any problems; after seeing your note, however, I tried with a binary and did notice that the browser cached the previous version, so after restoring it was still displaying the previous data, but upon refreshing the resource page the restored version was visible as expected. Any chance this is the same problem you were seeing?

Joshua Westgard: could be, though I thought I did a hard refresh. I'll try it again to conf hirm.

Joshua Westgard: I must not have done a hard refresh. So yes after a hard refresh it worked. I wonder if it should be a logged as a bug nevertheless. Ideally any refresh would not be required at all. A Command-R refresh doesn't refresh the page. Only Command-Shift-R. It seems like it could be a source of confusion. Perhaps a JIRA is warranted. Here it is:

Jira
serverDuraSpace JIRA
serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
keyFCREPO-2666


PostgreSQLosxJoshua Westgardconfig successful; testing in progress

PostgreSQL linuxKevin Ford

Tests were performed against fcrepo-webapp-4.7.5-RC not fcrepo-webapp-plus-4.7.5-RC.  

MySQL5.6 linuxKevin Ford

Tests were performed against fcrepo-webapp-4.7.5-RC not fcrepo-webapp-plus-4.7.5-RC.  

PostgreSQL linuxKevin Ford

Tests were performed against fcrepo-webapp-plus-4.7.5-RC.  

MySQL5.6 linuxKevin Ford

Tests were performed against fcrepo-webapp-plus-4.7.5-RC.  

fcr:backup/fcr:restore Functionality

...

  • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
  • This script can be used to walk your repository, failing if a non-success response is encountered.

 

Tested by

Platform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora 
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)

Success RC1?

Success RC2?

Notes                  


LinuxJettyFile-simple4.7.54.7.5
100



Kevin Ford

LinuxTomcatPostgres4.7.14.7.5-RC640064006.7 G(tick)

(tick)

Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

RC2 test used backup of 471 from RC1 test.

Kevin Ford

LinuxTomcatPostgres4.7.34.7.5-RC640064006.7 G(tick)

(tick)

Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

RC2 test used backup of 473 from RC1 test.

Kevin Ford

LinuxTomcatPostgres4.7.44.7.5-RC640064006.7 G(tick)

(tick)

Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

RC2 test used backup of 474 from RC1 test.

Michael Durbin

LinuxTomcatMysql4.7.44.7.5-RC-1794561196996G(tick)
Performed an fcr:export from 4.7.4.  Performed an fcr:import to 4.7.5-RC-1.  Performed a reindex using camel (to walk all RDF resources).  I did not test every binary.

Kevin Ford

LinuxTomcatMysql 5.64.7.54.7.5-RC-1640064006.7 G(tick)

(tick)

Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, as verification. All succeeded.

For RC2 test, the back up that was restored in this test was actually created from a postgres backend repo.

Kevin Ford

LinuxTomcatPostgres4.7.5
In process
4.7.5-RC640064006.7 G(tick)

(tick)

Performed a GET test on all resources in 4.7.5 RC2 before /fcr:restore, as verification. All succeeded.

For RC1 test, the back up that was restored in this test was actually created from a mysql backend repo.

NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

...

Test stepsTested BySuccess RC1RC2?Notes

FEDORA_AUTH=true
FEDORA_AUDIT=false

Bethany Seeger

(tick)(tick) auth working

(tick) audit disabled

(tick) triplestore is staying in sync

(tick) solr

(tick) triplestore reindexing

 

FEDORA_AUTH=false
FEDORA_AUDIT=false

Danny Bernstein

(tick)

 (tick) auth (disabled as expected)

(tick) audit disabled

(tick) triplestore is staying in sync

(tick) solr

(tick) triplestore reindexing

FEDORA_AUTH=true
FEDORA_AUDIT=true

Danny Bernstein

(tick)

(tick) Triple Store

(tick) Auth

(tick) Reindexing

(tick) Solr (after a "vagrant box update" and "vagrant destroy" it seems to work now).

(warning)However: if I add an RDF triple to a node (in my case <> dc:title "blah") , I'm am not seeing the change reflected in solr. The triple is however present in fuseki.

Is this expected behavior? ie are only some triples propagated to solr?

The above turns out not to be an issue. Updates to solr are collected and then execute in batch operations. I just needed to wait a few seconds.

(tick) Audit events: with this caveat

(warning) I am seeing this stacktrace in the karaf logs upon adding a resource. Not sure if it is a problem. Audit events are being logged properly as far as I can tell in /audit and fuseki is also receiving the audit triples.

sudo tail -f /opt/karaf/data/log/karaf.log:

Stacktrace
---------------------------------------------------------------------------------------------------------------------------------------
org.fcrepo.client.FcrepoOperationFailedException: HTTP operation failed invoking info:fedora/audit with statusCode: -1 and message: URI does not specify a valid host name: info:fedora/audit
at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:218)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:204)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
at org.fcrepo.client.RequestBuilder.perform(RequestBuilder.java:77)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
at org.fcrepo.camel.FcrepoProducer.getMetadataUri(FcrepoProducer.java:251)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
at org.fcrepo.camel.FcrepoProducer.getUri(FcrepoProducer.java:225)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
at org.fcrepo.camel.FcrepoProducer.doRequest(FcrepoProducer.java:194)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
at org.fcrepo.camel.FcrepoProducer.process(FcrepoProducer.java:156)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61)[58:org.apache.camel.camel-core:2.18.0]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:145)[58:org.apache.camel.camel-core:2.18.0]
at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[

(info) I confirmed that this behavior exists in in the 4.7.4

FEDORA_AUTH=false
FEDORA_AUDIT=true

Danny Bernstein

(tick)(tick)

Manual Tests

Same as above, plus:

(for reference: https://docs.google.com/presentation/d/1aU-qRVmU0lB18ywepk2AGYEmRe-HfIwhUaofHgathGQ/edit#slide=id.g11caa1fd99_0_0)

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations

  5. Verify reindexing to triplestore works

    Code Block
    vagrant ssh
sudo service tomcat7 stop
sudo rm -rf /etc/fuseki/databases/test_data/*
sudo service tomcat7 start
curl -XPOST localhost:9080/reindexing/ -H"Content-Type: application/json" -d '["activemq:queue:triplestore.reindex"]'


Backwards Compatibility Tests

  1. Start 4.7.4 one-click
  2. Load sample datasets via /fcr:restore
  3. Run test scripts on 4.7.4
  4. Stop 4.7.4
  5. Start RC one-click
  6. Run test scripts on RC
  7. ReStart RC
  8. Run test scripts on RC
Tested bySuccess RC1Success RC2Notes

Kevin Ford

(tick)(tick)Did not run camel_toolbox_tests or authz_tests.

Danny Bernstein


(tick)

Resources

[1] Testing scripts

...