Testing Blocker Tickets

  • RC-1
    • Unable to locate Jira server for this macro. It may be due to Application Link configuration.

External Projects

Hydra

ProjectSuccess?
ActiveFedora(error) See AF#1156
CurationConcerns(tick)
Plum(tick)
Sufia

(tick)

Islandora - (tick)

One issue related to this update is in process to be resolved.
https://github.com/Islandora-CLAW/CLAW/issues/370

 

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.0-RC

Sanity Builds

ProjectCommandPlatformTested bySuccess?Notes
fcrepo4mvn clean install

linux

Jared Whiklo

Nick Ruest

Andrew Woods

(tick)

(tick)

(tick)

Ubuntu 14.04 LTS

 Ubuntu 16.04 LTS

Ubuntu 16.04 LTS

fcrepo4mvn clean install mac Jared Whiklo(tick) 
fcrepo4mvn clean installwindowsAaron Birkland(tick)

Windows 10 (1607) x64; 1.8.0_101-b13

fcrepo-module-auth-rbaclmvn clean installlinux

 Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-module-auth-rbaclmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-rbaclmvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-module-auth-xacmlmvn clean install linux

 Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-module-auth-xacmlmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-xacmlmvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-module-auth-webacmvn clean install linux

 Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-module-auth-webacmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-webacmvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-mintmvn clean install linux

Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-mintmvn clean install macJared Whiklo(tick) 
fcrepo-mintmvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-connector-filemvn clean installlinux

Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-connector-filemvn clean installmacJared Whiklo(tick) 
fcrepo-connector-filemvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-auditmvn clean install linux

 Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-auditmvn clean install macJared Whiklo(tick) 
fcrepo-auditmvn clean installwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-webapp-plusmvn clean install linux

Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-webapp-plusmvn clean install macJared Whiklo(tick) 
fcrepo-webapp-plusmvn clean install windowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-webapp-plusmvn clean install -Prbacl macJared Whiklo(tick)

 

fcrepo-webapp-plusmvn clean install -PrbaclwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13
fcrepo-webapp-plusmvn clean install -Prbacllinux

Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-webapp-plusmvn clean install -PxacmlmacJared Whiklo(tick)

 

fcrepo-webapp-plusmvn clean install -PxacmlwindowsAaron Birkland(tick)Windows 10 (1607) x64; 1.8.0_101-b13cd
fcrepo-webapp-plusmvn clean install -Pxacmllinux

Jared Whiklo

Andrew Woods

(tick)

(tick)

Ubuntu 14.04 LTS

Ubuntu 16.04 LTS

fcrepo-webapp-plusmvn clean install -PconnectormacDanny Bernstein(tick)OSX 10.10.5
fcrepo-webapp-plusmvn clean install -PconnectorLinuxAndrew Woods(tick)

Ubuntu 16.04 LTS

Migration of Existing Repositories

See: RESTful HTTP API - Backup and Restore

# Backup from existing repository
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore to 4.7.0
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore
Tested byPlatformFrom Fedora VersionNumber of ResourcesSize of Backup (du -h .)Success?Notes
Nick RuestUbuntu 16.04.14.6.0?44M(tick)LUBM_02 dataset
Joshua WestgardMac OS 10.11.6 (El Capitan)4.6.0~24005.2G(tick)Also successfully ran import/export tooling against a 4.7 RC2 repo.
Tricia JenkinsCentos 6.8

Release: 4.1.0 | Build #4a7d6f9e (2015-02-04)

~6011M(tick)Am working toward a complete set of Hydranorth content (~213218 resources).
Julie AllinsonMac OS 10.10.54.6 (data created in 4.4)~ 113000 (~ 12GB in data folder)~ 93MB(tick)

No binary files, just metadata in this repo.

"java.sql.BatchUpdateException: Duplicate entry" error. Fixed with backup-fixer.jar

Need to verify all objects restored. Data folder post restore ~ 7GB

Filesystem Federation

Test simple federation

Tested byPlatformSuccess?Notes
Andrew WoodsLinux(tick)

Success viewing federated files
Success adding new files to filesystem and seeing them in Fedora

Jared WhikloMac(tick)Success viewing federated files
Success adding new files to filesystem and seeing them in Fedora

 

One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess? Notes
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jarLinuxNick Ruest(tick) 
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jarMacJared Whiklo(tick) 

java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar

WindowsAaron Birkland(tick) 
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jarLinuxAndrew Woods(tick) 

Manual Tests

All of the below should take place in the HTML UI.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess?Notes
MySQLosx (10.10.5)Danny Bernstein(tick)

 

Ubuntu 14.04Andy Wagner(tick)10.0.24-MariaDB-1~trusty-wsrep
Ubuntu 16.04Andrew Woods(tick)

mysql Ver 14.14 Distrib 5.7.16

PostgreSQLUbuntu 14.04Andy Wagner(tick)Postgresql 9.5

Vagrant Tests

vagrant destroy
vagrant up

 

 

Test stepsTested bySuccess?Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true

Yinlin Chen
Nick Ruest

(tick)

(tick)

4.7.0-RC is passed [2].
Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0"

 

FEDORA_AUTH=false
FEDORA_AUDIT=true

Nick Ruest

Yinlin Chen

(tick)

(tick)

Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0"

4.7.0-RC c325e30 is passed [2].

FEDORA_AUTH=true
FEDORA_AUDIT=false

Danny Bernstein

Nick Ruest

Yinlin Chen

(tick)

(tick)

(tick)

 

Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0" | All testing scripts pass
Yinlin Chen: 4.7.0-RC is passed [2].

FEDORA_AUTH=false
FEDORA_AUDIT=false

Andy Wagner

Yinlin Chen

(tick)

(tick)

All scripts pass.

4.7.0-RC c325e30 is passed [2].

    

Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] Testing scripts

[2] Fedora 4 Release Test Suite

Ubuntu 14.04 LTS

  • No labels

10 Comments

  1. Jared Whiklo

    Yinlin Chen, could you try your vagrant tests again. I've found that the Solr indexing does seem to work, but when I use your script it has a significant delay due to all the objects being created and immediately deleted. This causes a 404 when fcrepo-ldpath tries to retrieve the object which seems to add more delay to the indexing.

    Running your script it did eventually work, but I think perhaps for a full run of the tests, you might want to add all the objects as you run the tests, and then delete them all at the end. Alternatively, if you moved the indexing test to the start you'd have less objects to wait for being indexed to check Solr.

    1. Jared Whiklo

      Actually I also discovered that for speed tests, changing the error.maxRedeliveries=10 to error.maxRedeliveries=1 in 

      • org.fcrepo.camel.indexing.solr.cfg
      • org.fcrepo.camel.indexing.triplestore.cfg
      • org.fcrepo.camel.serialization.cfg
      • org.fcrepo.camel.audit.cfg

      Makes your test suite run much faster, however then I got these failures.

      Results :

Failed tests: 
  fusekiTest.testFuseki:68 expected:<201> but was:<410>
org.fcrepo.test.suite.indirectTest.testIndirect(org.fcrepo.test.suite.indirectTest)
  Run 1: indirectTest.testIndirect:66 expected:<201> but was:<410>
  Run 2: indirectTest.testIndirect:66 expected:<201> but was:<410>

org.fcrepo.test.suite.nestedTest.testNestedCreation(org.fcrepo.test.suite.nestedTest)
  Run 1: nestedTest.testNestedCreation:61 expected:<201> but was:<410>
  Run 2: nestedTest.testNestedCreation:61 expected:<201> but was:<410>

  solrTest.testSolr:70 expected:<201> but was:<410>

Tests run: 15, Failures: 4, Errors: 0, Skipped: 0

       

      This seems due to object name collisions, from re-using localhost:8080/fcrepo/rest/object over and over.

      1. Yinlin Chen

        fcrepo4-vagrant-4.6 can pass all the tests without change anything. I just download Release Candidate 1 - 4.7.0 and vagrant up, it shows following error message and fcrepo4 doesn't start up. vagrant box update already executed. I will try master branch later.

        ==> default: stdin: is not a tty

        ==> default: Installing backup restore scripts to ~/backup_restore directory

        ==> default: Running provisioner: shell...

            default: Running: /var/folders/zr/hchc67ln4n19x3wbnw_0nnc40000gn/T/vagrant-shell20161010-80124-1bzhral.sh

        ==> default: stdin: is not a tty

        ==> default: Installing Fedora Camel Toolbox

        ==> default: 1466 [sshd-SshClient[15b204a1]-nio2-thread-1] WARN org.apache.sshd.client.keyverifier.AcceptAllServerKeyVerifier - Server at localhost/127.0.0.1:8101 presented unverified RSA key: 80:33:b2:fb:a5:db:55:31:3a:01:af:eb:48:0d:b9:21

        ==> default: Adding feature url mvn:org.fcrepo.camel/toolbox-features/4.6.1/xml/features

        ==> default: 1175 [sshd-SshClient[15b204a1]-nio2-thread-1] WARN org.apache.sshd.client.keyverifier.AcceptAllServerKeyVerifier - Server at localhost/127.0.0.1:8101 presented unverified RSA key: 80:33:b2:fb:a5:db:55:31:3a:01:af:eb:48:0d:b9:21

        ==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0

        ==> default: Stopping karaf...

        ==> default: Waiting for karaf to exit...

        ==> default: Waiting for karaf to exit...

        ==> default: Waiting for karaf to exit...

        ==> default: Stopped karaf.

        ==> default: Starting karaf...

        1. Jared Whiklo

          Those errors are related to misspellings on my part. I will update the 4.7.0-RC-1 tag in vagrant.

          If you want to try the 4.7.0-RC branch it resolves those. Those should not affect anything as they are attempting to load a feature from fcrepo-camel-toolbox that does not exist. You can verify that the solr indexing has loaded properly, but logging in to the Karaf shell at /opt/karaf/bin/client and running features:list | grep 'fcrepo'.

          Also these are Karaf errors and shouldn't affect your fcrepo from starting in Tomcat.

          I also can't speak to the differences between 4.6.0 and 4.6.1 of fcrepo-camel-toolbox. But I am able to do the tests using either my shell scripts or manually, are you able to complete the tests that are failing for your test suite by performing them manually?

  2. Jared Whiklo

    Danny Bernstein re: your MySQL tests. Were you running a version of Fedora with Authorization enabled? The errors you reported are consistent with running the authorization tests against a repo without WebAc enabled. I should probably put a check to tell right off the bat that the repo is not configured correctly for AuthZ. 

    1. Danny Bernstein

      Jared Whiklo  - I did have auth enabled.   What was strange was that the auth failed only partially.  Calls to "cover"  using fedoraAdmin did pass which I wouldn't expect if there were a problem with authorization being enabled or not.

      1. Jared Whiklo

        Danny Bernstein - Hmmm, could you try the jetty_or_tomcat branch of the tests. Depending on how you are running the application this might be the solution, if it works perhaps you could also add a comment to that effect on PR-5.

        1. Andrew Woods

          It would be nice to get to the bottom of this error... as we want to close out the 4.7.0 testing this week.

          p.s. PR-5 has been merged into master.

          1. Jared Whiklo

            Andrew Woods - I'm not worried, I have seen this behaviour before. If you'd like to replicate it, just move back to the commit before jetty_or_tomcat was merged. Then build and run fcrepo-webapp-plus with WebAC enabled, but run it using mvn jetty:run. The problem is I had hardcoded the URL to the acl to use the /fcrepo/rest prefix, which is wrong for jetty. 

            1. Andrew Woods

              That makes sense, Jared Whiklo. As a note, I get around the "hardcoded context" issue when running Jetty with:

              mvn -Dfcrepo.test.context.path=/fcrepo jetty:run

All content on the LYRASIS Wiki is licensed under the CC BY (Attribution) license, unless otherwise noted.