Testing Blocker Tickets
- RC-1
External Projects
Hydra
Project | Success? |
---|---|
ActiveFedora | See AF#1156 |
CurationConcerns | |
Plum | |
Sufia |
Islandora -
One issue related to this update is in process to be resolved.
https://github.com/Islandora-CLAW/CLAW/issues/370
Testing Plan
git clone https://github.com/fcrepo4/fcrepo4 cd fcrepo4 git checkout 4.7.0-RC
Sanity Builds
Project | Command | Platform | Tested by | Success? | Notes |
---|---|---|---|---|---|
fcrepo4 | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS Ubuntu 16.04 LTS | ||
fcrepo4 | mvn clean install | mac | Jared Whiklo | ||
fcrepo4 | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-module-auth-rbacl | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-module-auth-rbacl | mvn clean install | mac | Jared Whiklo | ||
fcrepo-module-auth-rbacl | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-module-auth-xacml | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-module-auth-xacml | mvn clean install | mac | Jared Whiklo | ||
fcrepo-module-auth-xacml | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-module-auth-webac | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-module-auth-webac | mvn clean install | mac | Jared Whiklo | ||
fcrepo-module-auth-webac | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-mint | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-mint | mvn clean install | mac | Jared Whiklo | ||
fcrepo-mint | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-connector-file | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-connector-file | mvn clean install | mac | Jared Whiklo | ||
fcrepo-connector-file | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-audit | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-audit | mvn clean install | mac | Jared Whiklo | ||
fcrepo-audit | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-webapp-plus | mvn clean install | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-webapp-plus | mvn clean install | mac | Jared Whiklo | ||
fcrepo-webapp-plus | mvn clean install | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-webapp-plus | mvn clean install -Prbacl | mac | Jared Whiklo |
| |
fcrepo-webapp-plus | mvn clean install -Prbacl | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13 | |
fcrepo-webapp-plus | mvn clean install -Prbacl | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-webapp-plus | mvn clean install -Pxacml | mac | Jared Whiklo |
| |
fcrepo-webapp-plus | mvn clean install -Pxacml | windows | Aaron Birkland | Windows 10 (1607) x64; 1.8.0_101-b13cd | |
fcrepo-webapp-plus | mvn clean install -Pxacml | linux | Ubuntu 14.04 LTS Ubuntu 16.04 LTS | ||
fcrepo-webapp-plus | mvn clean install -Pconnector | mac | Danny Bernstein | OSX 10.10.5 | |
fcrepo-webapp-plus | mvn clean install -Pconnector | Linux | Andrew Woods | Ubuntu 16.04 LTS |
Migration of Existing Repositories
See: RESTful HTTP API - Backup and Restore
# Backup from existing repository curl -X POST localhost:8080/rest/fcr:backup # Restore to 4.7.0 curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore
Tested by | Platform | From Fedora Version | Number of Resources | Size of Backup (du -h .) | Success? | Notes |
---|---|---|---|---|---|---|
Nick Ruest | Ubuntu 16.04.1 | 4.6.0 | ? | 44M | LUBM_02 dataset | |
Joshua Westgard | Mac OS 10.11.6 (El Capitan) | 4.6.0 | ~2400 | 5.2G | Also successfully ran import/export tooling against a 4.7 RC2 repo. | |
Tricia Jenkins | Centos 6.8 | ~60 | 11M | Am working toward a complete set of Hydranorth content (~213218 resources). | ||
Julie Allinson | Mac OS 10.10.5 | 4.6 (data created in 4.4) | ~ 113000 (~ 12GB in data folder) | ~ 93MB | No binary files, just metadata in this repo. "java.sql.BatchUpdateException: Duplicate entry" error. Fixed with backup-fixer.jar Need to verify all objects restored. Data folder post restore ~ 7GB |
Filesystem Federation
Tested by | Platform | Success? | Notes |
---|---|---|---|
Andrew Woods | Linux | Success viewing federated files | |
Jared Whiklo | Mac | Success viewing federated files Success adding new files to filesystem and seeing them in Fedora |
One-Click Run
cd fcrepo-webapp; mvn clean install -Pone-click
Command | Platform | Tested by | Success? | Notes |
---|---|---|---|---|
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar | Linux | Nick Ruest | ||
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar | Mac | Jared Whiklo | ||
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar | Windows | Aaron Birkland | ||
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar | Linux | Andrew Woods |
Manual Tests
All of the below should take place in the HTML UI.
- Create nested containers
- Create binary resources
- Run fixity on binary
- Update Properties: Perform SPARQL-Update on container
- Update Properties: Perform SPARQL-Update on binary
- Delete container
- Delete binary
- Use transactions
- Create versions
- View versions
- Rollback versions
Database Tests
With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)
Database | Platform | Tested by | Success? | Notes |
---|---|---|---|---|
MySQL | osx (10.10.5) | Danny Bernstein |
| |
Ubuntu 14.04 | Andy Wagner | 10.0.24-MariaDB-1~trusty-wsrep | ||
Ubuntu 16.04 | Andrew Woods | mysql Ver 14.14 Distrib 5.7.16
| ||
PostgreSQL | Ubuntu 14.04 | Andy Wagner | Postgresql 9.5 |
Vagrant Tests
vagrant destroy vagrant up
Test steps | Tested by | Success? | Notes |
---|---|---|---|
FEDORA_AUTH=true | 4.7.0-RC is passed [2].
| ||
FEDORA_AUTH=false | Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0" | ||
FEDORA_AUTH=true |
Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0" | All testing scripts pass | ||
FEDORA_AUTH=false | All scripts pass. | ||
Manual Tests
Same as above, plus:
- Verify audit events are in triplestore
- Verify resources are in triplestore
- Verify resources are in Solr
- Verify authorization works for the two auth-enabled configurations
- Verify reindexing to triplestore works
[1] Testing scripts
[2] Fedora 4 Release Test Suite
Ubuntu 14.04 LTS
10 Comments
Jared Whiklo
Yinlin Chen, could you try your vagrant tests again. I've found that the Solr indexing does seem to work, but when I use your script it has a significant delay due to all the objects being created and immediately deleted. This causes a 404 when fcrepo-ldpath tries to retrieve the object which seems to add more delay to the indexing.
Running your script it did eventually work, but I think perhaps for a full run of the tests, you might want to add all the objects as you run the tests, and then delete them all at the end. Alternatively, if you moved the indexing test to the start you'd have less objects to wait for being indexed to check Solr.
Jared Whiklo
Actually I also discovered that for speed tests, changing the
error.maxRedeliveries=10
toerror.maxRedeliveries=1
inMakes your test suite run much faster, however then I got these failures.
This seems due to object name collisions, from re-using localhost:8080/fcrepo/rest/object over and over.
Yinlin Chen
fcrepo4-vagrant-4.6 can pass all the tests without change anything. I just download Release Candidate 1 - 4.7.0 and vagrant up, it shows following error message and fcrepo4 doesn't start up. vagrant box update already executed. I will try master branch later.
==> default: stdin: is not a tty
==> default: Installing backup restore scripts to ~/backup_restore directory
==> default: Running provisioner: shell...
default: Running: /var/folders/zr/hchc67ln4n19x3wbnw_0nnc40000gn/T/vagrant-shell20161010-80124-1bzhral.sh
==> default: stdin: is not a tty
==> default: Installing Fedora Camel Toolbox
==> default: 1466 [sshd-SshClient[15b204a1]-nio2-thread-1] WARN org.apache.sshd.client.keyverifier.AcceptAllServerKeyVerifier - Server at localhost/127.0.0.1:8101 presented unverified RSA key: 80:33:b2:fb:a5:db:55:31:3a:01:af:eb:48:0d:b9:21
==> default: Adding feature url mvn:org.fcrepo.camel/toolbox-features/4.6.1/xml/features
==> default: 1175 [sshd-SshClient[15b204a1]-nio2-thread-1] WARN org.apache.sshd.client.keyverifier.AcceptAllServerKeyVerifier - Server at localhost/127.0.0.1:8101 presented unverified RSA key: 80:33:b2:fb:a5:db:55:31:3a:01:af:eb:48:0d:b9:21
==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0
==> default: Stopping karaf...
==> default: Waiting for karaf to exit...
==> default: Waiting for karaf to exit...
==> default: Waiting for karaf to exit...
==> default: Stopped karaf.
==> default: Starting karaf...
Jared Whiklo
Those errors are related to misspellings on my part. I will update the 4.7.0-RC-1 tag in vagrant.
If you want to try the 4.7.0-RC branch it resolves those. Those should not affect anything as they are attempting to load a feature from fcrepo-camel-toolbox that does not exist. You can verify that the solr indexing has loaded properly, but logging in to the Karaf shell at /opt/karaf/bin/client and running
features:list | grep 'fcrepo'
.Also these are Karaf errors and shouldn't affect your fcrepo from starting in Tomcat.
I also can't speak to the differences between 4.6.0 and 4.6.1 of fcrepo-camel-toolbox. But I am able to do the tests using either my shell scripts or manually, are you able to complete the tests that are failing for your test suite by performing them manually?
Jared Whiklo
Danny Bernstein re: your MySQL tests. Were you running a version of Fedora with Authorization enabled? The errors you reported are consistent with running the authorization tests against a repo without WebAc enabled. I should probably put a check to tell right off the bat that the repo is not configured correctly for AuthZ.
Danny Bernstein
Jared Whiklo - I did have auth enabled. What was strange was that the auth failed only partially. Calls to "cover" using fedoraAdmin did pass which I wouldn't expect if there were a problem with authorization being enabled or not.
Jared Whiklo
Danny Bernstein - Hmmm, could you try the jetty_or_tomcat branch of the tests. Depending on how you are running the application this might be the solution, if it works perhaps you could also add a comment to that effect on PR-5.
Andrew Woods
It would be nice to get to the bottom of this error... as we want to close out the 4.7.0 testing this week.
p.s. PR-5 has been merged into master.
Jared Whiklo
Andrew Woods - I'm not worried, I have seen this behaviour before. If you'd like to replicate it, just move back to the commit before jetty_or_tomcat was merged. Then build and run fcrepo-webapp-plus with WebAC enabled, but run it using mvn jetty:run. The problem is I had hardcoded the URL to the acl to use the
/fcrepo/rest
prefix, which is wrong for jetty.Andrew Woods
That makes sense, Jared Whiklo. As a note, I get around the "hardcoded context" issue when running Jetty with: