You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 25 Next »

Testing Blocker Tickets

  • ...

External Projects

  • Hydra
  • Islandora

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.0-RC

Sanity Builds

ProjectCommandPlatformTested bySuccess?Notes
fcrepo4mvn clean install

linux

Jared Whiklo
Nick Ruest

(tick)

(tick)

Ubuntu 14.04 LTS
Ubuntu 16.04 LTS

fcrepo4mvn clean install mac Jared Whiklo(tick) 
fcrepo4mvn clean installwindows   
fcrepo-module-auth-rbaclmvn clean installlinux

 Jared Whiklo

(tick)Ubuntu 14.04 LTS
fcrepo-module-auth-rbaclmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-rbaclmvn clean installwindows   
fcrepo-module-auth-xacmlmvn clean install linux

 Jared Whiklo

(tick)Ubuntu 14.04 LTS
fcrepo-module-auth-xacmlmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-xacmlmvn clean installwindows   
fcrepo-module-auth-webacmvn clean install linux

 Jared Whiklo

(tick)Ubuntu 14.04 LTS
fcrepo-module-auth-webacmvn clean install macJared Whiklo(tick) 
fcrepo-module-auth-webacmvn clean installwindows   
fcrepo-mintmvn clean install linuxJared Whiklo(tick)Ubuntu 14.04 LTS
fcrepo-mintmvn clean install macJared Whiklo(tick) 
fcrepo-mintmvn clean installwindows   
fcrepo-connector-filemvn clean installlinuxJared Whiklo(tick)Ubuntu 14.04 LTS
fcrepo-connector-filemvn clean installmacJared Whiklo(tick) 
fcrepo-connector-filemvn clean installwindows   
fcrepo-auditmvn clean install linux

 Jared Whiklo

(tick)Ubuntu 14.04 LTS
fcrepo-auditmvn clean install macJared Whiklo(tick) 
fcrepo-auditmvn clean installwindows   
fcrepo-webapp-plusmvn clean install linux

Jared Whiklo

(tick)Ubuntu 14.04 LTS
fcrepo-webapp-plusmvn clean install macJared Whiklo(tick) 
fcrepo-webapp-plusmvn clean install windows   
fcrepo-webapp-plusmvn clean install -Prbacl macJared Whiklo(tick)

 

fcrepo-webapp-plusmvn clean install -Prbaclwindows   
fcrepo-webapp-plusmvn clean install -PrbacllinuxJared Whiklo(tick)Ubuntu 14.04 LTS
fcrepo-webapp-plusmvn clean install -PxacmlmacJared Whiklo(tick)

 

fcrepo-webapp-plusmvn clean install -Pxacmlwindows   
fcrepo-webapp-plusmvn clean install -PxacmllinuxJared Whiklo(tick)Ubuntu 14.04 LTS

Migration of Existing Repositories

See: RESTful HTTP API - Backup and Restore

# Backup from existing repository
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore to 4.7.0
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore
Tested byPlatformFrom Fedora VersionNumber of ResourcesSize of Backup (du -h .)Success?Notes
Nick RuestUbuntu 16.04.14.6.0?44M(tick)LUBM_02 dataset
       

One-Click Run

CommandPlatform Tested bySuccess? Notes
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jarLinuxNick Ruest(tick) 
java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jarMacJared Whiklo(tick) 

java -jar fcrepo-webapp-4.7.0-SNAPSHOT-jetty-console.jar

Windows   

Manual Tests

All of the below should take place in the HTML UI.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess?Notes
MySQLosx (10.10.5)Danny Bernstein(error)

All scripts run except for authz_tests.sh. Here are the last few lines of the output:

verifyAuthZ
Anonymous can't access "cover"
401 == 401 (Pass)
fedoraAdmin can access "cover"
200 == 200 (Pass)
adminuser can access "cover"
ERROR expected 200 and received 400

I did not see a similar failure on vagrant.

Ubuntu 14.04Andy Wagner(tick)10.0.24-MariaDB-1~trusty-wsrep
PostgreSQLUbuntu 14.04Andy Wagner(tick)Postgresql 9.5

Vagrant Tests

vagrant destroy
vagrant up

 

 

Test stepsTested bySuccess?Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true

Yinlin Chen
Nick Ruest

(error)

(tick)

Automated tests failed due to Solr test is not passed [2]. Manually added a container and that container wasn't been indexed by Solr.
Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0"

 

FEDORA_AUTH=false
FEDORA_AUDIT=true

Nick Ruest

(tick)

Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0"

FEDORA_AUTH=true
FEDORA_AUDIT=false

Danny Bernstein

Nick Ruest

(error)

(tick)

Danny Bernstein: The shell scripts pass, but Yinlin's test suite does not:

output from maven: (mvn clean -Dwaitingtime=10000 test)

Failed tests:
solrTest.testSolr:84 expected:<1> but was:<0>

Tests run: 17, Failures: 1, Errors: 0, Skipped: 0

Also - in the solr console I'm seeing

I'm seeing these failures in solr:

org.apache.solr.common.SolrException: ERROR: [doc=http://localhost:8080/fcrepo/rest/cover] unknown field 'type'
	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:185)
	at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:78)
NB: I saw more java test failures when the waitingtime param was set to 3000. 
Nick Ruest "==> default: Error executing command: No matching features for fcrepo-camel-ldpath/0.0.0" | All testing scripts pass

FEDORA_AUTH=false
FEDORA_AUDIT=false

Andy Wagner(tick)All scripts pass.

Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] Testing scripts

[2] Fedora 4 Release Test Suite

Ubuntu 14.04 LTS

  • No labels