Testers may either put their results directly in this wiki page, or in the testing Google spreadsheet.
Testing Blocker Tickets
None
Testing Plan
Prepare installation (build from source)
git clone https://github.com/vivo-project/Vitro.git Vitro git clone https://github.com/vivo-project/VIVO.git VIVO cd Vitro git checkout rel-1.10.0-RC-1 cd ../VIVO git checkout rel-1.10.0-RC-1 cp ./installer/example-settings.xml local-settings.xml # Update local-settings.xml with appropriate `vivo-dir` and `tomcat-dir`
Sanity Builds
Command | Platform | Tested by | Success? | Notes |
---|---|---|---|---|
mvn clean install -s local-settings.xml | Linux | Built from source | ||
mvn clean install -s local-settings.xml | Mac | Mike Conlon | Built from source | |
mvn clean install -s local-settings.xml | Mac | Mike Conlon |
| Built from distribution |
mvn clean install -s local-settings.xml | Windows | Ralph O'Flinn | Built from source |
New Installation Tests
- Prepare installation, see above
Empty MySQL database
mysql -u root -p mysql> drop database vitrodb mysql> CREATE DATABASE vitrodb CHARACTER SET utf8; mysql> GRANT ALL ON vitrodb.* TO 'vitrodbUsername'@'localhost' IDENTIFIED BY 'vitrodbPassword';
Remove application data
rm -rf ${VIVO_HOME}/tdbModels/* rm -rf ${VIVO_HOME}/solr/data/*
Start Tomcat
sudo service tomcat8 restart
UI Tests
Test | Platform | Tested by | Success? | Notes | |
---|---|---|---|---|---|
1 | Smoke tests do not produce error (warning about email server is OK) | Mac Linux | |||
2 | Home page displays correctly | Mac Linux |
| Wait for indexing, refresh. | |
3 | Log in as admin | Mac Linux |
| ||
4 | Site Admin page displays correctly | Mac Linux |
| Shows startup status warning re email | |
5 | Each function on site admin display correctly | Mac |
| All 24 links (including Data Input Pull down) display normally. Ontology list All looks good | |
6 | Site Admin - Add Individual of this class: Faculty Member (People) Project (Activities) Course (Courses) Academic Article (Research) Presentation (Events) Academic Department (Organizations) Populated Place (Locations) | Mac | Mike Conlon |
| Works as designed |
7 | Check required fields in creating classes | Mac | Mike Conlon |
| Not sure what this test is? VIVO only requires labels as individuals are created. |
8 | Check menu entries (Home, People, Organizations, Events, Capability Map) | Mac |
| Works as designed. | |
9 | Check Person display (logged out, logged in) | Mac |
| Works as designed. | |
10 | Add values to all Person attributes | Mac |
| All is a heavy lift. 64 attributes accessible from the person page, some of which lead to entities (publications, positions, etc)) each with their own attributes. Recommended: Add photo, overview, URL, research areas, position. Each exercises different functionality. | |
11 | Add research areas using vocabulary services | Mac | Unable to complete | UMLS service requires registration key. See Release Notes. Unclear where this key would go. Other services respond as expected. | |
12 | Check tabs on Person display (overview, publications, contact, etc.) | Mac | Mike Conlon |
| Works as designed. |
13 | Add new publication to person (check required fields) | Mac |
| Works as designed. | |
14 | Check publication sparkline | Mac | Test failed | The Information icon below the sparkline can not be clicked. | |
15 | Check manage publications (hide / show publications) | Mac |
| Works as designed. (I don't think I'd ever tried this. Works well.) | |
16 | Check Publication view | Mac |
| Works as designed. | |
17 | Check AltMetric badge (e.g. doi: 10.1038/nrmicro2331) | Mac |
| Poor UI experience. I copied in the link, which copied in the HTML tagging, which led to showing the HTML tagging in the display. The edit form is open ended HTML, should be plain text. Should indicate what form of DOI is expected , or should accept with or without http:// without without "doi". | |
18 | Add author(s) to publication | Mac |
| Works as designed. | |
19 | Check Person has co-author network | Mac |
| Works as designed. | |
20 | Check co-author network display | Mac |
| Works as designed | |
21 | Add grants to Person | Mac |
| Works as designed | |
22 | Add co-investigators to grants | Mac |
| Works as designed | |
23 | Check Person has co-investigator network | Mac |
| Works as designed | |
24 | Check co-investigator network display | Mac | Mike Conlon |
| Works as designed |
25 | Load Sample Data | Mac |
| sample-data.n3 loaded from https://github.com/vivo-project/sample-data/blob/master/sample-data.n3 | |
26 | Check Capability Map | Mac | Mike Conlon |
| Works as designed. Need more sample data with more concepts for more extensive tests. |
27 | Check Map of Science | Mac | Unable to complete | Testing requires google maps key configured in runtime.properties. | |
28 | Check Temporal Graph | Mac |
| Works as designed | |
29 | Search for "Derrida" | Mac |
| Works as designed | |
30 | Check index page | Mac |
| Works as designed | |
31 | Create self editor login associated with profile | Mac |
| Works as designed. Updated documentation to describe how this is done. See Creating and Managing User Accounts#AssociatingUserAccountswithProfilePages | |
32 | Log in as self editor. Verify can edit self, cannot edit others. | Mac | Mike Conlon |
| Works as designed. |
33 | Add and confirm an ORCiD | Mac | Mike Conlon | Unable to complete | ORCiD API configuration requires clientId and clientPassword and public VIVO. See Activating the ORCID integration |
34 | Create editor and assign proxy editing | Mac | Mike Conlon |
| Works as designed. |
35 | Log in as proxy editor. Verify can edit proxied profile, cannot edit others. | Mac | Mike Conlon |
| works as designed. |
36 | Check TPF endpoint | Mac |
| Works as designed. 45,279 triples with VIVO data, sample data, and some manually entered test data. Design needs work. | |
37 | Run a SPARQL query | Mac | Test failed | Chrome: Screen appeared to be showing all prefixes, then flashed and was replaced by screen showing just five prefixes. Query ran fine, but prefixes should appear in the default SPARQL query window. See SPARQL Prefixes missing 2018-06-03 14.50.25.png May be user error – perhaps caching this screen? I removed all cache and retried, but behavior remained. Safari: works as designed |
API Tests (reference: VIVO APIs)
Test | Platform | Tested by | Success? | Notes | |
---|---|---|---|---|---|
1 | Linked Open Data curl -i localhost:8080/vivo/individual/n3639.ttl | Linux | Mac | Windows | |||
2 | ListRDF | ||||
3 | Triple Pattern Fragments http://localhost:8080/vivo/tpf/core | ||||
4 | SPARQL Query API | ||||
5 | SPARQL Update API | ||||
6 | Search Indexing API | ||||
7 | Data Distribution API | ||||
8 | Direct2Experts API |
Unload/Load Tests
Test | Platform | Tested by | Success? | Notes | |
---|---|---|---|---|---|
1 | Load data using the Harvester | Linux | Mac | Windows | |||
2 | Unload using jena2tools -e | ||||
3 | Load using jena3tools -i | ||||
4 | Load sample data to a named graph | ||||
5 | Remove sample data named graph |
Upgrade Tests
- Install previous release
- Prepare installation per instructions above for previous release
- Start Tomcat - check that smoke test passes
- Stop Tomcat
Export data with jena2tools
java -jar jena2tools.jar -e -d /usr/local/vivo/home
Empty MySQL
mysql -u root -p mysql> drop database vitrodb; mysql> CREATE DATABASE vitrodb CHARACTER SET utf8; mysql> GRANT ALL ON vitrodb.* TO 'vitrodbUsername'@'localhost' IDENTIFIED BY 'vitrodbPassword';
Remove application data
rm -rf ${VIVO_DIR}/tdbModels/* rm -rf ${VIVO_DIR}/solr/data/*
Import data with jena3tools
java -jar jena3tools.jar -i -d /usr/local/vivo/home
- Start Tomcat
Verify application per `UI Tests` above
Test Platform Tested by Success? Notes All UI Tests Linux | Mac | Windows All API Tests Linux | Mac | Windows All Unload/Load tests All performance tests
Vagrant Tests
Clone VIVO Vagrant
git clone https://github.com/vivo-community/vivo-vagrant.git
Checkout release candidate
cd vivo-vagrant git checkout rel-1.10.0-RC-1
Load local or sample data
- Verify application per `UI Tests` above
Test | Platform | Tested by | Success? | Notes |
---|---|---|---|---|
All UI Tests | Linux | Mac | Windows | |||
All API Tests | ||||
All Unload/Load Tests | ||||
All performance tests |
Performance Tests
Performance tests should compare run times for a 1.9.3 vs a 1.10 on same hardware, same data.
Timing collection may be facilitated by enabling The Developer Panel.
Test | Platform | Tested by | Success? | Notes | |
---|---|---|---|---|---|
1 | Compare firsttime starttime time | Linux | Mac | Windows | |||
2 | Compare performance data load time | ||||
3 | Compare profile display time | ||||
4 | Compare SPARQL query time | ||||
5 | Compare Search Index rebuild time | ||||
6 | Compare Inferencer rebuild time | ||||
7 | Compare jenatools export time | ||||
8 | Compare jenatoools import time | ||||
9 | Compare Data Distribution API response time |