Summary
Introduction
This page presents the procedure for migrating data from DSpace to VIVO. It answers the use case of a VIVO instance in read-only mode used to present the metadata contained in DSpace
Goals
- The scenario to be realized by this procedure consists in developing the necessary steps in order to migrate the metadata of two DSpace instances (the DSpace-6 Demo instance and the DSpace-7 Demo instance) to a local VIVO instance
- At the end of this procedure, the experimenter should have a fully operational VIVO instance containing the metadata harvested from DSpace-6-Demo DSpace-7-Demo, both of which are available from the web.
- The experimenter will also have in his possession, the necessary information to harvest in VIVO the metadata of a DSpace instance that he will have chosen and that it is possible to harvest from an OAI-PMH endpoint
Useful addresses
| Title | URL | Description |
|---|---|---|
| DSpace-6 Demo Home Page | https://demo.dspace.org/ | This entry page links to other links concerning the DSpace-6 demo |
| DSpace-6 Demo UI | https://demo.dspace.org/xmlui/ | This page is the DSpace-6 api allowing to manipulate metadata |
| DSpace-6 OAI Api | https://demo.dspace.org/oai/request | OAI API used to harvest data |
| DSpace-7 Demo Home Page | https://demo7.dspace.org/home | This entry page links to other links concerning the DSpace-7 demo |
| VIVO Project GitHub Home Page | https://github.com/vivo-project | Source code location needed to install VIVO |
| DSpace-VIVO Integration Project (DV-IP) | https://github.com/vivo-community/DSpace-VIVO | Source code location for the migration of DSpace metadata to VIVO |
| DSpace-VIVO ETL Example | https://github.com/vivo-community/DSpace-VIVO/tree/main/test/org.vivoweb.dspacevivo.etlexample | Source code location for extract-transform-load (ETL) metadata processing from DSpace to VIVO |
Useful variable and constant names
| Title | Var Name | Var Value | Description |
|---|---|---|---|
| Project root directory | DVIP_HOME_PRJ | ~/dspace-vivo-prj | The value content is a suggestion |
| Git root directory | GIT_REPO | $DVIP_HOME_PRJ/00-GIT | Directory containing extracted GIT projects |
Software requirements
- jdk 11
- maven 3.6.3
- Linux Ubuntu
- No solr or tomcat instance should be running on the computer
Setting up
Setting up the necessary resources for running VIVO
| Step name and description | Commands |
|---|---|
| Setting up project | mkdir -p ~/dspace-vivo-prj/00-GIT |
| Retrieve the DV-IP source code | git clone https://github.com/vivo-community/DSpace-VIVO |
| Install Solr + Tomcat | ./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/00-INIT/install-tomcat-solr-app.sh |
| Installing/compiling VIVO | ./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/01-VIVO/vivo-git-clone.sh ./DSpace-VIVO/bundles/org.vivoweb.dspacevivo/script/vivo-compile-and-deploy-for-tomcat.sh |
Run - Start/Stop VIVO | Starting VIVO source ./DSpace-VIVO/bundles/org.vivoweb.dspacevivo/script/00-env.sh solr-start.sh tomcat-start.sh To show VIVO in a Web Browser browse-vivo.sh For stopping VIVO tomcat-stop.sh solr-stop.sh |
Installing the migration utilities
| Step name and description | Commands |
|---|---|
| Install Apache Jena and its other associated tools | ./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/99-OTHER_TOOLS/jena-git-clone-and-deploy.sh |
| Compiling/Installing DSpace-VIVO-EXEMPLE and its code libraries | ./DSpace-VIVO/test/org.vivoweb.dspacevivo.etlexample/script/mvn_install_example.sh |
Confirm the installation
| Step name and description | Commands |
|---|---|
| Validate that all necessary GIT projects are cloned and properly deployed | Excute ls command in $GIT_REPO ls -l total 24 drwxrwxr-x 6 heon heon 4096 mai 20 14:04 data-format-translator drwxrwxr-x 7 heon heon 4096 mai 20 11:02 DSpace-VIVO drwxrwxr-x 9 heon heon 4096 mai 20 11:08 Vitro drwxrwxr-x 11 heon heon 4096 mai 20 11:08 Vitro-languages drwxrwxr-x 10 heon heon 4096 mai 20 11:08 VIVO drwxrwxr-x 11 heon heon 4096 mai 20 11:08 VIVO-languages From $GIT_REPO ls -dl ./DSpace-VIVO/deploy/*/ drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-solr/ drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-tomcat/ drwxrwxr-x 2 heon heon 4096 mai 20 14:05 ./DSpace-VIVO/deploy/lib/ drwxrwxr-x 7 heon heon 4096 mai 20 14:04 ./DSpace-VIVO/deploy/translator/ drwxrwxr-x 9 heon heon 4096 mai 20 11:13 ./DSpace-VIVO/deploy/vivo-home/ |
| Validate that all utilities are properly deployed | From $GIT_REPO ls -dl ./DSpace-VIVO/deploy/*/ drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-solr/ drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-tomcat/ drwxrwxr-x 2 heon heon 4096 mai 20 14:05 ./DSpace-VIVO/deploy/lib/ drwxrwxr-x 7 heon heon 4096 mai 20 14:04 ./DSpace-VIVO/deploy/translator/ drwxrwxr-x 9 heon heon 4096 mai 20 11:13 ./DSpace-VIVO/deploy/vivo-home/ |
