Versions Compared

Old Version 53

changes.mady.by.user Michel Héon

Saved on

compared with

New Version Current

changes.mady.by.user Michel Héon

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Step name and descriptionCommands
Setting up project


Code Block
languagebash
mkdir -p ~/dspace-vivo-prj/00-GIT 
cd ~/dspace-vivo-prj/00-GIT


Retrieve the DV-IP source code


Code Block
languagebash
 git clone --depth 1 --branch Beta-1.1 https://github.com/vivo-community/DSpace-VIVO


Install Solr + Tomcat


Code Block
languagebash
./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/00-INIT/install-tomcat-solr-app.sh


Installing/compiling VIVO


Code Block
languagebash
./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/01-VIVO/vivo-git-clone.sh 
./DSpace-VIVO/bundles/org.vivoweb.dspacevivo/script/vivo-compile-and-deploy-for-tomcat.sh


Anchor
Run - Start/Stop VIVO
Run - Start/Stop VIVO
Run - Start/Stop VIVO



Code Block
languagebash
titleStarting VIVO
sourcecd ./DSpace-VIVO/bundles/org.vivoweb.dspacevivo/script
source ./00-env.sh 
solr-start.sh
tomcat-start.sh


Code Block
languagebash
titleTo show VIVO in a Web Browser (http://localhost:8080/vivo-dspace/)
browse-vivo.sh


Code Block
languagebash
titleFor stopping VIVO
tomcat-stop.sh
solr-stop.sh


Setting up the necessary resources for running Dspace

TODO

Installing the migration utilities

...

Step name and descriptionCommands
Validate that the OS contains all the necessary commands to run the dspace2vivo scripts


Code Block
languagebash
titleExcute 'ls' command from $GIT_REPORun the script to validate the required applications being installed
./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/99-OTHER_TOOLS/validate-syscmd-config.sh


Code Block
languagebash
titleResult summary
adduseradduser ok!
ant ok!
as ok!
at ok!
awk ok!
basename ok!
bash ok!
cat ok!
chmod ok!
chown ok!
chroot ok!
clear ok!
convert ok!
cp ok!
curl ok!
cut ok!
...


Code Block
languagebash
titleTo present the applications to be installed
./DSpace-VIVO/releng/org.vivoweb.dspacevivo.installer/99-OTHER_TOOLS/validate-syscmd-config.sh  | grep NOT


To identify the package to install

for a given application, simply type the command on the command line and run the proposal offered by the system


Code Block
languagebash
titleExample
$ as

Command 'as' not found, but can be installed with:

sudo apt install binutils

ubuntu@ip-172-22-10-100:~/dspace-vivo-prj/00-GIT$ sudo apt install binutils
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:


Validate that all necessary GIT projects are cloned and properly deployed


Code Block
languagebash
titleExcute 'ls' command from $GIT_REPO
ls -l
total 24
drwxrwxr-x  6 heon heon 4096 mai 20 14:04 data-format-translator
drwxrwxr-x  7 heon heon 4096 mai 20 11:02 DSpace-VIVO
drwxrwxr-x  9 heon heon 4096 mai 20 11:08 Vitro
drwxrwxr-x 11 heon heon 4096 mai 20 11:08 Vitro-languages
drwxrwxr-x 10 heon heon 4096 mai 20 11:08 VIVO
drwxrwxr-x 11 heon heon 4096 mai 20 11:08 VIVO-languages


Code Block
languagebash
titleExecute 'ls' from $GIT_REPO in deploy directory
ls -dl ./DSpace-VIVO/deploy/*/
drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-solr/
drwxrwxr-x 9 heon heon 4096 mai 20 11:07 ./DSpace-VIVO/deploy/app-tomcat/
drwxrwxr-x 2 heon heon 4096 mai 20 14:05 ./DSpace-VIVO/deploy/lib/
drwxrwxr-x 7 heon heon 4096 mai 20 14:04 ./DSpace-VIVO/deploy/translator/
drwxrwxr-x 9 heon heon 4096 mai 20 11:13 ./DSpace-VIVO/deploy/vivo-home/


Test the utilities to make sure they are working


Code Block
languagebash
titleSetting up environment variables in your session (From $GIT_REPO)
$ source ./DSpace-VIVO/bundles/org.vivoweb.dspacevivo/script/00-env.sh


Code Block
languagebash
titleValidate Solr
$ solr-start.sh 

Waiting up to 180 seconds to see Solr running on port 8983 [|]  
Started Solr server on port 8983 (pid=1741315). Happy searching!

$ solr-status.sh 

Found 1 Solr nodes: 
Solr process 56366 running on port 8983
{
  "solr_home":"xxxxxxx/00-GIT/DSpace-VIVO/deploy/app-solr/server/solr",
  "version":"8.11.1 0b002b11819df70783e83ef36b42ed1223c14b50 - janhoy - 2021-12-14 13:50:55",
  "startTime":"2022-05-19T15:15:10.534Z",
  "uptime":"0 days, 17 hours, 25 minutes, 10 seconds",
  "memory":"151 MB (%29.5) of 512 MB"}


Code Block
languagebash
titleValidate Tomcat
$ tomcat-start.sh

Using CATALINA_BASE:   xxxxxxx/00-GIT/DSpace-VIVO/deploy/app-tomcat
Using CATALINA_HOME:   xxxxxxx/00-GIT/DSpace-VIVO/deploy/app-tomcat
Using CATALINA_TMPDIR: xxxxxxx/00-GIT/DSpace-VIVO/deploy/app-tomcat/temp
Using JRE_HOME:        /opt/jdk-11.0.9
Using CLASSPATH:       xxxxxxx/00-GIT/DSpace-VIVO/deploy/app-tomcat/bin/tomcat-juli.jar
Using CATALINA_OPTS:   
Tomcat started.


Code Block
languagebash
titleTest Apache-Jena
$ sparql -version 2>/dev/null

Jena:       VERSION: 3.17.0
Jena:       BUILD_DATE: 2020-11-25T19:40:23+0000


...

Code Block
languagebash
titleRun migrating proccessprocess
./DSpace-VIVO/test/org.vivoweb.dspacevivo.etlexample/script/mvn_install_example.sh

...

Code Block
languagebash
titleRun migrating proccessprocess
./DSpace-VIVO/test/org.vivoweb.dspacevivo.etlexample/script/ETL-migration-DSpace-VIVO.sh

...

ETL-migration-DSpace-VIVO.sh

This script encapsulates the functions call allowing the migration of DSpace Demo(6&7) data into VIVO. It is the main script of the ETL process

Code Block
languagebash
titleETL-migration-DSpace-VIVO
linenumberstrue
collapsetrue
#!/bin/bash

###################################################################
# Script Name   :
# Description   : This script encapsulates the functions call allowing the migration of DSpace Demo(6&7) data into VIVO
# Args          : 
# Author       	: Michel Héon PhD
# Institution   : Université du Québec à Montréal
# Copyright     : Université du Québec à Montréal (c) 2022
# Email         : heon.michel@uqam.ca
###################################################################
export SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd -P)"
source $SCRIPT_DIR/00-env.sh
cd $SCRIPT_DIR

###################################################################
# Clean and setup up data directories and properties
cp $RESSOURCESDIR/*.conf $RESSOURCES_TARGET_DIR
flush_data_dspace.sh 2>/dev/null
flush_data_dspace6.sh 2>/dev/null 
flush_data_dspace7.sh 2>/dev/null
###################################################################
# Extract dspace(6-7) demo data
./extract-dspace6.sh 
./extract-dspace7.sh 
cp -r $DATA_DEMO6_DIR/* $DATA_DEMO7_DIR/* $DATA_DIR

###################################################################
# Produce all list
echo run produce-list-of-expertise.sh
produce-list-of-expertise.sh

###########################
echo run produce-list-of-itemtype.sh
produce-list-of-itemtype.sh

###########################
echo run produce-list-of-persons.sh
produce-list-of-persons.sh

###################################################################
# Process transformation and load to VIVO
load-data-to-vivo.sh
transform-map-vivo-doc-type.sh
load-data-doc_type-to-vivo.sh ; vivo-recomputeIndex.sh & 

transform-map-vivo-person.sh
load-data-person-to-vivo.sh ; vivo-recomputeIndex.sh &

transform-map-vivo-expertises.sh
load-data-expertises-to-vivo.sh ; vivo-recomputeIndex.sh &

transform-map-expertise-and-item-to-a-person-to-vivo.sh
load-data-person-expertise-to-vivo.sh ; vivo-recomputeIndex.sh

###################################################################
# Done ETL Process
echo "Done!"



-- End Of Document --