...
- This scenario performs the DSpace Items reading of the Demo-DSpace 6 (https://demo.dspace.org/jspui/) and DemoDSpace-7 (https://demo7.dspace.org/) demonstration sites.
- In order to achieve a complete extraction in a respectable time, the data harvesting parameters are pre-programmed to import 5 Items per demonstration site for a total of 10 Items. You can customize the harvesting settings according to the instructions in this section: Harvester Configuration
...
| Code Block |
|---|
| language | bash |
|---|
| title | Run migrating proccess |
|---|
|
./DSpace-VIVO/test/org.vivoweb.dspacevivo.etlexample/script/mvn_install_example.sh |
| Anchor |
|---|
| Run ETL-Migration program |
|---|
| Run ETL-Migration program |
|---|
|
- Run ETL-Migration program
...
Sample result in VIVO after running the migration scripts
Customize the harvesting process
The initial harvesting process is configured to achieve a fast result. The configuration values can be adjusted to meet your experimental needs
| Anchor |
|---|
| Harvester Configuration |
|---|
| Harvester Configuration |
|---|
|
Harvester configuration
Once the migration environment has been configured as indicated in the previous steps, the migration process is executed.To execute this process, we proceed to configure the program with information from the harvest source (dspace).This configuration is done in the harvest config file.To change the harvesting parameters of DemoDSpace6 and DemoDspace-7, edit and adjust the configuration values of the following two files:
| Code Block |
|---|
| language | bash |
|---|
| title | Config file path to configure Dspace source |
|---|
|
./DSpace-VIVO/test/org.vivoweb.dspacevivo.etlexample/src/main/resources/harvester-dspace6.conf
./DSpace-VIVO/bundlestest/org.vivoweb.dspacevivo.transformationetlexample/src/main/resources/harvester-dspace7.conf |
In the file you will find an example of the fields that the configuration file should contain.At the moment two ways of harvesting the data are supported:
...
| Params | Description | Example |
|---|
| type | Type of API used for data extraction. Enable for now ( OAI, RESTv7 ) | OAI |
| endpoint | API url direction. If the OAI type was selected, place the route of the OAI endpoint. On the other hand, if RESTv7 was selected, the rest API address. | https://api7.dspace.org/server/oai/request |
| uriPrefix | The prefix of the link to the repository. Used to generate valid links to the source repository. | https://demo7.dspace.org/ |
| harvestTotalCount | Number of items to harvest (proposed value = 5); put the parameter in comment to harvest all the site items | 5 |
| username | User of the dspace platform with permissions to use the rest API. (RESTv7 Only). | admin |
| password: | Password of the user (RESTv7 Only). | admin |
Compile Harvester sources
Go to the following path.
| Code Block |
|---|
| language | bash |
|---|
| title | Base directory of harvest components |
|---|
|
./DSpace-VIVO/bundles/ |
Compile the project components
| Code Block |
|---|
| language | bash |
|---|
| title | Maven compile command |
|---|
|
mvn clean install |
Install aditional components
Some migration processes are executed through bash scripts and require the installation of some special commands such as:
...
After the configuration as desired, simply restart the harvesting script as described: Run ETL-Migration program