2020-05-18 DSpace 7 Transition BTE to Live Import Mtg

Date

18 May 2020 from 14:00-15:00 UTC

Location: https://lyrasis.zoom.us/my/dspace (Meeting ID: 502 527 3040).

• More connection options available at DSpace Meeting Room

References

• As noted in 2020-05-07 DSpace 7 Working Group Meeting, BTE will be replaced by Live Import per the ticket at  Unable to locate Jira server for this macro. It may be due to Application Link configuration.
• Currently, the two frameworks support differing sets of formats:
  • Live Import in v7 currently supports LoC Names, Sherpa RoMEO, ORCID and PubMed (via "External Sources", see https://github.com/DSpace/DSpace/blob/master/dspace/config/spring/api/external-services.xml and https://github.com/DSpace/Rest7Contract/blob/master/external-authority-sources.md)
  • BTE in v6/7 current supports ArXiv, CiNii, CrossRef, PubMed (in DSpace codebase) and OAI-PMH, BibTeX, CSV, Endnote, Excel, and RIS (in BTE codebase)
    • Bolded items are not yet supported by Live Import

Agenda

1. Discuss Strategies for replacement.
   1. (Option 1) Quick Replacement
      1. Remove all BTE code immediately, replacing with Live Import implementations.
      2. Will cause loss of functionality for JSPUI users. As noted above, there are formats BTE supports that Live Import doesn't yet support (until each can be implemented)
      3. May be less development work overall, as it doesn't involve having to write a BTE plugin for Live Import (see next option)
   2. (Option 2) Transition by temporarily wrapping BTE
      1. Create a BTE plugin for Live Import.
      2. Remove BTE from usage(s) in REST API v7, replacing with Live Import.  Live Import can temporarily use BTE to process files/services that it doesn't yet support (no immediate loss of functionality)
      3. Transition BTE "data loaders" / services into Live Import "data providers".  Perhaps migrate one format as an initial example. That would provide a reference example to other developers to migrate other formats.
      4. Remove BTE entirely once "major" formats have been migrated to Live Import. (Need to determine which formats are considered "major".)
   3. (Option 3)
      1. create a live import implementation of the extract panel
      2. add support for file in live import to provide support for RIS,EndNote,BibTeX
      3. avoid any further development on top of BTE and incentivate porting of BTE feature to the live import framework
   4. (Other options?)
2. Discuss timelines for replacement
   1. (Option 1) BTE is completely removed by 7.0 Final.  Ensure all/most formats previously supported by BTE are either supported by Live Import, or scheduled for 7.1 or 7.2 (if needed).
   2. (Option 2) BTE is completely removed by 7.1 or 7.2.  Would require disabling BTE by default and placing warnings about possible security issues (especially DOS/Out-of-memory attack which seems possible in the Excel data loader)
   3. (Other options?)

Attendees

• Tim Donohue
• Andrea Bollini (4Science)
• Lieven Droogmans
• Ben Bosman
• Craig Rosenbeck

Notes