2020-06-18 DSpace 7 Working Group Meeting

Date

18 Jun 2020 from 14:00-15:00 UTC

Location: https://lyrasis.zoom.us/my/dspace (Meeting ID: 502 527 3040).

• More connection options available at DSpace Meeting Room

Agenda

• (BEFORE MEETING IN #dev-sprint) Developer Stand Up - Developers give brief updates on their effort (or their team's effort).

  • Update/see "Current Work" section below based on your status. Please feel free to update prior to meeting.
  • Please highlight any new work (needing reviews/testing), any blockers (for you), and any discussion topics you may have.
• (20 mins) General Discussion Topics
  • (20 mins) Proposal to migrate to using GitHub Project Boards instead of our DSpace 7 Release Plan spreadsheet (from Heather Greer Klein and Tim Donohue)
    • Draft Project Board for 7.0 beta3.  We propose having one project board per beta release.
    • Benefits
      • May be able to replace the (manually maintained) list of "PRs Needing Review" (in each agenda) with an automated list.
      • May be able to replace the (manually maintained) Release Plan spreadsheet (if we create weekly "milestones" for estimated due dates)
    • Risks / Issues
      • Would need to migrate away from creating JIRA tickets for 7.0 project tasks.  All tasks would need to be identified as GitHub Issues.  To ease the migration, we can create GitHub issue tickets that simply link to existing JIRA tickets. 
  • Tabled Topics (will not be discussed this week, but possible for next week)
    • Finalize / approve the initial list of all authorization features which we should implement for the /api/authz/features REST endpoint.  This list of features should be limited to only features which are required to enable/disable User Interface functionality. (In other words, we can always add more features in the future.  We just need to approve the list necessary for 7.0)
      1. Review current spreadsheet (from Andrea Bollini (4Science) ) : https://docs.google.com/spreadsheets/d/1182LcD_WqIZRbUGWpLtBw0aOMR9jhbOVB7GZqtTpR9A/edit?usp=sharing 
         1. Art Lowel (Atmire) : I don't see any immediate issues with the current set of features, but I would prefer a consistent naming scheme. I'd use canDoSomething for everything
         2. Tim Donohue added possible renames of these features based on Art's idea (see cell comments in spreadsheet).  I like the "can[DoSomething]" naming scheme as well.
    • Proposal from Art Lowel (Atmire)on enhancing object cache in Angular UI.
• (40 mins) Planning for next week
  
  • Assigning PRs for Review
  • (As necessary) claim tasks for next week from DSpace 7 Release Plan spreadsheet

Attendees

• Art Lowel (Atmire) 

• Andrea Bollini (4Science)  

• Tim Donohue

• Lieven Droogmans 

• Giuseppe Digilio (4Science) 
• Ben Bosman
• Paulo Graça 
• Heather Greer Klein  

7.0 Release Goals

These resources define the prioritization and general schedule we are working towards

• DSpace 7 Release Goals : overview of goals/timelines & beta release process
• DSpace 7 Release Plan spreadsheet:  our planning spreadsheet which details which features are scheduled for each Beta release.

Current Work

Claim a Ticket!

If you do not have access in JIRA or GitHub to officially claim the ticket you wish to work on, contact Tim Donohue

• Available Angular UI Tickets
  
  • Open issues in 7.0beta3 milestone (highest priority)
  • Open issues flagged as "Difficulty: low".  These may be a good starting point for newer developers.
• Available REST API Tickets
  
  • Unassigned tickets scheduled for 7.0beta3 (highest priority)
  • General REST API tickets flagged as "low hanging fruit".  These may be a good starting point for newer developers.
  • General REST API unassigned bug tickets.  Again, might be a good starting point for newer developers.

PRs Needing Review

1. (REST Contract) (beta 3) Refactoring Authority support  / value-pairs / controlled vocabularies: https://github.com/DSpace/Rest7Contract/pull/128 (Tim Donohue , Ben Bosman  feedback added)
2.  (high prio) (REST) (beta3) Pre authorize annotations for subresources https://github.com/DSpace/DSpace/pull/2778 (  Craig Rosenbeck , Andrea Bollini (4Science) )
3. (REST) (beta3) New user registration & forgot password https://github.com/DSpace/DSpace/pull/2763 (Tim Donohue -  waiting on feedback to be addressed by Ben, Andrea Bollini (4Science) REREVIEW)
4. (REST) (beta3) Scripts & processes: importing and exporting csv's https://github.com/DSpace/DSpace/pull/2648 ( Tim Donohue  waiting on refactor by Kevin based on https://github.com/DSpace/Rest7Contract/pull/130)
5. (REST) (beta3) DS-4042: Fix implementation and add IT for wrong PATCH request in submission: https://github.com/DSpace/DSpace/pull/2760 (Tim Donohue ,  Ben Bosman  feedback added)
6. (REST) (beta 3) CC License support: https://github.com/DSpace/DSpace/pull/2764 (Tim Donohue -  waiting on feedback to be addressed by Kevin,  Craig Rosenbeck )
7. (REST) (beta 3) Performance issues with finding Collections a user can submit to  https://github.com/DSpace/DSpace/pull/2771 (Kevin Van de Velde (Atmire - REREVIEW,  Tim Donohue )
8. (NEW) (REST) (beta 3) Authorization for Downloads of restricted Bitstreams (PR coming before end of week) (NEEDS REVIEWERS)
9. (NEW) (REST) (beta 3) Private Bitstreams should still return name, content link https://github.com/DSpace/DSpace/pull/2781 (NEEDS REVIEWERS)
10. (NEW) (REST) (beta 4) DSpace (Solr) Statistics - Usage Reports https://github.com/DSpace/DSpace/pull/2782 (NEEDS REVIEWERS)
11. (Angular) (beta3) Scripts & Processes Admin UI https://github.com/DSpace/dspace-angular/pull/636 (Tim Donohue, Giuseppe Digilio (4Science) feedback added, Craig Rosenbeck)
    1. Depends on REST PR #2648 (see above) 
12. (Angular) Add multi-field sorting https://github.com/DSpace/dspace-angular/pull/634 1 APPROVAL  (Giuseppe Digilio (4Science) feedback added, Tim Donohue -  questions on how to review/test. No specs in PR)
13. (Angular) New User Registration https://github.com/DSpace/dspace-angular/pull/687 (Art Lowel (Atmire)  with a few UX suggestions that can move to a ticket, Giuseppe Digilio (4Science) better to test once REST PR is merged)
    1. Depends on REST PR #2763 (see above)
14. (Angular) (beta3) Refactor registry service https://github.com/DSpace/dspace-angular/pull/697 (Tim Donohue will give quick second review, Giuseppe Digilio (4Science) REREVIEW)
15. (Angular) (beta4) Fix context sensitive menus https://github.com/DSpace/dspace-angular/pull/700 (Giuseppe Digilio (4Science) , Tim Donohue will give second review)
16. (Angular) (beta3) Fix issues with edit collection and community pages https://github.com/DSpace/dspace-angular/issues/701 1 APPROVAL (Giuseppe Digilio (4Science)  feedback added)
17. (Angular) (beta3) CC License support https://github.com/DSpace/dspace-angular/pull/703  (Giuseppe Digilio (4Science)  feedback added, Tim Donohue )
    1. depends on REST PR #2764
18. (Angular) Misc edit community and collection fixes: https://github.com/DSpace/dspace-angular/pull/701 (Giuseppe Digilio (4Science), NEEDS SECOND REVIEWER)
19. (NEW) (Angular) (beta3) Forgot password: https://github.com/DSpace/dspace-angular/pull/707 (NEEDS REVIEWERS)
    
20. (NEW) (Angular) (beta3) Simplify bitstream reorder: https://github.com/DSpace/dspace-angular/pull/709 (NEEDS REVIEWERS)
21. (NEW) (Angular) Community and Collection Tree fixes https://github.com/DSpace/dspace-angular/pull/710 (NEEDS REVIEWERS)
22. (UPCOMING) (Angular) (beta3) Add support for features and authorizations: ETA Monday 2020-06-22 (NEEDS REVIEWERS)
23. (Backend) (low priority) DS-626 : Exchange usage data with IRUS https://github.com/DSpace/DSpace/pull/2664 (Craig Rosenbeck, Tim Donohue - REREVIEW, others can take a look)
    
24. (Backend) (low priority) (tentative 7.2) DS-4440 GDPR - Anonymize Statistics Feature: https://github.com/DSpace/DSpace/pull/2692 (Andrea Bollini (4Science), Ben Bosman, Tim Donohue) 
25. (Backend) (low priority)  [DS-4149] porting XOAI additional indexer https://github.com/DSpace/DSpace/pull/2756 (Paulo Graça  feedback added, Andrea Bollini (4Science) )
26. (Backend) [DS-3940] SHERPA v2 API (master port): https://github.com/DSpace/DSpace/pull/2773 (WAITING ON UPDATES FROM KIM) (Andrea Bollini (4Science) feedback added, Kevin Van de Velde (Atmire)  feedback added)
27. (NEW) (Angular) (beta3) Collection dropdown refactoring  https://github.com/DSpace/dspace-angular/pull/708

PRs Needing Updates  / On Hold

1. (REST) (WAITING ON DISCUSSION, SEE 2020-05-18 DSpace 7 Transition BTE to Live Import Mtg) (tentative 7.1) [DS-4281]: Metadata suggestions in the live import https://github.com/DSpace/DSpace/pull/2712  (Tim Donohue , Andrea Bollini (4Science))
2. (REST) (WAITING ON UPDATES AFTER FINALIZING https://github.com/DSpace/Rest7Contract/pull/128) (beta 3) Controlled vocabularyMykhaylo Boychuk https://github.com/DSpace/DSpace/pull/2743 (REST Contract #120) (Tim Donohue, Kevin Van de Velde (Atmire) )
3. (Angular) (WAITING ON PROPOSAL FROM Art Lowel (Atmire) FOR RESOLVING CACHING MISBEHAVIOR IN SUBMISSION UI) Alternative links https://github.com/DSpace/dspace-angular/pull/652 (Giuseppe Digilio (4Science)  feedback added, Tim Donohue -  feedback added)

PRs Coming Soon

1. (beta 3) REST Language Support on the backend Mykhaylo Boychuk (blocked internally, it is under review by Andrea Bollini (4Science))

PRs Merged this week!

1.  (REST Contract) Minor Logout changes to support Logout Page https://github.com/DSpace/Rest7Contract/pull/124
2.  (REST Contract) (beta 3) related to the scripts & processes PR above (related to REST PR #2648) https://github.com/DSpace/Rest7Contract/pull/99
3.  (REST Contract) DS-4504 Update to contract per performance issues with finding Collections a user can submit to. https://github.com/DSpace/Rest7Contract/pull/127
4.  (REST Contract) DS-4466 explain the Accept-Language header usage: https://github.com/DSpace/Rest7Contract/pull/122
5.  (REST Contract) [CC License Support] Adding response for rightsByQuestions: https://github.com/DSpace/Rest7Contract/pull/129 1 APPROVAL
6.  (REST) (beta 3) DS-4486 Add support/tests for Collection/Community role-based groups for Community/Collection Admins https://github.com/DSpace/DSpace/pull/2774
7.  (Angular) Fix authentication issue with protected page on CSR: https://github.com/DSpace/dspace-angular/pull/702 1 APPROVAL

Blocked

1. (Blocked PRs go here)

Delayed / Needs Discussion

1. Initial Performance Testing from Chris.  Needs revisiting / retesting prior to 7.0. 
   1. https://cwilper.github.io/dspace-perftest/
   2. These performance tests were run prior to the work on "projections" (to limit the data returned by the REST API).  Therefore, it is likely performance is much improved, but needs verification testing.
2. (REST Contract) Edit Homepage News: https://github.com/DSpace/Rest7Contract/pull/45
   
   1. Delayed. General agreement (in meeting on March 21, 2019) that storing HTML in metadata fields is not really ideal behavior.  Metadata (from a librarian standpoint) tends to be free of format-related markup (as that allows for easier sharing, understanding of metadata.  Currently Community & Collection homepage information is HTML-based and is stored in metadata that is appropriate for a minor subset of information (like the title) but it is better to move large/rich text to bitstreams.  
   2. Proposal here is to consider storing HTML-based markup (for Site, Community & Collection homepages) in Bitstream(s) associated with the object in question.  May allow for more CMS-lite behavior in the future
   3. Timeline for this is uncertain.  Possibly in 7 or 8. May depend on how/whether it can be scoped.

Notes