Page History

...

17 Dec 2019 at 16:00 UTC (11:00am EDT)

Location:

Join from PC, Mac, Linux, iOS or Android: https://lyrasis.zoom.us/my/dspace  (Meeting ID: 502 527 3040)

Attendees

Actual attendee list will be updated after meeting.

Location:

Join from PC, Mac, Linux, iOS or Android: https://lyrasis.zoom.us/my/dspace  (Meeting ID: 502 527 3040)

Attendees

Actual attendee list will be updated after meeting.

• Tim Donohue - LYRASIS
• Alexander Sulfrian - Freie Universität Berlin 
• Lieven Droogmans - Atmire
• Ben Bosman  - Atmire
• Paulo Lopes - FCT|FCCN 
• Mark H. Wood - IUPUI
• Paulo Graça- FCT|
• Tim Donohue - LYRASIS
• Alexander Sulfrian - Freie Universität Berlin 
• Lieven Droogmans - Atmire
• Ben Bosman  - Atmire
• Paulo Lopes - FCT|FCCN 
• Mark H. Wood - IUPUI
• Paulo Graça- FCT|FCCN
• Jose Carvalho - University of Minho
• Dimitris Pierrakos - ARC/OpenAIRE
  
• Oliver Goldschmidt - Hamburg University of Technology (TUHH) (unavailable in Dec)
  

Agenda

...

• All JIRA tickets tagged with "Configurable Entities": https://jira.duraspace.org/issues/?jql=project%20%3D%20DS%20AND%20component%20%3D%20%22Configurable%20Entities%22
  • Critical Tickets: https://jira.duraspace.org/issues?jql=project%20%3D%20DS%20AND%20priority%20%3D%20Critical%20AND%20component%20%3D%20%22Configurable%20Entities%22
  • Major Tickets: https://jira.duraspace.org/issues?jql=project%20%3D%20DS%20AND%20priority%20%3D%20Major%20AND%20component%20%3D%20%22Configurable%20Entities%22
• (HIGH PRIORITY) Bug with performance of Angular (especially with regards to Entities, e.g. in PR#402): https://github.com/DSpace/dspace-angular/issues/458

• (REST Contract) There could be more than one Entity reference for external sources https://github.com/DSpace/Rest7Contract/issues/90

PRs Needing Review

1. (REST Contract) Entity type small changes ) Entities Configure search configurations matching name https://github.com/DSpace/Rest7ContractDSpace/pull/952667 (Tim Donohue, Paulo Graça, NEEDS SECOND REVIEWER)
2. (REST) Creating a workspace item from an external source NEW) (REST) Metadata PATCH when mixing plain text and relationship https://github.com/DSpace/DSpace/pull/26142691 (Tim Donohue, Paulo Graça - )
3. (NEW) (REST) Get entity type performance improvement  Removed the RelationshipTypeId from Relationship endpoints https://github.com/DSpace/DSpace/pull/26152745 (NEEDS REVIEWERS)
4. (NEW) StatuscolourBluetitle1 approval (Tim Donohue , NEEDS SECOND REVIEWER) (REST) Entities submission config related to Entities of the same type https://github.com/DSpace/DSpace/pull/26182746 (Tim Donohue, Paulo GraçaNEEDS REVIEWERS)
5. (NEW) (REST) Default Entities relationship types used for the demos https:Angular) Combining relationships and metadata during submission https://github.com/DSpace/DSpacedspace-angular/pull/2622541 (Paulo Graça , NEEDS SECOND REVIEWER) (12 hours)
6. (Angular) Keep virtual metadata on relationship delete NEW)(Angular) Create relationships as an admin in edit item [WIP] https://github.com/DSpace/dspace-angular/pull/530 (Paulo Graça - feedback added, Tim Donohue - feedback added)545  (NEEDS REVIEWERS ONCE DEPENDENCIES ARE MERGED) (16 hours left - week of Jan 6)
   
   1. Dependent on #530 (merged)
7. (COMING SOON) (OpenAIRE4) OpenAIRE API import of entities/metadata (In progress development by Dimitris Pierrakos)

PRs Merged

1.  (REST Contract) Entity type small changes 
2. (Angular) Create relationships during the submission https://github.com/DSpace/dspace-angular/pull/531 (Paulo Graça - it's Ok, but still is WIP, Tim Donohue - early review, one bug reported)
3. (Angular) Item page entities improvements https://github.com/DSpace/dspace-angularRest7Contract/pull/532 (Paulo Graça - feedback added, Tim Donohue,  Ben Bosman )
   1. sample screenshots: pr-532.pdf
   (Angular) Virtual metadata on item delete 95
4.  (REST) DS-4401 Enforce relational place ordering when place direction is known https://github.com/DSpace/dspace-angularDSpace/pull/533 ( Paulo Graça - feedback added , Tim Donohue )
   1. sample screenshots:  pr-533.pdf
   2. Dependent on #530 (see above)
   2617
5.  (REST) Get entity type performance improvement (Angular) Reordering related entities in the submission https://github.com/DSpace/dspace-angularDSpace/pull/5342615
6.  (Paulo Graça, Tim Donohue)
   1. Dependent on #531 (see above)
   (Angular) Lookup relations - Search external sources REST) Creating a workspace item from an external source https://github.com/DSpace/dspace-angularDSpace/pull/2614
7. 539 (Tim Donohue, Paulo Graça)
   1. Dependent on #531 (see above)
   (Angular) Convert external source to entity REST) Entities submission config https://github.com/DSpace/dspace-angular/DSpace/pull/5402618
8.  (NEEDS REVIEWERS ONCE READY)
   1. Dependent on #539 (see above)
   (Angular) Combining relationships and metadata during submission REST) Default Entities relationship types used for the demos https://github.com/DSpace/dspace-angularDSpace/pull/5412622
9.  (NEEDS REVIEWERS ONCE READY)
   1. Dependent on #534 (see above)
   (OpenAIRE4) OpenAIRE 4 submission forms and virtual metadata REST) EntityType by label endpoint and integration tests https://github.com/DSpace/DSpace/pull/2608 (Dimitris Pierrakos, Ben Bosman  - feedback added, Tim Donohue - feedback added)2628
10.  (REST) relationship type rest controller bug fix (OpenAIRE4) OpenAIRE4 oai_openaire metadata format support https://github.com/DSpace/DSpace/pull/2641
11. 2592 (Dimitris Pierrakos, Tim DonohueAngular) Item page entities improvements https://github.com/DSpace/dspace-angular/pull/532
12.  (OpenAIRE4) OpenAIRE 4 submission forms and virtual metadata , Ben Bosman)(NEW) (OpenAIRE4) OpenAIRE4 miscellaneous fixes [WIP] https://github.com/DSpace/DSpace/pull/2621 (NEEDS REVIEWERS ONCE READY)2608
13.  (OpenAIRE4) OpenAIRE4 adding missing field person.identifier https://github.com/DSpace/DSpace/pull/2621
14.  (OpenAIRE4) OpenAIRE4 funding agency missing translation(NEW) (OpenAIRE4 - angular) Openaire4 required translations [WIP] https://github.com/DSpace/dspace-angular/pull/542 (NEEDS REVIEWERS ONCE READY)

...

2.   (Angular) Create relationships during the submission https://github.com/DSpace/dspace-angular/pull/531
3.   (OpenAIRE4) OpenAIRE4 oai_openaire metadata format support REST) DS-4401 Enforce relational place ordering when place direction is known https://github.com/DSpace/DSpace/pull/2617

Task List

This task list has been updated as of our meeting on Oct 22, 2019.  The tasks are numbered for easy reference, but are not necessarily listed in priority order.  During this meeting we worked to re-summarize current work status so that we can align this task list with the DSpace 7 Estimation Process (and as such, estimate any we feel should be considered for 7.0 release).  NOTE: Keep in mind, just because a task is listed here does NOT guarantee it will be completed for DSpace 7.  Some of these tasks may need to be delayed for a future release.

1. 2592
2.  (Angular) Lookup relations - Search external sources https://github.com/DSpace/dspace-angular/pull/539
3.  (Angular) Reordering related entities in the submission https://github.com/DSpace/dspace-angular/pull/534
4.  (Angular) Convert external source to entity https://github.com/DSpace/dspace-angular/pull/540
5.  (Angular) Keep virtual metadata on relationship delete https://github.com/DSpace/dspace-angular/pull/530 
6.  (Angular) Virtual metadata on item delete  Metadata schemas for Entity types (DS-4223). REST: https://github.com/DSpace/DSpacedspace-angular/pull/2443 , Angular: https://github.com/DSpace/dspace-angular/pull/420
7. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.wjaqg235p53r
533

Task List

This task list has been updated as of our meeting TODAY.  The tasks are numbered for easy reference, but are not necessarily listed in priority order.  During this meeting we worked to re-summarize current work status so that we can align this task list with the DSpace 7 Estimation Process (and as such, estimate any we feel should be considered for 7.0 release).  NOTE: Keep in mind, just because a task is listed here does NOT guarantee it will be completed for DSpace 7.  Some of these tasks may need to be delayed for a future release.

1.  Metadata schemas for Entity types (DS-4223). 
   1. REST: 
2.  (Minor refactor) Decide which metadata field should be used to store Entity Type (DS-4184).  Currently, it is stored in "relationship.type". (DEEMED LOWER PRIORITY, but "nice to have" for 7.0 if possible?)
3.  Creating Relations (between Entities) with CSV Batch Import 
   1. REST: https://github.com/DSpace/DSpace/pull/2269 and 2443 , Angular: https://github.com/DSpace/DSpacedspace-angular/pull/2471 and https://github.com/DSpace/DSpace/pull/2522420
   2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.df1z7jh9mcc
4.  Permissions on Relations (between Entities)
   1. Discussed on Aug 6 
   2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.y6qarjnylexl
5. 1. wjaqg235p53r
6.  (Minor refactor) Decide which metadata field should be used to store Entity Type (DS-4184).  Currently, it is stored in "relationship.type". (DEEMED LOWER PRIORITY, but "nice to have" for 7.0 if possible?)
7.  Creating Relations (between Entities) with CSV Batch Import 
   1. REST: https://github.com/DSpace/DSpace/pull/2269 and
   Deleting Entities that have existing relations
   1.  Deletion action itself:REST Contract: https://github.com/DSpace/Rest7ContractDSpace/blob/master/relationships.md#deleting-a-relationship , REST: pull/2471 and https://github.com/DSpace/DSpace/pull/2332 , Angular2522
   2. Early Docs / Notes: https://githubdocs.google.com/DSpacedocument/dspace-angular/pull/402d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.df1z7jh9mcc
8.  Permissions on Relations (between Entities)
   1. Discussed on Aug 6 
   2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.c62y8iqnvlury6qarjnylexl
9.  Deleting Entities that have existing relations
   1.  Deletion action itself:
      1. REST
       Copy virtual metadata from deleted entity to related entity
      1.  REST Contract: https://github.com/DSpace/Rest7Contract/pull/78 REST implblob/master/relationships.md#deleting-a-relationship , REST: https://github.com/DSpace/DSpace/pull/2577 Angular Impl (under review)2332 , Angular: https://github.com/DSpace/dspace-angular/pull/530 and https://github.com/DSpace/dspace-angular/pull/533
    Dynamic display of Relations
   1. 1. 402
      2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.
      pm34t6u1djdf
   2.  (DELAYED) Completed, but may require usability improvements (NEEDS DISCUSSION - may be delayed for v7.1)
   Submission Integration Tasks
   1. 1. c62y8iqnvlur
   2. Copy virtual metadata from deleted entity to related entity
      1.  REST Contract
   3.  Creating new Entities using Submission Forms
      1. REST: https://github.com/DSpace/DSpaceRest7Contract/pull/244378
      2.  REST implEarly Docs / Notes: https://docsgithub.google.com/documentDSpace/dDSpace/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnp
       Creating relations between two Entities during Submission process
      
      1. pull/2577
      2. Angular Impl  REST Contract : https://github.com/DSpace/Rest7Contractdspace-angular/pull/64 , REST Impl: 530 and https://github.com/DSpace/DSpacedspace-angular/pull/2472
      3.  Angular Impl (under review): https://github.com/DSpace/dspace-angular/pull/531 and https://github.com/DSpace/dspace-angular/pull/534
      4. 533
10.  Dynamic display of Relations
    1. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnppm34t6u1djdf
    2.  Completed:  Search External Sources (includes ORCID integration with Entities) REST Contract: https://github.com/DSpace/Rest7Contractdspace-angular/pull/517
11.  Submission Integration Tasks
    1.  Creating new Entities using Submission Forms
       1. REST74  REST Impl: https://github.com/DSpace/DSpace/pull/2560 Angular Impl (under review)2443
       2. Early Docs / Notes: https://githubdocs.google.com/DSpacedocument/dspace-angular/pull/539 (NOTE: This PR is smaller than it seems, as it includes all the code in the larger PR#531)d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnp
    2.  Creating relations between two Entities during Submission process
        Convert External Sources to an Entity
       1. If an Admin: REST Contract:  https://github.com/DSpace/Rest7Contract/pull/8264 ,
       2.  REST Impl:  https://github.com/DSpace/DSpace/pull/25902472
       3.  Angular Impl (under review): https://github.com/DSpace/dspace-angular/pull/540 (NOTE: This PR is smaller than it seems, as it includes all the code in the larger  PR#531)If a Submitter (Feature is NOT specific to Entities, as this is simply porting the "Live Import" framework of DSpace 6.x) REST Contract under review: 531 and https://github.com/DSpace/Rest7Contractdspace-angular/pull/83 REST Impl (under review)534
       4. Early Docs / Notes: https://githubdocs.google.com/DSpacedocument/DSpaced/pull/2614
    Name Variants
    1. 1. 1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnp
    2.  Search External Sources (includes ORCID integration with Entities)
    3.  Create name variants in submission
       1.  REST ImplContract: https://github.com/DSpace/DSpaceRest7Contract/pull/256174 
       2.  REST Impl:  Angular Impl (under review) - this is included as part of https://github.com/DSpace/dspace-angularDSpace/pull/531
    4.  Display name variants on Item pages (Angular)
     OpenAIRE v4 support (using Entities)
    1. 1. 2560
       2.  Angular Impl
    2.  Configuration of Entities needed for OpenAIRE v4
       1. : https://github.com/DSpace/
       DSpace
       1. dspace-angular/pull/
       2575 Configuration of Metadata fields/schemas needed for OpenAIRE v4
       1. 539
    3. Convert External Sources to an Entity
       1. If an Admin:
          1.  REST Contract: https://github.com/DSpace/
       DSpace
       1. 1. Rest7Contract/pull/
       2576 Configuration of Submission Input Forms for OpenAIRE v4 (under review)
       1. 1. 82
          2.  REST Impl: https://github.com/DSpace/DSpace/pull/
       2608
       1. 1. 2590
          2.  Angular Impl: https://github.com/DSpace/dspace-angular/pull/540
       2. If a Submitter (Feature is NOT specific to Entities, as this is simply porting the "Live Import" framework of DSpace 6.x)
          1.  REST Contract
        Configuration of OAI-PMH for OpenAIRE v4 (under review)
       1. 1. : https://github.com/DSpace/
       DSpace
       1. 1. Rest7Contract/pull/
       2592
12.  How to display related items on an Item page if that related item is still in workflow approval
    1. Simply display the related item as plain text metadata (until workflow approval completes).
13. 1. 1. 1. 83
          2.  REST Impl: https://github.com/DSpace/DSpace/pull/2614
          3.  Angular Impl
     Edit Item page integration
    1. How to display relationships on "edit metadata" tab in UI.  How to add relationships on "relationships" tab in UI.
    2. Angular UI Mockups discussed/approved on Nov 5 and Nov 12.
    3.  Angular relationships tab
       1. 1. : https://github.com/DSpace/dspace-angular/pull/
       517
       1. 1. 540
14.  Name Variants
    1.  Create name variants in submission
     (DELAYED) Relations in AIP Backup & Restore
    1. Discussed on Oct 15
    2. Proposal: 
       1.  REST Impl:
       1. https://
       docs
       1. github.
       google.
       1. com/
       document
       1. DSpace/
       d
       1. DSpace/
       1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.qi8bp6kog7yi
     (DELAYED) Creating Relations in SAF Import (might be postponed for a future release)
    1. 1. pull/2561
       2.  Angular Impl - this is included as part of https://github.com/DSpace/dspace-angular/pull/531
    2.  Display name variants on Item pages (Angular)
15. OpenAIRE v4 support (using Entities)
    1.  Configuration of Entities needed for OpenAIRE v4
    2. Requires AIP Backup & Restore
    3. Proposal: https://docsgithub.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.n8ktliibe7kj
16.  (DELAYED) SWORD integration (might be postponed for a future release)
    1. Requires AIP Backup & Restore, as SWORD uses the same crosswalks / format as AIP.
    2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.xufwyy1ep8h2
17.  (DELAYED) Best Practices around Entities in Collections (NOT: this may just be early documentation).  We've suggested in the Preview Release to structure Collections based on Entity Type (Person Collection, Projects Collection, etc).  We should better document and formalize these best practices. 
    1. Should we eventually consider hiding these Collections which only serve to store Entity Types?

...

1. 1. com/DSpace/DSpace/pull/2575
   2.  Configuration of Metadata fields/schemas needed for OpenAIRE v4: https://github.com/DSpace/DSpace/pull/2576
   3.  Configuration of Submission Input Forms for OpenAIRE v4: https://github.com/DSpace/DSpace/pull/2608
   4.  Configuration of OAI-PMH for OpenAIRE v4: https://github.com/DSpace/DSpace/pull/2592
   5.  Import entities/metadata from OpenAIRE API (using Live Import feature): https://github.com/DSpace/DSpace/pull/2655
2.  How to display related items on an Item page if that related item is still in workflow approval
   1.  Simply display the related item as plain text metadata (until workflow approval completes).
3. Edit Item page integration
   1. How to display relationships on "edit metadata" tab in UI.  How to add relationships on "relationships" tab in UI.
   2. Angular UI Mockups discussed/approved on Nov 5 and Nov 12.
   3.  Angular relationships tab: https://github.com/DSpace/dspace-angular/pull/517
   4.  Create relationships as an admin in edit item (under review): https://github.com/DSpace/dspace-angular/pull/545
4.  (DELAYED for 7.1 or later) Relations in AIP Backup & Restore
   1. Discussed on Oct 15
   2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.qi8bp6kog7yi
5.  (DELAYED for 7.1 or later) Creating Relations in SAF Import (might be postponed for a future release)
   1. Requires AIP Backup & Restore
   2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.n8ktliibe7kj
6.  (DELAYED for 7.1 or later) SWORD integration (might be postponed for a future release)
   1. Requires AIP Backup & Restore, as SWORD uses the same crosswalks / format as AIP.
   2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.xufwyy1ep8h2
7.  (DELAYED for 7.1 or later) Best Practices around Entities in Collections (NOT: this may just be early documentation).  We've suggested in the Preview Release to structure Collections based on Entity Type (Person Collection, Projects Collection, etc).  We should better document and formalize these best practices. 
   1. Should we eventually consider hiding these Collections which only serve to store Entity Types?

Notes

• Last meeting of the DSpace 7 Entities Working Group (2018-19) (on indefinite hiatus).  Our working group is considered disbanded unless we find a reason to meet later in the year (if any remaining Entities effort is needed later in 2020)
  
  • REST API effort (contract & implementation) for Entities is COMPLETE!
  • There are still some outstanding Angular and OpenAIREv4 PRs (see list of "178881628" above), but NO MORE FEATURE PRs are expected
    • One exception we realized is that Dimitris from OpenAIRE is working on a PR to import metadata from the OpenAIRE API (using the existing "Live Import" framework in DSpace 7).  This PR is currently listed as "COMING SOON" above, and should be created by the end of 2019. It can be reviewed by volunteers in 2020.
• Next Steps for still open PRs
  
  • These are considered low priority to review/test in 2020.  The main DSpace 7 Working Group (2016-2023) will be working in organized sprints to finalize the DSpace 7.0 release, so their priorities will be on general DSpace 7.0 features.
    • That said, volunteer developers can continue to review Entities PRs as they see fit.  Tim will also review & test them when his time allows (but only after any high priority DSpace 7 PRs are reviewed/tested first)
  • As Working Group is no longer meeting, any Entities PR discussion should move to #entities-wg in Slack or GitHub. 
  • If a small group wants to talk in more detail about a specific PR, the DSpace Meeting Room is always available for an ad hoc PR meeting.  These can be organized or requested via Slack or Github.
• As the Working Group is not meeting any further, the "178881628" list & "178881628" sections above should be kept updated to let volunteers know the current status of any remaining Entities PRs.
• Thanks again to all who participated in the DSpace 7 Entities Working Group (2018-19) !  It's been wonderful seeing the passion & energy for both Entities & OpenAIREv4 in DSpace 7.  Please consider joining our DSpace 7 Working Group (2016-2023) in 2020 (if you have not already) to help us complete the 7.0 release!