Page History

...

• Tim Donohue - LYRASIS
• Pascal-Nicolas Becker - The Library Code (unavailable)
• Alexander Sulfrian - Freie Universität Berlin 
• Lieven Droogmans - Atmire
• Ben Bosman  - Atmire
• Paulo Lopes - FCT|FCCN 
• Mark H. Wood - IUPUI
• Paulo Graça- FCT|FCCN
• Jose Carvalho - University of Minho
• Dimitris Pierrakos - ARC/OpenAIRE
  
• Oliver Goldschmidt - Hamburg University of Technology (TUHH)
  
• Helen Baer - Colorado State University

Current Work

...

= Highest Priority tasks (please prioritize these reviews/tasks over others). These are tasks with lots of dependencies

 = review done, changes were requested or bugs found.

= review done, approved.

= review done, merge conflict or other minor changes requests

...

Agenda

Current Work

Tickets to Resolve

• All JIRA tickets tagged with "Configurable Entities": https://jira.duraspace.org/issues/?jql=project%20%3D%20DS%20AND%20component%20%3D%20%22Configurable%20Entities%22
  • Critical Tickets: https://jira.duraspace.org/issues?jql=project%20%3D%20DS%20AND%20priority%20%3D%20Critical%20AND%20component%20%3D%20%22Configurable%20Entities%22
  • Major Tickets: https://jira.duraspace.org/issues?jql=project%20%3D%20DS%20AND%20priority%20%3D%20Major%20AND%20component%20%3D%20%22Configurable%20Entities%22
• (HIGH PRIORITY) Bug with performance of Angular (especially with regards to Entities, e.g. in PR#402): https://github.com/DSpace/dspace-angular/issues/458
  

PRs Needing Review

1. (REST Contract) Entities: Creating an archived item from an external source https://github.com/DSpace/Rest7Contract/pull/82 (Paulo Graça - feedback provided, Tim Donohue)(REST Contract) Metadata suggestions in the live import https://github.com/DSpace/Rest7Contract/pull/83 (Paulo Graça - suggests to split in 2, Tim Donohue - added questions/feedback)
2. (REST) Ds 4224 paginated methods for relationships Entities bug-fixes in place management https://github.com/DSpace/DSpace/pull/25352551 (Chris Wilper, - feedback provided, Alexander Sulfrian ) (CAN BE MERGED)Tim Donohue, Paulo Graça) May just need one approval
3. (REST) Entities bug-fixes in place management Feature: external sources https://github.com/DSpace/DSpace/pull/25512560 (Chris WilperPaulo Graça,  Tim Donohue, Paulo Graça ) May just need one approval
4. (NEW) (REST) Feature: external sources  Entities: configuring whether name variants should be used https://github.com/DSpace/DSpace/pull/25602561 (Paulo Graça, Tim Donohue)
5. (Angular) Item page entities changes/refactoring https://github.com/DSpace/dspace-angular/pull/475 (Paulo Graça  , Tim Donohue - quick review)
6. (Angular) Name variants on item pages https://github.com/DSpace/dspace-angular/pull/496 

   Status
   colour Blue title 1 approval

     (Paulo Graça , Tim Donohue - quick review)

PRs Merged this week!

1.  (REST Contract) Entities support for external authority sources ) Ds 4224 paginated methods for relationships https://github.com/DSpace/Rest7ContractDSpace/pull/742535
2.  (REST Contract) Discovery indexing: Ensuring discovery configuration is used during indexing Entities: Creating an archived item from an external source https://github.com/DSpace/DSpaceRest7Contract/pull/252782

Task List

This list was roughly prioritized in the meeting on May 23, 2019 (just before OR2019).  The prioritization below may change, but it gives a high level overview of what still needs to be done. task list has been updated as of our meeting on Oct 22, 2019.  The tasks are numbered for easy reference, but are not necessarily listed in priority order.  During this meeting we worked to re-summarize current work status so that we can align this task list with the DSpace 7 Estimation Process (and as such, estimate any we feel should be considered for 7.0 release).  NOTE: Keep in mind, just because an item a task is listed here does NOT guarantee it will be completed for DSpace 7.  Some of these tasks may need to be delayed for a future release.

1.  Metadata schemas for Entity types
2. Submission integration (creating Entities & relations using the Item submission process) - Mockups already created by Paulo previously. - In implementation
   1. Not started yet: Adding name variants, importing from external sources
3. Which metadata fields should be used for each Entity type. (DS-4223). 
   1. REST: 
   - In implementation
   1. Not done yet: A field to store the entity type. This is currently set to relationship.type
4. Additional data for relations (essentially "metadata" or labels on relations) - Related to many other features / use cases.   - In implementation
   1. Not fully complete.
5. Author name variants  - In implementation
   1. Not fully complete. Can estimate.
6. Configuration of batch import (via CSV) for Entities - Already a CSV import available, but can only link entities in CSV to existing entities (in the system). Need to decide how to represent relations in CSV. - In implementation
   1. Needs analysis of what is outstanding.
7. Permissions on Relations (who has permissions to add/modify/delete relations) - Currently, if you have Edit permissions on the Entity, then you can edit/delete any relationships to/from that Entity. (NEEDS DISCUSSION)
8. Deleting objects with Relations (How or should deletion propagate between closely related objects, e.g. delete entire Journal) - Currently, deleting a relation just decouples the two Entities.  E.g. If you delete a Person entity, that Person may no longer be listed on any Publications it is linked to (may want to copy info over after deletion).  - Discussed on Aug 6
   1. Relates to GDPR
9. AIP Backup & Restore (of Entities)*
10. Dynamic display of Relations - determine automatically how a list of entities displayed on an Item page (list vs search). Currently hardcoded based on entity type (in item page template). Want to make it configurable/dynamic. (NEEDS DISCUSSION)
11. SWORD integration (submission of Entities via SWORD) - Uses same format as AIP. Once AIP is implemented, SWORD should be easy.
12. OpenAIRE v4 implementation using Entities* - Brought up in Steering.  Possibly just an OAI-PMH configuration which maps Entity metadata fields to OpenAIRE v4
13. ORCID integration with Entities (for Person Entities). (Related to #15)
    1. Importing from external sources (can estimate)
14. 1. https://github.com/DSpace/DSpace/pull/2443 , Angular: https://github.com/DSpace/dspace-angular/pull/420
    2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.wjaqg235p53r
15.  (Minor refactor) Decide which metadata field should be used to store Entity Type (DS-4184).  Currently, it is stored in "relationship.type".
16.  Creating Relations (between Entities) with CSV Batch Import 
    1. REST: https://github.com/DSpace/DSpace/pull/2269 and https://github.com/DSpace/DSpace/pull/2471 and https://github.com/DSpace/DSpace/pull/2522
    2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.df1z7jh9mcc
17.  Permissions on Relations (between Entities)
    1. Discussed on Aug 6 
    2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.y6qarjnylexl
18. Deleting Entities that have existing relations
    1.  Deletion action itself:
       1. REST Contract: https://github.com/DSpace/Rest7Contract/blob/master/relationships.md#deleting-a-relationship , REST: https://github.com/DSpace/DSpace/pull/2332 , Angular: https://github.com/DSpace/dspace-angular/pull/402
       2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.c62y8iqnvlur
    2.  Copy virtual metadata from deleted entity to related entity
       1. REST Contract: https://github.com/DSpace/Rest7Contract/pull/78
       2. In implementation (REST API and Angular)
19.  Dynamic display of Relations
    1. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.pm34t6u1djdf
    2.  May require usability improvements (NEEDS DISCUSSION)
20. Submission Integration Tasks
    1.  Creating new Entities using Submission Forms
       1. REST: https://github.com/DSpace/DSpace/pull/2443
       2. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnp
    2.  Creating relations between two Entities during Submission process
       
       1. Contract: https://github.com/DSpace/Rest7Contract/pull/64 , REST: https://github.com/DSpace/DSpace/pull/2472
       2. In Implementation (Angular)
       3. Early Docs / Notes: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.9aixusqzgcnp
    3.  Search External Sources (includes ORCID integration with Entities)
       1. REST Contract: https://github.com/DSpace/Rest7Contract/pull/74 (in review)
       2. REST: https://github.com/DSpace/DSpace/pull/2560 (in review)
       3. In Implementation (REST API and Angular)
    4.  Convert External Sources to an Entity
       1. If an Admin: Contract under review: https://github.com/DSpace/Rest7Contract/pull/82
       2. If a Submitter: Contract under review: https://github.com/DSpace/Rest7Contract/pull/83
21. Name Variants
    1.  Create name variants in submission
       1. In Implementation (REST API and Angular)
    2.  Display name variants on Item pages (Angular)
22.  OpenAIRE v4 implementation (using Entities)
    1. TO BE DISCUSSED ON OCT 29. 
    2. Early PR expected in the next week or so.  This initial work will be configuration only (no new code). 
    3. Possible need for a follow-up PR to implement improvements to OAI-PMH to support OpenAIRE v4.
23.  How to display related items on an Item page if that related item is still in workflow approval
    1. TODO: Needs proposal.  Early idea is to simply display the related item as plain text metadata (until approved).
24.  Edit Item page integration
    1. TODO: Needs proposal.  How to display relationships on "edit metadata" tab.  How to add relationships on "relationships" tab
25.  Relations in AIP Backup & Restore
    1. Discussed on Oct 15
    2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.qi8bp6kog7yi
26.  Creating Relations in SAF Import (might be postponed for a future release)
    1. Requires AIP Backup & Restore
    2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.n8ktliibe7kj
27.  SWORD integration (might be postponed for a future release)
    1. Requires AIP Backup & Restore, as SWORD uses the same crosswalks / format as AIP.
    2. Proposal: https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.xufwyy1ep8h2
28.  Best Practices around Entities in Collections (NOT: this may just be early documentation)Best Practices around Entities in Collections.  We've suggested in the Preview Release to structure Collections based on Entity Type (Person Collection, Projects Collection, etc).  We should better document and formalize these best practices.  Can we hide
    1. Should we eventually consider hiding these Collections which only serve to store Entity
    Type.
29. The ability of pick the proper affiliation of a Person for a specific context. DSpace should address this use case to allow the user to describe something like in this document http://repositorium.sdum.uminho.pt/bitstream/1822/46268/1/1-s2.0-S1877050917302788.pdf regarding the authors and affiliations. You have different persons, each can belong to an institution at the time of that publication. The affiliation shouldn't be changed afterwards. And the user should be able to pick the proper one if an Author has more than one.  (PER discussion on July 16, this is lower priority and may be more likely to be implemented in DSpace 8)

30. (REQUIRED) Deeper dive discussion into how Entities will work with Authority Control, and how ORCID integration will work (as ORCID integrates with Authority Control). Some useful resources:  Discussed in meetings on Aug 27 and Sept 17 - In implementation

    • Authority Control of Metadata Values
    • ORCID Integration#Importingexistingauthors&keepingtheindexuptodate

...

1. 1. Types?

Notes

• Discussion of OpenAIRE v4 updates.
  • Jose presented this slidedeck (first 5 slides are the new updates): https://docs.google.com/presentation/d/1G7JGRHq-qgQ44GSr3guBEUEQTb2-6JjKKsQ0-cPGkBM/edit
  • Some discussion around whether we should have separate "relationship-types.xml" and "schema.xml" (entity-types.xml) files specific to OpenAIRE
    • Tim notes that we might want to see if we can just update/use the core Entity "relationship-types.xml", if possible.   We need to determine though if there's significant overlap
    • For now, this approach seems good enough for a PR.  Once we see the PR, we might be able to more easily determine whether OpenAIRE needs custom configs, or if it can be added into the core Entities around Author Profiles / Publications.
• Discussion of Task List
  • Tim updated our list in this Wiki agenda based on last week's meeting
  • Lieven has internal estimates for the remaining tasks (except OpenAIRE and #12-15, which might be delayed).  See entities-task-list.pages.pdf
    • The top 7 tasks in this list have been subtotaled, as these are tasks that are already in progress – and that is the effort remaining in each task.  They total about 38 days of effort for 1 FTE.
    • The bottom 4 tasks have not been started, and perhaps could be candidates to move to the DSpace 7 Working Group meetings and/or reprioritize (as necessary)
  • Atmire feels these estimates are accurate.  We can at least use them as draft estimates for now, and check with Leadership / Governance if we need to do a more thorough estimation
• Assigned PRs and closed out meeting.  Next week we'll touch base again on OpenAIREv4 – hopefully there will be an early PR to discuss.