Contribute to the DSpace Development Fund

The newly established DSpace Development Fund supports the development of new features prioritized by DSpace Governance. For a list of planned features see the fund wiki page.

Date & Location

 at 15:00 UTC (11:00am EST)


Location:

Join from PC, Mac, Linux, iOS or Android:    https://lyrasis.zoom.us/my/dspace  (Meeting ID: 502 527 3040)

Attendees

Actual attendee list will be updated after meeting.

Agenda

#TimeItemInformationWho
15mins

Agenda

Any additional topics to today's agenda?

All
215minWorking to finalize task list for DSpace 7 Estimation Process
  • Review our updated Task List (to be drafted by Lieven Droogmans)
    • Filter out tasks that are "out of scope" for DSpace 7 (likely in DSpace 8 or beyond)
    • Define/scope/subdivide tasks that we want to estimate for DSpace 7.0 inclusion
  • Looking for additional volunteers to help with estimation of tasks!
  • Tim to report back on whether he can be the secondary estimator on all tasks.
All
35 minsPR 74

Any open feedback on  Entities support for external authority sources https://github.com/DSpace/Rest7Contract/pull/74?

This is a dependency for the new PRs 82 and 83 and the development in REST and Angular

Ben
415 minsAIP

Proposal on AIP export/import

https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.qi8bp6kog7yi

Ben
510minsWrap-up and Assigning tasks
  • Assign tasks / PRs to review (as needed)
  • Next meeting is Tues, Oct 22 

Current Work

Tickets to Resolve

PRs Needing Review

  1. (REST Contract) Entities support for external authority sources https://github.com/DSpace/Rest7Contract/pull/74 UPDATED (Paulo Graça (tick) ,Alexander Sulfrian(tick), Tim Donohue )
  2. (NEW) (REST Contract) Entities: Creating an archived item from an external source https://github.com/DSpace/Rest7Contract/pull/82 (Paulo GraçaTim Donohue)
  3. (NEW) (REST Contract) Metadata suggestions in the live import https://github.com/DSpace/Rest7Contract/pull/83 (Paulo GraçaTim Donohue)
  4. (REST) Discovery indexing: Ensuring discovery configuration is used during indexing https://github.com/DSpace/DSpace/pull/2527 (Tim Donohue, Paulo Graça (tick)) (READY TO MERGE)
  5. (REST) Ds 4224 paginated methods for relationships https://github.com/DSpace/DSpace/pull/2535 (Chris Wilper - feedback provided, Alexander Sulfrian (tick))
  6. (NEW) (REST) Entities bug-fixes in place management https://github.com/DSpace/DSpace/pull/2551 (Chris WilperTim DonohuePaulo Graça)
  7. (Angular) Item page entities changes/refactoring https://github.com/DSpace/dspace-angular/pull/475 (Paulo Graça (error) , Tim Donohue)
  8. (NEW) (Angular) Name variants on item pages https://github.com/DSpace/dspace-angular/pull/496 (Paulo GraçaTim Donohue)

PRs Merged this week!

  1. (tick) (REST Contract) Configuring whether name variants should be used https://github.com/DSpace/Rest7Contract/pull/77
  2. (tick) (REST) (Entities) CSV Import fixes, improvements to entity validation: https://github.com/DSpace/DSpace/pull/2522

Task List

This list was roughly prioritized in the meeting on May 23, 2019 (just before OR2019).  The prioritization below may change, but it gives a high level overview of what still needs to be done. NOTE: Keep in mind, just because an item is listed here does NOT guarantee it will be completed for DSpace 7.  Some of these tasks may need to be delayed for a future release.

  1. Submission integration (creating Entities & relations using the Item submission process) - Mockups already created by Paulo previously. - In implementation
    1. Not started yet: Adding name variants, importing from external sources
  2. Which metadata fields should be used for each Entity type. (DS-4223).  - In implementation
    1. Not done yet: A field to store the entity type. This is currently set to relationship.type
  3. Additional data for relations (essentially "metadata" or labels on relations) - Related to many other features / use cases.   - In implementation
    1. Not fully complete.
  4. Author name variants  - In implementation
    1. Not fully complete. Can estimate.
  5. Configuration of batch import (via CSV) for Entities - Already a CSV import available, but can only link entities in CSV to existing entities (in the system). Need to decide how to represent relations in CSV. - In implementation
    1. Needs analysis of what is outstanding.
  6. Permissions on Relations (who has permissions to add/modify/delete relations) - Currently, if you have Edit permissions on the Entity, then you can edit/delete any relationships to/from that Entity. (NEEDS DISCUSSION)
  7. Deleting objects with Relations (How or should deletion propagate between closely related objects, e.g. delete entire Journal) - Currently, deleting a relation just decouples the two Entities.  E.g. If you delete a Person entity, that Person may no longer be listed on any Publications it is linked to (may want to copy info over after deletion).  - Discussed on Aug 6
    1. Relates to GDPR
  8. AIP Backup & Restore (of Entities)*
  9. Dynamic display of Relations - determine automatically how a list of entities displayed on an Item page (list vs search). Currently hardcoded based on entity type (in item page template). Want to make it configurable/dynamic. (NEEDS DISCUSSION)
  10. SWORD integration (submission of Entities via SWORD) - Uses same format as AIP. Once AIP is implemented, SWORD should be easy.
  11. OpenAIRE v4 implementation using Entities* - Brought up in Steering.  Possibly just an OAI-PMH configuration which maps Entity metadata fields to OpenAIRE v4
  12. ORCID integration with Entities (for Person Entities). (Related to #15)
    1. Importing from external sources (can estimate)
  13. Best Practices around Entities in Collections.  We've suggested in the Preview Release to structure Collections based on Entity Type (Person Collection, Projects Collection, etc).  We should better document and formalize these best practices.  Can we hide these Collections which only serve to store Entity Type.
  14. The ability of pick the proper affiliation of a Person for a specific context. DSpace should address this use case to allow the user to describe something like in this document http://repositorium.sdum.uminho.pt/bitstream/1822/46268/1/1-s2.0-S1877050917302788.pdf regarding the authors and affiliations. You have different persons, each can belong to an institution at the time of that publication. The affiliation shouldn't be changed afterwards. And the user should be able to pick the proper one if an Author has more than one.  (PER discussion on July 16, this is lower priority and may be more likely to be implemented in DSpace 8)
  15. (REQUIRED) Deeper dive discussion into how Entities will work with Authority Control, and how ORCID integration will work (as ORCID integrates with Authority Control). Some useful resources:  Discussed in meetings on Aug 27 and Sept 17In implementation

Notes

  • Any open feedback on  Entities support for external authority sources https://github.com/DSpace/Rest7Contract/pull/74?
    • Tim notes this PR should not be changing the "/authorities" endpoint.  It's an Entities-specific PR, so it should just update "/externalsources" endpoint for Entities.
    • That said, if there are necessary refactoring/changes to "/authorities" endpoint those can be in a separate Contract PR, submitted to the DSpace 7 WG
    • Ben notes that makes sense to him too
    • Tim had questions in the PR on whether the "metadata" section coming back from each External Source would display DSpace schemas?  That seems to imply we'd be "pre-mapping" the response of the external source to DSpace metadata?
    • Ben answers Yes, we would need to do this pre-mapping to support the Angular UI anyways.  We don't want the Angular UI to have to "understanding" each different response from each different external source, so we need to map them to an understandable format/structure (DIM metadata in JSON response).  This simplifies things for the client.   Also, this same mapping can make the import process easier once a user selects an external object to import into an Entity (as it's metadata is already mapped)
    • Tim understands now.  This PR looks generally good.  Will add some notes to the approval though that if we hit performance issues or other issues with implementing this generic endpoint, then (as discussed last  week) we may need to revisit this contract.  But, it seems like a good place to start work.
  • Proposal on AIP export/import https://docs.google.com/document/d/1X0XsppZYOtPtbmq7yXwmu7FbMAfLxxOCONbw0_rl7jY/edit#heading=h.qi8bp6kog7yi

    • Ben walked us through this early proposal.
    • One of the main questions were around adding the "place" field to DIM output (to represent the ordering of metadata fields, especially important for mixed metadata – relationships and string metadata)
      • Tim and Paulo note this DIM output is likely used elsewhere (Paulo thinks the OAI harvesting uses it too).  But, that's not necessary a bad thing – the place field could be helpful there too
      • Generally, no one disapproves of this direction.  Seems like a "place" field would help simplify things, but we may want to make it optional .  If the metadata fields are already ordered, then place can be assumed to be the order they are in.  But, when needed (especially for entity relationships), "place" can be explicitly added to the field.
    • Other discussion notes were added to the Google Doc directly
  • Review our Updated Task List
    • Lieven is on holiday, and he wasn't able to pass along his work on this. 
    • We quickly ran through the tasks listed as "in implementation" to determine if any are complete.  None seem to be.  So, we need to better define/determine the remaining subtasks for each in order to add to an estimation spreadsheet
    • Lieven did have some notes on outstanding tasks from the North American User Group meeting talk on Entities.  Tim thinks those may have been higher level, but will review to see if they can be applied to this task list to make estimations easier here.
  • Wrapped up meeting with assignment of PRs.  Next meeting is Tues, Oct 22.
  • No labels