Page tree
Skip to end of metadata
Go to start of metadata

Time/Place

This meeting is a hybrid teleconference and slack chat. Anyone is welcome to join...here's the info:

Attendees 

  1. Danny Bernstein
  2. David Wilcox 
  3. Jared Whiklo 
  4. Peter Winckles 
  5. Daniel Lamb 
  6. Ben Pennell 
  7. Thomas Bernhart 
  8. Calvin Xu 
  9. Michael Ritter (star)

Agenda

  1. Announcements
    1. 2021-04 Fedora 6 Sprint 
    2. North American User Group Debrief
  2. Performance issues needing attention
    1. Short-lived transactions related issues
      1. FCREPO-3697 - Getting issue details... STATUS
      2. FCREPO-3695 - Getting issue details... STATUS
      3. FCREPO-3696 - Getting issue details... STATUS
    2. Migration Utils slow-down
      1. Do we know the problem is neither memory nor IO bound?
      2. Are there JVM tunings that we haven't tried?
      3. Is a heap dump likely to help us?
      4. Status of instrumenting migration-utils with micrometer: FCREPO-3692 - Getting issue details... STATUS

  3. Pilots / Testing
  4. Pre release short list of bug fixes and improvements
    1. FCREPO-3620 - Getting issue details... STATUS
    2. FCREPO-3561 - Getting issue details... STATUS
    3. FCREPO-3638 - Getting issue details... STATUS
    4. FCREPO-3672 - Getting issue details... STATUS
    5. FCREPO-3690 - Getting issue details... STATUS  
    6. FCREPO-3691 - Getting issue details... STATUS
  5. Marmotta is retired: fcrepo-camel-toolbox/fcrepo-ldpath depends on it.  What's our plan?
  6. Volunteers to be the maintainer on https://github.com/fcrepo-exts/migration-utils
  7. Any other new tickets/issues to be considered for the release
  8. Your topic

Tickets

  1. In Review

    T Key Summary Assignee Reporter P Status Resolution Created Updated Due
    Loading...
    Refresh

  2. Please squash a bug!

    Key Summary T Created Updated Due Assignee Reporter P Status Resolution
    Loading...
    Refresh

  3. Tickets resolved this week:

    Key Summary T Created Updated Due Assignee Reporter P Status Resolution
    Loading...
    Refresh

  4. Tickets created this week:

    Key Summary T Created Updated Due Assignee Reporter P Status Resolution
    Loading...
    Refresh

Notes

  1. Announcements
  2. Performance Issues
    1. Short live transactions
      1. More of an impact on reads than writes, e.g. getting the root resource of your repository with 1m+ items
      2. Ordering adds more latency
      3. Ongoing work for short lived transactions
        1. Long lived transactions perform full join
        2. Short transactions perform a simpler query
        3. Could be expanded to writes
      4. Search Index
        1. Current work is for a synchronous update
        2. Question of how much of a performance impact there is when updating the index
        3. Possibility of adding config to update async through event bus from initial discussion
    2. Long running transactions in bad states
      1. If changes are already committed to the ocfl layer, changes can't be rolled back
      2. Might be able to attempt to rollback, then mark transaction as failed
      3. Can also prevent the transaction from being committed at all
    3. Migration utils
      1. For pid list: need to stop iterating the F3 repository once we've processed all items
      2. metrics: Try and capture bytes/sec



Actions

  • Look through migration util commits since December to see if there are any potential causes of performance drop off.
  • No labels