...
Time/Place
This meeting is a hybrid teleconference and slack chat. Anyone is welcome to join...here's the info:
...
- Danny Bernstein
- Andrew Woods
- Peter Winckles
- Ben Pennell
- Ben Cail
- Jared Whiklo
- David Wilcox
- Calvin Xu
- Thomas Bernhart
- Daniel Lamb
- Arran Griffith
Agenda
- Announcements/Updates
- F3→6 migration validation tool
- Fedora Migration Validation ToolMigrating from Previous Versions of Fedora
- Migrate to Fedora 6
- Welcome Arran Griffith
- Demo Videos - demo video releases to be restarted
- Planned Breaking Changes (standing topic)
- PRs needing attention
- Housekeeping
- Merging 4.7-5.x into main in fcrepo-upgrade-util
- Cutting a release of fcrepo-import-export
- November Sprint Planning
- Alpha Announcement
- Fedora 6 Testing
Your Topic Here
Expand title Tickets resolved this week... Jira server DuraSpace JIRA jqlQuery filter=13111 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5
...
In Review
Expand Jira server DuraSpace JIRA jqlQuery filter=13100 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Please squash a bug!
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13122 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Tickets resolved this week:
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13111 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Tickets created this week:
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13029 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5
Notes
- Announcements
- New program coordinator may help out with the production of additional demo videos
- Demos - Searching, Starting fedora on EC2, etc
- OCFL community meeting
- New java based HTTP server over OCFL
- OCFL commandline client
- Planned breaking changes
- None.
- Sprint wrap-up/Ongoing work
- S3 support/performance improvements
- Peter setup config to run fedora in S3
- Performance improvements made based on results of load testing
- Caching of headers helps reduce the number of requests to S3
- Taking around 5 seconds to create a binary in S3, versus < 100ms in local file system.
- Thomas has tried using S3 synced local file system with Fedora 3. This use is not encouraged, and can be buggy/non-performant.
- Islandora uses external content for S3 storage.
- Memento containment issue
- FCREPO-3450
- HTML UI
- UI should now be as feature rich as Fedora 5.
- No version creation available via the UI if autoversioning is turned on
- Clicking to create a version when there are no changes takes you to the versions page, but does not create a version.
- Direct and Indirect Containers
- DirectContainer membership is being calculated, working on returning it for HEAD and mementos
- f4→f6 migration
- Excluding membership from export, as it should not be importing these generated properties
- Should now support all content types
- F4→F5 migration is largely working, have manually performed F4->F5→F6 transformation, implementing tests
- S3 support/performance improvements
- Alpha Release
- Was being held up by migration util for 3 and 4/5 to 6
- May be able to cut an alpha release next week, for testing usage only.
- Fedora 6 Testing
- Re-ran the API test suite, reduced to 27 errors (was around 47 before). Creating tickets for them as needed.
- There is a utility for deploying Fcrepo to AWS. Will add options for type of storage to mount for it.
- Suggested to change default database to postgres instead of mysql, due to performance
- /Updates
- F3-6 migration validation tool - design doc, migration doc
- Arran - working w/ David on governance/wiki/demos/user group meetings/...
- Demo videos - see ideas and sign up in google doc; videos are well-received by community; aim for 1 every couple weeks
- performance testing - test #4 (creating empty containers infinitely) - died because it used up 500GB disk space in ~90 hours (performance wasn't degrading)
- S3 test died, probably because of hiccup connecting to S3
- need to test other interactions as well, besides creating empty containers
- Peter's done some ocfl-java S3 performance testing
- Planned breaking changes
- none
- PRs needing attention
- https://github.com/fcrepo-exts/fcrepo-upgrade-utils/pull/24 - could use testing. Final piece for migrating Fedora 4 to 6. Need this for alpha.
- direct containers PR adding membership relations, validation, re-enabling/new ITs - should be done
- Housekeeping
- need a release of import-export tool - once in-process work is done
- fcrepo-upgrade-util - 4.7-5.x branch needs to be merged
- release before/with alpha
- fcrepo-storage-ocfl - in fcrepo-exts currently - should be migrated into fcrepo/
- migration from 5 to 6 - doesn't support resuming migration or identifying failed objects
- November sprint planning - focus on testing/fixing bugs - pretty good shape for features
- or use sprint to finish up alpha (or just release beta)
- Alpha announcement
- Fedora 6 testingMultiple errors in RDF, should we return collecting up errors to return together?
- Danny Bernstein to ensure that a JIRA exists for scenario of transaction does not succeed completely, but rollback does succeed (see: 2020-08-13- Fedora Tech Meeting)
- Danny Bernstein document the process of migrating from 4 → 5 → 6
- Peter Winckles to create a JIRA to investigate support for optimistic locking and mutable head (see: 2020-08-13- Fedora Tech Meeting)
- Who: Clarify in documentation that multiple simultaneous writes to OCFL are not supported
- migration-utils - translating RELS-EXT/INT into RDF in Fedora 6: is the functionality there? If not, add it.
- Danny Bernstein to organize a special topic call around the topic of high availability.
...