...
- Danny Bernstein
- David Wilcox
- Jared Whiklo
- Peter Winckles
- Ben Cail
- Daniel Lamb
- Calvin Xu
- Ben Pennell
- Thomas Bernhart
Agenda
- Announcements
- Sprint Planning
- Review Objective(s) of this sprint
- Review of the Board
- Performance Testing
- Flyway DB
- PRs needing attention
- https://github.com/fcrepo/fcrepo/pull/1853
- https://github.com/fcrepo-exts/migration-utils/pull/141
- Your topic here
- guidance on setting up solr with fedora6 for prototyping blacklight sit on top of solr driven fedora 6
Tickets
In Review
Expand Jira server DuraSpace JIRA jqlQuery filter=13100 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Please squash a bug!
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13122 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Tickets resolved this week:
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13111 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Tickets created this week:
Expand Jira server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery filter=13029 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5
Notes
- No announcements
- Sprint planning
- Main objective is getting to Beta, would be ideal if we can cut the Beta release during the sprint.
- Some important tickets are FCREPO-3605 (Add version property to the resource headers) and FCREPO-3608 (Initiate creation of memento with 'mementoCreatedDate')
- FCREPO-3623 - Upgrading to ocfl-java now that the specification has been merged needs to happen.
- FCREPO-3613 - Issues around GETting and PUTting to an existing resource.
- FCREPO-3583 - Allow users to configure default OCLF digest algorithm.
- OCFL bloat due to running the migration-utils over an existing repository output. Calvin and Peter to examine a single OCFL object from the migrated repository to see what they can figure out.
- Performance testing
- There is some caching of the resource headers. But we are not caching rdf types which would have additional benefits. It is hard to compare what others (Killian in this case) are doing to try and match their setup.
- Calvin will help test the updated documentation on indexing Fedora 6 to a Solr instance (FCREPO-3573)
- Flyway stuff is almost complete.
- PRs - Inline XML PR, Danny wants to confirm with Scott Prater that this solution is acceptable to him.
- Moving Camel toolkit to a non-OSGI environment. Thomas Bernhart and Ben Pennell both have experience and/or interest
- Affirming the team's understanding of famous current issues/bugs:
- bloated directory from migration utility update
- Peter has offered a potential solution to Calvin - just waiting to hear back
- Could also be due to incorrect size being reported from du command
- Fedora 3 "bad" checksum issue - for reference the MOTHER OF ALL THREADS on the subject (JIRA:
)Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3604 - Changes to migration-utils
- Extract data stream from inline XML and calculate checksum based on that
- Expectations for the fcrepo-migration-validator
- Bad checksums in Fedora 3 will stay in Fedora 3 - validator will not carry this forward
- Danny will create JIRA tickets to track these issues
- Changes to migration-utils
- The Daniel Lamb Bug
- Danny migrated a dataset with spaces in IDs
- Migration worked but updating a resource resulted in corrupted RDF with spaces in the IDs such that the object can no longer be read
- May be an issue with Millner
- Jared will help with debugging by trying to duplicate the issue
- The new Prefer Header recently accepted as part of the Fedora API : https://github.com/fcrepo/fcrepo-specification/pull/412
- Core: http://fedora.info/definitions/fcrepo#ServerManaged is not currently recognized
- Danny will create a JIRA to update
- Do we deprecate or accept both?
- Add to list of breaking changes and deprecate
- Core: http://fedora.info/definitions/fcrepo#ServerManaged is not currently recognized
- The new resource header (json) field jira that will make the following PR's no longer need to be merged:
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3592 Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3591 Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3595 Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3593 Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3596
- Validation error reporting on start up and side-loading: What is going to work for the user?
- For reference: https://github.com/fcrepo/fcrepo/pull/1852#pullrequestreview-577812174
- Currently, on start up, log messages indicate validation failures
- As a user, if you don't examine the logs, you won't notice the failures - need to document clearly
- bloated directory from migration utility update
- PRs
- object validation
- https://github.com/fcrepo/fcrepo/pull/1852 (wiring validation into fedora)
- https://github.com/fcrepo/fcrepo-storage-ocfl/pull/28 (validation logic)
- Danny will merge these today
- Minimum container triples: https://github.com/fcrepo/fcrepo/pull/1851
- Andrew is reviewing this
- object validation
- Sprint planning:
- Testing
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3612 - Confirming rebuild is faster post-parallelization
- https://docs.google.com/document/d/1ihoAHlnl1X8yCLF9cXT-ZmZFkCX37nYzgqIc-U3J2YQ/edit
- Community-sourced performance criteria
- Need to review for anything that should be included in the beta
- Development: Are the following must haves for beta?
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3610 - Need to get a baseline as soon as possible
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3605 - Small task but should be included
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3601 - Not critical for beta but needs to be in the release
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3597 - Not a beta blocker - just need to default to n-triples if there is no mime type
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3584 - Probably not a beta blocker but unsure how many people use ghost nodes
- Not affecting how anything is stored on disk in any case
Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3585 Jira server LYRASIS JIRA serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key FCREPO-3606 - Not a beta blocker but relatively easy to implement
- Documentation
- Lots of things to work on
- Testing
- Release processWith Andrew leaving it would be good to have others involved in the release process