...
- Danny Bernstein
- Arran Griffith
- Jared Whiklo
- Ben Pennell
- Michael Ritter
- Demian Katz
- Jon Roby
- James Alexander
- Thomas Bernhart
...
- Announcements:
- Pop-up/Other Topics:
- Fedora Release 6.3.0??
- Fedora Settings for OCFL 1.0→1.1 Auto upgrade:
- Docker Conversation recap
- Docker-Sponsored Open Source Program application: https://www.lyrasis.org/programs/Pages/membership-value-and-benefits.aspx
- Fedora with S3: recommended settings for Consistency level?
- none → meaning evantual consistency is fine for new and updated objects
- Read-after-new-write → meaning read-after-write-consistency for new objects, but not for updated objects
- stronger → meaning read-after-write-consistency for new and updated objects
- Migration Updates:
Updates on
- in progress
Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3857 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3853 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3856 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3847
- In Review:
Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3818 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3845 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3673 Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3816
- in progress
New tickets:
- Backlog Tickets to consider working:
Notes:
Announcements: Fedora Docker Conversation date finalized - Thanks to Thomas for setting it up,
Nov 1 @ 11am Eastern
invites went out, ask Arran for invites if needed, 8-10 have accepted invitations
committers leaders call cancelled next week in lieu of docker conversation
Lyrasis CEO announcement
Email has been sent out, John Wilkins is the new CEO, starts dec 1st
trasnsition period between current and new CEOs
Fedora Developer announcement
Dan Field is the new part time developer, starts jan 3rd, hopefully finishing migration at library of wales before starting in new role, will start attending meetings
Pop-up/Other Topics:
Samvera updates from Samvera Connect on Valkyrie and Hyrax
https://drive.google.com/file/d/1RYxBRdMyYjjxJlnQK9KTMVuOu2FJEj0y/view?usp=sharing
Ben is at samvera connect
presented yesterday about fedora 6 and pathways to fedora 6
attended product meeting, daniel pierce chart (link above) for pathways for hyrax with valkyrie 3 and active fedora
valkyrie vectors pass tests for 4,5 and 6 but no one is using them in production
some componanets of valkyrie not ready for samvera, but connectors are built
fedora talk went very well
Berlin State library using fedora 6 still with active fedora and samvera app on the front end
GitHub analytics?
Danny and Mike had started chatting about this at the Fedora staff meeting last week
discussion about sourceforge metrics, having github metrics
Danny - do we need an automated mnothly metric report? who is the audience?
Arran - useful for governence, who is using fedora, how many downloads?
downloads as a minimum for the report, track it over quarters so we have historical data
Danny - downloads, total forks, clones, (stars?)
will create ticket for this work (github analytics)
Scale testing Fedora 6
all use cases are different, but useful to have a number of binaries/etc to tell
people
Jared - number of items it can handle? how quickly? example could be Berlin?
arran - berlin only migrated 30k objects. question came from andrew, have we tried stress testing the system, generating binaries, perform searches, etc
Jared- stress testing could be expensive for s3 storage, etc
Dan - project has old stress test scripts that need to be updated (jmeter?)
andrew did this previously and got to 20 million objects
Jared - not sure what kind of objects those 20 mil were, previous tests tested each type of object, maybe we test multiple types simulataneously? maybe random obj types and specify a max disk size to fill?
Dan - writing a script to generate a certain number of objects, with certain range of child objects or a depth of tree, large files and/or small files to stress test. will create a ticket for that work.
Arran - can we poll the community to see who is using 6 and how many objects they have, as a rought idea of what is attainable. make this an action item
Migration Updates:
Demian - setting up producction servers, no news
James - asks if there are problems mounting NFS from Azure. should be the same as AWS, no one has tried this.
Calvin - good. higher priorities so not much work. Has a subset of their items, Has 1 mil objects in XML format
James - asked about documentation for OCFL/MariaDB/Postgresql connectors. Arran suggested the Code4Lib slack channel would be a good place to ask. jared suggested that maybe OCFL-java was updated and other projects needed to be updated.
Updates on
in progress and older but still relevant open tickets:
Mike R - FCREPO-3830 acl for transactions, PR soon, need integration test
talked with Danny about migration validator ticket FCREPO-3845, could not replicate behaviour
In Review:
New tickets:
FCREPO-3859 - Non default (<>) subject statements misrepresented in binary resources Received
Jared - problem seems a PUT to the binary description being altered, probably mis-implementation issue. code might be stripping subjects as they come in. found fedora reads binaries one way and migration tool writes them another way, so uses the binary URI. checks if using the binary URI and this might be why.
FCREPO-3858 - Allow both ldp:hasMemberRelation and ldp:isMemberOfRelation for DirectContainers Received
Jared - seems can only use one at a time?
Danny - difference between the two calls?
Jared - its direct vs Indirect containers and no one really remembers, would have to remember how each one works, would have to either fix the code or shelve it if no one uses it.
FCREPO-3853 - PUT returning 404
Jared - repeatedly adding and removing a container eventually makes the system crash
Mike R - not had time to work on this ticket this week, takes time to run test
Jared - be nice to get a stack trace or logs of a crash, maybe its resources?
Mike R - says it only happens sporadically every 1 to 2 days. Ask Justin Merz if it happens again if he can grab logs or a stack trace
...
- Fedora Docker conversation went well. We'll trying to bring it to a close next week during the tech call.
- We should apply for free DockerHub storage for open source projects
Release 6.3.0
- Danny will be release manager
- Announcement will go out on Monday
- All in progress/in review tickets will got into the release
- Adding ability to upgrade to OCFL 1.1 from 1.0 will be deferred
- fcrepo-doctor could take care of it - Jared Whiklo will create a ticket
- Jared Whiklo will create a ticket that will instruct fedora to create new objects as OCFL 1.1.
S3 Consistency levels
- if you're using postgres database caching, eventual consistency should not be a problem.
Migration Updates:
- Villanova should be going live once the migration is complete - should be done by January 1.
In progress tickets
: very hard to reproduce. If Mike can reproduce consistently then it will go into the release, but not likely.Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3853
: Mike will create integration test - will go into the releaseJira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3847
: hard to verify that it has been fixed.Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3847
: Jared Whiklo will confirm that this works on the Brown dataset.Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3845
: Is ready to be closed - if anyone wants to look at before feel free.Jira server Fedora JIRA serverId 1fe6d535-c432-380f-b5c0-a7d3b2940ea4 key FCREPO-3816
FCREPO-3856 - builds fail sometimes
Jared- not sure what is failing, seems to be containment table is not created and tests fail. Database spradically seems to not create table. Might be dependent on testing platform resources (RAM?)
Danny - will take this ticket
...