Sprint Team

General

Daily at 11am ET
Call-in: Google-hangout at:
- https://plus.google.com/hangouts/_/event/c1glu6soq43r1rr6ou17qtobug8
ReadyTalk (in case we reach hangout limit)
- 866-740-1260, participant code: 2257295
- internationally: http://www.readytalk.com/intl

Kernel-api work
- PR is ready to go with small code-review updates
- Frank's SCAPE connector may be impacted (likely not)
- Kernel has dependencies on Jena, we should revisit
- Dependency: snappy-java is questionable
- Side note, Adam is reinstalling own computer
- Adam to create ticket: update maven artifact names
OSGi pluggable work - Adam to continue
BOM work - push to just before beta release
There are 4 bugs to be fixed
Modeshape 3.7.1, waiting on Greg's fix
Frank
- Will be working on clustering
- Filter in web.xml for auth
- Wrap modeshape authz exceptions and catch in a filter
Clustering work
- Testing performance
- Documentation - on one machine and multi-machines
SCAPE usecase
- Reading, ingesting
- Currently off by a factor of four to goals
- Need to try with more than one thread
Topics for Thurs
- Indexing - Eric's proposal
- Artic issues
- Fedora ontology
- Clustering and transactions?
Tomorrow's meeting 11:15

Frank
- Clustering
  - Issue with transaction timeouts
  - Only seen in clustering, not seen on single node
  - Replication - all caches replicated
  - Distribution - specifies how many nodes should hold a given cache entry
  - Deleted objects re-appear after a time
  - Nodeservice and objectservice, path most start with a '/'
    - createObject requires absolute path
    - updatePropertiesGraph requires relative path
- Will document environment and errors so others can reproduce
- Will create tuning page under "Development"
- AuthZ issue
  - Can resolve with wrapping as new exception
Adam
- Still getting machine rebuilt
- Spoke with Martin Dow
  - He will be getting in touch soon
  - Suggestion to make pattern for accepting non-code contributions more clear

Frank
A. Soroka
1. Still rebuilding my workstation
2. managed to finish detailing the remaining work to assemble a kernel API
3. pursuing ongoing discussions with Martin Dow around the use of ontologies in Fedora 4
4. hopefully, will manage to get back to "OSGi-fying" the indexer codebase
Andrew

Adam
- Working on OSGi
- Laptop is back in order
Frank
- Clustering working
- Using UDP for discovery of nodes
- Using TCP for communication
- Bundling messages improves performance
  - But still slow
- Adding hundreds of properties to a node is very slow
- Will be profiling single-node updates of properties
Andrew
- Wrapping up two "federation" tickets
  - Adding properties to federated objects
  - Running fixity over federated objects

Frank
- Still running into issues
- Works using fsync per write
- Creating one object with 4000 children took 370 seconds
  - Slowed down with addition of more children, but children are all at the same level
- ISPN async config does not work at all
  - Fails in all modes, timeouts or path-not-found exceptions
- When transaction spans too many ingests, run into not enough filehandles
Adam
- Will be reviewing tickets
- Moving forward without roadblocks
- Has no cavities
Andrew
- Finished Federation fixity and properties
- New ticket for Federation caching of SHA-1
- Getting deployment to futures6 running again
- Need Adam to review some tickets