Versions Compared

Old Version 1

changes.mady.by.user Andrew Woods

Saved on

compared with

New Version Current

changes.mady.by.user Andrew Woods

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Meetings

Monday January 27

Tuesday January 28

  1. Kernel-api work
    • PR is ready to go with small code-review updates
    • Frank's SCAPE connector may be impacted (likely not)
    • Kernel has dependencies on Jena, we should revisit
    • Dependency: snappy-java is questionable
    • Side note, Adam is reinstalling own computer
    • Adam to create ticket: update maven artifact names
  2. OSGi pluggable work - Adam to continue
  3. BOM work - push to just before beta release
  4. There are 4 bugs to be fixed
  5. Modeshape 3.7.1, waiting on Greg's fix
  6. Frank
    • Will be working on clustering
    • Filter in web.xml for auth
    • Wrap modeshape authz exceptions and catch in a filter
  7. Clustering work
    • Testing performance
    • Documentation - on one machine and multi-machines
  8. SCAPE usecase
    • Reading, ingesting
    • Currently off by a factor of four to goals
    • Need to try with more than one thread
  9. Topics for Thurs
    • Indexing - Eric's proposal
    • Artic issues
    • Fedora ontology
    • Clustering and transactions?
  10. Tomorrow's meeting 11:15

Wednesday January 29

  1. Frank
    • Clustering
      • Issue with transaction timeouts
      • Only seen in clustering, not seen on single node
      • Replication - all caches replicated
      • Distribution - specifies how many nodes should hold a given cache entry
      • Deleted objects re-appear after a time
      • Nodeservice and objectservice, path most start with a '/'
        • createObject requires absolute path
        • updatePropertiesGraph requires relative path
    • Will document environment and errors so others can reproduce
    • Will create tuning page under "Development"
    • AuthZ issue
      • Can resolve with wrapping as new exception
  2. Adam
    • Still getting machine rebuilt
    • Spoke with Martin Dow
      • He will be getting in touch soon
      • Suggestion to make pattern for accepting non-code contributions more clear

Thursday January 30

Fedora Committer's Call

Friday January 31

...

Monday February 3

Tuesday February 4

Wednesday February 5

  1. Frank
  2. A. Soroka
    1. Still rebuilding my workstation
    2. managed to finish detailing the remaining work to assemble a kernel API
    3. pursuing ongoing discussions with Martin Dow around the use of ontologies in Fedora 4
    4. hopefully, will manage to get back to "OSGi-fying" the indexer codebase
  3. Andrew

Monday February 3

  1. Adam
    • Working on OSGi
    • Laptop is back in order
  2. Frank
    • Clustering working
    • Using UDP for discovery of nodes
    • Using TCP for communication
    • Bundling messages improves performance
      • But still slow
    • Adding hundreds of properties to a node is very slow
    • Will be profiling single-node updates of properties
  3. Andrew
    • Wrapping up two "federation" tickets
      • Adding properties to federated objects
      • Running fixity over federated objects

Tuesday February 4

  1. Frank
    • 300 ms (single in cluster)
    • 150 ms (single non-clustered)
    • Help in disabling indexing in repository.json
    • ISPN: switched to non-transactional mode
      • exceptions are thrown
    • ISPN: switched to async mode, did not see any performance improvement
    • ISPN: pessimistic locking vs. optimistic locking did not show performance diff
    • Will try bundling actions in a single transaction
  2. Adam
    • OSGi going forward - Solr libraries
    • Designing new "update" strategy
      • One goal is to get sparql machinery out of the kernel
    • Need to insure only valid updates are allowed
    • Need to determine how to select an update strategy, from the REST API
      • Do we only allow updates via SPARQL-Update?

Wednesday February 5

  1. Frank
    • Still running into issues
    • Works using fsync per write
    • Creating one object with 4000 children took 370 seconds
      • Slowed down with addition of more children, but children are all at the same level
    • ISPN async config does not work at all
      • Fails in all modes, timeouts or path-not-found exceptions
    • When transaction spans too many ingests, run into not enough filehandles
  2. Adam
    • Will be reviewing tickets
    • Moving forward without roadblocks
    • Has no cavities
  3. Andrew

Thursday February 6