Page History

...

frank asseg
- just got back, working on the cluster and reading comments on transactions in benchtool PR
Ben Pennell
- working on updates to benchtool transactions PR
- looking at cache files left behind after test runs, tracing this to see if it is a problem. Theory about versionable nodes has been rejected, b/c nodes in question are not versionable. Left running overnight, the cache is still not cleaned out.
- will ask about this in #modeshape
Mike Daines
- talked with Greg about authz and posted conclusions of use case analysis in pivotal, created some new tickets.
- will link new authz tickets to a wiki page with redesign notes
Greg Jansen
- finishing a PR for modeshape shutdown
- will return to performance testing on the cluster afterwards

Monday March 03

Mike Daines - will post notes on changes to auth api to support use cases
- has some tickets in icebox
- remove dead code from policy enforcement class
frank asseg
- working on the cluster
- pulls a new war file and installed it, can run ingest with multiple threads now
- trying pushing up the number of threads and try to increase performance
- run single node performance test for comparison
- merge pull request for benchtool from Ben
Ben Pennell
- generating reports on effect of transactions on ingest and other speeds
- still not able to get GC to cleanup cache files
- default should clean up in 24 hrs, may post another query #modeshape list
- performance degraded a lot depending on size of data in repo, will post metrics
Greg Jansen
- finished modeshape shutdown ticket on Thursday, PR is awaiting review
- testing a WAR on cluster (w/#260 shutdown PR)
  - found configuration problem with hostnames resolving to localhost IP.
  - will run benchmarks today.
- out Friday PM for local projects

Scott Prater
- working with Greg Jansen's TCP-based config for clustering
- still having a problem getting more than three members of cluster working together
- pulling back on New Relic to remove variables and get to the point of doing a load test
Greg Jansen
- working on getting UNC cluster set up
- testing the clean shutdown of containers in a cluster
- will get help from Scott Prater to test on UWisc clusters
Mike Daines
- posted wiki page detailing possible mods to API/SPI to support authZ use cases
- will consider the architectural constraint demanding no dependency from kernel or auth modules on HTTP constructs
frank asseg
- still trying to achieve useful performance for clustered ingest
- will start a ticket to expand operations in benchtool to include SPARQL Update
Unknown User (bbpennel)
- benchmarking of transactional workflows
- seeing performance become worse the more stuff that in the repository (diminishing returns)
- also examining binary garbage collection, doesn't appear to be properly configurable
David Wilcox
- examining and annotating beta objectives
Andrew Woods
- testing delivered tickets
- doing review for finished tickets
David Wilcox and Andrew Woods
- determining priorities and state of beta objectives
- preparing for meetings in Washington, D.C. next week

A. Soroka
- working event reporting ticket
- reading OR papers
Mike Daines
- discussed potential modifications to authorization SPI with Unknown User (bbpennel)
- hopefully can now support by design the absence of a servlet container
- ticket is filed, will work on it today
Greg Jansen
- UNC cluster is operational!
- it is not yet puppet-configured, but it is configured and it is working
- there are problems using benchtool against a cluster
  - because it now uses transactions, which are problematic against a load-balanced cluster
- Greg Jansen will files some tickets to get benchtool to use "sticky sessions" to avoid this
frank asseg
- still running tests again SCAPE cluster
- performance is terrible!
- everything is ingested, but horribly slowly
- in better news, we have been offered the use of another cluster
  - From a Romanian University
  - Four nodes using Eucalyptus, possible more to be added
  - Very fast, with very fast interconnects
  - We can have access via SSH, but we will need to put an acknowledgement of their support on our webpage (Andrew Woods and David Wilcox, perhaps you can do this?)
- frank asseg is also working a ticket related to benchtool
David Wilcox
- still reviewing and annotating use cases
- will have more to say on this topic tomorrow or soon
Ben Pennell
- working with Mike Daines on authorization questions