Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date: 

Attendees:  Steven, Huda, Tim, Simeon, John

Regrets:  Lynette, Jason

Agenda & Notes

Review actions from 2019-12-20 Cornell LD4P2 Meeting notes

  • Huda Khan to discuss with Astrid and David possible collaboration with U Chicago over usability (and maybe others in DOG team)
  • E. Lynette Rayle performance QA performance
    • Dave made some changes to address issues with 50x responses, still possible issues under high load (possibly something on the Sinopia side but waiting to look at IP
    • 2019-12-20 Connection time outs were happening due to increased requests (fixed); cache layer is returning a lot of 500s - Dave is working on this. No blocker - work itself is happening. Adding IP address to logging to identify whether same source is hitting us with same request.)
    • Ongoing discussion about the need build more complex indexes to deal with slowness of complex queries
    • QA server had too few DB connections with resulted in 500 errors, have now adjusted to allow more DB connections and seems fixed

Status updates and planning

  • Prep for Cataloging Sinatra and other 45's (Discogs data, https://github.com/ld4p/qa_server/issues?q=is%3Aissue+is%3Aopen+label%3ADiscogs)
    • STARTING with items not in DIscogs but AWAITING more work in Sinopia to import data. Sinopia work cycle 2 (through December 6) will we hope include the ability to read in RDF back from Trellis. We hope that we can leverage this to import RDF from a lookup in Discogs or ShareVDE. 
    • Usability - suffering from long vertical display with expanding sub-forms, lots of scrolling
    • Discogs QA module input is only using some data based on the profile being used, trouble filling in only work and not instance data when working from a work form with embedded instance. Steven will investigate whether template or profile changes can address this
    • Lookup performance still an issue but not even or even consistent within the same lookup. Seems also that there is an effect from overall load on the service. → Steven/Lynette/Huda to work out where the problem lies
    • Lookups for place not usable, relies on work from Dave to fix: https://github.com/LD4P/qa_server/issues/248 & https://github.com/LD4P/qa_server/issues/240
    • Work is being done but places are not being recordedWork is going on. Questions about where to put data and roles, and how many abstractions of work are required (e.g. for performance and for composition). Lookups are too slow and too buggy
  • Enhanced Discovery (see also https://wiki.duraspace.org/x/sJI7Bg and https://github.com/LD4P/discovery/projects/1)
    • BAM! (to run through end October)
    • SMASH! (to run through end of January)
      • John showed demo of search text in Google Books for cases where we have no hits in the catalog, using results to find items in the catalog via ISBN. Want to expand to use OCLC number.
      • Huda showed demos doing string matching (non left anchored) in LSCH and then finding broader and narrower subjects. Going to do expanded search of broader and narrower for the facets that come back from the catalog text search.
    • Open meeting March 3, 2-3:30pm in Mann 102 and should Zoom it too
    • How will we decide what to take forward from KAPOW!, BAM! and SMASH!?
  • Authority Lookups for Sinopia (Lookup infrastructure: https://github.com/LD4P/qa_server/projects/2, Authority requests: https://github.com/LD4P/qa_server/projects/1)
    • See above
    • Monitoring tests have been adjusted to run at night, required work with Robbie to adjust pingdom
  • Travel and meetings (see LD4P2 Cornell Meeting Attendances)
  • Next meetings: