Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • John has attended to D&A meetings with user reps, showed video searching Google Books to deal with the zero results case which they found interesting. Adam notes that much D&A work is quite low-level and we don't have a good way to think about the big ideas.
    • Could we have a server for labs/beta? Might want to have a carefully chosen selection of the most promising features we develop
    • Maybe bring up idea of beta server at March meeting? Or do it ahead of time so people can play. ACTION - Simeon to ask Adam to work out cost of a similar server, and devops work we would need
  • John had discussion with HT about API which is on their to-do but not scheduled. May be open to providing index access
    • There is investigation but not sure whether it will result in something we can use
  • Cataloging Sinatra and other 45's (Discogs data, https://github.com/ld4p/qa_server/issues?q=is%3Aissue+is%3Aopen+label%3ADiscogs)
  • Enhanced Discovery (see also https://wiki.duraspace.org/x/sJI7Bg and https://github.com/LD4P/discovery/projects/1)
    • BAM!: (Still) Finishing up lessons learned
    • SMASH! (to run through end of January)
      • John looking at the cases of queries that return small numbers of bad search results. Should "a secret history" return "the secret history", especially if there a few matches from the default search? John will continue to explore...
      • John: Followed up with HathiTrust and they may have Solr results and/or access experiment in a few weeks
      • ANNIF update: Annif requires a vocabulary and then training data to enable suggestion retrieval based on input text or an input document.  Worked through their tutorial/documentation (https://github.com/NatLibFi/Annif-tutorial/ and https://github.com/NatLibFi/Annif) to setup LCSH vocab and training documents based on our Solr index. Vocab: Retrieved all LCSH pref labels to URI matches from Dave's LCSH SPARQL endpoint (excluding any blank nodes).  Training documents: First queried solr index for 10000 documents looking for full title display and subject display fields, set up script to go through documents and query text of subject field against id.loc.gov to retrieve URIs.  Resulting training set had 8432 rows (each row is tab delimited title then followed by whatever subject URIs correspond).  Loading in vocab and training documents, annif can be asked through command line or through REST API for subject suggestions based on input text/query.  Tried that out with a few keywords and could see some results.  Plan next on (a) integrating REST API with data as it stands into the subject/person suggestions UI, (b) increasing size of training document set and (c) looking into what it would take to set up the ensemble option which allows for integrating multiple text analysis/classification strategies.
        • Additionally, Annif's own site includes Wikidata (English) suggestions.  John may look at these.
      • Tim demonstrates auto-suggest based on a small specialized index. Separates authors, locations, subjects, etc.. Would probably require a specialized index to support at scale
      • John working on getting synonyms from wikidata with the hope of addressing the zero-results scenario. Feel that current wikidata data is rather limited in its understanding of synonyms
      • Huda demonstrates related subject and people. Does search in LCSH, facet values based on the query and also calling annif (set up locally with 10k records from our catalog with title and subjects, and entire LCSH vocab. Will work to add more data into annif, will try to get FAST info from Dave, and also avoid empty boxes showing with no query
      • Plan to wrap up work next week, then move on to user tests, write up and video
    • Open meeting March 3, 2-3:30pm in Mann 102 and should Zoom it too
    • How will we decide what to take forward from KAPOW!, BAM! and SMASH!? (or as Tim put it, "what happens in late February?")
  • Authority Lookups for Sinopia (Lookup infrastructure: https://github.com/LD4P/qa_server/projects/2, Authority requests: https://github.com/LD4P/qa_server/projects/1)
    • See above
    • Monitoring tests have been adjusted to run at night, required work with Robbie to adjust pingdom
  • Travel and meetings (see LD4P2 Cornell Meeting Attendances)
    • 5th International LODLAM SUMMIT at the The Getty Center in Los Angeles. February 3-4, 2020
      • Steven, Lynette and Simeon will attend
    • code4lib - March 8-11, 2020. proposals done so no opportunity to share LD4P work, although registration still openopen 
    • Knowledge Graph Conference (Columbia University), May 6-7, workshops 5/4-5/5
    • LD4 Conference at College Station, TX (TAMU) - May 13/14, 2020
      • Proposals due 2020-01-31 – https://stanforduniversity.qualtrics.com/jfe/form/SV_ebmQF48Gn9bag6x
      • Lynette will consider lookup best practices and discuss with OCLC
      • Steven/Tim to think about discogs "supervised conversion"
      • Per slack message, Steven considering workshop on RDF
      • Huda/John/Tim/Steven to think about KPAOW! BAM! SMASH!
        • Preliminary brainstorming
          • Briefly discussed how there is probably enough content between user research, larger questions, and experiments/development and prototyping to fit into two presentations. Tim suggested using the larger questions to frame discussion of experiments/prototyping. 
    • rdfs:seeAlso Conferences Related to Linked Data in Libraries
  • Next meetings: