Date:
Attendees: Tim, Steven, Jason, Huda, Lynette, John, Simeon
Regrets:
Agenda & Notes
Review actions from 2020-03-06 Cornell LD4P2 Meeting notes
- E. Lynette Rayle QA performance
- 2020-02-14 Dave has made progress this week, is moving to have all data in index tailored to search in order to avoid SPARQL queries at search time, results are in a blob of RDF. Working on CERL first, expect to get this our soon. Will then try MeSH and OCLC FAST, then LC.
- 2020-02-21 CERL was deployed with the new index strategy but no before and after to compare. However, this is small so we need to wait for LC or such to get a sense of possible improvement
- 2020-02-25 New authorities have been brought online all the way through to Sinopia. These include CERL (searching person, corporate, imprint, or all of these) and Ligatus. Additionally, MeSH has been updated to include extended context and support for searching by subject or publication type.
- 2020-03-06: Dave in process of converting everything over. Unsure of status for any authority, including MeSH. When LC done, we'll know whether this has impact since there are considerable usage data for LC. Dave and Lynette each working on other projects at the moment.
- 2020-03-20: Dave is tied up with dept. COVID-19 planning. Log analysis shows two classes of error: 1) 502 is Dave's cache not responding, 2) 500 error which depends on query, Java null pointer error from Dave's system, and fewer of a third 3) timeout error
- Simeon Warner to ask Adam Smith to investigate cost and any issues with setting up a D&A Beta system to allow broader testing of some discovery ideas from this work.
- 2020-03-0620: STILL NOT DONE
- John Skiles Skinner to continue discussion with Hathi trust about an API or access to their index
- 2020-02-28 HathiTrust have allowed institutional accounts to add a query parameter to get XML output, may also provide IP based access for prototypes. Have already made demo with a mock-up of access
- 2020-03-06: Huda sent them IP Address... and then confirmed that it was indeed ours. Follow-up needed. John Skiles Skinner will do that before next meeting.
- 2020-03-20 - Have IP set up for dev VM but only works from there only. More important update is that XML content will be turned off for a while unless we have particular need. Huda thinks that even if we use this for WHAM we could rely on canned responses for a while
- Huda Khan to copy lessons learned from BAM! into the main wiki and check scripts into github
- BAM! lessons learned in wiki (DONE)
- Scripts making way into GitHub (in progress)
- 2020-03-06: NOT DONE. URLs need replacement; Huda will replace with comment + dummy URL. Will be completed 3/13
- DONE – links: https://github.com/LD4P/discovery/tree/master/scripts/bam (also SMASH! scripts, for reference: https://github.com/LD4P/discovery/tree/master/scripts/smash)
- E. Lynette Rayle to ask Tiziana about SHARE-VDE APIs for real-time up-to-date search and for possible engagement in linked data best practices for authoritative data working group
- 2020-03-06: NOT DONE. Will email by 2020-03-13
- Will instead email a larger group about proposed best practices working group, will delay a bit until
Status updates and planning
...