Date:
Attendees: Huda, Lynette, Jason, Steven, Simeon
Regrets: Greg
Discovery (WP3)
- https://github.com/LD4P/discovery/projects/2 for issues etc.
- Draft of a discovery plan: https://docs.google.com/document/d/1zKYW7FQVVNvyd0XjjW0qWznX9PC3jbmOE6Kz_yygPjs/edit?usp=sharing
- Research: how to go from knowledge graph to an index
- DASH! (Displaying Authorities Seamlessly Here)
- 2022-01-12
- Work and video done. Huda is finishing up some documentation including how index is set up and where connections made
- 2022-01-21
- Only things left are formatting of writeup and finishing off documentation
- 2022-01-12
- BANG! (Bibliographic Aspects Newly GUI'd)
- Jamboard link
- Expect to include Works. Need to do something beyond what we already have live from the OCLC concordance data.
- DAG Calls
- 2022-01-14 - Next call next Tuesday, will focus on topic roadmap and then talk about data (where does it come from and how does it show in discovery, and what other sources could be used?)21 - Roadmap review and slide to talk about library systems (very high level) and what data we get where (last slide has comments)
- Upcoming (in progress): Crossover episodes (DAG/WAG) (announcements forthcoming). Also session with archival focus: 3/1.
Linked-Data Authority Support (WP2)
- Qa Sinopia Collaboration
- 2022-01-1421
- Met this week to to talk about new vocab requests. General consensus is that there are unlikely to be many requests because we've already hit the big ones. Known current requests that are a priority include new ISNI rdf download and Homosaurus. There are existing requests that we probably should check in on to see if they are still needed and then determine priority (i.e. RBMS, ORCID, DCMI, CCL, GAMECIP, OLAC's Videogame Genre)
- Steven will review additional suggestions and discuss with Nancy
- Dave has already created a triple store of the new ISNI RDF download including a Fuseki end point. Steven did the review for extended context, https://github.com/LD4P/qa_server/issues/14#issuecomment-1018554436. It is in Dave's court for generating the index. Want support for searching by URI.
- Dave is looking to switch indexing from Lucene to Elastic Search. He wants to do this before starting the containerization process.
- Lynette to discuss ongoing maintenance issues for ES vs Lucene, we have mostly Solr expertise in CUL
- Dave believes he fixed a race condition that was causing the 500 errors. I'm not seeing the EOFError in the logs, but I am seeing RDF::Graph#load failure: IOError. So this may be something else going on.
- I reported suspicious access to SYSOPTS (e.g. requests to wp, python, .env, etc.) More info in at DLITSYS-4557. No response from SYSOPTS yet.
- Pagination merged, but not released. Want to update linked data module to use new pagination before releasing. Need to deal with backward compatibility for linked data module use of non-jsonapi parameters and output formatting for pagination.
- Looked into intermittent failure to respond to some queries. QA is logging `RDF::Graph#load EOFError` which implies it didn't get all the data from the cache. Verifying the failing queries today, they all pass. Dave doesn't report anything unusual in his logs.
- Topic for next week's meeting: openness to add more vocabs and on-going prioritization of this work
- Met this week to to talk about new vocab requests. General consensus is that there are unlikely to be many requests because we've already hit the big ones. Known current requests that are a priority include new ISNI rdf download and Homosaurus. There are existing requests that we probably should check in on to see if they are still needed and then determine priority (i.e. RBMS, ORCID, DCMI, CCL, GAMECIP, OLAC's Videogame Genre)
- 2022-01-1421
- Best Practices for Authoritative Data working group (focus on Change Management)
- 2022-01-1421
- We meet next Monday.
- There was discussion in Slack about the usage of Add vs. Create. I believe we have settled on Create indicating the entity is brand new and Add indicating that the entity wasn't available and now it is (e.g. permission change, temporary removal reinstated, etc.) I expect Remove and Delete to follow a similar pattern
- Next meeting 4th week in January.
- Overview of the architecture and flow are being organized in Entity Metadata Management Architecture
- Made significant progress on the external recommendations document.
- 2022-01-1421
- Containerization
- 2022-01-14
21- Greg out for a month.
- I checked in with Justin about progress. He stated... "I never got it to work correctly. I think the problem came down to networking."
- Next up is containerization of cache. Probably starting in Feb.Future work:
- Containerize Dave - perhaps Greg & Dave could start while Lynette works on best practices group
- Move our own QA instance to use CloudFormation. Lynette needs to look at customization parts and get them into container version first Maybe look at move from CloudFormation to Terraform
- 2022-01-14
Other Topics
- Github branch renaming
- See Renaming of LD4P Repositories – cul/blacklight-cornell now uses
main
but still has the oldmaster
branch too - Expect to be able switch this in LD4P as part of D&A work
- See Renaming of LD4P Repositories – cul/blacklight-cornell now uses
- Sinolio - Sinopia-FOLIO
- 2021-12-17 - Work Cycle finished, sprint video out
- OCLC Linked Data / Entities Advisory Group
- 2021-12-10 OCLC presented at bigheads meeting this week, in testing
- ISNI - made a soft launch of LOD this week. Shhh... they are providing data dumps now, dereferenceable LOD sometime in 2022. https://isni.org/page/linked-data/
- PCC
- 2021-1001-27 21 Definitions and non-RDA examples in MARC examples continued to shift, but should be able to finalize the spreadsheet that generates the RDF today.final report to POCO (hopefully) to be submitted next week
- 2022-01-14 Nothing new to report.
- Authorities in FOLIO
- 2022-01-14 Working on "deletes" workflow (actually deprecation with replacement process for references). Current workflow uses browse in Blacklight and benefits from links into FOLIO
- Upcoming presentations: Discussion on knowledge panels and Cornell Wikidata integration1/24 ARLIS/NA x Wikidata, and catalog form and function IG presentation March 11, 3-4pm (hope to also get Steven
)
...
Next Meeting(s), anyone out?:
- 2022-01-28 - Lynette probable out with Samvera Dev Congress, Greg away. Will start at 10am