Mini-sprint focused on VIVO committer review/refactor: July 14-16th
Committers will review work from previous sprint
Benjamin will help with code review
Don has also reserved time on the 14th and 17th
Michel will be available during this time if anyone has questions or needs support
Michel: Plans on having good Selenium tests before 14th. Need to make these tests for non-i18n and i18n versions of VIVO and comparing front-ends to ensure that they are exactly the same for the English language version. Ensure some part of the code can be merged into master
Michel: Consider VIVO as enterprise data source like other sources inside the organization.
Need to have messaging system where we can communicate data/exchange data from different data sources
Evaluating Kafka as a system to do so
Serialization/mapping data from CSV to RDF: will need to address this in the consumer/updater in the Kafka. Want streaming communication from data sources to VIVO
Different use cases with common need for mapping CSV or other data sources to RDF.
Michel: Don’s use case more ETL with VIVO at the center. In our case, integrate across data sources including VIVO.
Don: Open to other ways of bringing in data that doesn’t have to be traditional batch-driven ETL. Streaming messages could serve the same purpose. As long as have enough controls to determine how the app behaves (e.g. how many triples sent over).
Don: Other paradigm: don’t track differences in data. Every class group in own named graph. Easy enough to truncate and reload everything.
Benjamin: Prefer to upload/edit data through the interface
Rachid: Is there a task force for ingest?
Huda: Good idea to have one, to gather use cases, determine common requirements, and work on common goals.
Rachid: No task force yet or interest group yet
RDF messaging
William: Approach is tied to Apache Jena, not agnostic. Standard JMS messaging with Artemis broker - significantly different than Kafka stream. Not interchangeable. Similar in goal.
To do: bring up interest group/task force idea when Andrew is back