Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Validator framework: https://github.com/ld4l-labs/marc2rdf-validator

In a complementary effort, and to support its Tracer Bullet workflows in the LD4P project, Stanford developed a MARC → BIBFRAME conversion pipeline that took MARC record output from its ILS, used the Library of Congress BIBFRAME converter script, and loaded it into a Stanford-local triple store. A second phase of this work built a more robust conversion pipeline using Reactive programming, and employing a Kafka & Spark-based, high throughput, low latency converter. 

YouTub Video: Reactive pipeline demo
S
upporting code: Scala/Kafka/Spark Linked Data Pipeline (github repository)