Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Hope is that the approach is same as building the index, with different input
Alternatives Approaches

 TODO: what other approaches are there?

...

  • HTTP for retrieving RDF, yes
  • What is the adoption of SPARQL in the community
  • It may be nice to demonstrate that a SPARQL endpoint is not needed to enable interesting results
  • Solr, seems reasonable for now
    • Considering having Solr in one place versus distributed Solr (master/slaves)
  • Web interface: drupal with solrsearch.js
    • Most work is on clientside with js
    • This continues to be appealing
    • We have limited insight into this component
    • Suggestion to create list of default technologies, criteria, and alternatives
  • Hadoop is currently reasonable choice
  • Ruby (blacklight/hydra) or Drupal?
    • The js pattern allows from minimal reliance on Drupal
  • Need a mock-up of the UI to inform design of solr index
  • BootStrap is an interesting js framework to consider
  • Drupal upgrade cycle can be onerous

Technology Alternatives

  1. We could use a different index software other than Solr. 
    • What would that be? 
    • A database server with full text capabilities?

...

    •   
    • What are other options?

...

    •   
    • Are there full text search NoSQL options?
  1. What the the alternatives to Hadoop?

...

  1.   
    • What other ways would sufficient management of multiple tasks?

...

    •   
    • Could we just do it as multiple java processes or multiple java threads? 
    • OSGi? 
    • Some of the hadoop related systems like hadoop Streaming or Cascade?
  1. Serving the web site could be done with just about any system that allows interaction with Solr.

...

  1.   
    • The solrsearch javascript libraries would allow any system that serves HTML and js to server this.

...

    •   
    • The options are expansive: httpd, wordpress, movible type, drupal, cold fusion.

...

    •  
    • If the solrsearch javascript can provide almost all of the interactivity on the client side it might be desirable for the server side be as simple as possible.

...

    •   
    • It may even be possible to use static HTML and .js files served by any old web server.
Index Updates
  1. Once an index was created how would it be updated?
    1. Rebuild the whole index?
    2. Get a list of modified individuals from each site and only reindex them?