Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Configure Java to have a large heap size, e.g., -Xmx2048m
  • Limit the number of children under a single resource – ideally to 1,000 or less.  Consider using a hierarchy to organize resources, e.g., storing the resource with ID 12345678 at the path /12/34/56/78.  Automatically-generated identifiers will use this pattern.
  • Particularly when working with files larger than available memory, use Infinispan file storage (e.g. -Dfcrepo.modeshape.configuration=config/single-file/repository.json) or filesystem federation.  Federation avoids having to transfer files using HTTP – and with larger file sizes (or with larger numbers of files being processed), this can improve performance significantly.

Single Node Performance Testing

...

Arbitrarily-large files can be ingested (or projected into the repository using filesystem federation) and ingested and downloaded via the REST API (tested up to 1TB).  The only apparent limitations are disk space available to store the files, and a sufficiently large Java heap size (tested with -Xmx2048m). 

...