...
- Configure Java to have a large heap size, e.g.,
-Xmx2048m
- Limit the number of children under a single resource – ideally to 1,000 or less. Consider using a hierarchy to organize resources, e.g., storing the resource with ID
12345678
at the path/12/34/56/78
. Automatically-generated identifiers will use this pattern. - Particularly when working with files larger than available memory, use Infinispan file storage (e.g.
-Dfcrepo.modeshape.configuration=config/single-file/repository.json
) or filesystem federation. Federation avoids having to transfer files using HTTP – and with larger file sizes (or with larger numbers of files being processed), this can improve performance significantly.
Single Node Performance Testing
...
Arbitrarily-large files can be ingested (or projected into the repository using filesystem federation) and ingested and downloaded via the REST API (tested up to 1TB). The only apparent limitations are disk space available to store the files, and a sufficiently large Java heap size (tested with -Xmx2048m).
...