...
- Configure Java to have a large heap size, e.g.,
-Xmx2048m - Limit the number of children under a single node to less than 5,000. Consider creating a hierarchy to organize nodes, or using automatically-generated identifiers (which will create the hierarchy automatically).
- Particularly when working with files larger than available memory, use Infinispan file storage (e.g.
-Dfcrepo.modeshape.configuration=config/single-file/repository.json) or filesystem federation. Federation avoids having to transfer files using HTTP – and with larger file sizes (or with larger numbers of files being processed), this can improve performance significantly. This can be a significant performance improvement if you are ingesting a large number of multi-gigabyte files.
Single Node Performance Testing
...