...
16.7 million files were generated on a federated filesystem using a three-level hierarchy (256 top-level resources, 256 second-level resources in each, 256 third-level resources in each, and one 10KB binary in each), taking 26.78 hours. After each batch, three REST API operations were timed: listing the top level of the repository ("toplist"), listing a second-level resource ("dirlist"), and retrieving a file ("fileget"). Performance retrieving files and listing the second-level resources did not degrade with larger numbers of containers. However, listing the top-level of the repository degraded roughly linearly as more containers were added, and became increasing erratic.
...