...
Download of large amount of content as single user operation. This may require any number of repository operations to accomplish. Whether content and metadata stays fixed from the beginning to the end of the operation is to be defined. This is needs consideration a whole intellectual entity, graph or DIP is considered the unit. Also we need to consider what this means for continuous access operations.
...
Baseline Testing Matrix
Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Authoring | Use concurrency test (see below) | ||||||||||||
| Authoring | Authoring with Workflow Not planned for initial test | ||||||||||||
| Simple Ingest | Small Files | Rate | 1 | Increase Load Injectors until max rate is found. Synthetic data is acceptable for this test | |||||||||
| Simple Ingest | Medium Files | Rate | 1 | Increase Load Injectors until max rate is found. Synthetic data is acceptable for this test | |||||||||
| Simple Ingest | Large Files | Rate | 1 | Synthetic data is acceptable for this test | Simple Ingest | Mixed Files | Rate | 1 | Increase Load Injectors until max rate is found. Synthetic data is acceptable for this test | ||||
| Simple Ingest | Media Files | ||||||||||||
| Simple Ingest | Large File Count | Rate - Normalized Count | 1 | Ingest files to a substantial number to explore maximum file count. Normalized to ignore size of a given file. | |||||||||
| Bulk Ingest | Small Files | ||||||||||||
| Bulk Ingest | Medium Files | ||||||||||||
| Bulk Ingest | Large Files | ||||||||||||
| Bulk Ingest | Large File Count | Rate - Normalized Count | Ingest files to a substantial number to explore maximum file count | ||||||||||
| Simple Access | Small Files | Random Access | 1 | Increase Load Injectors until max rate is found. Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | |||||||||
| Simple Access | Medium Files | Random Access | 1 | Increase Load Injectors until max rate is found. Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | |||||||||
| Simple Access | Large Files | Random Access | 1 | Increase Load Injectors until max rate is found. Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | |||||||||
| Simple Access | Mixed Files | Random Access | 1 | Increase Load Injectors until max rate is found. Site should contain a set of files of all three sizes. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | |||||||||
| Simple Access | Large File Count | Random Access | 1 | Increase Load Injectors until max rate is found. Access a large number of files until time is exhausted. | |||||||||
| Bulk Ingest | Small Files | ||||||||||||
| Bulk Ingest | Medium Files | ||||||||||||
| Bulk Ingest | Large Files | ||||||||||||
| Bulk Ingest | Mixed Files | ||||||||||||
| Conditioned Access | None planned for initial testing | ||||||||||||
| Mediated Access | None planned for initial testing | ||||||||||||
| Concurrent Test #1 | Simple Access Mixed Files | Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||||||||
| Concurrent Test #1 | Authoring Simulation | Rate Directed Access | Random ingests (writes), Random delay read of same file. Count errors. | ||||||||||
Concurrency Tests
| Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes |
|---|---|---|---|---|---|---|
| Concurrent Test #1 | Simple Access Mixed Files Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||
| Concurrent Test #N | Authoring Simulation | Rate Directed Access |
...