...
Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes |
|---|---|---|---|---|---|---|
| Authoring | Use concurrency test (see below) | |||||
| Authoring | Authoring with Workflow Not planned for initial test | |||||
| Simple Ingest | Small Files | Rate | 1 | Synthetic data is acceptable for this test | ||
| Simple Ingest | Medium Files | Rate | 1 | Synthetic data is acceptable for this test | ||
| Simple Ingest | Large Files | Rate | 1 | Synthetic data is acceptable for this test | ||
| Simple Ingest | Mixed Files | Rate | 1 | Synthetic data is acceptable for this test | ||
| Simple Ingest | Media Files | |||||
| Simple Ingest | Large File Count | Rate - Normalized Count | Ingest files to a substantial number to explore maximum file count. Normalized to ignore size of a given file. | |||
| Bulk Ingest | Small Files | |||||
| Bulk Ingest | Medium Files | |||||
| Bulk Ingest | Large Files | |||||
| Bulk Ingest | Large File Count | Rate - Normalized Count | Ingest files to a substantial number to explore maximum file count | |||
| Simple Access | Small Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
| Simple Access | Medium Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
| Simple Access | Large Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
| Simple Access | Mixed Files | Random Access | 1 | Site should contain a set of files of all three sizes. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
| Simple Access | Large File Count | Random Access | 1 | Access a large number of files until time is exhausted. | ||
| Bulk Ingest | Small Files | |||||
| Bulk Ingest | Medium Files | |||||
| Bulk Ingest | Large Files | |||||
| Bulk Ingest | Mixed Files | |||||
| Conditioned Access | None planned for initial testing | |||||
| Mediated Access | None planned for initial testing | |||||
| Concurrent Test #1 | Simple Access Mixed Files Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||
| Concurrent Test #1 | Authoring Simulation | Rate Directed Access | Random ingests (writes), Random delay read of same file. Count errors. | |||
Concurrency Tests
| Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes |
|---|---|---|---|---|---|---|
| Concurrent Test #1 | Simple Access Mixed Files Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||
| Concurrent Test #N | Authoring Simulation | Rate Directed Access |
Testing Tools and Configuration
...