...
Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes |
---|---|---|---|---|---|---|
Authoring | Use concurrency test (see below) | |||||
Authoring | Authoring with Workflow Not planned for initial test | |||||
Simple Ingest | Small Files | Rate | 1 | Synthetic data is acceptable for this test | ||
Simple Ingest | Medium Files | Rate | 1 | Synthetic data is acceptable for this test | ||
Simple Ingest | Large Files | Rate | 1 | Synthetic data is acceptable for this test | ||
Simple Ingest | Mixed Files | Rate | 1 | Synthetic data is acceptable for this test | ||
Simple Ingest | Media Files | |||||
Simple Ingest | Large File Count | Rate - Normalized Count | Ingest files to a substantial number to explore maximum file count. Normalized to ignore size of a given file. | |||
Bulk Ingest | Small Files | |||||
Bulk Ingest | Medium Files | |||||
Bulk Ingest | Large Files | |||||
Bulk Ingest | Large File Count | Rate - Normalized Count | Ingest files to a substantial number to explore maximum file count | |||
Simple Access | Small Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
Simple Access | Medium Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
Simple Access | Large Files | Random Access | 1 | Site should contain a set of files of uniform size. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
Simple Access | Mixed Files | Random Access | 1 | Site should contain a set of files of all three sizes. Tests can vary download mix by URL. It is essential that caching be avoided. Synthetic data is acceptable for this test. | ||
Simple Access | Large File Count | Random Access | 1 | Access a large number of files until time is exhausted. | ||
Bulk Ingest | Small Files | |||||
Bulk Ingest | Medium Files | |||||
Bulk Ingest | Large Files | |||||
Bulk Ingest | Mixed Files | |||||
Conditioned Access | None planned for initial testing | |||||
Mediated Access | None planned for initial testing | |||||
Concurrent Test #1 | Simple Access Mixed Files Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||
Concurrent Test #1 | Authoring Simulation | Rate Directed Access | Random ingests (writes), Random delay read of same file. Count errors. | |||
Concurrency Tests
Category | User Operation | Repository Operation | Test Metric | Test | Priority | Notes |
---|---|---|---|---|---|---|
Concurrent Test #1 | Simple Access Mixed Files Simple Ingest Mixed Files | Rate Random Access | 1 | Number of Load Injectors TBD Number of Load Injectors TBD | ||
Concurrent Test #N | Authoring Simulation | Rate Directed Access |
Testing Tools and Configuration
...