...
To be valid, a performance test must minimize or isolate external influences. This can be done with a dedicated platform (and network if a multi-host configuration is used). Unfortunately, cloud platforms are shared and the performance allocated to any given set of processes varies with time. To utilize a ahared platform, you must monitor it and factor its load into the performance calculations. This can be complicated since there are so many potential factors to consider but "rough order of magnitude" results are still quite useful. This is still useful and may be the most practical approach for interim performance test.
- Best Accuracy - Isolated Platform
- Must be provided by one or more hosts
- Also good if on isolated LAN segment
- Dedicated disks particularly helpful
- Separate machine for database and/or resource index
- Separate machine for load injection
- Costs system admin time to set up but the installation can be reused
- Likely only one or a small number of configurations can be supported
- It would be nice to permit a Bamboo agent to kick off tests
- Most Convenience - Cloud Platform