Real World or Real Static?
Performance testing should be objective, but when vested interests design the setting, beware of latent bias.Performance testing should be objective, but when vested interests design the setting, beware of latent bias. eWeek Labs spent an extra week testing Cisco Systems Inc.s Catalyst 2950T-24 and 3550-12T switches to figure out why our performance tests showed slightly different resultsmore packet loss across a wider range of packet sizesthan those obtained at Ciscos labs. Using the same equipment, the two labs were getting different numbers. In the end, it turned out that we were doing a more rigorous test, one that we believe is more reflective of the real world. To run our Layer 2 tests, we used Spirent Communications Inc.s SmartBits 6000B performance analysis system, equipped with 12 Gigabit-over-copper ports, in conjunction with the companys AstII traffic generation and measurement software.
Using a "full-mesh" testone with all ports talking to all other portswe found a very small but measurable amount of packet loss.