SilkPerformer V Boasts New Accuracy

By Cameron Sturdevant  |  Posted 2002-01-14 Print this article Print

Segue Software Inc. has significantly improved its SilkPerformer V Web application testing and load simulation tool by streamlining test setup procedures and incorporating several innovative analysis utilities.

Segue Software Inc. has significantly improved its SilkPerformer V Web application testing and load simulation tool by streamlining test setup procedures and incorporating several innovative analysis utilities.

IT managers should consider SilkPerformer V to help with regression testing of complex Web sites that allow numerous user interactions, such as e-storefronts or online information clearinghouses. In eWeek Labs tests, the products new TrueLog capability allowed us to track down problems with user interactions by recording the screens as they appeared to end users while also providing us with information about where the probable breakdown occurred.

SilkPerformer V started shipping last month and is competitively priced, although at $18,000 for a six-month, 5,000-virtual-user license, it might give potential buyers pause. The number of licensed users "decrements" as tests are run, so, for example, a load test with 100 virtual users could be run 50 times (which should be more than enough to determine how an application will perform). Other license options, including one for perpetual use, are also available.

Would-be customers should check the list of predefined performance modules to make sure the products they use are supported. Competitors such as Mercury Interactive Corp.s $3,495 Astra LoadTest 5.0 provide a long list of prebuilt monitors, whereas SilkPerformer V offers modules only for AIX system information, IBM WebSphere and SilverStream Software Inc. applications, and a few others.

Perhaps the most impressive new feature in SilkPerformer V is True-Log on Error. During tests, we were able to find some (glaring) Web application problems on our BenchTen test site. SilkPerformer V saved the problem screens, such as unavailable page errors. This feature neatly saves only the error, not the entire session, making it a timesaving, resource-friendly way to diagnose Web application problems.

Reality Check

A common complaint about load-generation and simulation tools such as SilkPerformer is that test loads are very flat. Segue answered that concern with All Day Workload, which enables SilkPerformer V to create more-realistic tests. We handily created a daily rush of virtual users logging on from 5 to 8 a.m. to check the news at BenchTen, then simulated a percentage of those users going to the BenchTen store site to purchase widgets. All Day Workload allowed us to vary the number of virtual users across a long period of time, resulting in an interesting diagnosis of how well the site worked.

We suggest adding a random burst option to make tests even more realistic. Nearly every site has periodic, unpredicted interest, whether because of market fluctuations or breaking news. Although we could schedule a burst of interest in the test Web site every day at the same time, the random appearance of a traffic spike would have proved useful too.

The SilkPerformer V base-line wizard enabled us to set up workloads that provided more-realistic tests of our Web site and helped us to determine the threshold response times for which we should test. In the case of our Bench- Ten site, it took several seconds to get a log-on screen but only a few seconds more to get from a table of contents to a particular news story. These measurements made it much easier for us to interpret the performance of the Web site when it was under a test load of several hundred simultaneous users.

Users of previous versions of Silk- Performer will see improvements in its reports, which previously were text-only. We found the new HTML reports much easier to read and analyze.

Senior Analyst Cameron Sturdevant is at

Cameron Sturdevant Cameron Sturdevant is the executive editor of Enterprise Networking Planet. Prior to ENP, Cameron was technical analyst at PCWeek Labs, starting in 1997. Cameron finished up as the eWEEK Labs Technical Director in 2012. Before his extensive labs tenure Cameron paid his IT dues working in technical support and sales engineering at a software publishing firm . Cameron also spent two years with a database development firm, integrating applications with mainframe legacy programs. Cameron's areas of expertise include virtual and physical IT infrastructure, cloud computing, enterprise networking and mobility. In addition to reviews, Cameron has covered monolithic enterprise management systems throughout their lifecycles, providing the eWEEK reader with all-important history and context. Cameron takes special care in cultivating his IT manager contacts, to ensure that his analysis is grounded in real-world concern. Follow Cameron on Twitter at csturdevant, or reach him by email at

Submit a Comment

Loading Comments...
Manage your Newsletters: Login   Register My Newsletters

Rocket Fuel