The online community for software testing & quality assurance professionals
   
Active Topics Today's Topics
Sponsors:
Lost Password?

Home
BetaSoft
Jobs
Training
News
Links
Downloads

News Group:
software.testing


Testing
Automation
Performance
Engineering
Miscellaneous
Statistics
Poll
  QA Forums
  Performance & Load Testing
  Comparison of Load Test Tools

Post New Topic  Post A Reply
profile | register | preferences | faq | search

UBBFriend: Email This Page to Someone! next newest topic | next oldest topic
Author Topic:   Comparison of Load Test Tools
mikedawson
Member

Posts: 20
Registered: Dec 2001

posted 02-19-2002 03:03 AM     Click Here to See the Profile for mikedawson   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by mikedawson
Hi All

I've looking for some feedback from anyone who has experience of using both LoadRunner and the Microsoft Web Application Stress (WAS) tool or Windows Capacity Analysis tool (WCAT) for web load testing. Given that LoadRunner is expensive, I'm assuming it has features that are not available within either of the Microsoft tools - can anyone tell me what the relative shortcomings of the MS tools are, please? Also, can anyone explain the difference between WCAT and WAS?

Thanks very much.

Mike.

------------------

IP Logged

jpulley3
Guru

Posts: 285
Registered: Aug 2001

posted 02-19-2002 07:05 AM     Click Here to See the Profile for jpulley3   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by jpulley3 Visit jpulley3's Homepage!
Mike,

Microsoft owns large licenses for the use of LoadRunner and uses it for their Premier customers in their Premier Customer Labs. Clearly, there is a role for both and even Microsoft recognizes the limitations of their internal tools. I can't think of a better endorsement to suggest that one is not a direct replacement for the other.

It is my understanding from a distant view of the Microsoft tools, that their focus is for developers or for limited benchmarking of one server versus another. Mercury's tools are more focused on the business process and generate statistics appropriate for reporting on success, failure and volume of a representative business process under load.

------------------
James Pulley
nospam.jpulley@nospam.itestsolutions.com
iTest Solutions, Inc
704-243-2854 (voice)

IP Logged

charles_ezdata
Member

Posts: 19
Registered: Sep 2001

posted 02-21-2002 03:20 PM     Click Here to See the Profile for charles_ezdata   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by charles_ezdata Visit charles_ezdata's Homepage!
Since the topic is "comparing the testing tool". I think I can reuse this thread to talk about OpenSTA. OpenSTA is a free stuff. It has lots of features which many expensive testing utility have. Like record/playback , scripting support... But the data collecting is not very complete. It can collect NT performance data entries or SNMP data entries. But it can not collect transaction-related information like response time , transaction per second. Except you purchase the plug-in developed by CYRANO .

------------------

IP Logged

Ian
Advanced

Posts: 175
Registered: Sep 2001

posted 02-21-2002 03:33 PM     Click Here to See the Profile for Ian   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by Ian
Charles,

The basic 'Free' product supports 'HTTP' transaction response time and 'HTTP' transactions per second. The 'Plug in' options that you can buy are for Database transaction monitoring, just to clarify.
Follow this link for all the reporting features which are 'Free' with OpenSTA.
http://www.opensta.org/docs/ug13/os-resul.htm

------------------

IP Logged

ddoane
Member

Posts: 10
Registered: Mar 2002

posted 03-07-2002 09:11 AM     Click Here to See the Profile for ddoane   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by ddoane Visit ddoane's Homepage!
quote:
Originally posted by mikedawson:
Hi All

I've looking for some feedback from anyone who has experience of using both LoadRunner and the Microsoft Web Application Stress (WAS) tool or Windows Capacity Analysis tool (WCAT) for web load testing. Given that LoadRunner is expensive, I'm assuming it has features that are not available within either of the Microsoft tools - can anyone tell me what the relative shortcomings of the MS tools are, please? Also, can anyone explain the difference between WCAT and WAS?

Thanks very much.

Mike.


Mike, what type of app are you looking to test? May be we can help. Our OpenLoad testing tool is full featured, easy-to-use and fairly inexpensive as compared to the other tools on the market. Check-out http://www.opendemand.com/ or drop me a line.

Thanks,
Don

------------------
OpenDemand Systems, Inc.
744 Broad St., 16th Flr.
Newark, NJ 07102
973.735.0547
973.642.8665

IP Logged

PaulTennis
New Member

Posts: 5
Registered: Dec 2001

posted 04-26-2002 10:54 AM     Click Here to See the Profile for PaulTennis   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by PaulTennis
I have recently made a load test tool presentation available through the downloads section. You may find it useful.

IP Logged

Ian
Advanced

Posts: 175
Registered: Sep 2001

posted 05-07-2002 04:58 AM     Click Here to See the Profile for Ian   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by Ian
"can anyone tell me what the relative shortcomings of the MS tools are, please? Also, can anyone explain the difference between WCAT and WAS?"

Difference WCAT v WAS

The WCAT tool involves placing, pre-prepared files on the Server. The WCAT tool then runs 'load patterns' using these files. This is a good general tool for sizing but will not reporoduce load specific to your site. It can support GET/POST and HEAD but the POSTs are limited to pre-written asp files. The server must be Microsoft based. If you can generlize the load, this tool is ideal for capacity planning/Benchmarking an IIS based Web Site.
The 'WebStone' benchmark can be determined using WCAT.

WAS -
Targets any http server (not just IIS)
Allows you to write your own simulations accessing your own files, it is not a requirement to place any 'pre-prepared' files onto the server.

WAS v LoadRunner (since WCAT takes a different approach)

LoadRunner supports many protocols, not just http.

LoadRunner is a script based tool, which supports response parsing. This is vital for 'url re-writing' and allows you to use the data returned. Take Ebay as an example, you could retrieve the latest bid and make a bid based on the 'minimum required bid', this type of processing is not possible with WAS were there is no access to the http response data.

LoadRunner has other advantages, ease of use, access to results etc. but the above are the essential functional differences.

Regards

Ian

------------------

[This message has been edited by Ian (edited 05-07-2002).]

IP Logged

All times are PT (US)

next newest topic | next oldest topic

Administrative Options: Close Topic | Archive/Move | Delete Topic | Top
Post New Topic  Post A Reply
Hop to:

Contact Us | BetaSoft Inc. | Privacy Statement

Copyright © 1997-2003 BetaSoft Inc.


Ultimate Bulletin Board 5.45c