|
Author
|
Topic: Stress Test measurements
|
PradeepKumar
Member
Posts: 36
Registered: Dec 2001
|
posted 08-29-2002 11:45 PM
    
Hi All,
I am in the process of conducting performance test for web based app. Since the number of users is less than 5, i am concentrating more on stress tests.The test requirements are to measure the latency of page download, & transaction response times under varying stress.
The system basically is designed to upload huge volumes of data to the tune of 10K-50K records from an excel & also to display equally large amount of data from the database on user specified criteria.
I can only think of following measurements from the results of my tests.
1.A graph of time taken for a complete transaction v/s stress inputs.
2. A graph of response time ( latency) v/s users.
I would like to know from u experts what other measurements could i possibly derive from my tests. Thanks a lot in advance.
------------------
|
RSBarber
Moderator
Posts: 852
Registered: Jul 2002
|
posted 08-30-2002 05:39 AM
How about server side resource measurements like CPU & Memory usage, or disk I/O. Maybe network bandwidth measurements. This is one of those rare cases where throughput might actually be a useful measurement.There are tons of different things you can measure and ways you can present the data. I don't know about the others on the forum, but I never know what I am going to create charts and tables about until I see the results. I build charts and tables to highlight what I actually found, as opposed to using canned reports to show things that may or may not actually be related to what you want to show in the first place. That said, what is the point of the test? What are you trying to prove/demonstrate? Take measurements that help to prove or disprove those assumptions, then develop graphical ways to display those results intuitively to non-technical people. ------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
|
Tamarahz
Member
Posts: 6
Registered: Aug 2002
|
posted 09-02-2002 01:29 AM
Re: server side resource measurements like CPU & Memory usage, or disk I/O. Maybe network bandwidth measurements.I, too, would like to monitor these parameters. But since I am new to load testing, I seek your advice and help. Does the testing software provide for these functionalities? Or does the testing engineer have to write the scripts himself? Thanks in advance
|
RSBarber
Moderator
Posts: 852
Registered: Jul 2002
|
posted 09-02-2002 10:54 AM
quote:
Originally posted by Tamarahz:
I, too, would like to monitor these parameters. But since I am new to load testing, I seek your advice and help.Does the testing software provide for these functionalities? Or does the testing engineer have to write the scripts himself?
I hate to do this to you, but the answer is "it depends". Which tool are you using?
Some tools can monitor these resources remotely (and all of the market leading ones can), but to be honest with you, I don't recommend it. In most cases these servers already have performance monitorying software installed that is used by the system's administrator. If this is the case, stick with the one you already know and have. Every one of these monitors works a little differently and uses a different amount of resources itself, so if you report results as monitored from the load generation tool, they might not match what the server admin is seeing on their side at the same time. Neither set of measurements is more correct the the other. Without getting into more detail than is really necessary here, the answer to your question is this. Yes most quality load generation tools can monitory server side resources, but only use this functionality if you do not already have a standard way to collect these statistics
------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
|
PradeepKumar
Member
Posts: 36
Registered: Dec 2001
|
posted 09-04-2002 08:53 PM
Thanks a lot for the suggestion to measure CPU & memory on the server side. But i am currently not using loadrunner or rational load & hence need to do all this testing * record measurements manually. Kindly let me know if there are any performance measuring tools( free  ) which i can use for measuring CPU & memory usage etc.------------------
|
JoeW
Advanced
Posts: 110
Registered: Jun 2001
|
posted 09-05-2002 03:01 AM
If your server is Windows (NT/2000) then you use "perfmon", if it's UNIX then "sar" and "vmstat". These are included with the operating system. Talk to your system admin/manager, and if they haven't heard of those tools, then start to worry...------------------
|
RSBarber
Moderator
Posts: 852
Registered: Jul 2002
|
posted 09-05-2002 07:14 AM
Solaris comes with PerfMeter pre-installed. As JoeW said, ask your sys admin what they are using and use the same thing. Performance Engineering, and even Testing, is a team sport. Get your folks involved.------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com
|
stayalive
New Member
Posts: 3
Registered: Jul 2002
|
posted 09-09-2002 07:25 AM
You can also try using SE Toolkit for solaris, very handy, may be useful. I also advice using vmstat and iostat, you can draw graphs(CPU-Memory-# of connections whatever it is) with gnuplot on solaris or move those data to windows and draw in excel.------------------
|
epsilontek
New Member
Posts: 1
Registered: Nov 2002
|
posted 01-08-2003 03:45 PM
Hi, All
Do any one of you know any software use to monitor the CPU/Memory/Virtual Memory usage. currently, I am using WinTask, but I don't really like it. usage!!! Please let me know!!!Thank, Epsilontek
|
RSBarber
Moderator
Posts: 852
Registered: Jul 2002
|
posted 01-08-2003 05:11 PM
Umm, Perfmon? I'm guessing there is a reason that you aren't using that, though I'm not really sure why.------------------
Scott Barber, Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com
|
jstrazzere
Moderator
Posts: 2134
Registered: May 2000
|
posted 01-09-2003 04:39 AM
quote:
Originally posted by epsilontek:
Hi, All
Do any one of you know any software use to monitor the CPU/Memory/Virtual Memory usage. currently, I am using WinTask, but I don't really like it. usage!!! Please let me know!!!Thank, Epsilontek
Perfmon would be the obvious choice here.
WinTask can certainly give you some simple measures, but Perfmon can give you much more in-depth information. Maybe you could tell us what you are trying to accomplish? ------------------
- Joe (strazzerj@aol.com)
|
