The online community for software testing & quality assurance professionals
   
Active Topics Today's Topics
Sponsors:
Lost Password?

Home
BetaSoft
Jobs
Training
News
Links
Downloads

News Group:
software.testing


Testing
Automation
Performance
Engineering
Miscellaneous
Statistics
Poll
  QA Forums
  Performance & Load Testing
  Best Counters For Capacity plnning

Post New Topic  Post A Reply
profile | register | preferences | faq | search

UBBFriend: Email This Page to Someone! next newest topic | next oldest topic
Author Topic:   Best Counters For Capacity plnning
DA
Member

Posts: 14
Registered: Nov 2001

posted 09-16-2002 01:55 PM     Click Here to See the Profile for DA   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by DA
Hi

I would like to know what are best counters for capacity planing
CPU
Memory
Disk
Network

This will help me my capaciyt panning project.

Thanks
DA

------------------
Da

IP Logged

RSBarber
Moderator

Posts: 852
Registered: Jul 2002

posted 09-16-2002 02:00 PM     Click Here to See the Profile for RSBarber   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by RSBarber Visit RSBarber's Homepage!
Do you mean a tool to monitor those items? Or maybe the maximum percent utilization rate? I think we need more info to assist here.

------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com

IP Logged

DA
Member

Posts: 14
Registered: Nov 2001

posted 09-16-2002 02:11 PM     Click Here to See the Profile for DA   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by DA
Hi

Thanks for quick respond
Best maximum percent utilization rate for those hardwires
Ex: Memory page /sec or page fault or Ave. of many counters

Thanks
Dushan

------------------
Da

IP Logged

RSBarber
Moderator

Posts: 852
Registered: Jul 2002

posted 09-16-2002 05:09 PM     Click Here to See the Profile for RSBarber   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by RSBarber Visit RSBarber's Homepage!
For best performance:

- CPU should never go over 80% for over a second and shouldn't spend more than a few seconds over 50% at any time.

- Network utilization shound never exceed 75% of capacity

- There should be enough RAM on the machine that it doesn't need/doesn't use virtual memory AND always has SOME memory left (yes, some is a vague term)

- Disk I/O should be low enough that requests don't queue - again vague, but it depends on too many things for me to give you hard numbers.

All of these measurements could be related to one another, as well as dozens more. There are too many possiblilities to share them all.

Capacity planning is far from an exact science, and these measurements and guides are just a small part of the overall process.

You can get more "quotable" numbers from the manufacturers of the software and hardware you are using.

------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com

IP Logged

allogene
Advanced Guru

Posts: 921
Registered: Jun 2001

posted 09-17-2002 05:57 AM     Click Here to See the Profile for allogene   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by allogene

MonitoredResources.doc

 
Here is a document I put together regarding this issue. I hope it helps. I spent about a week doing research and consolidated this list from various sources.

------------------
Simple minds, Simple thoughts!

Doug

IP Logged

RSBarber
Moderator

Posts: 852
Registered: Jul 2002

posted 09-17-2002 07:31 AM     Click Here to See the Profile for RSBarber   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by RSBarber Visit RSBarber's Homepage!
Doug,

Very comprehensive! I don't think I have ever seen all of those things consolidated in one place before. I hope you don't mind me integrating some of this information into my (ever growing) reference documents.

------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com

IP Logged

rstens
Guru

Posts: 321
Registered: Aug 2000

posted 09-17-2002 11:51 AM     Click Here to See the Profile for rstens   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by rstens

SelectMetrics.zip

 
quote:
Originally posted by DA:
I would like to know what are best counters for capacity planing
CPU
Memory
Disk
Network

This will help me my capaciyt panning project.


I just went through a very similar exercise and yes the counters mentioned in this thread will indeed help you understand where capacity use of your application is now.

However, capacity planning goes beyond the now and looks into the future.
The easiest (and the most problematic) way to plan for increase in usage is to do straight extrapolations. For instance, you have information on system usage running a simulation of 100 users. Your systems are server a, b and c.

Now you want to plan for 200 users. You can calculate how many servers of the same configuration of a,b and c you would need to support that load. But you do not know how many servers you would need if you changed configured like doubled processors, got faster processors etc.
You simply cannot make assumption that a two-processor machine will do double the work unless you have done testing on a two-processor machine with the same load.

Another important issue in capacity planning is to identify the bottleneck in your system and when the bottleneck will cause you to upgrade your capacity. In my case we quickly found (by extrapolation) that our network bandwidth to the Internet would never be enough for the future plans of the company, so we upgraded from 1.5 Mbs to 10 Mbs pipe.

Secondly we found that our web servers were just doing fine but our business servers were used the heaviest. Initial extrapolations showed that we would have to bring in 6-10 (see how fuzzy the predictions become!) times the amount of servers to cope with the anticipated load.
This triggered a re-architecting of our Internet environment that included load balancing and clustering, App center, network appliances, SSL accellerators etc.

An initial environment will be created according to this new architecture and we will be load testing/monitoring and capacity planning again to refine the needs.

Another challenge in our environment is that we run many applications and that we have to make a choice which set of applications we use for simulating a load with (sadly we lack the resources to do all). Some applications are big resource users and others are pretty light. Related to this is the simulation and the type of scenarios you want to run. Your scenarios should resemble actual usage as closely as possible. Check out Scott Barber's articles on this (important) topic.

I have included my set of counters and guidelines that we use when monitoring. This is from our internal performance testing manual.

I hope this rambling post helps you.

------------------
Roland

[This message has been edited by rstens (edited 09-17-2002).]

IP Logged

allogene
Advanced Guru

Posts: 921
Registered: Jun 2001

posted 09-17-2002 12:21 PM     Click Here to See the Profile for allogene   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by allogene
quote:
Originally posted by RSBarber:
Doug,

Very comprehensive! I don't think I have ever seen all of those things consolidated in one place before. I hope you don't mind me integrating some of this information into my (ever growing) reference documents.




Feel free to use these and pass them on. This is one thing we lack as a main resource that every tester needs. And if you have others that are not on my list I would love to know them so I can add them to mine.

------------------
Simple minds, Simple thoughts!

Doug

IP Logged

RSBarber
Moderator

Posts: 852
Registered: Jul 2002

posted 09-17-2002 02:05 PM     Click Here to See the Profile for RSBarber   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by RSBarber Visit RSBarber's Homepage!
DA - The articles Roland mentioned are located at http://www.perftestplus.com . Specfically, they are articles 2,3 and 4 in the series.

Doug - I will give that doc a healthy review (I'll even do some compare and contrast with Roland's doc) and let you know what I see.

------------------
Scott Barber
NOBLE(STAR
Sr. Performance Engineer
sbarber@noblestar.com
http://www.noblestar.com
http://www.perftestplus.com

IP Logged

Prasad
Advanced

Posts: 117
Registered: Dec 2000

posted 11-12-2002 09:11 AM     Click Here to See the Profile for Prasad   Edit/Delete Message Copy This Message   Reply w/Quote Search for more posts by Prasad
Also check this one
http://www.qaforums.com/Forum2/HTML/000374.html

------------------

IP Logged

All times are PT (US)

next newest topic | next oldest topic

Administrative Options: Close Topic | Archive/Move | Delete Topic | Top
Post New Topic  Post A Reply
Hop to:

Contact Us | BetaSoft Inc. | Privacy Statement

Copyright © 1997-2003 BetaSoft Inc.


Ultimate Bulletin Board 5.45c