Dec 23 2011

Load Testing The Right Way - Some Tips From The Trenches

Posted by Mike Brunt at 12:03 PM Web Servers | .NET | DataBase | CloudComputing | Caching | Java-JVM | ColdFusion | JRun-J2EE

 

There have been two of my clients recently, who outsourced load-testing to third party companies, different ones in actual fact.  I would recommend against that for several reasons.

First and foremost, the load-testing will typically start from the wrong location; where the user sits, which is where we should end up, not where we should begin.  The reason, is if there are issues that could relate to network issues, time-to-first-byte (TTFB) or socket related issues, being where the user sits makes those almost impossible to pin down.  As another tip in this regard, there are several companies now offering Cloud-based, distributed testing, which definitely has its place but is not in of itself enough. All load testing should ideally start in the same sub-net as the application tier, directed at the application tier, which in turn will exercise the data tier. This will test the basic infrastructure with little or no network latency.  If we get TTFB errors or socket errors at this point, that confirms that there are issues with the application tier which can be dealt with quickly before we move further out via the network.  Ideally we should also test from inside and outside any firewalls whilst still in the hosting or network location.  If there is clustering (load-balancing/failover) we should test each server individually then in the cluster.  Also, if there is a content delivery system (CDN) we should also test with and without that.  All of this testing should happen before moving to testing from where the user exists.

Secondly, load-testing an application where there is no knowledge of how the application was written or even in what language it was created is far from ideal.  We had a client recently where a single request spawned 15 other requests and this was not easily apparent from browsing the web site but showed up in the details of the load test script after careful investigation.  If you are going to use a third-party company to carry out load-testing for you, make sure you get to see the scripts they create and pay particular attention to the URL's in the test.

Lastly, creating load-tests is not longer a multi-thousand dollar process.  J-Meter is an adequate open-source utility and commercial products such as Paessler Web Server Stress Tool are in the hundreds and not thousands of dollars to buy. If you encounter a vendor wanting thousands of dollars for a load-testing tool, in my opinion and experience, it is over-priced.  In addition, if a tool takes hours or days to produce a usable script, something is wrong.

 

Comments

Pritesh

Pritesh wrote on 12/23/11 8:24 PM

Nice...Post. I love J-Meter for load testing and customize report as per need.
Mike Brunt

Mike Brunt wrote on 12/24/11 1:59 AM

Thank you Pritesh and it would be interesting to know how you use reports from J-Meter.
IT Infrastructure

IT Infrastructure wrote on 12/29/11 3:45 AM

Hello, while searching some features about a product I found your blog post most relevant.I think this product will definitely help the users a lot.
hemorrhoids

hemorrhoids wrote on 01/10/12 3:37 AM

Thank you Pritesh and it would be interesting to know how you use reports from J-Meter.
Grants for Veterans

Grants for Veterans wrote on 02/21/12 8:31 PM

You have beautifully presented your thought in this blog post. I admire the time and effort you put into your blog and detailed information you offer.
www.24hrfitnessdeals.com

www.24hrfitnessdeals.com wrote on 09/25/12 5:32 AM

Ich würde mit Ihnen muss hier überprüfen. Welche ist nichts, was ich normalerweise tue! Ich bekomme Vergnügen beim Lesen eines veröffentlichen, machen Individuen denken kann. Darüber hinaus ermöglicht dank für mich zu bemerken! xyj
payday loans in ohio

payday loans in ohio wrote on 09/27/12 9:32 AM

Yeah, one should check each server individually to overcome the problem of clustering.
payday loans in ohio

payday loans in ohio wrote on 09/27/12 9:33 AM

Yeah, one should check each server individually to overcome the problem of clustering.
acheter pharmacie en france

acheter pharmacie en france wrote on 11/06/12 4:58 AM

acheter pharmacie en france
more here

more here wrote on 11/08/12 8:49 PM

The tips for load testing provided here for Cold fusion looks great to me. You have made it really easy to follow. I loved your style of writing; it is simple yet informative.
lzy

lzy wrote on 11/11/12 7:53 PM

Atmospheric and elegant watches men's preferred
Houston Dentist

Houston Dentist wrote on 12/04/12 2:22 AM

Excellent Post Never Had knowledge about "load-testing" Looking Forward To gather More of Information
www.active-domain

www.active-domain wrote on 01/09/13 2:05 AM

All the tips are very well presented and quite helpful as well to understand the testing criteria.
wedding grove

wedding grove wrote on 01/15/13 2:02 AM

How can we avoid Fibromyalgia? It is very painful diseases.
wedding planner

wedding planner wrote on 01/15/13 2:03 AM

Can you share some more detail of chronic pain? I really like to see.
wedding

wedding wrote on 01/15/13 2:03 AM

I have read your post and I am waiting for another interesting post. Please update useful information on your blog.
www.radiologytechnicianreviews.org

www.radiologytechnicianreviews.org wrote on 02/10/13 6:24 PM

How affordable or expensive is this load-testing nowadays? I have considered making use of this application before but it was way beyond our company's budget. I am hoping that this time the investment on this one has dropped significantly.
wiecej tutaj

wiecej tutaj wrote on 02/16/13 12:04 PM

Mike Brunt is awesome!!
surgicaltechnicianreviews.org

surgicaltechnicianreviews.org wrote on 02/25/13 1:21 AM

Was the testing successful enough to warrant the commencement of this program? What do you think could be the possible obstacles in this one? Are there any factors that we should consider first.
Burlinson Dental

Burlinson Dental wrote on 03/15/13 8:48 AM

What are your thoughts on load testing for small companies with small warehouses? Do you think using it would yield more satisfactory results? We are really looking to bring down our costs in various areas.
ADC Safes

ADC Safes wrote on 03/21/13 8:48 AM

The little ghost like man in your header is well freaky! Good post though.
iHub Solutions Hong Kong

iHub Solutions Hong Kong wrote on 04/03/13 12:57 AM

What is the proper way of performing load testing in a small organization like us? What are the common problems that are usually encountered? Are there any alternatives to this system?
achoice-insurance

achoice-insurance wrote on 04/13/13 4:40 AM

I would like to say thank for sharing this great article. We can’t get this kind of information from
easybabyshopping

easybabyshopping wrote on 04/15/13 11:08 PM

Shopping at thrift stores and consignment shops can reveal some incredible bargains, whether you're looking for durable clothes to let the kids run wild in or a new outfit for the office.
Emas Pte Ltd

Emas Pte Ltd wrote on 04/17/13 1:42 AM

How would I know if I am load-testing from the wrong location or not? How good should my Cloud-based storage be in order for the system to work efficiently?
pharmacytechnicianreviews.org

pharmacytechnicianreviews.org wrote on 04/20/13 6:41 AM

Who specifically should I hire if I want load testing to be performed on my system? How much is the price range of professionals working on this type of activity?
www.getcasinofreegames.com

www.getcasinofreegames.com wrote on 04/22/13 4:40 AM

Oh well, i guess i have the right to tell on what's truth and it will be into something right. it will be something great.
www.AccessDoorControls.co.uk

www.AccessDoorControls.co.uk wrote on 04/29/13 12:57 AM

Wow thanks! Been looking for a load testing tutorial for a while now. Really great post!
Megaton Pte Ltd

Megaton Pte Ltd wrote on 05/01/13 8:10 PM

If I am doing load testing the right way, how long do you think it will take before I can apply the necessary corrections? We are hoping that it will really reduce our operating costs by at least 25 percent.
ultrasoundtechnicianreviews.org

ultrasoundtechnicianreviews.org wrote on 05/06/13 12:50 AM

In your honest opinion, what should be the qualifications of a person who can properly conduct load testing on our system? What are the common problems usually encountered in the steps involved?
Active-Venture Web Hosting

Active-Venture Web Hosting wrote on 05/07/13 8:14 AM

Is it possible to get an online seminar for my employees on the topic of load testing? How many hours do you think will be suffice for this event?
employee satisfaction

employee satisfaction wrote on 06/14/13 7:38 AM

For me a trench is a type of excavation or depression in the ground. A trench is generally defined by being deeper than it is wide, and by being narrow compared to its length.
Visit Website

Visit Website wrote on 06/21/13 12:16 PM

Excellent Post Never Had knowledge about "load-testing" Looking Forward To gather More of Information
btelefonkatalogen.biz

btelefonkatalogen.biz wrote on 06/26/13 12:18 AM

I found the perfect place for my needs. Contains wonderful and useful messages. I have read most of them and has a lot of them. To me, he's doing the great work.
http://onlinecheapestcarinsurance.co.uk/

http://onlinecheapestcarinsurance.co.uk/ wrote on 06/28/13 10:38 AM

I need to express my reverence of your written work expertise and capacity to make bookworms read from the starting to the close.
onlinecampingstove.blogspot.com/

onlinecampingstove.blogspot.com/ wrote on 06/28/13 10:40 AM

???? ????? ??????? ????????, ?? ? ?? ??????, ??? ??? ????? ? ???????? ??????? ??? ????? ???????. ? ????????, ??? ????? ?????, ?? ?? ? ???? ?????, ????? ????????, ??? ???? ??????? ??????? ? ????.
fabulous web shows to watch

fabulous web shows to watch wrote on 07/01/13 9:40 AM

Test is a term used to refer to the shell of sea urchins, and also the shell of certain microorganisms, such as testate foraminifera and testate amoebae.
here

here wrote on 07/13/13 7:12 AM

Very attractive and informative publication indeed. I have to admit that I always follow your blog because it is full of various and useful information about everything. Well, it was quite interesting to read this your article. Actually, I am very interested in this sphere and reading this post I have known many new things, which I have not known before. Thanks for publishing this great article here, without you I would never known about such a thing ever.
Car wash lexington ky

Car wash lexington ky wrote on 07/24/13 1:50 AM

Park the car in a shaded area and then wash it down using a hose. Start with the roof, work your way down the sides, and then to the tires. Afterwards, scrub the car with a sponge dipped in water and mild liquid soap. Rinse and repeat if necessary.
software security consulting

software security consulting wrote on 08/10/13 11:27 AM

Thanks for these effective tips. I have searched a lot about this but got some stuffs only here.
Normal Human Biologicals

Normal Human Biologicals wrote on 08/14/13 9:14 AM

Great tips really. i am gonna follow this.
Movers Tampa FL

Movers Tampa FL wrote on 08/14/13 9:14 AM

Load-testing is most important thing before running a website, I am helpful from your tips!!

@ Author and Others,

Can you recommend some free software for load-testing?
Post-9/11 G.I. Bill

Post-9/11 G.I. Bill wrote on 08/14/13 5:11 PM

I am searching for many tips that will help me lower my grocery bill, maybe by as much as 50 percent.
Commission Advance

Commission Advance wrote on 08/27/13 3:50 AM

Enormous information in one blog post, I just love it. I must appreciate and mention that you completely know how to keep connected reader to blog post even if it is little long. Very good job. Keep it up..
Delhi sightseeing

Delhi sightseeing wrote on 09/02/13 5:09 AM

Just talked to the guy in charge at the scrapping company again. There is no way anyone can buy this car. maybe Tim´s proposal might work if NEVS are interested…
They have recieved loads of NG 9-5 sedans the last years that has been scrapped or used as training for the fire & resque services.
This is the only SC though
www.ritchielawfirm2.com

www.ritchielawfirm2.com wrote on 09/13/13 4:07 AM

Unbelievably phenomenal post, I completely thoroughly enjoy this site, proceed with it.
Johnny McCarthy

Johnny McCarthy wrote on 10/03/13 9:16 PM

Not long ago i observed your site nevertheless get substantial an answer to this specific to hold in. Keep up the nice carry out, their particular nearly impossible to get beneficial people. We've combined with each of our faves. Plus the reasoning behind Many thanks.
collier

collier wrote on 10/12/13 4:00 AM

Partout dans le monde, il est été l'un des sujets les plus parlé.
chaussure foot mercurial

chaussure foot mercurial wrote on 10/17/13 9:09 AM

Hm.The article content written very well,extremely is worth my study.
haiwaiz

haiwaiz wrote on 10/22/13 9:29 AM

Thank you for sharing. Longing for further superior post!These proceed through intensive study as well as growth to improve overall performance http://www.ronaldocleats.com characteristics which are good to gamers. Adidas, Nike, The puma company along with Umbro are the hottest and a lot donned cristiano ronaldo mercurial boot makes. The best measurement on your foot provides you with the best outstanding overall performance within a game. For most ages now, Chaussure de foot Nike Hypervenom may be famous for producing many different sneaker items that offers provide many players worldwide in several sports http://www.lionelmessif50.com as well as games. In almost any sport, Nike firm constantly make an effort to generate a particular footwear product which can be fitting to a certain sports activity variety. Thus, because presented within the Lionel Messi ads as well as used by way of a web host http://www.chaussurefootronaldo.com involving renowned people just like Gareth Bale, Jesse Silva, Luis Suarez as well as Pavel Pogrebnyak.This is exactly what Nike has developed for Ronaldo brand new footwear. Nonetheless, seems to be and all sorts of set aside. These shoes are produced from excellent unprocessed trash and are engineering based.A player must consider special care when picking her or his boots since it is critical Nike HyperVenom Phantom that it suits them personal, that means body along with really feel from the start. These boots need to suit the players?ft . properly, using the shape of the particular base into mind.
football

football wrote on 11/20/13 3:34 AM

This will need some skill to generate traffic to your website
canl? maç izle

canl? maç izle wrote on 11/25/13 1:15 AM

You got a definitely helpful blog I’ve been right here reading for about an hour. I’m a new and your accomplishment is quite a lot an inspiration for me.
<a href="http://www.bahislife.net/">canl? maç izle</a>
canl? maç izle

canl? maç izle wrote on 11/25/13 2:08 AM

Nice sharing
cleats boots

cleats boots wrote on 12/15/13 1:10 AM

It's Great web site,It is worth it to read.
new nike mercurial 2014

new nike mercurial 2014 wrote on 12/15/13 3:46 AM

your blog is good.Thanks for your sharing good info.
chaussure football pas cher

chaussure football pas cher wrote on 12/17/13 1:41 AM

This is a good site,I absolutely recognize the research an individual inside this specific.
replica watches factory

replica watches factory wrote on 03/16/14 11:37 PM

The same is true of the Internet -- if you want to access the whole thing, your <strong> replica Franck Muller watches </strong> needs to understand the language. Source: 5 Cheap Dividend Stocks Worth InvestigatingDisclosure: I have no <strong> replica watches </strong>s in any stocks mentioned, and no plans to initiate any <strong> replica Franck Muller watches </strong>s within the next 72 hours.
indian party dress

indian party dress wrote on 03/29/14 12:50 PM

I read it totally .I have considered making use of this application before but it was way beyond our company's budget. I am hoping that this time the investment on this one has dropped significantly.
Web designer

Web designer wrote on 05/09/14 3:00 AM

If a picture paints a thousand words, imagine what a movie can do. <a href="http://www.indesign.us">Web designer</a> Next time you create a PowerPoint presentation, consider adding a video clip to your slides
check cashing place

check cashing place wrote on 06/14/14 5:49 PM

I simply have a glimpse here and seem pleasant to hunt out this journal. created content writing hand and intensely cooperative science system. i would like most of we have got got a bent to tend to tend to tend to unit inclined to alliance bureau neck of the woods unit to seem out these ways in {which} that} at intervals that within which in at intervals that throughout that of things, here we have got got a bent to tend to tend to face persist the brink of observe everything. I’m with the content tribute associate degreed do esteem him as associate honest provider. Thanks for your labor and you too. day loans
health-matrix

health-matrix wrote on 07/23/14 1:20 AM

On the Internet you can find many current event health articles. These materials help us to expand our knowledge on the important issues that affect our well-being.
breakfast 4 health

breakfast 4 health wrote on 07/23/14 1:20 AM

The debate over the number of uninsured and whether or not they should be covered, public vs. private insurance, and who pays for all of this will go on.
water loo health care

water loo health care wrote on 07/23/14 1:20 AM

Taking care of your body is an investment. In order to get the most out of this investment, you should go beyond exercise and healthy eating.
online watch shopping

online watch shopping wrote on 07/23/14 1:20 AM

Wait, till you have to offer employee benefits, it gets tougher... Here are few tips to make shopping for employee health insurance easier.
italian shopping

italian shopping wrote on 07/23/14 1:21 AM

Whether you work in the construction sector or other area that requires stringent health and safety services, training staff in health and safety will be beneficial to both them and the company in the long run.
memorial day images

memorial day images wrote on 05/19/15 6:41 AM

Best Memorial Day Images, Messages, Pictures,wishes,Messages, Wallpapers,sms,greetings, Cards,Memorial Day Poems,Quotes To Share On Whatsapp,Facebook,Twitter And Other Social Media
christmas message

christmas message wrote on 10/08/15 9:15 AM

christmas images , christmas wishes ,christmas wallpapers ,christmas greetings
,christmas quotes ,christmas poems ,christmas cards ,christmas pictures.
dokter

dokter wrote on 12/14/15 1:01 AM

This blog is so nice to me. I will continue to come here again and again. Visit my link as well.
Good luck
valentines day pictures

valentines day pictures wrote on 01/12/16 1:40 AM

Top 2016 Happy Valentines Day Images, Valentines Day Pictures, Valentines Day Cards, Valentines Day Wallpapers For Boyfriend, Girlfriend And Wife Sharing
happy st patricks day images

happy st patricks day images wrote on 03/15/16 7:03 AM

Here in this web page, we have collected the best St.Patricks day Images, Pictures, Wallpapers, st.Patricks day quotes, sayings and wishes 2016 which you can use for sharing with your friends and family members on facebook, whatsapp, twitter, snapchat and other social media.
صور بنات

صور بنات wrote on 07/17/16 8:15 PM

web page, we have collected the best St.Patricks day Images, Pictures, Wallpapers, st.Patricks day quotes, sa
تحميل برامج

تحميل برامج wrote on 07/19/16 11:14 PM

Here in this web page, we have collected the best St.Patricks day Images, Pictures, Wallpapers, st.Patricks day quotes, sayings and wishes 2016 which you can use for sharing with your friends and family members on facebook, whatsapp, twitter, snapchat and other social media.
مواقيت الصلاة

مواقيت الصلاة wrote on 07/19/16 11:18 PM

Top 2016 Happy Valentines Day Images, Valentines Day Pictures, Valentines Day Cards, Valentines Day Wallpapers For Boyfriend, Girlfriend And Wife Sharing
مواعيد الصلاة

مواعيد الصلاة wrote on 07/19/16 11:35 PM

szdgfhgjnmcxvbnmgfjgfh
kathrinemf18

kathrinemf18 wrote on 07/27/16 4:05 AM

Bawdy representation shots
http://beach.sexblog.pw/?pictures_joelle
mature lit erot erotic halloween erotika
obat penggugur kandungan

obat penggugur kandungan wrote on 10/19/16 4:08 AM

Thanks for sharing the good and useful information here on the blog for us.