Systems & Software Talk 

Visitors since August 14, 2007: Free  Web Counters
Free Hit Counters

Case Study of Early (actually, really late) Application Performance Issue

04:41, 2007-Feb-8  ..  Posted in Performance Testing  ..  0 comments  ..  Link

CONTEXT and SENSITIZATION

Let us figure out where we are in the development life cycle and get sensitized:

  • The application is purported as fully developed and is being tested by those who operate with black boxes.
  • Those people who typically operate with glass or white boxes were way too busy trying to survive the transformation of the original 1.5-year project estimate into the marketing-driven ship date of a year earlier than the estimated ship date.
  • The application has been through several test evolutions and is being tested on a staging or pre-production system.
  • You haven’t yet thought about retaining an attorney.
  • The National Guard has not yet been called out.
  • A certain "famous" tart who uses her toddler as an automobile’s steering-wheel mounted safety airbag, still has not learned to sing.
  • The project team has no clue about how loud and often the customer will scream when this application transforms their otherwise screaming computers into molasses at minus 40° F, or minus 40° C.
  • The project manager apologetically approached you and asked you if you would conduct performance testing on this application as it was due to go live in one week.
  • Much like the coaches budgeting and using timeouts in an NFL game, the executives have by now used up all their typical statements:
    1. This is not rocket science.
    2. Any monkey can do this.
    3. Why didn’t we think of this sooner? (It is a good sign that they are yet using "we" instead of "you".)
  • Project team members still talk cordially to each other and look at each other as team members even though a bit of skepticism is blurring their vision and their tongues have a mild coating of cynicism.
  • Management has not yet sharpened or tuned one of these -->C  and visually overlaid team members with this:

Courtesy of: www.dartboards.com Winmau Blade IIITM – a trademark of Winmau Dartboard Company, LTD.

We now know who you are and we have an approximation of where we are (below) at in the development life cycle. An old Carole King song is repeating in your head as you listen to the pleas of the project manager.

You just happen to be in the ATF Zone (All-Too-Familiar)! While this is not about the real ATF - Alcohol, Tobacco, and Firearms, this situation and your location in the development life cycle can be just as dramatic and intriguing, and – any one or more of those items might come in handy!

' Would it be appropriate at this time to call your attorney?

If you are not yet sobbing uncontrollably, grab some Kleenex and read on. (Kleenex is a trademark of the Kimberly-Clark Corporation)

 I (I is you!) Agreed To Help The Project Manager (Oh Dear)

Of course you did! That is your job. You are a performer! What you work on may not be a performer, but you are!

What You Agreed To

While you are not an ordained minister, you agreed to bless the application – within the required timelines. (What were you thinking???) You also mumbled that blessings might not be appropriate. The PM’s eyeball rolling was an acknowledgement to your mumbling.

Ready, Set, Go!

  1. Risk notebook ready for input.
  2. Caveat recipes access – enabled.
  3. Reflecting sunglasses ready for encounters with project non-friendlies where eye contact with the host’s searing laser-emitting pupils may blind you.
  4. Fact-finding map at the ready.
  5. Popular IT-clichés/questions counters below reset:
  • Kick-the-tires counter = 0
  • Circle-the-wagons counter = 0
  • Well what are the industry standard page load specs counter = 0

Your Research Revealed

  • That the only capacity planning information available on the project was on napkins – napkins marked "Dimpy’s Bar & Grille". Perhaps the napkin user was testing his or her capacity for alcohol. There were no dates or version markings. The ink had coalesced with the cheeseburger grease wiped from the consumer’s mouth. You could still make out the partial words "pe..orm" and "b.tt.r."
  • That there were no performance specifications. You dig deep into bio-RAM and find an appropriate melodyric, and alter it to fit the occasion. "I don’t care what they say, I won’t stay in a world without specs." Thank you Peter & Gordon.

Melodyric (měl'ə-dĭr'ĭk) Combination word that means melody and lyric. Remember! IT people are notorious for inventing new words. Should you or I be any different?

  • That there were no service-level agreements with the customer base.
  • That swimming upstream into the development life cycle to get any information about performance proved futile. Architects, BAs, SAs, DBAs, and Developers – all looked at you as if you had asked them to join your multi-level marketing company down-line.
  • There were no performance measurements made anywhere upstream, therefore there was no factual evidence to indicate how this baby may or may not perform. No one seemed to be the least bit concerned except the PM.
  • That the people within the company trained in CPR were truly trained as they had to resuscitate you from near drowning in Lake Sorrow at least four times.

What Have You Accomplished Thus Far – In Parallel With The Above Research?

You have:

  1. Provided a performance test specification capture document to the requestor.
  2. Requested and received an approximate concurrently executing user count that clearly indicates the need for a simulation tool such as QALoad or LoadRunner.
  3. Discovered that all simulated users will need to be authenticated against an LDAP server.
  4. Arranged for a Proof-Of-Concept recording session with the appropriate team member to determine if your performance test tool is a fit.
  5. Acquainted yourself with the application a bit after you acquired power-user credentials. This experience made you wonder if this app was running on a 750 KHz 8-bit microprocessor with 4 KB RAM. ß Big clue!
  6. Studied system and network architectural diagrams.
  7. Made the appropriate requests to have your monitoring account setup on servers so your tool could pull server health counters.
  8. Discovered that the database will be sized as production and populated with production data and that you need not be concerned with SOX or any other data confidentiality issues. (Boy are we making this easy!)
  9. Updated and circulated your resume’.

Your Performance Testing Toolkit Consists of:

  1. LoadRunner/PerformanceCenter
  2. More than one controller
  3. Many thousands of Virtual User Licenses
  4. A load farm of tens of servers
  5. OpenSta
  6. Opnet’s IT-Guru/ACE
  7. VBScript Utilities:
  8. Reusable code for making ODBC connections and queries.
  9. LoadRunner Vuser log file parsers
  10. You have access to HP-OpenView

What Will You Do?

Reminder:

  • You need to make a statement about the performance of this application and architecture. You have less than a week to accomplish something that ordinarily takes about three weeks at a minimum.

Oh Wait! Some Other Interesting Developments Or Wrenches As It Were

  1. Your Proof-of-Concept recording of the application with LoadRunner’s Vugen exposed a proprietary protocol bundled in octet streams. You will not be able to correlate or parameterize data. The 3rd party developer of this application protocol is rightfully unwilling to expose the decode methods.
  2. You even tried Winsock. You were unsuccessful.
  3. OpenSta will not work either as a result of the above developments.

What would you do?

Your thoughts will be compiled into a checklist along with the methods/techniques actually used in this case. In March 2007. I will blog the techniques used to discover a major bottleneck.


 

{ Last Page }   { Page 23 of 45 }   { Next Page }

About Me

Home
My Profile
Archives
Friends
My Photo Album

Links

Corey Goldberg
Effective Testing?
Bj Rollison I.M. Testy Blog
Alan Page: Software Testing & Rants
Dmitry's LoadRunner and QTP Blog
Veterans History Project
Air Traffic Control Watch
Music Making Fun
My home 1972-1975

Categories

Functional Testing
Performance Horror
Development
Performance Testing
General
Tools Tips
Warped Humor
LoadRunner Tips and Tricks

Recent Entries

Introducing Testalis
Defect Report - Politically Correct
Performance Testing Vuser Personas – Part I
Happy Holidays 2007
Acceptance Testing (UAT) - Some Answers to Some Questions

Friends

LauraScharp
philk10
richardw100
aalhait
jimhazen
strazzerj
Lynnem
bru
EklecticTester
jgottlieb
leakybrain
michaeljf
prainbow
rajeshmathur
rstens
Yury
zeeslo
whollymindless

Syndication

RSS Site Feed