AJ'S SQA Space | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
QA Q and A - Smoke TestQA Q&A
When you want to quickly assess the state of a software build, you often turn to a Smoke Test (sometimes called a Build Verification Test). Essentially, you are trying to do something that is relatively quick and inexpensive, that will give you a general feeling for the software. You aren't looking for all the bugs. You aren't trying all the scenarios. You just want a general idea if the software works or not.
Often, the goal of this Smoke Test is to decide if more in-depth, more expensive testing is worthwhile, or if the software is too broken to be bothered.
Usually, you exercise only the basic paths of the software, and avoid all the unusual conditions. And usually, you don't test deeply at all - you just skim the surface.
In her book Effective Software Testing: 50 Specific Ways To Improve Your Testing, Elfriede Dustin says that a Smoke Test is "a condensed version of a regression test suite". And many companies do just that - extract a portion of their overall regression test suite, and use it repeatedly as a Smoke Test.
Manual Smoke Testing
But often, a written script tells the manual Smoke Tester what to test and how.
Either way, the manual Smoke Test should be brief and to the point. If the software is in generally good shape, the manual Smoke Test should pass. If not, the Smoke Test should fail.
If the builds occur overnight, I like to be able to schedule this Smoke Test so that it runs after the build and so that the results are ready and waiting for me when I get in the next morning. Sometimes, this allows me to run a larger overnight test and still have the results ready for the morning.
When I start to automate the testing of a system, the Smoke Test is usually the first automation I create.
In their excellent book How We Test Software At Microsoft, Alan Page, Ken Johnston, and Bj Rollison list these attributes of an automated Smoke Test (Build Verification Test):
For other QA and Testing terms, see: http://www.sqablogs.com/jstrazzere/46/A+Glossary+of+Testing+Terms.html
New Year, new things and Yakking up hairballsAfter 2 years of in-activity I guess I should do something to revive this blog. I guess being busy with work, life and all I have been negligent in my rantings... er, writings. I found a couple of other blogs recently that I think others will like. They are qahatesyou (http://qahatesyou.com/wordpress/) and PracticalQA (http://www.practicalqa.com/). The latter has a great post and title for the post. So for 2009 I suggest we all need to make sure we are not "yakking up hairballs". Be good people!
Jim New Year’s Eve of 2010 Catastrophe In the Works< I just noticed that my free site-visit counter is defective and rolls over on some strange boundary between 20K and 21K>
After reading this you may agree that we need to call on all manufacturers of numeric New Year's Eve year party eyeglasses to conduct product testing and make product alterations as indicated by such tests. Remember all the Year 2000 cussing, fussing, mussing and dooming and glooming? Well, unlike the actual results which were much milder than the predicted results, the New Year’s Eve celebration of the arrival of the Year 2010 will likely be catastrophic unless product design testing of numeric year party eyeglasses occurs, and – design changes are made accordingly.
Picture a million revelers in New York City’s Times Square on December 31, 2009. How many more millions will be assembled in a similar fashion around the world? How many of them will be wearing those goofy-looking numeric year party ungreen plastic eyeglasses – 2010? Did you notice something? “2009” glasses are natural for the eyes since they do not obscure one’s vision; the zeroes aligned perfectly with the vision-giving apertures. “2010” with the “1” over the left eye is going to impair depth perception. That sounds low-risk – correct? Think again. Imagine millions of shoulder-to-shoulder, hip-to-hip revelers worldwide already or soon to be impaired by giddiness, alcohol and d.r.u.g.s. Toss in impaired depth perception. We have a looming major problem of a magnitude not previously seen.
All hell will break loose with a series of small incidents that would be otherwise insignificant if one was sporting 2009 glasses. Here is how major mayhem and mass rioting will shake the very core of this planet Earth, causing worldwide tremors and sending seismographs into frenzied activity. Some newly engaged couple already under the depth-perception-robbing effects of hemp will attempt to kiss each other, with someone partially “lodged” between the kisser and the kissee. The kiss will not land on the fiancée, but instead land on the upper lip of that someone running block betwixt the original kisser and the kissee. Instant jealously and misunderstanding will drive the ensuing actions. A punch from the dominant and protective fiancée will fly, miss the intended face and land on an unintended face. Faster than a security hole in Windows can be exploited, the jealously, misunderstanding, and punch will go plural and spread. Similarly and concurrently elsewhere in these masses of humanity, other activities will trigger spawning mayhem. Other kisses will land at the business ends of cold-driven runny noses belonging to unfamiliar persons. Grabs for the usual body parts of familiar people will result in grabs of familiar parts on unfamiliar people. Males will be overheard asking the right question of the wrong females, "Did a mobile plastic surgeon just attend to you?" - OR - the wrong question of the right female where the response is a slap and escalation to feed the all-out brawl in progress.
Left-to-right, right-to-left eye-darting speed users will strobe themselves into seizures and nausea. The stroboscopic effect will act as an emetic and the resulting ejecta will find a partially bared bosom; triggering yet another rapidly spreading fight. Cocaine users armed with razor blades will miss the handheld mirrors and slice/dice someone’s digits. Human males wanting to unload processed liquids will miss the ground and decorate someone’s party stockings, pant legs, or ankle bracelet. More fighting erupts. Police on foot and horseback will respond. Some of those police and some of those horses will be wearing 2010 glasses. One can easily imagine the impact of horses with impaired depth perception. Some revelers will instantly acquire hoof-in-mouth disease. Other revelers may be handed some barn biscuits courtesy of the horses’ backside exits. They will launch these into the crowd and feed the Santa Ana winds-driven fire of hysteria. The perception-impaired police officers will miss their handcuff targets. Trump and O’Donnell will be accidentally cuffed together. OMG! The never-one-so-large largest riot is now underway. The fighting is unstoppable. People try to flee. It will be like a soccer game in Europe or a Who concert in Cincinnati! Hockey fans will feel at home. Those party-glasses equipped revelers on rooftops will misjudge the edges of their perches, soar to new unheights and then tattoo the road surfaces below. Unfortunately, Jerry Springer’s camera crews will not be on hand to film what would be his crowning achievement - millions of people with impaired depth-perception, fighting with temporarily defective targeting systems.
You can help prevent this looming tragedy of worldwide proportions. Please implore of the manufacturers of these to consider alternate designs. For ABC Television and their Rocking Eve, please send me a set of earplugs and glasses for the year 2111 if you are going to air the Pussycat Dolls again.
Perhaps They Should Have Tested More - Microsoft Zune
A Zune Swoon?
Hey, anyone know how to get this thing working again?
Apparently, starting around midnight last night, all first-generation 30GB Model Zunes - every one - restarted themselves and locked up at the boot screen.
Just take a look at some of the Headlines:
Think some Boundary Value Analysis might be in order?
At this time, Microsoft's Zune Support page says only:
When I checked at 2:00 PM Eastern time, Microsoft's Zune Support page now says:
So apparently it was a leap year problem.
Now who could possibly have thought to test for leap year issues? After all, that "leap year" thing is a fairly new invention, right?
Perhaps they should have tested more.
An update. Supposedly, this is the code which failed:
see: http://www.aeroxp.org/2009/01/lesson-on-infinite-loops/ http://www.zuneboards.com/forums/zune-news/38143-cause-zune-30-leapyear-problem-isolated.html http://programphases.com/?page_id=1732 http://www.zune.net/en-us/support/zune30.htm http://gizmodo.com/5121311/30gb-zunes-failing-everywhere-all-at-once http://news.cnet.com/8301-10805_3-10130186-75.html
Book: How We Test Software at MicrosoftA really nice addition to my QA Bookshelf.
In How We Test Software at Microsoft, Alan Page, Ken Johnston, and Bj Rollison provide a terrific mix of insight into Microsoft, along with in-depth explanations of practical test processes.
From the introduction:
I would also add that this book is for anyone who wants to learn some extremely useful, real-world approaches to both typical and complex testing situations.
Contents:
While not all of the solutions will apply to everyone (unless you happen to work at a company with over 9,000 testers), everyone will learn something. The excellent explanations of Equivalence Class Partitioning and Boundary Value Analysis are among the best I have ever read.
This is a very good book - one I highly recommend to all current and would-be testers.
Trial Versions of Commercial Test Automation Tools
Many vendors of commercial test automation tools offer trial versions.
Here are some:
New England Patriots 2008 Season EndsNew England Sports 2008-2009 Season (so far)
A rough season for the Patriots. Imagine:
and still going 11-5?
Yet, after that surprising effort, the Patriots are the first team in over 30 years to win 11 games and not make the playoffs. Oh well.
Bob Ryan of the Boston Globe says of the Pats: "They're the Best Team Ever To Miss The Playoffs".
A terrific season by Matt Cassell, and a good season by the team. Unfortunately, not quite good enough, given the high standards in New England. Next year...
Any comments on this article? Email Me Wingtips of Mass Destruction Found in Iraq
After all these years - conclusive evidence of WMDs in Iraq:
Any comments on this article? Email Me Perhaps They Should Have Tested More - Google Android
txtN cn B fun - bt danjrus!
Who knew that simply texting the word "reboot" would actually cause a phone to reboot?
Apparently, words texted right after a reboot were interpreted and executed as commands with root priveleges by Android, rather than simply being sent.
A bit of a security flaw, no?
Perhaps they should have tested more?
Here are a few helpful suggestions for words to use while testing the fix for this particular bug:
See also:
New England Revolution - 2008 Season EndsNew England Sports 2008-2009 Season (so far)
After three straight seasons of reaching the MLS Cup, and six straight seasons of reaching the Eastern Conference finals, the New England Revolution bowed out this year in the first playoff series.
Lots of injuries this year eventually become too much to overcome.
Oh well - wait until next year.
Any comments on this article? Email Me Real Leaders
A real leader takes the blame when things don't go as expected: "And though we fell short, the failure is mine, not yours."
"But above all, I will never forget who this victory truly belongs to - it belongs to you." Any comments on this article? Email Me US Elections on November 4th - Don't Vote!On November 4th - don't vote
If:
then DON'T VOTE!
All the better for the people who care.
Are you planning to vote? Email Me New England Sports 2008-2009New England Sports 2008-2009 Season (so far)
It's hard not to be at least a little bit disappointed that the Red Sox didn't make it back to the World Series.
Still, making it to game 7 of the ALCS isn't all that bad. And, they have a young team that should continue to contend for years to come.
Any comments on this article? Email Me A Fall Walk Around Walden PondIt was a beautiful fall day in New England yesterday.
Sunny, cool, no wind, great foliage.
So once we got our to-do list done for the day, we drove to Concord, and took a walk around Walden Pond.
(Walden Pond. October 18th, 2008)
What a great way to spend a fall afternoon.
A New Version of HttpWatch - 6.0The good folks at Simtec have released a new version of one of the tools in my toolbox - HttpWatch.
The biggest news is that HttpWatch now supports Firefox as well as Internet Explorer!
Here's the complete list of new features:
Check out HttpWatch at http://www.httpwatch.com/
See all the tools in my tool box at:
Odd Search TermsAs I have written before, I use StatCounter to track hits on this blog.
I like it because it's very simple to use, but also very powerful. And I find some of the results fascinating.
Among the features provided by StatCounter is a Keyword Analysis report.
Usually it's fairly obvious what the seearcher was looking for, but occasionally, I see a real puzzler.
I'll list some here as I encounter them, with a guess as to how the relevant search engine happened to serve up a link to All Things Quality in the results.
I assume the searcher was trying to find ways to crash browser. And they learned about crashing Google Chrome the easy way.
when are us elections november 4th When are the elections? November 4th, right? Note sure what this person was seeking, but they found this.
http://www.sqablogs.com/jstrazzere/1874/US+Elections+on+November+4th+-+Don%26%2339%3Bt+Vote%21.html
grandma mona simpson I occasionally use Simpsons character names as test data. To make that easier, I have a list on one of the blog pages.
http://www.sqablogs.com/jstrazzere/1692/Test+Data+-+Simpson+Characters.html
is yucart good for your While the searcher may have been looking for "yogurt", apparently this term brought the searcher to my post about some Spam that arrives in my email spam filter. One of the "from" names was "Yucart Churchgoing".
http://www.sqablogs.com/jstrazzere/973/Lazy+Spambots%3F.html
see: http://www.sqablogs.com/jstrazzere/832/A+New+Tool+for+Your+Website+or+Blog+-+StatCounter.html
Introducing TestalisDo you suffer from Testile Dysfunction? Are you no longer invited to Requirements or Design Review meetings because you ask important questions – questions where the responses are typically, “No customer will ever do that?” – Or – “Please confine yourself to testing and let us handle the design”? Are you depressed because every software build exposes R&D test neglect? These issues can lead to a serious condition known as Testile Dysfunction (TD), a condition in which you lose your enthusiasm for testing and all related test engineering activities. TD reduces your level of readiness when you are ultimately called upon to execute tests.
Could you be ready for that moment when that moment is right? When R&D hurls the next application build over the wall-of-distrust and all the developers run for shelter – could you be ready? Testalis® might be right for you. Testalis® can restore your enthusiasm for your role. Only you can decide if Testalis® is right for you. Before taking Testalis®, ask your test engineering lead if you should proceed with functional and regression test activity and be sure to tell your test engineering lead about any angst you may have with R&D and all soured relationships with R&D. Don't take Testalis® if you take Tiagra® as the combination can cause a sudden, rapid rise in defect-discovery output and clog your organization’s defect-handling process. Testalis® for daily use remains in your body for as long as you take it. Tell your test engineering lead about all medications, especially if you are going to attend any formal requirements or design review meetings, so your test engineering lead can be aware of potential review meeting conflicts.
Do drink alcohol in excess with Testalis®, as this will increase your funness, increase the illegibilty of your defect reports so they are rejected and thus bring you back into defect-discovery norms. Testalis® does not protect against intimately transmitted diseases, if engaging in these types of activities during testing. The most common side effect with Testalis® is too rapid of output of defect reports. Business and R&D complaints accompanied this anomalous behavior. As with any TD tablet, in the rare event of testing enthusiasm lasting more than 10 hours, seek out and imbibe multiples of the nearest alcohol beverages of choice in order to exude an increased level of funness, thus offsetting the ability to construct a coherent defect report. In rare instances, test engineers taking prescription Testile Dysfunction tablets (including Testalis®) reported a sudden interest in stepping down their careers to developing software. It's not possible to determine if these events are related directly to the Testile Dysfunction tablets or to other factors. If you have a sudden interest in developing software for a living, stop taking any ED tablet, including Testalis® and call your shrink right away. TESTALIS IS NOT FOR EVERYONE. Game Night at the OfficeIn my company, we've recently started a Game Night.
We take turns bringing in games. After hours, we grab a conference room, and play for an hour or so. It's been lots of fun so far, and helps create a nice bit of teamwork.
The games
Here are some we have played so far...
Foppen
Hit or Miss
Category 5
Gracias
Wyatt Earp
Trans America
Bohnanza
Tock
Uno Spin
Optimistic Developers, Pessimistic Testers
In my experience, developers tend to be optimistic folks, while testers tend to be more pessimistic.
I believe this is a good thing, a sort of checks-and-balances tension that makes for better software.
Optimistic Developer: There is no I in TEAM Pessimistic Tester: We can't spell BUGS without U Optimistic Developer: That's an "undocumented feature" Pessimistic Tester: That's a bug Optimistic Developer: I like to build things Pessimistic Tester: I like to break things Optimistic Developer: Sure, we can use the Beta version of this component in Production Pessimistic Tester: We should wait until version 2.1
Have any good Developer/Tester comparisons? Email Me Perhaps They Should Have Tested More - SkynetWhat's wrong with advanced artificial intelligence systems these days?
It's no surprise that self-aware systems will always turn on their creators - anyone could see that coming. But buggy robots? There's just no excuse.
Perhaps they should have tested more?
Oh wait, they still can! Just go back in time and do the testing that they should have done in the first place.
And if you can go back in time, why can't they go back and avoid the bugs altogether?
I guess the future just isn't what it used to be.
See:
{ Last Page } { Page 1 of 27 } { Next Page } |
About MeMy Profile Archives Friends My Photo Album LinksSQAForumsTesting Reflections SQA Training CategoriesRecent EntriesInteresting Interviewing IncidentsStopping Spammers! Spring (Fall) Cleanup! Your Thoughts on SQAblogs.com? 1st Entry.... FriendsrstensLynnem strazzerj jgottlieb JakeBrake jimhazen |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||