The Demons of Ambiguity

A few years back, there was a Dilbert cartoon where Dogbert would wave a wand and proclaim "Out Out!! You demons of stupidity!!" I don't typically have many problems with stupidity—the people I work with tend to be on the bright side—but I would love to have a wand like that to dispel ambiguities, because ambiguities plague my life. And they probably plague yours, too.

What Are We Talking About?
The main street in my town has a posted speed limit of 25 miles per hour. Near the local elementary school, however, there is a sign that says

The intent of the school zone is obviously to keep kids safe, but I find the sign ambiguous. Like almost everyone else in this situation, I simply drive slowly as I get near the school, but if I had to explain the school zone rules effectively to a computer, I would have to understand the rules much better.

• Why does the sign use the plural "children" instead of the singular "child"? Does the rule only apply if more than one child is present?
• Who qualifies as a "child"? What would happen if I drove past a 17-year-old at 25 mph?
• What does it mean to be "present"? A child walking along the sidewalk is certainly present, but what if the child was behind a fence?
• Does this rule apply only when school is in session? What about weekends? Holidays? Nighttime?
• And what if these situations are combined: two 17-year-olds behind a fence in a school zone on a summer weekend night? Well, maybe that's a whole different story ...

I could, of course, drive back and forth to test out each of these situations, but it would be a lot cheaper to find out the answers without having the police pull me over.

Have You Helped Someone to Think Clearly Today?
One of the most useful things a tester can do is ask good questions early in the software development process to help the rest of the team members to think clearly about what they're doing.

I recently helped someone design a utility to start and stop a service on a remote machine. Even this simple utility yielded several good questions:

• What happens if you send a "start" request to a service that is already running, or a "stop" request to a service that is not running?
• What if the remote machine reboots - does a running service automatically restart?
• What happens if the connection drops when you are sending your request? Does the utility return an error message, or does it retry? How many times does it retry?

Asking these questions up front saved us from misunderstandings and bugs later in the process that could have required substantial rework.

Driving Out Your Own Demons
Here are some simple heuristics to help you drive out the ambiguities you encounter.

• Dissect the description. Are the words open to different interpretations? The book Exploring Requirements by Weinberg and Gause uses this approach to twist the phrase Mary had a little lamb into everything from Mary ate a small portion of mutton to Mary conned the naïve stock trader. The authors state that "although the nursery rhyme example may seem silly, we've used this heuristic for years in reviewing requirements documents, and it has often saved vast sums of money." (p.95)
• Poke at the borders. Terms often map imperfectly onto each other, so find the fuzzy areas. For instance, in the remote service example, how will we check that a service is running? Are we checking a flag somewhere? Could that flag be improperly set to indicate that the service is running when it really isn't?
• Walk through an example. Scenarios are very powerful tools because they present a concrete situation rather than vague abstractions. Testers particularly shine in thinking up error scenarios. What if the connection drops? What if the customer enters something incorrectly? What if the disk is full? What happens if I pull out this cable?
• Get others involved. You should be not only a source of good questions, but an inspiration for good questions from others. Developers, for instance, have a different perspective and often think of questions testers might not. Once you begin to ask the "what happens if" questions, others will find themselves joining in.

Inquiring Minds
If you work for a team where the testers are brought in late in the cycle to test software that is almost finished, this question asking may seem a strange role for testers. But it is one of the most valuable activities a tester can do. My favorite tester story involves Human Resources at some company asking the requirements team, the development team, and the test team to write a 100-word description of what they did. The first two groups complied with typically boring statements. The testers sent back the following note:

Who is this description intended for? Why do you need this? When do you need this? What language do you want this in? Do you want to include only full-time testers? How about contractors? Why is it important that it be 100 words? Is that a lower limit or an upper limit? How do you want to count the words? Do hyphenated words count as one word or two? What format should this be in?

What a great reply! Rather than merely describe what testers do; it showed testers in action!

How Much Is Enough?
You may argue that some of these questions are too picky and lawyerly. And you may be right. Perhaps we don't care about all the details, but we do care about having enough details so that we understand what we're talking about and don't make too many costly mistakes. As long as the questions are asked, we are aware of the issues even if they get tabled for future discussion.

And you never can tell who will come to your defense in asking seemingly picky questions. At a spec review a few months ago, one tester was drilling down on some functionality when the spec writer said dismissively that such questions were too picky. There was a hush in the room until the developer on the feature spoke up "No, it's not too picky at all. The requirement is ambiguous. I want to know what it means so I don't have to guess and end up rewriting the code several times." It was a great moment—an unambiguous vote for clarity and quality!

Further Reading:

Exploring Requirements by Gerald Weinberg and Donald Gause
In Other Words by Marc Rene and Kathy Walker