Posts in Software Testing
Parallel Testing
Because I'm suspicious of all software (comes with the territory of being a tester I guess), over the weekend I decided to check my credit report to see exactly what I had on my record. I do a lot online (purchasing, bill-pay, etc...) and I'm somewhat paranoid about security and identity theft, because I know how easy it is to crack most security and/or gather someone's personal information.

If one wants to check their credit report here in the states, they can contact any of the three credit bureaus: Equifax, Experian, or TransUnion. Any one of these will provide you with your information according to them, and if you get a report from all three, you get your complete credit history and outlook. All three websites offer a 3 in 1 credit report service, where they contact the other agencies for you and compile a complete report (for a small fee of course).

Not having a preference, I decided to purchase from the first website I checked, which happened to be Experian. I filled out the form online, clicked submit, and was rewarded with an error. "Your information cannot be processed at this time. Please contact us at the following number for more information."

Ok, I thought. I picked up the phone and called. Once on the phone, I confirmed all the information I had entered and the operator attempted to reprocess the request. No good. I was instructed that my information was "too different between the three companies to be reconciled automatically" and that I would have to contact each company individually to gather all of my information. Have a great day. -- Phooey!

Well, what a great opportunity for a parallel test! I clicked over to the next website, Equifax, and filled out their application. I entered all the same information (in a screen that looked much like the previous one) and clicked submit. Behold! I was rewarded with my credit report!

This tells me several things about the companies and the software they use. All of these assumptions are based on the underlying assumption that my specific problem was the result of a defect in the software and not some random malfunction in Experian's hardware or some other failure unrelated to the software. This is all purely speculation based on one test. Take it for what it's worth.
  1. While the services they use looks to be the same service, it must not be, or if it is it must be customized in some way.

  2. Experian could have noticed my problem by running a series of parallel tests using their competitors web services. Apparently, they did not.

  3. Experian's manual process resulted in the same error as their online process, so I assume it is in fact, not a separate process. That seems odd.

  4. Reviewing my credit data between the two companies, there is in fact little to no difference, most of the differences are with TransUnion. This could mean that Experian's process had trouble reconciling TransUnion's data while Equifax did not.

  5. I should also concider that the problem may not be Experian's, but could in fact be Equifax's. If Equifax's web service that provides information is down, then Experian's service would fail, while Equifax's might not (it probably does not use it's own service).

I could probably come up with more, but without knowing more information and not being in a position to actually work on the problem, it's most likely a wasted effort. I do find it interesting however that a simple parallel test exposed this problem. I would have thought a parallel would be the most extensive testing they would execute, as they have two competitors offering the exact same product (which even uses their data).



One has to wonder how things like this get by...

Sometimes the Magic Works
I recently finished the book "Sometimes the Magic Works: Lessons from a Writing Life" by Terry Brooks. Not only is this an excellent book on writing, but more important to this blog, it is a phenomenal look at the creative and exploratory process. The following is an example:

"I know enough about the world to appreciate that the one constant in life is change. But change does not happen without imagination. Progress occurs not because we remain satisfied with what is, but because we hunger for what might be. We are always looking to take that next step. But the next step begins with looking beyond the possible to the impossible - because what seems impossible to us today becomes commonplace tomorrow. It is one of the primary lessons of the world, and it has its roots firmly embedded in the fertile loam of our recognition and celebration of the importance of the imagination."


Or perhaps if you were more interested in mentoring others:

"...then I must give him a chance to discover this truth on his own. I must encourage, not discourage, his use of imagination. I must remember that not only must I not close off the possibilities he chooses to explore - whether I believe them realistic or not - but I must encourage him to find a way to open the locked doors that bar his way."


Or possibly you desire to learn more about change, and advocating change:

"...I am as likely as the next person to fall under the sway of the world's overarching desire to remove the large part of life's nagging doubts by embracing the norm. As much as the next person, I seek reassurance that some things are dependably constant. I want a modicum of stability in my life. I want a sense of security and control. Using the imagination can stir up trouble. Challenging the status quo of things sometimes evokes unnecessary concerns about what we've always accepted as true."


Within the book, Terry Brooks gives one of the best descriptions I have read on the exploratory process. I found the book a warm contrast too much of the cooler - more analytical writings on the topic.

The book spans his fiction career (which may or may not interest you), his writing technique (which I would imagine intrigues most of you if you write blogs on a regular basis), and some of the relationships in his life where he tries to simultaneously learn, engage the creative process, and mentor or write (which to some of you may sound similar to simultaneous learning, test design and test execution).

If you are looking for an entertaining and imaginative book that will help with both your writing and your testing, give this one a try.