Damm! just now that we ordered the book just to find out what a Fex-Ex our was about. Anyway, Mr. Whittaker's book is a must have for all of us who (still) do manual exploratory testing.Salute!btw. don't you test Windows Mobile devices? Last time I checked out there was a lot of people (still) using those phones.
I loved this demonstration at Star. Complicated systems seem best automated to my by automating subsystems as well. I can't get my head around trying to automate some of the complex systems the I deal with every day. I am interested in automated components that I can string together to create more complex and varied tests.
>>> Tours tell me to focus on testing the parts that drive the car, rather than on whether or not the car drives.Is this same as saying - focus on what engine does, what gearbox does or what suspension system does - while not worrygin about whether some can actually drive the car? If yes ... then it reminds me of unit testing -- check class/component in isolation and simulate and excercise all posible interactions.What is different in tours? Unit/subsystem/component focus is old ...>>> The real value add of the tours comes from the fact that they guide me in testing those different parts and help me analyze how different capabilities inter-operate. Cars will always drive you off the lot, which part will break first is the real question.I don't think how can you related this (knowing which part will break, how do they interact) to "Tours".. Something that is not clear from your post. I did not attend your STAR presentation ... hence do not have the complete picture.>> As a system it's devilishly complicated, hard to automate and hard to find the right combination of factors to make it fail. What was your biggest problem "hard to automate" or "hard to test" ... I know, in google testing = automate.>>> It's exactly what a mechanic does when trying to diagnose a problem: he employs different strategies for testing/checking each mechanical subsystem.No.. I disagree. A mechanic uses his skill to zero in on the path of clue to follow. Notice the focus is on "Human, his sapience and skill" - A mechanic will not (normally) put a probe in the engine and wait for some light to blow that indicates problem. That is automation focus.>>> Exploratory Testing ... it's not just for manual testers anymore!Do not make this mistake of taking sapient Human from the scene and glorify automation. It like saying "Heart Surgery - not by human doctors any more" (I have heard claims of some robot assisted surgeries though).Automated Exploratory Testing is an oxymoron !!!!
Nice analysis, Rajat. This seems like an example of the "crowdsourcing" method. That seems to me to be an excellent approach for the testing of the complex mobile space. I'd like to add you can also increase automation by employing Monte Carlo methods. That is, generate inputs that model real-world input. Since the real-world can be considered stochastic you can simulate that my adding randomness that selects points from the, possibly infinite, input field and applying those to a test case.The problem then becomes how to detect unexpected results.
The comments you read and contribute here belong only to the person who posted them. We reserve the right to remove off-topic comments.