Conference Presentations

Don't Be the Quality Gatekeeper: Just Hold Up the Mirror

One of the greatest temptations of test managers and their teams is to be the quality gatekeeper-the ones who raise the gate when testing reveals little and keep it closed when they believe that defects (found and unfound) risk the project. Invariably, this role creates an expectation from stakeholders that if the release fails or a major flaw occurs in production, the test team is at fault. Based on his sometimes-painful experiences, Mfundo Nkosi shares his insights on how testing teams can maintain credibility and increase their influence by holding a mirror up to the project rather than becoming the quality police. Mfundo describes the process of maintaining a risks and issues log, writing an informative test closure report, and clearly communicating status-the good and the bad-in a non-threatening way.

Mfundo Nkosi, Micro to Mainframe
Patterns for Test Asset Reusability

Typically, testers write a test case for the one component and sub-system they are testing, thus limiting its value. What if you could repurpose and reuse previously developed test assets across several components and sub-systems? Vishal Chowdhary shares three test patterns he has encountered many times while testing various .NET Framework components at Microsoft. The “Test One, Get One Free” pattern describes how to test features that are layered-where a feature enhances an inner core feature. The “Features Get Tested Alike” pattern describes how to test similar features that are exposed via different interfaces to the user (e.g., through an API vs. the user interface). The “Standing on the Shoulders of Giants” pattern lays down design guidelines to optimally build reusable components that can be leveraged between feature teams testing large software products.

Vishal Chowdhary, Microsoft Corporation
The Power of the Crowd: Mobile Testing for Scale and Global Coverage

Crowdsourced testing of mobile applications, a middle ground between in-house and outsourced testing, has many advantages: scale, speed, coverage, lower capital costs, reduced staffing costs, and no long-term commitments. However, crowdsourced testing of any application-mobile or not-should augment your professional testing resources, not replace them. Most importantly, crowdsourced testing has to be done well or it’s a waste of time and money. John Carpenter reviews the applications and ways he’s outsourced testing to the crowd. Focusing on adopting crowdsourcing for both functional and usability testing in mobile applications, John describes scenarios in which you can leverage the crowd to lower costs and increase product quality, including scaling the application to large populations of global users.

John Carpenter, Mob4Hire, Inc.
Agile Testing: Facing the Challenges Beyond the Easy Contexts

Don't let anyone tell you otherwise-doing testing well on agile teams is hard work! First, you have to get management over the misconception that you don't need specialist testers within agile teams. Next, you have to integrate testers with the developers and provide holistic, high quality results. Those are just the easy challenges you face. Then, comes the hard part! Bob Galen explores more difficult agile testing contexts-how to attack a total lack of test automation, how to remain agile in highly regulated environments, how to serve your PMO or Testing COE while remaining agile, how to organize testing when your agile team is globally dispersed, how to blend traditional testing processes with their agile counterparts, and more. If you're in a difficult testing context within an agile development environment, come and join the conversation. You'll find examples and options, but no silver bullets. Remember-it's HARD!

Bob Galen, iContact
Testing Dialogues: Automation Issues

What problems are you facing in test automation right now? Just getting started? Trying to choose the right tool set? Working to convince executive managers of the value of automation? Dealing with excessive maintenance of scripts? Worrying about usability and security testing? Something else? Based on the problems and topics you and fellow automators bring to this session, Dorothy Graham and Mieke Gevers, both experienced test automation experts, will explore many of the most vexing test automation issues facing testers today. Join with other participants in small groups to discuss your situation, share your experiences, learn from your peers, and get the experts’ views from Dorothy and Mieke. As you learn and share, each group will create a brief presentation to give at the conclusion of the session.

Dorothy Graham, Consultant
Go Sleuthing with the Right Test Technique

Although much information is available on test design techniques, very little is written on how to select which techniques to use for the job at hand. Derk-Jan de Grood believes that many testers find it difficult to select the right techniques and very often use a technique simply because they know it. Instead, the best reason is that the technique is likely to discover the most important errors quickly. Derk-Jan shares his insights on test technique selection and poses three questions you should ask yourself when selecting a technique: What types of errors do I want to find? What impact do these errors have in production? Is the needed information to perform these tests available? He then lays out a list of common test techniques and discusses which error types they are most likely to discover. Take back a new understanding of test technique choice and selection to become a better software defect sleuth.

Derk-Jan de Grood, Valori
Taking Your Testing Team Global

With pressure to downsize local teams in favor of offshore or outsourced testing, you may be faced with taking your team global. Jane Fraser discusses the good, the bad, and the ugly of having to outsource or offshore testing. She talks about the pitfalls of hiring across cultures, such as when “Yes” means “We don't understand, but we'll try.” Jane shares ways to maintain your team processes and standards with a distributed team. She examines the issues and benefits of insourcing and outsourcing-and the difference between the two. Using her experience setting up insourced offices in China and India, and outsourced offices in Argentina, Vietnam, India, and China, Jane shares her transition plan to move 70% of her main development studio to five countries around the world. Whether you decide to offshore testing or it's decided for you, join Jane to discover how to successfully transfer some or all of your testing to a remote team.

Jane Fraser, Electronic Arts
Stick a Fork in It: Defining Done

It seems that developers have as many definitions of “done” as Eskimos have words for “snow.” But without a clear definition of done, it is difficult to gauge progress on a project. Menlo Innovations has a simple solution. Instead of declaring a story card or feature done on its own, developers collaborate with the business analyst and testing teammates to determine when the application meets their requirements. Tracy Beeson highlights the power of asking one deceptively simple question that has multiple, complex answers that can, if not implemented with care, upset the status quo and lead to new problems. Using loosely orchestrated role playing, you'll practice this approach for discovering when done is really done.

Tracy Beeson, Menlo Innovations
Test as a Service: A New Architecture for Embedded Systems

The classic models adopted in test automation today-guaranteeing ease of test implementation rather than extendibility of the test architecture-are inadequate for the unprecedented complexity of today’s embedded software market. Because many embedded software solutions must be designed and developed for multiple deployments on different and rapidly changing hardware platforms, testers need something new. Raniero Virgilio describes a novel approach he calls Test as a Service (TaaS), in which test logic is implemented in self-consistent components on a shared test automation infrastructure. These test components are deployed at runtime to make the test process completely dynamic. The TaaS architecture provides specific high-level test services to testers as they need them.

Raniero Virgilio, Intel
Testing with Virtual Machines: Past, Present, and Future

In the past several years, virtualization has dramatically improved tester productivity. A virtual machine is a useful abstraction for encapsulating the entire software stack. Roussi Roussev presents proven techniques that no modern test environment is complete without. Running multiple virtual machines on a single host maximizes hardware resource utilization and reduces operating costs. Strong isolation facilitates building security testing and multi-tenant environments. With the help of snapshots, virtual machines can quickly travel in time and space. Virtual hardware makes simulating machine, cluster or entire datacenter failure scenarios a whole lot easier. Deterministic record/replay helps track hard to reproduce bugs, comparing outputs allows for measuring the impact of small configuration and binary changes.

Roussi Roussev, VMware

Pages

AgileConnection is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.