Conference Presentations

Testing XML Documents for Information Content

More and more applications are generating XML documents as their primary or secondary outputs because XML is much easier to parse than traditional formats. However, simple string comparison is often too naïve to properly test XML documents. Instead, they must be evaluated for information content. XML has many syntactic options that make testing output more difficult than testing traditional, less rich formats. Elliotte Rusty Harold explores the challenges and pitfalls of testing XML documents and, even more importantly, offers suggestions of what to check and what to ignore. He presents valuable tools for testing XML-parsers, schemas, DTDs, canonical XML, and XPath--and discusses automating tests by writing xUnit test cases that use XML APIs such as DOM to compare the actual to the expected output.

Elliotte Harold, Polytechnic University
Let's End the Defect Report-Fix-Check-Rework-Cycle

Find out how teams transitioning to Agile practices must re-think their workflows and project metrics originally designed to handle many hundreds of defect reports that occur in typical testlast development cycles. Richard Leavitt discusses how a real-world implementation of key practices like early testing and continual integration-though not without bumps and bruises-lowered the number of open defect reports by an order of magnitude. These practices also can improve how the team communicates, reduce delays, and provide more direct measures of project status, feature progress, and release readiness.

Richard Leavitt, Rally Software Development
The Next Stop in Test Automation: Test Environment Setup

To achieve the most effective test automation, you need to go beyond automated test case creation and implement automated environment setup. In tracking the testing time spent over several projects, the Clustering group Amit Mathur worked with found that more staff time was being spent on setup than on actual testing. He discusses and demonstrates the Environment Configuration System (ECS) his group developed to automatically set up test environments and trigger automated test execution. Find out how ECS has dramatically improved the ability to automate many more manual tests. ECS employs a scripting language (Perl) and libraries for environment setup and test cases. Based on interface specifications and dependency rules, ECS bundles environment setups and test cases for complex test scenarios. Learn how you can adapt the ECS approach for your applications and environment.

Amit Mathur, VERITAS Software Corporation
Systematic Techniques for Fault Detection and Isolation

Selecting the appropriate testing techniques and test cases improves test efficiency, reduces time to market, and gives you confidence that the system is ready to ship. Using real-world case studies as examples, Madhav Phadke explains the fundamentals of robust test case selection and how code coverage can improve your test results. He discusses ways for testers to support debugging and faster repairs by isolating defects to a specific part of the software. Learn to select test outputs based on "total function evaluation" rather than end customer outputs and ways to use orthogonal arrays for testing combinations of parameters. Take away a list of free or inexpensive tools that can speed up your testing process.

Madhav Phadke, Phadke Associates
How Much Building Is Too Much?

Staged integration versus continuous integration—which does your team prefer? Can't decide if one is better than the other? In this column, Johanna Rothman explains that you can create the perfect blend of the two. Developers and testers benefit from frequent builds, but be careful with how much you build. Build too much or too little and a project could topple.

Johanna Rothman's picture Johanna Rothman
A Look at Canoo WebTest

Need to get the scoop on the latest software tests and trends? You've come to the right place. Get one reviewer's opinion of Canoo WebTest, an open source tool that supports Web application development through test automation.

Lisa Crispin's picture Lisa Crispin
Journey to Test Automation Maturity

Organizations that want to automate their testing generally go through a number of stages before they reach maturity. Whether you are about to begin your journey or are well under way, it is important to know where you are going and where you could go. In automating test execution, many organizations stop short of achieving their maximum benefits. This presentation looks at six levels of maturity in test automation and includes a self-assessment test to see where you are. It is important to have good objectives and realistic plans to achieve them. But in automating testing, these often seem very plausible at first but are not well expressed or are unrealistic. This presentation covers typical problems and examples of unrealistic automation plans and objectives. Leave with advice to help you have a successful journey to test automation.

Dorothy Graham, Grove Consultants
STARWEST 2005: Interpersonal Skills for Working with Business Stakeholders

As a professional test manager or test engineer, you must keep up with the latest test techniques, management practices, and systems technologies. But that is not enough. You also must interact with-and more importantly learn to influence-executive managers and other non-technical project stakeholders. Even today in many companies, testing and test management are not well understood and are under-appreciated by non-technical people. Now is the time for you to take action and do more than simply "get along" in your organization. Join Robert Sabourin for a lively session on developing your interpersonal skills, including the skills of communication, persuasion, problem solving, and teamwork. Discover new ways to work harmoniously with non-technical people while efficiently and effectively getting your important testing job done.

Robert Sabourin, AmiBug.com Inc
The Venerable Triangle Redux

Jerry Weinberg's venerable triangle problem has been around since 1966 and was popularized in Glenford Myers' book The Art of Software Testing. To assess a tester's effectiveness, many software companies have used the triangle problem as an interview question. But, past studies indicate testers' effectiveness at solving the problem is relatively low. Recent studies by noted experts indicate that a significant number of testers in the industry lack formal training in software testing techniques. Over a three-year period Microsoft conducted several experiments to accurately quantify the effectiveness of testers with different years of experience and skill.

William Rollison, Microsoft Corporation
Risk: The Testers Favorite Four Letter Word

Identifying risk is important-but managing risk is vital. Good project managers speak the language of risk, and their understanding of risk guides important decisions. Testers can contribute to an organization's decision making ability by speaking that same language. Learn from Julie Gardiner how to evaluate risk in both quantitative and qualitative ways. Julie will discuss how to deal with some of the misconceptions managers have about risk-based testing including: Testing is always risk-based. Risk-based testing is nothing more than prioritizing tests. Risk-based testing is a one-time-only activity. Risk-based testing is a waste of time. And risk-based testing will delay the project.

Julie Gardiner, QST Consultants Ltd.

Pages

AgileConnection is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.