How We Test Software at Microsoft

Author: Alan Page
Publisher: Microsoft Press
ISBN: 9780735638310
Release Date: 2008-12-10
Genre: Computers

It may surprise you to learn that Microsoft employs as many software testers as developers. Less surprising is the emphasis the company places on the testing discipline—and its role in managing quality across a diverse, 150+ product portfolio. This book—written by three of Microsoft’s most prominent test professionals—shares the best practices, tools, and systems used by the company’s 9,000-strong corps of testers. Learn how your colleagues at Microsoft design and manage testing, their approach to training and career development, and what challenges they see ahead. Most important, you’ll get practical insights you can apply for better results in your organization. Discover how to: Design effective tests and run them throughout the product lifecycle Minimize cost and risk with functional tests, and know when to apply structural techniques Measure code complexity to identify bugs and potential maintenance issues Use models to generate test cases, surface unexpected application behavior, and manage risk Know when to employ automated tests, design them for long-term use, and plug into an automation infrastructure Review the hallmarks of great testers—and the tools they use to run tests, probe systems, and track progress efficiently Explore the challenges of testing services vs. shrink-wrapped software

How We Test Software at Microsoft

Author: Alan Page
Publisher: Microsoft Press
ISBN: 0735624259
Release Date: 2009
Genre: Computers

Looks at the process, tools, and systems used by Microsoft's software testers.

How We Test Software at Microsoft

Author: Alan Page
Publisher: "O'Reilly Media, Inc."
ISBN: 9780735638310
Release Date: 2009-11-30
Genre: Computers

It may surprise you to learn that Microsoft employs as many software testers as developers. Less surprising is the emphasis the company places on the testing discipline—and its role in managing quality across a diverse, 150+ product portfolio. This book—written by three of Microsoft’s most prominent test professionals—shares the best practices, tools, and systems used by the company’s 9,000-strong corps of testers. Learn how your colleagues at Microsoft design and manage testing, their approach to training and career development, and what challenges they see ahead. Most important, you’ll get practical insights you can apply for better results in your organization. Discover how to: Design effective tests and run them throughout the product lifecycle Minimize cost and risk with functional tests, and know when to apply structural techniques Measure code complexity to identify bugs and potential maintenance issues Use models to generate test cases, surface unexpected application behavior, and manage risk Know when to employ automated tests, design them for long-term use, and plug into an automation infrastructure Review the hallmarks of great testers—and the tools they use to run tests, probe systems, and track progress efficiently Explore the challenges of testing services vs. shrink-wrapped software

How Google Tests Software

Author: James A. Whittaker
Publisher: Addison-Wesley Professional
ISBN: 9780321803023
Release Date: 2012
Genre: Computers

Describes the techniques Google uses to test their software, and offers similiar techniques for analyzing risk and planning tests, allowing an Internet company to become more productive.

Software Testing with Visual Studio 2010

Author: Jeff Levinson
Publisher: Pearson Education
ISBN: 013218060X
Release Date: 2011-02-07
Genre: Computers

Use Visual Studio 2010’s Breakthrough Testing Tools to Improve Quality Throughout the Entire Software Lifecycle Together, Visual Studio 2010 Ultimate, Visual Studio Test Professional 2010, Lab Management 2010, and Team Foundation Server offer Microsoft developers the most sophisticated, well-integrated testing solution they’ve ever had. Now, Microsoft MVP and VS testing guru Jeff Levinson shows exactly how to use Microsoft’s new tools to save time, reduce costs, and improve quality throughout the entire development lifecycle. Jeff demonstrates how Microsoft’s new tools can help you finally overcome long-standing communication, coordination, and management challenges. You’ll discover how to perform first-rate functional testing; quickly create and execute tests and record the results with log files and video; and create bugs directly from tests, ensuring reproducibility and eliminating wasted time. Levinson offers in-depth coverage of Microsoft’s powerful new testing metrics, helping you ensure traceability all the way from requirements through finished software. Coverage includes • Planning your tests using Microsoft Test Manager (MTM) • Creating test settings, structuring test cases, and managing the testing process • Executing manual tests with Microsoft Test Manager and Test Runner • Filing and resolving bugs, and customizing your bug reporting process • Automating test cases and linking automated tests with requirements • Executing automated test cases through both Visual Studio and Microsoft Test Manager • Integrating automated testing into the build process • Using Microsoft’s Lab Management virtualization platform to test applications, snapshot environments, and reproduce bugs • Implementing detailed metrics for evaluating quality and identifying improvements Whether you’re a developer, tester, manager, or analyst, this book can help you significantly improve the way you work and the results you deliver—both as an individual right now, and as a team member throughout your entire project.

Beautiful Testing

Author: Adam Goucher
Publisher: "O'Reilly Media, Inc."
ISBN: 9781449388683
Release Date: 2009-10-14
Genre: Computers

Successful software depends as much on scrupulous testing as it does on solid architecture or elegant code. But testing is not a routine process, it's a constant exploration of methods and an evolution of good ideas. Beautiful Testing offers 23 essays from 27 leading testers and developers that illustrate the qualities and techniques that make testing an art. Through personal anecdotes, you'll learn how each of these professionals developed beautiful ways of testing a wide range of products -- valuable knowledge that you can apply to your own projects. Here's a sample of what you'll find inside: Microsoft's Alan Page knows a lot about large-scale test automation, and shares some of his secrets on how to make it beautiful Scott Barber explains why performance testing needs to be a collaborative process, rather than simply an exercise in measuring speed Karen Johnson describes how her professional experience intersected her personal life while testing medical software Rex Black reveals how satisfying stakeholders for 25 years is a beautiful thing Mathematician John D. Cook applies a classic definition of beauty, based on complexity and unity, to testing random number generators All author royalties will be donated to the Nothing But Nets campaign to save lives by preventing malaria, a disease that kills millions of children in Africa each year. This book includes contributions from: Adam Goucher Linda Wilkinson Rex Black Martin Schröder Clint Talbert Scott Barber Kamran Khan Emily Chen Brian Nitz Remko Tronçon Alan Page Neal Norwitz Michelle Levesque Jeffrey Yasskin John D. Cook Murali Nandigama Karen N. Johnson Chris McMahon Jennitta Andrea Lisa Crispin Matt Heusser Andreas Zeller David Schuler Tomasz Kojm Adam Christian Tim Riley Isaac Clerencia

Testing for Continuous Delivery with Visual Studio 2012

Author: Larry Brader
Publisher: Microsoft patterns & practices
ISBN: 1621140180
Release Date: 2013-03
Genre:

As more software projects adopt a continuous delivery cycle, testing threatens to be the bottleneck in the process. Agile development frequently revisits each part of the source code, but every change requires a re-test of the product. While the skills of the manual tester are vital, purely manual testing can't keep up. Visual Studio 2012 provides many features that remove roadblocks in the testing and debugging process and also help speed up and automate retesting. This guide shows you how to record and play back manual tests to reproduce bugs and verify the fixes, transform manual tests into code to speed up re-testing, monitor your project in terms of tests passed, create and use effective unit tests, load, and performance tests, run build-deploy-test workflows on virtual lab environments, and evolve your testing process to satisfy the demands of agile and continuous delivery. You'll learn how to set up all the tools you need for testing in Visual Studio 2012 and 2010, including Team Foundation Server, the build system, test controllers and agents, SCVMM and Hyper-V. Each chapter is structured so that you can move gradually from entry-level to advanced usage.

The Art of Software Testing

Author: Glenford J. Myers
Publisher: John Wiley & Sons
ISBN: 9781118133156
Release Date: 2011-09-23
Genre: Business & Economics

The classic, landmark work on software testing The hardware and software of computing have changed markedly in the three decades since the first edition of The Art of Software Testing, but this book's powerful underlying analysis has stood the test of time. Whereas most books on software testing target particular development techniques, languages, or testing methods, The Art of Software Testing, Third Edition provides a brief but powerful and comprehensive presentation of time-proven software testing approaches. If your software development project is mission critical, this book is an investment that will pay for itself with the first bug you find. The new Third Edition explains how to apply the book's classic principles to today's hot topics including: Testing apps for iPhones, iPads, BlackBerrys, Androids, and other mobile devices Collaborative (user) programming and testing Testing for Internet applications, e-commerce, and agile programming environments Whether you're a student looking for a testing guide you'll use for the rest of your career, or an IT manager overseeing a software development team, The Art of Software Testing, Third Edition is an expensive book that will pay for itself many times over.

Visual Studio Team Foundation Server 2012

Author: Sam Guckenheimer
Publisher: Addison-Wesley
ISBN: 9780133119183
Release Date: 2012-09-11
Genre: Computers

Use Visual Studio® Team Foundation Server 2012 and Agile Methods to Deliver Higher Value Software Faster This is the definitive guide to applying agile development and modern software engineering practices with Visual Studio Team Foundation Server 2012—Microsoft’s complementary Application Lifecycle Management (ALM) platform. Written by the Microsoft Visual Studio product owner and a long-time Team Foundation Server implementation specialist, it focuses on solving real development challenges, systematically eliminating waste, improving transparency, and delivering better software more quickly and painlessly. Coverage includes • Accelerating the “flow of value” to customers, with a transparent backlog, PowerPoint Storyboarding, VS 2012 feedback requests, and a “usability lab” right into your customers’ hands • Driving quality upstream to uncover hidden architectural patterns, ensure cleaner code, fix multiple recurring “cloned” bugs at once, ensure the definition of done with continuous integration and deployment in a reliable build process • Eliminating “no repro” bugs with VS 2012’s six powerful mechanisms for more accurate fault identification and use of virtualized test environments • Using Scrum or other Agile methods with Process Templates effectively across distributed teams in large organization by automating burndowns and dashboards to identify “early warning signals” of emerging problems with quality or maintainability • Staying in the groove by storing the state of your work and environment with shelvesets, to let you handle interruptions smoothly • Leveraging VS 2012’s new support for multiple Microsoft and open source unit testing frameworks in your IDE and continuous integration pipeline • Performing exploratory testing to uncover bugs in surprising places and testing immersive Windows 8 apps • Rapidly improving team development and collaboration with the hosted Team Foundation Service Whatever your development role, this book will help you apply modern software development practices using Visual Studio Team Foundation Server 2012 to focus on what really matters: building soft­ware that begins delivering exceptional value sooner and keeps delighting customers far into the future.

How to Break Web Software

Author: Mike Andrews
Publisher: Addison-Wesley Professional
ISBN: 0321657519
Release Date: 2006-02-02
Genre: Computers

Rigorously test and improve the security of all your Web software! It’s as certain as death and taxes: hackers will mercilessly attack your Web sites, applications, and services. If you’re vulnerable, you’d better discover these attacks yourself, before the black hats do. Now, there’s a definitive, hands-on guide to security-testing any Web-based software: How to Break Web Software. In this book, two renowned experts address every category of Web software exploit: attacks on clients, servers, state, user inputs, and more. You’ll master powerful attack tools and techniques as you uncover dozens of crucial, widely exploited flaws in Web architecture and coding. The authors reveal where to look for potential threats and attack vectors, how to rigorously test for each of them, and how to mitigate the problems you find. Coverage includes · Client vulnerabilities, including attacks on client-side validation · State-based attacks: hidden fields, CGI parameters, cookie poisoning, URL jumping, and session hijacking · Attacks on user-supplied inputs: cross-site scripting, SQL injection, and directory traversal · Language- and technology-based attacks: buffer overflows, canonicalization, and NULL string attacks · Server attacks: SQL Injection with stored procedures, command injection, and server fingerprinting · Cryptography, privacy, and attacks on Web services Your Web software is mission-critical–it can’t be compromised. Whether you’re a developer, tester, QA specialist, or IT manager, this book will help you protect that software–systematically.

Practical Model Based Testing

Author: Mark Utting
Publisher: Elsevier
ISBN: 0080466486
Release Date: 2010-07-27
Genre: Computers

Practical Model-Based Testing gives a practical introduction to model-based testing, showing how to write models for testing purposes and how to use model-based testing tools to generate test suites. It is aimed at testers and software developers who wish to use model-based testing, rather than at tool-developers or academics. The book focuses on the mainstream practice of functional black-box testing and covers different styles of models, especially transition-based models (UML state machines) and pre/post models (UML/OCL specifications and B notation). The steps of applying model-based testing are demonstrated on examples and case studies from a variety of software domains, including embedded software and information systems. From this book you will learn: The basic principles and terminology of model-based testing How model-based testing differs from other testing processes How model-based testing fits into typical software lifecycles such as agile methods and the Unified Process The benefits and limitations of model-based testing, its cost effectiveness and how it can reduce time-to-market A step-by-step process for applying model-based testing How to write good models for model-based testing How to use a variety of test selection criteria to control the tests that are generated from your models How model-based testing can connect to existing automated test execution platforms such as Mercury Test Director, Java JUnit, and proprietary test execution environments Presents the basic principles and terminology of model-based testing Shows how model-based testing fits into the software lifecycle, its cost-effectiveness, and how it can reduce time to market Offers guidance on how to use different kinds of modeling techniques, useful test generation strategies, how to apply model-based testing techniques to real applications using case studies

Lessons Learned in Software Testing

Author: Cem Kaner
Publisher: John Wiley & Sons
ISBN: 9781118080559
Release Date: 2011-08-02
Genre: Computers

Decades of software testing experience condensed into the most important lessons learned. The world's leading software testing experts lend you their wisdom and years of experience to help you avoid the most common mistakes in testing software. Each lesson is an assertion related to software testing, followed by an explanation or example that shows you the how, when, and why of the testing lesson. More than just tips, tricks, and pitfalls to avoid, Lessons Learned in Software Testing speeds you through the critical testing phase of the software development project without the extensive trial and error it normally takes to do so. The ultimate resource for software testers and developers at every level of expertise, this guidebook features: * Over 200 lessons gleaned from over 30 years of combined testing experience * Tips, tricks, and common pitfalls to avoid by simply reading the book rather than finding out the hard way * Lessons for all key topic areas, including test design, test management, testing strategies, and bug reporting * Explanations and examples of each testing trouble spot help illustrate each lesson's assertion

Showstopper

Author: G. Pascal Zachary
Publisher: Open Road Media
ISBN: 9781480494848
Release Date: 2014-04-01
Genre: Business & Economics

Showstopper is the dramatic, inside story of the creation of Windows NT, told by Wall Street Journal reporter G. Pascal Zachary. Driven by the legendary David Cutler, a picked band of software engineers sacrifices almost everything in their lives to build a new, stable, operating system aimed at giving Microsoft a platform for growth through the next decade of development in the computing business. Comparable in many ways to the Pulitzer Prize–winning book The Soul of a New Machine by Tracy Kidder, Showstopper gets deep inside the process of software development, the lives and motivations of coders and the pressure to succeed coupled with the drive for originality and perfection that can pull a diverse team together to create a program consisting of many hundreds of thousands of lines of code.

Visual Studio Team System

Author: James W. Newkirk
Publisher: Pearson Education
ISBN: 0132701723
Release Date: 2007-05-17
Genre: Computers

Visual Studio Team System (VSTS) gives Microsoft development teams a powerful, integrated toolset for Agile development. Visual Studio Team System: Better Software Development for Agile Teams is a comprehensive, start-to-finish guide to making the most of VSTS in real-world Agile environments. Using a book-length case study, the authors show how to use VSTS to improve every aspect of software development, step by step–from project planning through design and from coding through testing and deployment. Agile consultant Will Stott and Microsoft development lead James Newkirk carefully integrate theory and practice, offering hands-on exercises, practical insights into core Extreme Programming (XP) techniques, and much more. Coverage includes Using VSTS to support the transition to Agile values and techniques Forming Agile teams and building effective process frameworks Leveraging Team Foundation Version Control to help teams manage change and share their code effectively Implementing incremental builds and integration with Team Foundation Build Making the most of VSTS tools for Test-Driven Development and refactoring Bringing agility into software modeling and using patterns to model solutions more effectively Using the FIT integrated testing framework to make sure customers are getting what they need Estimating, prioritizing, and planning Agile projects

Test Driven Development in Microsoft NET

Author: Alexei Vorontsov
Publisher: Microsoft Press
ISBN: 9780735637412
Release Date: 2004-03-17
Genre: Computers

With the clarity and precision intrinsic to the Test-Driven Development (TDD) process itself, experts James Newkirk and Alexei Vorontsov demonstrate how to implement TDD principles and practices to drive lean, efficient coding—and better design. The best way to understand TDD is to see it in action, and Newkirk and Vorontsov walk step by step through TDD and refactoring in an n-tier, .NET-connected solution. And, as members of the development team for NUnit, a leading unit-testing framework for Microsoft .NET, the authors can offer matchless insights on testing in this environment—ultimately making their expertise your own. Test first—and drive ambiguity out of the development process: Document your code with tests, rather than paper Use test lists to generate explicit requirements and completion criteria Refactor—and improve the design of existing code Alternate programmer tests with customer tests Change how you build UI code—a thin layer on top of rigorously tested code Use tests to make small, incremental changes—and minimize the debugging process Deliver software that’s verifiable, reliable, and robust