← All insights
Share this insight
LinkedIn

In this insight

Begin with the question, then choose the method

The useful testing question is what the team needs to learn about the product. A repeatable check can establish whether defined expectations were met. An exploratory session can investigate behavior that has not yet been fully described. Both approaches can contribute valuable evidence when their purpose and limits are clear.

Debates about which method is better often combine several different concerns: execution time, maintenance effort, coverage, usability, and release confidence. Separate those concerns before making a decision. Identify the behavior under review, the consequences of a problem, and how the result will be used. The method should fit the question rather than determine it.

Human investigation follows unexpected clues

Manual testing is useful when judgment, interpretation, and adaptation matter. A tester can notice confusing feedback, follow an unexpected state, or ask whether an interaction makes sense to a user. These observations may be difficult to express as a predefined assertion because the relevant question emerges during investigation.

Give that work structure. Define the session goal, the environment, the areas to explore, and how observations will be recorded. A focused session might examine how a user recovers from incomplete information or how a new workflow behaves across different states. Recording the reasoning and evidence makes the investigation easier to discuss and follow up.

Automation repeats defined expectations

Automated checks are useful when the expected behavior can be stated clearly and needs to be evaluated repeatedly. They can compare results, detect a change in an agreed contract, or exercise a stable user journey. Their value depends on relevant assertions, dependable setup, and reports that somebody can act on.

A passing check establishes only what that check examined. It does not show that every user need, interaction, or failure mode has been considered. Review the assumptions behind the suite and the behavior it protects. Keep test data and dependencies understandable so the team can distinguish an application problem from a problem in the checking process.

A hypothetical release shows the difference

Imagine a team introducing a new checkout experience. Automated checks might verify an agreed calculation, required fields, and a small set of stable ordering journeys. These checks provide repeatable feedback as engineers change the application. They also create a record of whether those particular expectations were met for a given version.

A manual session could investigate how understandable error messages are, whether a customer can recover after changing an item, and what happens when the interface presents unfamiliar states. Findings from exploration may lead to new repeatable checks, a clarified requirement, or a design change. The methods contribute different evidence to the same release decision.

Compare the complete operating effort

Automated execution time is only one part of the cost. A suite also requires design, data preparation, failure investigation, and updates as the product changes. Manual work requires planning, skilled attention, and enough documentation to make observations useful. Both approaches become expensive when the purpose of the work is unclear.

Evaluate the effort involved in obtaining usable feedback. Ask how frequently a check runs, how quickly a result can be understood, and whether the team still trusts it. Consider the value of an exploratory finding as well as the time spent producing it. A balanced strategy should make the work sustainable for the people maintaining the product.

Allocate attention according to risk

Start with important user journeys and the conditions most likely to undermine them. Decide which expectations deserve recurring checks, which areas need exploration, and where specialized review is appropriate. The balance can change as features stabilize, integrations grow, or the team learns from production behavior.

For each important area, record the purpose of testing, the current approach, the responsible owner, and a known limitation. This provides a readable coverage map without pretending that a single percentage describes quality. Revisit the map after major changes or meaningful failures. Testing priorities should evolve with the product and the decisions the team needs to support.

Make the release evidence understandable

A release discussion should explain what was evaluated, what was found, and what remains unknown. Combine relevant automated results with exploratory observations and the status of important findings. State the version and environment involved. Decision makers need this context to understand the evidence rather than assume that a green report settles every question.

A useful next step is to select one critical journey and describe how both repeatable checks and human investigation could evaluate it. Identify overlap, gaps, and unnecessary work. Agree the first improvement and its owner. Quality becomes a shared engineering practice when the evidence is understandable and the team can act on it.

Share this insight
LinkedIn