Oracle Problem in Test Execution

by Nataliia Vasylyna | January 30, 2012 10:00 am

Checking of the result is a complex task, because of the theoretical difficulties and practical limitations. According to the long standing theoretical outputs result checking for software testing in common is an insoluble trouble.

To put it differently, there is no algorithmic or entirely automated solution to the common test oracle problem.

From the practical point of view, the expected behavior is hard to describe exactly so that the monitored behavior can be compared against. Software can fail in countless variations. The unexpected behavior may occur in really unexpected ways, making result checking complicated or almost unrealizable.

Nevertheless, there are cases where specific kinds of system failures, such as irresponsive behavior or system crash, are easy to detect.

Let’s try to find a rough solution to the oracle problem:

Learn more from QATestLab

Related Posts:

Endnotes:
  1. defect: https://blog.qatestlab.com/2011/10/11/main-types-of-defects-in-software-testing/
  2. Latest QA Trends: Key Insights Into Test Automation: https://blog.qatestlab.com/2024/12/19/test-automation-insights-and-trends/
  3. AI In Test Automation: From Costs To Benefits: https://blog.qatestlab.com/2024/11/27/test-automation-and-ai-benefits/
  4. Software Development (Doesn’t) Need Independent QA: https://blog.qatestlab.com/2024/11/14/software-development-doesnt-need-independent-qa/

Source URL: https://blog.qatestlab.com/2012/01/30/the-oracle-problem-in-the-test-execution/