Oracle Problem in Test Execution

by Nataliia Vasylyna | January 30, 2012 10:00 am

Checking of the result is a complex task, because of the theoretical difficulties and practical limitations. According to the long standing theoretical outputs result checking for software testing in common is an insoluble trouble.

To put it differently, there is no algorithmic or entirely automated solution to the common test oracle problem.

From the practical point of view, the expected behavior is hard to describe exactly so that the monitored behavior can be compared against. Software can fail in countless variations. The unexpected behavior may occur in really unexpected ways, making result checking complicated or almost unrealizable.

Nevertheless, there are cases where specific kinds of system failures, such as irresponsive behavior or system crash, are easy to detect.

Let’s try to find a rough solution to the oracle problem:

Learn more from QATestLab

Related Posts:

Endnotes:
  1. defect: https://blog.qatestlab.com/2011/10/11/main-types-of-defects-in-software-testing/
  2. How to Test a Trading Platform (like a crypto exchange): https://blog.qatestlab.com/2024/03/27/trading-platform-testing/
  3. From Troubled Launch to Excellence: A Startup’s Real-Life Success Story: https://blog.qatestlab.com/2024/03/05/startup-story/
  4. Why Is a Healthy Testing Process Crucial? A Full Checklist: https://blog.qatestlab.com/2024/02/15/why-is-a-healthy-testing-process-crucial-a-full-checklist/

Source URL: https://blog.qatestlab.com/2012/01/30/the-oracle-problem-in-the-test-execution/