What Is a Type II Error?
A type II error is a statistical term used within the context of hypothesis testing that describes the error that occurs when one fails to reject a null hypothesis that is actually false. A type II error produces a false negative, also known as an error of omission.
For example, a test for a disease may report a negative result when the patient is infected. This is a type II error because we accept the conclusion of the test as negative, even though it is incorrect.
A type II error can be contrasted with a type I error, where researchers incorrectly reject a true null hypothesis. A type II error happens when one fails to reject a null hypothesis that is actually false. A type I error produces a false positive.
Key Takeaways
- A type II error is defined as the probability of incorrectly failing to reject the null hypothesis, when in fact it is not applicable to the entire population.
- A type II error is essentially a false negative.
- A type II error can be made less likely by making more stringent criteria for rejecting a null hypothesis, although this increases the chances of a false positive.
- The sample size, the true population size, and the preset alpha level influence the magnitude of risk of an error.
- Analysts need to weigh the likelihood and impact of type II errors with type I errors.
Understanding a Type II Error
A type II error, also known as an error of the second kind or a beta error, confirms an idea that should have been rejected—for instance, claiming that two observances are the same, despite them being different. A type II error does not reject the null hypothesis, even though the alternative hypothesis is actually correct. In other words, a false finding is accepted as true.
The likelihood of a type II error can be reduced by making more stringent criteria for rejecting a null hypothesis (H0). For example, if an analyst is considering anything that falls within the +/- bounds of a 95% confidence interval as statistically insignificant (a negative result), then by decreasing that tolerance to +/- 90%, and subsequently narrowing the bounds, you will get fewer negative results, and thus reduce the chances of a false negative.
Taking these steps, however, tends to increase the chances of encountering a type I error—a false-positive result. When conducting a hypothesis test, the probability or risk of making a type I error or type II error should be considered.
The steps taken to reduce the chances of encountering a type II error tend to increase the probability of a type I error.
Type I Errors vs. Type II Errors
The difference between a type II error and a type I error is that a type I error rejects the null hypothesis when it is true (i.e., a false positive). The probability of committing a type I error is equal to the level of significance that was set for the hypothesis test. Therefore, if the level of significance is 0.05, there is a 5% chance that a type I error may occur.
The probability of committing a type II error is equal to one minus the power of the test, also known as beta. The power of the test could be increased by increasing the sample size, which decreases the risk of committing a type II error.
Some statistical literature will include overall significance level and type II error risk as part of the report’s analysis. For example, a 2021 meta-analysis of exosome in the treatment of spinal cord injury recorded an overall significance level of 0.05 and a type II error risk of 0.1.
Example of a Type II Error
Assume a biotechnology company wants to compare how effective two of its drugs are for treating diabetes. The null hypothesis states the two medications are equally effective. A null hypothesis, H0, is the claim that the company hopes to reject using the one-tailed test. The alternative hypothesis, Ha, states that the two drugs are not equally effective. The alternative hypothesis, Ha, is the state of nature that is supported by rejecting the null hypothesis.
The biotech company implements a large clinical trial of 3,000 patients with diabetes to compare the treatments. The company randomly divides the 3,000 patients into two equally sized groups, giving one group one of the treatments and the other group the other treatment. It selects a significance level of 0.05, which indicates it is willing to accept a 5% chance it may reject the null hypothesis when it is true or a 5% chance of committing a type I error.
Assume the beta is calculated to be 0.025, or 2.5%. Therefore, the probability of committing a type II error is 97.5%. If the two medications are not equal, the null hypothesis should be rejected. However, if the biotech company does not reject the null hypothesis when the drugs are not equally effective, then a type II error occurs.
What Is the Difference Between Type I and Type II Errors?
A type I error occurs if a null hypothesis is rejected that is actually true in the population. This type of error is representative of a false positive. Alternatively, a type II error occurs if a null hypothesis is not rejected that is actually false in the population. This type of error is representative of a false negative.
What Causes Type II Errors?
A type II error is commonly caused if the statistical power of a test is too low. The higher the statistical power, the greater the chance of avoiding an error. It’s often recommended that the statistical power should be set to at least 80% prior to conducting any testing.
What Factors Influence the Magnitude of Risk for Type II Errors?
As the sample size of a study increases, the risk of type II errors should decrease. As the true population effect size increases, the probability of a type II error should also decrease. Finally, the preset alpha level set by the research influences the magnitude of risk. As the alpha level set decreases, the risk of a type II error increases.
How Can a Type II Error Be Minimized?
It is not possible to fully prevent committing a type II error, but the risk can be minimized by increasing the sample size. However, doing so will also increase the risk of committing a type I error instead.
The Bottom Line
In statistics, a type II error results in a false negative—meaning that there is a finding, but it has been missed in the analysis (or that the null hypothesis is not rejected when it ought to have been). A type II error can occur if there is not enough power in statistical tests, often resulting from sample sizes that are too small. Increasing the sample size can help reduce the chances of committing a type II error.
Type II errors can be contrasted with type I errors, which are false positives.