161k views
2 votes
If we have a classifier where one type of mistake is more costly where do we move the line?

User Balkyto
by
8.7k points

1 Answer

4 votes

Final answer:

To minimize the impact of the costlier mistake in a classifier, we adjust the decision threshold to either be more strict (to reduce Type I errors) or more lenient (to reduce Type II errors), depending on which error is more costly.

Step-by-step explanation:

If we have a classifier where one type of mistake is more costly than the other, we need to adjust our decision threshold accordingly to minimize the impact of that costlier mistake. For instance, in medical diagnostics, a Type I error (false positive) might be considered more serious than a Type II error (false negative) because it could lead to unnecessary treatment that can cause harm.

Conversely, in a different context, missing a true positive might be more dangerous, such as failing to detect a serious disease. In these cases, experts might have good intuition about what results are plausible, and they might adjust the classifier threshold to reduce the more costly error.

When referring to the concept of a 'line' within classification, this can often be related to a decision boundary. For example, if we want to minimize Type I errors, we may move the decision line in such a way that it requires more evidence before classifying a positive case.

This can make it less likely to accept a false claim, such as incorrectly identifying an environment as cancer-causing when it is not. Again, this comes at the risk of increasing Type II errors, but if Type I errors are deemed more costly, this trade-off might be acceptable.

User Kobus Myburgh
by
7.6k points