Bad practices in evaluation methodology relevant to class-imbalanced problems — mentioned by Scea91

Sat, 16 Nov 2019 16:41:12 GMT

Also accuracy is not a good measure for evaluating detection of rare events such as seizures. (https://arxiv.org/pdf/1812.01388.pdf)

Paper and discussion history. A mention is not an endorsement.

Bad practices in evaluation methodology relevant to class-imbalanced problems — mentioned by Scea91

Thu, 02 May 2019 06:41:53 GMT

While I agree that there are problems with the paper, I think you are confused about suitability of ROC, PR and how test set class imbalance affects them. Your first two suggestions combined together are very wrong. If you made the test dataset balanced and then measured PR curve the precision would be way too optimistic as it is directly affected by the class imbalance. ROC curve on the other hand is invariant to the test set imbalance. You can find interesting this short article I have written about this problem: https://arxiv.org/abs/1812.01388

Paper and discussion history. A mention is not an endorsement.

Bad practices in evaluation methodology relevant to class-imbalanced problems · HackerPapers discussions

Bad practices in evaluation methodology relevant to class-imbalanced problems — mentioned by Scea91

Bad practices in evaluation methodology relevant to class-imbalanced problems — mentioned by Scea91