开发者:上海品职教育科技有限公司 隐私政策详情

应用版本:4.2.11(IOS)|3.2.5(安卓)APP下载

徒慕君 · 2023年07月20日

为什么不用F1

NO.PZ2023040502000081

问题如下:

Exhibit 1 provides results from a sample of loans from the ALPHA model that compared expected and actual defaults over the past 12 months.


While reviewing the model documentation, Lovell confirms that the model was able to correctly predict a default in 5,290 instances of the model prediction dataset after the completed data wrangling.

Based on the results provided for the ALPHA model (Exhibit 1) and its associated documentation, the precision of the model is closest to:

选项:

A.

75.4%

B.

85.5%

C.

95.1%

解释:

C is correct. Precision (P) = TP/(TP + FP), where

TP = True positive = 5,290

FP = False positive = Type 1 error = 273

FN = False negative = Type 2 error = 894

P = 5,290/(5,290 + 273) = 5,290/5,563 = 95.1%.

A is incorrect. The calculation incorrectly uses the total number of predictions in the denominator: 5,290/7,018 = 75.4%.

B is incorrect. The calculation uses the correct equation but incorrectly treats a Type 2 error as a false positive and a Type 1 error as a false negative:

P = TP/(TP + FP) = 5,290/(5,290 + 894) = 5,290/6,184 = 85.5%.

这个题class分布并不平衡,为什么不用F1衡量结果的准确性?

2 个答案
已采纳答案

星星_品职助教 · 2023年07月21日

同学你好,

本题题干中明确要求计算的是“the precision of the model”。所以只能选择计算Precision这个指标,不能用F1或者其他的指标。

王园圆_品职助教 · 2023年07月20日

同学你好,这是数量的题目,不是Equity的哦,助教转给负责数量的老师了哦