SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
ults - PRC, Inc.
Summary Statistics J
Run number prceol- 1 Recall-Precision Curve
Num[OCRerr]queries 50 j 1
Total number of documents over all queries
Retrieved 100001 0.8 -
Relevant 4056
Rel[OCRerr]ret 1666 J
0.6
ecall Level Averages Document Level Averages Precision
Lll Precision Recall Precision 0.4
0.6598 at 5 docs 0.0379 0.4040
) 0.4382 at 15 docs 0.1193 0.3653
) 0.3451 at 30 docs 0.1714 0.3033 0.2
) 0.2536 at 100 docs 0.3438 0.2322
0.1753 at 200 docs 0.4557 0.1666 0
0.1400
0.1016 ROC Averages
0.0489 False Alarm Detection
0.0185 0.00000 0.0388
0.0015 0.00001 0.0534
0.0015 0.00002 0.0582
0.00003 0.0690
eprecision for all points 1
0.00004 0.0753
[OCRerr]vg 0.1985
0.00005 0.0943
;e precision for 3 0.00006 0.0901
[OCRerr]diate points 0.00007 0.1012
0.00008 0.1033
1 0.00009 0.1143
[OCRerr].50, 0.80)
vg 0.1679
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE - Detection-False Alarm
0 Ol 0.02 0.16
3
2
1
0
-1
-2
-3
C
0.5 0.84 0.98 0
-3 -2 -1 0 1 2 3