Skip to main content

Table 6 Triage subtask runs, sorted by utility.

From: The TREC 2004 genomics track categorization task: classifying full text biomedical documents

Run Group (reference) Precision Recall F-score Utility
dimacsTfl9d rutgers.dayanik [3] 0.1579 0.8881 0.2681 0.6512
dimacsTl9mhg rutgers.dayanik [3] 0.1514 0.8952 0.259 0.6443
dimacsTfl9w rutgers.dayanik [3] 0.1553 0.8833 0.2642 0.6431
dimacsTl9md rutgers.dayanik [3] 0.173 0.7952 0.2841 0.6051
pllsgen4t3 patolis.fujita [4] 0.149 0.769 0.2496 0.5494
pllsgen4t4 patolis.fujita [4] 0.1259 0.831 0.2186 0.5424
pllsgen4t2 patolis.fujita [4] 0.1618 0.7238 0.2645 0.5363
pllsgen4t5 patolis.fujita [4] 0.174 0.6976 0.2785 0.532
pllsgen4t1 patolis.fujita [4] 0.1694 0.7024 0.273 0.5302
GUCwdply2000 german.u.cairo [11] 0.151 0.719 0.2496 0.5169
KoikeyaTri1 u.tokyo (none) 0.0938 0.9643 0.171 0.4986
OHSUVP ohsu.hersh [5] 0.1714 0.6571 0.2719 0.4983
KoikeyaTri3 u.tokyo (none) 0.0955 0.9452 0.1734 0.4974
KoikeyaTri2 u.tokyo (none) 0.0913 0.9738 0.167 0.4893
NLMT2SVM nlm.umd.ul [12] 0.1286 0.7333 0.2188 0.4849
dimacsTl9w rutgers.dayanik [3] 0.1456 0.6643 0.2389 0.4694
nusbird2004c mlg.nus [13] 0.1731 0.5833 0.267 0.444
lgct1 indiana.u.seki [7] 0.1118 0.7214 0.1935 0.4348
OHSUNBAYES ohsu.hersh [5] 0.129 0.6548 0.2155 0.4337
NLMT2BAYES nlm.umd.ul [12] 0.0902 0.869 0.1635 0.4308
THIRcat04 tsinghua.ma [14] 0.0908 0.7881 0.1628 0.3935
GUClin1700 german.u.cairo [11] 0.1382 0.5595 0.2217 0.3851
NLMT22 nlm.umd.ul [12] 0.1986 0.481 0.2811 0.3839
NTU2v3N1 ntu.chen [15] 0.1003 0.6905 0.1752 0.381
NLMT21 nlm.umd.ul [12] 0.195 0.4643 0.2746 0.3685
GUCply1700 german.u.cairo [11] 0.1324 0.5357 0.2123 0.3601
NTU3v3N1 ntu.chen [15] 0.0953 0.6857 0.1673 0.3601
NLMT2ADA nlm.umd.ul [12] 0.0713 0.9881 0.133 0.3448
lgct2 indiana.u.seki [7] 0.1086 0.581 0.183 0.3426
GUClin1260 german.u.cairo [11] 0.1563 0.469 0.2345 0.3425
THIRcat01 tsinghua.ma [14] 0.1021 0.6024 0.1746 0.3375
NTU4v3N1416 ntu.chen [15] 0.0948 0.6357 0.165 0.3323
THIRcat02 tsinghua.ma [14] 0.1033 0.5571 0.1743 0.3154
biotext1trge u.cberkeley.hearst [16] 0.0831 0.7 0.1486 0.3139
GUCply1260 german.u.cairo [11] 0.1444 0.4333 0.2167 0.305
OHSUSVMJ20 ohsu.hersh [5] 0.2309 0.3524 0.279 0.2937
biotext2trge u.cberkeley.hearst [16] 0.095 0.5548 0.1622 0.2905
THIRcat03 tsinghua.ma [14] 0.0914 0.55 0.1567 0.2765
THIRcat05 tsinghua.ma [14] 0.1082 0.4167 0.1718 0.245
biotext3trge u.cberkeley.hearst [16] 0.1096 0.4024 0.1723 0.2389
nusbird2004a mlg.nus [13] 0.1373 0.3357 0.1949 0.2302
nusbird2004d mlg.nus [13] 0.1349 0.2881 0.1838 0.1957
nusbird2004b mlg.nus [13] 0.1163 0.3 0.1677 0.1861
eres2 u.edinburgh.sinclair [17] 0.1647 0.231 0.1923 0.1724
biotext4trge u.cberkeley.hearst [16] 0.1271 0.2571 0.1701 0.1688
emet2 u.edinburgh.sinclair [17] 0.1847 0.2071 0.1953 0.1614
epub2 u.edinburgh.sinclair [17] 0.1729 0.2095 0.1895 0.1594
nusbird2004e mlg.nus [13] 0.136 0.231 0.1712 0.1576
geneteam3 u.hospital.geneva [18] 0.1829 0.1833 0.1831 0.1424
edis2 u.edinburgh.sinclair [17] 0.1602 0.1857 0.172 0.137
wdtriage1 indiana.u.yang [19] 0.202 0.1476 0.1706 0.1185
eint2 u.edinburgh.sinclair [17] 0.1538 0.1619 0.1578 0.1174
NTU3v3N1c2 ntu.chen [15] 0.1553 0.1357 0.1449 0.0988
geneteam1 u.hospital.geneva [18] 0.1333 0.1333 0.1333 0.09
geneteam2 u.hospital.geneva [18] 0.1333 0.1333 0.1333 0.09
biotext5trge u.cberkeley.hearst [16] 0.1192 0.1214 0.1203 0.0765
TRICSUSM u.sanmarcos [20] 0.0792 0.1762 0.1093 0.0738
IBMIRLver1 ibm.india (none) 0.2053 0.0738 0.1086 0.0595
EMCTNOT1 tno.kraaij [21] 0.2 0.0143 0.0267 0.0114
Mean   0.1381 0.5194 0.1946 0.3303
MeSH Mice rutgers.dayanik [3] 0.1502 0.8929 0.2572 0.6404