BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on REG-TOTAL events by Strict matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[REG-TOTAL]==       1653 (  498)     1283 (  498)    30.13    38.82    33.92
[ConcordU ]       ==[REG-TOTAL]==       1653 (  419)      911 (  419)    25.35    45.99    32.68
[JULIELab ]       ==[REG-TOTAL]==       1653 (  494)     1695 (  494)    29.89    29.14    29.51
[UT+DBCLS ]       ==[REG-TOTAL]==       1653 (  377)     1038 (  377)    22.81    36.32    28.02
[VIBGhent ]       ==[REG-TOTAL]==       1653 (  273)      908 (  273)    16.52    30.07    21.32
[  UNSW   ]       ==[REG-TOTAL]==       1653 (  249)      962 (  249)    15.06    25.88    19.04
[ UTokyo  ]       ==[REG-TOTAL]==       1653 (  213)      698 (  213)    12.89    30.52    18.12
[ UZurich ]       ==[REG-TOTAL]==       1653 (  222)      811 (  222)    13.43    27.37    18.02
[UAntwerp ]       ==[REG-TOTAL]==       1653 (  167)      613 (  167)    10.10    27.24    14.74
[   Cam   ]       ==[REG-TOTAL]==       1653 (  152)      437 (  152)     9.20    34.78    14.55
[  SCAI   ]       ==[REG-TOTAL]==       1653 (  191)     1263 (  191)    11.55    15.12    13.10
[ Team 24 ]       ==[REG-TOTAL]==       1653 (  143)      801 (  143)     8.65    17.85    11.65
[  NICTA  ]       ==[REG-TOTAL]==       1653 (  117)      712 (  117)     7.08    16.43     9.89
[CIPS-ASU ]       ==[REG-TOTAL]==       1653 (  179)     2405 (  179)    10.83     7.44     8.82
[ UAveiro ]       ==[REG-TOTAL]==       1653 (   91)      494 (   91)     5.51    18.42     8.48
[CNBMadrid]       ==[REG-TOTAL]==       1653 (  170)     2527 (  170)    10.28     6.73     8.13
[ASU+HU+BU]       ==[REG-TOTAL]==       1653 (   77)      257 (   77)     4.66    29.96     8.06
[  UMich  ]       ==[REG-TOTAL]==       1653 (  207)     3607 (  207)    12.52     5.74     7.87
[ UNIMAN  ]       ==[REG-TOTAL]==       1653 (   64)      400 (   64)     3.87    16.00     6.23
[ USzeged ]       ==[REG-TOTAL]==       1653 (   63)      379 (   63)     3.81    16.62     6.20
[CCP-BTMG ]       ==[REG-TOTAL]==       1653 (   49)      106 (   49)     2.96    46.23     5.57
[ Team 09 ]       ==[REG-TOTAL]==       1653 (   38)      343 (   38)     2.30    11.08     3.81
[  PIKB   ]       ==[REG-TOTAL]==       1653 (   16)       59 (   16)     0.97    27.12     1.87
[ KoreaU  ]       ==[REG-TOTAL]==       1653 (   11)       29 (   11)     0.67    37.93     1.31

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[REG-TOTAL]==       1658 (  367)     1038 (  367)    22.14    35.36    27.23
[UAntwerp ]       ==[REG-TOTAL]==       1658 (  158)      613 (  158)     9.53    25.77    13.91
[ Team 24 ]       ==[REG-TOTAL]==       1658 (  143)      818 (  143)     8.62    17.48    11.55
[ASU+HU+BU]       ==[REG-TOTAL]==       1658 (   72)      257 (   72)     4.34    28.02     7.52
[CNBMadrid]       ==[REG-TOTAL]==       1658 (  128)     2527 (  128)     7.72     5.07     6.12
[CCP-BTMG ]       ==[REG-TOTAL]==       1658 (   48)      106 (   48)     2.90    45.28     5.44

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------