BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Localization events by Strict matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]        Localization          174 (   85)      105 (   85)    48.85    80.95    60.93
[VIBGhent ]        Localization          174 (   75)       98 (   75)    43.10    76.53    55.15
[JULIELab ]        Localization          174 (   73)       98 (   73)    41.95    74.49    53.68
[UT+DBCLS ]        Localization          174 (   65)       75 (   65)    37.36    86.67    52.21
[ConcordU ]        Localization          174 (   61)       67 (   61)    35.06    91.04    50.62
[ UNIMAN  ]        Localization          174 (   77)      147 (   77)    44.25    52.38    47.98
[ASU+HU+BU]        Localization          174 (   57)       70 (   57)    32.76    81.43    46.72
[ UTokyo  ]        Localization          174 (   54)       59 (   54)    31.03    91.53    46.35
[ UAveiro ]        Localization          174 (   56)       89 (   56)    32.18    62.92    42.59
[CNBMadrid]        Localization          174 (   60)      114 (   60)    34.48    52.63    41.67
[  UMich  ]        Localization          174 (   77)      212 (   77)    44.25    36.32    39.90
[  SCAI   ]        Localization          174 (   46)       58 (   46)    26.44    79.31    39.66
[   Cam   ]        Localization          174 (   44)       50 (   44)    25.29    88.00    39.29
[ Team 24 ]        Localization          174 (   47)       80 (   47)    27.01    58.75    37.01
[  UNSW   ]        Localization          174 (   39)       41 (   39)    22.41    95.12    36.28
[  NICTA  ]        Localization          174 (   41)       66 (   41)    23.56    62.12    34.17
[ KoreaU  ]        Localization          174 (   35)       43 (   35)    20.11    81.40    32.26
[UAntwerp ]        Localization          174 (   35)       46 (   35)    20.11    76.09    31.82
[CIPS-ASU ]        Localization          174 (   48)      143 (   48)    27.59    33.57    30.28
[ UZurich ]        Localization          174 (   31)       34 (   31)    17.82    91.18    29.81
[  PIKB   ]        Localization          174 (   19)       23 (   19)    10.92    82.61    19.29
[CCP-BTMG ]        Localization          174 (   18)       18 (   18)    10.34   100.00    18.75
[ USzeged ]        Localization          174 (   13)       33 (   13)     7.47    39.39    12.56
[ Team 09 ]        Localization          174 (    1)        1 (    1)     0.57   100.00     1.14

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]        Localization          174 (   56)       75 (   56)    32.18    74.67    44.98
[ASU+HU+BU]        Localization          174 (   42)       70 (   42)    24.14    60.00    34.43
[CNBMadrid]        Localization          174 (   48)      114 (   48)    27.59    42.11    33.33
[ Team 24 ]        Localization          174 (   38)       95 (   38)    21.84    40.00    28.25
[UAntwerp ]        Localization          174 (   30)       46 (   30)    17.24    65.22    27.27
[CCP-BTMG ]        Localization          174 (   17)       18 (   17)     9.77    94.44    17.71

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------