BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on EVT-TOTAL events by Strict matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[EVT-TOTAL]==       1529 (  859)     1259 (  859)    56.18    68.23    61.62
[VIBGhent ]       ==[EVT-TOTAL]==       1529 (  759)     1157 (  759)    49.64    65.60    56.52
[UT+DBCLS ]       ==[EVT-TOTAL]==       1529 (  713)     1072 (  713)    46.63    66.51    54.83
[JULIELab ]       ==[EVT-TOTAL]==       1529 (  775)     1375 (  775)    50.69    56.36    53.37
[ConcordU ]       ==[EVT-TOTAL]==       1529 (  642)      897 (  642)    41.99    71.57    52.93
[ UTokyo  ]       ==[EVT-TOTAL]==       1529 (  633)     1012 (  633)    41.40    62.55    49.82
[ASU+HU+BU]       ==[EVT-TOTAL]==       1529 (  578)      850 (  578)    37.80    68.00    48.59
[ UNIMAN  ]       ==[EVT-TOTAL]==       1529 (  617)     1044 (  617)    40.35    59.10    47.96
[ UZurich ]       ==[EVT-TOTAL]==       1529 (  617)     1084 (  617)    40.35    56.92    47.23
[  UNSW   ]       ==[EVT-TOTAL]==       1529 (  574)      995 (  574)    37.54    57.69    45.48
[  SCAI   ]       ==[EVT-TOTAL]==       1529 (  558)     1015 (  558)    36.49    54.98    43.87
[   Cam   ]       ==[EVT-TOTAL]==       1529 (  494)      744 (  494)    32.31    66.40    43.47
[ Team 24 ]       ==[EVT-TOTAL]==       1529 (  544)      977 (  544)    35.58    55.68    43.42
[UAntwerp ]       ==[EVT-TOTAL]==       1529 (  519)      889 (  519)    33.94    58.38    42.93
[ USzeged ]       ==[EVT-TOTAL]==       1529 (  604)     1473 (  604)    39.50    41.00    40.24
[ UAveiro ]       ==[EVT-TOTAL]==       1529 (  477)      858 (  477)    31.20    55.59    39.97
[CNBMadrid]       ==[EVT-TOTAL]==       1529 (  637)     1837 (  637)    41.66    34.68    37.85
[  NICTA  ]       ==[EVT-TOTAL]==       1529 (  415)      677 (  415)    27.14    61.30    37.62
[CCP-BTMG ]       ==[EVT-TOTAL]==       1529 (  364)      490 (  364)    23.81    74.29    36.06
[CIPS-ASU ]       ==[EVT-TOTAL]==       1529 (  515)     1406 (  515)    33.68    36.63    35.09
[  PIKB   ]       ==[EVT-TOTAL]==       1529 (  329)      479 (  329)    21.52    68.68    32.77
[ KoreaU  ]       ==[EVT-TOTAL]==       1529 (  275)      456 (  275)    17.99    60.31    27.71
[  UMich  ]       ==[EVT-TOTAL]==       1529 (  660)     3303 (  660)    43.17    19.98    27.32
[ Team 09 ]       ==[EVT-TOTAL]==       1529 (  329)      885 (  329)    21.52    37.18    27.26

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[EVT-TOTAL]==       1535 (  692)     1072 (  692)    45.08    64.55    53.09
[ASU+HU+BU]       ==[EVT-TOTAL]==       1535 (  520)      850 (  520)    33.88    61.18    43.61
[ Team 24 ]       ==[EVT-TOTAL]==       1535 (  527)     1021 (  527)    34.33    51.62    41.24
[UAntwerp ]       ==[EVT-TOTAL]==       1535 (  494)      889 (  494)    32.18    55.57    40.76
[CCP-BTMG ]       ==[EVT-TOTAL]==       1535 (  360)      490 (  360)    23.45    73.47    35.56
[CNBMadrid]       ==[EVT-TOTAL]==       1535 (  569)     1837 (  569)    37.07    30.97    33.75

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------