BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on ALL-TOTAL events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[ALL-TOTAL]== 3182 ( 1357) 2542 ( 1357) 42.65 53.38 47.41
[ConcordU ] ==[ALL-TOTAL]== 3182 ( 1061) 1808 ( 1061) 33.34 58.68 42.53
[UT+DBCLS ] ==[ALL-TOTAL]== 3182 ( 1090) 2110 ( 1090) 34.26 51.66 41.19
[JULIELab ] ==[ALL-TOTAL]== 3182 ( 1269) 3070 ( 1269) 39.88 41.34 40.60
[VIBGhent ] ==[ALL-TOTAL]== 3182 ( 1032) 2065 ( 1032) 32.43 49.98 39.34
[ UTokyo ] ==[ALL-TOTAL]== 3182 ( 846) 1710 ( 846) 26.59 49.47 34.59
[ UZurich ] ==[ALL-TOTAL]== 3182 ( 839) 1895 ( 839) 26.37 44.27 33.05
[ UNSW ] ==[ALL-TOTAL]== 3182 ( 823) 1957 ( 823) 25.86 42.05 32.03
[ASU+HU+BU] ==[ALL-TOTAL]== 3182 ( 655) 1107 ( 655) 20.58 59.17 30.54
[ Cam ] ==[ALL-TOTAL]== 3182 ( 646) 1181 ( 646) 20.30 54.70 29.61
[ UNIMAN ] ==[ALL-TOTAL]== 3182 ( 681) 1444 ( 681) 21.40 47.16 29.44
[UAntwerp ] ==[ALL-TOTAL]== 3182 ( 686) 1502 ( 686) 21.56 45.67 29.29
[ Team 24 ] ==[ALL-TOTAL]== 3182 ( 687) 1778 ( 687) 21.59 38.64 27.70
[ SCAI ] ==[ALL-TOTAL]== 3182 ( 749) 2278 ( 749) 23.54 32.88 27.44
[ USzeged ] ==[ALL-TOTAL]== 3182 ( 667) 1852 ( 667) 20.96 36.02 26.50
[ UAveiro ] ==[ALL-TOTAL]== 3182 ( 568) 1352 ( 568) 17.85 42.01 25.06
[ NICTA ] ==[ALL-TOTAL]== 3182 ( 532) 1389 ( 532) 16.72 38.30 23.28
[CCP-BTMG ] ==[ALL-TOTAL]== 3182 ( 413) 596 ( 413) 12.98 69.30 21.86
[CNBMadrid] ==[ALL-TOTAL]== 3182 ( 807) 4364 ( 807) 25.36 18.49 21.39
[CIPS-ASU ] ==[ALL-TOTAL]== 3182 ( 694) 3811 ( 694) 21.81 18.21 19.85
[ PIKB ] ==[ALL-TOTAL]== 3182 ( 345) 538 ( 345) 10.84 64.13 18.55
[ UMich ] ==[ALL-TOTAL]== 3182 ( 867) 6910 ( 867) 27.25 12.55 17.18
[ Team 09 ] ==[ALL-TOTAL]== 3182 ( 367) 1228 ( 367) 11.53 29.89 16.64
[ KoreaU ] ==[ALL-TOTAL]== 3182 ( 286) 485 ( 286) 8.99 58.97 15.60
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[ALL-TOTAL]== 3193 ( 1059) 2110 ( 1059) 33.17 50.19 39.94
[UAntwerp ] ==[ALL-TOTAL]== 3193 ( 652) 1502 ( 652) 20.42 43.41 27.77
[ASU+HU+BU] ==[ALL-TOTAL]== 3193 ( 592) 1107 ( 592) 18.54 53.48 27.53
[ Team 24 ] ==[ALL-TOTAL]== 3193 ( 670) 1839 ( 670) 20.98 36.43 26.63
[CCP-BTMG ] ==[ALL-TOTAL]== 3193 ( 408) 596 ( 408) 12.78 68.46 21.54
[CNBMadrid] ==[ALL-TOTAL]== 3193 ( 697) 4364 ( 697) 21.83 15.97 18.45
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] ==[ALL-TOTAL]== 3617 ( 1121) 1944 ( 1121) 30.99 57.66 40.32
[VIBGhent ] ==[ALL-TOTAL]== 3617 ( 1065) 2232 ( 1065) 29.44 47.72 36.42
[ASU+HU+BU] ==[ALL-TOTAL]== 3617 ( 677) 1186 ( 677) 18.72 57.08 28.19
[ NICTA ] ==[ALL-TOTAL]== 3617 ( 548) 1451 ( 548) 15.15 37.77 21.63
[ USzeged ] ==[ALL-TOTAL]== 3617 ( 701) 3113 ( 701) 19.38 22.52 20.83
[CCP-BTMG ] ==[ALL-TOTAL]== 3617 ( 430) 777 ( 430) 11.89 55.34 19.57