BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Transcription events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Transcription 137 ( 50) 78 ( 50) 36.50 64.10 46.51
[VIBGhent ] Transcription 137 ( 51) 90 ( 51) 37.23 56.67 44.93
[ UTokyo ] Transcription 137 ( 44) 110 ( 44) 32.12 40.00 35.63
[ NICTA ] Transcription 137 ( 30) 44 ( 30) 21.90 68.18 33.15
[ Team 24 ] Transcription 137 ( 36) 89 ( 36) 26.28 40.45 31.86
[UAntwerp ] Transcription 137 ( 32) 82 ( 32) 23.36 39.02 29.22
[ UNIMAN ] Transcription 137 ( 20) 31 ( 20) 14.60 64.52 23.81
[JULIELab ] Transcription 137 ( 25) 79 ( 25) 18.25 31.65 23.15
[ SCAI ] Transcription 137 ( 23) 62 ( 23) 16.79 37.10 23.12
[ConcordU ] Transcription 137 ( 19) 35 ( 19) 13.87 54.29 22.09
[ASU+HU+BU] Transcription 137 ( 20) 52 ( 20) 14.60 38.46 21.16
[ Cam ] Transcription 137 ( 17) 30 ( 17) 12.41 56.67 20.36
[ UZurich ] Transcription 137 ( 28) 148 ( 28) 20.44 18.92 19.65
[UT+DBCLS ] Transcription 137 ( 20) 77 ( 20) 14.60 25.97 18.69
[ UNSW ] Transcription 137 ( 21) 103 ( 21) 15.33 20.39 17.50
[ USzeged ] Transcription 137 ( 25) 150 ( 25) 18.25 16.67 17.42
[ PIKB ] Transcription 137 ( 15) 38 ( 15) 10.95 39.47 17.14
[ UAveiro ] Transcription 137 ( 21) 112 ( 21) 15.33 18.75 16.87
[ Team 09 ] Transcription 137 ( 16) 53 ( 16) 11.68 30.19 16.84
[CNBMadrid] Transcription 137 ( 36) 341 ( 36) 26.28 10.56 15.06
[ KoreaU ] Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
[CCP-BTMG ] Transcription 137 ( 9) 20 ( 9) 6.57 45.00 11.46
[CIPS-ASU ] Transcription 137 ( 15) 133 ( 15) 10.95 11.28 11.11
[ UMich ] Transcription 137 ( 37) 701 ( 37) 27.01 5.28 8.83
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ Team 24 ] Transcription 137 ( 36) 89 ( 36) 26.28 40.45 31.86
[UAntwerp ] Transcription 137 ( 32) 82 ( 32) 23.36 39.02 29.22
[ASU+HU+BU] Transcription 137 ( 20) 52 ( 20) 14.60 38.46 21.16
[UT+DBCLS ] Transcription 137 ( 20) 77 ( 20) 14.60 25.97 18.69
[CNBMadrid] Transcription 137 ( 36) 341 ( 36) 26.28 10.56 15.06
[CCP-BTMG ] Transcription 137 ( 9) 20 ( 9) 6.57 45.00 11.46
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------