---------------------------------------------
35 ROUGE-1 Average_R: 0.27534 (95%-conf.int. 0.26482 - 0.28544)
35 ROUGE-1 Average_P: 0.19287 (95%-conf.int. 0.18430 - 0.20096)
35 ROUGE-1 Average_F: 0.22518 (95%-conf.int. 0.21591 - 0.23365)
.............................................
35 ROUGE-1 Eval D0703-A.M.100.A-A.35 R:0.36486 P:0.27273 F:0.31214
35 ROUGE-1 Eval D0703-A.M.100.A-C.35 R:0.34899 P:0.26263 F:0.29971
35 ROUGE-1 Eval D0703-A.M.100.A-D.35 R:0.36426 P:0.26768 F:0.30859
35 ROUGE-1 Eval D0703-A.M.100.A-J.35 R:0.35714 P:0.26515 F:0.30435
35 ROUGE-1 Eval D0703-B.M.100.A-A.35 R:0.32680 P:0.23474 F:0.27322
35 ROUGE-1 Eval D0703-B.M.100.A-C.35 R:0.36242 P:0.25352 F:0.29834
35 ROUGE-1 Eval D0703-B.M.100.A-D.35 R:0.34228 P:0.23944 F:0.28177
35 ROUGE-1 Eval D0703-B.M.100.A-J.35 R:0.33555 P:0.23709 F:0.27786
35 ROUGE-1 Eval D0703-C.M.100.A-A.35 R:0.32333 P:0.22611 F:0.26612
35 ROUGE-1 Eval D0703-C.M.100.A-C.35 R:0.33766 P:0.24242 F:0.28222
35 ROUGE-1 Eval D0703-C.M.100.A-D.35 R:0.34106 P:0.24009 F:0.28180
35 ROUGE-1 Eval D0703-C.M.100.A-J.35 R:0.31457 P:0.22145 F:0.25992
35 ROUGE-1 Eval D0706-A.M.100.B-B.35 R:0.35065 P:0.22360 F:0.27307
35 ROUGE-1 Eval D0706-A.M.100.B-D.35 R:0.32353 P:0.20497 F:0.25095
35 ROUGE-1 Eval D0706-A.M.100.B-E.35 R:0.32468 P:0.20704 F:0.25285
35 ROUGE-1 Eval D0706-A.M.100.B-I.35 R:0.32792 P:0.20911 F:0.25537
35 ROUGE-1 Eval D0706-B.M.100.B-B.35 R:0.24183 P:0.24667 F:0.24423
35 ROUGE-1 Eval D0706-B.M.100.B-D.35 R:0.21824 P:0.22333 F:0.22076
35 ROUGE-1 Eval D0706-B.M.100.B-E.35 R:0.23052 P:0.23667 F:0.23355
35 ROUGE-1 Eval D0706-B.M.100.B-I.35 R:0.26537 P:0.27333 F:0.26929
35 ROUGE-1 Eval D0706-C.M.100.B-B.35 R:0.26129 P:0.17089 F:0.20664
35 ROUGE-1 Eval D0706-C.M.100.B-D.35 R:0.26774 P:0.17511 F:0.21174
35 ROUGE-1 Eval D0706-C.M.100.B-E.35 R:0.25321 P:0.16667 F:0.20102
35 ROUGE-1 Eval D0706-C.M.100.B-I.35 R:0.27796 P:0.18354 F:0.22109
35 ROUGE-1 Eval D0711-A.M.100.C-A.35 R:0.24671 P:0.15337 F:0.18915
35 ROUGE-1 Eval D0711-A.M.100.C-B.35 R:0.33000 P:0.20245 F:0.25095
35 ROUGE-1 Eval D0711-A.M.100.C-C.35 R:0.31000 P:0.19018 F:0.23574
35 ROUGE-1 Eval D0711-A.M.100.C-F.35 R:0.32781 P:0.20245 F:0.25031
35 ROUGE-1 Eval D0711-B.M.100.C-A.35 R:0.34014 P:0.22989 F:0.27435
35 ROUGE-1 Eval D0711-B.M.100.C-B.35 R:0.32534 P:0.21839 F:0.26135
35 ROUGE-1 Eval D0711-B.M.100.C-C.35 R:0.32550 P:0.22299 F:0.26467
35 ROUGE-1 Eval D0711-B.M.100.C-F.35 R:0.35254 P:0.23908 F:0.28493
35 ROUGE-1 Eval D0711-C.M.100.C-A.35 R:0.24422 P:0.17746 F:0.20556
35 ROUGE-1 Eval D0711-C.M.100.C-B.35 R:0.26962 P:0.18945 F:0.22253
35 ROUGE-1 Eval D0711-C.M.100.C-C.35 R:0.28041 P:0.19904 F:0.23282
35 ROUGE-1 Eval D0711-C.M.100.C-F.35 R:0.25676 P:0.18225 F:0.21318
35 ROUGE-1 Eval D0716-A.M.100.D-C.35 R:0.34754 P:0.21677 F:0.26700
35 ROUGE-1 Eval D0716-A.M.100.D-D.35 R:0.37000 P:0.22699 F:0.28137
35 ROUGE-1 Eval D0716-A.M.100.D-E.35 R:0.36877 P:0.22699 F:0.28101
35 ROUGE-1 Eval D0716-A.M.100.D-F.35 R:0.36304 P:0.22495 F:0.27778
35 ROUGE-1 Eval D0716-B.M.100.D-C.35 R:0.33553 P:0.25564 F:0.29019
35 ROUGE-1 Eval D0716-B.M.100.D-D.35 R:0.35906 P:0.26817 F:0.30703
35 ROUGE-1 Eval D0716-B.M.100.D-E.35 R:0.31894 P:0.24060 F:0.27429
35 ROUGE-1 Eval D0716-B.M.100.D-F.35 R:0.33333 P:0.25063 F:0.28612
35 ROUGE-1 Eval D0716-C.M.100.D-C.35 R:0.22476 P:0.15646 F:0.18449
35 ROUGE-1 Eval D0716-C.M.100.D-D.35 R:0.22074 P:0.14966 F:0.17838
35 ROUGE-1 Eval D0716-C.M.100.D-E.35 R:0.23102 P:0.15873 F:0.18817
35 ROUGE-1 Eval D0716-C.M.100.D-F.35 R:0.24667 P:0.16780 F:0.19973
35 ROUGE-1 Eval D0721-A.M.100.E-B.35 R:0.23000 P:0.15972 F:0.18852
35 ROUGE-1 Eval D0721-A.M.100.E-C.35 R:0.23052 P:0.16435 F:0.19189
35 ROUGE-1 Eval D0721-A.M.100.E-E.35 R:0.19805 P:0.14120 F:0.16486
35 ROUGE-1 Eval D0721-A.M.100.E-G.35 R:0.21975 P:0.15972 F:0.18499
35 ROUGE-1 Eval D0721-B.M.100.E-B.35 R:0.36482 P:0.22222 F:0.27620
35 ROUGE-1 Eval D0721-B.M.100.E-C.35 R:0.34076 P:0.21230 F:0.26161
35 ROUGE-1 Eval D0721-B.M.100.E-E.35 R:0.34754 P:0.21032 F:0.26205
35 ROUGE-1 Eval D0721-B.M.100.E-G.35 R:0.33548 P:0.20635 F:0.25553
35 ROUGE-1 Eval D0721-C.M.100.E-B.35 R:0.23279 P:0.22756 F:0.23015
35 ROUGE-1 Eval D0721-C.M.100.E-C.35 R:0.20792 P:0.20192 F:0.20488
35 ROUGE-1 Eval D0721-C.M.100.E-E.35 R:0.20000 P:0.19231 F:0.19608
35 ROUGE-1 Eval D0721-C.M.100.E-G.35 R:0.20847 P:0.20513 F:0.20679
35 ROUGE-1 Eval D0726-A.M.100.F-A.35 R:0.16611 P:0.10352 F:0.12755
35 ROUGE-1 Eval D0726-A.M.100.F-E.35 R:0.17000 P:0.10559 F:0.13027
35 ROUGE-1 Eval D0726-A.M.100.F-F.35 R:0.17940 P:0.11180 F:0.13775
35 ROUGE-1 Eval D0726-A.M.100.F-G.35 R:0.16279 P:0.10145 F:0.12500
35 ROUGE-1 Eval D0726-B.M.100.F-A.35 R:0.25490 P:0.19259 F:0.21941
35 ROUGE-1 Eval D0726-B.M.100.F-E.35 R:0.24917 P:0.18519 F:0.21247
35 ROUGE-1 Eval D0726-B.M.100.F-F.35 R:0.24917 P:0.18519 F:0.21247
35 ROUGE-1 Eval D0726-B.M.100.F-G.35 R:0.24671 P:0.18519 F:0.21157
35 ROUGE-1 Eval D0726-C.M.100.F-A.35 R:0.24667 P:0.12521 F:0.16610
35 ROUGE-1 Eval D0726-C.M.100.F-E.35 R:0.23569 P:0.11844 F:0.15765
35 ROUGE-1 Eval D0726-C.M.100.F-F.35 R:0.26102 P:0.13029 F:0.17382
35 ROUGE-1 Eval D0726-C.M.100.F-G.35 R:0.24918 P:0.12860 F:0.16965
35 ROUGE-1 Eval D0727-A.M.100.G-A.35 R:0.33887 P:0.29565 F:0.31579
35 ROUGE-1 Eval D0727-A.M.100.G-F.35 R:0.32237 P:0.28406 F:0.30200
35 ROUGE-1 Eval D0727-A.M.100.G-G.35 R:0.30719 P:0.27246 F:0.28878
35 ROUGE-1 Eval D0727-A.M.100.G-H.35 R:0.31579 P:0.27826 F:0.29584
35 ROUGE-1 Eval D0727-B.M.100.G-A.35 R:0.34708 P:0.21042 F:0.26200
35 ROUGE-1 Eval D0727-B.M.100.G-F.35 R:0.32143 P:0.20625 F:0.25127
35 ROUGE-1 Eval D0727-B.M.100.G-G.35 R:0.34256 P:0.20625 F:0.25748
35 ROUGE-1 Eval D0727-B.M.100.G-H.35 R:0.30241 P:0.18333 F:0.22827
35 ROUGE-1 Eval D0727-C.M.100.G-A.35 R:0.27036 P:0.15201 F:0.19460
35 ROUGE-1 Eval D0727-C.M.100.G-F.35 R:0.30303 P:0.16484 F:0.21353
35 ROUGE-1 Eval D0727-C.M.100.G-G.35 R:0.29043 P:0.16117 F:0.20730
35 ROUGE-1 Eval D0727-C.M.100.G-H.35 R:0.30405 P:0.16484 F:0.21378
35 ROUGE-1 Eval D0736-A.M.100.H-G.35 R:0.18638 P:0.10505 F:0.13437
35 ROUGE-1 Eval D0736-A.M.100.H-H.35 R:0.18613 P:0.10303 F:0.13264
35 ROUGE-1 Eval D0736-A.M.100.H-I.35 R:0.18861 P:0.10707 F:0.13660
35 ROUGE-1 Eval D0736-A.M.100.H-J.35 R:0.18627 P:0.11515 F:0.14232
35 ROUGE-1 Eval D0736-B.M.100.H-G.35 R:0.19084 P:0.10040 F:0.13158
35 ROUGE-1 Eval D0736-B.M.100.H-H.35 R:0.18595 P:0.09036 F:0.12162
35 ROUGE-1 Eval D0736-B.M.100.H-I.35 R:0.17573 P:0.08434 F:0.11398
35 ROUGE-1 Eval D0736-B.M.100.H-J.35 R:0.18182 P:0.10442 F:0.13266
35 ROUGE-1 Eval D0736-C.M.100.H-G.35 R:0.25316 P:0.12903 F:0.17094
35 ROUGE-1 Eval D0736-C.M.100.H-H.35 R:0.26738 P:0.10753 F:0.15338
35 ROUGE-1 Eval D0736-C.M.100.H-I.35 R:0.28877 P:0.11613 F:0.16565
35 ROUGE-1 Eval D0736-C.M.100.H-J.35 R:0.21887 P:0.12473 F:0.15890
35 ROUGE-1 Eval D0740-A.M.100.I-D.35 R:0.24092 P:0.18159 F:0.20709
35 ROUGE-1 Eval D0740-A.M.100.I-H.35 R:0.22222 P:0.16915 F:0.19209
35 ROUGE-1 Eval D0740-A.M.100.I-I.35 R:0.20779 P:0.15920 F:0.18028
35 ROUGE-1 Eval D0740-A.M.100.I-J.35 R:0.22903 P:0.17662 F:0.19944
35 ROUGE-1 Eval D0740-B.M.100.I-D.35 R:0.31494 P:0.23095 F:0.26648
35 ROUGE-1 Eval D0740-B.M.100.I-H.35 R:0.33444 P:0.24048 F:0.27978
35 ROUGE-1 Eval D0740-B.M.100.I-I.35 R:0.34754 P:0.25238 F:0.29241
35 ROUGE-1 Eval D0740-B.M.100.I-J.35 R:0.31715 P:0.23333 F:0.26886
35 ROUGE-1 Eval D0740-C.M.100.I-D.35 R:0.28115 P:0.22222 F:0.24824
35 ROUGE-1 Eval D0740-C.M.100.I-H.35 R:0.27331 P:0.21465 F:0.24045
35 ROUGE-1 Eval D0740-C.M.100.I-I.35 R:0.28115 P:0.22222 F:0.24824
35 ROUGE-1 Eval D0740-C.M.100.I-J.35 R:0.26752 P:0.21212 F:0.23662
35 ROUGE-1 Eval D0743-A.M.100.J-B.35 R:0.22857 P:0.21053 F:0.21918
35 ROUGE-1 Eval D0743-A.M.100.J-H.35 R:0.21296 P:0.20175 F:0.20720
35 ROUGE-1 Eval D0743-A.M.100.J-I.35 R:0.22812 P:0.21345 F:0.22054
35 ROUGE-1 Eval D0743-A.M.100.J-J.35 R:0.19077 P:0.18129 F:0.18591
35 ROUGE-1 Eval D0743-B.M.100.J-B.35 R:0.23077 P:0.16667 F:0.19355
35 ROUGE-1 Eval D0743-B.M.100.J-H.35 R:0.23028 P:0.16898 F:0.19492
35 ROUGE-1 Eval D0743-B.M.100.J-I.35 R:0.24367 P:0.17824 F:0.20588
35 ROUGE-1 Eval D0743-B.M.100.J-J.35 R:0.22430 P:0.16667 F:0.19124
35 ROUGE-1 Eval D0743-C.M.100.J-B.35 R:0.26984 P:0.21628 F:0.24011
35 ROUGE-1 Eval D0743-C.M.100.J-H.35 R:0.24204 P:0.19338 F:0.21499
35 ROUGE-1 Eval D0743-C.M.100.J-I.35 R:0.27157 P:0.21628 F:0.24079
35 ROUGE-1 Eval D0743-C.M.100.J-J.35 R:0.22642 P:0.18321 F:0.20254
---------------------------------------------
35 ROUGE-2 Average_R: 0.04577 (95%-conf.int. 0.04045 - 0.05085)
35 ROUGE-2 Average_P: 0.03203 (95%-conf.int. 0.02851 - 0.03545)
35 ROUGE-2 Average_F: 0.03742 (95%-conf.int. 0.03319 - 0.04139)
.............................................
35 ROUGE-2 Eval D0703-A.M.100.A-A.35 R:0.08191 P:0.06107 F:0.06997
35 ROUGE-2 Eval D0703-A.M.100.A-C.35 R:0.08814 P:0.06616 F:0.07558
35 ROUGE-2 Eval D0703-A.M.100.A-D.35 R:0.06944 P:0.05089 F:0.05874
35 ROUGE-2 Eval D0703-A.M.100.A-J.35 R:0.07904 P:0.05852 F:0.06725
35 ROUGE-2 Eval D0703-B.M.100.A-A.35 R:0.08251 P:0.05910 F:0.06887
35 ROUGE-2 Eval D0703-B.M.100.A-C.35 R:0.09153 P:0.06383 F:0.07521
35 ROUGE-2 Eval D0703-B.M.100.A-D.35 R:0.08814 P:0.06147 F:0.07243
35 ROUGE-2 Eval D0703-B.M.100.A-J.35 R:0.09060 P:0.06383 F:0.07489
35 ROUGE-2 Eval D0703-C.M.100.A-A.35 R:0.06061 P:0.04225 F:0.04979
35 ROUGE-2 Eval D0703-C.M.100.A-C.35 R:0.08525 P:0.06103 F:0.07113
35 ROUGE-2 Eval D0703-C.M.100.A-D.35 R:0.08027 P:0.05634 F:0.06621
35 ROUGE-2 Eval D0703-C.M.100.A-J.35 R:0.07358 P:0.05164 F:0.06069
35 ROUGE-2 Eval D0706-A.M.100.B-B.35 R:0.06885 P:0.04375 F:0.05350
35 ROUGE-2 Eval D0706-A.M.100.B-D.35 R:0.07261 P:0.04583 F:0.05619
35 ROUGE-2 Eval D0706-A.M.100.B-E.35 R:0.07213 P:0.04583 F:0.05605
35 ROUGE-2 Eval D0706-A.M.100.B-I.35 R:0.07213 P:0.04583 F:0.05605
35 ROUGE-2 Eval D0706-B.M.100.B-B.35 R:0.05281 P:0.05387 F:0.05333
35 ROUGE-2 Eval D0706-B.M.100.B-D.35 R:0.04934 P:0.05051 F:0.04992
35 ROUGE-2 Eval D0706-B.M.100.B-E.35 R:0.05574 P:0.05724 F:0.05648
35 ROUGE-2 Eval D0706-B.M.100.B-I.35 R:0.06863 P:0.07071 F:0.06965
35 ROUGE-2 Eval D0706-C.M.100.B-B.35 R:0.02280 P:0.01486 F:0.01799
35 ROUGE-2 Eval D0706-C.M.100.B-D.35 R:0.02280 P:0.01486 F:0.01799
35 ROUGE-2 Eval D0706-C.M.100.B-E.35 R:0.01942 P:0.01274 F:0.01539
35 ROUGE-2 Eval D0706-C.M.100.B-I.35 R:0.02258 P:0.01486 F:0.01792
35 ROUGE-2 Eval D0711-A.M.100.C-A.35 R:0.02990 P:0.01852 F:0.02287
35 ROUGE-2 Eval D0711-A.M.100.C-B.35 R:0.08754 P:0.05350 F:0.06641
35 ROUGE-2 Eval D0711-A.M.100.C-C.35 R:0.07407 P:0.04527 F:0.05619
35 ROUGE-2 Eval D0711-A.M.100.C-F.35 R:0.07023 P:0.04321 F:0.05350
35 ROUGE-2 Eval D0711-B.M.100.C-A.35 R:0.03093 P:0.02083 F:0.02489
35 ROUGE-2 Eval D0711-B.M.100.C-B.35 R:0.03460 P:0.02315 F:0.02774
35 ROUGE-2 Eval D0711-B.M.100.C-C.35 R:0.02373 P:0.01620 F:0.01925
35 ROUGE-2 Eval D0711-B.M.100.C-F.35 R:0.03425 P:0.02315 F:0.02763
35 ROUGE-2 Eval D0711-C.M.100.C-A.35 R:0.00667 P:0.00483 F:0.00560
35 ROUGE-2 Eval D0711-C.M.100.C-B.35 R:0.01034 P:0.00725 F:0.00852
35 ROUGE-2 Eval D0711-C.M.100.C-C.35 R:0.01024 P:0.00725 F:0.00849
35 ROUGE-2 Eval D0711-C.M.100.C-F.35 R:0.01365 P:0.00966 F:0.01131
35 ROUGE-2 Eval D0716-A.M.100.D-C.35 R:0.07616 P:0.04733 F:0.05838
35 ROUGE-2 Eval D0716-A.M.100.D-D.35 R:0.08754 P:0.05350 F:0.06641
35 ROUGE-2 Eval D0716-A.M.100.D-E.35 R:0.09396 P:0.05761 F:0.07143
35 ROUGE-2 Eval D0716-A.M.100.D-F.35 R:0.09333 P:0.05761 F:0.07124
35 ROUGE-2 Eval D0716-B.M.100.D-C.35 R:0.09967 P:0.07576 F:0.08609
35 ROUGE-2 Eval D0716-B.M.100.D-D.35 R:0.10169 P:0.07576 F:0.08683
35 ROUGE-2 Eval D0716-B.M.100.D-E.35 R:0.07383 P:0.05556 F:0.06341
35 ROUGE-2 Eval D0716-B.M.100.D-F.35 R:0.10774 P:0.08081 F:0.09235
35 ROUGE-2 Eval D0716-C.M.100.D-C.35 R:0.02961 P:0.02055 F:0.02426
35 ROUGE-2 Eval D0716-C.M.100.D-D.35 R:0.01014 P:0.00685 F:0.00818
35 ROUGE-2 Eval D0716-C.M.100.D-E.35 R:0.03000 P:0.02055 F:0.02439
35 ROUGE-2 Eval D0716-C.M.100.D-F.35 R:0.02020 P:0.01370 F:0.01633
35 ROUGE-2 Eval D0721-A.M.100.E-B.35 R:0.04377 P:0.03030 F:0.03581
35 ROUGE-2 Eval D0721-A.M.100.E-C.35 R:0.03934 P:0.02797 F:0.03269
35 ROUGE-2 Eval D0721-A.M.100.E-E.35 R:0.03934 P:0.02797 F:0.03269
35 ROUGE-2 Eval D0721-A.M.100.E-G.35 R:0.04502 P:0.03263 F:0.03784
35 ROUGE-2 Eval D0721-B.M.100.E-B.35 R:0.07566 P:0.04591 F:0.05714
35 ROUGE-2 Eval D0721-B.M.100.E-C.35 R:0.06752 P:0.04192 F:0.05173
35 ROUGE-2 Eval D0721-B.M.100.E-E.35 R:0.06623 P:0.03992 F:0.04981
35 ROUGE-2 Eval D0721-B.M.100.E-G.35 R:0.05537 P:0.03393 F:0.04208
35 ROUGE-2 Eval D0721-C.M.100.E-B.35 R:0.02318 P:0.02265 F:0.02291
35 ROUGE-2 Eval D0721-C.M.100.E-C.35 R:0.02000 P:0.01942 F:0.01971
35 ROUGE-2 Eval D0721-C.M.100.E-E.35 R:0.02357 P:0.02265 F:0.02310
35 ROUGE-2 Eval D0721-C.M.100.E-G.35 R:0.01316 P:0.01294 F:0.01305
35 ROUGE-2 Eval D0726-A.M.100.F-A.35 R:0.02013 P:0.01250 F:0.01542
35 ROUGE-2 Eval D0726-A.M.100.F-E.35 R:0.01684 P:0.01042 F:0.01287
35 ROUGE-2 Eval D0726-A.M.100.F-F.35 R:0.02013 P:0.01250 F:0.01542
35 ROUGE-2 Eval D0726-A.M.100.F-G.35 R:0.01342 P:0.00833 F:0.01028
35 ROUGE-2 Eval D0726-B.M.100.F-A.35 R:0.04290 P:0.03234 F:0.03688
35 ROUGE-2 Eval D0726-B.M.100.F-E.35 R:0.03691 P:0.02736 F:0.03143
35 ROUGE-2 Eval D0726-B.M.100.F-F.35 R:0.03691 P:0.02736 F:0.03143
35 ROUGE-2 Eval D0726-B.M.100.F-G.35 R:0.03322 P:0.02488 F:0.02845
35 ROUGE-2 Eval D0726-C.M.100.F-A.35 R:0.03704 P:0.01871 F:0.02486
35 ROUGE-2 Eval D0726-C.M.100.F-E.35 R:0.03741 P:0.01871 F:0.02494
35 ROUGE-2 Eval D0726-C.M.100.F-F.35 R:0.03767 P:0.01871 F:0.02500
35 ROUGE-2 Eval D0726-C.M.100.F-G.35 R:0.03974 P:0.02041 F:0.02697
35 ROUGE-2 Eval D0727-A.M.100.G-A.35 R:0.03356 P:0.02924 F:0.03125
35 ROUGE-2 Eval D0727-A.M.100.G-F.35 R:0.03654 P:0.03216 F:0.03421
35 ROUGE-2 Eval D0727-A.M.100.G-G.35 R:0.03300 P:0.02924 F:0.03101
35 ROUGE-2 Eval D0727-A.M.100.G-H.35 R:0.03654 P:0.03216 F:0.03421
35 ROUGE-2 Eval D0727-B.M.100.G-A.35 R:0.07639 P:0.04612 F:0.05752
35 ROUGE-2 Eval D0727-B.M.100.G-F.35 R:0.04918 P:0.03145 F:0.03837
35 ROUGE-2 Eval D0727-B.M.100.G-G.35 R:0.06643 P:0.03983 F:0.04980
35 ROUGE-2 Eval D0727-B.M.100.G-H.35 R:0.05556 P:0.03354 F:0.04183
35 ROUGE-2 Eval D0727-C.M.100.G-A.35 R:0.02303 P:0.01289 F:0.01653
35 ROUGE-2 Eval D0727-C.M.100.G-F.35 R:0.03401 P:0.01842 F:0.02390
35 ROUGE-2 Eval D0727-C.M.100.G-G.35 R:0.02667 P:0.01473 F:0.01898
35 ROUGE-2 Eval D0727-C.M.100.G-H.35 R:0.03754 P:0.02026 F:0.02632
35 ROUGE-2 Eval D0736-A.M.100.H-G.35 R:0.00362 P:0.00203 F:0.00260
35 ROUGE-2 Eval D0736-A.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-2 Eval D0736-A.M.100.H-I.35 R:0.00360 P:0.00203 F:0.00260
35 ROUGE-2 Eval D0736-A.M.100.H-J.35 R:0.00330 P:0.00203 F:0.00251
35 ROUGE-2 Eval D0736-B.M.100.H-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-2 Eval D0736-B.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-2 Eval D0736-B.M.100.H-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-2 Eval D0736-B.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-2 Eval D0736-C.M.100.H-G.35 R:0.05556 P:0.02814 F:0.03736
35 ROUGE-2 Eval D0736-C.M.100.H-H.35 R:0.08152 P:0.03247 F:0.04644
35 ROUGE-2 Eval D0736-C.M.100.H-I.35 R:0.07065 P:0.02814 F:0.04025
35 ROUGE-2 Eval D0736-C.M.100.H-J.35 R:0.03817 P:0.02165 F:0.02763
35 ROUGE-2 Eval D0740-A.M.100.I-D.35 R:0.03333 P:0.02506 F:0.02861
35 ROUGE-2 Eval D0740-A.M.100.I-H.35 R:0.03960 P:0.03008 F:0.03419
35 ROUGE-2 Eval D0740-A.M.100.I-I.35 R:0.02951 P:0.02256 F:0.02557
35 ROUGE-2 Eval D0740-A.M.100.I-J.35 R:0.02606 P:0.02005 F:0.02266
35 ROUGE-2 Eval D0740-B.M.100.I-D.35 R:0.09180 P:0.06715 F:0.07756
35 ROUGE-2 Eval D0740-B.M.100.I-H.35 R:0.11371 P:0.08153 F:0.09497
35 ROUGE-2 Eval D0740-B.M.100.I-I.35 R:0.11258 P:0.08153 F:0.09457
35 ROUGE-2 Eval D0740-B.M.100.I-J.35 R:0.07843 P:0.05755 F:0.06639
35 ROUGE-2 Eval D0740-C.M.100.I-D.35 R:0.01935 P:0.01527 F:0.01707
35 ROUGE-2 Eval D0740-C.M.100.I-H.35 R:0.01948 P:0.01527 F:0.01712
35 ROUGE-2 Eval D0740-C.M.100.I-I.35 R:0.02258 P:0.01781 F:0.01991
35 ROUGE-2 Eval D0740-C.M.100.I-J.35 R:0.02572 P:0.02036 F:0.02273
35 ROUGE-2 Eval D0743-A.M.100.J-B.35 R:0.03526 P:0.03245 F:0.03380
35 ROUGE-2 Eval D0743-A.M.100.J-H.35 R:0.02804 P:0.02655 F:0.02727
35 ROUGE-2 Eval D0743-A.M.100.J-I.35 R:0.03785 P:0.03540 F:0.03658
35 ROUGE-2 Eval D0743-A.M.100.J-J.35 R:0.01242 P:0.01180 F:0.01210
35 ROUGE-2 Eval D0743-B.M.100.J-B.35 R:0.01294 P:0.00932 F:0.01084
35 ROUGE-2 Eval D0743-B.M.100.J-H.35 R:0.01911 P:0.01399 F:0.01615
35 ROUGE-2 Eval D0743-B.M.100.J-I.35 R:0.01917 P:0.01399 F:0.01618
35 ROUGE-2 Eval D0743-B.M.100.J-J.35 R:0.01572 P:0.01166 F:0.01339
35 ROUGE-2 Eval D0743-C.M.100.J-B.35 R:0.05128 P:0.04103 F:0.04559
35 ROUGE-2 Eval D0743-C.M.100.J-H.35 R:0.05145 P:0.04103 F:0.04565
35 ROUGE-2 Eval D0743-C.M.100.J-I.35 R:0.05161 P:0.04103 F:0.04572
35 ROUGE-2 Eval D0743-C.M.100.J-J.35 R:0.03810 P:0.03077 F:0.03404
---------------------------------------------
35 ROUGE-3 Average_R: 0.01324 (95%-conf.int. 0.01056 - 0.01571)
35 ROUGE-3 Average_P: 0.00936 (95%-conf.int. 0.00747 - 0.01126)
35 ROUGE-3 Average_F: 0.01089 (95%-conf.int. 0.00871 - 0.01307)
.............................................
35 ROUGE-3 Eval D0703-A.M.100.A-A.35 R:0.03103 P:0.02308 F:0.02647
35 ROUGE-3 Eval D0703-A.M.100.A-C.35 R:0.03082 P:0.02308 F:0.02639
35 ROUGE-3 Eval D0703-A.M.100.A-D.35 R:0.02456 P:0.01795 F:0.02074
35 ROUGE-3 Eval D0703-A.M.100.A-J.35 R:0.01736 P:0.01282 F:0.01475
35 ROUGE-3 Eval D0703-B.M.100.A-A.35 R:0.02000 P:0.01429 F:0.01667
35 ROUGE-3 Eval D0703-B.M.100.A-C.35 R:0.01712 P:0.01190 F:0.01404
35 ROUGE-3 Eval D0703-B.M.100.A-D.35 R:0.02055 P:0.01429 F:0.01686
35 ROUGE-3 Eval D0703-B.M.100.A-J.35 R:0.02373 P:0.01667 F:0.01958
35 ROUGE-3 Eval D0703-C.M.100.A-A.35 R:0.01020 P:0.00709 F:0.00837
35 ROUGE-3 Eval D0703-C.M.100.A-C.35 R:0.02980 P:0.02128 F:0.02483
35 ROUGE-3 Eval D0703-C.M.100.A-D.35 R:0.02703 P:0.01891 F:0.02225
35 ROUGE-3 Eval D0703-C.M.100.A-J.35 R:0.02365 P:0.01655 F:0.01947
35 ROUGE-3 Eval D0706-A.M.100.B-B.35 R:0.01987 P:0.01258 F:0.01541
35 ROUGE-3 Eval D0706-A.M.100.B-D.35 R:0.03333 P:0.02096 F:0.02574
35 ROUGE-3 Eval D0706-A.M.100.B-E.35 R:0.02980 P:0.01887 F:0.02311
35 ROUGE-3 Eval D0706-A.M.100.B-I.35 R:0.02649 P:0.01677 F:0.02054
35 ROUGE-3 Eval D0706-B.M.100.B-B.35 R:0.02000 P:0.02041 F:0.02020
35 ROUGE-3 Eval D0706-B.M.100.B-D.35 R:0.01661 P:0.01701 F:0.01681
35 ROUGE-3 Eval D0706-B.M.100.B-E.35 R:0.02318 P:0.02381 F:0.02349
35 ROUGE-3 Eval D0706-B.M.100.B-I.35 R:0.02970 P:0.03061 F:0.03015
35 ROUGE-3 Eval D0706-C.M.100.B-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0706-C.M.100.B-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0706-C.M.100.B-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0706-C.M.100.B-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0711-A.M.100.C-A.35 R:0.00671 P:0.00414 F:0.00512
35 ROUGE-3 Eval D0711-A.M.100.C-B.35 R:0.02721 P:0.01656 F:0.02059
35 ROUGE-3 Eval D0711-A.M.100.C-C.35 R:0.02381 P:0.01449 F:0.01802
35 ROUGE-3 Eval D0711-A.M.100.C-F.35 R:0.02365 P:0.01449 F:0.01797
35 ROUGE-3 Eval D0711-B.M.100.C-A.35 R:0.00694 P:0.00466 F:0.00558
35 ROUGE-3 Eval D0711-B.M.100.C-B.35 R:0.00699 P:0.00466 F:0.00559
35 ROUGE-3 Eval D0711-B.M.100.C-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0711-B.M.100.C-F.35 R:0.00692 P:0.00466 F:0.00557
35 ROUGE-3 Eval D0711-C.M.100.C-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0711-C.M.100.C-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0711-C.M.100.C-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0711-C.M.100.C-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0716-A.M.100.D-C.35 R:0.02676 P:0.01656 F:0.02046
35 ROUGE-3 Eval D0716-A.M.100.D-D.35 R:0.03061 P:0.01863 F:0.02316
35 ROUGE-3 Eval D0716-A.M.100.D-E.35 R:0.02712 P:0.01656 F:0.02056
35 ROUGE-3 Eval D0716-A.M.100.D-F.35 R:0.02694 P:0.01656 F:0.02051
35 ROUGE-3 Eval D0716-B.M.100.D-C.35 R:0.03356 P:0.02545 F:0.02895
35 ROUGE-3 Eval D0716-B.M.100.D-D.35 R:0.03767 P:0.02799 F:0.03212
35 ROUGE-3 Eval D0716-B.M.100.D-E.35 R:0.01695 P:0.01272 F:0.01453
35 ROUGE-3 Eval D0716-B.M.100.D-F.35 R:0.04422 P:0.03308 F:0.03785
35 ROUGE-3 Eval D0716-C.M.100.D-C.35 R:0.00332 P:0.00230 F:0.00272
35 ROUGE-3 Eval D0716-C.M.100.D-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0716-C.M.100.D-E.35 R:0.00337 P:0.00230 F:0.00273
35 ROUGE-3 Eval D0716-C.M.100.D-F.35 R:0.00340 P:0.00230 F:0.00274
35 ROUGE-3 Eval D0721-A.M.100.E-B.35 R:0.01361 P:0.00939 F:0.01111
35 ROUGE-3 Eval D0721-A.M.100.E-C.35 R:0.00993 P:0.00704 F:0.00824
35 ROUGE-3 Eval D0721-A.M.100.E-E.35 R:0.00331 P:0.00235 F:0.00275
35 ROUGE-3 Eval D0721-A.M.100.E-G.35 R:0.01299 P:0.00939 F:0.01090
35 ROUGE-3 Eval D0721-B.M.100.E-B.35 R:0.01993 P:0.01205 F:0.01502
35 ROUGE-3 Eval D0721-B.M.100.E-C.35 R:0.01623 P:0.01004 F:0.01241
35 ROUGE-3 Eval D0721-B.M.100.E-E.35 R:0.02341 P:0.01406 F:0.01757
35 ROUGE-3 Eval D0721-B.M.100.E-G.35 R:0.00987 P:0.00602 F:0.00748
35 ROUGE-3 Eval D0721-C.M.100.E-B.35 R:0.01003 P:0.00980 F:0.00991
35 ROUGE-3 Eval D0721-C.M.100.E-C.35 R:0.01010 P:0.00980 F:0.00995
35 ROUGE-3 Eval D0721-C.M.100.E-E.35 R:0.01020 P:0.00980 F:0.01000
35 ROUGE-3 Eval D0721-C.M.100.E-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0726-A.M.100.F-A.35 R:0.00678 P:0.00419 F:0.00518
35 ROUGE-3 Eval D0726-A.M.100.F-E.35 R:0.00680 P:0.00419 F:0.00519
35 ROUGE-3 Eval D0726-A.M.100.F-F.35 R:0.00678 P:0.00419 F:0.00518
35 ROUGE-3 Eval D0726-A.M.100.F-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0726-B.M.100.F-A.35 R:0.02000 P:0.01504 F:0.01717
35 ROUGE-3 Eval D0726-B.M.100.F-E.35 R:0.01695 P:0.01253 F:0.01441
35 ROUGE-3 Eval D0726-B.M.100.F-F.35 R:0.01356 P:0.01003 F:0.01153
35 ROUGE-3 Eval D0726-B.M.100.F-G.35 R:0.01007 P:0.00752 F:0.00861
35 ROUGE-3 Eval D0726-C.M.100.F-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0726-C.M.100.F-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0726-C.M.100.F-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0726-C.M.100.F-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0727-A.M.100.G-A.35 R:0.00339 P:0.00295 F:0.00315
35 ROUGE-3 Eval D0727-A.M.100.G-F.35 R:0.00671 P:0.00590 F:0.00628
35 ROUGE-3 Eval D0727-A.M.100.G-G.35 R:0.00333 P:0.00295 F:0.00313
35 ROUGE-3 Eval D0727-A.M.100.G-H.35 R:0.00671 P:0.00590 F:0.00628
35 ROUGE-3 Eval D0727-B.M.100.G-A.35 R:0.02456 P:0.01477 F:0.01845
35 ROUGE-3 Eval D0727-B.M.100.G-F.35 R:0.00331 P:0.00211 F:0.00258
35 ROUGE-3 Eval D0727-B.M.100.G-G.35 R:0.02473 P:0.01477 F:0.01849
35 ROUGE-3 Eval D0727-B.M.100.G-H.35 R:0.02105 P:0.01266 F:0.01581
35 ROUGE-3 Eval D0727-C.M.100.G-A.35 R:0.00332 P:0.00185 F:0.00238
35 ROUGE-3 Eval D0727-C.M.100.G-F.35 R:0.00687 P:0.00370 F:0.00481
35 ROUGE-3 Eval D0727-C.M.100.G-G.35 R:0.00337 P:0.00185 F:0.00239
35 ROUGE-3 Eval D0727-C.M.100.G-H.35 R:0.00690 P:0.00370 F:0.00482
35 ROUGE-3 Eval D0736-A.M.100.H-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-A.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-A.M.100.H-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-A.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-B.M.100.H-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-B.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-B.M.100.H-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-B.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0736-C.M.100.H-G.35 R:0.02165 P:0.01089 F:0.01449
35 ROUGE-3 Eval D0736-C.M.100.H-H.35 R:0.02762 P:0.01089 F:0.01562
35 ROUGE-3 Eval D0736-C.M.100.H-I.35 R:0.02210 P:0.00871 F:0.01250
35 ROUGE-3 Eval D0736-C.M.100.H-J.35 R:0.00386 P:0.00218 F:0.00279
35 ROUGE-3 Eval D0740-A.M.100.I-D.35 R:0.00673 P:0.00505 F:0.00577
35 ROUGE-3 Eval D0740-A.M.100.I-H.35 R:0.01000 P:0.00758 F:0.00862
35 ROUGE-3 Eval D0740-A.M.100.I-I.35 R:0.00662 P:0.00505 F:0.00573
35 ROUGE-3 Eval D0740-A.M.100.I-J.35 R:0.00658 P:0.00505 F:0.00571
35 ROUGE-3 Eval D0740-B.M.100.I-D.35 R:0.05298 P:0.03865 F:0.04469
35 ROUGE-3 Eval D0740-B.M.100.I-H.35 R:0.07095 P:0.05072 F:0.05915
35 ROUGE-3 Eval D0740-B.M.100.I-I.35 R:0.06689 P:0.04831 F:0.05610
35 ROUGE-3 Eval D0740-B.M.100.I-J.35 R:0.03960 P:0.02899 F:0.03347
35 ROUGE-3 Eval D0740-C.M.100.I-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0740-C.M.100.I-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0740-C.M.100.I-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0740-C.M.100.I-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0743-A.M.100.J-B.35 R:0.01294 P:0.01190 F:0.01240
35 ROUGE-3 Eval D0743-A.M.100.J-H.35 R:0.00943 P:0.00893 F:0.00917
35 ROUGE-3 Eval D0743-A.M.100.J-I.35 R:0.01274 P:0.01190 F:0.01231
35 ROUGE-3 Eval D0743-A.M.100.J-J.35 R:0.00313 P:0.00298 F:0.00305
35 ROUGE-3 Eval D0743-B.M.100.J-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-3 Eval D0743-B.M.100.J-H.35 R:0.00322 P:0.00235 F:0.00272
35 ROUGE-3 Eval D0743-B.M.100.J-I.35 R:0.00323 P:0.00235 F:0.00272
35 ROUGE-3 Eval D0743-B.M.100.J-J.35 R:0.00317 P:0.00235 F:0.00270
35 ROUGE-3 Eval D0743-C.M.100.J-B.35 R:0.00971 P:0.00775 F:0.00862
35 ROUGE-3 Eval D0743-C.M.100.J-H.35 R:0.00974 P:0.00775 F:0.00863
35 ROUGE-3 Eval D0743-C.M.100.J-I.35 R:0.00977 P:0.00775 F:0.00864
35 ROUGE-3 Eval D0743-C.M.100.J-J.35 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
35 ROUGE-4 Average_R: 0.00577 (95%-conf.int. 0.00431 - 0.00737)
35 ROUGE-4 Average_P: 0.00406 (95%-conf.int. 0.00302 - 0.00518)
35 ROUGE-4 Average_F: 0.00473 (95%-conf.int. 0.00352 - 0.00603)
.............................................
35 ROUGE-4 Eval D0703-A.M.100.A-A.35 R:0.01742 P:0.01292 F:0.01484
35 ROUGE-4 Eval D0703-A.M.100.A-C.35 R:0.01730 P:0.01292 F:0.01479
35 ROUGE-4 Eval D0703-A.M.100.A-D.35 R:0.01418 P:0.01034 F:0.01196
35 ROUGE-4 Eval D0703-A.M.100.A-J.35 R:0.00351 P:0.00258 F:0.00297
35 ROUGE-4 Eval D0703-B.M.100.A-A.35 R:0.00337 P:0.00240 F:0.00280
35 ROUGE-4 Eval D0703-B.M.100.A-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0703-B.M.100.A-D.35 R:0.00346 P:0.00240 F:0.00283
35 ROUGE-4 Eval D0703-B.M.100.A-J.35 R:0.00342 P:0.00240 F:0.00282
35 ROUGE-4 Eval D0703-C.M.100.A-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0703-C.M.100.A-C.35 R:0.01338 P:0.00952 F:0.01112
35 ROUGE-4 Eval D0703-C.M.100.A-D.35 R:0.01365 P:0.00952 F:0.01122
35 ROUGE-4 Eval D0703-C.M.100.A-J.35 R:0.01365 P:0.00952 F:0.01122
35 ROUGE-4 Eval D0706-A.M.100.B-B.35 R:0.01003 P:0.00633 F:0.00776
35 ROUGE-4 Eval D0706-A.M.100.B-D.35 R:0.02020 P:0.01266 F:0.01556
35 ROUGE-4 Eval D0706-A.M.100.B-E.35 R:0.01672 P:0.01055 F:0.01294
35 ROUGE-4 Eval D0706-A.M.100.B-I.35 R:0.01338 P:0.00844 F:0.01035
35 ROUGE-4 Eval D0706-B.M.100.B-B.35 R:0.01010 P:0.01031 F:0.01020
35 ROUGE-4 Eval D0706-B.M.100.B-D.35 R:0.00671 P:0.00687 F:0.00679
35 ROUGE-4 Eval D0706-B.M.100.B-E.35 R:0.01003 P:0.01031 F:0.01017
35 ROUGE-4 Eval D0706-B.M.100.B-I.35 R:0.01333 P:0.01375 F:0.01354
35 ROUGE-4 Eval D0706-C.M.100.B-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0706-C.M.100.B-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0706-C.M.100.B-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0706-C.M.100.B-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-A.M.100.C-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-A.M.100.C-B.35 R:0.01031 P:0.00625 F:0.00778
35 ROUGE-4 Eval D0711-A.M.100.C-C.35 R:0.01031 P:0.00625 F:0.00778
35 ROUGE-4 Eval D0711-A.M.100.C-F.35 R:0.01024 P:0.00625 F:0.00776
35 ROUGE-4 Eval D0711-B.M.100.C-A.35 R:0.00351 P:0.00235 F:0.00282
35 ROUGE-4 Eval D0711-B.M.100.C-B.35 R:0.00353 P:0.00235 F:0.00282
35 ROUGE-4 Eval D0711-B.M.100.C-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-B.M.100.C-F.35 R:0.00350 P:0.00235 F:0.00281
35 ROUGE-4 Eval D0711-C.M.100.C-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-C.M.100.C-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-C.M.100.C-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0711-C.M.100.C-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0716-A.M.100.D-C.35 R:0.01014 P:0.00625 F:0.00773
35 ROUGE-4 Eval D0716-A.M.100.D-D.35 R:0.01031 P:0.00625 F:0.00778
35 ROUGE-4 Eval D0716-A.M.100.D-E.35 R:0.01027 P:0.00625 F:0.00777
35 ROUGE-4 Eval D0716-A.M.100.D-F.35 R:0.01020 P:0.00625 F:0.00775
35 ROUGE-4 Eval D0716-B.M.100.D-C.35 R:0.02034 P:0.01538 F:0.01752
35 ROUGE-4 Eval D0716-B.M.100.D-D.35 R:0.02076 P:0.01538 F:0.01767
35 ROUGE-4 Eval D0716-B.M.100.D-E.35 R:0.00685 P:0.00513 F:0.00587
35 ROUGE-4 Eval D0716-B.M.100.D-F.35 R:0.02405 P:0.01795 F:0.02056
35 ROUGE-4 Eval D0716-C.M.100.D-C.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0716-C.M.100.D-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0716-C.M.100.D-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0716-C.M.100.D-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0721-A.M.100.E-B.35 R:0.00687 P:0.00473 F:0.00560
35 ROUGE-4 Eval D0721-A.M.100.E-C.35 R:0.00669 P:0.00473 F:0.00554
35 ROUGE-4 Eval D0721-A.M.100.E-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0721-A.M.100.E-G.35 R:0.00656 P:0.00473 F:0.00550
35 ROUGE-4 Eval D0721-B.M.100.E-B.35 R:0.00671 P:0.00404 F:0.00504
35 ROUGE-4 Eval D0721-B.M.100.E-C.35 R:0.00328 P:0.00202 F:0.00250
35 ROUGE-4 Eval D0721-B.M.100.E-E.35 R:0.00676 P:0.00404 F:0.00506
35 ROUGE-4 Eval D0721-B.M.100.E-G.35 R:0.00332 P:0.00202 F:0.00251
35 ROUGE-4 Eval D0721-C.M.100.E-B.35 R:0.00676 P:0.00660 F:0.00668
35 ROUGE-4 Eval D0721-C.M.100.E-C.35 R:0.00680 P:0.00660 F:0.00670
35 ROUGE-4 Eval D0721-C.M.100.E-E.35 R:0.00687 P:0.00660 F:0.00673
35 ROUGE-4 Eval D0721-C.M.100.E-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0726-A.M.100.F-A.35 R:0.00342 P:0.00211 F:0.00261
35 ROUGE-4 Eval D0726-A.M.100.F-E.35 R:0.00344 P:0.00211 F:0.00262
35 ROUGE-4 Eval D0726-A.M.100.F-F.35 R:0.00342 P:0.00211 F:0.00261
35 ROUGE-4 Eval D0726-A.M.100.F-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0726-B.M.100.F-A.35 R:0.00673 P:0.00505 F:0.00577
35 ROUGE-4 Eval D0726-B.M.100.F-E.35 R:0.00685 P:0.00505 F:0.00581
35 ROUGE-4 Eval D0726-B.M.100.F-F.35 R:0.00342 P:0.00253 F:0.00291
35 ROUGE-4 Eval D0726-B.M.100.F-G.35 R:0.00339 P:0.00253 F:0.00290
35 ROUGE-4 Eval D0726-C.M.100.F-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0726-C.M.100.F-E.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0726-C.M.100.F-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0726-C.M.100.F-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-A.M.100.G-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-A.M.100.G-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-A.M.100.G-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-A.M.100.G-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-B.M.100.G-A.35 R:0.01064 P:0.00637 F:0.00797
35 ROUGE-4 Eval D0727-B.M.100.G-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-B.M.100.G-G.35 R:0.01071 P:0.00637 F:0.00799
35 ROUGE-4 Eval D0727-B.M.100.G-H.35 R:0.01064 P:0.00637 F:0.00797
35 ROUGE-4 Eval D0727-C.M.100.G-A.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-C.M.100.G-F.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-C.M.100.G-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0727-C.M.100.G-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-A.M.100.H-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-A.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-A.M.100.H-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-A.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-B.M.100.H-G.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-B.M.100.H-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-B.M.100.H-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-B.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0736-C.M.100.H-G.35 R:0.01316 P:0.00658 F:0.00877
35 ROUGE-4 Eval D0736-C.M.100.H-H.35 R:0.01685 P:0.00658 F:0.00946
35 ROUGE-4 Eval D0736-C.M.100.H-I.35 R:0.01685 P:0.00658 F:0.00946
35 ROUGE-4 Eval D0736-C.M.100.H-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-A.M.100.I-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-A.M.100.I-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-A.M.100.I-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-A.M.100.I-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-B.M.100.I-D.35 R:0.03344 P:0.02433 F:0.02817
35 ROUGE-4 Eval D0740-B.M.100.I-H.35 R:0.04778 P:0.03406 F:0.03977
35 ROUGE-4 Eval D0740-B.M.100.I-I.35 R:0.04054 P:0.02920 F:0.03395
35 ROUGE-4 Eval D0740-B.M.100.I-J.35 R:0.02000 P:0.01460 F:0.01688
35 ROUGE-4 Eval D0740-C.M.100.I-D.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-C.M.100.I-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-C.M.100.I-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0740-C.M.100.I-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-A.M.100.J-B.35 R:0.00654 P:0.00601 F:0.00626
35 ROUGE-4 Eval D0743-A.M.100.J-H.35 R:0.00635 P:0.00601 F:0.00618
35 ROUGE-4 Eval D0743-A.M.100.J-I.35 R:0.00643 P:0.00601 F:0.00621
35 ROUGE-4 Eval D0743-A.M.100.J-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-B.M.100.J-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-B.M.100.J-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-B.M.100.J-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-B.M.100.J-J.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-C.M.100.J-B.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-C.M.100.J-H.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-C.M.100.J-I.35 R:0.00000 P:0.00000 F:0.00000
35 ROUGE-4 Eval D0743-C.M.100.J-J.35 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
35 ROUGE-L Average_R: 0.24033 (95%-conf.int. 0.23099 - 0.24887)
35 ROUGE-L Average_P: 0.16801 (95%-conf.int. 0.16033 - 0.17530)
35 ROUGE-L Average_F: 0.19631 (95%-conf.int. 0.18823 - 0.20387)
.............................................
35 ROUGE-L Eval D0703-A.M.100.A-A.35 R:0.31757 P:0.23737 F:0.27167
35 ROUGE-L Eval D0703-A.M.100.A-C.35 R:0.30872 P:0.23232 F:0.26513
35 ROUGE-L Eval D0703-A.M.100.A-D.35 R:0.29897 P:0.21970 F:0.25328
35 ROUGE-L Eval D0703-A.M.100.A-J.35 R:0.31633 P:0.23485 F:0.26957
35 ROUGE-L Eval D0703-B.M.100.A-A.35 R:0.29085 P:0.20892 F:0.24317
35 ROUGE-L Eval D0703-B.M.100.A-C.35 R:0.32215 P:0.22535 F:0.26519
35 ROUGE-L Eval D0703-B.M.100.A-D.35 R:0.30201 P:0.21127 F:0.24862
35 ROUGE-L Eval D0703-B.M.100.A-J.35 R:0.30233 P:0.21362 F:0.25035
35 ROUGE-L Eval D0703-C.M.100.A-A.35 R:0.29000 P:0.20280 F:0.23869
35 ROUGE-L Eval D0703-C.M.100.A-C.35 R:0.29545 P:0.21212 F:0.24694
35 ROUGE-L Eval D0703-C.M.100.A-D.35 R:0.29139 P:0.20513 F:0.24077
35 ROUGE-L Eval D0703-C.M.100.A-J.35 R:0.28146 P:0.19814 F:0.23256
35 ROUGE-L Eval D0706-A.M.100.B-B.35 R:0.32143 P:0.20497 F:0.25032
35 ROUGE-L Eval D0706-A.M.100.B-D.35 R:0.27778 P:0.17598 F:0.21546
35 ROUGE-L Eval D0706-A.M.100.B-E.35 R:0.28247 P:0.18012 F:0.21997
35 ROUGE-L Eval D0706-A.M.100.B-I.35 R:0.27922 P:0.17805 F:0.21744
35 ROUGE-L Eval D0706-B.M.100.B-B.35 R:0.21895 P:0.22333 F:0.22112
35 ROUGE-L Eval D0706-B.M.100.B-D.35 R:0.19870 P:0.20333 F:0.20099
35 ROUGE-L Eval D0706-B.M.100.B-E.35 R:0.20779 P:0.21333 F:0.21052
35 ROUGE-L Eval D0706-B.M.100.B-I.35 R:0.24272 P:0.25000 F:0.24631
35 ROUGE-L Eval D0706-C.M.100.B-B.35 R:0.22903 P:0.14979 F:0.18112
35 ROUGE-L Eval D0706-C.M.100.B-D.35 R:0.22903 P:0.14979 F:0.18112
35 ROUGE-L Eval D0706-C.M.100.B-E.35 R:0.22115 P:0.14557 F:0.17557
35 ROUGE-L Eval D0706-C.M.100.B-I.35 R:0.23642 P:0.15612 F:0.18806
35 ROUGE-L Eval D0711-A.M.100.C-A.35 R:0.21382 P:0.13292 F:0.16393
35 ROUGE-L Eval D0711-A.M.100.C-B.35 R:0.28000 P:0.17178 F:0.21293
35 ROUGE-L Eval D0711-A.M.100.C-C.35 R:0.26000 P:0.15951 F:0.19772
35 ROUGE-L Eval D0711-A.M.100.C-F.35 R:0.27152 P:0.16769 F:0.20733
35 ROUGE-L Eval D0711-B.M.100.C-A.35 R:0.28912 P:0.19540 F:0.23320
35 ROUGE-L Eval D0711-B.M.100.C-B.35 R:0.25000 P:0.16782 F:0.20083
35 ROUGE-L Eval D0711-B.M.100.C-C.35 R:0.25168 P:0.17241 F:0.20464
35 ROUGE-L Eval D0711-B.M.100.C-F.35 R:0.27797 P:0.18851 F:0.22466
35 ROUGE-L Eval D0711-C.M.100.C-A.35 R:0.21122 P:0.15348 F:0.17778
35 ROUGE-L Eval D0711-C.M.100.C-B.35 R:0.21843 P:0.15348 F:0.18028
35 ROUGE-L Eval D0711-C.M.100.C-C.35 R:0.22635 P:0.16067 F:0.18794
35 ROUGE-L Eval D0711-C.M.100.C-F.35 R:0.20270 P:0.14388 F:0.16830
35 ROUGE-L Eval D0716-A.M.100.D-C.35 R:0.30492 P:0.19018 F:0.23425
35 ROUGE-L Eval D0716-A.M.100.D-D.35 R:0.32000 P:0.19632 F:0.24335
35 ROUGE-L Eval D0716-A.M.100.D-E.35 R:0.32226 P:0.19836 F:0.24557
35 ROUGE-L Eval D0716-A.M.100.D-F.35 R:0.32343 P:0.20041 F:0.24747
35 ROUGE-L Eval D0716-B.M.100.D-C.35 R:0.29276 P:0.22306 F:0.25320
35 ROUGE-L Eval D0716-B.M.100.D-D.35 R:0.32215 P:0.24060 F:0.27547
35 ROUGE-L Eval D0716-B.M.100.D-E.35 R:0.28571 P:0.21554 F:0.24571
35 ROUGE-L Eval D0716-B.M.100.D-F.35 R:0.30667 P:0.23058 F:0.26324
35 ROUGE-L Eval D0716-C.M.100.D-C.35 R:0.17590 P:0.12245 F:0.14439
35 ROUGE-L Eval D0716-C.M.100.D-D.35 R:0.15719 P:0.10658 F:0.12703
35 ROUGE-L Eval D0716-C.M.100.D-E.35 R:0.18152 P:0.12472 F:0.14785
35 ROUGE-L Eval D0716-C.M.100.D-F.35 R:0.18000 P:0.12245 F:0.14575
35 ROUGE-L Eval D0721-A.M.100.E-B.35 R:0.21667 P:0.15046 F:0.17759
35 ROUGE-L Eval D0721-A.M.100.E-C.35 R:0.20779 P:0.14815 F:0.17297
35 ROUGE-L Eval D0721-A.M.100.E-E.35 R:0.17857 P:0.12731 F:0.14864
35 ROUGE-L Eval D0721-A.M.100.E-G.35 R:0.19745 P:0.14352 F:0.16622
35 ROUGE-L Eval D0721-B.M.100.E-B.35 R:0.31270 P:0.19048 F:0.23675
35 ROUGE-L Eval D0721-B.M.100.E-C.35 R:0.29936 P:0.18651 F:0.22983
35 ROUGE-L Eval D0721-B.M.100.E-E.35 R:0.29836 P:0.18056 F:0.22497
35 ROUGE-L Eval D0721-B.M.100.E-G.35 R:0.28387 P:0.17460 F:0.21621
35 ROUGE-L Eval D0721-C.M.100.E-B.35 R:0.18689 P:0.18269 F:0.18477
35 ROUGE-L Eval D0721-C.M.100.E-C.35 R:0.16502 P:0.16026 F:0.16261
35 ROUGE-L Eval D0721-C.M.100.E-E.35 R:0.16000 P:0.15385 F:0.15686
35 ROUGE-L Eval D0721-C.M.100.E-G.35 R:0.16938 P:0.16667 F:0.16801
35 ROUGE-L Eval D0726-A.M.100.F-A.35 R:0.14618 P:0.09110 F:0.11225
35 ROUGE-L Eval D0726-A.M.100.F-E.35 R:0.14667 P:0.09110 F:0.11239
35 ROUGE-L Eval D0726-A.M.100.F-F.35 R:0.15615 P:0.09731 F:0.11990
35 ROUGE-L Eval D0726-A.M.100.F-G.35 R:0.14950 P:0.09317 F:0.11480
35 ROUGE-L Eval D0726-B.M.100.F-A.35 R:0.23856 P:0.18025 F:0.20535
35 ROUGE-L Eval D0726-B.M.100.F-E.35 R:0.22591 P:0.16790 F:0.19263
35 ROUGE-L Eval D0726-B.M.100.F-F.35 R:0.21927 P:0.16296 F:0.18697
35 ROUGE-L Eval D0726-B.M.100.F-G.35 R:0.22697 P:0.17037 F:0.19464
35 ROUGE-L Eval D0726-C.M.100.F-A.35 R:0.22333 P:0.11337 F:0.15039
35 ROUGE-L Eval D0726-C.M.100.F-E.35 R:0.21212 P:0.10660 F:0.14189
35 ROUGE-L Eval D0726-C.M.100.F-F.35 R:0.23390 P:0.11675 F:0.15576
35 ROUGE-L Eval D0726-C.M.100.F-G.35 R:0.22295 P:0.11506 F:0.15179
35 ROUGE-L Eval D0727-A.M.100.G-A.35 R:0.30233 P:0.26377 F:0.28174
35 ROUGE-L Eval D0727-A.M.100.G-F.35 R:0.27632 P:0.24348 F:0.25886
35 ROUGE-L Eval D0727-A.M.100.G-G.35 R:0.26144 P:0.23188 F:0.24577
35 ROUGE-L Eval D0727-A.M.100.G-H.35 R:0.27632 P:0.24348 F:0.25886
35 ROUGE-L Eval D0727-B.M.100.G-A.35 R:0.32646 P:0.19792 F:0.24644
35 ROUGE-L Eval D0727-B.M.100.G-F.35 R:0.29870 P:0.19167 F:0.23350
35 ROUGE-L Eval D0727-B.M.100.G-G.35 R:0.32180 P:0.19375 F:0.24187
35 ROUGE-L Eval D0727-B.M.100.G-H.35 R:0.28522 P:0.17292 F:0.21531
35 ROUGE-L Eval D0727-C.M.100.G-A.35 R:0.25407 P:0.14286 F:0.18289
35 ROUGE-L Eval D0727-C.M.100.G-F.35 R:0.27609 P:0.15018 F:0.19454
35 ROUGE-L Eval D0727-C.M.100.G-G.35 R:0.27063 P:0.15018 F:0.19317
35 ROUGE-L Eval D0727-C.M.100.G-H.35 R:0.28716 P:0.15568 F:0.20190
35 ROUGE-L Eval D0736-A.M.100.H-G.35 R:0.17921 P:0.10101 F:0.12920
35 ROUGE-L Eval D0736-A.M.100.H-H.35 R:0.17153 P:0.09495 F:0.12224
35 ROUGE-L Eval D0736-A.M.100.H-I.35 R:0.17438 P:0.09899 F:0.12629
35 ROUGE-L Eval D0736-A.M.100.H-J.35 R:0.17974 P:0.11111 F:0.13733
35 ROUGE-L Eval D0736-B.M.100.H-G.35 R:0.17939 P:0.09438 F:0.12369
35 ROUGE-L Eval D0736-B.M.100.H-H.35 R:0.17769 P:0.08635 F:0.11622
35 ROUGE-L Eval D0736-B.M.100.H-I.35 R:0.16736 P:0.08032 F:0.10855
35 ROUGE-L Eval D0736-B.M.100.H-J.35 R:0.17483 P:0.10040 F:0.12755
35 ROUGE-L Eval D0736-C.M.100.H-G.35 R:0.21941 P:0.11183 F:0.14815
35 ROUGE-L Eval D0736-C.M.100.H-H.35 R:0.22995 P:0.09247 F:0.13190
35 ROUGE-L Eval D0736-C.M.100.H-I.35 R:0.24064 P:0.09677 F:0.13803
35 ROUGE-L Eval D0736-C.M.100.H-J.35 R:0.18491 P:0.10538 F:0.13425
35 ROUGE-L Eval D0740-A.M.100.I-D.35 R:0.21122 P:0.15920 F:0.18156
35 ROUGE-L Eval D0740-A.M.100.I-H.35 R:0.20261 P:0.15423 F:0.17514
35 ROUGE-L Eval D0740-A.M.100.I-I.35 R:0.19156 P:0.14677 F:0.16620
35 ROUGE-L Eval D0740-A.M.100.I-J.35 R:0.20645 P:0.15920 F:0.17977
35 ROUGE-L Eval D0740-B.M.100.I-D.35 R:0.29545 P:0.21667 F:0.25000
35 ROUGE-L Eval D0740-B.M.100.I-H.35 R:0.30795 P:0.22143 F:0.25762
35 ROUGE-L Eval D0740-B.M.100.I-I.35 R:0.31148 P:0.22619 F:0.26207
35 ROUGE-L Eval D0740-B.M.100.I-J.35 R:0.29126 P:0.21429 F:0.24692
35 ROUGE-L Eval D0740-C.M.100.I-D.35 R:0.22045 P:0.17424 F:0.19464
35 ROUGE-L Eval D0740-C.M.100.I-H.35 R:0.22186 P:0.17424 F:0.19519
35 ROUGE-L Eval D0740-C.M.100.I-I.35 R:0.22364 P:0.17677 F:0.19746
35 ROUGE-L Eval D0740-C.M.100.I-J.35 R:0.20701 P:0.16414 F:0.18310
35 ROUGE-L Eval D0743-A.M.100.J-B.35 R:0.20000 P:0.18421 F:0.19178
35 ROUGE-L Eval D0743-A.M.100.J-H.35 R:0.18519 P:0.17544 F:0.18018
35 ROUGE-L Eval D0743-A.M.100.J-I.35 R:0.19062 P:0.17836 F:0.18429
35 ROUGE-L Eval D0743-A.M.100.J-J.35 R:0.16308 P:0.15497 F:0.15892
35 ROUGE-L Eval D0743-B.M.100.J-B.35 R:0.20513 P:0.14815 F:0.17204
35 ROUGE-L Eval D0743-B.M.100.J-H.35 R:0.20820 P:0.15278 F:0.17624
35 ROUGE-L Eval D0743-B.M.100.J-I.35 R:0.21519 P:0.15741 F:0.18182
35 ROUGE-L Eval D0743-B.M.100.J-J.35 R:0.19626 P:0.14583 F:0.16733
35 ROUGE-L Eval D0743-C.M.100.J-B.35 R:0.21270 P:0.17048 F:0.18926
35 ROUGE-L Eval D0743-C.M.100.J-H.35 R:0.20701 P:0.16539 F:0.18387
35 ROUGE-L Eval D0743-C.M.100.J-I.35 R:0.22045 P:0.17557 F:0.19547
35 ROUGE-L Eval D0743-C.M.100.J-J.35 R:0.19811 P:0.16031 F:0.17722
---------------------------------------------
35 ROUGE-W-1.2 Average_R: 0.08445 (95%-conf.int. 0.08135 - 0.08733)
35 ROUGE-W-1.2 Average_P: 0.10699 (95%-conf.int. 0.10241 - 0.11145)
35 ROUGE-W-1.2 Average_F: 0.09369 (95%-conf.int. 0.09013 - 0.09710)
.............................................
35 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.35 R:0.10618 P:0.14291 F:0.12184
35 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.35 R:0.10119 P:0.13840 F:0.11691
35 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.35 R:0.10510 P:0.14238 F:0.12093
35 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.35 R:0.10930 P:0.13882 F:0.12230
35 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.35 R:0.09618 P:0.12811 F:0.10987
35 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.35 R:0.10618 P:0.14055 F:0.12097
35 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.35 R:0.10317 P:0.13538 F:0.11710
35 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.35 R:0.10557 P:0.13835 F:0.11976
35 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.35 R:0.09536 P:0.12400 F:0.10781
35 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.35 R:0.10011 P:0.13570 F:0.11522
35 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.35 R:0.10091 P:0.13483 F:0.11543
35 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.35 R:0.10346 P:0.13118 F:0.11568
35 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.35 R:0.11317 P:0.12952 F:0.12079
35 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.35 R:0.09858 P:0.11460 F:0.10599
35 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.35 R:0.09996 P:0.11559 F:0.10721
35 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.35 R:0.09828 P:0.11614 F:0.10647
35 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.35 R:0.08214 P:0.14511 F:0.10490
35 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.35 R:0.07535 P:0.13598 F:0.09697
35 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.35 R:0.07813 P:0.14158 F:0.10069
35 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.35 R:0.08680 P:0.16167 F:0.11295
35 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.35 R:0.08358 P:0.09329 F:0.08817
35 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.35 R:0.08170 P:0.09198 F:0.08654
35 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.35 R:0.08017 P:0.08939 F:0.08453
35 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.35 R:0.08491 P:0.09738 F:0.09072
35 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.35 R:0.07881 P:0.08833 F:0.08330
35 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.35 R:0.10380 P:0.11534 F:0.10927
35 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.35 R:0.09697 P:0.10684 F:0.10167
35 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.35 R:0.09903 P:0.11095 F:0.10465
35 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.35 R:0.10193 P:0.12291 F:0.11144
35 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.35 R:0.08650 P:0.10882 F:0.09638
35 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.35 R:0.08817 P:0.11346 F:0.09923
35 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.35 R:0.09645 P:0.12148 F:0.10753
35 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.35 R:0.07191 P:0.09769 F:0.08284
35 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.35 R:0.07403 P:0.09727 F:0.08407
35 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.35 R:0.07696 P:0.10373 F:0.08836
35 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.35 R:0.06839 P:0.09356 F:0.07902
35 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.35 R:0.10747 P:0.12246 F:0.11448
35 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.35 R:0.10755 P:0.12571 F:0.11592
35 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.35 R:0.10938 P:0.12573 F:0.11699
35 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.35 R:0.10914 P:0.12861 F:0.11808
35 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.35 R:0.10333 P:0.13734 F:0.11793
35 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.35 R:0.10911 P:0.14584 F:0.12483
35 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.35 R:0.10092 P:0.13554 F:0.11570
35 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.35 R:0.10869 P:0.14465 F:0.12412
35 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.35 R:0.06080 P:0.07889 F:0.06867
35 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.35 R:0.05257 P:0.06912 F:0.05972
35 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.35 R:0.06124 P:0.08154 F:0.06995
35 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.35 R:0.05876 P:0.07776 F:0.06694
35 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.35 R:0.08083 P:0.09866 F:0.08886
35 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.35 R:0.07372 P:0.09325 F:0.08234
35 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.35 R:0.06440 P:0.08248 F:0.07233
35 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.35 R:0.07204 P:0.09176 F:0.08071
35 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.35 R:0.10564 P:0.12440 F:0.11426
35 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.35 R:0.10238 P:0.11988 F:0.11044
35 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.35 R:0.09804 P:0.11645 F:0.10645
35 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.35 R:0.09276 P:0.11387 F:0.10224
35 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.35 R:0.06457 P:0.11618 F:0.08301
35 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.35 R:0.05752 P:0.10511 F:0.07435
35 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.35 R:0.05685 P:0.10202 F:0.07301
35 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.35 R:0.05918 P:0.10890 F:0.07669
35 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.35 R:0.05547 P:0.06126 F:0.05822
35 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.35 R:0.05600 P:0.06093 F:0.05836
35 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.35 R:0.05813 P:0.06452 F:0.06116
35 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.35 R:0.05461 P:0.06161 F:0.05790
35 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.35 R:0.08874 P:0.11794 F:0.10128
35 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.35 R:0.08098 P:0.10864 F:0.09279
35 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.35 R:0.07976 P:0.10770 F:0.09165
35 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.35 R:0.08200 P:0.11113 F:0.09437
35 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.35 R:0.07540 P:0.06721 F:0.07107
35 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.35 R:0.07115 P:0.06311 F:0.06689
35 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.35 R:0.07612 P:0.06805 F:0.07186
35 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.35 R:0.07818 P:0.07224 F:0.07509
35 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.35 R:0.10477 P:0.16089 F:0.12690
35 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.35 R:0.09279 P:0.14925 F:0.11443
35 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.35 R:0.09034 P:0.14191 F:0.11040
35 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.35 R:0.09547 P:0.15080 F:0.11692
35 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.35 R:0.11954 P:0.12716 F:0.12323
35 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.35 R:0.10214 P:0.11773 F:0.10938
35 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.35 R:0.11543 P:0.12448 F:0.11978
35 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.35 R:0.10212 P:0.10959 F:0.10572
35 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.35 R:0.08849 P:0.08948 F:0.08898
35 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.35 R:0.09448 P:0.09499 F:0.09473
35 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.35 R:0.09276 P:0.09475 F:0.09374
35 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.35 R:0.10078 P:0.09833 F:0.09954
35 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.35 R:0.06566 P:0.06554 F:0.06560
35 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.35 R:0.06312 P:0.06144 F:0.06227
35 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.35 R:0.06312 P:0.06403 F:0.06357
35 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.35 R:0.06417 P:0.07072 F:0.06729
35 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.35 R:0.06320 P:0.06154 F:0.06236
35 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.35 R:0.06375 P:0.05731 F:0.06036
35 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.35 R:0.06066 P:0.05377 F:0.05701
35 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.35 R:0.06122 P:0.06499 F:0.06305
35 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.35 R:0.08191 P:0.07584 F:0.07876
35 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.35 R:0.08947 P:0.06725 F:0.07678
35 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.35 R:0.09365 P:0.06870 F:0.07926
35 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.35 R:0.06830 P:0.06945 F:0.06887
35 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.35 R:0.07502 P:0.10401 F:0.08717
35 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.35 R:0.07514 P:0.10319 F:0.08696
35 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.35 R:0.06785 P:0.09615 F:0.07956
35 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.35 R:0.07255 P:0.10278 F:0.08506
35 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.35 R:0.10319 P:0.13903 F:0.11846
35 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.35 R:0.11347 P:0.14519 F:0.12739
35 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.35 R:0.10774 P:0.14702 F:0.12435
35 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.35 R:0.10467 P:0.13767 F:0.11892
35 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.35 R:0.07020 P:0.10708 F:0.08480
35 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.35 R:0.07038 P:0.10316 F:0.08367
35 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.35 R:0.06719 P:0.10386 F:0.08159
35 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.35 R:0.06615 P:0.10050 F:0.07978
35 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.35 R:0.07467 P:0.11988 F:0.09202
35 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.35 R:0.06968 P:0.11402 F:0.08650
35 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.35 R:0.06955 P:0.11548 F:0.08681
35 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.35 R:0.06172 P:0.10181 F:0.07685
35 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.35 R:0.07465 P:0.09029 F:0.08173
35 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.35 R:0.07945 P:0.09668 F:0.08722
35 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.35 R:0.07640 P:0.09418 F:0.08436
35 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.35 R:0.07154 P:0.08740 F:0.07868
35 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.35 R:0.07538 P:0.10576 F:0.08802
35 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.35 R:0.07327 P:0.09776 F:0.08376
35 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.35 R:0.07742 P:0.10988 F:0.09084
35 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.35 R:0.06777 P:0.09229 F:0.07815
---------------------------------------------
35 ROUGE-SU4 Average_R: 0.08563 (95%-conf.int. 0.08044 - 0.09063)
35 ROUGE-SU4 Average_P: 0.05969 (95%-conf.int. 0.05580 - 0.06375)
35 ROUGE-SU4 Average_F: 0.06983 (95%-conf.int. 0.06548 - 0.07415)
.............................................
35 ROUGE-SU4 Eval D0703-A.M.100.A-A.35 R:0.12616 P:0.09364 F:0.10749
35 ROUGE-SU4 Eval D0703-A.M.100.A-C.35 R:0.12184 P:0.09107 F:0.10423
35 ROUGE-SU4 Eval D0703-A.M.100.A-D.35 R:0.12191 P:0.08892 F:0.10283
35 ROUGE-SU4 Eval D0703-A.M.100.A-J.35 R:0.11480 P:0.08462 F:0.09743
35 ROUGE-SU4 Eval D0703-B.M.100.A-A.35 R:0.12192 P:0.08692 F:0.10149
35 ROUGE-SU4 Eval D0703-B.M.100.A-C.35 R:0.14770 P:0.10247 F:0.12100
35 ROUGE-SU4 Eval D0703-B.M.100.A-D.35 R:0.13908 P:0.09649 F:0.11393
35 ROUGE-SU4 Eval D0703-B.M.100.A-J.35 R:0.13652 P:0.09569 F:0.11252
35 ROUGE-SU4 Eval D0703-C.M.100.A-A.35 R:0.11416 P:0.07918 F:0.09351
35 ROUGE-SU4 Eval D0703-C.M.100.A-C.35 R:0.13167 P:0.09382 F:0.10957
35 ROUGE-SU4 Eval D0703-C.M.100.A-D.35 R:0.12528 P:0.08749 F:0.10303
35 ROUGE-SU4 Eval D0703-C.M.100.A-J.35 R:0.12018 P:0.08393 F:0.09884
35 ROUGE-SU4 Eval D0706-A.M.100.B-B.35 R:0.10944 P:0.06912 F:0.08473
35 ROUGE-SU4 Eval D0706-A.M.100.B-D.35 R:0.10179 P:0.06386 F:0.07848
35 ROUGE-SU4 Eval D0706-A.M.100.B-E.35 R:0.10222 P:0.06456 F:0.07914
35 ROUGE-SU4 Eval D0706-A.M.100.B-I.35 R:0.10056 P:0.06351 F:0.07785
35 ROUGE-SU4 Eval D0706-B.M.100.B-B.35 R:0.08445 P:0.08619 F:0.08531
35 ROUGE-SU4 Eval D0706-B.M.100.B-D.35 R:0.07135 P:0.07306 F:0.07219
35 ROUGE-SU4 Eval D0706-B.M.100.B-E.35 R:0.08722 P:0.08961 F:0.08840
35 ROUGE-SU4 Eval D0706-B.M.100.B-I.35 R:0.10244 P:0.10559 F:0.10399
35 ROUGE-SU4 Eval D0706-C.M.100.B-B.35 R:0.06623 P:0.04292 F:0.05209
35 ROUGE-SU4 Eval D0706-C.M.100.B-D.35 R:0.06954 P:0.04506 F:0.05469
35 ROUGE-SU4 Eval D0706-C.M.100.B-E.35 R:0.06469 P:0.04220 F:0.05108
35 ROUGE-SU4 Eval D0706-C.M.100.B-I.35 R:0.06831 P:0.04471 F:0.05405
35 ROUGE-SU4 Eval D0711-A.M.100.C-A.35 R:0.07601 P:0.04678 F:0.05792
35 ROUGE-SU4 Eval D0711-A.M.100.C-B.35 R:0.11815 P:0.07173 F:0.08927
35 ROUGE-SU4 Eval D0711-A.M.100.C-C.35 R:0.11073 P:0.06722 F:0.08366
35 ROUGE-SU4 Eval D0711-A.M.100.C-F.35 R:0.11451 P:0.06999 F:0.08688
35 ROUGE-SU4 Eval D0711-B.M.100.C-A.35 R:0.10198 P:0.06831 F:0.08182
35 ROUGE-SU4 Eval D0711-B.M.100.C-B.35 R:0.09624 P:0.06401 F:0.07688
35 ROUGE-SU4 Eval D0711-B.M.100.C-C.35 R:0.09540 P:0.06479 F:0.07717
35 ROUGE-SU4 Eval D0711-B.M.100.C-F.35 R:0.10743 P:0.07221 F:0.08637
35 ROUGE-SU4 Eval D0711-C.M.100.C-A.35 R:0.06723 P:0.04849 F:0.05634
35 ROUGE-SU4 Eval D0711-C.M.100.C-B.35 R:0.07719 P:0.05379 F:0.06340
35 ROUGE-SU4 Eval D0711-C.M.100.C-C.35 R:0.07986 P:0.05623 F:0.06599
35 ROUGE-SU4 Eval D0711-C.M.100.C-F.35 R:0.07523 P:0.05297 F:0.06217
35 ROUGE-SU4 Eval D0716-A.M.100.D-C.35 R:0.11504 P:0.07103 F:0.08783
35 ROUGE-SU4 Eval D0716-A.M.100.D-D.35 R:0.12100 P:0.07346 F:0.09142
35 ROUGE-SU4 Eval D0716-A.M.100.D-E.35 R:0.12230 P:0.07450 F:0.09260
35 ROUGE-SU4 Eval D0716-A.M.100.D-F.35 R:0.12260 P:0.07519 F:0.09321
35 ROUGE-SU4 Eval D0716-B.M.100.D-C.35 R:0.13176 P:0.09974 F:0.11354
35 ROUGE-SU4 Eval D0716-B.M.100.D-D.35 R:0.14713 P:0.10912 F:0.12531
35 ROUGE-SU4 Eval D0716-B.M.100.D-E.35 R:0.11263 P:0.08440 F:0.09649
35 ROUGE-SU4 Eval D0716-B.M.100.D-F.35 R:0.13813 P:0.10315 F:0.11810
35 ROUGE-SU4 Eval D0716-C.M.100.D-C.35 R:0.06355 P:0.04388 F:0.05191
35 ROUGE-SU4 Eval D0716-C.M.100.D-D.35 R:0.06071 P:0.04080 F:0.04880
35 ROUGE-SU4 Eval D0716-C.M.100.D-E.35 R:0.06441 P:0.04388 F:0.05220
35 ROUGE-SU4 Eval D0716-C.M.100.D-F.35 R:0.07135 P:0.04811 F:0.05747
35 ROUGE-SU4 Eval D0721-A.M.100.E-B.35 R:0.06621 P:0.04560 F:0.05401
35 ROUGE-SU4 Eval D0721-A.M.100.E-C.35 R:0.06056 P:0.04285 F:0.05019
35 ROUGE-SU4 Eval D0721-A.M.100.E-E.35 R:0.05222 P:0.03695 F:0.04328
35 ROUGE-SU4 Eval D0721-A.M.100.E-G.35 R:0.06318 P:0.04560 F:0.05297
35 ROUGE-SU4 Eval D0721-B.M.100.E-B.35 R:0.11260 P:0.06788 F:0.08470
35 ROUGE-SU4 Eval D0721-B.M.100.E-C.35 R:0.10131 P:0.06250 F:0.07731
35 ROUGE-SU4 Eval D0721-B.M.100.E-E.35 R:0.11055 P:0.06620 F:0.08281
35 ROUGE-SU4 Eval D0721-B.M.100.E-G.35 R:0.09768 P:0.05948 F:0.07394
35 ROUGE-SU4 Eval D0721-C.M.100.E-B.35 R:0.05724 P:0.05592 F:0.05657
35 ROUGE-SU4 Eval D0721-C.M.100.E-C.35 R:0.05254 P:0.05099 F:0.05175
35 ROUGE-SU4 Eval D0721-C.M.100.E-E.35 R:0.04852 P:0.04660 F:0.04754
35 ROUGE-SU4 Eval D0721-C.M.100.E-G.35 R:0.04627 P:0.04550 F:0.04588
35 ROUGE-SU4 Eval D0726-A.M.100.F-A.35 R:0.03641 P:0.02246 F:0.02778
35 ROUGE-SU4 Eval D0726-A.M.100.F-E.35 R:0.03767 P:0.02316 F:0.02868
35 ROUGE-SU4 Eval D0726-A.M.100.F-F.35 R:0.04209 P:0.02596 F:0.03211
35 ROUGE-SU4 Eval D0726-A.M.100.F-G.35 R:0.03584 P:0.02211 F:0.02735
35 ROUGE-SU4 Eval D0726-B.M.100.F-A.35 R:0.08781 P:0.06591 F:0.07530
35 ROUGE-SU4 Eval D0726-B.M.100.F-E.35 R:0.07565 P:0.05584 F:0.06425
35 ROUGE-SU4 Eval D0726-B.M.100.F-F.35 R:0.08077 P:0.05961 F:0.06860
35 ROUGE-SU4 Eval D0726-B.M.100.F-G.35 R:0.08108 P:0.06045 F:0.06926
35 ROUGE-SU4 Eval D0726-C.M.100.F-A.35 R:0.06050 P:0.03030 F:0.04038
35 ROUGE-SU4 Eval D0726-C.M.100.F-E.35 R:0.05767 P:0.02859 F:0.03823
35 ROUGE-SU4 Eval D0726-C.M.100.F-F.35 R:0.06678 P:0.03288 F:0.04406
35 ROUGE-SU4 Eval D0726-C.M.100.F-G.35 R:0.06397 P:0.03259 F:0.04318
35 ROUGE-SU4 Eval D0727-A.M.100.G-A.35 R:0.10182 P:0.08853 F:0.09471
35 ROUGE-SU4 Eval D0727-A.M.100.G-F.35 R:0.09797 P:0.08605 F:0.09162
35 ROUGE-SU4 Eval D0727-A.M.100.G-G.35 R:0.08445 P:0.07468 F:0.07927
35 ROUGE-SU4 Eval D0727-A.M.100.G-H.35 R:0.09628 P:0.08457 F:0.09005
35 ROUGE-SU4 Eval D0727-B.M.100.G-A.35 R:0.12603 P:0.07556 F:0.09448
35 ROUGE-SU4 Eval D0727-B.M.100.G-F.35 R:0.09944 P:0.06321 F:0.07729
35 ROUGE-SU4 Eval D0727-B.M.100.G-G.35 R:0.12396 P:0.07380 F:0.09252
35 ROUGE-SU4 Eval D0727-B.M.100.G-H.35 R:0.10306 P:0.06179 F:0.07726
35 ROUGE-SU4 Eval D0727-C.M.100.G-A.35 R:0.07971 P:0.04430 F:0.05695
35 ROUGE-SU4 Eval D0727-C.M.100.G-F.35 R:0.08766 P:0.04709 F:0.06127
35 ROUGE-SU4 Eval D0727-C.M.100.G-G.35 R:0.08418 P:0.04616 F:0.05962
35 ROUGE-SU4 Eval D0727-C.M.100.G-H.35 R:0.08854 P:0.04740 F:0.06174
35 ROUGE-SU4 Eval D0736-A.M.100.H-G.35 R:0.03875 P:0.02156 F:0.02771
35 ROUGE-SU4 Eval D0736-A.M.100.H-H.35 R:0.04198 P:0.02293 F:0.02966
35 ROUGE-SU4 Eval D0736-A.M.100.H-I.35 R:0.04029 P:0.02259 F:0.02895
35 ROUGE-SU4 Eval D0736-A.M.100.H-J.35 R:0.03971 P:0.02430 F:0.03015
35 ROUGE-SU4 Eval D0736-B.M.100.H-G.35 R:0.04659 P:0.02415 F:0.03181
35 ROUGE-SU4 Eval D0736-B.M.100.H-H.35 R:0.04558 P:0.02177 F:0.02947
35 ROUGE-SU4 Eval D0736-B.M.100.H-I.35 R:0.04329 P:0.02041 F:0.02774
35 ROUGE-SU4 Eval D0736-B.M.100.H-J.35 R:0.04496 P:0.02551 F:0.03255
35 ROUGE-SU4 Eval D0736-C.M.100.H-G.35 R:0.08079 P:0.04048 F:0.05394
35 ROUGE-SU4 Eval D0736-C.M.100.H-H.35 R:0.09404 P:0.03683 F:0.05293
35 ROUGE-SU4 Eval D0736-C.M.100.H-I.35 R:0.09497 P:0.03720 F:0.05346
35 ROUGE-SU4 Eval D0736-C.M.100.H-J.35 R:0.06485 P:0.03647 F:0.04669
35 ROUGE-SU4 Eval D0740-A.M.100.I-D.35 R:0.06949 P:0.05203 F:0.05951
35 ROUGE-SU4 Eval D0740-A.M.100.I-H.35 R:0.06320 P:0.04780 F:0.05443
35 ROUGE-SU4 Eval D0740-A.M.100.I-I.35 R:0.05833 P:0.04442 F:0.05043
35 ROUGE-SU4 Eval D0740-A.M.100.I-J.35 R:0.06512 P:0.04992 F:0.05652
35 ROUGE-SU4 Eval D0740-B.M.100.I-D.35 R:0.11444 P:0.08333 F:0.09644
35 ROUGE-SU4 Eval D0740-B.M.100.I-H.35 R:0.13039 P:0.09304 F:0.10859
35 ROUGE-SU4 Eval D0740-B.M.100.I-I.35 R:0.13580 P:0.09790 F:0.11378
35 ROUGE-SU4 Eval D0740-B.M.100.I-J.35 R:0.10631 P:0.07767 F:0.08976
35 ROUGE-SU4 Eval D0740-C.M.100.I-D.35 R:0.07923 P:0.06229 F:0.06975
35 ROUGE-SU4 Eval D0740-C.M.100.I-H.35 R:0.07811 P:0.06100 F:0.06850
35 ROUGE-SU4 Eval D0740-C.M.100.I-I.35 R:0.08306 P:0.06529 F:0.07311
35 ROUGE-SU4 Eval D0740-C.M.100.I-J.35 R:0.07462 P:0.05885 F:0.06580
35 ROUGE-SU4 Eval D0743-A.M.100.J-B.35 R:0.06406 P:0.05888 F:0.06136
35 ROUGE-SU4 Eval D0743-A.M.100.J-H.35 R:0.05643 P:0.05339 F:0.05487
35 ROUGE-SU4 Eval D0743-A.M.100.J-I.35 R:0.06517 P:0.06088 F:0.06295
35 ROUGE-SU4 Eval D0743-A.M.100.J-J.35 R:0.04942 P:0.04691 F:0.04813
35 ROUGE-SU4 Eval D0743-B.M.100.J-B.35 R:0.05757 P:0.04127 F:0.04808
35 ROUGE-SU4 Eval D0743-B.M.100.J-H.35 R:0.05825 P:0.04245 F:0.04911
35 ROUGE-SU4 Eval D0743-B.M.100.J-I.35 R:0.06223 P:0.04520 F:0.05237
35 ROUGE-SU4 Eval D0743-B.M.100.J-J.35 R:0.05378 P:0.03970 F:0.04568
35 ROUGE-SU4 Eval D0743-C.M.100.J-B.35 R:0.08740 P:0.06970 F:0.07755
35 ROUGE-SU4 Eval D0743-C.M.100.J-H.35 R:0.07680 P:0.06104 F:0.06802
35 ROUGE-SU4 Eval D0743-C.M.100.J-I.35 R:0.08798 P:0.06970 F:0.07778
35 ROUGE-SU4 Eval D0743-C.M.100.J-J.35 R:0.07043 P:0.05671 F:0.06283
---------------------------------------------
36 ROUGE-1 Average_R: 0.35996 (95%-conf.int. 0.35154 - 0.36840)
36 ROUGE-1 Average_P: 0.22478 (95%-conf.int. 0.21858 - 0.23132)
36 ROUGE-1 Average_F: 0.27610 (95%-conf.int. 0.26921 - 0.28336)
.............................................
36 ROUGE-1 Eval D0703-A.M.100.A-A.36 R:0.40878 P:0.25367 F:0.31307
36 ROUGE-1 Eval D0703-A.M.100.A-C.36 R:0.40268 P:0.25157 F:0.30967
36 ROUGE-1 Eval D0703-A.M.100.A-D.36 R:0.39863 P:0.24319 F:0.30209
36 ROUGE-1 Eval D0703-A.M.100.A-J.36 R:0.40816 P:0.25157 F:0.31128
36 ROUGE-1 Eval D0703-B.M.100.A-A.36 R:0.29739 P:0.20495 F:0.24266
36 ROUGE-1 Eval D0703-B.M.100.A-C.36 R:0.35906 P:0.24099 F:0.28841
36 ROUGE-1 Eval D0703-B.M.100.A-D.36 R:0.32215 P:0.21622 F:0.25876
36 ROUGE-1 Eval D0703-B.M.100.A-J.36 R:0.30897 P:0.20946 F:0.24966
36 ROUGE-1 Eval D0703-C.M.100.A-A.36 R:0.33000 P:0.21569 F:0.26087
36 ROUGE-1 Eval D0703-C.M.100.A-C.36 R:0.34091 P:0.22876 F:0.27380
36 ROUGE-1 Eval D0703-C.M.100.A-D.36 R:0.33775 P:0.22222 F:0.26807
36 ROUGE-1 Eval D0703-C.M.100.A-J.36 R:0.33775 P:0.22222 F:0.26807
36 ROUGE-1 Eval D0706-A.M.100.B-B.36 R:0.35390 P:0.24062 F:0.28647
36 ROUGE-1 Eval D0706-A.M.100.B-D.36 R:0.30392 P:0.20530 F:0.24506
36 ROUGE-1 Eval D0706-A.M.100.B-E.36 R:0.29221 P:0.19868 F:0.23653
36 ROUGE-1 Eval D0706-A.M.100.B-I.36 R:0.34740 P:0.23620 F:0.28121
36 ROUGE-1 Eval D0706-B.M.100.B-B.36 R:0.30719 P:0.21171 F:0.25067
36 ROUGE-1 Eval D0706-B.M.100.B-D.36 R:0.28013 P:0.19369 F:0.22903
36 ROUGE-1 Eval D0706-B.M.100.B-E.36 R:0.28896 P:0.20045 F:0.23670
36 ROUGE-1 Eval D0706-B.M.100.B-I.36 R:0.33333 P:0.23198 F:0.27357
36 ROUGE-1 Eval D0706-C.M.100.B-B.36 R:0.31935 P:0.20625 F:0.25063
36 ROUGE-1 Eval D0706-C.M.100.B-D.36 R:0.35484 P:0.22917 F:0.27848
36 ROUGE-1 Eval D0706-C.M.100.B-E.36 R:0.33333 P:0.21667 F:0.26263
36 ROUGE-1 Eval D0706-C.M.100.B-I.36 R:0.36102 P:0.23542 F:0.28500
36 ROUGE-1 Eval D0711-A.M.100.C-A.36 R:0.31579 P:0.21477 F:0.25566
36 ROUGE-1 Eval D0711-A.M.100.C-B.36 R:0.31333 P:0.21029 F:0.25167
36 ROUGE-1 Eval D0711-A.M.100.C-C.36 R:0.32000 P:0.21477 F:0.25703
36 ROUGE-1 Eval D0711-A.M.100.C-F.36 R:0.33444 P:0.22595 F:0.26969
36 ROUGE-1 Eval D0711-B.M.100.C-A.36 R:0.36054 P:0.21946 F:0.27284
36 ROUGE-1 Eval D0711-B.M.100.C-B.36 R:0.39041 P:0.23602 F:0.29419
36 ROUGE-1 Eval D0711-B.M.100.C-C.36 R:0.37919 P:0.23395 F:0.28937
36 ROUGE-1 Eval D0711-B.M.100.C-F.36 R:0.35593 P:0.21739 F:0.26992
36 ROUGE-1 Eval D0711-C.M.100.C-A.36 R:0.40924 P:0.25358 F:0.31313
36 ROUGE-1 Eval D0711-C.M.100.C-B.36 R:0.42321 P:0.25358 F:0.31714
36 ROUGE-1 Eval D0711-C.M.100.C-C.36 R:0.45270 P:0.27403 F:0.34140
36 ROUGE-1 Eval D0711-C.M.100.C-F.36 R:0.40203 P:0.24335 F:0.30318
36 ROUGE-1 Eval D0716-A.M.100.D-C.36 R:0.46230 P:0.29375 F:0.35924
36 ROUGE-1 Eval D0716-A.M.100.D-D.36 R:0.47667 P:0.29792 F:0.36667
36 ROUGE-1 Eval D0716-A.M.100.D-E.36 R:0.49502 P:0.31042 F:0.38157
36 ROUGE-1 Eval D0716-A.M.100.D-F.36 R:0.46205 P:0.29167 F:0.35760
36 ROUGE-1 Eval D0716-B.M.100.D-C.36 R:0.44737 P:0.27812 F:0.34300
36 ROUGE-1 Eval D0716-B.M.100.D-D.36 R:0.46309 P:0.28221 F:0.35070
36 ROUGE-1 Eval D0716-B.M.100.D-E.36 R:0.41860 P:0.25767 F:0.31899
36 ROUGE-1 Eval D0716-B.M.100.D-F.36 R:0.42667 P:0.26176 F:0.32446
36 ROUGE-1 Eval D0716-C.M.100.D-C.36 R:0.39414 P:0.24897 F:0.30517
36 ROUGE-1 Eval D0716-C.M.100.D-D.36 R:0.40468 P:0.24897 F:0.30828
36 ROUGE-1 Eval D0716-C.M.100.D-E.36 R:0.43894 P:0.27366 F:0.33713
36 ROUGE-1 Eval D0716-C.M.100.D-F.36 R:0.42000 P:0.25926 F:0.32061
36 ROUGE-1 Eval D0721-A.M.100.E-B.36 R:0.34333 P:0.22737 F:0.27357
36 ROUGE-1 Eval D0721-A.M.100.E-C.36 R:0.33117 P:0.22517 F:0.26807
36 ROUGE-1 Eval D0721-A.M.100.E-E.36 R:0.32792 P:0.22296 F:0.26544
36 ROUGE-1 Eval D0721-A.M.100.E-G.36 R:0.32484 P:0.22517 F:0.26597
36 ROUGE-1 Eval D0721-B.M.100.E-B.36 R:0.37459 P:0.25219 F:0.30144
36 ROUGE-1 Eval D0721-B.M.100.E-C.36 R:0.38217 P:0.26316 F:0.31169
36 ROUGE-1 Eval D0721-B.M.100.E-E.36 R:0.35082 P:0.23465 F:0.28121
36 ROUGE-1 Eval D0721-B.M.100.E-G.36 R:0.37742 P:0.25658 F:0.30548
36 ROUGE-1 Eval D0721-C.M.100.E-B.36 R:0.37377 P:0.25503 F:0.30319
36 ROUGE-1 Eval D0721-C.M.100.E-C.36 R:0.34983 P:0.23714 F:0.28267
36 ROUGE-1 Eval D0721-C.M.100.E-E.36 R:0.33000 P:0.22148 F:0.26506
36 ROUGE-1 Eval D0721-C.M.100.E-G.36 R:0.34853 P:0.23937 F:0.28382
36 ROUGE-1 Eval D0726-A.M.100.F-A.36 R:0.41196 P:0.27556 F:0.33023
36 ROUGE-1 Eval D0726-A.M.100.F-E.36 R:0.41000 P:0.27333 F:0.32800
36 ROUGE-1 Eval D0726-A.M.100.F-F.36 R:0.42193 P:0.28222 F:0.33822
36 ROUGE-1 Eval D0726-A.M.100.F-G.36 R:0.41196 P:0.27556 F:0.33023
36 ROUGE-1 Eval D0726-B.M.100.F-A.36 R:0.33660 P:0.19619 F:0.24789
36 ROUGE-1 Eval D0726-B.M.100.F-E.36 R:0.31561 P:0.18095 F:0.23002
36 ROUGE-1 Eval D0726-B.M.100.F-F.36 R:0.33887 P:0.19429 F:0.24698
36 ROUGE-1 Eval D0726-B.M.100.F-G.36 R:0.33553 P:0.19429 F:0.24608
36 ROUGE-1 Eval D0726-C.M.100.F-A.36 R:0.37333 P:0.23188 F:0.28608
36 ROUGE-1 Eval D0726-C.M.100.F-E.36 R:0.37037 P:0.22774 F:0.28205
36 ROUGE-1 Eval D0726-C.M.100.F-F.36 R:0.36271 P:0.22153 F:0.27506
36 ROUGE-1 Eval D0726-C.M.100.F-G.36 R:0.32787 P:0.20704 F:0.25381
36 ROUGE-1 Eval D0727-A.M.100.G-A.36 R:0.45847 P:0.28571 F:0.35204
36 ROUGE-1 Eval D0727-A.M.100.G-F.36 R:0.43421 P:0.27329 F:0.33545
36 ROUGE-1 Eval D0727-A.M.100.G-G.36 R:0.41830 P:0.26501 F:0.32446
36 ROUGE-1 Eval D0727-A.M.100.G-H.36 R:0.44737 P:0.28157 F:0.34561
36 ROUGE-1 Eval D0727-B.M.100.G-A.36 R:0.33677 P:0.17949 F:0.23417
36 ROUGE-1 Eval D0727-B.M.100.G-F.36 R:0.30195 P:0.17033 F:0.21780
36 ROUGE-1 Eval D0727-B.M.100.G-G.36 R:0.29758 P:0.15751 F:0.20599
36 ROUGE-1 Eval D0727-B.M.100.G-H.36 R:0.31615 P:0.16850 F:0.21983
36 ROUGE-1 Eval D0727-C.M.100.G-A.36 R:0.36156 P:0.20670 F:0.26303
36 ROUGE-1 Eval D0727-C.M.100.G-F.36 R:0.38047 P:0.21043 F:0.27098
36 ROUGE-1 Eval D0727-C.M.100.G-G.36 R:0.36964 P:0.20857 F:0.26667
36 ROUGE-1 Eval D0727-C.M.100.G-H.36 R:0.38514 P:0.21229 F:0.27371
36 ROUGE-1 Eval D0736-A.M.100.H-G.36 R:0.35484 P:0.21854 F:0.27049
36 ROUGE-1 Eval D0736-A.M.100.H-H.36 R:0.34307 P:0.20751 F:0.25860
36 ROUGE-1 Eval D0736-A.M.100.H-I.36 R:0.35943 P:0.22296 F:0.27521
36 ROUGE-1 Eval D0736-A.M.100.H-J.36 R:0.35294 P:0.23841 F:0.28458
36 ROUGE-1 Eval D0736-B.M.100.H-G.36 R:0.32824 P:0.16667 F:0.22108
36 ROUGE-1 Eval D0736-B.M.100.H-H.36 R:0.35124 P:0.16473 F:0.22428
36 ROUGE-1 Eval D0736-B.M.100.H-I.36 R:0.38494 P:0.17829 F:0.24370
36 ROUGE-1 Eval D0736-B.M.100.H-J.36 R:0.36014 P:0.19961 F:0.25686
36 ROUGE-1 Eval D0736-C.M.100.H-G.36 R:0.35443 P:0.16092 F:0.22134
36 ROUGE-1 Eval D0736-C.M.100.H-H.36 R:0.33155 P:0.11877 F:0.17489
36 ROUGE-1 Eval D0736-C.M.100.H-I.36 R:0.39037 P:0.13985 F:0.20593
36 ROUGE-1 Eval D0736-C.M.100.H-J.36 R:0.33962 P:0.17241 F:0.22871
36 ROUGE-1 Eval D0740-A.M.100.I-D.36 R:0.32343 P:0.20165 F:0.24842
36 ROUGE-1 Eval D0740-A.M.100.I-H.36 R:0.31046 P:0.19547 F:0.23990
36 ROUGE-1 Eval D0740-A.M.100.I-I.36 R:0.31494 P:0.19959 F:0.24434
36 ROUGE-1 Eval D0740-A.M.100.I-J.36 R:0.31290 P:0.19959 F:0.24372
36 ROUGE-1 Eval D0740-B.M.100.I-D.36 R:0.33442 P:0.22737 F:0.27070
36 ROUGE-1 Eval D0740-B.M.100.I-H.36 R:0.28808 P:0.19205 F:0.23046
36 ROUGE-1 Eval D0740-B.M.100.I-I.36 R:0.32131 P:0.21634 F:0.25858
36 ROUGE-1 Eval D0740-B.M.100.I-J.36 R:0.33010 P:0.22517 F:0.26772
36 ROUGE-1 Eval D0740-C.M.100.I-D.36 R:0.41534 P:0.26749 F:0.32541
36 ROUGE-1 Eval D0740-C.M.100.I-H.36 R:0.38585 P:0.24691 F:0.30113
36 ROUGE-1 Eval D0740-C.M.100.I-I.36 R:0.42173 P:0.27160 F:0.33041
36 ROUGE-1 Eval D0740-C.M.100.I-J.36 R:0.43631 P:0.28189 F:0.34250
36 ROUGE-1 Eval D0743-A.M.100.J-B.36 R:0.33016 P:0.21138 F:0.25774
36 ROUGE-1 Eval D0743-A.M.100.J-H.36 R:0.29321 P:0.19309 F:0.23284
36 ROUGE-1 Eval D0743-A.M.100.J-I.36 R:0.35000 P:0.22764 F:0.27586
36 ROUGE-1 Eval D0743-A.M.100.J-J.36 R:0.32615 P:0.21545 F:0.25949
36 ROUGE-1 Eval D0743-B.M.100.J-B.36 R:0.28846 P:0.17241 F:0.21582
36 ROUGE-1 Eval D0743-B.M.100.J-H.36 R:0.27760 P:0.16858 F:0.20977
36 ROUGE-1 Eval D0743-B.M.100.J-I.36 R:0.28797 P:0.17433 F:0.21718
36 ROUGE-1 Eval D0743-B.M.100.J-J.36 R:0.28349 P:0.17433 F:0.21590
36 ROUGE-1 Eval D0743-C.M.100.J-B.36 R:0.32698 P:0.20559 F:0.25245
36 ROUGE-1 Eval D0743-C.M.100.J-H.36 R:0.30255 P:0.18962 F:0.23313
36 ROUGE-1 Eval D0743-C.M.100.J-I.36 R:0.36102 P:0.22555 F:0.27764
36 ROUGE-1 Eval D0743-C.M.100.J-J.36 R:0.30503 P:0.19361 F:0.23687
---------------------------------------------
36 ROUGE-2 Average_R: 0.08820 (95%-conf.int. 0.08288 - 0.09425)
36 ROUGE-2 Average_P: 0.05453 (95%-conf.int. 0.05134 - 0.05810)
36 ROUGE-2 Average_F: 0.06721 (95%-conf.int. 0.06332 - 0.07170)
.............................................
36 ROUGE-2 Eval D0703-A.M.100.A-A.36 R:0.15700 P:0.09705 F:0.11995
36 ROUGE-2 Eval D0703-A.M.100.A-C.36 R:0.14915 P:0.09283 F:0.11444
36 ROUGE-2 Eval D0703-A.M.100.A-D.36 R:0.15278 P:0.09283 F:0.11549
36 ROUGE-2 Eval D0703-A.M.100.A-J.36 R:0.14777 P:0.09072 F:0.11242
36 ROUGE-2 Eval D0703-B.M.100.A-A.36 R:0.07921 P:0.05442 F:0.06452
36 ROUGE-2 Eval D0703-B.M.100.A-C.36 R:0.12203 P:0.08163 F:0.09782
36 ROUGE-2 Eval D0703-B.M.100.A-D.36 R:0.09153 P:0.06122 F:0.07337
36 ROUGE-2 Eval D0703-B.M.100.A-J.36 R:0.10067 P:0.06803 F:0.08119
36 ROUGE-2 Eval D0703-C.M.100.A-A.36 R:0.06734 P:0.04386 F:0.05312
36 ROUGE-2 Eval D0703-C.M.100.A-C.36 R:0.08197 P:0.05482 F:0.06570
36 ROUGE-2 Eval D0703-C.M.100.A-D.36 R:0.07358 P:0.04825 F:0.05828
36 ROUGE-2 Eval D0703-C.M.100.A-J.36 R:0.08696 P:0.05702 F:0.06888
36 ROUGE-2 Eval D0706-A.M.100.B-B.36 R:0.08197 P:0.05556 F:0.06623
36 ROUGE-2 Eval D0706-A.M.100.B-D.36 R:0.04620 P:0.03111 F:0.03718
36 ROUGE-2 Eval D0706-A.M.100.B-E.36 R:0.04918 P:0.03333 F:0.03973
36 ROUGE-2 Eval D0706-A.M.100.B-I.36 R:0.07869 P:0.05333 F:0.06357
36 ROUGE-2 Eval D0706-B.M.100.B-B.36 R:0.06271 P:0.04308 F:0.05107
36 ROUGE-2 Eval D0706-B.M.100.B-D.36 R:0.04605 P:0.03175 F:0.03759
36 ROUGE-2 Eval D0706-B.M.100.B-E.36 R:0.04590 P:0.03175 F:0.03754
36 ROUGE-2 Eval D0706-B.M.100.B-I.36 R:0.07190 P:0.04989 F:0.05891
36 ROUGE-2 Eval D0706-C.M.100.B-B.36 R:0.03909 P:0.02516 F:0.03061
36 ROUGE-2 Eval D0706-C.M.100.B-D.36 R:0.06840 P:0.04403 F:0.05357
36 ROUGE-2 Eval D0706-C.M.100.B-E.36 R:0.05502 P:0.03564 F:0.04326
36 ROUGE-2 Eval D0706-C.M.100.B-I.36 R:0.06129 P:0.03983 F:0.04828
36 ROUGE-2 Eval D0711-A.M.100.C-A.36 R:0.04651 P:0.03153 F:0.03758
36 ROUGE-2 Eval D0711-A.M.100.C-B.36 R:0.04377 P:0.02928 F:0.03509
36 ROUGE-2 Eval D0711-A.M.100.C-C.36 R:0.06061 P:0.04054 F:0.04858
36 ROUGE-2 Eval D0711-A.M.100.C-F.36 R:0.05017 P:0.03378 F:0.04038
36 ROUGE-2 Eval D0711-B.M.100.C-A.36 R:0.06186 P:0.03750 F:0.04669
36 ROUGE-2 Eval D0711-B.M.100.C-B.36 R:0.10035 P:0.06042 F:0.07543
36 ROUGE-2 Eval D0711-B.M.100.C-C.36 R:0.09831 P:0.06042 F:0.07484
36 ROUGE-2 Eval D0711-B.M.100.C-F.36 R:0.06849 P:0.04167 F:0.05182
36 ROUGE-2 Eval D0711-C.M.100.C-A.36 R:0.09000 P:0.05556 F:0.06871
36 ROUGE-2 Eval D0711-C.M.100.C-B.36 R:0.09655 P:0.05761 F:0.07216
36 ROUGE-2 Eval D0711-C.M.100.C-C.36 R:0.12969 P:0.07819 F:0.09756
36 ROUGE-2 Eval D0711-C.M.100.C-F.36 R:0.11263 P:0.06790 F:0.08472
36 ROUGE-2 Eval D0716-A.M.100.D-C.36 R:0.14238 P:0.09015 F:0.11040
36 ROUGE-2 Eval D0716-A.M.100.D-D.36 R:0.15152 P:0.09434 F:0.11628
36 ROUGE-2 Eval D0716-A.M.100.D-E.36 R:0.15101 P:0.09434 F:0.11613
36 ROUGE-2 Eval D0716-A.M.100.D-F.36 R:0.14667 P:0.09224 F:0.11325
36 ROUGE-2 Eval D0716-B.M.100.D-C.36 R:0.15615 P:0.09671 F:0.11944
36 ROUGE-2 Eval D0716-B.M.100.D-D.36 R:0.16271 P:0.09877 F:0.12292
36 ROUGE-2 Eval D0716-B.M.100.D-E.36 R:0.11409 P:0.06996 F:0.08673
36 ROUGE-2 Eval D0716-B.M.100.D-F.36 R:0.15152 P:0.09259 F:0.11494
36 ROUGE-2 Eval D0716-C.M.100.D-C.36 R:0.11842 P:0.07453 F:0.09148
36 ROUGE-2 Eval D0716-C.M.100.D-D.36 R:0.11149 P:0.06832 F:0.08472
36 ROUGE-2 Eval D0716-C.M.100.D-E.36 R:0.13333 P:0.08282 F:0.10217
36 ROUGE-2 Eval D0716-C.M.100.D-F.36 R:0.11785 P:0.07246 F:0.08974
36 ROUGE-2 Eval D0721-A.M.100.E-B.36 R:0.07071 P:0.04667 F:0.05623
36 ROUGE-2 Eval D0721-A.M.100.E-C.36 R:0.06557 P:0.04444 F:0.05298
36 ROUGE-2 Eval D0721-A.M.100.E-E.36 R:0.08525 P:0.05778 F:0.06888
36 ROUGE-2 Eval D0721-A.M.100.E-G.36 R:0.08360 P:0.05778 F:0.06833
36 ROUGE-2 Eval D0721-B.M.100.E-B.36 R:0.08224 P:0.05519 F:0.06605
36 ROUGE-2 Eval D0721-B.M.100.E-C.36 R:0.08039 P:0.05519 F:0.06545
36 ROUGE-2 Eval D0721-B.M.100.E-E.36 R:0.05629 P:0.03753 F:0.04503
36 ROUGE-2 Eval D0721-B.M.100.E-G.36 R:0.06515 P:0.04415 F:0.05263
36 ROUGE-2 Eval D0721-C.M.100.E-B.36 R:0.09603 P:0.06532 F:0.07775
36 ROUGE-2 Eval D0721-C.M.100.E-C.36 R:0.08000 P:0.05405 F:0.06451
36 ROUGE-2 Eval D0721-C.M.100.E-E.36 R:0.06734 P:0.04505 F:0.05398
36 ROUGE-2 Eval D0721-C.M.100.E-G.36 R:0.08553 P:0.05856 F:0.06952
36 ROUGE-2 Eval D0726-A.M.100.F-A.36 R:0.07383 P:0.04922 F:0.05906
36 ROUGE-2 Eval D0726-A.M.100.F-E.36 R:0.09091 P:0.06040 F:0.07258
36 ROUGE-2 Eval D0726-A.M.100.F-F.36 R:0.08389 P:0.05593 F:0.06711
36 ROUGE-2 Eval D0726-A.M.100.F-G.36 R:0.07383 P:0.04922 F:0.05906
36 ROUGE-2 Eval D0726-B.M.100.F-A.36 R:0.07591 P:0.04406 F:0.05576
36 ROUGE-2 Eval D0726-B.M.100.F-E.36 R:0.06040 P:0.03448 F:0.04390
36 ROUGE-2 Eval D0726-B.M.100.F-F.36 R:0.07383 P:0.04215 F:0.05366
36 ROUGE-2 Eval D0726-B.M.100.F-G.36 R:0.06977 P:0.04023 F:0.05103
36 ROUGE-2 Eval D0726-C.M.100.F-A.36 R:0.10101 P:0.06250 F:0.07722
36 ROUGE-2 Eval D0726-C.M.100.F-E.36 R:0.09184 P:0.05625 F:0.06977
36 ROUGE-2 Eval D0726-C.M.100.F-F.36 R:0.07192 P:0.04375 F:0.05440
36 ROUGE-2 Eval D0726-C.M.100.F-G.36 R:0.05960 P:0.03750 F:0.04604
36 ROUGE-2 Eval D0727-A.M.100.G-A.36 R:0.13423 P:0.08333 F:0.10283
36 ROUGE-2 Eval D0727-A.M.100.G-F.36 R:0.11628 P:0.07292 F:0.08963
36 ROUGE-2 Eval D0727-A.M.100.G-G.36 R:0.08251 P:0.05208 F:0.06385
36 ROUGE-2 Eval D0727-A.M.100.G-H.36 R:0.12625 P:0.07917 F:0.09731
36 ROUGE-2 Eval D0727-B.M.100.G-A.36 R:0.08681 P:0.04604 F:0.06017
36 ROUGE-2 Eval D0727-B.M.100.G-F.36 R:0.06557 P:0.03683 F:0.04717
36 ROUGE-2 Eval D0727-B.M.100.G-G.36 R:0.07343 P:0.03867 F:0.05066
36 ROUGE-2 Eval D0727-B.M.100.G-H.36 R:0.08333 P:0.04420 F:0.05776
36 ROUGE-2 Eval D0727-C.M.100.G-A.36 R:0.05263 P:0.02996 F:0.03818
36 ROUGE-2 Eval D0727-C.M.100.G-F.36 R:0.06463 P:0.03558 F:0.04589
36 ROUGE-2 Eval D0727-C.M.100.G-G.36 R:0.06667 P:0.03745 F:0.04796
36 ROUGE-2 Eval D0727-C.M.100.G-H.36 R:0.06826 P:0.03745 F:0.04837
36 ROUGE-2 Eval D0736-A.M.100.H-G.36 R:0.08696 P:0.05333 F:0.06611
36 ROUGE-2 Eval D0736-A.M.100.H-H.36 R:0.03690 P:0.02222 F:0.02774
36 ROUGE-2 Eval D0736-A.M.100.H-I.36 R:0.08633 P:0.05333 F:0.06593
36 ROUGE-2 Eval D0736-A.M.100.H-J.36 R:0.08581 P:0.05778 F:0.06906
36 ROUGE-2 Eval D0736-B.M.100.H-G.36 R:0.04633 P:0.02339 F:0.03109
36 ROUGE-2 Eval D0736-B.M.100.H-H.36 R:0.07950 P:0.03704 F:0.05054
36 ROUGE-2 Eval D0736-B.M.100.H-I.36 R:0.09746 P:0.04483 F:0.06141
36 ROUGE-2 Eval D0736-B.M.100.H-J.36 R:0.08481 P:0.04678 F:0.06030
36 ROUGE-2 Eval D0736-C.M.100.H-G.36 R:0.14530 P:0.06551 F:0.09031
36 ROUGE-2 Eval D0736-C.M.100.H-H.36 R:0.08152 P:0.02890 F:0.04267
36 ROUGE-2 Eval D0736-C.M.100.H-I.36 R:0.16304 P:0.05780 F:0.08534
36 ROUGE-2 Eval D0736-C.M.100.H-J.36 R:0.12214 P:0.06166 F:0.08195
36 ROUGE-2 Eval D0740-A.M.100.I-D.36 R:0.07333 P:0.04555 F:0.05619
36 ROUGE-2 Eval D0740-A.M.100.I-H.36 R:0.06601 P:0.04141 F:0.05089
36 ROUGE-2 Eval D0740-A.M.100.I-I.36 R:0.06230 P:0.03934 F:0.04823
36 ROUGE-2 Eval D0740-A.M.100.I-J.36 R:0.06515 P:0.04141 F:0.05064
36 ROUGE-2 Eval D0740-B.M.100.I-D.36 R:0.08197 P:0.05556 F:0.06623
36 ROUGE-2 Eval D0740-B.M.100.I-H.36 R:0.06355 P:0.04222 F:0.05073
36 ROUGE-2 Eval D0740-B.M.100.I-I.36 R:0.06291 P:0.04222 F:0.05053
36 ROUGE-2 Eval D0740-B.M.100.I-J.36 R:0.07843 P:0.05333 F:0.06349
36 ROUGE-2 Eval D0740-C.M.100.I-D.36 R:0.15161 P:0.09731 F:0.11854
36 ROUGE-2 Eval D0740-C.M.100.I-H.36 R:0.12662 P:0.08075 F:0.09861
36 ROUGE-2 Eval D0740-C.M.100.I-I.36 R:0.14839 P:0.09524 F:0.11602
36 ROUGE-2 Eval D0740-C.M.100.I-J.36 R:0.16399 P:0.10559 F:0.12846
36 ROUGE-2 Eval D0743-A.M.100.J-B.36 R:0.08654 P:0.05521 F:0.06741
36 ROUGE-2 Eval D0743-A.M.100.J-H.36 R:0.05607 P:0.03681 F:0.04444
36 ROUGE-2 Eval D0743-A.M.100.J-I.36 R:0.08833 P:0.05726 F:0.06948
36 ROUGE-2 Eval D0743-A.M.100.J-J.36 R:0.06211 P:0.04090 F:0.04932
36 ROUGE-2 Eval D0743-B.M.100.J-B.36 R:0.05502 P:0.03276 F:0.04107
36 ROUGE-2 Eval D0743-B.M.100.J-H.36 R:0.05096 P:0.03083 F:0.03842
36 ROUGE-2 Eval D0743-B.M.100.J-I.36 R:0.05431 P:0.03276 F:0.04087
36 ROUGE-2 Eval D0743-B.M.100.J-J.36 R:0.05975 P:0.03661 F:0.04540
36 ROUGE-2 Eval D0743-C.M.100.J-B.36 R:0.07051 P:0.04418 F:0.05432
36 ROUGE-2 Eval D0743-C.M.100.J-H.36 R:0.07395 P:0.04618 F:0.05686
36 ROUGE-2 Eval D0743-C.M.100.J-I.36 R:0.08710 P:0.05422 F:0.06684
36 ROUGE-2 Eval D0743-C.M.100.J-J.36 R:0.06667 P:0.04217 F:0.05166
---------------------------------------------
36 ROUGE-3 Average_R: 0.03507 (95%-conf.int. 0.03124 - 0.03915)
36 ROUGE-3 Average_P: 0.02149 (95%-conf.int. 0.01923 - 0.02394)
36 ROUGE-3 Average_F: 0.02657 (95%-conf.int. 0.02380 - 0.02964)
.............................................
36 ROUGE-3 Eval D0703-A.M.100.A-A.36 R:0.07241 P:0.04459 F:0.05519
36 ROUGE-3 Eval D0703-A.M.100.A-C.36 R:0.06849 P:0.04246 F:0.05242
36 ROUGE-3 Eval D0703-A.M.100.A-D.36 R:0.07368 P:0.04459 F:0.05556
36 ROUGE-3 Eval D0703-A.M.100.A-J.36 R:0.05556 P:0.03397 F:0.04216
36 ROUGE-3 Eval D0703-B.M.100.A-A.36 R:0.03667 P:0.02511 F:0.02981
36 ROUGE-3 Eval D0703-B.M.100.A-C.36 R:0.05479 P:0.03653 F:0.04383
36 ROUGE-3 Eval D0703-B.M.100.A-D.36 R:0.04110 P:0.02740 F:0.03288
36 ROUGE-3 Eval D0703-B.M.100.A-J.36 R:0.04068 P:0.02740 F:0.03274
36 ROUGE-3 Eval D0703-C.M.100.A-A.36 R:0.02041 P:0.01325 F:0.01607
36 ROUGE-3 Eval D0703-C.M.100.A-C.36 R:0.02318 P:0.01545 F:0.01854
36 ROUGE-3 Eval D0703-C.M.100.A-D.36 R:0.01689 P:0.01104 F:0.01335
36 ROUGE-3 Eval D0703-C.M.100.A-J.36 R:0.03041 P:0.01987 F:0.02404
36 ROUGE-3 Eval D0706-A.M.100.B-B.36 R:0.03642 P:0.02461 F:0.02937
36 ROUGE-3 Eval D0706-A.M.100.B-D.36 R:0.02333 P:0.01566 F:0.01874
36 ROUGE-3 Eval D0706-A.M.100.B-E.36 R:0.01325 P:0.00895 F:0.01068
36 ROUGE-3 Eval D0706-A.M.100.B-I.36 R:0.03642 P:0.02461 F:0.02937
36 ROUGE-3 Eval D0706-B.M.100.B-B.36 R:0.03667 P:0.02511 F:0.02981
36 ROUGE-3 Eval D0706-B.M.100.B-D.36 R:0.02326 P:0.01598 F:0.01894
36 ROUGE-3 Eval D0706-B.M.100.B-E.36 R:0.01987 P:0.01370 F:0.01622
36 ROUGE-3 Eval D0706-B.M.100.B-I.36 R:0.03960 P:0.02740 F:0.03239
36 ROUGE-3 Eval D0706-C.M.100.B-B.36 R:0.00987 P:0.00633 F:0.00771
36 ROUGE-3 Eval D0706-C.M.100.B-D.36 R:0.02303 P:0.01477 F:0.01800
36 ROUGE-3 Eval D0706-C.M.100.B-E.36 R:0.01634 P:0.01055 F:0.01282
36 ROUGE-3 Eval D0706-C.M.100.B-I.36 R:0.01954 P:0.01266 F:0.01536
36 ROUGE-3 Eval D0711-A.M.100.C-A.36 R:0.00671 P:0.00454 F:0.00542
36 ROUGE-3 Eval D0711-A.M.100.C-B.36 R:0.00680 P:0.00454 F:0.00544
36 ROUGE-3 Eval D0711-A.M.100.C-C.36 R:0.01020 P:0.00680 F:0.00816
36 ROUGE-3 Eval D0711-A.M.100.C-F.36 R:0.00676 P:0.00454 F:0.00543
36 ROUGE-3 Eval D0711-B.M.100.C-A.36 R:0.01389 P:0.00839 F:0.01046
36 ROUGE-3 Eval D0711-B.M.100.C-B.36 R:0.02448 P:0.01468 F:0.01835
36 ROUGE-3 Eval D0711-B.M.100.C-C.36 R:0.02397 P:0.01468 F:0.01821
36 ROUGE-3 Eval D0711-B.M.100.C-F.36 R:0.01038 P:0.00629 F:0.00783
36 ROUGE-3 Eval D0711-C.M.100.C-A.36 R:0.05387 P:0.03313 F:0.04103
36 ROUGE-3 Eval D0711-C.M.100.C-B.36 R:0.05923 P:0.03520 F:0.04416
36 ROUGE-3 Eval D0711-C.M.100.C-C.36 R:0.09655 P:0.05797 F:0.07244
36 ROUGE-3 Eval D0711-C.M.100.C-F.36 R:0.07931 P:0.04762 F:0.05951
36 ROUGE-3 Eval D0716-A.M.100.D-C.36 R:0.06020 P:0.03797 F:0.04657
36 ROUGE-3 Eval D0716-A.M.100.D-D.36 R:0.05782 P:0.03586 F:0.04427
36 ROUGE-3 Eval D0716-A.M.100.D-E.36 R:0.04407 P:0.02743 F:0.03381
36 ROUGE-3 Eval D0716-A.M.100.D-F.36 R:0.06061 P:0.03797 F:0.04669
36 ROUGE-3 Eval D0716-B.M.100.D-C.36 R:0.07718 P:0.04762 F:0.05890
36 ROUGE-3 Eval D0716-B.M.100.D-D.36 R:0.07877 P:0.04762 F:0.05936
36 ROUGE-3 Eval D0716-B.M.100.D-E.36 R:0.03729 P:0.02277 F:0.02827
36 ROUGE-3 Eval D0716-B.M.100.D-F.36 R:0.07143 P:0.04348 F:0.05406
36 ROUGE-3 Eval D0716-C.M.100.D-C.36 R:0.06645 P:0.04167 F:0.05122
36 ROUGE-3 Eval D0716-C.M.100.D-D.36 R:0.05119 P:0.03125 F:0.03881
36 ROUGE-3 Eval D0716-C.M.100.D-E.36 R:0.06397 P:0.03958 F:0.04890
36 ROUGE-3 Eval D0716-C.M.100.D-F.36 R:0.06122 P:0.03750 F:0.04651
36 ROUGE-3 Eval D0721-A.M.100.E-B.36 R:0.02381 P:0.01566 F:0.01889
36 ROUGE-3 Eval D0721-A.M.100.E-C.36 R:0.01656 P:0.01119 F:0.01336
36 ROUGE-3 Eval D0721-A.M.100.E-E.36 R:0.02980 P:0.02013 F:0.02403
36 ROUGE-3 Eval D0721-A.M.100.E-G.36 R:0.02922 P:0.02013 F:0.02384
36 ROUGE-3 Eval D0721-B.M.100.E-B.36 R:0.02326 P:0.01556 F:0.01865
36 ROUGE-3 Eval D0721-B.M.100.E-C.36 R:0.02273 P:0.01556 F:0.01847
36 ROUGE-3 Eval D0721-B.M.100.E-E.36 R:0.01338 P:0.00889 F:0.01068
36 ROUGE-3 Eval D0721-B.M.100.E-G.36 R:0.01974 P:0.01333 F:0.01591
36 ROUGE-3 Eval D0721-C.M.100.E-B.36 R:0.04682 P:0.03175 F:0.03784
36 ROUGE-3 Eval D0721-C.M.100.E-C.36 R:0.03704 P:0.02494 F:0.02981
36 ROUGE-3 Eval D0721-C.M.100.E-E.36 R:0.02721 P:0.01814 F:0.02177
36 ROUGE-3 Eval D0721-C.M.100.E-G.36 R:0.03987 P:0.02721 F:0.03235
36 ROUGE-3 Eval D0726-A.M.100.F-A.36 R:0.02712 P:0.01802 F:0.02165
36 ROUGE-3 Eval D0726-A.M.100.F-E.36 R:0.04082 P:0.02703 F:0.03252
36 ROUGE-3 Eval D0726-A.M.100.F-F.36 R:0.03051 P:0.02027 F:0.02436
36 ROUGE-3 Eval D0726-A.M.100.F-G.36 R:0.02373 P:0.01577 F:0.01895
36 ROUGE-3 Eval D0726-B.M.100.F-A.36 R:0.02667 P:0.01541 F:0.01953
36 ROUGE-3 Eval D0726-B.M.100.F-E.36 R:0.01695 P:0.00963 F:0.01228
36 ROUGE-3 Eval D0726-B.M.100.F-F.36 R:0.02373 P:0.01349 F:0.01720
36 ROUGE-3 Eval D0726-B.M.100.F-G.36 R:0.02349 P:0.01349 F:0.01714
36 ROUGE-3 Eval D0726-C.M.100.F-A.36 R:0.03401 P:0.02096 F:0.02594
36 ROUGE-3 Eval D0726-C.M.100.F-E.36 R:0.02749 P:0.01677 F:0.02083
36 ROUGE-3 Eval D0726-C.M.100.F-F.36 R:0.02768 P:0.01677 F:0.02089
36 ROUGE-3 Eval D0726-C.M.100.F-G.36 R:0.01338 P:0.00839 F:0.01031
36 ROUGE-3 Eval D0727-A.M.100.G-A.36 R:0.07458 P:0.04612 F:0.05699
36 ROUGE-3 Eval D0727-A.M.100.G-F.36 R:0.06376 P:0.03983 F:0.04903
36 ROUGE-3 Eval D0727-A.M.100.G-G.36 R:0.03333 P:0.02096 F:0.02574
36 ROUGE-3 Eval D0727-A.M.100.G-H.36 R:0.07047 P:0.04403 F:0.05420
36 ROUGE-3 Eval D0727-B.M.100.G-A.36 R:0.03860 P:0.02037 F:0.02667
36 ROUGE-3 Eval D0727-B.M.100.G-F.36 R:0.01987 P:0.01111 F:0.01425
36 ROUGE-3 Eval D0727-B.M.100.G-G.36 R:0.02827 P:0.01481 F:0.01944
36 ROUGE-3 Eval D0727-B.M.100.G-H.36 R:0.03860 P:0.02037 F:0.02667
36 ROUGE-3 Eval D0727-C.M.100.G-A.36 R:0.00997 P:0.00565 F:0.00721
36 ROUGE-3 Eval D0727-C.M.100.G-F.36 R:0.01031 P:0.00565 F:0.00730
36 ROUGE-3 Eval D0727-C.M.100.G-G.36 R:0.01684 P:0.00942 F:0.01208
36 ROUGE-3 Eval D0727-C.M.100.G-H.36 R:0.01379 P:0.00753 F:0.00974
36 ROUGE-3 Eval D0736-A.M.100.H-G.36 R:0.04029 P:0.02461 F:0.03056
36 ROUGE-3 Eval D0736-A.M.100.H-H.36 R:0.00746 P:0.00447 F:0.00559
36 ROUGE-3 Eval D0736-A.M.100.H-I.36 R:0.04000 P:0.02461 F:0.03047
36 ROUGE-3 Eval D0736-A.M.100.H-J.36 R:0.04000 P:0.02685 F:0.03213
36 ROUGE-3 Eval D0736-B.M.100.H-G.36 R:0.00391 P:0.00196 F:0.00261
36 ROUGE-3 Eval D0736-B.M.100.H-H.36 R:0.04237 P:0.01961 F:0.02681
36 ROUGE-3 Eval D0736-B.M.100.H-I.36 R:0.04721 P:0.02157 F:0.02961
36 ROUGE-3 Eval D0736-B.M.100.H-J.36 R:0.03929 P:0.02157 F:0.02785
36 ROUGE-3 Eval D0736-C.M.100.H-G.36 R:0.08225 P:0.03682 F:0.05087
36 ROUGE-3 Eval D0736-C.M.100.H-H.36 R:0.02762 P:0.00969 F:0.01435
36 ROUGE-3 Eval D0736-C.M.100.H-I.36 R:0.08287 P:0.02907 F:0.04304
36 ROUGE-3 Eval D0736-C.M.100.H-J.36 R:0.06950 P:0.03488 F:0.04645
36 ROUGE-3 Eval D0740-A.M.100.I-D.36 R:0.01010 P:0.00625 F:0.00772
36 ROUGE-3 Eval D0740-A.M.100.I-H.36 R:0.01333 P:0.00833 F:0.01025
36 ROUGE-3 Eval D0740-A.M.100.I-I.36 R:0.00662 P:0.00417 F:0.00512
36 ROUGE-3 Eval D0740-A.M.100.I-J.36 R:0.00987 P:0.00625 F:0.00765
36 ROUGE-3 Eval D0740-B.M.100.I-D.36 R:0.02318 P:0.01566 F:0.01869
36 ROUGE-3 Eval D0740-B.M.100.I-H.36 R:0.02365 P:0.01566 F:0.01884
36 ROUGE-3 Eval D0740-B.M.100.I-I.36 R:0.01003 P:0.00671 F:0.00804
36 ROUGE-3 Eval D0740-B.M.100.I-J.36 R:0.02310 P:0.01566 F:0.01867
36 ROUGE-3 Eval D0740-C.M.100.I-D.36 R:0.08795 P:0.05625 F:0.06862
36 ROUGE-3 Eval D0740-C.M.100.I-H.36 R:0.05902 P:0.03750 F:0.04586
36 ROUGE-3 Eval D0740-C.M.100.I-I.36 R:0.07166 P:0.04583 F:0.05591
36 ROUGE-3 Eval D0740-C.M.100.I-J.36 R:0.08442 P:0.05417 F:0.06599
36 ROUGE-3 Eval D0743-A.M.100.J-B.36 R:0.04207 P:0.02675 F:0.03270
36 ROUGE-3 Eval D0743-A.M.100.J-H.36 R:0.01887 P:0.01235 F:0.01493
36 ROUGE-3 Eval D0743-A.M.100.J-I.36 R:0.04140 P:0.02675 F:0.03250
36 ROUGE-3 Eval D0743-A.M.100.J-J.36 R:0.02194 P:0.01440 F:0.01739
36 ROUGE-3 Eval D0743-B.M.100.J-B.36 R:0.01307 P:0.00775 F:0.00973
36 ROUGE-3 Eval D0743-B.M.100.J-H.36 R:0.00965 P:0.00581 F:0.00725
36 ROUGE-3 Eval D0743-B.M.100.J-I.36 R:0.00968 P:0.00581 F:0.00726
36 ROUGE-3 Eval D0743-B.M.100.J-J.36 R:0.01587 P:0.00969 F:0.01203
36 ROUGE-3 Eval D0743-C.M.100.J-B.36 R:0.01294 P:0.00808 F:0.00995
36 ROUGE-3 Eval D0743-C.M.100.J-H.36 R:0.02273 P:0.01414 F:0.01743
36 ROUGE-3 Eval D0743-C.M.100.J-I.36 R:0.02280 P:0.01414 F:0.01745
36 ROUGE-3 Eval D0743-C.M.100.J-J.36 R:0.00962 P:0.00606 F:0.00744
---------------------------------------------
36 ROUGE-4 Average_R: 0.01686 (95%-conf.int. 0.01397 - 0.01985)
36 ROUGE-4 Average_P: 0.01017 (95%-conf.int. 0.00849 - 0.01197)
36 ROUGE-4 Average_F: 0.01263 (95%-conf.int. 0.01049 - 0.01484)
.............................................
36 ROUGE-4 Eval D0703-A.M.100.A-A.36 R:0.04181 P:0.02564 F:0.03179
36 ROUGE-4 Eval D0703-A.M.100.A-C.36 R:0.03806 P:0.02350 F:0.02906
36 ROUGE-4 Eval D0703-A.M.100.A-D.36 R:0.04610 P:0.02778 F:0.03467
36 ROUGE-4 Eval D0703-A.M.100.A-J.36 R:0.02105 P:0.01282 F:0.01594
36 ROUGE-4 Eval D0703-B.M.100.A-A.36 R:0.01010 P:0.00690 F:0.00820
36 ROUGE-4 Eval D0703-B.M.100.A-C.36 R:0.01384 P:0.00920 F:0.01105
36 ROUGE-4 Eval D0703-B.M.100.A-D.36 R:0.01038 P:0.00690 F:0.00829
36 ROUGE-4 Eval D0703-B.M.100.A-J.36 R:0.00685 P:0.00460 F:0.00550
36 ROUGE-4 Eval D0703-C.M.100.A-A.36 R:0.01031 P:0.00667 F:0.00810
36 ROUGE-4 Eval D0703-C.M.100.A-C.36 R:0.01003 P:0.00667 F:0.00801
36 ROUGE-4 Eval D0703-C.M.100.A-D.36 R:0.00683 P:0.00444 F:0.00538
36 ROUGE-4 Eval D0703-C.M.100.A-J.36 R:0.01365 P:0.00889 F:0.01077
36 ROUGE-4 Eval D0706-A.M.100.B-B.36 R:0.02007 P:0.01351 F:0.01615
36 ROUGE-4 Eval D0706-A.M.100.B-D.36 R:0.01347 P:0.00901 F:0.01080
36 ROUGE-4 Eval D0706-A.M.100.B-E.36 R:0.00669 P:0.00450 F:0.00538
36 ROUGE-4 Eval D0706-A.M.100.B-I.36 R:0.02007 P:0.01351 F:0.01615
36 ROUGE-4 Eval D0706-B.M.100.B-B.36 R:0.02694 P:0.01839 F:0.02186
36 ROUGE-4 Eval D0706-B.M.100.B-D.36 R:0.01678 P:0.01149 F:0.01364
36 ROUGE-4 Eval D0706-B.M.100.B-E.36 R:0.01003 P:0.00690 F:0.00818
36 ROUGE-4 Eval D0706-B.M.100.B-I.36 R:0.02667 P:0.01839 F:0.02177
36 ROUGE-4 Eval D0706-C.M.100.B-B.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0706-C.M.100.B-D.36 R:0.00664 P:0.00425 F:0.00518
36 ROUGE-4 Eval D0706-C.M.100.B-E.36 R:0.00660 P:0.00425 F:0.00517
36 ROUGE-4 Eval D0706-C.M.100.B-I.36 R:0.00658 P:0.00425 F:0.00516
36 ROUGE-4 Eval D0711-A.M.100.C-A.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0711-A.M.100.C-B.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0711-A.M.100.C-C.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0711-A.M.100.C-F.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0711-B.M.100.C-A.36 R:0.00351 P:0.00211 F:0.00264
36 ROUGE-4 Eval D0711-B.M.100.C-B.36 R:0.00707 P:0.00422 F:0.00529
36 ROUGE-4 Eval D0711-B.M.100.C-C.36 R:0.00692 P:0.00422 F:0.00524
36 ROUGE-4 Eval D0711-B.M.100.C-F.36 R:0.00350 P:0.00211 F:0.00263
36 ROUGE-4 Eval D0711-C.M.100.C-A.36 R:0.04082 P:0.02500 F:0.03101
36 ROUGE-4 Eval D0711-C.M.100.C-B.36 R:0.04577 P:0.02708 F:0.03403
36 ROUGE-4 Eval D0711-C.M.100.C-C.36 R:0.07666 P:0.04583 F:0.05737
36 ROUGE-4 Eval D0711-C.M.100.C-F.36 R:0.06620 P:0.03958 F:0.04954
36 ROUGE-4 Eval D0716-A.M.100.D-C.36 R:0.03041 P:0.01911 F:0.02347
36 ROUGE-4 Eval D0716-A.M.100.D-D.36 R:0.03093 P:0.01911 F:0.02362
36 ROUGE-4 Eval D0716-A.M.100.D-E.36 R:0.01027 P:0.00637 F:0.00786
36 ROUGE-4 Eval D0716-A.M.100.D-F.36 R:0.03061 P:0.01911 F:0.02353
36 ROUGE-4 Eval D0716-B.M.100.D-C.36 R:0.03729 P:0.02292 F:0.02839
36 ROUGE-4 Eval D0716-B.M.100.D-D.36 R:0.03806 P:0.02292 F:0.02861
36 ROUGE-4 Eval D0716-B.M.100.D-E.36 R:0.01370 P:0.00833 F:0.01036
36 ROUGE-4 Eval D0716-B.M.100.D-F.36 R:0.03436 P:0.02083 F:0.02594
36 ROUGE-4 Eval D0716-C.M.100.D-C.36 R:0.02685 P:0.01677 F:0.02065
36 ROUGE-4 Eval D0716-C.M.100.D-D.36 R:0.01379 P:0.00839 F:0.01043
36 ROUGE-4 Eval D0716-C.M.100.D-E.36 R:0.02041 P:0.01258 F:0.01557
36 ROUGE-4 Eval D0716-C.M.100.D-F.36 R:0.02062 P:0.01258 F:0.01563
36 ROUGE-4 Eval D0721-A.M.100.E-B.36 R:0.01031 P:0.00676 F:0.00817
36 ROUGE-4 Eval D0721-A.M.100.E-C.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0721-A.M.100.E-E.36 R:0.01003 P:0.00676 F:0.00808
36 ROUGE-4 Eval D0721-A.M.100.E-G.36 R:0.00984 P:0.00676 F:0.00801
36 ROUGE-4 Eval D0721-B.M.100.E-B.36 R:0.00336 P:0.00224 F:0.00269
36 ROUGE-4 Eval D0721-B.M.100.E-C.36 R:0.00328 P:0.00224 F:0.00266
36 ROUGE-4 Eval D0721-B.M.100.E-E.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0721-B.M.100.E-G.36 R:0.00332 P:0.00224 F:0.00268
36 ROUGE-4 Eval D0721-C.M.100.E-B.36 R:0.02703 P:0.01826 F:0.02180
36 ROUGE-4 Eval D0721-C.M.100.E-C.36 R:0.02041 P:0.01370 F:0.01640
36 ROUGE-4 Eval D0721-C.M.100.E-E.36 R:0.01031 P:0.00685 F:0.00823
36 ROUGE-4 Eval D0721-C.M.100.E-G.36 R:0.02349 P:0.01598 F:0.01902
36 ROUGE-4 Eval D0726-A.M.100.F-A.36 R:0.01712 P:0.01134 F:0.01364
36 ROUGE-4 Eval D0726-A.M.100.F-E.36 R:0.02062 P:0.01361 F:0.01640
36 ROUGE-4 Eval D0726-A.M.100.F-F.36 R:0.01370 P:0.00907 F:0.01091
36 ROUGE-4 Eval D0726-A.M.100.F-G.36 R:0.01027 P:0.00680 F:0.00818
36 ROUGE-4 Eval D0726-B.M.100.F-A.36 R:0.00673 P:0.00388 F:0.00492
36 ROUGE-4 Eval D0726-B.M.100.F-E.36 R:0.00685 P:0.00388 F:0.00495
36 ROUGE-4 Eval D0726-B.M.100.F-F.36 R:0.00342 P:0.00194 F:0.00248
36 ROUGE-4 Eval D0726-B.M.100.F-G.36 R:0.00339 P:0.00194 F:0.00247
36 ROUGE-4 Eval D0726-C.M.100.F-A.36 R:0.00687 P:0.00422 F:0.00523
36 ROUGE-4 Eval D0726-C.M.100.F-E.36 R:0.00694 P:0.00422 F:0.00525
36 ROUGE-4 Eval D0726-C.M.100.F-F.36 R:0.00699 P:0.00422 F:0.00526
36 ROUGE-4 Eval D0726-C.M.100.F-G.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0727-A.M.100.G-A.36 R:0.04452 P:0.02743 F:0.03395
36 ROUGE-4 Eval D0727-A.M.100.G-F.36 R:0.04068 P:0.02532 F:0.03121
36 ROUGE-4 Eval D0727-A.M.100.G-G.36 R:0.01010 P:0.00633 F:0.00778
36 ROUGE-4 Eval D0727-A.M.100.G-H.36 R:0.04746 P:0.02954 F:0.03641
36 ROUGE-4 Eval D0727-B.M.100.G-A.36 R:0.01773 P:0.00931 F:0.01221
36 ROUGE-4 Eval D0727-B.M.100.G-F.36 R:0.00669 P:0.00372 F:0.00478
36 ROUGE-4 Eval D0727-B.M.100.G-G.36 R:0.01071 P:0.00559 F:0.00735
36 ROUGE-4 Eval D0727-B.M.100.G-H.36 R:0.01773 P:0.00931 F:0.01221
36 ROUGE-4 Eval D0727-C.M.100.G-A.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0727-C.M.100.G-F.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0727-C.M.100.G-G.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0727-C.M.100.G-H.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0736-A.M.100.H-G.36 R:0.02222 P:0.01351 F:0.01680
36 ROUGE-4 Eval D0736-A.M.100.H-H.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0736-A.M.100.H-I.36 R:0.02206 P:0.01351 F:0.01676
36 ROUGE-4 Eval D0736-A.M.100.H-J.36 R:0.02020 P:0.01351 F:0.01619
36 ROUGE-4 Eval D0736-B.M.100.H-G.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0736-B.M.100.H-H.36 R:0.03433 P:0.01578 F:0.02162
36 ROUGE-4 Eval D0736-B.M.100.H-I.36 R:0.03478 P:0.01578 F:0.02171
36 ROUGE-4 Eval D0736-B.M.100.H-J.36 R:0.02888 P:0.01578 F:0.02041
36 ROUGE-4 Eval D0736-C.M.100.H-G.36 R:0.05702 P:0.02534 F:0.03509
36 ROUGE-4 Eval D0736-C.M.100.H-H.36 R:0.01685 P:0.00585 F:0.00868
36 ROUGE-4 Eval D0736-C.M.100.H-I.36 R:0.05618 P:0.01949 F:0.02894
36 ROUGE-4 Eval D0736-C.M.100.H-J.36 R:0.05078 P:0.02534 F:0.03381
36 ROUGE-4 Eval D0740-A.M.100.I-D.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0740-A.M.100.I-H.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0740-A.M.100.I-I.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0740-A.M.100.I-J.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0740-B.M.100.I-D.36 R:0.01003 P:0.00676 F:0.00808
36 ROUGE-4 Eval D0740-B.M.100.I-H.36 R:0.01024 P:0.00676 F:0.00814
36 ROUGE-4 Eval D0740-B.M.100.I-I.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0740-B.M.100.I-J.36 R:0.01000 P:0.00676 F:0.00807
36 ROUGE-4 Eval D0740-C.M.100.I-D.36 R:0.05263 P:0.03354 F:0.04097
36 ROUGE-4 Eval D0740-C.M.100.I-H.36 R:0.03311 P:0.02096 F:0.02567
36 ROUGE-4 Eval D0740-C.M.100.I-I.36 R:0.03618 P:0.02306 F:0.02817
36 ROUGE-4 Eval D0740-C.M.100.I-J.36 R:0.04590 P:0.02935 F:0.03581
36 ROUGE-4 Eval D0743-A.M.100.J-B.36 R:0.03268 P:0.02070 F:0.02535
36 ROUGE-4 Eval D0743-A.M.100.J-H.36 R:0.01587 P:0.01035 F:0.01253
36 ROUGE-4 Eval D0743-A.M.100.J-I.36 R:0.03215 P:0.02070 F:0.02518
36 ROUGE-4 Eval D0743-A.M.100.J-J.36 R:0.01582 P:0.01035 F:0.01251
36 ROUGE-4 Eval D0743-B.M.100.J-B.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0743-B.M.100.J-H.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0743-B.M.100.J-I.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0743-B.M.100.J-J.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0743-C.M.100.J-B.36 R:0.00000 P:0.00000 F:0.00000
36 ROUGE-4 Eval D0743-C.M.100.J-H.36 R:0.00656 P:0.00407 F:0.00502
36 ROUGE-4 Eval D0743-C.M.100.J-I.36 R:0.00658 P:0.00407 F:0.00503
36 ROUGE-4 Eval D0743-C.M.100.J-J.36 R:0.00647 P:0.00407 F:0.00500
---------------------------------------------
36 ROUGE-L Average_R: 0.31660 (95%-conf.int. 0.30860 - 0.32515)
36 ROUGE-L Average_P: 0.19754 (95%-conf.int. 0.19186 - 0.20321)
36 ROUGE-L Average_F: 0.24272 (95%-conf.int. 0.23643 - 0.24929)
.............................................
36 ROUGE-L Eval D0703-A.M.100.A-A.36 R:0.36486 P:0.22642 F:0.27943
36 ROUGE-L Eval D0703-A.M.100.A-C.36 R:0.34564 P:0.21593 F:0.26580
36 ROUGE-L Eval D0703-A.M.100.A-D.36 R:0.35739 P:0.21803 F:0.27083
36 ROUGE-L Eval D0703-A.M.100.A-J.36 R:0.35714 P:0.22013 F:0.27238
36 ROUGE-L Eval D0703-B.M.100.A-A.36 R:0.27124 P:0.18694 F:0.22133
36 ROUGE-L Eval D0703-B.M.100.A-C.36 R:0.31879 P:0.21396 F:0.25606
36 ROUGE-L Eval D0703-B.M.100.A-D.36 R:0.29195 P:0.19595 F:0.23451
36 ROUGE-L Eval D0703-B.M.100.A-J.36 R:0.27575 P:0.18694 F:0.22282
36 ROUGE-L Eval D0703-C.M.100.A-A.36 R:0.30333 P:0.19826 F:0.23979
36 ROUGE-L Eval D0703-C.M.100.A-C.36 R:0.30519 P:0.20479 F:0.24511
36 ROUGE-L Eval D0703-C.M.100.A-D.36 R:0.30132 P:0.19826 F:0.23916
36 ROUGE-L Eval D0703-C.M.100.A-J.36 R:0.31788 P:0.20915 F:0.25230
36 ROUGE-L Eval D0706-A.M.100.B-B.36 R:0.33117 P:0.22517 F:0.26807
36 ROUGE-L Eval D0706-A.M.100.B-D.36 R:0.27451 P:0.18543 F:0.22134
36 ROUGE-L Eval D0706-A.M.100.B-E.36 R:0.25974 P:0.17660 F:0.21025
36 ROUGE-L Eval D0706-A.M.100.B-I.36 R:0.32468 P:0.22075 F:0.26281
36 ROUGE-L Eval D0706-B.M.100.B-B.36 R:0.27124 P:0.18694 F:0.22133
36 ROUGE-L Eval D0706-B.M.100.B-D.36 R:0.24104 P:0.16667 F:0.19707
36 ROUGE-L Eval D0706-B.M.100.B-E.36 R:0.25325 P:0.17568 F:0.20745
36 ROUGE-L Eval D0706-B.M.100.B-I.36 R:0.28803 P:0.20045 F:0.23639
36 ROUGE-L Eval D0706-C.M.100.B-B.36 R:0.29032 P:0.18750 F:0.22785
36 ROUGE-L Eval D0706-C.M.100.B-D.36 R:0.32903 P:0.21250 F:0.25823
36 ROUGE-L Eval D0706-C.M.100.B-E.36 R:0.29167 P:0.18958 F:0.22980
36 ROUGE-L Eval D0706-C.M.100.B-I.36 R:0.32268 P:0.21042 F:0.25473
36 ROUGE-L Eval D0711-A.M.100.C-A.36 R:0.26316 P:0.17897 F:0.21305
36 ROUGE-L Eval D0711-A.M.100.C-B.36 R:0.27333 P:0.18345 F:0.21955
36 ROUGE-L Eval D0711-A.M.100.C-C.36 R:0.27667 P:0.18568 F:0.22222
36 ROUGE-L Eval D0711-A.M.100.C-F.36 R:0.27152 P:0.18345 F:0.21896
36 ROUGE-L Eval D0711-B.M.100.C-A.36 R:0.31973 P:0.19462 F:0.24196
36 ROUGE-L Eval D0711-B.M.100.C-B.36 R:0.35616 P:0.21532 F:0.26839
36 ROUGE-L Eval D0711-B.M.100.C-C.36 R:0.33893 P:0.20911 F:0.25864
36 ROUGE-L Eval D0711-B.M.100.C-F.36 R:0.31864 P:0.19462 F:0.24165
36 ROUGE-L Eval D0711-C.M.100.C-A.36 R:0.34653 P:0.21472 F:0.26515
36 ROUGE-L Eval D0711-C.M.100.C-B.36 R:0.35495 P:0.21268 F:0.26599
36 ROUGE-L Eval D0711-C.M.100.C-C.36 R:0.38176 P:0.23108 F:0.28790
36 ROUGE-L Eval D0711-C.M.100.C-F.36 R:0.35135 P:0.21268 F:0.26497
36 ROUGE-L Eval D0716-A.M.100.D-C.36 R:0.42295 P:0.26875 F:0.32866
36 ROUGE-L Eval D0716-A.M.100.D-D.36 R:0.43333 P:0.27083 F:0.33333
36 ROUGE-L Eval D0716-A.M.100.D-E.36 R:0.44518 P:0.27917 F:0.34315
36 ROUGE-L Eval D0716-A.M.100.D-F.36 R:0.42574 P:0.26875 F:0.32950
36 ROUGE-L Eval D0716-B.M.100.D-C.36 R:0.39145 P:0.24335 F:0.30012
36 ROUGE-L Eval D0716-B.M.100.D-D.36 R:0.41946 P:0.25562 F:0.31766
36 ROUGE-L Eval D0716-B.M.100.D-E.36 R:0.35880 P:0.22086 F:0.27342
36 ROUGE-L Eval D0716-B.M.100.D-F.36 R:0.37667 P:0.23108 F:0.28644
36 ROUGE-L Eval D0716-C.M.100.D-C.36 R:0.36482 P:0.23045 F:0.28247
36 ROUGE-L Eval D0716-C.M.100.D-D.36 R:0.37124 P:0.22840 F:0.28281
36 ROUGE-L Eval D0716-C.M.100.D-E.36 R:0.40594 P:0.25309 F:0.31179
36 ROUGE-L Eval D0716-C.M.100.D-F.36 R:0.38667 P:0.23868 F:0.29516
36 ROUGE-L Eval D0721-A.M.100.E-B.36 R:0.30000 P:0.19868 F:0.23905
36 ROUGE-L Eval D0721-A.M.100.E-C.36 R:0.29545 P:0.20088 F:0.23916
36 ROUGE-L Eval D0721-A.M.100.E-E.36 R:0.30195 P:0.20530 F:0.24442
36 ROUGE-L Eval D0721-A.M.100.E-G.36 R:0.29299 P:0.20309 F:0.23989
36 ROUGE-L Eval D0721-B.M.100.E-B.36 R:0.30619 P:0.20614 F:0.24640
36 ROUGE-L Eval D0721-B.M.100.E-C.36 R:0.30573 P:0.21053 F:0.24935
36 ROUGE-L Eval D0721-B.M.100.E-E.36 R:0.27541 P:0.18421 F:0.22076
36 ROUGE-L Eval D0721-B.M.100.E-G.36 R:0.28710 P:0.19518 F:0.23238
36 ROUGE-L Eval D0721-C.M.100.E-B.36 R:0.31803 P:0.21700 F:0.25798
36 ROUGE-L Eval D0721-C.M.100.E-C.36 R:0.28383 P:0.19239 F:0.22933
36 ROUGE-L Eval D0721-C.M.100.E-E.36 R:0.27000 P:0.18121 F:0.21687
36 ROUGE-L Eval D0721-C.M.100.E-G.36 R:0.28339 P:0.19463 F:0.23077
36 ROUGE-L Eval D0726-A.M.100.F-A.36 R:0.34884 P:0.23333 F:0.27963
36 ROUGE-L Eval D0726-A.M.100.F-E.36 R:0.35667 P:0.23778 F:0.28534
36 ROUGE-L Eval D0726-A.M.100.F-F.36 R:0.36877 P:0.24667 F:0.29561
36 ROUGE-L Eval D0726-A.M.100.F-G.36 R:0.35216 P:0.23556 F:0.28229
36 ROUGE-L Eval D0726-B.M.100.F-A.36 R:0.29739 P:0.17333 F:0.21901
36 ROUGE-L Eval D0726-B.M.100.F-E.36 R:0.27907 P:0.16000 F:0.20339
36 ROUGE-L Eval D0726-B.M.100.F-F.36 R:0.29236 P:0.16762 F:0.21308
36 ROUGE-L Eval D0726-B.M.100.F-G.36 R:0.28947 P:0.16762 F:0.21230
36 ROUGE-L Eval D0726-C.M.100.F-A.36 R:0.33333 P:0.20704 F:0.25543
36 ROUGE-L Eval D0726-C.M.100.F-E.36 R:0.33670 P:0.20704 F:0.25641
36 ROUGE-L Eval D0726-C.M.100.F-F.36 R:0.31525 P:0.19255 F:0.23908
36 ROUGE-L Eval D0726-C.M.100.F-G.36 R:0.28852 P:0.18219 F:0.22335
36 ROUGE-L Eval D0727-A.M.100.G-A.36 R:0.42193 P:0.26294 F:0.32398
36 ROUGE-L Eval D0727-A.M.100.G-F.36 R:0.38816 P:0.24431 F:0.29988
36 ROUGE-L Eval D0727-A.M.100.G-G.36 R:0.38235 P:0.24224 F:0.29658
36 ROUGE-L Eval D0727-A.M.100.G-H.36 R:0.40789 P:0.25673 F:0.31512
36 ROUGE-L Eval D0727-B.M.100.G-A.36 R:0.29553 P:0.15751 F:0.20550
36 ROUGE-L Eval D0727-B.M.100.G-F.36 R:0.27273 P:0.15385 F:0.19673
36 ROUGE-L Eval D0727-B.M.100.G-G.36 R:0.26990 P:0.14286 F:0.18683
36 ROUGE-L Eval D0727-B.M.100.G-H.36 R:0.29210 P:0.15568 F:0.20311
36 ROUGE-L Eval D0727-C.M.100.G-A.36 R:0.32899 P:0.18808 F:0.23933
36 ROUGE-L Eval D0727-C.M.100.G-F.36 R:0.34007 P:0.18808 F:0.24221
36 ROUGE-L Eval D0727-C.M.100.G-G.36 R:0.33663 P:0.18994 F:0.24285
36 ROUGE-L Eval D0727-C.M.100.G-H.36 R:0.34122 P:0.18808 F:0.24250
36 ROUGE-L Eval D0736-A.M.100.H-G.36 R:0.30108 P:0.18543 F:0.22951
36 ROUGE-L Eval D0736-A.M.100.H-H.36 R:0.28832 P:0.17439 F:0.21733
36 ROUGE-L Eval D0736-A.M.100.H-I.36 R:0.30961 P:0.19205 F:0.23706
36 ROUGE-L Eval D0736-A.M.100.H-J.36 R:0.30065 P:0.20309 F:0.24242
36 ROUGE-L Eval D0736-B.M.100.H-G.36 R:0.29008 P:0.14729 F:0.19538
36 ROUGE-L Eval D0736-B.M.100.H-H.36 R:0.31405 P:0.14729 F:0.20053
36 ROUGE-L Eval D0736-B.M.100.H-I.36 R:0.33054 P:0.15310 F:0.20927
36 ROUGE-L Eval D0736-B.M.100.H-J.36 R:0.32517 P:0.18023 F:0.23192
36 ROUGE-L Eval D0736-C.M.100.H-G.36 R:0.32068 P:0.14559 F:0.20026
36 ROUGE-L Eval D0736-C.M.100.H-H.36 R:0.30481 P:0.10920 F:0.16079
36 ROUGE-L Eval D0736-C.M.100.H-I.36 R:0.33690 P:0.12069 F:0.17772
36 ROUGE-L Eval D0736-C.M.100.H-J.36 R:0.31321 P:0.15900 F:0.21092
36 ROUGE-L Eval D0740-A.M.100.I-D.36 R:0.29703 P:0.18519 F:0.22814
36 ROUGE-L Eval D0740-A.M.100.I-H.36 R:0.28431 P:0.17901 F:0.21969
36 ROUGE-L Eval D0740-A.M.100.I-I.36 R:0.28247 P:0.17901 F:0.21914
36 ROUGE-L Eval D0740-A.M.100.I-J.36 R:0.28065 P:0.17901 F:0.21859
36 ROUGE-L Eval D0740-B.M.100.I-D.36 R:0.28571 P:0.19426 F:0.23127
36 ROUGE-L Eval D0740-B.M.100.I-H.36 R:0.24172 P:0.16115 F:0.19338
36 ROUGE-L Eval D0740-B.M.100.I-I.36 R:0.26230 P:0.17660 F:0.21108
36 ROUGE-L Eval D0740-B.M.100.I-J.36 R:0.27832 P:0.18985 F:0.22573
36 ROUGE-L Eval D0740-C.M.100.I-D.36 R:0.36422 P:0.23457 F:0.28536
36 ROUGE-L Eval D0740-C.M.100.I-H.36 R:0.36013 P:0.23045 F:0.28105
36 ROUGE-L Eval D0740-C.M.100.I-I.36 R:0.37061 P:0.23868 F:0.29036
36 ROUGE-L Eval D0740-C.M.100.I-J.36 R:0.38217 P:0.24691 F:0.30000
36 ROUGE-L Eval D0743-A.M.100.J-B.36 R:0.29206 P:0.18699 F:0.22800
36 ROUGE-L Eval D0743-A.M.100.J-H.36 R:0.24383 P:0.16057 F:0.19363
36 ROUGE-L Eval D0743-A.M.100.J-I.36 R:0.30000 P:0.19512 F:0.23645
36 ROUGE-L Eval D0743-A.M.100.J-J.36 R:0.26769 P:0.17683 F:0.21297
36 ROUGE-L Eval D0743-B.M.100.J-B.36 R:0.23397 P:0.13985 F:0.17506
36 ROUGE-L Eval D0743-B.M.100.J-H.36 R:0.23344 P:0.14176 F:0.17640
36 ROUGE-L Eval D0743-B.M.100.J-I.36 R:0.24367 P:0.14751 F:0.18377
36 ROUGE-L Eval D0743-B.M.100.J-J.36 R:0.23676 P:0.14559 F:0.18031
36 ROUGE-L Eval D0743-C.M.100.J-B.36 R:0.27619 P:0.17365 F:0.21323
36 ROUGE-L Eval D0743-C.M.100.J-H.36 R:0.27389 P:0.17166 F:0.21105
36 ROUGE-L Eval D0743-C.M.100.J-I.36 R:0.30671 P:0.19162 F:0.23587
36 ROUGE-L Eval D0743-C.M.100.J-J.36 R:0.26730 P:0.16966 F:0.20757
---------------------------------------------
36 ROUGE-W-1.2 Average_R: 0.11126 (95%-conf.int. 0.10873 - 0.11394)
36 ROUGE-W-1.2 Average_P: 0.12579 (95%-conf.int. 0.12249 - 0.12939)
36 ROUGE-W-1.2 Average_F: 0.11772 (95%-conf.int. 0.11509 - 0.12064)
.............................................
36 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.36 R:0.13195 P:0.14744 F:0.13927
36 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.36 R:0.12487 P:0.14179 F:0.13279
36 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.36 R:0.13047 P:0.14675 F:0.13813
36 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.36 R:0.13328 P:0.14052 F:0.13680
36 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.36 R:0.09611 P:0.12282 F:0.10784
36 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.36 R:0.10916 P:0.13865 F:0.12215
36 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.36 R:0.09950 P:0.12527 F:0.11091
36 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.36 R:0.09655 P:0.12140 F:0.10756
36 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.36 R:0.10107 P:0.12282 F:0.11089
36 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.36 R:0.09753 P:0.12357 F:0.10902
36 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.36 R:0.09701 P:0.12115 F:0.10774
36 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.36 R:0.10670 P:0.12644 F:0.11573
36 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.36 R:0.11567 P:0.14114 F:0.12714
36 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.36 R:0.09362 P:0.11604 F:0.10363
36 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.36 R:0.08845 P:0.10906 F:0.09768
36 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.36 R:0.11270 P:0.14200 F:0.12566
36 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.36 R:0.10278 P:0.12268 F:0.11185
36 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.36 R:0.08802 P:0.10732 F:0.09672
36 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.36 R:0.09230 P:0.11302 F:0.10161
36 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.36 R:0.10226 P:0.12870 F:0.11397
36 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.36 R:0.10831 P:0.11939 F:0.11358
36 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.36 R:0.11715 P:0.13025 F:0.12335
36 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.36 R:0.10796 P:0.11887 F:0.11315
36 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.36 R:0.11821 P:0.13387 F:0.12555
36 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.36 R:0.09418 P:0.11548 F:0.10375
36 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.36 R:0.09318 P:0.11327 F:0.10225
36 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.36 R:0.09870 P:0.11895 F:0.10788
36 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.36 R:0.09569 P:0.11727 F:0.10539
36 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.36 R:0.11061 P:0.12012 F:0.11517
36 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.36 R:0.11678 P:0.13231 F:0.12406
36 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.36 R:0.11106 P:0.12872 F:0.11924
36 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.36 R:0.10434 P:0.11836 F:0.11091
36 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.36 R:0.11814 P:0.13686 F:0.12681
36 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.36 R:0.11891 P:0.13324 F:0.12567
36 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.36 R:0.13078 P:0.15031 F:0.13987
36 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.36 R:0.12114 P:0.14132 F:0.13045
36 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.36 R:0.14351 P:0.16660 F:0.15420
36 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.36 R:0.14077 P:0.16762 F:0.15303
36 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.36 R:0.14826 P:0.17363 F:0.15995
36 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.36 R:0.13917 P:0.16706 F:0.15184
36 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.36 R:0.14566 P:0.15797 F:0.15157
36 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.36 R:0.15041 P:0.16403 F:0.15693
36 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.36 R:0.13117 P:0.14374 F:0.13717
36 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.36 R:0.13769 P:0.14952 F:0.14336
36 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.36 R:0.12503 P:0.14721 F:0.13522
36 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.36 R:0.12171 P:0.14521 F:0.13243
36 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.36 R:0.13243 P:0.16000 F:0.14492
36 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.36 R:0.12854 P:0.15435 F:0.14027
36 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.36 R:0.11211 P:0.13050 F:0.12061
36 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.36 R:0.10849 P:0.13087 F:0.11863
36 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.36 R:0.10975 P:0.13405 F:0.12069
36 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.36 R:0.10902 P:0.13243 F:0.11959
36 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.36 R:0.09941 P:0.12938 F:0.11243
36 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.36 R:0.10138 P:0.13121 F:0.11438
36 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.36 R:0.08962 P:0.11766 F:0.10174
36 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.36 R:0.08999 P:0.12210 F:0.10361
36 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.36 R:0.10933 P:0.13731 F:0.12173
36 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.36 R:0.09738 P:0.12420 F:0.10917
36 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.36 R:0.09171 P:0.11488 F:0.10200
36 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.36 R:0.09891 P:0.12704 F:0.11122
36 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.36 R:0.11905 P:0.14111 F:0.12914
36 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.36 R:0.12374 P:0.14453 F:0.13333
36 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.36 R:0.12294 P:0.14647 F:0.13368
36 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.36 R:0.12029 P:0.14564 F:0.13176
36 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.36 R:0.10876 P:0.11151 F:0.11012
36 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.36 R:0.09649 P:0.09987 F:0.09815
36 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.36 R:0.10465 P:0.10901 F:0.10679
36 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.36 R:0.10359 P:0.10831 F:0.10590
36 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.36 R:0.11867 P:0.12943 F:0.12382
36 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.36 R:0.11814 P:0.12821 F:0.12297
36 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.36 R:0.11153 P:0.12199 F:0.11653
36 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.36 R:0.10051 P:0.11364 F:0.10667
36 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.36 R:0.14026 P:0.15386 F:0.14675
36 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.36 R:0.12623 P:0.14502 F:0.13497
36 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.36 R:0.12058 P:0.13529 F:0.12751
36 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.36 R:0.14172 P:0.15989 F:0.15026
36 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.36 R:0.11161 P:0.10437 F:0.10787
36 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.36 R:0.09713 P:0.09842 F:0.09777
36 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.36 R:0.09567 P:0.09070 F:0.09312
36 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.36 R:0.10731 P:0.10124 F:0.10419
36 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.36 R:0.11461 P:0.11784 F:0.11620
36 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.36 R:0.11571 P:0.11828 F:0.11698
36 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.36 R:0.11601 P:0.12049 F:0.11821
36 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.36 R:0.12050 P:0.11955 F:0.12002
36 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.36 R:0.11265 P:0.12286 F:0.11753
36 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.36 R:0.10084 P:0.10726 F:0.10395
36 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.36 R:0.11113 P:0.12317 F:0.11684
36 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.36 R:0.10533 P:0.12684 F:0.11509
36 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.36 R:0.10087 P:0.09480 F:0.09774
36 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.36 R:0.11453 P:0.09937 F:0.10641
36 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.36 R:0.12027 P:0.10289 F:0.11090
36 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.36 R:0.11470 P:0.11752 F:0.11609
36 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.36 R:0.12685 P:0.10462 F:0.11467
36 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.36 R:0.11708 P:0.07840 F:0.09391
36 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.36 R:0.13470 P:0.08803 F:0.10648
36 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.36 R:0.12272 P:0.11115 F:0.11665
36 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.36 R:0.10408 P:0.11936 F:0.11120
36 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.36 R:0.10074 P:0.11443 F:0.10715
36 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.36 R:0.09514 P:0.11152 F:0.10268
36 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.36 R:0.09557 P:0.11198 F:0.10313
36 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.36 R:0.10543 P:0.13170 F:0.11711
36 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.36 R:0.09357 P:0.11101 F:0.10155
36 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.36 R:0.09366 P:0.11849 F:0.10462
36 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.36 R:0.10740 P:0.13097 F:0.11802
36 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.36 R:0.12338 P:0.15335 F:0.13674
36 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.36 R:0.12779 P:0.15262 F:0.13911
36 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.36 R:0.12291 P:0.15480 F:0.13702
36 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.36 R:0.13022 P:0.16122 F:0.14407
36 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.36 R:0.10781 P:0.12032 F:0.11372
36 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.36 R:0.09028 P:0.10270 F:0.09609
36 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.36 R:0.10840 P:0.12511 F:0.11616
36 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.36 R:0.09865 P:0.11312 F:0.10539
36 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.36 R:0.08552 P:0.08560 F:0.08556
36 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.36 R:0.09079 P:0.09144 F:0.09111
36 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.36 R:0.09442 P:0.09632 F:0.09536
36 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.36 R:0.09196 P:0.09298 F:0.09247
36 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.36 R:0.09971 P:0.10973 F:0.10448
36 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.36 R:0.10067 P:0.10537 F:0.10297
36 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.36 R:0.10742 P:0.11959 F:0.11318
36 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.36 R:0.09501 P:0.10150 F:0.09815
---------------------------------------------
36 ROUGE-SU4 Average_R: 0.12768 (95%-conf.int. 0.12288 - 0.13319)
36 ROUGE-SU4 Average_P: 0.07869 (95%-conf.int. 0.07550 - 0.08210)
36 ROUGE-SU4 Average_F: 0.09712 (95%-conf.int. 0.09342 - 0.10129)
.............................................
36 ROUGE-SU4 Eval D0703-A.M.100.A-A.36 R:0.17477 P:0.10732 F:0.13298
36 ROUGE-SU4 Eval D0703-A.M.100.A-C.36 R:0.17414 P:0.10768 F:0.13307
36 ROUGE-SU4 Eval D0703-A.M.100.A-D.36 R:0.17256 P:0.10412 F:0.12988
36 ROUGE-SU4 Eval D0703-A.M.100.A-J.36 R:0.16026 P:0.09773 F:0.12142
36 ROUGE-SU4 Eval D0703-B.M.100.A-A.36 R:0.11186 P:0.07645 F:0.09083
36 ROUGE-SU4 Eval D0703-B.M.100.A-C.36 R:0.14655 P:0.09748 F:0.11708
36 ROUGE-SU4 Eval D0703-B.M.100.A-D.36 R:0.12241 P:0.08142 F:0.09779
36 ROUGE-SU4 Eval D0703-B.M.100.A-J.36 R:0.11490 P:0.07722 F:0.09236
36 ROUGE-SU4 Eval D0703-C.M.100.A-A.36 R:0.10731 P:0.06948 F:0.08435
36 ROUGE-SU4 Eval D0703-C.M.100.A-C.36 R:0.11500 P:0.07650 F:0.09188
36 ROUGE-SU4 Eval D0703-C.M.100.A-D.36 R:0.11054 P:0.07206 F:0.08725
36 ROUGE-SU4 Eval D0703-C.M.100.A-J.36 R:0.11281 P:0.07354 F:0.08904
36 ROUGE-SU4 Eval D0706-A.M.100.B-B.36 R:0.12500 P:0.08427 F:0.10067
36 ROUGE-SU4 Eval D0706-A.M.100.B-D.36 R:0.09899 P:0.06629 F:0.07941
36 ROUGE-SU4 Eval D0706-A.M.100.B-E.36 R:0.09500 P:0.06404 F:0.07651
36 ROUGE-SU4 Eval D0706-A.M.100.B-I.36 R:0.12333 P:0.08315 F:0.09933
36 ROUGE-SU4 Eval D0706-B.M.100.B-B.36 R:0.11242 P:0.07683 F:0.09128
36 ROUGE-SU4 Eval D0706-B.M.100.B-D.36 R:0.08696 P:0.05963 F:0.07075
36 ROUGE-SU4 Eval D0706-B.M.100.B-E.36 R:0.09167 P:0.06307 F:0.07473
36 ROUGE-SU4 Eval D0706-B.M.100.B-I.36 R:0.11960 P:0.08257 F:0.09769
36 ROUGE-SU4 Eval D0706-C.M.100.B-B.36 R:0.09658 P:0.06179 F:0.07536
36 ROUGE-SU4 Eval D0706-C.M.100.B-D.36 R:0.11921 P:0.07627 F:0.09302
36 ROUGE-SU4 Eval D0706-C.M.100.B-E.36 R:0.10800 P:0.06956 F:0.08462
36 ROUGE-SU4 Eval D0706-C.M.100.B-I.36 R:0.11639 P:0.07521 F:0.09137
36 ROUGE-SU4 Eval D0711-A.M.100.C-A.36 R:0.10304 P:0.06948 F:0.08300
36 ROUGE-SU4 Eval D0711-A.M.100.C-B.36 R:0.10274 P:0.06834 F:0.08208
36 ROUGE-SU4 Eval D0711-A.M.100.C-C.36 R:0.10674 P:0.07099 F:0.08527
36 ROUGE-SU4 Eval D0711-A.M.100.C-F.36 R:0.10828 P:0.07251 F:0.08686
36 ROUGE-SU4 Eval D0711-B.M.100.C-A.36 R:0.12529 P:0.07544 F:0.09418
36 ROUGE-SU4 Eval D0711-B.M.100.C-B.36 R:0.15141 P:0.09053 F:0.11331
36 ROUGE-SU4 Eval D0711-B.M.100.C-C.36 R:0.14770 P:0.09018 F:0.11199
36 ROUGE-SU4 Eval D0711-B.M.100.C-F.36 R:0.11963 P:0.07228 F:0.09011
36 ROUGE-SU4 Eval D0711-C.M.100.C-A.36 R:0.14972 P:0.09182 F:0.11383
36 ROUGE-SU4 Eval D0711-C.M.100.C-B.36 R:0.15497 P:0.09182 F:0.11532
36 ROUGE-SU4 Eval D0711-C.M.100.C-C.36 R:0.19329 P:0.11573 F:0.14478
36 ROUGE-SU4 Eval D0711-C.M.100.C-F.36 R:0.17361 P:0.10395 F:0.13004
36 ROUGE-SU4 Eval D0716-A.M.100.D-C.36 R:0.19248 P:0.12112 F:0.14868
36 ROUGE-SU4 Eval D0716-A.M.100.D-D.36 R:0.20091 P:0.12429 F:0.15357
36 ROUGE-SU4 Eval D0716-A.M.100.D-E.36 R:0.20193 P:0.12535 F:0.15468
36 ROUGE-SU4 Eval D0716-A.M.100.D-F.36 R:0.19322 P:0.12076 F:0.14863
36 ROUGE-SU4 Eval D0716-B.M.100.D-C.36 R:0.18187 P:0.11192 F:0.13857
36 ROUGE-SU4 Eval D0716-B.M.100.D-D.36 R:0.19483 P:0.11746 F:0.14656
36 ROUGE-SU4 Eval D0716-B.M.100.D-E.36 R:0.15074 P:0.09182 F:0.11412
36 ROUGE-SU4 Eval D0716-B.M.100.D-F.36 R:0.17295 P:0.10499 F:0.13066
36 ROUGE-SU4 Eval D0716-C.M.100.D-C.36 R:0.14493 P:0.09066 F:0.11154
36 ROUGE-SU4 Eval D0716-C.M.100.D-D.36 R:0.14777 P:0.08996 F:0.11184
36 ROUGE-SU4 Eval D0716-C.M.100.D-E.36 R:0.16158 P:0.09972 F:0.12333
36 ROUGE-SU4 Eval D0716-C.M.100.D-F.36 R:0.15753 P:0.09623 F:0.11948
36 ROUGE-SU4 Eval D0721-A.M.100.E-B.36 R:0.11187 P:0.07341 F:0.08865
36 ROUGE-SU4 Eval D0721-A.M.100.E-C.36 R:0.10389 P:0.07004 F:0.08367
36 ROUGE-SU4 Eval D0721-A.M.100.E-E.36 R:0.11000 P:0.07416 F:0.08859
36 ROUGE-SU4 Eval D0721-A.M.100.E-G.36 R:0.11002 P:0.07566 F:0.08966
36 ROUGE-SU4 Eval D0721-B.M.100.E-B.36 R:0.12932 P:0.08631 F:0.10353
36 ROUGE-SU4 Eval D0721-B.M.100.E-C.36 R:0.12800 P:0.08743 F:0.10389
36 ROUGE-SU4 Eval D0721-B.M.100.E-E.36 R:0.11055 P:0.07329 F:0.08814
36 ROUGE-SU4 Eval D0721-B.M.100.E-G.36 R:0.11865 P:0.07999 F:0.09556
36 ROUGE-SU4 Eval D0721-C.M.100.E-B.36 R:0.13636 P:0.09226 F:0.11006
36 ROUGE-SU4 Eval D0721-C.M.100.E-C.36 R:0.12203 P:0.08200 F:0.09809
36 ROUGE-SU4 Eval D0721-C.M.100.E-E.36 R:0.10274 P:0.06834 F:0.08208
36 ROUGE-SU4 Eval D0721-C.M.100.E-G.36 R:0.12040 P:0.08200 F:0.09756
36 ROUGE-SU4 Eval D0726-A.M.100.F-A.36 R:0.12287 P:0.08145 F:0.09796
36 ROUGE-SU4 Eval D0726-A.M.100.F-E.36 R:0.13242 P:0.08748 F:0.10536
36 ROUGE-SU4 Eval D0726-A.M.100.F-F.36 R:0.13197 P:0.08748 F:0.10522
36 ROUGE-SU4 Eval D0726-A.M.100.F-G.36 R:0.12856 P:0.08522 F:0.10250
36 ROUGE-SU4 Eval D0726-B.M.100.F-A.36 R:0.10179 P:0.05867 F:0.07444
36 ROUGE-SU4 Eval D0726-B.M.100.F-E.36 R:0.08703 P:0.04932 F:0.06296
36 ROUGE-SU4 Eval D0726-B.M.100.F-F.36 R:0.10296 P:0.05835 F:0.07449
36 ROUGE-SU4 Eval D0726-B.M.100.F-G.36 R:0.10135 P:0.05803 F:0.07380
36 ROUGE-SU4 Eval D0726-C.M.100.F-A.36 R:0.12500 P:0.07684 F:0.09517
36 ROUGE-SU4 Eval D0726-C.M.100.F-E.36 R:0.12976 P:0.07895 F:0.09817
36 ROUGE-SU4 Eval D0726-C.M.100.F-F.36 R:0.12079 P:0.07298 F:0.09099
36 ROUGE-SU4 Eval D0726-C.M.100.F-G.36 R:0.10382 P:0.06491 F:0.07988
36 ROUGE-SU4 Eval D0727-A.M.100.G-A.36 R:0.18487 P:0.11404 F:0.14106
36 ROUGE-SU4 Eval D0727-A.M.100.G-F.36 R:0.16723 P:0.10421 F:0.12840
36 ROUGE-SU4 Eval D0727-A.M.100.G-G.36 R:0.13982 P:0.08772 F:0.10781
36 ROUGE-SU4 Eval D0727-A.M.100.G-H.36 R:0.17962 P:0.11193 F:0.13792
36 ROUGE-SU4 Eval D0727-B.M.100.G-A.36 R:0.12250 P:0.06444 F:0.08445
36 ROUGE-SU4 Eval D0727-B.M.100.G-F.36 R:0.09722 P:0.05421 F:0.06961
36 ROUGE-SU4 Eval D0727-B.M.100.G-G.36 R:0.10676 P:0.05576 F:0.07326
36 ROUGE-SU4 Eval D0727-B.M.100.G-H.36 R:0.11543 P:0.06072 F:0.07958
36 ROUGE-SU4 Eval D0727-C.M.100.G-A.36 R:0.12375 P:0.06994 F:0.08937
36 ROUGE-SU4 Eval D0727-C.M.100.G-F.36 R:0.13091 P:0.07152 F:0.09250
36 ROUGE-SU4 Eval D0727-C.M.100.G-G.36 R:0.12655 P:0.07057 F:0.09061
36 ROUGE-SU4 Eval D0727-C.M.100.G-H.36 R:0.13657 P:0.07435 F:0.09628
36 ROUGE-SU4 Eval D0736-A.M.100.H-G.36 R:0.11747 P:0.07154 F:0.08892
36 ROUGE-SU4 Eval D0736-A.M.100.H-H.36 R:0.10150 P:0.06067 F:0.07595
36 ROUGE-SU4 Eval D0736-A.M.100.H-I.36 R:0.12393 P:0.07603 F:0.09424
36 ROUGE-SU4 Eval D0736-A.M.100.H-J.36 R:0.11689 P:0.07828 F:0.09377
36 ROUGE-SU4 Eval D0736-B.M.100.H-G.36 R:0.09908 P:0.04954 F:0.06605
36 ROUGE-SU4 Eval D0736-B.M.100.H-H.36 R:0.13248 P:0.06102 F:0.08355
36 ROUGE-SU4 Eval D0736-B.M.100.H-I.36 R:0.14358 P:0.06529 F:0.08976
36 ROUGE-SU4 Eval D0736-B.M.100.H-J.36 R:0.13189 P:0.07218 F:0.09330
36 ROUGE-SU4 Eval D0736-C.M.100.H-G.36 R:0.15575 P:0.06939 F:0.09601
36 ROUGE-SU4 Eval D0736-C.M.100.H-H.36 R:0.12011 P:0.04183 F:0.06205
36 ROUGE-SU4 Eval D0736-C.M.100.H-I.36 R:0.17691 P:0.06161 F:0.09139
36 ROUGE-SU4 Eval D0736-C.M.100.H-J.36 R:0.14073 P:0.07036 F:0.09382
36 ROUGE-SU4 Eval D0740-A.M.100.I-D.36 R:0.10847 P:0.06695 F:0.08280
36 ROUGE-SU4 Eval D0740-A.M.100.I-H.36 R:0.09843 P:0.06137 F:0.07560
36 ROUGE-SU4 Eval D0740-A.M.100.I-I.36 R:0.10167 P:0.06381 F:0.07841
36 ROUGE-SU4 Eval D0740-A.M.100.I-J.36 R:0.10155 P:0.06416 F:0.07864
36 ROUGE-SU4 Eval D0740-B.M.100.I-D.36 R:0.12444 P:0.08390 F:0.10023
36 ROUGE-SU4 Eval D0740-B.M.100.I-H.36 R:0.09524 P:0.06292 F:0.07578
36 ROUGE-SU4 Eval D0740-B.M.100.I-I.36 R:0.10494 P:0.07004 F:0.08401
36 ROUGE-SU4 Eval D0740-B.M.100.I-J.36 R:0.12292 P:0.08315 F:0.09920
36 ROUGE-SU4 Eval D0740-C.M.100.I-D.36 R:0.17596 P:0.11227 F:0.13708
36 ROUGE-SU4 Eval D0740-C.M.100.I-H.36 R:0.15622 P:0.09902 F:0.12121
36 ROUGE-SU4 Eval D0740-C.M.100.I-I.36 R:0.17923 P:0.11437 F:0.13964
36 ROUGE-SU4 Eval D0740-C.M.100.I-J.36 R:0.18900 P:0.12099 F:0.14753
36 ROUGE-SU4 Eval D0743-A.M.100.J-B.36 R:0.10586 P:0.06715 F:0.08217
36 ROUGE-SU4 Eval D0743-A.M.100.J-H.36 R:0.08070 P:0.05269 F:0.06375
36 ROUGE-SU4 Eval D0743-A.M.100.J-I.36 R:0.11058 P:0.07128 F:0.08668
36 ROUGE-SU4 Eval D0743-A.M.100.J-J.36 R:0.08991 P:0.05888 F:0.07116
36 ROUGE-SU4 Eval D0743-B.M.100.J-B.36 R:0.08059 P:0.04767 F:0.05991
36 ROUGE-SU4 Eval D0743-B.M.100.J-H.36 R:0.07443 P:0.04475 F:0.05589
36 ROUGE-SU4 Eval D0743-B.M.100.J-I.36 R:0.08333 P:0.04994 F:0.06245
36 ROUGE-SU4 Eval D0743-B.M.100.J-J.36 R:0.07774 P:0.04734 F:0.05885
36 ROUGE-SU4 Eval D0743-C.M.100.J-B.36 R:0.10423 P:0.06491 F:0.08000
36 ROUGE-SU4 Eval D0743-C.M.100.J-H.36 R:0.09804 P:0.06085 F:0.07509
36 ROUGE-SU4 Eval D0743-C.M.100.J-I.36 R:0.12295 P:0.07606 F:0.09398
36 ROUGE-SU4 Eval D0743-C.M.100.J-J.36 R:0.09839 P:0.06187 F:0.07597
---------------------------------------------
37 ROUGE-1 Average_R: 0.28317 (95%-conf.int. 0.27301 - 0.29388)
37 ROUGE-1 Average_P: 0.18535 (95%-conf.int. 0.17660 - 0.19448)
37 ROUGE-1 Average_F: 0.22328 (95%-conf.int. 0.21349 - 0.23314)
.............................................
37 ROUGE-1 Eval D0703-A.M.100.A-A.37 R:0.27703 P:0.20865 F:0.23803
37 ROUGE-1 Eval D0703-A.M.100.A-C.37 R:0.25839 P:0.19593 F:0.22287
37 ROUGE-1 Eval D0703-A.M.100.A-D.37 R:0.26804 P:0.19847 F:0.22807
37 ROUGE-1 Eval D0703-A.M.100.A-J.37 R:0.25510 P:0.19084 F:0.21834
37 ROUGE-1 Eval D0703-B.M.100.A-A.37 R:0.25490 P:0.17450 F:0.20717
37 ROUGE-1 Eval D0703-B.M.100.A-C.37 R:0.29866 P:0.19911 F:0.23893
37 ROUGE-1 Eval D0703-B.M.100.A-D.37 R:0.26510 P:0.17673 F:0.21208
37 ROUGE-1 Eval D0703-B.M.100.A-J.37 R:0.25914 P:0.17450 F:0.20856
37 ROUGE-1 Eval D0703-C.M.100.A-A.37 R:0.37333 P:0.23333 F:0.28718
37 ROUGE-1 Eval D0703-C.M.100.A-C.37 R:0.36039 P:0.23125 F:0.28173
37 ROUGE-1 Eval D0703-C.M.100.A-D.37 R:0.35762 P:0.22500 F:0.27622
37 ROUGE-1 Eval D0703-C.M.100.A-J.37 R:0.39404 P:0.24792 F:0.30435
37 ROUGE-1 Eval D0706-A.M.100.B-B.37 R:0.24026 P:0.15612 F:0.18926
37 ROUGE-1 Eval D0706-A.M.100.B-D.37 R:0.21242 P:0.13713 F:0.16667
37 ROUGE-1 Eval D0706-A.M.100.B-E.37 R:0.20455 P:0.13291 F:0.16113
37 ROUGE-1 Eval D0706-A.M.100.B-I.37 R:0.24026 P:0.15612 F:0.18926
37 ROUGE-1 Eval D0706-B.M.100.B-B.37 R:0.15033 P:0.08519 F:0.10875
37 ROUGE-1 Eval D0706-B.M.100.B-D.37 R:0.14007 P:0.07963 F:0.10154
37 ROUGE-1 Eval D0706-B.M.100.B-E.37 R:0.15260 P:0.08704 F:0.11085
37 ROUGE-1 Eval D0706-B.M.100.B-I.37 R:0.13269 P:0.07593 F:0.09659
37 ROUGE-1 Eval D0706-C.M.100.B-B.37 R:0.32903 P:0.22667 F:0.26842
37 ROUGE-1 Eval D0706-C.M.100.B-D.37 R:0.31290 P:0.21556 F:0.25527
37 ROUGE-1 Eval D0706-C.M.100.B-E.37 R:0.32372 P:0.22444 F:0.26509
37 ROUGE-1 Eval D0706-C.M.100.B-I.37 R:0.31629 P:0.22000 F:0.25950
37 ROUGE-1 Eval D0711-A.M.100.C-A.37 R:0.37500 P:0.23457 F:0.28861
37 ROUGE-1 Eval D0711-A.M.100.C-B.37 R:0.39000 P:0.24074 F:0.29771
37 ROUGE-1 Eval D0711-A.M.100.C-C.37 R:0.35667 P:0.22016 F:0.27226
37 ROUGE-1 Eval D0711-A.M.100.C-F.37 R:0.37086 P:0.23045 F:0.28426
37 ROUGE-1 Eval D0711-B.M.100.C-A.37 R:0.29252 P:0.18495 F:0.22662
37 ROUGE-1 Eval D0711-B.M.100.C-B.37 R:0.27397 P:0.17204 F:0.21136
37 ROUGE-1 Eval D0711-B.M.100.C-C.37 R:0.25168 P:0.16129 F:0.19659
37 ROUGE-1 Eval D0711-B.M.100.C-F.37 R:0.27119 P:0.17204 F:0.21053
37 ROUGE-1 Eval D0711-C.M.100.C-A.37 R:0.35644 P:0.22360 F:0.27481
37 ROUGE-1 Eval D0711-C.M.100.C-B.37 R:0.35495 P:0.21532 F:0.26804
37 ROUGE-1 Eval D0711-C.M.100.C-C.37 R:0.36824 P:0.22567 F:0.27984
37 ROUGE-1 Eval D0711-C.M.100.C-F.37 R:0.33446 P:0.20497 F:0.25417
37 ROUGE-1 Eval D0716-A.M.100.D-C.37 R:0.33115 P:0.25700 F:0.28940
37 ROUGE-1 Eval D0716-A.M.100.D-D.37 R:0.33000 P:0.25191 F:0.28572
37 ROUGE-1 Eval D0716-A.M.100.D-E.37 R:0.33223 P:0.25445 F:0.28818
37 ROUGE-1 Eval D0716-A.M.100.D-F.37 R:0.31683 P:0.24427 F:0.27586
37 ROUGE-1 Eval D0716-B.M.100.D-C.37 R:0.30592 P:0.25000 F:0.27515
37 ROUGE-1 Eval D0716-B.M.100.D-D.37 R:0.33221 P:0.26613 F:0.29552
37 ROUGE-1 Eval D0716-B.M.100.D-E.37 R:0.29900 P:0.24194 F:0.26746
37 ROUGE-1 Eval D0716-B.M.100.D-F.37 R:0.31000 P:0.25000 F:0.27679
37 ROUGE-1 Eval D0716-C.M.100.D-C.37 R:0.38436 P:0.28095 F:0.32462
37 ROUGE-1 Eval D0716-C.M.100.D-D.37 R:0.39799 P:0.28333 F:0.33101
37 ROUGE-1 Eval D0716-C.M.100.D-E.37 R:0.39934 P:0.28810 F:0.33472
37 ROUGE-1 Eval D0716-C.M.100.D-F.37 R:0.37667 P:0.26905 F:0.31389
37 ROUGE-1 Eval D0721-A.M.100.E-B.37 R:0.34333 P:0.22737 F:0.27357
37 ROUGE-1 Eval D0721-A.M.100.E-C.37 R:0.32792 P:0.22296 F:0.26544
37 ROUGE-1 Eval D0721-A.M.100.E-E.37 R:0.31494 P:0.21413 F:0.25493
37 ROUGE-1 Eval D0721-A.M.100.E-G.37 R:0.33121 P:0.22958 F:0.27119
37 ROUGE-1 Eval D0721-B.M.100.E-B.37 R:0.32573 P:0.21368 F:0.25807
37 ROUGE-1 Eval D0721-B.M.100.E-C.37 R:0.31847 P:0.21368 F:0.25576
37 ROUGE-1 Eval D0721-B.M.100.E-E.37 R:0.28525 P:0.18590 F:0.22510
37 ROUGE-1 Eval D0721-B.M.100.E-G.37 R:0.30323 P:0.20085 F:0.24164
37 ROUGE-1 Eval D0721-C.M.100.E-B.37 R:0.31803 P:0.19836 F:0.24433
37 ROUGE-1 Eval D0721-C.M.100.E-C.37 R:0.27063 P:0.16769 F:0.20707
37 ROUGE-1 Eval D0721-C.M.100.E-E.37 R:0.29000 P:0.17791 F:0.22053
37 ROUGE-1 Eval D0721-C.M.100.E-G.37 R:0.26710 P:0.16769 F:0.20603
37 ROUGE-1 Eval D0726-A.M.100.F-A.37 R:0.33555 P:0.22296 F:0.26791
37 ROUGE-1 Eval D0726-A.M.100.F-E.37 R:0.27333 P:0.18102 F:0.21780
37 ROUGE-1 Eval D0726-A.M.100.F-F.37 R:0.33555 P:0.22296 F:0.26791
37 ROUGE-1 Eval D0726-A.M.100.F-G.37 R:0.31229 P:0.20751 F:0.24934
37 ROUGE-1 Eval D0726-B.M.100.F-A.37 R:0.24510 P:0.17483 F:0.20409
37 ROUGE-1 Eval D0726-B.M.100.F-E.37 R:0.21927 P:0.15385 F:0.18082
37 ROUGE-1 Eval D0726-B.M.100.F-F.37 R:0.25249 P:0.17716 F:0.20822
37 ROUGE-1 Eval D0726-B.M.100.F-G.37 R:0.23355 P:0.16550 F:0.19372
37 ROUGE-1 Eval D0726-C.M.100.F-A.37 R:0.30667 P:0.18930 F:0.23410
37 ROUGE-1 Eval D0726-C.M.100.F-E.37 R:0.28956 P:0.17695 F:0.21966
37 ROUGE-1 Eval D0726-C.M.100.F-F.37 R:0.29153 P:0.17695 F:0.22023
37 ROUGE-1 Eval D0726-C.M.100.F-G.37 R:0.28525 P:0.17901 F:0.21997
37 ROUGE-1 Eval D0727-A.M.100.G-A.37 R:0.33887 P:0.22667 F:0.27164
37 ROUGE-1 Eval D0727-A.M.100.G-F.37 R:0.35855 P:0.24222 F:0.28912
37 ROUGE-1 Eval D0727-A.M.100.G-G.37 R:0.33660 P:0.22889 F:0.27249
37 ROUGE-1 Eval D0727-A.M.100.G-H.37 R:0.33882 P:0.22889 F:0.27321
37 ROUGE-1 Eval D0727-B.M.100.G-A.37 R:0.32990 P:0.20000 F:0.24903
37 ROUGE-1 Eval D0727-B.M.100.G-F.37 R:0.34740 P:0.22292 F:0.27158
37 ROUGE-1 Eval D0727-B.M.100.G-G.37 R:0.32526 P:0.19583 F:0.24447
37 ROUGE-1 Eval D0727-B.M.100.G-H.37 R:0.31959 P:0.19375 F:0.24125
37 ROUGE-1 Eval D0727-C.M.100.G-A.37 R:0.28339 P:0.19205 F:0.22895
37 ROUGE-1 Eval D0727-C.M.100.G-F.37 R:0.30640 P:0.20088 F:0.24267
37 ROUGE-1 Eval D0727-C.M.100.G-G.37 R:0.30033 P:0.20088 F:0.24074
37 ROUGE-1 Eval D0727-C.M.100.G-H.37 R:0.29730 P:0.19426 F:0.23498
37 ROUGE-1 Eval D0736-A.M.100.H-G.37 R:0.27599 P:0.15844 F:0.20131
37 ROUGE-1 Eval D0736-A.M.100.H-H.37 R:0.29562 P:0.16667 F:0.21316
37 ROUGE-1 Eval D0736-A.M.100.H-I.37 R:0.27402 P:0.15844 F:0.20078
37 ROUGE-1 Eval D0736-A.M.100.H-J.37 R:0.25163 P:0.15844 F:0.19445
37 ROUGE-1 Eval D0736-B.M.100.H-G.37 R:0.16794 P:0.07928 F:0.10771
37 ROUGE-1 Eval D0736-B.M.100.H-H.37 R:0.16942 P:0.07387 F:0.10288
37 ROUGE-1 Eval D0736-B.M.100.H-I.37 R:0.15900 P:0.06847 F:0.09572
37 ROUGE-1 Eval D0736-B.M.100.H-J.37 R:0.16783 P:0.08649 F:0.11415
37 ROUGE-1 Eval D0736-C.M.100.H-G.37 R:0.21097 P:0.08547 F:0.12165
37 ROUGE-1 Eval D0736-C.M.100.H-H.37 R:0.23529 P:0.07521 F:0.11398
37 ROUGE-1 Eval D0736-C.M.100.H-I.37 R:0.19786 P:0.06325 F:0.09586
37 ROUGE-1 Eval D0736-C.M.100.H-J.37 R:0.20755 P:0.09402 F:0.12942
37 ROUGE-1 Eval D0740-A.M.100.I-D.37 R:0.24092 P:0.16331 F:0.19466
37 ROUGE-1 Eval D0740-A.M.100.I-H.37 R:0.23529 P:0.16107 F:0.19123
37 ROUGE-1 Eval D0740-A.M.100.I-I.37 R:0.20455 P:0.14094 F:0.16689
37 ROUGE-1 Eval D0740-A.M.100.I-J.37 R:0.21935 P:0.15213 F:0.17966
37 ROUGE-1 Eval D0740-B.M.100.I-D.37 R:0.24351 P:0.14620 F:0.18271
37 ROUGE-1 Eval D0740-B.M.100.I-H.37 R:0.25166 P:0.14815 F:0.18651
37 ROUGE-1 Eval D0740-B.M.100.I-I.37 R:0.24262 P:0.14425 F:0.18093
37 ROUGE-1 Eval D0740-B.M.100.I-J.37 R:0.24272 P:0.14620 F:0.18248
37 ROUGE-1 Eval D0740-C.M.100.I-D.37 R:0.31629 P:0.20625 F:0.24968
37 ROUGE-1 Eval D0740-C.M.100.I-H.37 R:0.30868 P:0.20000 F:0.24273
37 ROUGE-1 Eval D0740-C.M.100.I-I.37 R:0.32268 P:0.21042 F:0.25473
37 ROUGE-1 Eval D0740-C.M.100.I-J.37 R:0.30892 P:0.20208 F:0.24433
37 ROUGE-1 Eval D0743-A.M.100.J-B.37 R:0.24127 P:0.16136 F:0.19339
37 ROUGE-1 Eval D0743-A.M.100.J-H.37 R:0.24383 P:0.16773 F:0.19874
37 ROUGE-1 Eval D0743-A.M.100.J-I.37 R:0.24063 P:0.16348 F:0.19469
37 ROUGE-1 Eval D0743-A.M.100.J-J.37 R:0.22769 P:0.15711 F:0.18593
37 ROUGE-1 Eval D0743-B.M.100.J-B.37 R:0.22115 P:0.14110 F:0.17228
37 ROUGE-1 Eval D0743-B.M.100.J-H.37 R:0.22713 P:0.14724 F:0.17866
37 ROUGE-1 Eval D0743-B.M.100.J-I.37 R:0.23418 P:0.15133 F:0.18385
37 ROUGE-1 Eval D0743-B.M.100.J-J.37 R:0.20872 P:0.13701 F:0.16543
37 ROUGE-1 Eval D0743-C.M.100.J-B.37 R:0.25397 P:0.18018 F:0.21080
37 ROUGE-1 Eval D0743-C.M.100.J-H.37 R:0.21656 P:0.15315 F:0.17942
37 ROUGE-1 Eval D0743-C.M.100.J-I.37 R:0.23323 P:0.16441 F:0.19286
37 ROUGE-1 Eval D0743-C.M.100.J-J.37 R:0.21069 P:0.15090 F:0.17585
---------------------------------------------
37 ROUGE-2 Average_R: 0.04243 (95%-conf.int. 0.03805 - 0.04665)
37 ROUGE-2 Average_P: 0.02814 (95%-conf.int. 0.02518 - 0.03123)
37 ROUGE-2 Average_F: 0.03370 (95%-conf.int. 0.03026 - 0.03723)
.............................................
37 ROUGE-2 Eval D0703-A.M.100.A-A.37 R:0.06143 P:0.04615 F:0.05270
37 ROUGE-2 Eval D0703-A.M.100.A-C.37 R:0.06780 P:0.05128 F:0.05839
37 ROUGE-2 Eval D0703-A.M.100.A-D.37 R:0.05208 P:0.03846 F:0.04425
37 ROUGE-2 Eval D0703-A.M.100.A-J.37 R:0.05498 P:0.04103 F:0.04699
37 ROUGE-2 Eval D0703-B.M.100.A-A.37 R:0.03300 P:0.02252 F:0.02677
37 ROUGE-2 Eval D0703-B.M.100.A-C.37 R:0.04068 P:0.02703 F:0.03248
37 ROUGE-2 Eval D0703-B.M.100.A-D.37 R:0.03729 P:0.02477 F:0.02977
37 ROUGE-2 Eval D0703-B.M.100.A-J.37 R:0.04027 P:0.02703 F:0.03235
37 ROUGE-2 Eval D0703-C.M.100.A-A.37 R:0.07071 P:0.04403 F:0.05427
37 ROUGE-2 Eval D0703-C.M.100.A-C.37 R:0.05902 P:0.03774 F:0.04604
37 ROUGE-2 Eval D0703-C.M.100.A-D.37 R:0.06020 P:0.03774 F:0.04639
37 ROUGE-2 Eval D0703-C.M.100.A-J.37 R:0.07023 P:0.04403 F:0.05413
37 ROUGE-2 Eval D0706-A.M.100.B-B.37 R:0.04262 P:0.02760 F:0.03350
37 ROUGE-2 Eval D0706-A.M.100.B-D.37 R:0.03300 P:0.02123 F:0.02584
37 ROUGE-2 Eval D0706-A.M.100.B-E.37 R:0.02295 P:0.01486 F:0.01804
37 ROUGE-2 Eval D0706-A.M.100.B-I.37 R:0.03934 P:0.02548 F:0.03093
37 ROUGE-2 Eval D0706-B.M.100.B-B.37 R:0.01320 P:0.00745 F:0.00952
37 ROUGE-2 Eval D0706-B.M.100.B-D.37 R:0.00329 P:0.00186 F:0.00238
37 ROUGE-2 Eval D0706-B.M.100.B-E.37 R:0.01311 P:0.00745 F:0.00950
37 ROUGE-2 Eval D0706-B.M.100.B-I.37 R:0.00980 P:0.00559 F:0.00712
37 ROUGE-2 Eval D0706-C.M.100.B-B.37 R:0.06189 P:0.04251 F:0.05040
37 ROUGE-2 Eval D0706-C.M.100.B-D.37 R:0.03257 P:0.02237 F:0.02652
37 ROUGE-2 Eval D0706-C.M.100.B-E.37 R:0.06149 P:0.04251 F:0.05027
37 ROUGE-2 Eval D0706-C.M.100.B-I.37 R:0.04839 P:0.03356 F:0.03963
37 ROUGE-2 Eval D0711-A.M.100.C-A.37 R:0.08638 P:0.05383 F:0.06633
37 ROUGE-2 Eval D0711-A.M.100.C-B.37 R:0.09764 P:0.06004 F:0.07436
37 ROUGE-2 Eval D0711-A.M.100.C-C.37 R:0.04377 P:0.02692 F:0.03334
37 ROUGE-2 Eval D0711-A.M.100.C-F.37 R:0.08361 P:0.05176 F:0.06394
37 ROUGE-2 Eval D0711-B.M.100.C-A.37 R:0.03780 P:0.02381 F:0.02922
37 ROUGE-2 Eval D0711-B.M.100.C-B.37 R:0.04498 P:0.02814 F:0.03462
37 ROUGE-2 Eval D0711-B.M.100.C-C.37 R:0.03729 P:0.02381 F:0.02906
37 ROUGE-2 Eval D0711-B.M.100.C-F.37 R:0.03425 P:0.02165 F:0.02653
37 ROUGE-2 Eval D0711-C.M.100.C-A.37 R:0.04333 P:0.02708 F:0.03333
37 ROUGE-2 Eval D0711-C.M.100.C-B.37 R:0.04828 P:0.02917 F:0.03637
37 ROUGE-2 Eval D0711-C.M.100.C-C.37 R:0.04437 P:0.02708 F:0.03363
37 ROUGE-2 Eval D0711-C.M.100.C-F.37 R:0.02730 P:0.01667 F:0.02070
37 ROUGE-2 Eval D0716-A.M.100.D-C.37 R:0.10265 P:0.07949 F:0.08960
37 ROUGE-2 Eval D0716-A.M.100.D-D.37 R:0.11448 P:0.08718 F:0.09898
37 ROUGE-2 Eval D0716-A.M.100.D-E.37 R:0.09732 P:0.07436 F:0.08430
37 ROUGE-2 Eval D0716-A.M.100.D-F.37 R:0.09667 P:0.07436 F:0.08406
37 ROUGE-2 Eval D0716-B.M.100.D-C.37 R:0.05648 P:0.04607 F:0.05075
37 ROUGE-2 Eval D0716-B.M.100.D-D.37 R:0.06102 P:0.04878 F:0.05422
37 ROUGE-2 Eval D0716-B.M.100.D-E.37 R:0.05034 P:0.04065 F:0.04498
37 ROUGE-2 Eval D0716-B.M.100.D-F.37 R:0.07407 P:0.05962 F:0.06606
37 ROUGE-2 Eval D0716-C.M.100.D-C.37 R:0.08553 P:0.06235 F:0.07212
37 ROUGE-2 Eval D0716-C.M.100.D-D.37 R:0.07095 P:0.05036 F:0.05891
37 ROUGE-2 Eval D0716-C.M.100.D-E.37 R:0.10000 P:0.07194 F:0.08368
37 ROUGE-2 Eval D0716-C.M.100.D-F.37 R:0.07407 P:0.05276 F:0.06162
37 ROUGE-2 Eval D0721-A.M.100.E-B.37 R:0.05724 P:0.03778 F:0.04552
37 ROUGE-2 Eval D0721-A.M.100.E-C.37 R:0.06885 P:0.04667 F:0.05563
37 ROUGE-2 Eval D0721-A.M.100.E-E.37 R:0.06885 P:0.04667 F:0.05563
37 ROUGE-2 Eval D0721-A.M.100.E-G.37 R:0.07074 P:0.04889 F:0.05782
37 ROUGE-2 Eval D0721-B.M.100.E-B.37 R:0.05263 P:0.03441 F:0.04161
37 ROUGE-2 Eval D0721-B.M.100.E-C.37 R:0.05788 P:0.03871 F:0.04639
37 ROUGE-2 Eval D0721-B.M.100.E-E.37 R:0.03974 P:0.02581 F:0.03129
37 ROUGE-2 Eval D0721-B.M.100.E-G.37 R:0.04560 P:0.03011 F:0.03627
37 ROUGE-2 Eval D0721-C.M.100.E-B.37 R:0.05298 P:0.03292 F:0.04061
37 ROUGE-2 Eval D0721-C.M.100.E-C.37 R:0.03333 P:0.02058 F:0.02545
37 ROUGE-2 Eval D0721-C.M.100.E-E.37 R:0.04714 P:0.02881 F:0.03576
37 ROUGE-2 Eval D0721-C.M.100.E-G.37 R:0.03618 P:0.02263 F:0.02784
37 ROUGE-2 Eval D0726-A.M.100.F-A.37 R:0.05369 P:0.03556 F:0.04278
37 ROUGE-2 Eval D0726-A.M.100.F-E.37 R:0.02694 P:0.01778 F:0.02142
37 ROUGE-2 Eval D0726-A.M.100.F-F.37 R:0.05034 P:0.03333 F:0.04011
37 ROUGE-2 Eval D0726-A.M.100.F-G.37 R:0.04027 P:0.02667 F:0.03209
37 ROUGE-2 Eval D0726-B.M.100.F-A.37 R:0.04290 P:0.03052 F:0.03567
37 ROUGE-2 Eval D0726-B.M.100.F-E.37 R:0.01678 P:0.01174 F:0.01381
37 ROUGE-2 Eval D0726-B.M.100.F-F.37 R:0.04027 P:0.02817 F:0.03315
37 ROUGE-2 Eval D0726-B.M.100.F-G.37 R:0.02990 P:0.02113 F:0.02476
37 ROUGE-2 Eval D0726-C.M.100.F-A.37 R:0.03030 P:0.01863 F:0.02307
37 ROUGE-2 Eval D0726-C.M.100.F-E.37 R:0.03061 P:0.01863 F:0.02316
37 ROUGE-2 Eval D0726-C.M.100.F-F.37 R:0.02397 P:0.01449 F:0.01806
37 ROUGE-2 Eval D0726-C.M.100.F-G.37 R:0.02649 P:0.01656 F:0.02038
37 ROUGE-2 Eval D0727-A.M.100.G-A.37 R:0.04362 P:0.02908 F:0.03490
37 ROUGE-2 Eval D0727-A.M.100.G-F.37 R:0.05316 P:0.03579 F:0.04278
37 ROUGE-2 Eval D0727-A.M.100.G-G.37 R:0.05281 P:0.03579 F:0.04267
37 ROUGE-2 Eval D0727-A.M.100.G-H.37 R:0.04983 P:0.03356 F:0.04011
37 ROUGE-2 Eval D0727-B.M.100.G-A.37 R:0.01736 P:0.01048 F:0.01307
37 ROUGE-2 Eval D0727-B.M.100.G-F.37 R:0.02623 P:0.01677 F:0.02046
37 ROUGE-2 Eval D0727-B.M.100.G-G.37 R:0.02098 P:0.01258 F:0.01573
37 ROUGE-2 Eval D0727-B.M.100.G-H.37 R:0.01736 P:0.01048 F:0.01307
37 ROUGE-2 Eval D0727-C.M.100.G-A.37 R:0.01645 P:0.01111 F:0.01326
37 ROUGE-2 Eval D0727-C.M.100.G-F.37 R:0.01701 P:0.01111 F:0.01344
37 ROUGE-2 Eval D0727-C.M.100.G-G.37 R:0.02000 P:0.01333 F:0.01600
37 ROUGE-2 Eval D0727-C.M.100.G-H.37 R:0.01706 P:0.01111 F:0.01346
37 ROUGE-2 Eval D0736-A.M.100.H-G.37 R:0.03623 P:0.02070 F:0.02635
37 ROUGE-2 Eval D0736-A.M.100.H-H.37 R:0.04428 P:0.02484 F:0.03183
37 ROUGE-2 Eval D0736-A.M.100.H-I.37 R:0.04676 P:0.02692 F:0.03417
37 ROUGE-2 Eval D0736-A.M.100.H-J.37 R:0.02310 P:0.01449 F:0.01781
37 ROUGE-2 Eval D0736-B.M.100.H-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-2 Eval D0736-B.M.100.H-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-2 Eval D0736-B.M.100.H-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-2 Eval D0736-B.M.100.H-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-2 Eval D0736-C.M.100.H-G.37 R:0.05556 P:0.02234 F:0.03187
37 ROUGE-2 Eval D0736-C.M.100.H-H.37 R:0.07065 P:0.02234 F:0.03395
37 ROUGE-2 Eval D0736-C.M.100.H-I.37 R:0.01630 P:0.00515 F:0.00783
37 ROUGE-2 Eval D0736-C.M.100.H-J.37 R:0.04962 P:0.02234 F:0.03081
37 ROUGE-2 Eval D0740-A.M.100.I-D.37 R:0.04333 P:0.02928 F:0.03495
37 ROUGE-2 Eval D0740-A.M.100.I-H.37 R:0.04620 P:0.03153 F:0.03748
37 ROUGE-2 Eval D0740-A.M.100.I-I.37 R:0.01311 P:0.00901 F:0.01068
37 ROUGE-2 Eval D0740-A.M.100.I-J.37 R:0.03583 P:0.02477 F:0.02929
37 ROUGE-2 Eval D0740-B.M.100.I-D.37 R:0.02623 P:0.01569 F:0.01963
37 ROUGE-2 Eval D0740-B.M.100.I-H.37 R:0.03344 P:0.01961 F:0.02472
37 ROUGE-2 Eval D0740-B.M.100.I-I.37 R:0.03311 P:0.01961 F:0.02463
37 ROUGE-2 Eval D0740-B.M.100.I-J.37 R:0.02614 P:0.01569 F:0.01961
37 ROUGE-2 Eval D0740-C.M.100.I-D.37 R:0.07742 P:0.05031 F:0.06099
37 ROUGE-2 Eval D0740-C.M.100.I-H.37 R:0.07468 P:0.04822 F:0.05860
37 ROUGE-2 Eval D0740-C.M.100.I-I.37 R:0.07742 P:0.05031 F:0.06099
37 ROUGE-2 Eval D0740-C.M.100.I-J.37 R:0.08039 P:0.05241 F:0.06345
37 ROUGE-2 Eval D0743-A.M.100.J-B.37 R:0.01923 P:0.01282 F:0.01538
37 ROUGE-2 Eval D0743-A.M.100.J-H.37 R:0.01558 P:0.01068 F:0.01267
37 ROUGE-2 Eval D0743-A.M.100.J-I.37 R:0.01893 P:0.01282 F:0.01529
37 ROUGE-2 Eval D0743-A.M.100.J-J.37 R:0.00311 P:0.00214 F:0.00254
37 ROUGE-2 Eval D0743-B.M.100.J-B.37 R:0.00647 P:0.00412 F:0.00503
37 ROUGE-2 Eval D0743-B.M.100.J-H.37 R:0.00637 P:0.00412 F:0.00500
37 ROUGE-2 Eval D0743-B.M.100.J-I.37 R:0.00639 P:0.00412 F:0.00501
37 ROUGE-2 Eval D0743-B.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-2 Eval D0743-C.M.100.J-B.37 R:0.01923 P:0.01361 F:0.01594
37 ROUGE-2 Eval D0743-C.M.100.J-H.37 R:0.01286 P:0.00907 F:0.01064
37 ROUGE-2 Eval D0743-C.M.100.J-I.37 R:0.01613 P:0.01134 F:0.01332
37 ROUGE-2 Eval D0743-C.M.100.J-J.37 R:0.00952 P:0.00680 F:0.00793
---------------------------------------------
37 ROUGE-3 Average_R: 0.01253 (95%-conf.int. 0.01007 - 0.01489)
37 ROUGE-3 Average_P: 0.00834 (95%-conf.int. 0.00672 - 0.01003)
37 ROUGE-3 Average_F: 0.00995 (95%-conf.int. 0.00803 - 0.01193)
.............................................
37 ROUGE-3 Eval D0703-A.M.100.A-A.37 R:0.02414 P:0.01809 F:0.02068
37 ROUGE-3 Eval D0703-A.M.100.A-C.37 R:0.02740 P:0.02067 F:0.02356
37 ROUGE-3 Eval D0703-A.M.100.A-D.37 R:0.02105 P:0.01550 F:0.01785
37 ROUGE-3 Eval D0703-A.M.100.A-J.37 R:0.01042 P:0.00775 F:0.00889
37 ROUGE-3 Eval D0703-B.M.100.A-A.37 R:0.00333 P:0.00227 F:0.00270
37 ROUGE-3 Eval D0703-B.M.100.A-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0703-B.M.100.A-D.37 R:0.00342 P:0.00227 F:0.00273
37 ROUGE-3 Eval D0703-B.M.100.A-J.37 R:0.00339 P:0.00227 F:0.00272
37 ROUGE-3 Eval D0703-C.M.100.A-A.37 R:0.01701 P:0.01055 F:0.01302
37 ROUGE-3 Eval D0703-C.M.100.A-C.37 R:0.01987 P:0.01266 F:0.01547
37 ROUGE-3 Eval D0703-C.M.100.A-D.37 R:0.02027 P:0.01266 F:0.01559
37 ROUGE-3 Eval D0703-C.M.100.A-J.37 R:0.02365 P:0.01477 F:0.01818
37 ROUGE-3 Eval D0706-A.M.100.B-B.37 R:0.01325 P:0.00855 F:0.01039
37 ROUGE-3 Eval D0706-A.M.100.B-D.37 R:0.01000 P:0.00641 F:0.00781
37 ROUGE-3 Eval D0706-A.M.100.B-E.37 R:0.00331 P:0.00214 F:0.00260
37 ROUGE-3 Eval D0706-A.M.100.B-I.37 R:0.01325 P:0.00855 F:0.01039
37 ROUGE-3 Eval D0706-B.M.100.B-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0706-B.M.100.B-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0706-B.M.100.B-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0706-B.M.100.B-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0706-C.M.100.B-B.37 R:0.02303 P:0.01577 F:0.01872
37 ROUGE-3 Eval D0706-C.M.100.B-D.37 R:0.00329 P:0.00225 F:0.00267
37 ROUGE-3 Eval D0706-C.M.100.B-E.37 R:0.02288 P:0.01577 F:0.01867
37 ROUGE-3 Eval D0706-C.M.100.B-I.37 R:0.01954 P:0.01351 F:0.01597
37 ROUGE-3 Eval D0711-A.M.100.C-A.37 R:0.04027 P:0.02500 F:0.03085
37 ROUGE-3 Eval D0711-A.M.100.C-B.37 R:0.04082 P:0.02500 F:0.03101
37 ROUGE-3 Eval D0711-A.M.100.C-C.37 R:0.00340 P:0.00208 F:0.00258
37 ROUGE-3 Eval D0711-A.M.100.C-F.37 R:0.03716 P:0.02292 F:0.02835
37 ROUGE-3 Eval D0711-B.M.100.C-A.37 R:0.00694 P:0.00436 F:0.00536
37 ROUGE-3 Eval D0711-B.M.100.C-B.37 R:0.01049 P:0.00654 F:0.00806
37 ROUGE-3 Eval D0711-B.M.100.C-C.37 R:0.00685 P:0.00436 F:0.00533
37 ROUGE-3 Eval D0711-B.M.100.C-F.37 R:0.00692 P:0.00436 F:0.00535
37 ROUGE-3 Eval D0711-C.M.100.C-A.37 R:0.00673 P:0.00419 F:0.00516
37 ROUGE-3 Eval D0711-C.M.100.C-B.37 R:0.00697 P:0.00419 F:0.00523
37 ROUGE-3 Eval D0711-C.M.100.C-C.37 R:0.00690 P:0.00419 F:0.00521
37 ROUGE-3 Eval D0711-C.M.100.C-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0716-A.M.100.D-C.37 R:0.04682 P:0.03618 F:0.04082
37 ROUGE-3 Eval D0716-A.M.100.D-D.37 R:0.05782 P:0.04393 F:0.04993
37 ROUGE-3 Eval D0716-A.M.100.D-E.37 R:0.04746 P:0.03618 F:0.04106
37 ROUGE-3 Eval D0716-A.M.100.D-F.37 R:0.05051 P:0.03876 F:0.04386
37 ROUGE-3 Eval D0716-B.M.100.D-C.37 R:0.02685 P:0.02186 F:0.02410
37 ROUGE-3 Eval D0716-B.M.100.D-D.37 R:0.02740 P:0.02186 F:0.02432
37 ROUGE-3 Eval D0716-B.M.100.D-E.37 R:0.01356 P:0.01093 F:0.01210
37 ROUGE-3 Eval D0716-B.M.100.D-F.37 R:0.03401 P:0.02732 F:0.03030
37 ROUGE-3 Eval D0716-C.M.100.D-C.37 R:0.02990 P:0.02174 F:0.02518
37 ROUGE-3 Eval D0716-C.M.100.D-D.37 R:0.02389 P:0.01691 F:0.01980
37 ROUGE-3 Eval D0716-C.M.100.D-E.37 R:0.03704 P:0.02657 F:0.03094
37 ROUGE-3 Eval D0716-C.M.100.D-F.37 R:0.03061 P:0.02174 F:0.02542
37 ROUGE-3 Eval D0721-A.M.100.E-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0721-A.M.100.E-C.37 R:0.01325 P:0.00895 F:0.01068
37 ROUGE-3 Eval D0721-A.M.100.E-E.37 R:0.01325 P:0.00895 F:0.01068
37 ROUGE-3 Eval D0721-A.M.100.E-G.37 R:0.01299 P:0.00895 F:0.01060
37 ROUGE-3 Eval D0721-B.M.100.E-B.37 R:0.00332 P:0.00216 F:0.00262
37 ROUGE-3 Eval D0721-B.M.100.E-C.37 R:0.00325 P:0.00216 F:0.00260
37 ROUGE-3 Eval D0721-B.M.100.E-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0721-B.M.100.E-G.37 R:0.00329 P:0.00216 F:0.00261
37 ROUGE-3 Eval D0721-C.M.100.E-B.37 R:0.01672 P:0.01035 F:0.01279
37 ROUGE-3 Eval D0721-C.M.100.E-C.37 R:0.00673 P:0.00414 F:0.00513
37 ROUGE-3 Eval D0721-C.M.100.E-E.37 R:0.01701 P:0.01035 F:0.01287
37 ROUGE-3 Eval D0721-C.M.100.E-G.37 R:0.00997 P:0.00621 F:0.00765
37 ROUGE-3 Eval D0726-A.M.100.F-A.37 R:0.00678 P:0.00447 F:0.00539
37 ROUGE-3 Eval D0726-A.M.100.F-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0726-A.M.100.F-F.37 R:0.00678 P:0.00447 F:0.00539
37 ROUGE-3 Eval D0726-A.M.100.F-G.37 R:0.00678 P:0.00447 F:0.00539
37 ROUGE-3 Eval D0726-B.M.100.F-A.37 R:0.02333 P:0.01655 F:0.01936
37 ROUGE-3 Eval D0726-B.M.100.F-E.37 R:0.00678 P:0.00473 F:0.00557
37 ROUGE-3 Eval D0726-B.M.100.F-F.37 R:0.02373 P:0.01655 F:0.01950
37 ROUGE-3 Eval D0726-B.M.100.F-G.37 R:0.01678 P:0.01182 F:0.01387
37 ROUGE-3 Eval D0726-C.M.100.F-A.37 R:0.01020 P:0.00625 F:0.00775
37 ROUGE-3 Eval D0726-C.M.100.F-E.37 R:0.01031 P:0.00625 F:0.00778
37 ROUGE-3 Eval D0726-C.M.100.F-F.37 R:0.00692 P:0.00417 F:0.00520
37 ROUGE-3 Eval D0726-C.M.100.F-G.37 R:0.01338 P:0.00833 F:0.01027
37 ROUGE-3 Eval D0727-A.M.100.G-A.37 R:0.00339 P:0.00225 F:0.00270
37 ROUGE-3 Eval D0727-A.M.100.G-F.37 R:0.00671 P:0.00450 F:0.00539
37 ROUGE-3 Eval D0727-A.M.100.G-G.37 R:0.00667 P:0.00450 F:0.00537
37 ROUGE-3 Eval D0727-A.M.100.G-H.37 R:0.00336 P:0.00225 F:0.00270
37 ROUGE-3 Eval D0727-B.M.100.G-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-B.M.100.G-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-B.M.100.G-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-B.M.100.G-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-C.M.100.G-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-C.M.100.G-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-C.M.100.G-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0727-C.M.100.G-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-A.M.100.H-G.37 R:0.01465 P:0.00833 F:0.01062
37 ROUGE-3 Eval D0736-A.M.100.H-H.37 R:0.02239 P:0.01250 F:0.01604
37 ROUGE-3 Eval D0736-A.M.100.H-I.37 R:0.02182 P:0.01250 F:0.01589
37 ROUGE-3 Eval D0736-A.M.100.H-J.37 R:0.00667 P:0.00417 F:0.00513
37 ROUGE-3 Eval D0736-B.M.100.H-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-B.M.100.H-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-B.M.100.H-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-B.M.100.H-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-C.M.100.H-G.37 R:0.03030 P:0.01209 F:0.01728
37 ROUGE-3 Eval D0736-C.M.100.H-H.37 R:0.03867 P:0.01209 F:0.01842
37 ROUGE-3 Eval D0736-C.M.100.H-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0736-C.M.100.H-J.37 R:0.02703 P:0.01209 F:0.01671
37 ROUGE-3 Eval D0740-A.M.100.I-D.37 R:0.01684 P:0.01134 F:0.01355
37 ROUGE-3 Eval D0740-A.M.100.I-H.37 R:0.01667 P:0.01134 F:0.01350
37 ROUGE-3 Eval D0740-A.M.100.I-I.37 R:0.00662 P:0.00454 F:0.00539
37 ROUGE-3 Eval D0740-A.M.100.I-J.37 R:0.00987 P:0.00680 F:0.00805
37 ROUGE-3 Eval D0740-B.M.100.I-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0740-B.M.100.I-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0740-B.M.100.I-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0740-B.M.100.I-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0740-C.M.100.I-D.37 R:0.04235 P:0.02743 F:0.03329
37 ROUGE-3 Eval D0740-C.M.100.I-H.37 R:0.03607 P:0.02321 F:0.02825
37 ROUGE-3 Eval D0740-C.M.100.I-I.37 R:0.03909 P:0.02532 F:0.03073
37 ROUGE-3 Eval D0740-C.M.100.I-J.37 R:0.03896 P:0.02532 F:0.03069
37 ROUGE-3 Eval D0743-A.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-A.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-A.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-A.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-B.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-B.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-B.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-B.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-C.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-C.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-C.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-3 Eval D0743-C.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
37 ROUGE-4 Average_R: 0.00555 (95%-conf.int. 0.00419 - 0.00695)
37 ROUGE-4 Average_P: 0.00356 (95%-conf.int. 0.00272 - 0.00441)
37 ROUGE-4 Average_F: 0.00430 (95%-conf.int. 0.00326 - 0.00537)
.............................................
37 ROUGE-4 Eval D0703-A.M.100.A-A.37 R:0.01394 P:0.01042 F:0.01193
37 ROUGE-4 Eval D0703-A.M.100.A-C.37 R:0.01384 P:0.01042 F:0.01189
37 ROUGE-4 Eval D0703-A.M.100.A-D.37 R:0.01418 P:0.01042 F:0.01201
37 ROUGE-4 Eval D0703-A.M.100.A-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0703-B.M.100.A-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0703-B.M.100.A-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0703-B.M.100.A-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0703-B.M.100.A-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0703-C.M.100.A-A.37 R:0.00687 P:0.00425 F:0.00525
37 ROUGE-4 Eval D0703-C.M.100.A-C.37 R:0.00669 P:0.00425 F:0.00520
37 ROUGE-4 Eval D0703-C.M.100.A-D.37 R:0.00683 P:0.00425 F:0.00524
37 ROUGE-4 Eval D0703-C.M.100.A-J.37 R:0.01024 P:0.00637 F:0.00785
37 ROUGE-4 Eval D0706-A.M.100.B-B.37 R:0.00669 P:0.00430 F:0.00524
37 ROUGE-4 Eval D0706-A.M.100.B-D.37 R:0.00673 P:0.00430 F:0.00525
37 ROUGE-4 Eval D0706-A.M.100.B-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-A.M.100.B-I.37 R:0.00669 P:0.00430 F:0.00524
37 ROUGE-4 Eval D0706-B.M.100.B-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-B.M.100.B-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-B.M.100.B-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-B.M.100.B-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-C.M.100.B-B.37 R:0.01661 P:0.01134 F:0.01348
37 ROUGE-4 Eval D0706-C.M.100.B-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0706-C.M.100.B-E.37 R:0.01650 P:0.01134 F:0.01344
37 ROUGE-4 Eval D0706-C.M.100.B-I.37 R:0.01645 P:0.01134 F:0.01343
37 ROUGE-4 Eval D0711-A.M.100.C-A.37 R:0.02373 P:0.01468 F:0.01814
37 ROUGE-4 Eval D0711-A.M.100.C-B.37 R:0.02405 P:0.01468 F:0.01823
37 ROUGE-4 Eval D0711-A.M.100.C-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-A.M.100.C-F.37 R:0.02389 P:0.01468 F:0.01819
37 ROUGE-4 Eval D0711-B.M.100.C-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-B.M.100.C-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-B.M.100.C-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-B.M.100.C-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-C.M.100.C-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-C.M.100.C-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-C.M.100.C-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0711-C.M.100.C-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0716-A.M.100.D-C.37 R:0.02027 P:0.01563 F:0.01765
37 ROUGE-4 Eval D0716-A.M.100.D-D.37 R:0.03093 P:0.02344 F:0.02667
37 ROUGE-4 Eval D0716-A.M.100.D-E.37 R:0.02055 P:0.01563 F:0.01776
37 ROUGE-4 Eval D0716-A.M.100.D-F.37 R:0.02041 P:0.01563 F:0.01770
37 ROUGE-4 Eval D0716-B.M.100.D-C.37 R:0.01017 P:0.00826 F:0.00912
37 ROUGE-4 Eval D0716-B.M.100.D-D.37 R:0.01038 P:0.00826 F:0.00920
37 ROUGE-4 Eval D0716-B.M.100.D-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0716-B.M.100.D-F.37 R:0.01031 P:0.00826 F:0.00917
37 ROUGE-4 Eval D0716-C.M.100.D-C.37 R:0.00336 P:0.00243 F:0.00282
37 ROUGE-4 Eval D0716-C.M.100.D-D.37 R:0.00345 P:0.00243 F:0.00285
37 ROUGE-4 Eval D0716-C.M.100.D-E.37 R:0.00680 P:0.00487 F:0.00568
37 ROUGE-4 Eval D0716-C.M.100.D-F.37 R:0.00687 P:0.00487 F:0.00570
37 ROUGE-4 Eval D0721-A.M.100.E-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0721-A.M.100.E-C.37 R:0.01003 P:0.00676 F:0.00808
37 ROUGE-4 Eval D0721-A.M.100.E-E.37 R:0.01003 P:0.00676 F:0.00808
37 ROUGE-4 Eval D0721-A.M.100.E-G.37 R:0.00984 P:0.00676 F:0.00801
37 ROUGE-4 Eval D0721-B.M.100.E-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0721-B.M.100.E-C.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0721-B.M.100.E-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0721-B.M.100.E-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0721-C.M.100.E-B.37 R:0.01014 P:0.00625 F:0.00773
37 ROUGE-4 Eval D0721-C.M.100.E-C.37 R:0.00340 P:0.00208 F:0.00258
37 ROUGE-4 Eval D0721-C.M.100.E-E.37 R:0.01031 P:0.00625 F:0.00778
37 ROUGE-4 Eval D0721-C.M.100.E-G.37 R:0.00671 P:0.00417 F:0.00514
37 ROUGE-4 Eval D0726-A.M.100.F-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0726-A.M.100.F-E.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0726-A.M.100.F-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0726-A.M.100.F-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0726-B.M.100.F-A.37 R:0.01347 P:0.00952 F:0.01116
37 ROUGE-4 Eval D0726-B.M.100.F-E.37 R:0.00342 P:0.00238 F:0.00281
37 ROUGE-4 Eval D0726-B.M.100.F-F.37 R:0.01370 P:0.00952 F:0.01123
37 ROUGE-4 Eval D0726-B.M.100.F-G.37 R:0.01017 P:0.00714 F:0.00839
37 ROUGE-4 Eval D0726-C.M.100.F-A.37 R:0.00344 P:0.00210 F:0.00261
37 ROUGE-4 Eval D0726-C.M.100.F-E.37 R:0.00347 P:0.00210 F:0.00262
37 ROUGE-4 Eval D0726-C.M.100.F-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0726-C.M.100.F-G.37 R:0.00338 P:0.00210 F:0.00259
37 ROUGE-4 Eval D0727-A.M.100.G-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-A.M.100.G-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-A.M.100.G-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-A.M.100.G-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-B.M.100.G-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-B.M.100.G-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-B.M.100.G-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-B.M.100.G-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-C.M.100.G-A.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-C.M.100.G-F.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-C.M.100.G-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0727-C.M.100.G-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-A.M.100.H-G.37 R:0.00741 P:0.00419 F:0.00535
37 ROUGE-4 Eval D0736-A.M.100.H-H.37 R:0.01132 P:0.00629 F:0.00809
37 ROUGE-4 Eval D0736-A.M.100.H-I.37 R:0.01103 P:0.00629 F:0.00801
37 ROUGE-4 Eval D0736-A.M.100.H-J.37 R:0.00337 P:0.00210 F:0.00259
37 ROUGE-4 Eval D0736-B.M.100.H-G.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-B.M.100.H-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-B.M.100.H-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-B.M.100.H-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-C.M.100.H-G.37 R:0.02632 P:0.01042 F:0.01493
37 ROUGE-4 Eval D0736-C.M.100.H-H.37 R:0.03371 P:0.01042 F:0.01592
37 ROUGE-4 Eval D0736-C.M.100.H-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0736-C.M.100.H-J.37 R:0.02344 P:0.01042 F:0.01443
37 ROUGE-4 Eval D0740-A.M.100.I-D.37 R:0.00680 P:0.00457 F:0.00547
37 ROUGE-4 Eval D0740-A.M.100.I-H.37 R:0.00673 P:0.00457 F:0.00544
37 ROUGE-4 Eval D0740-A.M.100.I-I.37 R:0.00334 P:0.00228 F:0.00271
37 ROUGE-4 Eval D0740-A.M.100.I-J.37 R:0.00332 P:0.00228 F:0.00270
37 ROUGE-4 Eval D0740-B.M.100.I-D.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0740-B.M.100.I-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0740-B.M.100.I-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0740-B.M.100.I-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0740-C.M.100.I-D.37 R:0.01645 P:0.01062 F:0.01291
37 ROUGE-4 Eval D0740-C.M.100.I-H.37 R:0.00993 P:0.00637 F:0.00776
37 ROUGE-4 Eval D0740-C.M.100.I-I.37 R:0.01645 P:0.01062 F:0.01291
37 ROUGE-4 Eval D0740-C.M.100.I-J.37 R:0.01639 P:0.01062 F:0.01289
37 ROUGE-4 Eval D0743-A.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-A.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-A.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-A.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-B.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-B.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-B.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-B.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-C.M.100.J-B.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-C.M.100.J-H.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-C.M.100.J-I.37 R:0.00000 P:0.00000 F:0.00000
37 ROUGE-4 Eval D0743-C.M.100.J-J.37 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
37 ROUGE-L Average_R: 0.24962 (95%-conf.int. 0.24093 - 0.25851)
37 ROUGE-L Average_P: 0.16309 (95%-conf.int. 0.15572 - 0.17055)
37 ROUGE-L Average_F: 0.19659 (95%-conf.int. 0.18865 - 0.20474)
.............................................
37 ROUGE-L Eval D0703-A.M.100.A-A.37 R:0.23986 P:0.18066 F:0.20609
37 ROUGE-L Eval D0703-A.M.100.A-C.37 R:0.22148 P:0.16794 F:0.19103
37 ROUGE-L Eval D0703-A.M.100.A-D.37 R:0.22680 P:0.16794 F:0.19298
37 ROUGE-L Eval D0703-A.M.100.A-J.37 R:0.21769 P:0.16285 F:0.18632
37 ROUGE-L Eval D0703-B.M.100.A-A.37 R:0.23856 P:0.16331 F:0.19389
37 ROUGE-L Eval D0703-B.M.100.A-C.37 R:0.27181 P:0.18121 F:0.21745
37 ROUGE-L Eval D0703-B.M.100.A-D.37 R:0.24497 P:0.16331 F:0.19597
37 ROUGE-L Eval D0703-B.M.100.A-J.37 R:0.23256 P:0.15660 F:0.18717
37 ROUGE-L Eval D0703-C.M.100.A-A.37 R:0.30667 P:0.19167 F:0.23590
37 ROUGE-L Eval D0703-C.M.100.A-C.37 R:0.29221 P:0.18750 F:0.22843
37 ROUGE-L Eval D0703-C.M.100.A-D.37 R:0.29139 P:0.18333 F:0.22506
37 ROUGE-L Eval D0703-C.M.100.A-J.37 R:0.33775 P:0.21250 F:0.26087
37 ROUGE-L Eval D0706-A.M.100.B-B.37 R:0.22727 P:0.14768 F:0.17903
37 ROUGE-L Eval D0706-A.M.100.B-D.37 R:0.19608 P:0.12658 F:0.15384
37 ROUGE-L Eval D0706-A.M.100.B-E.37 R:0.18182 P:0.11814 F:0.14322
37 ROUGE-L Eval D0706-A.M.100.B-I.37 R:0.22403 P:0.14557 F:0.17647
37 ROUGE-L Eval D0706-B.M.100.B-B.37 R:0.14379 P:0.08148 F:0.10402
37 ROUGE-L Eval D0706-B.M.100.B-D.37 R:0.13029 P:0.07407 F:0.09445
37 ROUGE-L Eval D0706-B.M.100.B-E.37 R:0.14610 P:0.08333 F:0.10613
37 ROUGE-L Eval D0706-B.M.100.B-I.37 R:0.12621 P:0.07222 F:0.09187
37 ROUGE-L Eval D0706-C.M.100.B-B.37 R:0.29355 P:0.20222 F:0.23947
37 ROUGE-L Eval D0706-C.M.100.B-D.37 R:0.27097 P:0.18667 F:0.22106
37 ROUGE-L Eval D0706-C.M.100.B-E.37 R:0.28846 P:0.20000 F:0.23622
37 ROUGE-L Eval D0706-C.M.100.B-I.37 R:0.28435 P:0.19778 F:0.23329
37 ROUGE-L Eval D0711-A.M.100.C-A.37 R:0.33553 P:0.20988 F:0.25823
37 ROUGE-L Eval D0711-A.M.100.C-B.37 R:0.34000 P:0.20988 F:0.25954
37 ROUGE-L Eval D0711-A.M.100.C-C.37 R:0.29667 P:0.18313 F:0.22647
37 ROUGE-L Eval D0711-A.M.100.C-F.37 R:0.32119 P:0.19959 F:0.24619
37 ROUGE-L Eval D0711-B.M.100.C-A.37 R:0.25510 P:0.16129 F:0.19763
37 ROUGE-L Eval D0711-B.M.100.C-B.37 R:0.22945 P:0.14409 F:0.17702
37 ROUGE-L Eval D0711-B.M.100.C-C.37 R:0.22483 P:0.14409 F:0.17562
37 ROUGE-L Eval D0711-B.M.100.C-F.37 R:0.22712 P:0.14409 F:0.17632
37 ROUGE-L Eval D0711-C.M.100.C-A.37 R:0.30363 P:0.19048 F:0.23410
37 ROUGE-L Eval D0711-C.M.100.C-B.37 R:0.31741 P:0.19255 F:0.23969
37 ROUGE-L Eval D0711-C.M.100.C-C.37 R:0.31419 P:0.19255 F:0.23877
37 ROUGE-L Eval D0711-C.M.100.C-F.37 R:0.28716 P:0.17598 F:0.21823
37 ROUGE-L Eval D0716-A.M.100.D-C.37 R:0.28525 P:0.22137 F:0.24928
37 ROUGE-L Eval D0716-A.M.100.D-D.37 R:0.28667 P:0.21883 F:0.24820
37 ROUGE-L Eval D0716-A.M.100.D-E.37 R:0.29568 P:0.22646 F:0.25648
37 ROUGE-L Eval D0716-A.M.100.D-F.37 R:0.27393 P:0.21120 F:0.23851
37 ROUGE-L Eval D0716-B.M.100.D-C.37 R:0.26316 P:0.21505 F:0.23668
37 ROUGE-L Eval D0716-B.M.100.D-D.37 R:0.29530 P:0.23656 F:0.26269
37 ROUGE-L Eval D0716-B.M.100.D-E.37 R:0.25249 P:0.20430 F:0.22585
37 ROUGE-L Eval D0716-B.M.100.D-F.37 R:0.27667 P:0.22312 F:0.24703
37 ROUGE-L Eval D0716-C.M.100.D-C.37 R:0.35505 P:0.25952 F:0.29986
37 ROUGE-L Eval D0716-C.M.100.D-D.37 R:0.34448 P:0.24524 F:0.28651
37 ROUGE-L Eval D0716-C.M.100.D-E.37 R:0.35644 P:0.25714 F:0.29875
37 ROUGE-L Eval D0716-C.M.100.D-F.37 R:0.32333 P:0.23095 F:0.26944
37 ROUGE-L Eval D0721-A.M.100.E-B.37 R:0.30000 P:0.19868 F:0.23905
37 ROUGE-L Eval D0721-A.M.100.E-C.37 R:0.28571 P:0.19426 F:0.23127
37 ROUGE-L Eval D0721-A.M.100.E-E.37 R:0.28571 P:0.19426 F:0.23127
37 ROUGE-L Eval D0721-A.M.100.E-G.37 R:0.29936 P:0.20751 F:0.24511
37 ROUGE-L Eval D0721-B.M.100.E-B.37 R:0.27687 P:0.18162 F:0.21935
37 ROUGE-L Eval D0721-B.M.100.E-C.37 R:0.28344 P:0.19017 F:0.22762
37 ROUGE-L Eval D0721-B.M.100.E-E.37 R:0.24918 P:0.16239 F:0.19663
37 ROUGE-L Eval D0721-B.M.100.E-G.37 R:0.26774 P:0.17735 F:0.21337
37 ROUGE-L Eval D0721-C.M.100.E-B.37 R:0.29508 P:0.18405 F:0.22670
37 ROUGE-L Eval D0721-C.M.100.E-C.37 R:0.24422 P:0.15133 F:0.18687
37 ROUGE-L Eval D0721-C.M.100.E-E.37 R:0.26333 P:0.16155 F:0.20025
37 ROUGE-L Eval D0721-C.M.100.E-G.37 R:0.24430 P:0.15337 F:0.18844
37 ROUGE-L Eval D0726-A.M.100.F-A.37 R:0.27907 P:0.18543 F:0.22281
37 ROUGE-L Eval D0726-A.M.100.F-E.37 R:0.22000 P:0.14570 F:0.17530
37 ROUGE-L Eval D0726-A.M.100.F-F.37 R:0.27907 P:0.18543 F:0.22281
37 ROUGE-L Eval D0726-A.M.100.F-G.37 R:0.25914 P:0.17219 F:0.20690
37 ROUGE-L Eval D0726-B.M.100.F-A.37 R:0.21569 P:0.15385 F:0.17960
37 ROUGE-L Eval D0726-B.M.100.F-E.37 R:0.18937 P:0.13287 F:0.15617
37 ROUGE-L Eval D0726-B.M.100.F-F.37 R:0.21927 P:0.15385 F:0.18082
37 ROUGE-L Eval D0726-B.M.100.F-G.37 R:0.20724 P:0.14685 F:0.17190
37 ROUGE-L Eval D0726-C.M.100.F-A.37 R:0.28000 P:0.17284 F:0.21374
37 ROUGE-L Eval D0726-C.M.100.F-E.37 R:0.26936 P:0.16461 F:0.20434
37 ROUGE-L Eval D0726-C.M.100.F-F.37 R:0.26780 P:0.16255 F:0.20230
37 ROUGE-L Eval D0726-C.M.100.F-G.37 R:0.25574 P:0.16049 F:0.19722
37 ROUGE-L Eval D0727-A.M.100.G-A.37 R:0.30565 P:0.20444 F:0.24500
37 ROUGE-L Eval D0727-A.M.100.G-F.37 R:0.30921 P:0.20889 F:0.24934
37 ROUGE-L Eval D0727-A.M.100.G-G.37 R:0.29739 P:0.20222 F:0.24074
37 ROUGE-L Eval D0727-A.M.100.G-H.37 R:0.30263 P:0.20444 F:0.24403
37 ROUGE-L Eval D0727-B.M.100.G-A.37 R:0.30241 P:0.18333 F:0.22827
37 ROUGE-L Eval D0727-B.M.100.G-F.37 R:0.31169 P:0.20000 F:0.24366
37 ROUGE-L Eval D0727-B.M.100.G-G.37 R:0.29758 P:0.17917 F:0.22367
37 ROUGE-L Eval D0727-B.M.100.G-H.37 R:0.28866 P:0.17500 F:0.21790
37 ROUGE-L Eval D0727-C.M.100.G-A.37 R:0.22801 P:0.15453 F:0.18421
37 ROUGE-L Eval D0727-C.M.100.G-F.37 R:0.24916 P:0.16336 F:0.19734
37 ROUGE-L Eval D0727-C.M.100.G-G.37 R:0.23432 P:0.15673 F:0.18783
37 ROUGE-L Eval D0727-C.M.100.G-H.37 R:0.24662 P:0.16115 F:0.19493
37 ROUGE-L Eval D0736-A.M.100.H-G.37 R:0.26165 P:0.15021 F:0.19085
37 ROUGE-L Eval D0736-A.M.100.H-H.37 R:0.28467 P:0.16049 F:0.20526
37 ROUGE-L Eval D0736-A.M.100.H-I.37 R:0.25979 P:0.15021 F:0.19036
37 ROUGE-L Eval D0736-A.M.100.H-J.37 R:0.24837 P:0.15638 F:0.19192
37 ROUGE-L Eval D0736-B.M.100.H-G.37 R:0.15649 P:0.07387 F:0.10036
37 ROUGE-L Eval D0736-B.M.100.H-H.37 R:0.16529 P:0.07207 F:0.10037
37 ROUGE-L Eval D0736-B.M.100.H-I.37 R:0.15063 P:0.06486 F:0.09068
37 ROUGE-L Eval D0736-B.M.100.H-J.37 R:0.15734 P:0.08108 F:0.10701
37 ROUGE-L Eval D0736-C.M.100.H-G.37 R:0.19409 P:0.07863 F:0.11192
37 ROUGE-L Eval D0736-C.M.100.H-H.37 R:0.21925 P:0.07009 F:0.10622
37 ROUGE-L Eval D0736-C.M.100.H-I.37 R:0.17112 P:0.05470 F:0.08290
37 ROUGE-L Eval D0736-C.M.100.H-J.37 R:0.19623 P:0.08889 F:0.12235
37 ROUGE-L Eval D0740-A.M.100.I-D.37 R:0.21782 P:0.14765 F:0.17600
37 ROUGE-L Eval D0740-A.M.100.I-H.37 R:0.21569 P:0.14765 F:0.17530
37 ROUGE-L Eval D0740-A.M.100.I-I.37 R:0.18506 P:0.12752 F:0.15099
37 ROUGE-L Eval D0740-A.M.100.I-J.37 R:0.20323 P:0.14094 F:0.16645
37 ROUGE-L Eval D0740-B.M.100.I-D.37 R:0.22727 P:0.13645 F:0.17052
37 ROUGE-L Eval D0740-B.M.100.I-H.37 R:0.22848 P:0.13450 F:0.16932
37 ROUGE-L Eval D0740-B.M.100.I-I.37 R:0.21967 P:0.13060 F:0.16381
37 ROUGE-L Eval D0740-B.M.100.I-J.37 R:0.22654 P:0.13645 F:0.17032
37 ROUGE-L Eval D0740-C.M.100.I-D.37 R:0.27796 P:0.18125 F:0.21942
37 ROUGE-L Eval D0740-C.M.100.I-H.37 R:0.28296 P:0.18333 F:0.22250
37 ROUGE-L Eval D0740-C.M.100.I-I.37 R:0.28115 P:0.18333 F:0.22194
37 ROUGE-L Eval D0740-C.M.100.I-J.37 R:0.26115 P:0.17083 F:0.20655
37 ROUGE-L Eval D0743-A.M.100.J-B.37 R:0.21587 P:0.14437 F:0.17302
37 ROUGE-L Eval D0743-A.M.100.J-H.37 R:0.21605 P:0.14862 F:0.17610
37 ROUGE-L Eval D0743-A.M.100.J-I.37 R:0.20313 P:0.13800 F:0.16435
37 ROUGE-L Eval D0743-A.M.100.J-J.37 R:0.19692 P:0.13588 F:0.16080
37 ROUGE-L Eval D0743-B.M.100.J-B.37 R:0.18590 P:0.11861 F:0.14482
37 ROUGE-L Eval D0743-B.M.100.J-H.37 R:0.20505 P:0.13292 F:0.16129
37 ROUGE-L Eval D0743-B.M.100.J-I.37 R:0.19937 P:0.12883 F:0.15652
37 ROUGE-L Eval D0743-B.M.100.J-J.37 R:0.17757 P:0.11656 F:0.14074
37 ROUGE-L Eval D0743-C.M.100.J-B.37 R:0.20000 P:0.14189 F:0.16601
37 ROUGE-L Eval D0743-C.M.100.J-H.37 R:0.18153 P:0.12838 F:0.15040
37 ROUGE-L Eval D0743-C.M.100.J-I.37 R:0.18211 P:0.12838 F:0.15060
37 ROUGE-L Eval D0743-C.M.100.J-J.37 R:0.17925 P:0.12838 F:0.14961
---------------------------------------------
37 ROUGE-W-1.2 Average_R: 0.08753 (95%-conf.int. 0.08462 - 0.09040)
37 ROUGE-W-1.2 Average_P: 0.10372 (95%-conf.int. 0.09923 - 0.10844)
37 ROUGE-W-1.2 Average_F: 0.09454 (95%-conf.int. 0.09090 - 0.09816)
.............................................
37 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.37 R:0.08811 P:0.11950 F:0.10143
37 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.37 R:0.08507 P:0.11725 F:0.09860
37 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.37 R:0.08445 P:0.11528 F:0.09749
37 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.37 R:0.08677 P:0.11104 F:0.09742
37 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.37 R:0.08063 P:0.10234 F:0.09020
37 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.37 R:0.08972 P:0.11319 F:0.10010
37 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.37 R:0.08158 P:0.10202 F:0.09066
37 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.37 R:0.07906 P:0.09874 F:0.08781
37 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.37 R:0.10145 P:0.11789 F:0.10905
37 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.37 R:0.09488 P:0.11494 F:0.10395
37 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.37 R:0.09463 P:0.11300 F:0.10300
37 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.37 R:0.11367 P:0.12881 F:0.12077
37 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.37 R:0.08335 P:0.09720 F:0.08974
37 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.37 R:0.06986 P:0.08275 F:0.07576
37 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.37 R:0.06669 P:0.07858 F:0.07215
37 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.37 R:0.08072 P:0.09720 F:0.08820
37 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.37 R:0.05485 P:0.05383 F:0.05434
37 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.37 R:0.04887 P:0.04900 F:0.04893
37 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.37 R:0.05416 P:0.05452 F:0.05434
37 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.37 R:0.04667 P:0.04829 F:0.04747
37 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.37 R:0.10872 P:0.12783 F:0.11750
37 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.37 R:0.09641 P:0.11433 F:0.10461
37 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.37 R:0.10784 P:0.12665 F:0.11649
37 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.37 R:0.10486 P:0.12667 F:0.11474
37 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.37 R:0.11783 P:0.13288 F:0.12490
37 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.37 R:0.12005 P:0.13423 F:0.12674
37 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.37 R:0.10289 P:0.11405 F:0.10818
37 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.37 R:0.11313 P:0.12753 F:0.11990
37 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.37 R:0.08985 P:0.10136 F:0.09526
37 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.37 R:0.07710 P:0.09074 F:0.08337
37 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.37 R:0.07649 P:0.09208 F:0.08356
37 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.37 R:0.07842 P:0.09240 F:0.08484
37 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.37 R:0.09976 P:0.11700 F:0.10769
37 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.37 R:0.10264 P:0.11643 F:0.10910
37 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.37 R:0.10089 P:0.11740 F:0.10852
37 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.37 R:0.09094 P:0.10741 F:0.09849
37 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.37 R:0.09763 P:0.13842 F:0.11450
37 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.37 R:0.09706 P:0.14115 F:0.11502
37 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.37 R:0.09925 P:0.14196 F:0.11682
37 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.37 R:0.09463 P:0.13875 F:0.11252
37 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.37 R:0.09796 P:0.13965 F:0.11515
37 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.37 R:0.10632 P:0.15241 F:0.12526
37 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.37 R:0.09099 P:0.13107 F:0.10741
37 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.37 R:0.10157 P:0.14498 F:0.11945
37 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.37 R:0.11675 P:0.15906 F:0.13466
37 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.37 R:0.10994 P:0.15179 F:0.12752
37 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.37 R:0.11432 P:0.15983 F:0.13330
37 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.37 R:0.10304 P:0.14317 F:0.11983
37 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.37 R:0.11531 P:0.13422 F:0.12405
37 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.37 R:0.10920 P:0.13173 F:0.11941
37 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.37 R:0.10513 P:0.12841 F:0.11561
37 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.37 R:0.11460 P:0.13920 F:0.12571
37 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.37 R:0.08806 P:0.11167 F:0.09847
37 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.37 R:0.09208 P:0.11611 F:0.10271
37 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.37 R:0.07783 P:0.09955 F:0.08736
37 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.37 R:0.08280 P:0.10946 F:0.09428
37 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.37 R:0.10071 P:0.11561 F:0.10765
37 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.37 R:0.08220 P:0.09583 F:0.08849
37 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.37 R:0.08958 P:0.10257 F:0.09564
37 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.37 R:0.08388 P:0.09848 F:0.09060
37 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.37 R:0.10129 P:0.11927 F:0.10955
37 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.37 R:0.08083 P:0.09378 F:0.08682
37 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.37 R:0.09887 P:0.11701 F:0.10718
37 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.37 R:0.09207 P:0.11073 F:0.10054
37 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.37 R:0.08108 P:0.10173 F:0.09024
37 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.37 R:0.06680 P:0.08461 F:0.07466
37 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.37 R:0.07954 P:0.10139 F:0.08915
37 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.37 R:0.07542 P:0.09650 F:0.08467
37 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.37 R:0.09910 P:0.10742 F:0.10309
37 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.37 R:0.09689 P:0.10451 F:0.10056
37 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.37 R:0.09148 P:0.09944 F:0.09529
37 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.37 R:0.08920 P:0.10024 F:0.09440
37 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.37 R:0.10503 P:0.12366 F:0.11359
37 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.37 R:0.10564 P:0.13026 F:0.11667
37 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.37 R:0.10519 P:0.12668 F:0.11494
37 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.37 R:0.10521 P:0.12740 F:0.11525
37 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.37 R:0.10510 P:0.11180 F:0.10835
37 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.37 R:0.10474 P:0.12073 F:0.11217
37 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.37 R:0.10073 P:0.10863 F:0.10453
37 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.37 R:0.09864 P:0.10585 F:0.10212
37 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.37 R:0.08096 P:0.09868 F:0.08895
37 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.37 R:0.08635 P:0.10464 F:0.09462
37 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.37 R:0.08089 P:0.09959 F:0.08927
37 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.37 R:0.08406 P:0.09886 F:0.09086
37 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.37 R:0.09652 P:0.09813 F:0.09732
37 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.37 R:0.10383 P:0.10295 F:0.10339
37 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.37 R:0.09486 P:0.09800 F:0.09640
37 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.37 R:0.08738 P:0.09809 F:0.09243
37 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.37 R:0.05570 P:0.04867 F:0.05195
37 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.37 R:0.05878 P:0.04742 F:0.05249
37 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.37 R:0.05501 P:0.04375 F:0.04874
37 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.37 R:0.05542 P:0.05280 F:0.05408
37 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.37 R:0.07586 P:0.05583 F:0.06432
37 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.37 R:0.08448 P:0.05047 F:0.06319
37 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.37 R:0.06403 P:0.03734 F:0.04717
37 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.37 R:0.07482 P:0.06047 F:0.06688
37 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.37 R:0.07821 P:0.09752 F:0.08680
37 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.37 R:0.08027 P:0.09913 F:0.08871
37 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.37 R:0.06594 P:0.08404 F:0.07390
37 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.37 R:0.07350 P:0.09364 F:0.08236
37 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.37 R:0.07767 P:0.08567 F:0.08147
37 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.37 R:0.07722 P:0.08090 F:0.07902
37 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.37 R:0.07133 P:0.07968 F:0.07527
37 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.37 R:0.07706 P:0.08298 F:0.07991
37 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.37 R:0.09446 P:0.11887 F:0.10527
37 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.37 R:0.09988 P:0.12078 F:0.10934
37 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.37 R:0.09139 P:0.11655 F:0.10245
37 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.37 R:0.09073 P:0.11373 F:0.10094
37 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.37 R:0.07697 P:0.08973 F:0.08286
37 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.37 R:0.07726 P:0.09181 F:0.08391
37 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.37 R:0.07167 P:0.08640 F:0.07835
37 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.37 R:0.06985 P:0.08367 F:0.07614
37 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.37 R:0.07092 P:0.07577 F:0.07326
37 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.37 R:0.07783 P:0.08367 F:0.08064
37 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.37 R:0.07372 P:0.08029 F:0.07686
37 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.37 R:0.06897 P:0.07443 F:0.07160
37 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.37 R:0.07058 P:0.08765 F:0.07819
37 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.37 R:0.06691 P:0.07903 F:0.07247
37 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.37 R:0.06537 P:0.08212 F:0.07279
37 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.37 R:0.06650 P:0.08017 F:0.07270
---------------------------------------------
37 ROUGE-SU4 Average_R: 0.08090 (95%-conf.int. 0.07682 - 0.08533)
37 ROUGE-SU4 Average_P: 0.05276 (95%-conf.int. 0.04943 - 0.05626)
37 ROUGE-SU4 Average_F: 0.06363 (95%-conf.int. 0.05995 - 0.06753)
.............................................
37 ROUGE-SU4 Eval D0703-A.M.100.A-A.37 R:0.08449 P:0.06320 F:0.07231
37 ROUGE-SU4 Eval D0703-A.M.100.A-C.37 R:0.08678 P:0.06537 F:0.07457
37 ROUGE-SU4 Eval D0703-A.M.100.A-D.37 R:0.08422 P:0.06190 F:0.07136
37 ROUGE-SU4 Eval D0703-A.M.100.A-J.37 R:0.07576 P:0.05628 F:0.06458
37 ROUGE-SU4 Eval D0703-B.M.100.A-A.37 R:0.07215 P:0.04897 F:0.05834
37 ROUGE-SU4 Eval D0703-B.M.100.A-C.37 R:0.09483 P:0.06264 F:0.07544
37 ROUGE-SU4 Eval D0703-B.M.100.A-D.37 R:0.08161 P:0.05391 F:0.06493
37 ROUGE-SU4 Eval D0703-B.M.100.A-J.37 R:0.07964 P:0.05315 F:0.06375
37 ROUGE-SU4 Eval D0703-C.M.100.A-A.37 R:0.11416 P:0.07062 F:0.08726
37 ROUGE-SU4 Eval D0703-C.M.100.A-C.37 R:0.10611 P:0.06744 F:0.08247
37 ROUGE-SU4 Eval D0703-C.M.100.A-D.37 R:0.10884 P:0.06780 F:0.08355
37 ROUGE-SU4 Eval D0703-C.M.100.A-J.37 R:0.12188 P:0.07592 F:0.09356
37 ROUGE-SU4 Eval D0706-A.M.100.B-B.37 R:0.07056 P:0.04542 F:0.05527
37 ROUGE-SU4 Eval D0706-A.M.100.B-D.37 R:0.05872 P:0.03755 F:0.04581
37 ROUGE-SU4 Eval D0706-A.M.100.B-E.37 R:0.05000 P:0.03219 F:0.03917
37 ROUGE-SU4 Eval D0706-A.M.100.B-I.37 R:0.06778 P:0.04363 F:0.05309
37 ROUGE-SU4 Eval D0706-B.M.100.B-B.37 R:0.03300 P:0.01848 F:0.02369
37 ROUGE-SU4 Eval D0706-B.M.100.B-D.37 R:0.02899 P:0.01629 F:0.02086
37 ROUGE-SU4 Eval D0706-B.M.100.B-E.37 R:0.03278 P:0.01848 F:0.02364
37 ROUGE-SU4 Eval D0706-B.M.100.B-I.37 R:0.02713 P:0.01535 F:0.01961
37 ROUGE-SU4 Eval D0706-C.M.100.B-B.37 R:0.10651 P:0.07278 F:0.08647
37 ROUGE-SU4 Eval D0706-C.M.100.B-D.37 R:0.08278 P:0.05656 F:0.06720
37 ROUGE-SU4 Eval D0706-C.M.100.B-E.37 R:0.10197 P:0.07014 F:0.08311
37 ROUGE-SU4 Eval D0706-C.M.100.B-I.37 R:0.09617 P:0.06637 F:0.07854
37 ROUGE-SU4 Eval D0711-A.M.100.C-A.37 R:0.12275 P:0.07601 F:0.09388
37 ROUGE-SU4 Eval D0711-A.M.100.C-B.37 R:0.12728 P:0.07775 F:0.09653
37 ROUGE-SU4 Eval D0711-A.M.100.C-C.37 R:0.09304 P:0.05683 F:0.07056
37 ROUGE-SU4 Eval D0711-A.M.100.C-F.37 R:0.11848 P:0.07287 F:0.09024
37 ROUGE-SU4 Eval D0711-B.M.100.C-A.37 R:0.07576 P:0.04741 F:0.05832
37 ROUGE-SU4 Eval D0711-B.M.100.C-B.37 R:0.06984 P:0.04340 F:0.05353
37 ROUGE-SU4 Eval D0711-B.M.100.C-C.37 R:0.06149 P:0.03902 F:0.04774
37 ROUGE-SU4 Eval D0711-B.M.100.C-F.37 R:0.07027 P:0.04413 F:0.05421
37 ROUGE-SU4 Eval D0711-C.M.100.C-A.37 R:0.10395 P:0.06456 F:0.07965
37 ROUGE-SU4 Eval D0711-C.M.100.C-B.37 R:0.10351 P:0.06211 F:0.07764
37 ROUGE-SU4 Eval D0711-C.M.100.C-C.37 R:0.10880 P:0.06596 F:0.08213
37 ROUGE-SU4 Eval D0711-C.M.100.C-F.37 R:0.09201 P:0.05579 F:0.06946
37 ROUGE-SU4 Eval D0716-A.M.100.D-C.37 R:0.12907 P:0.09957 F:0.11242
37 ROUGE-SU4 Eval D0716-A.M.100.D-D.37 R:0.14155 P:0.10736 F:0.12211
37 ROUGE-SU4 Eval D0716-A.M.100.D-E.37 R:0.12969 P:0.09870 F:0.11209
37 ROUGE-SU4 Eval D0716-A.M.100.D-F.37 R:0.12147 P:0.09307 F:0.10539
37 ROUGE-SU4 Eval D0716-B.M.100.D-C.37 R:0.10079 P:0.08196 F:0.09040
37 ROUGE-SU4 Eval D0716-B.M.100.D-D.37 R:0.10920 P:0.08700 F:0.09684
37 ROUGE-SU4 Eval D0716-B.M.100.D-E.37 R:0.08646 P:0.06960 F:0.07712
37 ROUGE-SU4 Eval D0716-B.M.100.D-F.37 R:0.10160 P:0.08150 F:0.09045
37 ROUGE-SU4 Eval D0716-C.M.100.D-C.37 R:0.12876 P:0.09345 F:0.10830
37 ROUGE-SU4 Eval D0716-C.M.100.D-D.37 R:0.13001 P:0.09183 F:0.10763
37 ROUGE-SU4 Eval D0716-C.M.100.D-E.37 R:0.13333 P:0.09547 F:0.11127
37 ROUGE-SU4 Eval D0716-C.M.100.D-F.37 R:0.12272 P:0.08697 F:0.10180
37 ROUGE-SU4 Eval D0721-A.M.100.E-B.37 R:0.09646 P:0.06330 F:0.07644
37 ROUGE-SU4 Eval D0721-A.M.100.E-C.37 R:0.09500 P:0.06404 F:0.07651
37 ROUGE-SU4 Eval D0721-A.M.100.E-E.37 R:0.09167 P:0.06180 F:0.07383
37 ROUGE-SU4 Eval D0721-A.M.100.E-G.37 R:0.09586 P:0.06592 F:0.07812
37 ROUGE-SU4 Eval D0721-B.M.100.E-B.37 R:0.08528 P:0.05543 F:0.06719
37 ROUGE-SU4 Eval D0721-B.M.100.E-C.37 R:0.08824 P:0.05870 F:0.07050
37 ROUGE-SU4 Eval D0721-B.M.100.E-E.37 R:0.07295 P:0.04710 F:0.05724
37 ROUGE-SU4 Eval D0721-B.M.100.E-G.37 R:0.08223 P:0.05399 F:0.06518
37 ROUGE-SU4 Eval D0721-C.M.100.E-B.37 R:0.09371 P:0.05787 F:0.07155
37 ROUGE-SU4 Eval D0721-C.M.100.E-C.37 R:0.06949 P:0.04262 F:0.05283
37 ROUGE-SU4 Eval D0721-C.M.100.E-E.37 R:0.08276 P:0.05024 F:0.06252
37 ROUGE-SU4 Eval D0721-C.M.100.E-G.37 R:0.07525 P:0.04678 F:0.05769
37 ROUGE-SU4 Eval D0726-A.M.100.F-A.37 R:0.08646 P:0.05693 F:0.06865
37 ROUGE-SU4 Eval D0726-A.M.100.F-E.37 R:0.06621 P:0.04345 F:0.05247
37 ROUGE-SU4 Eval D0726-A.M.100.F-F.37 R:0.08931 P:0.05880 F:0.07091
37 ROUGE-SU4 Eval D0726-A.M.100.F-G.37 R:0.08419 P:0.05543 F:0.06685
37 ROUGE-SU4 Eval D0726-B.M.100.F-A.37 R:0.07159 P:0.05067 F:0.05934
37 ROUGE-SU4 Eval D0726-B.M.100.F-E.37 R:0.04949 P:0.03444 F:0.04062
37 ROUGE-SU4 Eval D0726-B.M.100.F-F.37 R:0.07110 P:0.04949 F:0.05836
37 ROUGE-SU4 Eval D0726-B.M.100.F-G.37 R:0.06700 P:0.04711 F:0.05532
37 ROUGE-SU4 Eval D0726-C.M.100.F-A.37 R:0.07763 P:0.04742 F:0.05888
37 ROUGE-SU4 Eval D0726-C.M.100.F-E.37 R:0.07497 P:0.04533 F:0.05650
37 ROUGE-SU4 Eval D0726-C.M.100.F-F.37 R:0.07375 P:0.04428 F:0.05534
37 ROUGE-SU4 Eval D0726-C.M.100.F-G.37 R:0.07239 P:0.04498 F:0.05548
37 ROUGE-SU4 Eval D0727-A.M.100.G-A.37 R:0.08305 P:0.05505 F:0.06621
37 ROUGE-SU4 Eval D0727-A.M.100.G-F.37 R:0.09685 P:0.06486 F:0.07769
37 ROUGE-SU4 Eval D0727-A.M.100.G-G.37 R:0.08949 P:0.06033 F:0.07207
37 ROUGE-SU4 Eval D0727-A.M.100.G-H.37 R:0.08896 P:0.05958 F:0.07136
37 ROUGE-SU4 Eval D0727-B.M.100.G-A.37 R:0.09069 P:0.05438 F:0.06799
37 ROUGE-SU4 Eval D0727-B.M.100.G-F.37 R:0.10000 P:0.06356 F:0.07772
37 ROUGE-SU4 Eval D0727-B.M.100.G-G.37 R:0.09075 P:0.05403 F:0.06773
37 ROUGE-SU4 Eval D0727-B.M.100.G-H.37 R:0.08952 P:0.05367 F:0.06711
37 ROUGE-SU4 Eval D0727-C.M.100.G-A.37 R:0.07581 P:0.05094 F:0.06094
37 ROUGE-SU4 Eval D0727-C.M.100.G-F.37 R:0.08189 P:0.05318 F:0.06448
37 ROUGE-SU4 Eval D0727-C.M.100.G-G.37 R:0.08136 P:0.05393 F:0.06486
37 ROUGE-SU4 Eval D0727-C.M.100.G-H.37 R:0.07870 P:0.05094 F:0.06185
37 ROUGE-SU4 Eval D0736-A.M.100.H-G.37 R:0.07995 P:0.04533 F:0.05786
37 ROUGE-SU4 Eval D0736-A.M.100.H-H.37 R:0.09273 P:0.05160 F:0.06630
37 ROUGE-SU4 Eval D0736-A.M.100.H-I.37 R:0.08425 P:0.04812 F:0.06125
37 ROUGE-SU4 Eval D0736-A.M.100.H-J.37 R:0.07271 P:0.04533 F:0.05584
37 ROUGE-SU4 Eval D0736-B.M.100.H-G.37 R:0.03806 P:0.01767 F:0.02413
37 ROUGE-SU4 Eval D0736-B.M.100.H-H.37 R:0.03775 P:0.01615 F:0.02262
37 ROUGE-SU4 Eval D0736-B.M.100.H-I.37 R:0.03463 P:0.01463 F:0.02057
37 ROUGE-SU4 Eval D0736-B.M.100.H-J.37 R:0.03777 P:0.01920 F:0.02546
37 ROUGE-SU4 Eval D0736-C.M.100.H-G.37 R:0.07205 P:0.02860 F:0.04095
37 ROUGE-SU4 Eval D0736-C.M.100.H-H.37 R:0.08194 P:0.02542 F:0.03880
37 ROUGE-SU4 Eval D0736-C.M.100.H-I.37 R:0.04376 P:0.01358 F:0.02073
37 ROUGE-SU4 Eval D0736-C.M.100.H-J.37 R:0.06809 P:0.03033 F:0.04197
37 ROUGE-SU4 Eval D0740-A.M.100.I-D.37 R:0.06949 P:0.04670 F:0.05586
37 ROUGE-SU4 Eval D0740-A.M.100.I-H.37 R:0.06767 P:0.04594 F:0.05473
37 ROUGE-SU4 Eval D0740-A.M.100.I-I.37 R:0.05000 P:0.03417 F:0.04060
37 ROUGE-SU4 Eval D0740-A.M.100.I-J.37 R:0.06071 P:0.04176 F:0.04948
37 ROUGE-SU4 Eval D0740-B.M.100.I-D.37 R:0.06222 P:0.03696 F:0.04637
37 ROUGE-SU4 Eval D0740-B.M.100.I-H.37 R:0.06122 P:0.03564 F:0.04505
37 ROUGE-SU4 Eval D0740-B.M.100.I-I.37 R:0.06285 P:0.03696 F:0.04655
37 ROUGE-SU4 Eval D0740-B.M.100.I-J.37 R:0.06202 P:0.03696 F:0.04632
37 ROUGE-SU4 Eval D0740-C.M.100.I-D.37 R:0.10437 P:0.06744 F:0.08194
37 ROUGE-SU4 Eval D0740-C.M.100.I-H.37 R:0.10066 P:0.06462 F:0.07871
37 ROUGE-SU4 Eval D0740-C.M.100.I-I.37 R:0.10656 P:0.06886 F:0.08366
37 ROUGE-SU4 Eval D0740-C.M.100.I-J.37 R:0.10349 P:0.06709 F:0.08141
37 ROUGE-SU4 Eval D0743-A.M.100.J-B.37 R:0.05320 P:0.03528 F:0.04243
37 ROUGE-SU4 Eval D0743-A.M.100.J-H.37 R:0.05538 P:0.03780 F:0.04493
37 ROUGE-SU4 Eval D0743-A.M.100.J-I.37 R:0.05342 P:0.03600 F:0.04301
37 ROUGE-SU4 Eval D0743-A.M.100.J-J.37 R:0.04890 P:0.03348 F:0.03975
37 ROUGE-SU4 Eval D0743-B.M.100.J-B.37 R:0.04770 P:0.03015 F:0.03695
37 ROUGE-SU4 Eval D0743-B.M.100.J-H.37 R:0.04962 P:0.03188 F:0.03882
37 ROUGE-SU4 Eval D0743-B.M.100.J-I.37 R:0.04870 P:0.03119 F:0.03803
37 ROUGE-SU4 Eval D0743-B.M.100.J-J.37 R:0.03887 P:0.02529 F:0.03064
37 ROUGE-SU4 Eval D0743-C.M.100.J-B.37 R:0.06786 P:0.04778 F:0.05608
37 ROUGE-SU4 Eval D0743-C.M.100.J-H.37 R:0.05610 P:0.03937 F:0.04627
37 ROUGE-SU4 Eval D0743-C.M.100.J-I.37 R:0.05792 P:0.04052 F:0.04768
37 ROUGE-SU4 Eval D0743-C.M.100.J-J.37 R:0.05269 P:0.03746 F:0.04379
---------------------------------------------
38 ROUGE-1 Average_R: 0.36313 (95%-conf.int. 0.35287 - 0.37287)
38 ROUGE-1 Average_P: 0.22495 (95%-conf.int. 0.21842 - 0.23098)
38 ROUGE-1 Average_F: 0.27717 (95%-conf.int. 0.26960 - 0.28416)
.............................................
38 ROUGE-1 Eval D0703-A.M.100.A-A.38 R:0.36149 P:0.22432 F:0.27685
38 ROUGE-1 Eval D0703-A.M.100.A-C.38 R:0.33893 P:0.21174 F:0.26065
38 ROUGE-1 Eval D0703-A.M.100.A-D.38 R:0.34364 P:0.20964 F:0.26041
38 ROUGE-1 Eval D0703-A.M.100.A-J.38 R:0.36054 P:0.22222 F:0.27496
38 ROUGE-1 Eval D0703-B.M.100.A-A.38 R:0.42484 P:0.26915 F:0.32953
38 ROUGE-1 Eval D0703-B.M.100.A-C.38 R:0.41611 P:0.25673 F:0.31754
38 ROUGE-1 Eval D0703-B.M.100.A-D.38 R:0.42282 P:0.26087 F:0.32266
38 ROUGE-1 Eval D0703-B.M.100.A-J.38 R:0.44186 P:0.27536 F:0.33928
38 ROUGE-1 Eval D0703-C.M.100.A-A.38 R:0.40667 P:0.25417 F:0.31282
38 ROUGE-1 Eval D0703-C.M.100.A-C.38 R:0.38312 P:0.24583 F:0.29949
38 ROUGE-1 Eval D0703-C.M.100.A-D.38 R:0.37417 P:0.23542 F:0.28900
38 ROUGE-1 Eval D0703-C.M.100.A-J.38 R:0.40066 P:0.25208 F:0.30946
38 ROUGE-1 Eval D0706-A.M.100.B-B.38 R:0.39286 P:0.25208 F:0.30710
38 ROUGE-1 Eval D0706-A.M.100.B-D.38 R:0.37255 P:0.23750 F:0.29008
38 ROUGE-1 Eval D0706-A.M.100.B-E.38 R:0.34091 P:0.21875 F:0.26650
38 ROUGE-1 Eval D0706-A.M.100.B-I.38 R:0.37662 P:0.24167 F:0.29442
38 ROUGE-1 Eval D0706-B.M.100.B-B.38 R:0.34314 P:0.23649 F:0.28000
38 ROUGE-1 Eval D0706-B.M.100.B-D.38 R:0.33876 P:0.23423 F:0.27696
38 ROUGE-1 Eval D0706-B.M.100.B-E.38 R:0.33766 P:0.23423 F:0.27659
38 ROUGE-1 Eval D0706-B.M.100.B-I.38 R:0.36570 P:0.25450 F:0.30013
38 ROUGE-1 Eval D0706-C.M.100.B-B.38 R:0.37742 P:0.22674 F:0.28329
38 ROUGE-1 Eval D0706-C.M.100.B-D.38 R:0.40000 P:0.24031 F:0.30024
38 ROUGE-1 Eval D0706-C.M.100.B-E.38 R:0.37500 P:0.22674 F:0.28261
38 ROUGE-1 Eval D0706-C.M.100.B-I.38 R:0.40895 P:0.24806 F:0.30881
38 ROUGE-1 Eval D0711-A.M.100.C-A.38 R:0.36184 P:0.23656 F:0.28609
38 ROUGE-1 Eval D0711-A.M.100.C-B.38 R:0.38667 P:0.24946 F:0.30327
38 ROUGE-1 Eval D0711-A.M.100.C-C.38 R:0.38667 P:0.24946 F:0.30327
38 ROUGE-1 Eval D0711-A.M.100.C-F.38 R:0.39735 P:0.25806 F:0.31290
38 ROUGE-1 Eval D0711-B.M.100.C-A.38 R:0.33673 P:0.19880 F:0.25000
38 ROUGE-1 Eval D0711-B.M.100.C-B.38 R:0.36986 P:0.21687 F:0.27342
38 ROUGE-1 Eval D0711-B.M.100.C-C.38 R:0.36577 P:0.21888 F:0.27387
38 ROUGE-1 Eval D0711-B.M.100.C-F.38 R:0.35254 P:0.20884 F:0.26230
38 ROUGE-1 Eval D0711-C.M.100.C-A.38 R:0.37954 P:0.25386 F:0.30423
38 ROUGE-1 Eval D0711-C.M.100.C-B.38 R:0.40614 P:0.26269 F:0.31903
38 ROUGE-1 Eval D0711-C.M.100.C-C.38 R:0.36824 P:0.24062 F:0.29106
38 ROUGE-1 Eval D0711-C.M.100.C-F.38 R:0.33108 P:0.21634 F:0.26169
38 ROUGE-1 Eval D0716-A.M.100.D-C.38 R:0.42951 P:0.27292 F:0.33376
38 ROUGE-1 Eval D0716-A.M.100.D-D.38 R:0.41000 P:0.25625 F:0.31538
38 ROUGE-1 Eval D0716-A.M.100.D-E.38 R:0.45183 P:0.28333 F:0.34827
38 ROUGE-1 Eval D0716-A.M.100.D-F.38 R:0.42574 P:0.26875 F:0.32950
38 ROUGE-1 Eval D0716-B.M.100.D-C.38 R:0.36513 P:0.23871 F:0.28869
38 ROUGE-1 Eval D0716-B.M.100.D-D.38 R:0.40268 P:0.25806 F:0.31454
38 ROUGE-1 Eval D0716-B.M.100.D-E.38 R:0.36213 P:0.23441 F:0.28460
38 ROUGE-1 Eval D0716-B.M.100.D-F.38 R:0.37667 P:0.24301 F:0.29543
38 ROUGE-1 Eval D0716-C.M.100.D-C.38 R:0.42345 P:0.29885 F:0.35040
38 ROUGE-1 Eval D0716-C.M.100.D-D.38 R:0.42140 P:0.28966 F:0.34333
38 ROUGE-1 Eval D0716-C.M.100.D-E.38 R:0.42244 P:0.29425 F:0.34688
38 ROUGE-1 Eval D0716-C.M.100.D-F.38 R:0.42000 P:0.28966 F:0.34286
38 ROUGE-1 Eval D0721-A.M.100.E-B.38 R:0.32000 P:0.20000 F:0.24615
38 ROUGE-1 Eval D0721-A.M.100.E-C.38 R:0.31818 P:0.20417 F:0.24873
38 ROUGE-1 Eval D0721-A.M.100.E-E.38 R:0.28571 P:0.18333 F:0.22335
38 ROUGE-1 Eval D0721-A.M.100.E-G.38 R:0.30573 P:0.20000 F:0.24181
38 ROUGE-1 Eval D0721-B.M.100.E-B.38 R:0.32573 P:0.20576 F:0.25220
38 ROUGE-1 Eval D0721-B.M.100.E-C.38 R:0.30255 P:0.19547 F:0.23750
38 ROUGE-1 Eval D0721-B.M.100.E-E.38 R:0.27869 P:0.17490 F:0.21492
38 ROUGE-1 Eval D0721-B.M.100.E-G.38 R:0.31613 P:0.20165 F:0.24623
38 ROUGE-1 Eval D0721-C.M.100.E-B.38 R:0.35410 P:0.23841 F:0.28496
38 ROUGE-1 Eval D0721-C.M.100.E-C.38 R:0.30693 P:0.20530 F:0.24603
38 ROUGE-1 Eval D0721-C.M.100.E-E.38 R:0.31667 P:0.20971 F:0.25232
38 ROUGE-1 Eval D0721-C.M.100.E-G.38 R:0.29642 P:0.20088 F:0.23947
38 ROUGE-1 Eval D0726-A.M.100.F-A.38 R:0.35880 P:0.22222 F:0.27446
38 ROUGE-1 Eval D0726-A.M.100.F-E.38 R:0.35333 P:0.21811 F:0.26972
38 ROUGE-1 Eval D0726-A.M.100.F-F.38 R:0.36213 P:0.22428 F:0.27700
38 ROUGE-1 Eval D0726-A.M.100.F-G.38 R:0.38206 P:0.23663 F:0.29225
38 ROUGE-1 Eval D0726-B.M.100.F-A.38 R:0.37255 P:0.20652 F:0.26573
38 ROUGE-1 Eval D0726-B.M.100.F-E.38 R:0.37874 P:0.20652 F:0.26729
38 ROUGE-1 Eval D0726-B.M.100.F-F.38 R:0.38870 P:0.21196 F:0.27433
38 ROUGE-1 Eval D0726-B.M.100.F-G.38 R:0.38487 P:0.21196 F:0.27337
38 ROUGE-1 Eval D0726-C.M.100.F-A.38 R:0.37000 P:0.26056 F:0.30578
38 ROUGE-1 Eval D0726-C.M.100.F-E.38 R:0.36027 P:0.25117 F:0.29599
38 ROUGE-1 Eval D0726-C.M.100.F-F.38 R:0.37627 P:0.26056 F:0.30790
38 ROUGE-1 Eval D0726-C.M.100.F-G.38 R:0.36721 P:0.26291 F:0.30643
38 ROUGE-1 Eval D0727-A.M.100.G-A.38 R:0.45847 P:0.28221 F:0.34937
38 ROUGE-1 Eval D0727-A.M.100.G-F.38 R:0.44079 P:0.27403 F:0.33796
38 ROUGE-1 Eval D0727-A.M.100.G-G.38 R:0.42157 P:0.26380 F:0.32453
38 ROUGE-1 Eval D0727-A.M.100.G-H.38 R:0.43750 P:0.27198 F:0.33543
38 ROUGE-1 Eval D0727-B.M.100.G-A.38 R:0.35739 P:0.22807 F:0.27845
38 ROUGE-1 Eval D0727-B.M.100.G-F.38 R:0.33766 P:0.22807 F:0.27225
38 ROUGE-1 Eval D0727-B.M.100.G-G.38 R:0.30796 P:0.19518 F:0.23893
38 ROUGE-1 Eval D0727-B.M.100.G-H.38 R:0.32990 P:0.21053 F:0.25703
38 ROUGE-1 Eval D0727-C.M.100.G-A.38 R:0.40065 P:0.22905 F:0.29147
38 ROUGE-1 Eval D0727-C.M.100.G-F.38 R:0.39057 P:0.21601 F:0.27817
38 ROUGE-1 Eval D0727-C.M.100.G-G.38 R:0.40264 P:0.22719 F:0.29048
38 ROUGE-1 Eval D0727-C.M.100.G-H.38 R:0.40203 P:0.22160 F:0.28571
38 ROUGE-1 Eval D0736-A.M.100.H-G.38 R:0.34050 P:0.19916 F:0.25132
38 ROUGE-1 Eval D0736-A.M.100.H-H.38 R:0.33577 P:0.19287 F:0.24501
38 ROUGE-1 Eval D0736-A.M.100.H-I.38 R:0.34520 P:0.20335 F:0.25593
38 ROUGE-1 Eval D0736-A.M.100.H-J.38 R:0.34641 P:0.22222 F:0.27075
38 ROUGE-1 Eval D0736-B.M.100.H-G.38 R:0.36641 P:0.19753 F:0.25668
38 ROUGE-1 Eval D0736-B.M.100.H-H.38 R:0.42149 P:0.20988 F:0.28022
38 ROUGE-1 Eval D0736-B.M.100.H-I.38 R:0.46025 P:0.22634 F:0.30345
38 ROUGE-1 Eval D0736-B.M.100.H-J.38 R:0.43357 P:0.25514 F:0.32124
38 ROUGE-1 Eval D0736-C.M.100.H-G.38 R:0.42616 P:0.19238 F:0.26509
38 ROUGE-1 Eval D0736-C.M.100.H-H.38 R:0.40107 P:0.14286 F:0.21068
38 ROUGE-1 Eval D0736-C.M.100.H-I.38 R:0.46524 P:0.16571 F:0.24438
38 ROUGE-1 Eval D0736-C.M.100.H-J.38 R:0.40000 P:0.20190 F:0.26835
38 ROUGE-1 Eval D0740-A.M.100.I-D.38 R:0.37294 P:0.22967 F:0.28427
38 ROUGE-1 Eval D0740-A.M.100.I-H.38 R:0.34314 P:0.21341 F:0.26316
38 ROUGE-1 Eval D0740-A.M.100.I-I.38 R:0.37013 P:0.23171 F:0.28500
38 ROUGE-1 Eval D0740-A.M.100.I-J.38 R:0.32258 P:0.20325 F:0.24937
38 ROUGE-1 Eval D0740-B.M.100.I-D.38 R:0.36688 P:0.23251 F:0.28463
38 ROUGE-1 Eval D0740-B.M.100.I-H.38 R:0.33444 P:0.20782 F:0.25635
38 ROUGE-1 Eval D0740-B.M.100.I-I.38 R:0.37049 P:0.23251 F:0.28571
38 ROUGE-1 Eval D0740-B.M.100.I-J.38 R:0.36893 P:0.23457 F:0.28679
38 ROUGE-1 Eval D0740-C.M.100.I-D.38 R:0.39936 P:0.25880 F:0.31407
38 ROUGE-1 Eval D0740-C.M.100.I-H.38 R:0.40193 P:0.25880 F:0.31486
38 ROUGE-1 Eval D0740-C.M.100.I-I.38 R:0.42492 P:0.27536 F:0.33417
38 ROUGE-1 Eval D0740-C.M.100.I-J.38 R:0.38535 P:0.25052 F:0.30364
38 ROUGE-1 Eval D0743-A.M.100.J-B.38 R:0.20635 P:0.12745 F:0.15758
38 ROUGE-1 Eval D0743-A.M.100.J-H.38 R:0.17284 P:0.10980 F:0.13429
38 ROUGE-1 Eval D0743-A.M.100.J-I.38 R:0.22500 P:0.14118 F:0.17350
38 ROUGE-1 Eval D0743-A.M.100.J-J.38 R:0.18154 P:0.11569 F:0.14132
38 ROUGE-1 Eval D0743-B.M.100.J-B.38 R:0.28205 P:0.16762 F:0.21028
38 ROUGE-1 Eval D0743-B.M.100.J-H.38 R:0.27760 P:0.16762 F:0.20903
38 ROUGE-1 Eval D0743-B.M.100.J-I.38 R:0.29747 P:0.17905 F:0.22355
38 ROUGE-1 Eval D0743-B.M.100.J-J.38 R:0.28037 P:0.17143 F:0.21277
38 ROUGE-1 Eval D0743-C.M.100.J-B.38 R:0.28254 P:0.18313 F:0.22222
38 ROUGE-1 Eval D0743-C.M.100.J-H.38 R:0.25159 P:0.16255 F:0.19750
38 ROUGE-1 Eval D0743-C.M.100.J-I.38 R:0.28435 P:0.18313 F:0.22278
38 ROUGE-1 Eval D0743-C.M.100.J-J.38 R:0.27673 P:0.18107 F:0.21891
---------------------------------------------
38 ROUGE-2 Average_R: 0.08787 (95%-conf.int. 0.08042 - 0.09557)
38 ROUGE-2 Average_P: 0.05371 (95%-conf.int. 0.04966 - 0.05828)
38 ROUGE-2 Average_F: 0.06647 (95%-conf.int. 0.06123 - 0.07205)
.............................................
38 ROUGE-2 Eval D0703-A.M.100.A-A.38 R:0.12969 P:0.08017 F:0.09909
38 ROUGE-2 Eval D0703-A.M.100.A-C.38 R:0.12203 P:0.07595 F:0.09363
38 ROUGE-2 Eval D0703-A.M.100.A-D.38 R:0.11806 P:0.07173 F:0.08924
38 ROUGE-2 Eval D0703-A.M.100.A-J.38 R:0.13402 P:0.08228 F:0.10196
38 ROUGE-2 Eval D0703-B.M.100.A-A.38 R:0.17162 P:0.10833 F:0.13282
38 ROUGE-2 Eval D0703-B.M.100.A-C.38 R:0.13220 P:0.08125 F:0.10064
38 ROUGE-2 Eval D0703-B.M.100.A-D.38 R:0.16271 P:0.10000 F:0.12387
38 ROUGE-2 Eval D0703-B.M.100.A-J.38 R:0.18792 P:0.11667 F:0.14396
38 ROUGE-2 Eval D0703-C.M.100.A-A.38 R:0.07407 P:0.04612 F:0.05685
38 ROUGE-2 Eval D0703-C.M.100.A-C.38 R:0.07541 P:0.04822 F:0.05883
38 ROUGE-2 Eval D0703-C.M.100.A-D.38 R:0.07023 P:0.04403 F:0.05413
38 ROUGE-2 Eval D0703-C.M.100.A-J.38 R:0.07023 P:0.04403 F:0.05413
38 ROUGE-2 Eval D0706-A.M.100.B-B.38 R:0.12131 P:0.07757 F:0.09463
38 ROUGE-2 Eval D0706-A.M.100.B-D.38 R:0.11881 P:0.07547 F:0.09231
38 ROUGE-2 Eval D0706-A.M.100.B-E.38 R:0.06230 P:0.03983 F:0.04859
38 ROUGE-2 Eval D0706-A.M.100.B-I.38 R:0.11148 P:0.07128 F:0.08696
38 ROUGE-2 Eval D0706-B.M.100.B-B.38 R:0.08911 P:0.06122 F:0.07258
38 ROUGE-2 Eval D0706-B.M.100.B-D.38 R:0.08224 P:0.05669 F:0.06712
38 ROUGE-2 Eval D0706-B.M.100.B-E.38 R:0.06885 P:0.04762 F:0.05630
38 ROUGE-2 Eval D0706-B.M.100.B-I.38 R:0.09477 P:0.06576 F:0.07764
38 ROUGE-2 Eval D0706-C.M.100.B-B.38 R:0.10749 P:0.06433 F:0.08049
38 ROUGE-2 Eval D0706-C.M.100.B-D.38 R:0.13029 P:0.07797 F:0.09756
38 ROUGE-2 Eval D0706-C.M.100.B-E.38 R:0.08091 P:0.04873 F:0.06083
38 ROUGE-2 Eval D0706-C.M.100.B-I.38 R:0.12903 P:0.07797 F:0.09720
38 ROUGE-2 Eval D0711-A.M.100.C-A.38 R:0.06312 P:0.04113 F:0.04981
38 ROUGE-2 Eval D0711-A.M.100.C-B.38 R:0.06734 P:0.04329 F:0.05270
38 ROUGE-2 Eval D0711-A.M.100.C-C.38 R:0.07744 P:0.04978 F:0.06060
38 ROUGE-2 Eval D0711-A.M.100.C-F.38 R:0.07358 P:0.04762 F:0.05782
38 ROUGE-2 Eval D0711-B.M.100.C-A.38 R:0.02749 P:0.01616 F:0.02035
38 ROUGE-2 Eval D0711-B.M.100.C-B.38 R:0.05536 P:0.03232 F:0.04081
38 ROUGE-2 Eval D0711-B.M.100.C-C.38 R:0.05085 P:0.03030 F:0.03797
38 ROUGE-2 Eval D0711-B.M.100.C-F.38 R:0.03082 P:0.01818 F:0.02287
38 ROUGE-2 Eval D0711-C.M.100.C-A.38 R:0.06000 P:0.04000 F:0.04800
38 ROUGE-2 Eval D0711-C.M.100.C-B.38 R:0.06552 P:0.04222 F:0.05135
38 ROUGE-2 Eval D0711-C.M.100.C-C.38 R:0.04778 P:0.03111 F:0.03768
38 ROUGE-2 Eval D0711-C.M.100.C-F.38 R:0.03072 P:0.02000 F:0.02423
38 ROUGE-2 Eval D0716-A.M.100.D-C.38 R:0.13245 P:0.08386 F:0.10270
38 ROUGE-2 Eval D0716-A.M.100.D-D.38 R:0.10774 P:0.06709 F:0.08269
38 ROUGE-2 Eval D0716-A.M.100.D-E.38 R:0.15101 P:0.09434 F:0.11613
38 ROUGE-2 Eval D0716-A.M.100.D-F.38 R:0.12000 P:0.07547 F:0.09266
38 ROUGE-2 Eval D0716-B.M.100.D-C.38 R:0.12625 P:0.08225 F:0.09961
38 ROUGE-2 Eval D0716-B.M.100.D-D.38 R:0.15593 P:0.09957 F:0.12153
38 ROUGE-2 Eval D0716-B.M.100.D-E.38 R:0.11074 P:0.07143 F:0.08684
38 ROUGE-2 Eval D0716-B.M.100.D-F.38 R:0.15152 P:0.09740 F:0.11858
38 ROUGE-2 Eval D0716-C.M.100.D-C.38 R:0.11184 P:0.07870 F:0.09239
38 ROUGE-2 Eval D0716-C.M.100.D-D.38 R:0.09797 P:0.06713 F:0.07967
38 ROUGE-2 Eval D0716-C.M.100.D-E.38 R:0.09333 P:0.06481 F:0.07650
38 ROUGE-2 Eval D0716-C.M.100.D-F.38 R:0.10774 P:0.07407 F:0.08779
38 ROUGE-2 Eval D0721-A.M.100.E-B.38 R:0.05387 P:0.03354 F:0.04134
38 ROUGE-2 Eval D0721-A.M.100.E-C.38 R:0.06230 P:0.03983 F:0.04859
38 ROUGE-2 Eval D0721-A.M.100.E-E.38 R:0.04918 P:0.03145 F:0.03837
38 ROUGE-2 Eval D0721-A.M.100.E-G.38 R:0.06109 P:0.03983 F:0.04822
38 ROUGE-2 Eval D0721-B.M.100.E-B.38 R:0.04934 P:0.03106 F:0.03812
38 ROUGE-2 Eval D0721-B.M.100.E-C.38 R:0.05466 P:0.03520 F:0.04282
38 ROUGE-2 Eval D0721-B.M.100.E-E.38 R:0.04305 P:0.02692 F:0.03313
38 ROUGE-2 Eval D0721-B.M.100.E-G.38 R:0.04886 P:0.03106 F:0.03798
38 ROUGE-2 Eval D0721-C.M.100.E-B.38 R:0.07285 P:0.04889 F:0.05851
38 ROUGE-2 Eval D0721-C.M.100.E-C.38 R:0.04667 P:0.03111 F:0.03733
38 ROUGE-2 Eval D0721-C.M.100.E-E.38 R:0.06734 P:0.04444 F:0.05354
38 ROUGE-2 Eval D0721-C.M.100.E-G.38 R:0.05263 P:0.03556 F:0.04244
38 ROUGE-2 Eval D0726-A.M.100.F-A.38 R:0.07047 P:0.04348 F:0.05378
38 ROUGE-2 Eval D0726-A.M.100.F-E.38 R:0.09764 P:0.06004 F:0.07436
38 ROUGE-2 Eval D0726-A.M.100.F-F.38 R:0.08054 P:0.04969 F:0.06146
38 ROUGE-2 Eval D0726-A.M.100.F-G.38 R:0.09396 P:0.05797 F:0.07170
38 ROUGE-2 Eval D0726-B.M.100.F-A.38 R:0.06931 P:0.03825 F:0.04930
38 ROUGE-2 Eval D0726-B.M.100.F-E.38 R:0.07383 P:0.04007 F:0.05195
38 ROUGE-2 Eval D0726-B.M.100.F-F.38 R:0.07383 P:0.04007 F:0.05195
38 ROUGE-2 Eval D0726-B.M.100.F-G.38 R:0.07309 P:0.04007 F:0.05176
38 ROUGE-2 Eval D0726-C.M.100.F-A.38 R:0.08754 P:0.06147 F:0.07222
38 ROUGE-2 Eval D0726-C.M.100.F-E.38 R:0.06122 P:0.04255 F:0.05021
38 ROUGE-2 Eval D0726-C.M.100.F-F.38 R:0.07534 P:0.05201 F:0.06154
38 ROUGE-2 Eval D0726-C.M.100.F-G.38 R:0.06954 P:0.04965 F:0.05794
38 ROUGE-2 Eval D0727-A.M.100.G-A.38 R:0.11409 P:0.06996 F:0.08673
38 ROUGE-2 Eval D0727-A.M.100.G-F.38 R:0.08970 P:0.05556 F:0.06862
38 ROUGE-2 Eval D0727-A.M.100.G-G.38 R:0.08911 P:0.05556 F:0.06844
38 ROUGE-2 Eval D0727-A.M.100.G-H.38 R:0.08638 P:0.05350 F:0.06608
38 ROUGE-2 Eval D0727-B.M.100.G-A.38 R:0.05208 P:0.03311 F:0.04048
38 ROUGE-2 Eval D0727-B.M.100.G-F.38 R:0.06230 P:0.04194 F:0.05013
38 ROUGE-2 Eval D0727-B.M.100.G-G.38 R:0.03497 P:0.02208 F:0.02707
38 ROUGE-2 Eval D0727-B.M.100.G-H.38 R:0.04514 P:0.02870 F:0.03509
38 ROUGE-2 Eval D0727-C.M.100.G-A.38 R:0.08224 P:0.04682 F:0.05967
38 ROUGE-2 Eval D0727-C.M.100.G-F.38 R:0.08503 P:0.04682 F:0.06039
38 ROUGE-2 Eval D0727-C.M.100.G-G.38 R:0.09000 P:0.05056 F:0.06475
38 ROUGE-2 Eval D0727-C.M.100.G-H.38 R:0.09556 P:0.05243 F:0.06771
38 ROUGE-2 Eval D0736-A.M.100.H-G.38 R:0.08696 P:0.05063 F:0.06400
38 ROUGE-2 Eval D0736-A.M.100.H-H.38 R:0.04428 P:0.02532 F:0.03222
38 ROUGE-2 Eval D0736-A.M.100.H-I.38 R:0.06835 P:0.04008 F:0.05053
38 ROUGE-2 Eval D0736-A.M.100.H-J.38 R:0.07591 P:0.04852 F:0.05920
38 ROUGE-2 Eval D0736-B.M.100.H-G.38 R:0.06950 P:0.03727 F:0.04852
38 ROUGE-2 Eval D0736-B.M.100.H-H.38 R:0.16318 P:0.08075 F:0.10804
38 ROUGE-2 Eval D0736-B.M.100.H-I.38 R:0.18220 P:0.08903 F:0.11961
38 ROUGE-2 Eval D0736-B.M.100.H-J.38 R:0.16608 P:0.09731 F:0.12272
38 ROUGE-2 Eval D0736-C.M.100.H-G.38 R:0.17521 P:0.07854 F:0.10846
38 ROUGE-2 Eval D0736-C.M.100.H-H.38 R:0.13043 P:0.04598 F:0.06799
38 ROUGE-2 Eval D0736-C.M.100.H-I.38 R:0.19022 P:0.06705 F:0.09915
38 ROUGE-2 Eval D0736-C.M.100.H-J.38 R:0.14504 P:0.07280 F:0.09694
38 ROUGE-2 Eval D0740-A.M.100.I-D.38 R:0.12000 P:0.07362 F:0.09126
38 ROUGE-2 Eval D0740-A.M.100.I-H.38 R:0.08251 P:0.05112 F:0.06313
38 ROUGE-2 Eval D0740-A.M.100.I-I.38 R:0.12131 P:0.07566 F:0.09320
38 ROUGE-2 Eval D0740-A.M.100.I-J.38 R:0.09121 P:0.05726 F:0.07035
38 ROUGE-2 Eval D0740-B.M.100.I-D.38 R:0.07869 P:0.04969 F:0.06091
38 ROUGE-2 Eval D0740-B.M.100.I-H.38 R:0.07358 P:0.04555 F:0.05627
38 ROUGE-2 Eval D0740-B.M.100.I-I.38 R:0.06623 P:0.04141 F:0.05096
38 ROUGE-2 Eval D0740-B.M.100.I-J.38 R:0.07843 P:0.04969 F:0.06084
38 ROUGE-2 Eval D0740-C.M.100.I-D.38 R:0.15484 P:0.10000 F:0.12152
38 ROUGE-2 Eval D0740-C.M.100.I-H.38 R:0.15909 P:0.10208 F:0.12436
38 ROUGE-2 Eval D0740-C.M.100.I-I.38 R:0.19355 P:0.12500 F:0.15190
38 ROUGE-2 Eval D0740-C.M.100.I-J.38 R:0.13183 P:0.08542 F:0.10367
38 ROUGE-2 Eval D0743-A.M.100.J-B.38 R:0.03205 P:0.01972 F:0.02442
38 ROUGE-2 Eval D0743-A.M.100.J-H.38 R:0.01246 P:0.00789 F:0.00966
38 ROUGE-2 Eval D0743-A.M.100.J-I.38 R:0.02839 P:0.01775 F:0.02184
38 ROUGE-2 Eval D0743-A.M.100.J-J.38 R:0.02174 P:0.01381 F:0.01689
38 ROUGE-2 Eval D0743-B.M.100.J-B.38 R:0.03883 P:0.02299 F:0.02888
38 ROUGE-2 Eval D0743-B.M.100.J-H.38 R:0.03185 P:0.01916 F:0.02393
38 ROUGE-2 Eval D0743-B.M.100.J-I.38 R:0.03834 P:0.02299 F:0.02874
38 ROUGE-2 Eval D0743-B.M.100.J-J.38 R:0.03459 P:0.02107 F:0.02619
38 ROUGE-2 Eval D0743-C.M.100.J-B.38 R:0.03846 P:0.02484 F:0.03018
38 ROUGE-2 Eval D0743-C.M.100.J-H.38 R:0.02894 P:0.01863 F:0.02267
38 ROUGE-2 Eval D0743-C.M.100.J-I.38 R:0.04194 P:0.02692 F:0.03279
38 ROUGE-2 Eval D0743-C.M.100.J-J.38 R:0.03492 P:0.02277 F:0.02757
---------------------------------------------
38 ROUGE-3 Average_R: 0.03463 (95%-conf.int. 0.02970 - 0.04017)
38 ROUGE-3 Average_P: 0.02093 (95%-conf.int. 0.01814 - 0.02406)
38 ROUGE-3 Average_F: 0.02599 (95%-conf.int. 0.02243 - 0.02999)
.............................................
38 ROUGE-3 Eval D0703-A.M.100.A-A.38 R:0.05172 P:0.03185 F:0.03942
38 ROUGE-3 Eval D0703-A.M.100.A-C.38 R:0.04110 P:0.02548 F:0.03146
38 ROUGE-3 Eval D0703-A.M.100.A-D.38 R:0.04211 P:0.02548 F:0.03175
38 ROUGE-3 Eval D0703-A.M.100.A-J.38 R:0.04167 P:0.02548 F:0.03162
38 ROUGE-3 Eval D0703-B.M.100.A-A.38 R:0.10000 P:0.06289 F:0.07722
38 ROUGE-3 Eval D0703-B.M.100.A-C.38 R:0.05137 P:0.03145 F:0.03901
38 ROUGE-3 Eval D0703-B.M.100.A-D.38 R:0.08562 P:0.05241 F:0.06502
38 ROUGE-3 Eval D0703-B.M.100.A-J.38 R:0.10847 P:0.06709 F:0.08290
38 ROUGE-3 Eval D0703-C.M.100.A-A.38 R:0.01701 P:0.01055 F:0.01302
38 ROUGE-3 Eval D0703-C.M.100.A-C.38 R:0.01987 P:0.01266 F:0.01547
38 ROUGE-3 Eval D0703-C.M.100.A-D.38 R:0.01014 P:0.00633 F:0.00779
38 ROUGE-3 Eval D0703-C.M.100.A-J.38 R:0.01351 P:0.00844 F:0.01039
38 ROUGE-3 Eval D0706-A.M.100.B-B.38 R:0.05629 P:0.03586 F:0.04381
38 ROUGE-3 Eval D0706-A.M.100.B-D.38 R:0.06333 P:0.04008 F:0.04909
38 ROUGE-3 Eval D0706-A.M.100.B-E.38 R:0.00662 P:0.00422 F:0.00515
38 ROUGE-3 Eval D0706-A.M.100.B-I.38 R:0.06291 P:0.04008 F:0.04896
38 ROUGE-3 Eval D0706-B.M.100.B-B.38 R:0.03667 P:0.02511 F:0.02981
38 ROUGE-3 Eval D0706-B.M.100.B-D.38 R:0.02658 P:0.01826 F:0.02165
38 ROUGE-3 Eval D0706-B.M.100.B-E.38 R:0.02318 P:0.01598 F:0.01892
38 ROUGE-3 Eval D0706-B.M.100.B-I.38 R:0.04290 P:0.02968 F:0.03509
38 ROUGE-3 Eval D0706-C.M.100.B-B.38 R:0.05263 P:0.03137 F:0.03931
38 ROUGE-3 Eval D0706-C.M.100.B-D.38 R:0.06579 P:0.03922 F:0.04914
38 ROUGE-3 Eval D0706-C.M.100.B-E.38 R:0.01634 P:0.00980 F:0.01225
38 ROUGE-3 Eval D0706-C.M.100.B-I.38 R:0.06189 P:0.03725 F:0.04651
38 ROUGE-3 Eval D0711-A.M.100.C-A.38 R:0.02349 P:0.01525 F:0.01849
38 ROUGE-3 Eval D0711-A.M.100.C-B.38 R:0.01701 P:0.01089 F:0.01328
38 ROUGE-3 Eval D0711-A.M.100.C-C.38 R:0.03061 P:0.01961 F:0.02391
38 ROUGE-3 Eval D0711-A.M.100.C-F.38 R:0.03041 P:0.01961 F:0.02384
38 ROUGE-3 Eval D0711-B.M.100.C-A.38 R:0.00347 P:0.00203 F:0.00256
38 ROUGE-3 Eval D0711-B.M.100.C-B.38 R:0.01399 P:0.00813 F:0.01028
38 ROUGE-3 Eval D0711-B.M.100.C-C.38 R:0.01370 P:0.00813 F:0.01020
38 ROUGE-3 Eval D0711-B.M.100.C-F.38 R:0.01038 P:0.00610 F:0.00768
38 ROUGE-3 Eval D0711-C.M.100.C-A.38 R:0.03030 P:0.02013 F:0.02419
38 ROUGE-3 Eval D0711-C.M.100.C-B.38 R:0.03136 P:0.02013 F:0.02452
38 ROUGE-3 Eval D0711-C.M.100.C-C.38 R:0.02414 P:0.01566 F:0.01900
38 ROUGE-3 Eval D0711-C.M.100.C-F.38 R:0.00690 P:0.00447 F:0.00543
38 ROUGE-3 Eval D0716-A.M.100.D-C.38 R:0.03679 P:0.02321 F:0.02846
38 ROUGE-3 Eval D0716-A.M.100.D-D.38 R:0.02041 P:0.01266 F:0.01563
38 ROUGE-3 Eval D0716-A.M.100.D-E.38 R:0.04407 P:0.02743 F:0.03381
38 ROUGE-3 Eval D0716-A.M.100.D-F.38 R:0.04040 P:0.02532 F:0.03113
38 ROUGE-3 Eval D0716-B.M.100.D-C.38 R:0.05369 P:0.03486 F:0.04227
38 ROUGE-3 Eval D0716-B.M.100.D-D.38 R:0.07877 P:0.05011 F:0.06125
38 ROUGE-3 Eval D0716-B.M.100.D-E.38 R:0.05085 P:0.03268 F:0.03979
38 ROUGE-3 Eval D0716-B.M.100.D-F.38 R:0.08163 P:0.05229 F:0.06375
38 ROUGE-3 Eval D0716-C.M.100.D-C.38 R:0.05316 P:0.03730 F:0.04384
38 ROUGE-3 Eval D0716-C.M.100.D-D.38 R:0.04437 P:0.03030 F:0.03601
38 ROUGE-3 Eval D0716-C.M.100.D-E.38 R:0.02020 P:0.01399 F:0.01653
38 ROUGE-3 Eval D0716-C.M.100.D-F.38 R:0.05442 P:0.03730 F:0.04426
38 ROUGE-3 Eval D0721-A.M.100.E-B.38 R:0.02381 P:0.01477 F:0.01823
38 ROUGE-3 Eval D0721-A.M.100.E-C.38 R:0.02980 P:0.01899 F:0.02320
38 ROUGE-3 Eval D0721-A.M.100.E-E.38 R:0.01656 P:0.01055 F:0.01289
38 ROUGE-3 Eval D0721-A.M.100.E-G.38 R:0.02922 P:0.01899 F:0.02302
38 ROUGE-3 Eval D0721-B.M.100.E-B.38 R:0.00664 P:0.00417 F:0.00512
38 ROUGE-3 Eval D0721-B.M.100.E-C.38 R:0.01299 P:0.00833 F:0.01015
38 ROUGE-3 Eval D0721-B.M.100.E-E.38 R:0.01003 P:0.00625 F:0.00770
38 ROUGE-3 Eval D0721-B.M.100.E-G.38 R:0.00987 P:0.00625 F:0.00765
38 ROUGE-3 Eval D0721-C.M.100.E-B.38 R:0.02676 P:0.01790 F:0.02145
38 ROUGE-3 Eval D0721-C.M.100.E-C.38 R:0.01010 P:0.00671 F:0.00806
38 ROUGE-3 Eval D0721-C.M.100.E-E.38 R:0.02721 P:0.01790 F:0.02159
38 ROUGE-3 Eval D0721-C.M.100.E-G.38 R:0.01661 P:0.01119 F:0.01337
38 ROUGE-3 Eval D0726-A.M.100.F-A.38 R:0.01695 P:0.01042 F:0.01291
38 ROUGE-3 Eval D0726-A.M.100.F-E.38 R:0.03061 P:0.01875 F:0.02326
38 ROUGE-3 Eval D0726-A.M.100.F-F.38 R:0.02034 P:0.01250 F:0.01548
38 ROUGE-3 Eval D0726-A.M.100.F-G.38 R:0.02373 P:0.01458 F:0.01806
38 ROUGE-3 Eval D0726-B.M.100.F-A.38 R:0.01333 P:0.00733 F:0.00946
38 ROUGE-3 Eval D0726-B.M.100.F-E.38 R:0.01017 P:0.00549 F:0.00713
38 ROUGE-3 Eval D0726-B.M.100.F-F.38 R:0.01695 P:0.00916 F:0.01189
38 ROUGE-3 Eval D0726-B.M.100.F-G.38 R:0.01007 P:0.00549 F:0.00711
38 ROUGE-3 Eval D0726-C.M.100.F-A.38 R:0.04082 P:0.02857 F:0.03361
38 ROUGE-3 Eval D0726-C.M.100.F-E.38 R:0.01718 P:0.01190 F:0.01406
38 ROUGE-3 Eval D0726-C.M.100.F-F.38 R:0.03460 P:0.02381 F:0.02821
38 ROUGE-3 Eval D0726-C.M.100.F-G.38 R:0.03010 P:0.02143 F:0.02504
38 ROUGE-3 Eval D0727-A.M.100.G-A.38 R:0.02712 P:0.01656 F:0.02056
38 ROUGE-3 Eval D0727-A.M.100.G-F.38 R:0.02013 P:0.01242 F:0.01536
38 ROUGE-3 Eval D0727-A.M.100.G-G.38 R:0.02667 P:0.01656 F:0.02043
38 ROUGE-3 Eval D0727-A.M.100.G-H.38 R:0.02685 P:0.01656 F:0.02049
38 ROUGE-3 Eval D0727-B.M.100.G-A.38 R:0.02105 P:0.01333 F:0.01632
38 ROUGE-3 Eval D0727-B.M.100.G-F.38 R:0.02318 P:0.01556 F:0.01862
38 ROUGE-3 Eval D0727-B.M.100.G-G.38 R:0.01060 P:0.00667 F:0.00819
38 ROUGE-3 Eval D0727-B.M.100.G-H.38 R:0.01754 P:0.01111 F:0.01360
38 ROUGE-3 Eval D0727-C.M.100.G-A.38 R:0.01661 P:0.00942 F:0.01202
38 ROUGE-3 Eval D0727-C.M.100.G-F.38 R:0.01375 P:0.00753 F:0.00973
38 ROUGE-3 Eval D0727-C.M.100.G-G.38 R:0.01684 P:0.00942 F:0.01208
38 ROUGE-3 Eval D0727-C.M.100.G-H.38 R:0.01379 P:0.00753 F:0.00974
38 ROUGE-3 Eval D0736-A.M.100.H-G.38 R:0.03663 P:0.02123 F:0.02688
38 ROUGE-3 Eval D0736-A.M.100.H-H.38 R:0.01866 P:0.01062 F:0.01354
38 ROUGE-3 Eval D0736-A.M.100.H-I.38 R:0.02545 P:0.01486 F:0.01876
38 ROUGE-3 Eval D0736-A.M.100.H-J.38 R:0.02667 P:0.01699 F:0.02076
38 ROUGE-3 Eval D0736-B.M.100.H-G.38 R:0.02344 P:0.01250 F:0.01630
38 ROUGE-3 Eval D0736-B.M.100.H-H.38 R:0.11864 P:0.05833 F:0.07821
38 ROUGE-3 Eval D0736-B.M.100.H-I.38 R:0.12876 P:0.06250 F:0.08415
38 ROUGE-3 Eval D0736-B.M.100.H-J.38 R:0.11429 P:0.06667 F:0.08421
38 ROUGE-3 Eval D0736-C.M.100.H-G.38 R:0.10390 P:0.04624 F:0.06400
38 ROUGE-3 Eval D0736-C.M.100.H-H.38 R:0.05525 P:0.01927 F:0.02857
38 ROUGE-3 Eval D0736-C.M.100.H-I.38 R:0.10497 P:0.03661 F:0.05429
38 ROUGE-3 Eval D0736-C.M.100.H-J.38 R:0.07336 P:0.03661 F:0.04884
38 ROUGE-3 Eval D0740-A.M.100.I-D.38 R:0.06061 P:0.03704 F:0.04598
38 ROUGE-3 Eval D0740-A.M.100.I-H.38 R:0.02667 P:0.01646 F:0.02036
38 ROUGE-3 Eval D0740-A.M.100.I-I.38 R:0.05960 P:0.03704 F:0.04569
38 ROUGE-3 Eval D0740-A.M.100.I-J.38 R:0.04276 P:0.02675 F:0.03291
38 ROUGE-3 Eval D0740-B.M.100.I-D.38 R:0.02649 P:0.01667 F:0.02046
38 ROUGE-3 Eval D0740-B.M.100.I-H.38 R:0.02703 P:0.01667 F:0.02062
38 ROUGE-3 Eval D0740-B.M.100.I-I.38 R:0.01672 P:0.01042 F:0.01284
38 ROUGE-3 Eval D0740-B.M.100.I-J.38 R:0.02970 P:0.01875 F:0.02299
38 ROUGE-3 Eval D0740-C.M.100.I-D.38 R:0.09121 P:0.05870 F:0.07143
38 ROUGE-3 Eval D0740-C.M.100.I-H.38 R:0.07869 P:0.05031 F:0.06138
38 ROUGE-3 Eval D0740-C.M.100.I-I.38 R:0.10749 P:0.06918 F:0.08418
38 ROUGE-3 Eval D0740-C.M.100.I-J.38 R:0.05519 P:0.03564 F:0.04331
38 ROUGE-3 Eval D0743-A.M.100.J-B.38 R:0.00324 P:0.00198 F:0.00246
38 ROUGE-3 Eval D0743-A.M.100.J-H.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-3 Eval D0743-A.M.100.J-I.38 R:0.00318 P:0.00198 F:0.00244
38 ROUGE-3 Eval D0743-A.M.100.J-J.38 R:0.00313 P:0.00198 F:0.00243
38 ROUGE-3 Eval D0743-B.M.100.J-B.38 R:0.00327 P:0.00193 F:0.00243
38 ROUGE-3 Eval D0743-B.M.100.J-H.38 R:0.00322 P:0.00193 F:0.00241
38 ROUGE-3 Eval D0743-B.M.100.J-I.38 R:0.00645 P:0.00385 F:0.00482
38 ROUGE-3 Eval D0743-B.M.100.J-J.38 R:0.00635 P:0.00385 F:0.00479
38 ROUGE-3 Eval D0743-C.M.100.J-B.38 R:0.00324 P:0.00208 F:0.00253
38 ROUGE-3 Eval D0743-C.M.100.J-H.38 R:0.00649 P:0.00417 F:0.00508
38 ROUGE-3 Eval D0743-C.M.100.J-I.38 R:0.00977 P:0.00625 F:0.00762
38 ROUGE-3 Eval D0743-C.M.100.J-J.38 R:0.00962 P:0.00625 F:0.00758
---------------------------------------------
38 ROUGE-4 Average_R: 0.01883 (95%-conf.int. 0.01504 - 0.02312)
38 ROUGE-4 Average_P: 0.01119 (95%-conf.int. 0.00906 - 0.01362)
38 ROUGE-4 Average_F: 0.01397 (95%-conf.int. 0.01135 - 0.01705)
.............................................
38 ROUGE-4 Eval D0703-A.M.100.A-A.38 R:0.02439 P:0.01496 F:0.01855
38 ROUGE-4 Eval D0703-A.M.100.A-C.38 R:0.01730 P:0.01068 F:0.01321
38 ROUGE-4 Eval D0703-A.M.100.A-D.38 R:0.02128 P:0.01282 F:0.01600
38 ROUGE-4 Eval D0703-A.M.100.A-J.38 R:0.01053 P:0.00641 F:0.00797
38 ROUGE-4 Eval D0703-B.M.100.A-A.38 R:0.06734 P:0.04219 F:0.05188
38 ROUGE-4 Eval D0703-B.M.100.A-C.38 R:0.02076 P:0.01266 F:0.01573
38 ROUGE-4 Eval D0703-B.M.100.A-D.38 R:0.05536 P:0.03376 F:0.04194
38 ROUGE-4 Eval D0703-B.M.100.A-J.38 R:0.07192 P:0.04430 F:0.05483
38 ROUGE-4 Eval D0703-C.M.100.A-A.38 R:0.00344 P:0.00212 F:0.00262
38 ROUGE-4 Eval D0703-C.M.100.A-C.38 R:0.00334 P:0.00212 F:0.00259
38 ROUGE-4 Eval D0703-C.M.100.A-D.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0703-C.M.100.A-J.38 R:0.00341 P:0.00212 F:0.00261
38 ROUGE-4 Eval D0706-A.M.100.B-B.38 R:0.04348 P:0.02760 F:0.03377
38 ROUGE-4 Eval D0706-A.M.100.B-D.38 R:0.04714 P:0.02972 F:0.03646
38 ROUGE-4 Eval D0706-A.M.100.B-E.38 R:0.00334 P:0.00212 F:0.00259
38 ROUGE-4 Eval D0706-A.M.100.B-I.38 R:0.04682 P:0.02972 F:0.03636
38 ROUGE-4 Eval D0706-B.M.100.B-B.38 R:0.02694 P:0.01839 F:0.02186
38 ROUGE-4 Eval D0706-B.M.100.B-D.38 R:0.01678 P:0.01149 F:0.01364
38 ROUGE-4 Eval D0706-B.M.100.B-E.38 R:0.01003 P:0.00690 F:0.00818
38 ROUGE-4 Eval D0706-B.M.100.B-I.38 R:0.02667 P:0.01839 F:0.02177
38 ROUGE-4 Eval D0706-C.M.100.B-B.38 R:0.03987 P:0.02367 F:0.02970
38 ROUGE-4 Eval D0706-C.M.100.B-D.38 R:0.04651 P:0.02761 F:0.03465
38 ROUGE-4 Eval D0706-C.M.100.B-E.38 R:0.00660 P:0.00394 F:0.00493
38 ROUGE-4 Eval D0706-C.M.100.B-I.38 R:0.04605 P:0.02761 F:0.03452
38 ROUGE-4 Eval D0711-A.M.100.C-A.38 R:0.01356 P:0.00877 F:0.01065
38 ROUGE-4 Eval D0711-A.M.100.C-B.38 R:0.00344 P:0.00219 F:0.00268
38 ROUGE-4 Eval D0711-A.M.100.C-C.38 R:0.01718 P:0.01096 F:0.01338
38 ROUGE-4 Eval D0711-A.M.100.C-F.38 R:0.01706 P:0.01096 F:0.01335
38 ROUGE-4 Eval D0711-B.M.100.C-A.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0711-B.M.100.C-B.38 R:0.00353 P:0.00204 F:0.00259
38 ROUGE-4 Eval D0711-B.M.100.C-C.38 R:0.00346 P:0.00204 F:0.00257
38 ROUGE-4 Eval D0711-B.M.100.C-F.38 R:0.00350 P:0.00204 F:0.00258
38 ROUGE-4 Eval D0711-C.M.100.C-A.38 R:0.01701 P:0.01126 F:0.01355
38 ROUGE-4 Eval D0711-C.M.100.C-B.38 R:0.01761 P:0.01126 F:0.01374
38 ROUGE-4 Eval D0711-C.M.100.C-C.38 R:0.01394 P:0.00901 F:0.01095
38 ROUGE-4 Eval D0711-C.M.100.C-F.38 R:0.00348 P:0.00225 F:0.00273
38 ROUGE-4 Eval D0716-A.M.100.D-C.38 R:0.01014 P:0.00637 F:0.00782
38 ROUGE-4 Eval D0716-A.M.100.D-D.38 R:0.00344 P:0.00212 F:0.00262
38 ROUGE-4 Eval D0716-A.M.100.D-E.38 R:0.01370 P:0.00849 F:0.01048
38 ROUGE-4 Eval D0716-A.M.100.D-F.38 R:0.01361 P:0.00849 F:0.01046
38 ROUGE-4 Eval D0716-B.M.100.D-C.38 R:0.02373 P:0.01535 F:0.01864
38 ROUGE-4 Eval D0716-B.M.100.D-D.38 R:0.04152 P:0.02632 F:0.03222
38 ROUGE-4 Eval D0716-B.M.100.D-E.38 R:0.02740 P:0.01754 F:0.02139
38 ROUGE-4 Eval D0716-B.M.100.D-F.38 R:0.04124 P:0.02632 F:0.03213
38 ROUGE-4 Eval D0716-C.M.100.D-C.38 R:0.03691 P:0.02582 F:0.03038
38 ROUGE-4 Eval D0716-C.M.100.D-D.38 R:0.03448 P:0.02347 F:0.02793
38 ROUGE-4 Eval D0716-C.M.100.D-E.38 R:0.00340 P:0.00235 F:0.00278
38 ROUGE-4 Eval D0716-C.M.100.D-F.38 R:0.03780 P:0.02582 F:0.03068
38 ROUGE-4 Eval D0721-A.M.100.E-B.38 R:0.01031 P:0.00637 F:0.00787
38 ROUGE-4 Eval D0721-A.M.100.E-C.38 R:0.01338 P:0.00849 F:0.01039
38 ROUGE-4 Eval D0721-A.M.100.E-E.38 R:0.00334 P:0.00212 F:0.00259
38 ROUGE-4 Eval D0721-A.M.100.E-G.38 R:0.01311 P:0.00849 F:0.01031
38 ROUGE-4 Eval D0721-B.M.100.E-B.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0721-B.M.100.E-C.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0721-B.M.100.E-E.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0721-B.M.100.E-G.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0721-C.M.100.E-B.38 R:0.01351 P:0.00901 F:0.01081
38 ROUGE-4 Eval D0721-C.M.100.E-C.38 R:0.00340 P:0.00225 F:0.00271
38 ROUGE-4 Eval D0721-C.M.100.E-E.38 R:0.01375 P:0.00901 F:0.01089
38 ROUGE-4 Eval D0721-C.M.100.E-G.38 R:0.01007 P:0.00676 F:0.00809
38 ROUGE-4 Eval D0726-A.M.100.F-A.38 R:0.01027 P:0.00629 F:0.00780
38 ROUGE-4 Eval D0726-A.M.100.F-E.38 R:0.01718 P:0.01048 F:0.01302
38 ROUGE-4 Eval D0726-A.M.100.F-F.38 R:0.01027 P:0.00629 F:0.00780
38 ROUGE-4 Eval D0726-A.M.100.F-G.38 R:0.01370 P:0.00839 F:0.01041
38 ROUGE-4 Eval D0726-B.M.100.F-A.38 R:0.00337 P:0.00184 F:0.00238
38 ROUGE-4 Eval D0726-B.M.100.F-E.38 R:0.00342 P:0.00184 F:0.00239
38 ROUGE-4 Eval D0726-B.M.100.F-F.38 R:0.00342 P:0.00184 F:0.00239
38 ROUGE-4 Eval D0726-B.M.100.F-G.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0726-C.M.100.F-A.38 R:0.01375 P:0.00959 F:0.01130
38 ROUGE-4 Eval D0726-C.M.100.F-E.38 R:0.00347 P:0.00240 F:0.00284
38 ROUGE-4 Eval D0726-C.M.100.F-F.38 R:0.01399 P:0.00959 F:0.01138
38 ROUGE-4 Eval D0726-C.M.100.F-G.38 R:0.01014 P:0.00719 F:0.00841
38 ROUGE-4 Eval D0727-A.M.100.G-A.38 R:0.01027 P:0.00625 F:0.00777
38 ROUGE-4 Eval D0727-A.M.100.G-F.38 R:0.00678 P:0.00417 F:0.00516
38 ROUGE-4 Eval D0727-A.M.100.G-G.38 R:0.01010 P:0.00625 F:0.00772
38 ROUGE-4 Eval D0727-A.M.100.G-H.38 R:0.01356 P:0.00833 F:0.01032
38 ROUGE-4 Eval D0727-B.M.100.G-A.38 R:0.00709 P:0.00447 F:0.00548
38 ROUGE-4 Eval D0727-B.M.100.G-F.38 R:0.00669 P:0.00447 F:0.00536
38 ROUGE-4 Eval D0727-B.M.100.G-G.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0727-B.M.100.G-H.38 R:0.00709 P:0.00447 F:0.00548
38 ROUGE-4 Eval D0727-C.M.100.G-A.38 R:0.00336 P:0.00189 F:0.00242
38 ROUGE-4 Eval D0727-C.M.100.G-F.38 R:0.00347 P:0.00189 F:0.00245
38 ROUGE-4 Eval D0727-C.M.100.G-G.38 R:0.00340 P:0.00189 F:0.00243
38 ROUGE-4 Eval D0727-C.M.100.G-H.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0736-A.M.100.H-G.38 R:0.01111 P:0.00641 F:0.00813
38 ROUGE-4 Eval D0736-A.M.100.H-H.38 R:0.00755 P:0.00427 F:0.00545
38 ROUGE-4 Eval D0736-A.M.100.H-I.38 R:0.00735 P:0.00427 F:0.00540
38 ROUGE-4 Eval D0736-A.M.100.H-J.38 R:0.00673 P:0.00427 F:0.00522
38 ROUGE-4 Eval D0736-B.M.100.H-G.38 R:0.01581 P:0.00839 F:0.01096
38 ROUGE-4 Eval D0736-B.M.100.H-H.38 R:0.09871 P:0.04822 F:0.06479
38 ROUGE-4 Eval D0736-B.M.100.H-I.38 R:0.10870 P:0.05241 F:0.07072
38 ROUGE-4 Eval D0736-B.M.100.H-J.38 R:0.09386 P:0.05451 F:0.06897
38 ROUGE-4 Eval D0736-C.M.100.H-G.38 R:0.07018 P:0.03101 F:0.04301
38 ROUGE-4 Eval D0736-C.M.100.H-H.38 R:0.03371 P:0.01163 F:0.01729
38 ROUGE-4 Eval D0736-C.M.100.H-I.38 R:0.07303 P:0.02519 F:0.03746
38 ROUGE-4 Eval D0736-C.M.100.H-J.38 R:0.05078 P:0.02519 F:0.03368
38 ROUGE-4 Eval D0740-A.M.100.I-D.38 R:0.03741 P:0.02277 F:0.02831
38 ROUGE-4 Eval D0740-A.M.100.I-H.38 R:0.01010 P:0.00621 F:0.00769
38 ROUGE-4 Eval D0740-A.M.100.I-I.38 R:0.03679 P:0.02277 F:0.02813
38 ROUGE-4 Eval D0740-A.M.100.I-J.38 R:0.02658 P:0.01656 F:0.02041
38 ROUGE-4 Eval D0740-B.M.100.I-D.38 R:0.01003 P:0.00629 F:0.00773
38 ROUGE-4 Eval D0740-B.M.100.I-H.38 R:0.01365 P:0.00839 F:0.01039
38 ROUGE-4 Eval D0740-B.M.100.I-I.38 R:0.00338 P:0.00210 F:0.00259
38 ROUGE-4 Eval D0740-B.M.100.I-J.38 R:0.01333 P:0.00839 F:0.01030
38 ROUGE-4 Eval D0740-C.M.100.I-D.38 R:0.06250 P:0.04008 F:0.04884
38 ROUGE-4 Eval D0740-C.M.100.I-H.38 R:0.04636 P:0.02954 F:0.03609
38 ROUGE-4 Eval D0740-C.M.100.I-I.38 R:0.06579 P:0.04219 F:0.05141
38 ROUGE-4 Eval D0740-C.M.100.I-J.38 R:0.02295 P:0.01477 F:0.01797
38 ROUGE-4 Eval D0743-A.M.100.J-B.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-A.M.100.J-H.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-A.M.100.J-I.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-A.M.100.J-J.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-B.M.100.J-B.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-B.M.100.J-H.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-B.M.100.J-I.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-B.M.100.J-J.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-C.M.100.J-B.38 R:0.00000 P:0.00000 F:0.00000
38 ROUGE-4 Eval D0743-C.M.100.J-H.38 R:0.00328 P:0.00210 F:0.00256
38 ROUGE-4 Eval D0743-C.M.100.J-I.38 R:0.00329 P:0.00210 F:0.00256
38 ROUGE-4 Eval D0743-C.M.100.J-J.38 R:0.00324 P:0.00210 F:0.00255
---------------------------------------------
38 ROUGE-L Average_R: 0.32208 (95%-conf.int. 0.31315 - 0.33088)
38 ROUGE-L Average_P: 0.19945 (95%-conf.int. 0.19366 - 0.20506)
38 ROUGE-L Average_F: 0.24578 (95%-conf.int. 0.23891 - 0.25234)
.............................................
38 ROUGE-L Eval D0703-A.M.100.A-A.38 R:0.31419 P:0.19497 F:0.24062
38 ROUGE-L Eval D0703-A.M.100.A-C.38 R:0.28523 P:0.17820 F:0.21936
38 ROUGE-L Eval D0703-A.M.100.A-D.38 R:0.29553 P:0.18029 F:0.22395
38 ROUGE-L Eval D0703-A.M.100.A-J.38 R:0.32653 P:0.20126 F:0.24903
38 ROUGE-L Eval D0703-B.M.100.A-A.38 R:0.36928 P:0.23395 F:0.28643
38 ROUGE-L Eval D0703-B.M.100.A-C.38 R:0.35570 P:0.21946 F:0.27144
38 ROUGE-L Eval D0703-B.M.100.A-D.38 R:0.36577 P:0.22567 F:0.27913
38 ROUGE-L Eval D0703-B.M.100.A-J.38 R:0.39535 P:0.24638 F:0.30357
38 ROUGE-L Eval D0703-C.M.100.A-A.38 R:0.35333 P:0.22083 F:0.27179
38 ROUGE-L Eval D0703-C.M.100.A-C.38 R:0.32792 P:0.21042 F:0.25635
38 ROUGE-L Eval D0703-C.M.100.A-D.38 R:0.31457 P:0.19792 F:0.24297
38 ROUGE-L Eval D0703-C.M.100.A-J.38 R:0.36093 P:0.22708 F:0.27877
38 ROUGE-L Eval D0706-A.M.100.B-B.38 R:0.35714 P:0.22917 F:0.27919
38 ROUGE-L Eval D0706-A.M.100.B-D.38 R:0.33007 P:0.21042 F:0.25700
38 ROUGE-L Eval D0706-A.M.100.B-E.38 R:0.30195 P:0.19375 F:0.23604
38 ROUGE-L Eval D0706-A.M.100.B-I.38 R:0.33766 P:0.21667 F:0.26396
38 ROUGE-L Eval D0706-B.M.100.B-B.38 R:0.31046 P:0.21396 F:0.25333
38 ROUGE-L Eval D0706-B.M.100.B-D.38 R:0.29967 P:0.20721 F:0.24501
38 ROUGE-L Eval D0706-B.M.100.B-E.38 R:0.31494 P:0.21847 F:0.25798
38 ROUGE-L Eval D0706-B.M.100.B-I.38 R:0.32362 P:0.22523 F:0.26561
38 ROUGE-L Eval D0706-C.M.100.B-B.38 R:0.35161 P:0.21124 F:0.26392
38 ROUGE-L Eval D0706-C.M.100.B-D.38 R:0.36774 P:0.22093 F:0.27603
38 ROUGE-L Eval D0706-C.M.100.B-E.38 R:0.33654 P:0.20349 F:0.25362
38 ROUGE-L Eval D0706-C.M.100.B-I.38 R:0.37061 P:0.22481 F:0.27986
38 ROUGE-L Eval D0711-A.M.100.C-A.38 R:0.31579 P:0.20645 F:0.24967
38 ROUGE-L Eval D0711-A.M.100.C-B.38 R:0.33667 P:0.21720 F:0.26405
38 ROUGE-L Eval D0711-A.M.100.C-C.38 R:0.33333 P:0.21505 F:0.26143
38 ROUGE-L Eval D0711-A.M.100.C-F.38 R:0.32781 P:0.21290 F:0.25814
38 ROUGE-L Eval D0711-B.M.100.C-A.38 R:0.30272 P:0.17871 F:0.22474
38 ROUGE-L Eval D0711-B.M.100.C-B.38 R:0.33219 P:0.19478 F:0.24557
38 ROUGE-L Eval D0711-B.M.100.C-C.38 R:0.32215 P:0.19277 F:0.24121
38 ROUGE-L Eval D0711-B.M.100.C-F.38 R:0.31525 P:0.18675 F:0.23455
38 ROUGE-L Eval D0711-C.M.100.C-A.38 R:0.33003 P:0.22075 F:0.26455
38 ROUGE-L Eval D0711-C.M.100.C-B.38 R:0.34471 P:0.22296 F:0.27078
38 ROUGE-L Eval D0711-C.M.100.C-C.38 R:0.31419 P:0.20530 F:0.24833
38 ROUGE-L Eval D0711-C.M.100.C-F.38 R:0.27365 P:0.17881 F:0.21629
38 ROUGE-L Eval D0716-A.M.100.D-C.38 R:0.37377 P:0.23750 F:0.29045
38 ROUGE-L Eval D0716-A.M.100.D-D.38 R:0.33333 P:0.20833 F:0.25641
38 ROUGE-L Eval D0716-A.M.100.D-E.38 R:0.37542 P:0.23542 F:0.28938
38 ROUGE-L Eval D0716-A.M.100.D-F.38 R:0.35644 P:0.22500 F:0.27586
38 ROUGE-L Eval D0716-B.M.100.D-C.38 R:0.34539 P:0.22581 F:0.27308
38 ROUGE-L Eval D0716-B.M.100.D-D.38 R:0.38926 P:0.24946 F:0.30406
38 ROUGE-L Eval D0716-B.M.100.D-E.38 R:0.34551 P:0.22366 F:0.27154
38 ROUGE-L Eval D0716-B.M.100.D-F.38 R:0.35667 P:0.23011 F:0.27974
38 ROUGE-L Eval D0716-C.M.100.D-C.38 R:0.38111 P:0.26897 F:0.31537
38 ROUGE-L Eval D0716-C.M.100.D-D.38 R:0.36120 P:0.24828 F:0.29428
38 ROUGE-L Eval D0716-C.M.100.D-E.38 R:0.35974 P:0.25057 F:0.29539
38 ROUGE-L Eval D0716-C.M.100.D-F.38 R:0.36667 P:0.25287 F:0.29932
38 ROUGE-L Eval D0721-A.M.100.E-B.38 R:0.26333 P:0.16458 F:0.20256
38 ROUGE-L Eval D0721-A.M.100.E-C.38 R:0.27597 P:0.17708 F:0.21573
38 ROUGE-L Eval D0721-A.M.100.E-E.38 R:0.25325 P:0.16250 F:0.19797
38 ROUGE-L Eval D0721-A.M.100.E-G.38 R:0.26115 P:0.17083 F:0.20655
38 ROUGE-L Eval D0721-B.M.100.E-B.38 R:0.25733 P:0.16255 F:0.19924
38 ROUGE-L Eval D0721-B.M.100.E-C.38 R:0.24841 P:0.16049 F:0.19500
38 ROUGE-L Eval D0721-B.M.100.E-E.38 R:0.21639 P:0.13580 F:0.16687
38 ROUGE-L Eval D0721-B.M.100.E-G.38 R:0.24839 P:0.15844 F:0.19347
38 ROUGE-L Eval D0721-C.M.100.E-B.38 R:0.32131 P:0.21634 F:0.25858
38 ROUGE-L Eval D0721-C.M.100.E-C.38 R:0.26733 P:0.17881 F:0.21429
38 ROUGE-L Eval D0721-C.M.100.E-E.38 R:0.28667 P:0.18985 F:0.22842
38 ROUGE-L Eval D0721-C.M.100.E-G.38 R:0.26059 P:0.17660 F:0.21053
38 ROUGE-L Eval D0726-A.M.100.F-A.38 R:0.30565 P:0.18930 F:0.23380
38 ROUGE-L Eval D0726-A.M.100.F-E.38 R:0.32667 P:0.20165 F:0.24937
38 ROUGE-L Eval D0726-A.M.100.F-F.38 R:0.32226 P:0.19959 F:0.24651
38 ROUGE-L Eval D0726-A.M.100.F-G.38 R:0.33223 P:0.20576 F:0.25413
38 ROUGE-L Eval D0726-B.M.100.F-A.38 R:0.34641 P:0.19203 F:0.24709
38 ROUGE-L Eval D0726-B.M.100.F-E.38 R:0.34551 P:0.18841 F:0.24385
38 ROUGE-L Eval D0726-B.M.100.F-F.38 R:0.35216 P:0.19203 F:0.24854
38 ROUGE-L Eval D0726-B.M.100.F-G.38 R:0.35197 P:0.19384 F:0.25000
38 ROUGE-L Eval D0726-C.M.100.F-A.38 R:0.33333 P:0.23474 F:0.27548
38 ROUGE-L Eval D0726-C.M.100.F-E.38 R:0.32660 P:0.22770 F:0.26833
38 ROUGE-L Eval D0726-C.M.100.F-F.38 R:0.34237 P:0.23709 F:0.28017
38 ROUGE-L Eval D0726-C.M.100.F-G.38 R:0.34098 P:0.24413 F:0.28454
38 ROUGE-L Eval D0727-A.M.100.G-A.38 R:0.38538 P:0.23722 F:0.29367
38 ROUGE-L Eval D0727-A.M.100.G-F.38 R:0.36513 P:0.22699 F:0.27995
38 ROUGE-L Eval D0727-A.M.100.G-G.38 R:0.36601 P:0.22904 F:0.28176
38 ROUGE-L Eval D0727-A.M.100.G-H.38 R:0.37500 P:0.23313 F:0.28752
38 ROUGE-L Eval D0727-B.M.100.G-A.38 R:0.31959 P:0.20395 F:0.24900
38 ROUGE-L Eval D0727-B.M.100.G-F.38 R:0.30519 P:0.20614 F:0.24607
38 ROUGE-L Eval D0727-B.M.100.G-G.38 R:0.27336 P:0.17325 F:0.21208
38 ROUGE-L Eval D0727-B.M.100.G-H.38 R:0.29210 P:0.18640 F:0.22758
38 ROUGE-L Eval D0727-C.M.100.G-A.38 R:0.36482 P:0.20857 F:0.26541
38 ROUGE-L Eval D0727-C.M.100.G-F.38 R:0.34343 P:0.18994 F:0.24460
38 ROUGE-L Eval D0727-C.M.100.G-G.38 R:0.36304 P:0.20484 F:0.26190
38 ROUGE-L Eval D0727-C.M.100.G-H.38 R:0.37500 P:0.20670 F:0.26650
38 ROUGE-L Eval D0736-A.M.100.H-G.38 R:0.31541 P:0.18449 F:0.23281
38 ROUGE-L Eval D0736-A.M.100.H-H.38 R:0.30292 P:0.17400 F:0.22104
38 ROUGE-L Eval D0736-A.M.100.H-I.38 R:0.30961 P:0.18239 F:0.22955
38 ROUGE-L Eval D0736-A.M.100.H-J.38 R:0.31373 P:0.20126 F:0.24521
38 ROUGE-L Eval D0736-B.M.100.H-G.38 R:0.33588 P:0.18107 F:0.23529
38 ROUGE-L Eval D0736-B.M.100.H-H.38 R:0.38843 P:0.19342 F:0.25825
38 ROUGE-L Eval D0736-B.M.100.H-I.38 R:0.42678 P:0.20988 F:0.28138
38 ROUGE-L Eval D0736-B.M.100.H-J.38 R:0.40210 P:0.23663 F:0.29793
38 ROUGE-L Eval D0736-C.M.100.H-G.38 R:0.37975 P:0.17143 F:0.23622
38 ROUGE-L Eval D0736-C.M.100.H-H.38 R:0.35829 P:0.12762 F:0.18820
38 ROUGE-L Eval D0736-C.M.100.H-I.38 R:0.39572 P:0.14095 F:0.20786
38 ROUGE-L Eval D0736-C.M.100.H-J.38 R:0.37358 P:0.18857 F:0.25063
38 ROUGE-L Eval D0740-A.M.100.I-D.38 R:0.33993 P:0.20935 F:0.25912
38 ROUGE-L Eval D0740-A.M.100.I-H.38 R:0.32026 P:0.19919 F:0.24562
38 ROUGE-L Eval D0740-A.M.100.I-I.38 R:0.34416 P:0.21545 F:0.26500
38 ROUGE-L Eval D0740-A.M.100.I-J.38 R:0.29677 P:0.18699 F:0.22942
38 ROUGE-L Eval D0740-B.M.100.I-D.38 R:0.31494 P:0.19959 F:0.24434
38 ROUGE-L Eval D0740-B.M.100.I-H.38 R:0.29470 P:0.18313 F:0.22589
38 ROUGE-L Eval D0740-B.M.100.I-I.38 R:0.31148 P:0.19547 F:0.24020
38 ROUGE-L Eval D0740-B.M.100.I-J.38 R:0.32362 P:0.20576 F:0.25157
38 ROUGE-L Eval D0740-C.M.100.I-D.38 R:0.36422 P:0.23602 F:0.28643
38 ROUGE-L Eval D0740-C.M.100.I-H.38 R:0.36977 P:0.23810 F:0.28967
38 ROUGE-L Eval D0740-C.M.100.I-I.38 R:0.38339 P:0.24845 F:0.30151
38 ROUGE-L Eval D0740-C.M.100.I-J.38 R:0.35032 P:0.22774 F:0.27603
38 ROUGE-L Eval D0743-A.M.100.J-B.38 R:0.19048 P:0.11765 F:0.14546
38 ROUGE-L Eval D0743-A.M.100.J-H.38 R:0.16049 P:0.10196 F:0.12470
38 ROUGE-L Eval D0743-A.M.100.J-I.38 R:0.20625 P:0.12941 F:0.15903
38 ROUGE-L Eval D0743-A.M.100.J-J.38 R:0.16308 P:0.10392 F:0.12695
38 ROUGE-L Eval D0743-B.M.100.J-B.38 R:0.25321 P:0.15048 F:0.18877
38 ROUGE-L Eval D0743-B.M.100.J-H.38 R:0.24921 P:0.15048 F:0.18765
38 ROUGE-L Eval D0743-B.M.100.J-I.38 R:0.25949 P:0.15619 F:0.19500
38 ROUGE-L Eval D0743-B.M.100.J-J.38 R:0.24299 P:0.14857 F:0.18440
38 ROUGE-L Eval D0743-C.M.100.J-B.38 R:0.26032 P:0.16872 F:0.20474
38 ROUGE-L Eval D0743-C.M.100.J-H.38 R:0.23567 P:0.15226 F:0.18500
38 ROUGE-L Eval D0743-C.M.100.J-I.38 R:0.26198 P:0.16872 F:0.20525
38 ROUGE-L Eval D0743-C.M.100.J-J.38 R:0.26101 P:0.17078 F:0.20647
---------------------------------------------
38 ROUGE-W-1.2 Average_R: 0.11384 (95%-conf.int. 0.11036 - 0.11712)
38 ROUGE-W-1.2 Average_P: 0.12771 (95%-conf.int. 0.12389 - 0.13156)
38 ROUGE-W-1.2 Average_F: 0.12000 (95%-conf.int. 0.11668 - 0.12328)
.............................................
38 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.38 R:0.10927 P:0.12210 F:0.11533
38 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.38 R:0.09626 P:0.10931 F:0.10237
38 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.38 R:0.10749 P:0.12090 F:0.11380
38 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.38 R:0.11703 P:0.12339 F:0.12013
38 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.38 R:0.13194 P:0.15499 F:0.14254
38 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.38 R:0.12224 P:0.14272 F:0.13169
38 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.38 R:0.12973 P:0.15013 F:0.13919
38 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.38 R:0.14155 P:0.16361 F:0.15178
38 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.38 R:0.11616 P:0.13498 F:0.12486
38 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.38 R:0.10617 P:0.12862 F:0.11632
38 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.38 R:0.10061 P:0.12014 F:0.10951
38 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.38 R:0.11997 P:0.13595 F:0.12746
38 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.38 R:0.12797 P:0.14736 F:0.13698
38 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.38 R:0.11783 P:0.13784 F:0.12705
38 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.38 R:0.10215 P:0.11886 F:0.10987
38 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.38 R:0.11797 P:0.14027 F:0.12816
38 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.38 R:0.12023 P:0.14351 F:0.13084
38 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.38 R:0.10956 P:0.13359 F:0.12039
38 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.38 R:0.11847 P:0.14506 F:0.13042
38 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.38 R:0.11786 P:0.14833 F:0.13135
38 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.38 R:0.13437 P:0.13778 F:0.13605
38 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.38 R:0.13940 P:0.14416 F:0.14174
38 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.38 R:0.12401 P:0.12702 F:0.12550
38 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.38 R:0.13882 P:0.14624 F:0.14243
38 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.38 R:0.11444 P:0.13489 F:0.12383
38 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.38 R:0.12228 P:0.14289 F:0.13178
38 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.38 R:0.12074 P:0.13988 F:0.12961
38 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.38 R:0.11906 P:0.14027 F:0.12880
38 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.38 R:0.10084 P:0.10622 F:0.10346
38 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.38 R:0.10617 P:0.11666 F:0.11117
38 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.38 R:0.10369 P:0.11656 F:0.10975
38 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.38 R:0.10341 P:0.11377 F:0.10834
38 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.38 R:0.11033 P:0.13797 F:0.12261
38 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.38 R:0.11469 P:0.13872 F:0.12557
38 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.38 R:0.10316 P:0.12799 F:0.11424
38 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.38 R:0.08868 P:0.11168 F:0.09886
38 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.38 R:0.12907 P:0.14983 F:0.13868
38 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.38 R:0.11176 P:0.13308 F:0.12149
38 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.38 R:0.12644 P:0.14807 F:0.13640
38 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.38 R:0.11663 P:0.14001 F:0.12726
38 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.38 R:0.12726 P:0.14514 F:0.13561
38 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.38 R:0.14288 P:0.16387 F:0.15266
38 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.38 R:0.12440 P:0.14335 F:0.13320
38 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.38 R:0.13469 P:0.15381 F:0.14362
38 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.38 R:0.13429 P:0.17665 F:0.15258
38 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.38 R:0.12377 P:0.16498 F:0.14143
38 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.38 R:0.11927 P:0.16099 F:0.13702
38 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.38 R:0.12475 P:0.16736 F:0.14295
38 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.38 R:0.09735 P:0.10694 F:0.10192
38 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.38 R:0.09999 P:0.11384 F:0.10647
38 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.38 R:0.09075 P:0.10460 F:0.09718
38 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.38 R:0.09705 P:0.11126 F:0.10367
38 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.38 R:0.07953 P:0.09712 F:0.08745
38 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.38 R:0.07976 P:0.09686 F:0.08748
38 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.38 R:0.06776 P:0.08347 F:0.07480
38 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.38 R:0.07384 P:0.09400 F:0.08271
38 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.38 R:0.11012 P:0.13646 F:0.12188
38 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.38 R:0.09050 P:0.11389 F:0.10086
38 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.38 R:0.09913 P:0.12253 F:0.10959
38 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.38 R:0.08923 P:0.11309 F:0.09975
38 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.38 R:0.10997 P:0.12069 F:0.11508
38 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.38 R:0.12134 P:0.13122 F:0.12609
38 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.38 R:0.11693 P:0.12899 F:0.12266
38 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.38 R:0.11915 P:0.13358 F:0.12595
38 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.38 R:0.12219 P:0.11914 F:0.12065
38 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.38 R:0.11840 P:0.11655 F:0.11747
38 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.38 R:0.12156 P:0.12043 F:0.12099
38 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.38 R:0.12158 P:0.12090 F:0.12124
38 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.38 R:0.11719 P:0.14492 F:0.12959
38 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.38 R:0.11428 P:0.14062 F:0.12609
38 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.38 R:0.12146 P:0.15062 F:0.13448
38 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.38 R:0.11732 P:0.15040 F:0.13182
38 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.38 R:0.12722 P:0.13784 F:0.13232
38 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.38 R:0.11807 P:0.13398 F:0.12552
38 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.38 R:0.11959 P:0.13254 F:0.12573
38 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.38 R:0.12877 P:0.14350 F:0.13574
38 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.38 R:0.11418 P:0.12785 F:0.12063
38 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.38 R:0.10767 P:0.13064 F:0.11805
38 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.38 R:0.09563 P:0.10855 F:0.10168
38 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.38 R:0.10382 P:0.11727 F:0.11014
38 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.38 R:0.12775 P:0.13135 F:0.12952
38 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.38 R:0.11791 P:0.12053 F:0.11921
38 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.38 R:0.12442 P:0.12923 F:0.12678
38 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.38 R:0.13052 P:0.12949 F:0.13000
38 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.38 R:0.11649 P:0.12066 F:0.11854
38 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.38 R:0.11066 P:0.11178 F:0.11122
38 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.38 R:0.11250 P:0.11842 F:0.11538
38 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.38 R:0.11127 P:0.12725 F:0.11872
38 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.38 R:0.11898 P:0.11873 F:0.11885
38 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.38 R:0.15343 P:0.14134 F:0.14714
38 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.38 R:0.16365 P:0.14864 F:0.15578
38 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.38 R:0.14905 P:0.16215 F:0.15532
38 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.38 R:0.14585 P:0.11961 F:0.13143
38 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.38 R:0.13570 P:0.09034 F:0.10847
38 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.38 R:0.15692 P:0.10196 F:0.12361
38 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.38 R:0.13982 P:0.12592 F:0.13251
38 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.38 R:0.12664 P:0.14345 F:0.13452
38 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.38 R:0.11425 P:0.12820 F:0.12082
38 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.38 R:0.12808 P:0.14832 F:0.13746
38 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.38 R:0.10989 P:0.12720 F:0.11791
38 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.38 R:0.11144 P:0.12976 F:0.11990
38 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.38 R:0.10876 P:0.12028 F:0.11423
38 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.38 R:0.10448 P:0.12320 F:0.11307
38 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.38 R:0.11766 P:0.13374 F:0.12519
38 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.38 R:0.12585 P:0.15739 F:0.13986
38 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.38 R:0.12822 P:0.15408 F:0.13997
38 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.38 R:0.13045 P:0.16532 F:0.14583
38 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.38 R:0.11793 P:0.14691 F:0.13083
38 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.38 R:0.07069 P:0.07611 F:0.07330
38 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.38 R:0.05929 P:0.06507 F:0.06205
38 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.38 R:0.07420 P:0.08261 F:0.07818
38 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.38 R:0.06040 P:0.06682 F:0.06345
38 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.38 R:0.09555 P:0.09509 F:0.09532
38 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.38 R:0.09765 P:0.09779 F:0.09772
38 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.38 R:0.09817 P:0.09958 F:0.09887
38 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.38 R:0.09620 P:0.09671 F:0.09645
38 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.38 R:0.09018 P:0.10231 F:0.09586
38 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.38 R:0.08908 P:0.09611 F:0.09246
38 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.38 R:0.09084 P:0.10425 F:0.09708
38 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.38 R:0.09554 P:0.10523 F:0.10015
---------------------------------------------
38 ROUGE-SU4 Average_R: 0.12988 (95%-conf.int. 0.12327 - 0.13644)
38 ROUGE-SU4 Average_P: 0.07932 (95%-conf.int. 0.07565 - 0.08312)
38 ROUGE-SU4 Average_F: 0.09821 (95%-conf.int. 0.09350 - 0.10291)
.............................................
38 ROUGE-SU4 Eval D0703-A.M.100.A-A.38 R:0.14931 P:0.09168 F:0.11360
38 ROUGE-SU4 Eval D0703-A.M.100.A-C.38 R:0.13276 P:0.08209 F:0.10145
38 ROUGE-SU4 Eval D0703-A.M.100.A-D.38 R:0.13604 P:0.08209 F:0.10239
38 ROUGE-SU4 Eval D0703-A.M.100.A-J.38 R:0.14336 P:0.08742 F:0.10861
38 ROUGE-SU4 Eval D0703-B.M.100.A-A.38 R:0.19351 P:0.12140 F:0.14920
38 ROUGE-SU4 Eval D0703-B.M.100.A-C.38 R:0.16264 P:0.09930 F:0.12331
38 ROUGE-SU4 Eval D0703-B.M.100.A-D.38 R:0.19080 P:0.11649 F:0.14466
38 ROUGE-SU4 Eval D0703-B.M.100.A-J.38 R:0.20592 P:0.12702 F:0.15712
38 ROUGE-SU4 Eval D0703-C.M.100.A-A.38 R:0.14098 P:0.08722 F:0.10777
38 ROUGE-SU4 Eval D0703-C.M.100.A-C.38 R:0.13111 P:0.08333 F:0.10190
38 ROUGE-SU4 Eval D0703-C.M.100.A-D.38 R:0.12075 P:0.07521 F:0.09269
38 ROUGE-SU4 Eval D0703-C.M.100.A-J.38 R:0.13605 P:0.08475 F:0.10444
38 ROUGE-SU4 Eval D0706-A.M.100.B-B.38 R:0.14667 P:0.09322 F:0.11399
38 ROUGE-SU4 Eval D0706-A.M.100.B-D.38 R:0.14206 P:0.08969 F:0.10996
38 ROUGE-SU4 Eval D0706-A.M.100.B-E.38 R:0.10222 P:0.06497 F:0.07945
38 ROUGE-SU4 Eval D0706-A.M.100.B-I.38 R:0.13833 P:0.08792 F:0.10751
38 ROUGE-SU4 Eval D0706-B.M.100.B-B.38 R:0.12808 P:0.08754 F:0.10400
38 ROUGE-SU4 Eval D0706-B.M.100.B-D.38 R:0.11371 P:0.07798 F:0.09252
38 ROUGE-SU4 Eval D0706-B.M.100.B-E.38 R:0.11278 P:0.07760 F:0.09194
38 ROUGE-SU4 Eval D0706-B.M.100.B-I.38 R:0.13289 P:0.09174 F:0.10855
38 ROUGE-SU4 Eval D0706-C.M.100.B-B.38 R:0.15839 P:0.09416 F:0.11811
38 ROUGE-SU4 Eval D0706-C.M.100.B-D.38 R:0.17439 P:0.10367 F:0.13004
38 ROUGE-SU4 Eval D0706-C.M.100.B-E.38 R:0.13542 P:0.08104 F:0.10140
38 ROUGE-SU4 Eval D0706-C.M.100.B-I.38 R:0.17486 P:0.10499 F:0.13120
38 ROUGE-SU4 Eval D0711-A.M.100.C-A.38 R:0.13176 P:0.08534 F:0.10359
38 ROUGE-SU4 Eval D0711-A.M.100.C-B.38 R:0.13413 P:0.08570 F:0.10458
38 ROUGE-SU4 Eval D0711-A.M.100.C-C.38 R:0.13984 P:0.08935 F:0.10903
38 ROUGE-SU4 Eval D0711-A.M.100.C-F.38 R:0.14626 P:0.09409 F:0.11451
38 ROUGE-SU4 Eval D0711-B.M.100.C-A.38 R:0.09965 P:0.05816 F:0.07345
38 ROUGE-SU4 Eval D0711-B.M.100.C-B.38 R:0.12031 P:0.06973 F:0.08829
38 ROUGE-SU4 Eval D0711-B.M.100.C-C.38 R:0.11609 P:0.06871 F:0.08633
38 ROUGE-SU4 Eval D0711-B.M.100.C-F.38 R:0.11034 P:0.06463 F:0.08151
38 ROUGE-SU4 Eval D0711-C.M.100.C-A.38 R:0.12768 P:0.08464 F:0.10180
38 ROUGE-SU4 Eval D0711-C.M.100.C-B.38 R:0.13743 P:0.08801 F:0.10730
38 ROUGE-SU4 Eval D0711-C.M.100.C-C.38 R:0.11979 P:0.07753 F:0.09413
38 ROUGE-SU4 Eval D0711-C.M.100.C-F.38 R:0.10475 P:0.06779 F:0.08231
38 ROUGE-SU4 Eval D0716-A.M.100.D-C.38 R:0.14703 P:0.09251 F:0.11357
38 ROUGE-SU4 Eval D0716-A.M.100.D-D.38 R:0.12842 P:0.07945 F:0.09817
38 ROUGE-SU4 Eval D0716-A.M.100.D-E.38 R:0.15870 P:0.09852 F:0.12157
38 ROUGE-SU4 Eval D0716-A.M.100.D-F.38 R:0.14520 P:0.09075 F:0.11169
38 ROUGE-SU4 Eval D0716-B.M.100.D-C.38 R:0.15090 P:0.09774 F:0.11864
38 ROUGE-SU4 Eval D0716-B.M.100.D-D.38 R:0.18851 P:0.11962 F:0.14636
38 ROUGE-SU4 Eval D0716-B.M.100.D-E.38 R:0.15358 P:0.09847 F:0.12000
38 ROUGE-SU4 Eval D0716-B.M.100.D-F.38 R:0.17523 P:0.11196 F:0.13663
38 ROUGE-SU4 Eval D0716-C.M.100.D-C.38 R:0.16834 P:0.11788 F:0.13866
38 ROUGE-SU4 Eval D0716-C.M.100.D-D.38 R:0.16724 P:0.11397 F:0.13556
38 ROUGE-SU4 Eval D0716-C.M.100.D-E.38 R:0.15254 P:0.10539 F:0.12466
38 ROUGE-SU4 Eval D0716-C.M.100.D-F.38 R:0.16096 P:0.11007 F:0.13074
38 ROUGE-SU4 Eval D0721-A.M.100.E-B.38 R:0.09247 P:0.05720 F:0.07068
38 ROUGE-SU4 Eval D0721-A.M.100.E-C.38 R:0.09722 P:0.06179 F:0.07556
38 ROUGE-SU4 Eval D0721-A.M.100.E-E.38 R:0.08000 P:0.05085 F:0.06218
38 ROUGE-SU4 Eval D0721-A.M.100.E-G.38 R:0.09423 P:0.06109 F:0.07412
38 ROUGE-SU4 Eval D0721-B.M.100.E-B.38 R:0.09365 P:0.05858 F:0.07208
38 ROUGE-SU4 Eval D0721-B.M.100.E-C.38 R:0.08932 P:0.05718 F:0.06972
38 ROUGE-SU4 Eval D0721-B.M.100.E-E.38 R:0.07464 P:0.04637 F:0.05720
38 ROUGE-SU4 Eval D0721-B.M.100.E-G.38 R:0.09106 P:0.05753 F:0.07051
38 ROUGE-SU4 Eval D0721-C.M.100.E-B.38 R:0.11672 P:0.07790 F:0.09344
38 ROUGE-SU4 Eval D0721-C.M.100.E-C.38 R:0.09153 P:0.06067 F:0.07297
38 ROUGE-SU4 Eval D0721-C.M.100.E-E.38 R:0.10217 P:0.06704 F:0.08096
38 ROUGE-SU4 Eval D0721-C.M.100.E-G.38 R:0.09197 P:0.06180 F:0.07393
38 ROUGE-SU4 Eval D0726-A.M.100.F-A.38 R:0.11490 P:0.07043 F:0.08733
38 ROUGE-SU4 Eval D0726-A.M.100.F-E.38 R:0.12900 P:0.07880 F:0.09784
38 ROUGE-SU4 Eval D0726-A.M.100.F-F.38 R:0.13026 P:0.07985 F:0.09901
38 ROUGE-SU4 Eval D0726-A.M.100.F-G.38 R:0.13481 P:0.08264 F:0.10247
38 ROUGE-SU4 Eval D0726-B.M.100.F-A.38 R:0.11689 P:0.06403 F:0.08274
38 ROUGE-SU4 Eval D0726-B.M.100.F-E.38 R:0.11604 P:0.06250 F:0.08124
38 ROUGE-SU4 Eval D0726-B.M.100.F-F.38 R:0.12059 P:0.06495 F:0.08443
38 ROUGE-SU4 Eval D0726-B.M.100.F-G.38 R:0.12275 P:0.06679 F:0.08651
38 ROUGE-SU4 Eval D0726-C.M.100.F-A.38 R:0.13413 P:0.09370 F:0.11033
38 ROUGE-SU4 Eval D0726-C.M.100.F-E.38 R:0.12630 P:0.08732 F:0.10325
38 ROUGE-SU4 Eval D0726-C.M.100.F-F.38 R:0.13937 P:0.09569 F:0.11347
38 ROUGE-SU4 Eval D0726-C.M.100.F-G.38 R:0.13412 P:0.09530 F:0.11143
38 ROUGE-SU4 Eval D0727-A.M.100.G-A.38 R:0.16325 P:0.09945 F:0.12360
38 ROUGE-SU4 Eval D0727-A.M.100.G-F.38 R:0.15203 P:0.09356 F:0.11583
38 ROUGE-SU4 Eval D0727-A.M.100.G-G.38 R:0.14262 P:0.08836 F:0.10912
38 ROUGE-SU4 Eval D0727-A.M.100.G-H.38 R:0.15428 P:0.09494 F:0.11755
38 ROUGE-SU4 Eval D0727-B.M.100.G-A.38 R:0.11249 P:0.07106 F:0.08710
38 ROUGE-SU4 Eval D0727-B.M.100.G-F.38 R:0.10889 P:0.07292 F:0.08735
38 ROUGE-SU4 Eval D0727-B.M.100.G-G.38 R:0.09134 P:0.05729 F:0.07041
38 ROUGE-SU4 Eval D0727-B.M.100.G-H.38 R:0.09835 P:0.06213 F:0.07615
38 ROUGE-SU4 Eval D0727-C.M.100.G-A.38 R:0.13991 P:0.07908 F:0.10105
38 ROUGE-SU4 Eval D0727-C.M.100.G-F.38 R:0.13322 P:0.07278 F:0.09413
38 ROUGE-SU4 Eval D0727-C.M.100.G-G.38 R:0.14124 P:0.07876 F:0.10113
38 ROUGE-SU4 Eval D0727-C.M.100.G-H.38 R:0.14757 P:0.08034 F:0.10404
38 ROUGE-SU4 Eval D0736-A.M.100.H-G.38 R:0.10701 P:0.06183 F:0.07838
38 ROUGE-SU4 Eval D0736-A.M.100.H-H.38 R:0.10150 P:0.05757 F:0.07347
38 ROUGE-SU4 Eval D0736-A.M.100.H-I.38 R:0.10623 P:0.06183 F:0.07816
38 ROUGE-SU4 Eval D0736-A.M.100.H-J.38 R:0.10738 P:0.06823 F:0.08344
38 ROUGE-SU4 Eval D0736-B.M.100.H-G.38 R:0.12730 P:0.06764 F:0.08834
38 ROUGE-SU4 Eval D0736-B.M.100.H-H.38 R:0.20726 P:0.10146 F:0.13623
38 ROUGE-SU4 Eval D0736-B.M.100.H-I.38 R:0.22439 P:0.10844 F:0.14622
38 ROUGE-SU4 Eval D0736-B.M.100.H-J.38 R:0.20264 P:0.11785 F:0.14903
38 ROUGE-SU4 Eval D0736-C.M.100.H-G.38 R:0.19287 P:0.08543 F:0.11841
38 ROUGE-SU4 Eval D0736-C.M.100.H-H.38 R:0.16387 P:0.05674 F:0.08429
38 ROUGE-SU4 Eval D0736-C.M.100.H-I.38 R:0.21322 P:0.07382 F:0.10967
38 ROUGE-SU4 Eval D0736-C.M.100.H-J.38 R:0.16861 P:0.08382 F:0.11197
38 ROUGE-SU4 Eval D0740-A.M.100.I-D.38 R:0.15593 P:0.09504 F:0.11810
38 ROUGE-SU4 Eval D0740-A.M.100.I-H.38 R:0.12864 P:0.07920 F:0.09804
38 ROUGE-SU4 Eval D0740-A.M.100.I-I.38 R:0.16000 P:0.09917 F:0.12245
38 ROUGE-SU4 Eval D0740-A.M.100.I-J.38 R:0.12969 P:0.08092 F:0.09966
38 ROUGE-SU4 Eval D0740-B.M.100.I-D.38 R:0.12278 P:0.07706 F:0.09469
38 ROUGE-SU4 Eval D0740-B.M.100.I-H.38 R:0.10714 P:0.06590 F:0.08161
38 ROUGE-SU4 Eval D0740-B.M.100.I-I.38 R:0.11560 P:0.07183 F:0.08860
38 ROUGE-SU4 Eval D0740-B.M.100.I-J.38 R:0.12569 P:0.07915 F:0.09713
38 ROUGE-SU4 Eval D0740-C.M.100.I-D.38 R:0.16612 P:0.10667 F:0.12992
38 ROUGE-SU4 Eval D0740-C.M.100.I-H.38 R:0.16667 P:0.10632 F:0.12982
38 ROUGE-SU4 Eval D0740-C.M.100.I-I.38 R:0.18579 P:0.11930 F:0.14530
38 ROUGE-SU4 Eval D0740-C.M.100.I-J.38 R:0.14270 P:0.09193 F:0.11182
38 ROUGE-SU4 Eval D0743-A.M.100.J-B.38 R:0.05375 P:0.03287 F:0.04079
38 ROUGE-SU4 Eval D0743-A.M.100.J-H.38 R:0.04008 P:0.02523 F:0.03097
38 ROUGE-SU4 Eval D0743-A.M.100.J-I.38 R:0.05716 P:0.03552 F:0.04381
38 ROUGE-SU4 Eval D0743-A.M.100.J-J.38 R:0.04416 P:0.02789 F:0.03419
38 ROUGE-SU4 Eval D0743-B.M.100.J-B.38 R:0.08004 P:0.04707 F:0.05928
38 ROUGE-SU4 Eval D0743-B.M.100.J-H.38 R:0.07282 P:0.04352 F:0.05448
38 ROUGE-SU4 Eval D0743-B.M.100.J-I.38 R:0.08550 P:0.05093 F:0.06384
38 ROUGE-SU4 Eval D0743-B.M.100.J-J.38 R:0.07774 P:0.04707 F:0.05864
38 ROUGE-SU4 Eval D0743-C.M.100.J-B.38 R:0.07818 P:0.05021 F:0.06115
38 ROUGE-SU4 Eval D0743-C.M.100.J-H.38 R:0.06917 P:0.04428 F:0.05399
38 ROUGE-SU4 Eval D0743-C.M.100.J-I.38 R:0.08579 P:0.05474 F:0.06683
38 ROUGE-SU4 Eval D0743-C.M.100.J-J.38 R:0.07796 P:0.05056 F:0.06134
---------------------------------------------
39 ROUGE-1 Average_R: 0.30693 (95%-conf.int. 0.29517 - 0.31778)
39 ROUGE-1 Average_P: 0.17769 (95%-conf.int. 0.16990 - 0.18554)
39 ROUGE-1 Average_F: 0.22450 (95%-conf.int. 0.21508 - 0.23335)
.............................................
39 ROUGE-1 Eval D0703-A.M.100.A-A.39 R:0.31757 P:0.22222 F:0.26147
39 ROUGE-1 Eval D0703-A.M.100.A-C.39 R:0.27181 P:0.19149 F:0.22469
39 ROUGE-1 Eval D0703-A.M.100.A-D.39 R:0.29553 P:0.20331 F:0.24090
39 ROUGE-1 Eval D0703-A.M.100.A-J.39 R:0.29592 P:0.20567 F:0.24268
39 ROUGE-1 Eval D0703-B.M.100.A-A.39 R:0.29412 P:0.19868 F:0.23716
39 ROUGE-1 Eval D0703-B.M.100.A-C.39 R:0.31879 P:0.20971 F:0.25299
39 ROUGE-1 Eval D0703-B.M.100.A-D.39 R:0.31544 P:0.20751 F:0.25034
39 ROUGE-1 Eval D0703-B.M.100.A-J.39 R:0.30897 P:0.20530 F:0.24669
39 ROUGE-1 Eval D0703-C.M.100.A-A.39 R:0.39000 P:0.23353 F:0.29213
39 ROUGE-1 Eval D0703-C.M.100.A-C.39 R:0.36364 P:0.22355 F:0.27688
39 ROUGE-1 Eval D0703-C.M.100.A-D.39 R:0.36093 P:0.21756 F:0.27148
39 ROUGE-1 Eval D0703-C.M.100.A-J.39 R:0.39073 P:0.23553 F:0.29390
39 ROUGE-1 Eval D0706-A.M.100.B-B.39 R:0.23052 P:0.12793 F:0.16454
39 ROUGE-1 Eval D0706-A.M.100.B-D.39 R:0.22876 P:0.12613 F:0.16261
39 ROUGE-1 Eval D0706-A.M.100.B-E.39 R:0.19481 P:0.10811 F:0.13905
39 ROUGE-1 Eval D0706-A.M.100.B-I.39 R:0.23377 P:0.12973 F:0.16686
39 ROUGE-1 Eval D0706-B.M.100.B-B.39 R:0.20261 P:0.11052 F:0.14302
39 ROUGE-1 Eval D0706-B.M.100.B-D.39 R:0.20847 P:0.11408 F:0.14746
39 ROUGE-1 Eval D0706-B.M.100.B-E.39 R:0.20455 P:0.11230 F:0.14500
39 ROUGE-1 Eval D0706-B.M.100.B-I.39 R:0.21359 P:0.11765 F:0.15173
39 ROUGE-1 Eval D0706-C.M.100.B-B.39 R:0.26774 P:0.14638 F:0.18928
39 ROUGE-1 Eval D0706-C.M.100.B-D.39 R:0.28710 P:0.15697 F:0.20297
39 ROUGE-1 Eval D0706-C.M.100.B-E.39 R:0.29487 P:0.16226 F:0.20933
39 ROUGE-1 Eval D0706-C.M.100.B-I.39 R:0.29712 P:0.16402 F:0.21136
39 ROUGE-1 Eval D0711-A.M.100.C-A.39 R:0.30921 P:0.21315 F:0.25235
39 ROUGE-1 Eval D0711-A.M.100.C-B.39 R:0.32000 P:0.21769 F:0.25911
39 ROUGE-1 Eval D0711-A.M.100.C-C.39 R:0.29333 P:0.19955 F:0.23752
39 ROUGE-1 Eval D0711-A.M.100.C-F.39 R:0.32119 P:0.21995 F:0.26110
39 ROUGE-1 Eval D0711-B.M.100.C-A.39 R:0.30272 P:0.15614 F:0.20602
39 ROUGE-1 Eval D0711-B.M.100.C-B.39 R:0.31507 P:0.16140 F:0.21345
39 ROUGE-1 Eval D0711-B.M.100.C-C.39 R:0.28859 P:0.15088 F:0.19816
39 ROUGE-1 Eval D0711-B.M.100.C-F.39 R:0.30508 P:0.15789 F:0.20809
39 ROUGE-1 Eval D0711-C.M.100.C-A.39 R:0.40264 P:0.22344 F:0.28739
39 ROUGE-1 Eval D0711-C.M.100.C-B.39 R:0.42662 P:0.22894 F:0.29798
39 ROUGE-1 Eval D0711-C.M.100.C-C.39 R:0.37500 P:0.20330 F:0.26366
39 ROUGE-1 Eval D0711-C.M.100.C-F.39 R:0.36149 P:0.19597 F:0.25416
39 ROUGE-1 Eval D0716-A.M.100.D-C.39 R:0.43607 P:0.26869 F:0.33250
39 ROUGE-1 Eval D0716-A.M.100.D-D.39 R:0.44333 P:0.26869 F:0.33459
39 ROUGE-1 Eval D0716-A.M.100.D-E.39 R:0.44186 P:0.26869 F:0.33417
39 ROUGE-1 Eval D0716-A.M.100.D-F.39 R:0.41584 P:0.25455 F:0.31579
39 ROUGE-1 Eval D0716-B.M.100.D-C.39 R:0.41118 P:0.21151 F:0.27933
39 ROUGE-1 Eval D0716-B.M.100.D-D.39 R:0.44295 P:0.22335 F:0.29696
39 ROUGE-1 Eval D0716-B.M.100.D-E.39 R:0.41528 P:0.21151 F:0.28027
39 ROUGE-1 Eval D0716-B.M.100.D-F.39 R:0.42667 P:0.21658 F:0.28732
39 ROUGE-1 Eval D0716-C.M.100.D-C.39 R:0.36808 P:0.21402 F:0.27066
39 ROUGE-1 Eval D0716-C.M.100.D-D.39 R:0.37793 P:0.21402 F:0.27328
39 ROUGE-1 Eval D0716-C.M.100.D-E.39 R:0.40924 P:0.23485 F:0.29844
39 ROUGE-1 Eval D0716-C.M.100.D-F.39 R:0.39333 P:0.22348 F:0.28502
39 ROUGE-1 Eval D0721-A.M.100.E-B.39 R:0.28333 P:0.16569 F:0.20910
39 ROUGE-1 Eval D0721-A.M.100.E-C.39 R:0.28896 P:0.17349 F:0.21681
39 ROUGE-1 Eval D0721-A.M.100.E-E.39 R:0.25649 P:0.15400 F:0.19245
39 ROUGE-1 Eval D0721-A.M.100.E-G.39 R:0.26433 P:0.16179 F:0.20072
39 ROUGE-1 Eval D0721-B.M.100.E-B.39 R:0.34853 P:0.18480 F:0.24153
39 ROUGE-1 Eval D0721-B.M.100.E-C.39 R:0.35350 P:0.19171 F:0.24860
39 ROUGE-1 Eval D0721-B.M.100.E-E.39 R:0.36066 P:0.18998 F:0.24887
39 ROUGE-1 Eval D0721-B.M.100.E-G.39 R:0.32581 P:0.17444 F:0.22722
39 ROUGE-1 Eval D0721-C.M.100.E-B.39 R:0.33115 P:0.17535 F:0.22929
39 ROUGE-1 Eval D0721-C.M.100.E-C.39 R:0.30693 P:0.16146 F:0.21161
39 ROUGE-1 Eval D0721-C.M.100.E-E.39 R:0.32667 P:0.17014 F:0.22375
39 ROUGE-1 Eval D0721-C.M.100.E-G.39 R:0.29967 P:0.15972 F:0.20838
39 ROUGE-1 Eval D0726-A.M.100.F-A.39 R:0.31561 P:0.18738 F:0.23515
39 ROUGE-1 Eval D0726-A.M.100.F-E.39 R:0.30667 P:0.18146 F:0.22801
39 ROUGE-1 Eval D0726-A.M.100.F-F.39 R:0.32558 P:0.19329 F:0.24257
39 ROUGE-1 Eval D0726-A.M.100.F-G.39 R:0.31894 P:0.18935 F:0.23763
39 ROUGE-1 Eval D0726-B.M.100.F-A.39 R:0.28758 P:0.16117 F:0.20657
39 ROUGE-1 Eval D0726-B.M.100.F-E.39 R:0.32226 P:0.17766 F:0.22905
39 ROUGE-1 Eval D0726-B.M.100.F-F.39 R:0.32558 P:0.17949 F:0.23141
39 ROUGE-1 Eval D0726-B.M.100.F-G.39 R:0.32237 P:0.17949 F:0.23059
39 ROUGE-1 Eval D0726-C.M.100.F-A.39 R:0.30333 P:0.16576 F:0.21437
39 ROUGE-1 Eval D0726-C.M.100.F-E.39 R:0.32323 P:0.17486 F:0.22695
39 ROUGE-1 Eval D0726-C.M.100.F-F.39 R:0.30847 P:0.16576 F:0.21564
39 ROUGE-1 Eval D0726-C.M.100.F-G.39 R:0.28852 P:0.16029 F:0.20609
39 ROUGE-1 Eval D0727-A.M.100.G-A.39 R:0.36877 P:0.22699 F:0.28101
39 ROUGE-1 Eval D0727-A.M.100.G-F.39 R:0.34539 P:0.21472 F:0.26481
39 ROUGE-1 Eval D0727-A.M.100.G-G.39 R:0.35621 P:0.22290 F:0.27421
39 ROUGE-1 Eval D0727-A.M.100.G-H.39 R:0.37171 P:0.23108 F:0.28499
39 ROUGE-1 Eval D0727-B.M.100.G-A.39 R:0.34364 P:0.18519 F:0.24068
39 ROUGE-1 Eval D0727-B.M.100.G-F.39 R:0.32468 P:0.18519 F:0.23585
39 ROUGE-1 Eval D0727-B.M.100.G-G.39 R:0.34256 P:0.18333 F:0.23884
39 ROUGE-1 Eval D0727-B.M.100.G-H.39 R:0.32302 P:0.17407 F:0.22623
39 ROUGE-1 Eval D0727-C.M.100.G-A.39 R:0.32899 P:0.19804 F:0.24725
39 ROUGE-1 Eval D0727-C.M.100.G-F.39 R:0.35354 P:0.20588 F:0.26022
39 ROUGE-1 Eval D0727-C.M.100.G-G.39 R:0.33003 P:0.19608 F:0.24600
39 ROUGE-1 Eval D0727-C.M.100.G-H.39 R:0.35473 P:0.20588 F:0.26054
39 ROUGE-1 Eval D0736-A.M.100.H-G.39 R:0.26165 P:0.17258 F:0.20798
39 ROUGE-1 Eval D0736-A.M.100.H-H.39 R:0.25182 P:0.16312 F:0.19799
39 ROUGE-1 Eval D0736-A.M.100.H-I.39 R:0.26335 P:0.17494 F:0.21023
39 ROUGE-1 Eval D0736-A.M.100.H-J.39 R:0.25490 P:0.18440 F:0.21399
39 ROUGE-1 Eval D0736-B.M.100.H-G.39 R:0.21374 P:0.09773 F:0.13413
39 ROUGE-1 Eval D0736-B.M.100.H-H.39 R:0.21488 P:0.09075 F:0.12761
39 ROUGE-1 Eval D0736-B.M.100.H-I.39 R:0.23013 P:0.09599 F:0.13547
39 ROUGE-1 Eval D0736-B.M.100.H-J.39 R:0.23776 P:0.11867 F:0.15832
39 ROUGE-1 Eval D0736-C.M.100.H-G.39 R:0.16456 P:0.07303 F:0.10116
39 ROUGE-1 Eval D0736-C.M.100.H-H.39 R:0.14973 P:0.05243 F:0.07766
39 ROUGE-1 Eval D0736-C.M.100.H-I.39 R:0.18182 P:0.06367 F:0.09431
39 ROUGE-1 Eval D0736-C.M.100.H-J.39 R:0.16226 P:0.08052 F:0.10763
39 ROUGE-1 Eval D0740-A.M.100.I-D.39 R:0.34653 P:0.22581 F:0.27344
39 ROUGE-1 Eval D0740-A.M.100.I-H.39 R:0.33987 P:0.22366 F:0.26978
39 ROUGE-1 Eval D0740-A.M.100.I-I.39 R:0.33766 P:0.22366 F:0.26908
39 ROUGE-1 Eval D0740-A.M.100.I-J.39 R:0.32581 P:0.21720 F:0.26064
39 ROUGE-1 Eval D0740-B.M.100.I-D.39 R:0.32468 P:0.19048 F:0.24010
39 ROUGE-1 Eval D0740-B.M.100.I-H.39 R:0.31126 P:0.17905 F:0.22733
39 ROUGE-1 Eval D0740-B.M.100.I-I.39 R:0.34098 P:0.19810 F:0.25061
39 ROUGE-1 Eval D0740-B.M.100.I-J.39 R:0.30744 P:0.18095 F:0.22781
39 ROUGE-1 Eval D0740-C.M.100.I-D.39 R:0.32588 P:0.17801 F:0.23025
39 ROUGE-1 Eval D0740-C.M.100.I-H.39 R:0.30868 P:0.16754 F:0.21719
39 ROUGE-1 Eval D0740-C.M.100.I-I.39 R:0.30990 P:0.16928 F:0.21896
39 ROUGE-1 Eval D0740-C.M.100.I-J.39 R:0.32166 P:0.17627 F:0.22774
39 ROUGE-1 Eval D0743-A.M.100.J-B.39 R:0.23175 P:0.12807 F:0.16497
39 ROUGE-1 Eval D0743-A.M.100.J-H.39 R:0.20370 P:0.11579 F:0.14765
39 ROUGE-1 Eval D0743-A.M.100.J-I.39 R:0.23125 P:0.12982 F:0.16629
39 ROUGE-1 Eval D0743-A.M.100.J-J.39 R:0.21231 P:0.12105 F:0.15419
39 ROUGE-1 Eval D0743-B.M.100.J-B.39 R:0.25641 P:0.14733 F:0.18713
39 ROUGE-1 Eval D0743-B.M.100.J-H.39 R:0.23659 P:0.13812 F:0.17442
39 ROUGE-1 Eval D0743-B.M.100.J-I.39 R:0.27848 P:0.16206 F:0.20489
39 ROUGE-1 Eval D0743-B.M.100.J-J.39 R:0.25234 P:0.14917 F:0.18750
39 ROUGE-1 Eval D0743-C.M.100.J-B.39 R:0.24762 P:0.15385 F:0.18978
39 ROUGE-1 Eval D0743-C.M.100.J-H.39 R:0.23248 P:0.14398 F:0.17783
39 ROUGE-1 Eval D0743-C.M.100.J-I.39 R:0.27157 P:0.16765 F:0.20732
39 ROUGE-1 Eval D0743-C.M.100.J-J.39 R:0.23899 P:0.14990 F:0.18424
---------------------------------------------
39 ROUGE-2 Average_R: 0.05338 (95%-conf.int. 0.04720 - 0.05962)
39 ROUGE-2 Average_P: 0.03101 (95%-conf.int. 0.02745 - 0.03461)
39 ROUGE-2 Average_F: 0.03914 (95%-conf.int. 0.03467 - 0.04371)
.............................................
39 ROUGE-2 Eval D0703-A.M.100.A-A.39 R:0.07167 P:0.05000 F:0.05891
39 ROUGE-2 Eval D0703-A.M.100.A-C.39 R:0.05424 P:0.03810 F:0.04476
39 ROUGE-2 Eval D0703-A.M.100.A-D.39 R:0.07292 P:0.05000 F:0.05932
39 ROUGE-2 Eval D0703-A.M.100.A-J.39 R:0.07904 P:0.05476 F:0.06470
39 ROUGE-2 Eval D0703-B.M.100.A-A.39 R:0.04290 P:0.02889 F:0.03453
39 ROUGE-2 Eval D0703-B.M.100.A-C.39 R:0.07119 P:0.04667 F:0.05638
39 ROUGE-2 Eval D0703-B.M.100.A-D.39 R:0.06441 P:0.04222 F:0.05101
39 ROUGE-2 Eval D0703-B.M.100.A-J.39 R:0.06376 P:0.04222 F:0.05080
39 ROUGE-2 Eval D0703-C.M.100.A-A.39 R:0.08081 P:0.04819 F:0.06038
39 ROUGE-2 Eval D0703-C.M.100.A-C.39 R:0.05574 P:0.03414 F:0.04234
39 ROUGE-2 Eval D0703-C.M.100.A-D.39 R:0.06689 P:0.04016 F:0.05019
39 ROUGE-2 Eval D0703-C.M.100.A-J.39 R:0.07692 P:0.04618 F:0.05771
39 ROUGE-2 Eval D0706-A.M.100.B-B.39 R:0.04590 P:0.02536 F:0.03267
39 ROUGE-2 Eval D0706-A.M.100.B-D.39 R:0.04950 P:0.02717 F:0.03508
39 ROUGE-2 Eval D0706-A.M.100.B-E.39 R:0.02623 P:0.01449 F:0.01867
39 ROUGE-2 Eval D0706-A.M.100.B-I.39 R:0.04590 P:0.02536 F:0.03267
39 ROUGE-2 Eval D0706-B.M.100.B-B.39 R:0.02640 P:0.01434 F:0.01858
39 ROUGE-2 Eval D0706-B.M.100.B-D.39 R:0.02961 P:0.01613 F:0.02088
39 ROUGE-2 Eval D0706-B.M.100.B-E.39 R:0.01311 P:0.00717 F:0.00927
39 ROUGE-2 Eval D0706-B.M.100.B-I.39 R:0.01961 P:0.01075 F:0.01389
39 ROUGE-2 Eval D0706-C.M.100.B-B.39 R:0.00977 P:0.00532 F:0.00689
39 ROUGE-2 Eval D0706-C.M.100.B-D.39 R:0.02932 P:0.01596 F:0.02067
39 ROUGE-2 Eval D0706-C.M.100.B-E.39 R:0.03560 P:0.01950 F:0.02520
39 ROUGE-2 Eval D0706-C.M.100.B-I.39 R:0.03226 P:0.01773 F:0.02288
39 ROUGE-2 Eval D0711-A.M.100.C-A.39 R:0.03322 P:0.02283 F:0.02706
39 ROUGE-2 Eval D0711-A.M.100.C-B.39 R:0.03704 P:0.02511 F:0.02993
39 ROUGE-2 Eval D0711-A.M.100.C-C.39 R:0.03030 P:0.02055 F:0.02449
39 ROUGE-2 Eval D0711-A.M.100.C-F.39 R:0.04013 P:0.02740 F:0.03257
39 ROUGE-2 Eval D0711-B.M.100.C-A.39 R:0.04467 P:0.02293 F:0.03030
39 ROUGE-2 Eval D0711-B.M.100.C-B.39 R:0.06228 P:0.03175 F:0.04206
39 ROUGE-2 Eval D0711-B.M.100.C-C.39 R:0.04407 P:0.02293 F:0.03016
39 ROUGE-2 Eval D0711-B.M.100.C-F.39 R:0.04452 P:0.02293 F:0.03027
39 ROUGE-2 Eval D0711-C.M.100.C-A.39 R:0.10333 P:0.05709 F:0.07355
39 ROUGE-2 Eval D0711-C.M.100.C-B.39 R:0.11724 P:0.06262 F:0.08164
39 ROUGE-2 Eval D0711-C.M.100.C-C.39 R:0.08532 P:0.04604 F:0.05981
39 ROUGE-2 Eval D0711-C.M.100.C-F.39 R:0.08191 P:0.04420 F:0.05742
39 ROUGE-2 Eval D0716-A.M.100.D-C.39 R:0.16225 P:0.09959 F:0.12342
39 ROUGE-2 Eval D0716-A.M.100.D-D.39 R:0.18182 P:0.10976 F:0.13689
39 ROUGE-2 Eval D0716-A.M.100.D-E.39 R:0.16779 P:0.10163 F:0.12659
39 ROUGE-2 Eval D0716-A.M.100.D-F.39 R:0.16000 P:0.09756 F:0.12121
39 ROUGE-2 Eval D0716-B.M.100.D-C.39 R:0.10299 P:0.05272 F:0.06974
39 ROUGE-2 Eval D0716-B.M.100.D-D.39 R:0.12203 P:0.06122 F:0.08154
39 ROUGE-2 Eval D0716-B.M.100.D-E.39 R:0.11409 P:0.05782 F:0.07675
39 ROUGE-2 Eval D0716-B.M.100.D-F.39 R:0.12458 P:0.06293 F:0.08362
39 ROUGE-2 Eval D0716-C.M.100.D-C.39 R:0.08882 P:0.05143 F:0.06514
39 ROUGE-2 Eval D0716-C.M.100.D-D.39 R:0.08784 P:0.04952 F:0.06333
39 ROUGE-2 Eval D0716-C.M.100.D-E.39 R:0.08667 P:0.04952 F:0.06303
39 ROUGE-2 Eval D0716-C.M.100.D-F.39 R:0.09764 P:0.05524 F:0.07056
39 ROUGE-2 Eval D0721-A.M.100.E-B.39 R:0.02357 P:0.01373 F:0.01735
39 ROUGE-2 Eval D0721-A.M.100.E-C.39 R:0.02951 P:0.01765 F:0.02209
39 ROUGE-2 Eval D0721-A.M.100.E-E.39 R:0.01967 P:0.01176 F:0.01472
39 ROUGE-2 Eval D0721-A.M.100.E-G.39 R:0.02572 P:0.01569 F:0.01949
39 ROUGE-2 Eval D0721-B.M.100.E-B.39 R:0.07895 P:0.04167 F:0.05455
39 ROUGE-2 Eval D0721-B.M.100.E-C.39 R:0.07395 P:0.03993 F:0.05186
39 ROUGE-2 Eval D0721-B.M.100.E-E.39 R:0.07285 P:0.03819 F:0.05011
39 ROUGE-2 Eval D0721-B.M.100.E-G.39 R:0.05863 P:0.03125 F:0.04077
39 ROUGE-2 Eval D0721-C.M.100.E-B.39 R:0.06291 P:0.03316 F:0.04343
39 ROUGE-2 Eval D0721-C.M.100.E-C.39 R:0.07333 P:0.03839 F:0.05040
39 ROUGE-2 Eval D0721-C.M.100.E-E.39 R:0.07407 P:0.03839 F:0.05057
39 ROUGE-2 Eval D0721-C.M.100.E-G.39 R:0.06908 P:0.03665 F:0.04789
39 ROUGE-2 Eval D0726-A.M.100.F-A.39 R:0.02349 P:0.01389 F:0.01746
39 ROUGE-2 Eval D0726-A.M.100.F-E.39 R:0.02020 P:0.01190 F:0.01498
39 ROUGE-2 Eval D0726-A.M.100.F-F.39 R:0.03020 P:0.01786 F:0.02245
39 ROUGE-2 Eval D0726-A.M.100.F-G.39 R:0.02685 P:0.01587 F:0.01995
39 ROUGE-2 Eval D0726-B.M.100.F-A.39 R:0.03630 P:0.02026 F:0.02601
39 ROUGE-2 Eval D0726-B.M.100.F-E.39 R:0.04698 P:0.02578 F:0.03329
39 ROUGE-2 Eval D0726-B.M.100.F-F.39 R:0.04698 P:0.02578 F:0.03329
39 ROUGE-2 Eval D0726-B.M.100.F-G.39 R:0.03987 P:0.02210 F:0.02844
39 ROUGE-2 Eval D0726-C.M.100.F-A.39 R:0.05051 P:0.02747 F:0.03559
39 ROUGE-2 Eval D0726-C.M.100.F-E.39 R:0.05102 P:0.02747 F:0.03571
39 ROUGE-2 Eval D0726-C.M.100.F-F.39 R:0.04795 P:0.02564 F:0.03341
39 ROUGE-2 Eval D0726-C.M.100.F-G.39 R:0.04305 P:0.02381 F:0.03066
39 ROUGE-2 Eval D0727-A.M.100.G-A.39 R:0.06711 P:0.04115 F:0.05102
39 ROUGE-2 Eval D0727-A.M.100.G-F.39 R:0.04319 P:0.02675 F:0.03304
39 ROUGE-2 Eval D0727-A.M.100.G-G.39 R:0.05611 P:0.03498 F:0.04309
39 ROUGE-2 Eval D0727-A.M.100.G-H.39 R:0.04319 P:0.02675 F:0.03304
39 ROUGE-2 Eval D0727-B.M.100.G-A.39 R:0.09375 P:0.05028 F:0.06546
39 ROUGE-2 Eval D0727-B.M.100.G-F.39 R:0.05574 P:0.03166 F:0.04038
39 ROUGE-2 Eval D0727-B.M.100.G-G.39 R:0.09091 P:0.04842 F:0.06319
39 ROUGE-2 Eval D0727-B.M.100.G-H.39 R:0.09028 P:0.04842 F:0.06303
39 ROUGE-2 Eval D0727-C.M.100.G-A.39 R:0.02303 P:0.01381 F:0.01727
39 ROUGE-2 Eval D0727-C.M.100.G-F.39 R:0.02721 P:0.01578 F:0.01998
39 ROUGE-2 Eval D0727-C.M.100.G-G.39 R:0.02000 P:0.01183 F:0.01487
39 ROUGE-2 Eval D0727-C.M.100.G-H.39 R:0.03072 P:0.01775 F:0.02250
39 ROUGE-2 Eval D0736-A.M.100.H-G.39 R:0.03986 P:0.02619 F:0.03161
39 ROUGE-2 Eval D0736-A.M.100.H-H.39 R:0.05535 P:0.03571 F:0.04341
39 ROUGE-2 Eval D0736-A.M.100.H-I.39 R:0.07554 P:0.05000 F:0.06017
39 ROUGE-2 Eval D0736-A.M.100.H-J.39 R:0.06271 P:0.04524 F:0.05256
39 ROUGE-2 Eval D0736-B.M.100.H-G.39 R:0.01158 P:0.00526 F:0.00723
39 ROUGE-2 Eval D0736-B.M.100.H-H.39 R:0.01674 P:0.00702 F:0.00989
39 ROUGE-2 Eval D0736-B.M.100.H-I.39 R:0.01271 P:0.00526 F:0.00744
39 ROUGE-2 Eval D0736-B.M.100.H-J.39 R:0.01767 P:0.00877 F:0.01172
39 ROUGE-2 Eval D0736-C.M.100.H-G.39 R:0.00427 P:0.00188 F:0.00261
39 ROUGE-2 Eval D0736-C.M.100.H-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-2 Eval D0736-C.M.100.H-I.39 R:0.00543 P:0.00188 F:0.00279
39 ROUGE-2 Eval D0736-C.M.100.H-J.39 R:0.00382 P:0.00188 F:0.00252
39 ROUGE-2 Eval D0740-A.M.100.I-D.39 R:0.08667 P:0.05628 F:0.06824
39 ROUGE-2 Eval D0740-A.M.100.I-H.39 R:0.08251 P:0.05411 F:0.06536
39 ROUGE-2 Eval D0740-A.M.100.I-I.39 R:0.07541 P:0.04978 F:0.05997
39 ROUGE-2 Eval D0740-A.M.100.I-J.39 R:0.07166 P:0.04762 F:0.05722
39 ROUGE-2 Eval D0740-B.M.100.I-D.39 R:0.04262 P:0.02490 F:0.03143
39 ROUGE-2 Eval D0740-B.M.100.I-H.39 R:0.04013 P:0.02299 F:0.02923
39 ROUGE-2 Eval D0740-B.M.100.I-I.39 R:0.04967 P:0.02874 F:0.03641
39 ROUGE-2 Eval D0740-B.M.100.I-J.39 R:0.03595 P:0.02107 F:0.02657
39 ROUGE-2 Eval D0740-C.M.100.I-D.39 R:0.05806 P:0.03158 F:0.04091
39 ROUGE-2 Eval D0740-C.M.100.I-H.39 R:0.03896 P:0.02105 F:0.02733
39 ROUGE-2 Eval D0740-C.M.100.I-I.39 R:0.05161 P:0.02807 F:0.03636
39 ROUGE-2 Eval D0740-C.M.100.I-J.39 R:0.05466 P:0.02982 F:0.03859
39 ROUGE-2 Eval D0743-A.M.100.J-B.39 R:0.02885 P:0.01587 F:0.02048
39 ROUGE-2 Eval D0743-A.M.100.J-H.39 R:0.01558 P:0.00882 F:0.01126
39 ROUGE-2 Eval D0743-A.M.100.J-I.39 R:0.01893 P:0.01058 F:0.01357
39 ROUGE-2 Eval D0743-A.M.100.J-J.39 R:0.02174 P:0.01235 F:0.01575
39 ROUGE-2 Eval D0743-B.M.100.J-B.39 R:0.02265 P:0.01296 F:0.01649
39 ROUGE-2 Eval D0743-B.M.100.J-H.39 R:0.01911 P:0.01111 F:0.01405
39 ROUGE-2 Eval D0743-B.M.100.J-I.39 R:0.02875 P:0.01667 F:0.02110
39 ROUGE-2 Eval D0743-B.M.100.J-J.39 R:0.02516 P:0.01481 F:0.01864
39 ROUGE-2 Eval D0743-C.M.100.J-B.39 R:0.01603 P:0.00992 F:0.01226
39 ROUGE-2 Eval D0743-C.M.100.J-H.39 R:0.01608 P:0.00992 F:0.01227
39 ROUGE-2 Eval D0743-C.M.100.J-I.39 R:0.02258 P:0.01389 F:0.01720
39 ROUGE-2 Eval D0743-C.M.100.J-J.39 R:0.01270 P:0.00794 F:0.00977
---------------------------------------------
39 ROUGE-3 Average_R: 0.01590 (95%-conf.int. 0.01267 - 0.01935)
39 ROUGE-3 Average_P: 0.00925 (95%-conf.int. 0.00735 - 0.01126)
39 ROUGE-3 Average_F: 0.01167 (95%-conf.int. 0.00928 - 0.01423)
.............................................
39 ROUGE-3 Eval D0703-A.M.100.A-A.39 R:0.02069 P:0.01439 F:0.01697
39 ROUGE-3 Eval D0703-A.M.100.A-C.39 R:0.00685 P:0.00480 F:0.00564
39 ROUGE-3 Eval D0703-A.M.100.A-D.39 R:0.02105 P:0.01439 F:0.01709
39 ROUGE-3 Eval D0703-A.M.100.A-J.39 R:0.02431 P:0.01679 F:0.01986
39 ROUGE-3 Eval D0703-B.M.100.A-A.39 R:0.02000 P:0.01342 F:0.01606
39 ROUGE-3 Eval D0703-B.M.100.A-C.39 R:0.02740 P:0.01790 F:0.02165
39 ROUGE-3 Eval D0703-B.M.100.A-D.39 R:0.02397 P:0.01566 F:0.01894
39 ROUGE-3 Eval D0703-B.M.100.A-J.39 R:0.02034 P:0.01342 F:0.01617
39 ROUGE-3 Eval D0703-C.M.100.A-A.39 R:0.01701 P:0.01010 F:0.01267
39 ROUGE-3 Eval D0703-C.M.100.A-C.39 R:0.01325 P:0.00808 F:0.01004
39 ROUGE-3 Eval D0703-C.M.100.A-D.39 R:0.01689 P:0.01010 F:0.01264
39 ROUGE-3 Eval D0703-C.M.100.A-J.39 R:0.01351 P:0.00808 F:0.01011
39 ROUGE-3 Eval D0706-A.M.100.B-B.39 R:0.01656 P:0.00911 F:0.01175
39 ROUGE-3 Eval D0706-A.M.100.B-D.39 R:0.01667 P:0.00911 F:0.01178
39 ROUGE-3 Eval D0706-A.M.100.B-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-A.M.100.B-I.39 R:0.01656 P:0.00911 F:0.01175
39 ROUGE-3 Eval D0706-B.M.100.B-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-B.M.100.B-D.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-B.M.100.B-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-B.M.100.B-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-C.M.100.B-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0706-C.M.100.B-D.39 R:0.01316 P:0.00713 F:0.00925
39 ROUGE-3 Eval D0706-C.M.100.B-E.39 R:0.01307 P:0.00713 F:0.00923
39 ROUGE-3 Eval D0706-C.M.100.B-I.39 R:0.01303 P:0.00713 F:0.00922
39 ROUGE-3 Eval D0711-A.M.100.C-A.39 R:0.00336 P:0.00230 F:0.00273
39 ROUGE-3 Eval D0711-A.M.100.C-B.39 R:0.00340 P:0.00230 F:0.00274
39 ROUGE-3 Eval D0711-A.M.100.C-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0711-A.M.100.C-F.39 R:0.00338 P:0.00230 F:0.00274
39 ROUGE-3 Eval D0711-B.M.100.C-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0711-B.M.100.C-B.39 R:0.00350 P:0.00177 F:0.00235
39 ROUGE-3 Eval D0711-B.M.100.C-C.39 R:0.00342 P:0.00177 F:0.00233
39 ROUGE-3 Eval D0711-B.M.100.C-F.39 R:0.00346 P:0.00177 F:0.00234
39 ROUGE-3 Eval D0711-C.M.100.C-A.39 R:0.05051 P:0.02778 F:0.03585
39 ROUGE-3 Eval D0711-C.M.100.C-B.39 R:0.05923 P:0.03148 F:0.04111
39 ROUGE-3 Eval D0711-C.M.100.C-C.39 R:0.03793 P:0.02037 F:0.02651
39 ROUGE-3 Eval D0711-C.M.100.C-F.39 R:0.04828 P:0.02593 F:0.03374
39 ROUGE-3 Eval D0716-A.M.100.D-C.39 R:0.07358 P:0.04499 F:0.05584
39 ROUGE-3 Eval D0716-A.M.100.D-D.39 R:0.09184 P:0.05521 F:0.06896
39 ROUGE-3 Eval D0716-A.M.100.D-E.39 R:0.07458 P:0.04499 F:0.05612
39 ROUGE-3 Eval D0716-A.M.100.D-F.39 R:0.07407 P:0.04499 F:0.05598
39 ROUGE-3 Eval D0716-B.M.100.D-C.39 R:0.03356 P:0.01709 F:0.02265
39 ROUGE-3 Eval D0716-B.M.100.D-D.39 R:0.04452 P:0.02222 F:0.02964
39 ROUGE-3 Eval D0716-B.M.100.D-E.39 R:0.04068 P:0.02051 F:0.02727
39 ROUGE-3 Eval D0716-B.M.100.D-F.39 R:0.04422 P:0.02222 F:0.02958
39 ROUGE-3 Eval D0716-C.M.100.D-C.39 R:0.02990 P:0.01724 F:0.02187
39 ROUGE-3 Eval D0716-C.M.100.D-D.39 R:0.02730 P:0.01533 F:0.01963
39 ROUGE-3 Eval D0716-C.M.100.D-E.39 R:0.02357 P:0.01341 F:0.01709
39 ROUGE-3 Eval D0716-C.M.100.D-F.39 R:0.03061 P:0.01724 F:0.02206
39 ROUGE-3 Eval D0721-A.M.100.E-B.39 R:0.00340 P:0.00197 F:0.00249
39 ROUGE-3 Eval D0721-A.M.100.E-C.39 R:0.00331 P:0.00197 F:0.00247
39 ROUGE-3 Eval D0721-A.M.100.E-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0721-A.M.100.E-G.39 R:0.00325 P:0.00197 F:0.00245
39 ROUGE-3 Eval D0721-B.M.100.E-B.39 R:0.01329 P:0.00698 F:0.00915
39 ROUGE-3 Eval D0721-B.M.100.E-C.39 R:0.01299 P:0.00698 F:0.00908
39 ROUGE-3 Eval D0721-B.M.100.E-E.39 R:0.01672 P:0.00873 F:0.01147
39 ROUGE-3 Eval D0721-B.M.100.E-G.39 R:0.00658 P:0.00349 F:0.00456
39 ROUGE-3 Eval D0721-C.M.100.E-B.39 R:0.01672 P:0.00877 F:0.01151
39 ROUGE-3 Eval D0721-C.M.100.E-C.39 R:0.03030 P:0.01579 F:0.02076
39 ROUGE-3 Eval D0721-C.M.100.E-E.39 R:0.03061 P:0.01579 F:0.02083
39 ROUGE-3 Eval D0721-C.M.100.E-G.39 R:0.03322 P:0.01754 F:0.02296
39 ROUGE-3 Eval D0726-A.M.100.F-A.39 R:0.00339 P:0.00200 F:0.00252
39 ROUGE-3 Eval D0726-A.M.100.F-E.39 R:0.00340 P:0.00200 F:0.00252
39 ROUGE-3 Eval D0726-A.M.100.F-F.39 R:0.00678 P:0.00399 F:0.00502
39 ROUGE-3 Eval D0726-A.M.100.F-G.39 R:0.00678 P:0.00399 F:0.00502
39 ROUGE-3 Eval D0726-B.M.100.F-A.39 R:0.00333 P:0.00185 F:0.00238
39 ROUGE-3 Eval D0726-B.M.100.F-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0726-B.M.100.F-F.39 R:0.00339 P:0.00185 F:0.00239
39 ROUGE-3 Eval D0726-B.M.100.F-G.39 R:0.00336 P:0.00185 F:0.00239
39 ROUGE-3 Eval D0726-C.M.100.F-A.39 R:0.01020 P:0.00552 F:0.00716
39 ROUGE-3 Eval D0726-C.M.100.F-E.39 R:0.01031 P:0.00552 F:0.00719
39 ROUGE-3 Eval D0726-C.M.100.F-F.39 R:0.00346 P:0.00184 F:0.00240
39 ROUGE-3 Eval D0726-C.M.100.F-G.39 R:0.00669 P:0.00368 F:0.00475
39 ROUGE-3 Eval D0727-A.M.100.G-A.39 R:0.02712 P:0.01656 F:0.02056
39 ROUGE-3 Eval D0727-A.M.100.G-F.39 R:0.01678 P:0.01035 F:0.01280
39 ROUGE-3 Eval D0727-A.M.100.G-G.39 R:0.02333 P:0.01449 F:0.01788
39 ROUGE-3 Eval D0727-A.M.100.G-H.39 R:0.01342 P:0.00828 F:0.01024
39 ROUGE-3 Eval D0727-B.M.100.G-A.39 R:0.04211 P:0.02247 F:0.02930
39 ROUGE-3 Eval D0727-B.M.100.G-F.39 R:0.01656 P:0.00936 F:0.01196
39 ROUGE-3 Eval D0727-B.M.100.G-G.39 R:0.04240 P:0.02247 F:0.02937
39 ROUGE-3 Eval D0727-B.M.100.G-H.39 R:0.04561 P:0.02434 F:0.03174
39 ROUGE-3 Eval D0727-C.M.100.G-A.39 R:0.00664 P:0.00397 F:0.00497
39 ROUGE-3 Eval D0727-C.M.100.G-F.39 R:0.00687 P:0.00397 F:0.00503
39 ROUGE-3 Eval D0727-C.M.100.G-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0727-C.M.100.G-H.39 R:0.00690 P:0.00397 F:0.00504
39 ROUGE-3 Eval D0736-A.M.100.H-G.39 R:0.01832 P:0.01199 F:0.01449
39 ROUGE-3 Eval D0736-A.M.100.H-H.39 R:0.02985 P:0.01918 F:0.02335
39 ROUGE-3 Eval D0736-A.M.100.H-I.39 R:0.04727 P:0.03118 F:0.03757
39 ROUGE-3 Eval D0736-A.M.100.H-J.39 R:0.04333 P:0.03118 F:0.03626
39 ROUGE-3 Eval D0736-B.M.100.H-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-B.M.100.H-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-B.M.100.H-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-B.M.100.H-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-C.M.100.H-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-C.M.100.H-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-C.M.100.H-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0736-C.M.100.H-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0740-A.M.100.I-D.39 R:0.01684 P:0.01089 F:0.01323
39 ROUGE-3 Eval D0740-A.M.100.I-H.39 R:0.01667 P:0.01089 F:0.01317
39 ROUGE-3 Eval D0740-A.M.100.I-I.39 R:0.01325 P:0.00871 F:0.01051
39 ROUGE-3 Eval D0740-A.M.100.I-J.39 R:0.01316 P:0.00871 F:0.01048
39 ROUGE-3 Eval D0740-B.M.100.I-D.39 R:0.00993 P:0.00578 F:0.00731
39 ROUGE-3 Eval D0740-B.M.100.I-H.39 R:0.01014 P:0.00578 F:0.00736
39 ROUGE-3 Eval D0740-B.M.100.I-I.39 R:0.01338 P:0.00771 F:0.00978
39 ROUGE-3 Eval D0740-B.M.100.I-J.39 R:0.00660 P:0.00385 F:0.00486
39 ROUGE-3 Eval D0740-C.M.100.I-D.39 R:0.01303 P:0.00705 F:0.00915
39 ROUGE-3 Eval D0740-C.M.100.I-H.39 R:0.00984 P:0.00529 F:0.00688
39 ROUGE-3 Eval D0740-C.M.100.I-I.39 R:0.01303 P:0.00705 F:0.00915
39 ROUGE-3 Eval D0740-C.M.100.I-J.39 R:0.01299 P:0.00705 F:0.00914
39 ROUGE-3 Eval D0743-A.M.100.J-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-A.M.100.J-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-A.M.100.J-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-A.M.100.J-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-B.M.100.J-B.39 R:0.00327 P:0.00186 F:0.00237
39 ROUGE-3 Eval D0743-B.M.100.J-H.39 R:0.00322 P:0.00186 F:0.00236
39 ROUGE-3 Eval D0743-B.M.100.J-I.39 R:0.00645 P:0.00372 F:0.00472
39 ROUGE-3 Eval D0743-B.M.100.J-J.39 R:0.00635 P:0.00372 F:0.00469
39 ROUGE-3 Eval D0743-C.M.100.J-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-C.M.100.J-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-C.M.100.J-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-3 Eval D0743-C.M.100.J-J.39 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
39 ROUGE-4 Average_R: 0.00575 (95%-conf.int. 0.00394 - 0.00791)
39 ROUGE-4 Average_P: 0.00339 (95%-conf.int. 0.00227 - 0.00468)
39 ROUGE-4 Average_F: 0.00426 (95%-conf.int. 0.00286 - 0.00586)
.............................................
39 ROUGE-4 Eval D0703-A.M.100.A-A.39 R:0.00697 P:0.00483 F:0.00571
39 ROUGE-4 Eval D0703-A.M.100.A-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0703-A.M.100.A-D.39 R:0.00709 P:0.00483 F:0.00575
39 ROUGE-4 Eval D0703-A.M.100.A-J.39 R:0.00702 P:0.00483 F:0.00572
39 ROUGE-4 Eval D0703-B.M.100.A-A.39 R:0.00673 P:0.00450 F:0.00539
39 ROUGE-4 Eval D0703-B.M.100.A-C.39 R:0.00692 P:0.00450 F:0.00545
39 ROUGE-4 Eval D0703-B.M.100.A-D.39 R:0.00692 P:0.00450 F:0.00545
39 ROUGE-4 Eval D0703-B.M.100.A-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0703-C.M.100.A-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0703-C.M.100.A-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0703-C.M.100.A-D.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0703-C.M.100.A-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-A.M.100.B-B.39 R:0.01003 P:0.00549 F:0.00710
39 ROUGE-4 Eval D0706-A.M.100.B-D.39 R:0.01010 P:0.00549 F:0.00711
39 ROUGE-4 Eval D0706-A.M.100.B-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-A.M.100.B-I.39 R:0.01003 P:0.00549 F:0.00710
39 ROUGE-4 Eval D0706-B.M.100.B-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-B.M.100.B-D.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-B.M.100.B-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-B.M.100.B-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-C.M.100.B-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0706-C.M.100.B-D.39 R:0.00664 P:0.00358 F:0.00465
39 ROUGE-4 Eval D0706-C.M.100.B-E.39 R:0.00660 P:0.00358 F:0.00464
39 ROUGE-4 Eval D0706-C.M.100.B-I.39 R:0.00658 P:0.00358 F:0.00464
39 ROUGE-4 Eval D0711-A.M.100.C-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-A.M.100.C-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-A.M.100.C-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-A.M.100.C-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-B.M.100.C-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-B.M.100.C-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-B.M.100.C-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-B.M.100.C-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0711-C.M.100.C-A.39 R:0.03061 P:0.01676 F:0.02166
39 ROUGE-4 Eval D0711-C.M.100.C-B.39 R:0.03521 P:0.01862 F:0.02436
39 ROUGE-4 Eval D0711-C.M.100.C-C.39 R:0.01742 P:0.00931 F:0.01213
39 ROUGE-4 Eval D0711-C.M.100.C-F.39 R:0.03136 P:0.01676 F:0.02185
39 ROUGE-4 Eval D0716-A.M.100.D-C.39 R:0.04054 P:0.02469 F:0.03069
39 ROUGE-4 Eval D0716-A.M.100.D-D.39 R:0.06186 P:0.03704 F:0.04634
39 ROUGE-4 Eval D0716-A.M.100.D-E.39 R:0.05137 P:0.03086 F:0.03856
39 ROUGE-4 Eval D0716-A.M.100.D-F.39 R:0.04082 P:0.02469 F:0.03077
39 ROUGE-4 Eval D0716-B.M.100.D-C.39 R:0.00339 P:0.00172 F:0.00228
39 ROUGE-4 Eval D0716-B.M.100.D-D.39 R:0.00346 P:0.00172 F:0.00230
39 ROUGE-4 Eval D0716-B.M.100.D-E.39 R:0.00342 P:0.00172 F:0.00229
39 ROUGE-4 Eval D0716-B.M.100.D-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0716-C.M.100.D-C.39 R:0.00671 P:0.00385 F:0.00489
39 ROUGE-4 Eval D0716-C.M.100.D-D.39 R:0.00690 P:0.00385 F:0.00494
39 ROUGE-4 Eval D0716-C.M.100.D-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0716-C.M.100.D-F.39 R:0.00687 P:0.00385 F:0.00493
39 ROUGE-4 Eval D0721-A.M.100.E-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-A.M.100.E-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-A.M.100.E-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-A.M.100.E-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-B.M.100.E-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-B.M.100.E-C.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-B.M.100.E-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-B.M.100.E-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0721-C.M.100.E-B.39 R:0.00338 P:0.00176 F:0.00231
39 ROUGE-4 Eval D0721-C.M.100.E-C.39 R:0.01361 P:0.00705 F:0.00929
39 ROUGE-4 Eval D0721-C.M.100.E-E.39 R:0.01031 P:0.00529 F:0.00699
39 ROUGE-4 Eval D0721-C.M.100.E-G.39 R:0.01342 P:0.00705 F:0.00924
39 ROUGE-4 Eval D0726-A.M.100.F-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-A.M.100.F-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-A.M.100.F-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-A.M.100.F-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-B.M.100.F-A.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-B.M.100.F-E.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-B.M.100.F-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-B.M.100.F-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-C.M.100.F-A.39 R:0.00344 P:0.00185 F:0.00241
39 ROUGE-4 Eval D0726-C.M.100.F-E.39 R:0.00347 P:0.00185 F:0.00241
39 ROUGE-4 Eval D0726-C.M.100.F-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0726-C.M.100.F-G.39 R:0.00338 P:0.00185 F:0.00239
39 ROUGE-4 Eval D0727-A.M.100.G-A.39 R:0.01370 P:0.00833 F:0.01036
39 ROUGE-4 Eval D0727-A.M.100.G-F.39 R:0.01017 P:0.00625 F:0.00774
39 ROUGE-4 Eval D0727-A.M.100.G-G.39 R:0.01347 P:0.00833 F:0.01029
39 ROUGE-4 Eval D0727-A.M.100.G-H.39 R:0.00339 P:0.00208 F:0.00258
39 ROUGE-4 Eval D0727-B.M.100.G-A.39 R:0.01418 P:0.00753 F:0.00984
39 ROUGE-4 Eval D0727-B.M.100.G-F.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0727-B.M.100.G-G.39 R:0.01429 P:0.00753 F:0.00986
39 ROUGE-4 Eval D0727-B.M.100.G-H.39 R:0.01418 P:0.00753 F:0.00984
39 ROUGE-4 Eval D0727-C.M.100.G-A.39 R:0.00336 P:0.00200 F:0.00251
39 ROUGE-4 Eval D0727-C.M.100.G-F.39 R:0.00347 P:0.00200 F:0.00254
39 ROUGE-4 Eval D0727-C.M.100.G-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0727-C.M.100.G-H.39 R:0.00348 P:0.00200 F:0.00254
39 ROUGE-4 Eval D0736-A.M.100.H-G.39 R:0.01481 P:0.00966 F:0.01169
39 ROUGE-4 Eval D0736-A.M.100.H-H.39 R:0.02264 P:0.01449 F:0.01767
39 ROUGE-4 Eval D0736-A.M.100.H-I.39 R:0.03676 P:0.02415 F:0.02915
39 ROUGE-4 Eval D0736-A.M.100.H-J.39 R:0.03367 P:0.02415 F:0.02813
39 ROUGE-4 Eval D0736-B.M.100.H-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-B.M.100.H-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-B.M.100.H-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-B.M.100.H-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-C.M.100.H-G.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-C.M.100.H-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-C.M.100.H-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0736-C.M.100.H-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-A.M.100.I-D.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-A.M.100.I-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-A.M.100.I-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-A.M.100.I-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-B.M.100.I-D.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-B.M.100.I-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-B.M.100.I-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-B.M.100.I-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-C.M.100.I-D.39 R:0.00329 P:0.00177 F:0.00230
39 ROUGE-4 Eval D0740-C.M.100.I-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0740-C.M.100.I-I.39 R:0.00329 P:0.00177 F:0.00230
39 ROUGE-4 Eval D0740-C.M.100.I-J.39 R:0.00328 P:0.00177 F:0.00230
39 ROUGE-4 Eval D0743-A.M.100.J-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-A.M.100.J-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-A.M.100.J-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-A.M.100.J-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-B.M.100.J-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-B.M.100.J-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-B.M.100.J-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-B.M.100.J-J.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-C.M.100.J-B.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-C.M.100.J-H.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-C.M.100.J-I.39 R:0.00000 P:0.00000 F:0.00000
39 ROUGE-4 Eval D0743-C.M.100.J-J.39 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
39 ROUGE-L Average_R: 0.27101 (95%-conf.int. 0.26142 - 0.27964)
39 ROUGE-L Average_P: 0.15686 (95%-conf.int. 0.15044 - 0.16323)
39 ROUGE-L Average_F: 0.19819 (95%-conf.int. 0.19039 - 0.20580)
.............................................
39 ROUGE-L Eval D0703-A.M.100.A-A.39 R:0.29054 P:0.20331 F:0.23922
39 ROUGE-L Eval D0703-A.M.100.A-C.39 R:0.24497 P:0.17258 F:0.20250
39 ROUGE-L Eval D0703-A.M.100.A-D.39 R:0.28179 P:0.19385 F:0.22969
39 ROUGE-L Eval D0703-A.M.100.A-J.39 R:0.27211 P:0.18913 F:0.22316
39 ROUGE-L Eval D0703-B.M.100.A-A.39 R:0.25490 P:0.17219 F:0.20554
39 ROUGE-L Eval D0703-B.M.100.A-C.39 R:0.28188 P:0.18543 F:0.22370
39 ROUGE-L Eval D0703-B.M.100.A-D.39 R:0.27852 P:0.18322 F:0.22104
39 ROUGE-L Eval D0703-B.M.100.A-J.39 R:0.27243 P:0.18102 F:0.21751
39 ROUGE-L Eval D0703-C.M.100.A-A.39 R:0.33000 P:0.19760 F:0.24719
39 ROUGE-L Eval D0703-C.M.100.A-C.39 R:0.30195 P:0.18563 F:0.22992
39 ROUGE-L Eval D0703-C.M.100.A-D.39 R:0.31126 P:0.18762 F:0.23412
39 ROUGE-L Eval D0703-C.M.100.A-J.39 R:0.34437 P:0.20758 F:0.25902
39 ROUGE-L Eval D0706-A.M.100.B-B.39 R:0.22078 P:0.12252 F:0.15759
39 ROUGE-L Eval D0706-A.M.100.B-D.39 R:0.21569 P:0.11892 F:0.15331
39 ROUGE-L Eval D0706-A.M.100.B-E.39 R:0.18506 P:0.10270 F:0.13209
39 ROUGE-L Eval D0706-A.M.100.B-I.39 R:0.22727 P:0.12613 F:0.16223
39 ROUGE-L Eval D0706-B.M.100.B-B.39 R:0.20261 P:0.11052 F:0.14302
39 ROUGE-L Eval D0706-B.M.100.B-D.39 R:0.20195 P:0.11052 F:0.14286
39 ROUGE-L Eval D0706-B.M.100.B-E.39 R:0.19805 P:0.10873 F:0.14039
39 ROUGE-L Eval D0706-B.M.100.B-I.39 R:0.20712 P:0.11408 F:0.14712
39 ROUGE-L Eval D0706-C.M.100.B-B.39 R:0.23548 P:0.12875 F:0.16648
39 ROUGE-L Eval D0706-C.M.100.B-D.39 R:0.26452 P:0.14462 F:0.18700
39 ROUGE-L Eval D0706-C.M.100.B-E.39 R:0.26282 P:0.14462 F:0.18657
39 ROUGE-L Eval D0706-C.M.100.B-I.39 R:0.26837 P:0.14815 F:0.19091
39 ROUGE-L Eval D0711-A.M.100.C-A.39 R:0.26645 P:0.18367 F:0.21745
39 ROUGE-L Eval D0711-A.M.100.C-B.39 R:0.27333 P:0.18594 F:0.22132
39 ROUGE-L Eval D0711-A.M.100.C-C.39 R:0.26667 P:0.18141 F:0.21593
39 ROUGE-L Eval D0711-A.M.100.C-F.39 R:0.26821 P:0.18367 F:0.21803
39 ROUGE-L Eval D0711-B.M.100.C-A.39 R:0.25510 P:0.13158 F:0.17361
39 ROUGE-L Eval D0711-B.M.100.C-B.39 R:0.26370 P:0.13509 F:0.17866
39 ROUGE-L Eval D0711-B.M.100.C-C.39 R:0.24497 P:0.12807 F:0.16820
39 ROUGE-L Eval D0711-B.M.100.C-F.39 R:0.25424 P:0.13158 F:0.17341
39 ROUGE-L Eval D0711-C.M.100.C-A.39 R:0.35314 P:0.19597 F:0.25206
39 ROUGE-L Eval D0711-C.M.100.C-B.39 R:0.38225 P:0.20513 F:0.26699
39 ROUGE-L Eval D0711-C.M.100.C-C.39 R:0.32095 P:0.17399 F:0.22565
39 ROUGE-L Eval D0711-C.M.100.C-F.39 R:0.30743 P:0.16667 F:0.21615
39 ROUGE-L Eval D0716-A.M.100.D-C.39 R:0.37377 P:0.23030 F:0.28500
39 ROUGE-L Eval D0716-A.M.100.D-D.39 R:0.39000 P:0.23636 F:0.29434
39 ROUGE-L Eval D0716-A.M.100.D-E.39 R:0.39203 P:0.23838 F:0.29648
39 ROUGE-L Eval D0716-A.M.100.D-F.39 R:0.36304 P:0.22222 F:0.27569
39 ROUGE-L Eval D0716-B.M.100.D-C.39 R:0.34868 P:0.17936 F:0.23687
39 ROUGE-L Eval D0716-B.M.100.D-D.39 R:0.37919 P:0.19120 F:0.25422
39 ROUGE-L Eval D0716-B.M.100.D-E.39 R:0.36545 P:0.18613 F:0.24664
39 ROUGE-L Eval D0716-B.M.100.D-F.39 R:0.38333 P:0.19459 F:0.25814
39 ROUGE-L Eval D0716-C.M.100.D-C.39 R:0.32248 P:0.18750 F:0.23713
39 ROUGE-L Eval D0716-C.M.100.D-D.39 R:0.31104 P:0.17614 F:0.22491
39 ROUGE-L Eval D0716-C.M.100.D-E.39 R:0.34323 P:0.19697 F:0.25030
39 ROUGE-L Eval D0716-C.M.100.D-F.39 R:0.33333 P:0.18939 F:0.24154
39 ROUGE-L Eval D0721-A.M.100.E-B.39 R:0.24667 P:0.14425 F:0.18204
39 ROUGE-L Eval D0721-A.M.100.E-C.39 R:0.25000 P:0.15010 F:0.18758
39 ROUGE-L Eval D0721-A.M.100.E-E.39 R:0.23052 P:0.13840 F:0.17296
39 ROUGE-L Eval D0721-A.M.100.E-G.39 R:0.23885 P:0.14620 F:0.18138
39 ROUGE-L Eval D0721-B.M.100.E-B.39 R:0.31596 P:0.16753 F:0.21896
39 ROUGE-L Eval D0721-B.M.100.E-C.39 R:0.31529 P:0.17098 F:0.22172
39 ROUGE-L Eval D0721-B.M.100.E-E.39 R:0.31803 P:0.16753 F:0.21946
39 ROUGE-L Eval D0721-B.M.100.E-G.39 R:0.29355 P:0.15717 F:0.20473
39 ROUGE-L Eval D0721-C.M.100.E-B.39 R:0.29836 P:0.15799 F:0.20659
39 ROUGE-L Eval D0721-C.M.100.E-C.39 R:0.27063 P:0.14236 F:0.18658
39 ROUGE-L Eval D0721-C.M.100.E-E.39 R:0.29667 P:0.15451 F:0.20319
39 ROUGE-L Eval D0721-C.M.100.E-G.39 R:0.27036 P:0.14410 F:0.18800
39 ROUGE-L Eval D0726-A.M.100.F-A.39 R:0.27243 P:0.16174 F:0.20298
39 ROUGE-L Eval D0726-A.M.100.F-E.39 R:0.26333 P:0.15582 F:0.19579
39 ROUGE-L Eval D0726-A.M.100.F-F.39 R:0.27575 P:0.16371 F:0.20545
39 ROUGE-L Eval D0726-A.M.100.F-G.39 R:0.26578 P:0.15779 F:0.19802
39 ROUGE-L Eval D0726-B.M.100.F-A.39 R:0.24183 P:0.13553 F:0.17371
39 ROUGE-L Eval D0726-B.M.100.F-E.39 R:0.26910 P:0.14835 F:0.19126
39 ROUGE-L Eval D0726-B.M.100.F-F.39 R:0.25914 P:0.14286 F:0.18418
39 ROUGE-L Eval D0726-B.M.100.F-G.39 R:0.28947 P:0.16117 F:0.20706
39 ROUGE-L Eval D0726-C.M.100.F-A.39 R:0.28333 P:0.15483 F:0.20024
39 ROUGE-L Eval D0726-C.M.100.F-E.39 R:0.29630 P:0.16029 F:0.20804
39 ROUGE-L Eval D0726-C.M.100.F-F.39 R:0.28136 P:0.15118 F:0.19668
39 ROUGE-L Eval D0726-C.M.100.F-G.39 R:0.26230 P:0.14572 F:0.18736
39 ROUGE-L Eval D0727-A.M.100.G-A.39 R:0.31894 P:0.19632 F:0.24304
39 ROUGE-L Eval D0727-A.M.100.G-F.39 R:0.28618 P:0.17791 F:0.21942
39 ROUGE-L Eval D0727-A.M.100.G-G.39 R:0.30719 P:0.19223 F:0.23648
39 ROUGE-L Eval D0727-A.M.100.G-H.39 R:0.32237 P:0.20041 F:0.24716
39 ROUGE-L Eval D0727-B.M.100.G-A.39 R:0.30584 P:0.16481 F:0.21420
39 ROUGE-L Eval D0727-B.M.100.G-F.39 R:0.28896 P:0.16481 F:0.20990
39 ROUGE-L Eval D0727-B.M.100.G-G.39 R:0.31142 P:0.16667 F:0.21713
39 ROUGE-L Eval D0727-B.M.100.G-H.39 R:0.29553 P:0.15926 F:0.20698
39 ROUGE-L Eval D0727-C.M.100.G-A.39 R:0.28013 P:0.16863 F:0.21053
39 ROUGE-L Eval D0727-C.M.100.G-F.39 R:0.30640 P:0.17843 F:0.22553
39 ROUGE-L Eval D0727-C.M.100.G-G.39 R:0.28383 P:0.16863 F:0.21156
39 ROUGE-L Eval D0727-C.M.100.G-H.39 R:0.30743 P:0.17843 F:0.22580
39 ROUGE-L Eval D0736-A.M.100.H-G.39 R:0.24373 P:0.16076 F:0.19374
39 ROUGE-L Eval D0736-A.M.100.H-H.39 R:0.23723 P:0.15366 F:0.18651
39 ROUGE-L Eval D0736-A.M.100.H-I.39 R:0.25267 P:0.16785 F:0.20171
39 ROUGE-L Eval D0736-A.M.100.H-J.39 R:0.24510 P:0.17730 F:0.20576
39 ROUGE-L Eval D0736-B.M.100.H-G.39 R:0.20611 P:0.09424 F:0.12934
39 ROUGE-L Eval D0736-B.M.100.H-H.39 R:0.20248 P:0.08551 F:0.12024
39 ROUGE-L Eval D0736-B.M.100.H-I.39 R:0.22594 P:0.09424 F:0.13300
39 ROUGE-L Eval D0736-B.M.100.H-J.39 R:0.22727 P:0.11344 F:0.15134
39 ROUGE-L Eval D0736-C.M.100.H-G.39 R:0.14768 P:0.06554 F:0.09079
39 ROUGE-L Eval D0736-C.M.100.H-H.39 R:0.13369 P:0.04682 F:0.06935
39 ROUGE-L Eval D0736-C.M.100.H-I.39 R:0.15508 P:0.05431 F:0.08045
39 ROUGE-L Eval D0736-C.M.100.H-J.39 R:0.15094 P:0.07491 F:0.10013
39 ROUGE-L Eval D0740-A.M.100.I-D.39 R:0.31353 P:0.20430 F:0.24739
39 ROUGE-L Eval D0740-A.M.100.I-H.39 R:0.30719 P:0.20215 F:0.24384
39 ROUGE-L Eval D0740-A.M.100.I-I.39 R:0.29870 P:0.19785 F:0.23803
39 ROUGE-L Eval D0740-A.M.100.I-J.39 R:0.29355 P:0.19570 F:0.23484
39 ROUGE-L Eval D0740-B.M.100.I-D.39 R:0.28247 P:0.16571 F:0.20888
39 ROUGE-L Eval D0740-B.M.100.I-H.39 R:0.26821 P:0.15429 F:0.19589
39 ROUGE-L Eval D0740-B.M.100.I-I.39 R:0.28852 P:0.16762 F:0.21205
39 ROUGE-L Eval D0740-B.M.100.I-J.39 R:0.26861 P:0.15810 F:0.19904
39 ROUGE-L Eval D0740-C.M.100.I-D.39 R:0.26837 P:0.14660 F:0.18962
39 ROUGE-L Eval D0740-C.M.100.I-H.39 R:0.26045 P:0.14136 F:0.18326
39 ROUGE-L Eval D0740-C.M.100.I-I.39 R:0.26198 P:0.14311 F:0.18510
39 ROUGE-L Eval D0740-C.M.100.I-J.39 R:0.26433 P:0.14485 F:0.18715
39 ROUGE-L Eval D0743-A.M.100.J-B.39 R:0.21905 P:0.12105 F:0.15593
39 ROUGE-L Eval D0743-A.M.100.J-H.39 R:0.18827 P:0.10702 F:0.13647
39 ROUGE-L Eval D0743-A.M.100.J-I.39 R:0.21250 P:0.11930 F:0.15281
39 ROUGE-L Eval D0743-A.M.100.J-J.39 R:0.19385 P:0.11053 F:0.14079
39 ROUGE-L Eval D0743-B.M.100.J-B.39 R:0.22756 P:0.13076 F:0.16608
39 ROUGE-L Eval D0743-B.M.100.J-H.39 R:0.20820 P:0.12155 F:0.15349
39 ROUGE-L Eval D0743-B.M.100.J-I.39 R:0.24684 P:0.14365 F:0.18161
39 ROUGE-L Eval D0743-B.M.100.J-J.39 R:0.22741 P:0.13444 F:0.16898
39 ROUGE-L Eval D0743-C.M.100.J-B.39 R:0.20635 P:0.12821 F:0.15815
39 ROUGE-L Eval D0743-C.M.100.J-H.39 R:0.21338 P:0.13215 F:0.16322
39 ROUGE-L Eval D0743-C.M.100.J-I.39 R:0.22364 P:0.13807 F:0.17073
39 ROUGE-L Eval D0743-C.M.100.J-J.39 R:0.19497 P:0.12229 F:0.15030
---------------------------------------------
39 ROUGE-W-1.2 Average_R: 0.09534 (95%-conf.int. 0.09212 - 0.09837)
39 ROUGE-W-1.2 Average_P: 0.10016 (95%-conf.int. 0.09609 - 0.10438)
39 ROUGE-W-1.2 Average_F: 0.09740 (95%-conf.int. 0.09370 - 0.10098)
.............................................
39 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.39 R:0.10125 P:0.12758 F:0.11290
39 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.39 R:0.08468 P:0.10843 F:0.09509
39 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.39 R:0.10199 P:0.12935 F:0.11405
39 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.39 R:0.10062 P:0.11963 F:0.10930
39 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.39 R:0.08162 P:0.10223 F:0.09077
39 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.39 R:0.08932 P:0.11119 F:0.09906
39 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.39 R:0.08901 P:0.10983 F:0.09833
39 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.39 R:0.09193 P:0.11330 F:0.10150
39 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.39 R:0.10950 P:0.12191 F:0.11537
39 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.39 R:0.09724 P:0.11286 F:0.10447
39 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.39 R:0.10162 P:0.11626 F:0.10845
39 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.39 R:0.11684 P:0.12684 F:0.12163
39 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.39 R:0.08214 P:0.08180 F:0.08197
39 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.39 R:0.07875 P:0.07967 F:0.07921
39 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.39 R:0.06651 P:0.06693 F:0.06672
39 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.39 R:0.08087 P:0.08316 F:0.08200
39 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.39 R:0.07574 P:0.07155 F:0.07359
39 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.39 R:0.07360 P:0.07102 F:0.07229
39 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.39 R:0.07052 P:0.06834 F:0.06941
39 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.39 R:0.07321 P:0.07292 F:0.07306
39 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.39 R:0.08774 P:0.08187 F:0.08470
39 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.39 R:0.09561 P:0.08998 F:0.09271
39 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.39 R:0.09592 P:0.08941 F:0.09255
39 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.39 R:0.09373 P:0.08986 F:0.09175
39 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.39 R:0.09210 P:0.11447 F:0.10207
39 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.39 R:0.09365 P:0.11539 F:0.10339
39 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.39 R:0.09014 P:0.11012 F:0.09913
39 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.39 R:0.09202 P:0.11431 F:0.10196
39 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.39 R:0.09132 P:0.08403 F:0.08752
39 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.39 R:0.08928 P:0.08571 F:0.08746
39 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.39 R:0.08301 P:0.08152 F:0.08226
39 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.39 R:0.08602 P:0.08269 F:0.08432
39 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.39 R:0.12625 P:0.13098 F:0.12857
39 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.39 R:0.13175 P:0.13221 F:0.13198
39 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.39 R:0.10749 P:0.11065 F:0.10905
39 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.39 R:0.10496 P:0.10967 F:0.10726
39 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.39 R:0.14049 P:0.15815 F:0.14880
39 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.39 R:0.14122 P:0.16306 F:0.15136
39 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.39 R:0.14493 P:0.16459 F:0.15414
39 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.39 R:0.13104 P:0.15254 F:0.14097
39 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.39 R:0.12564 P:0.11274 F:0.11884
39 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.39 R:0.13403 P:0.12094 F:0.12715
39 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.39 R:0.13007 P:0.11793 F:0.12370
39 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.39 R:0.13637 P:0.12253 F:0.12908
39 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.39 R:0.10844 P:0.11753 F:0.11280
39 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.39 R:0.10309 P:0.11321 F:0.10791
39 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.39 R:0.11119 P:0.12366 F:0.11709
39 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.39 R:0.10715 P:0.11843 F:0.11251
39 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.39 R:0.08757 P:0.09002 F:0.08878
39 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.39 R:0.08831 P:0.09407 F:0.09110
39 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.39 R:0.08122 P:0.08760 F:0.08429
39 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.39 R:0.08518 P:0.09137 F:0.08817
39 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.39 R:0.10637 P:0.10903 F:0.10768
39 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.39 R:0.10673 P:0.10878 F:0.10775
39 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.39 R:0.10398 P:0.10751 F:0.10572
39 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.39 R:0.09281 P:0.09918 F:0.09589
39 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.39 R:0.10335 P:0.10073 F:0.10202
39 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.39 R:0.09615 P:0.09516 F:0.09565
39 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.39 R:0.10315 P:0.10027 F:0.10169
39 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.39 R:0.09614 P:0.09583 F:0.09598
39 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.39 R:0.09571 P:0.10070 F:0.09814
39 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.39 R:0.09278 P:0.09618 F:0.09445
39 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.39 R:0.09606 P:0.10158 F:0.09874
39 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.39 R:0.09153 P:0.09837 F:0.09483
39 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.39 R:0.08951 P:0.08824 F:0.08887
39 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.39 R:0.09769 P:0.09722 F:0.09745
39 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.39 R:0.09430 P:0.09445 F:0.09437
39 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.39 R:0.10179 P:0.10233 F:0.10206
39 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.39 R:0.10220 P:0.09806 F:0.10009
39 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.39 R:0.10687 P:0.10204 F:0.10440
39 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.39 R:0.09838 P:0.09467 F:0.09649
39 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.39 R:0.09264 P:0.09215 F:0.09239
39 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.39 R:0.11113 P:0.12040 F:0.11558
39 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.39 R:0.09569 P:0.10858 F:0.10173
39 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.39 R:0.10618 P:0.11767 F:0.11163
39 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.39 R:0.10767 P:0.11998 F:0.11349
39 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.39 R:0.11772 P:0.11131 F:0.11443
39 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.39 R:0.10416 P:0.10672 F:0.10542
39 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.39 R:0.11570 P:0.11091 F:0.11325
39 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.39 R:0.11083 P:0.10572 F:0.10821
39 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.39 R:0.09485 P:0.10268 F:0.09861
39 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.39 R:0.10431 P:0.11227 F:0.10814
39 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.39 R:0.09728 P:0.10638 F:0.10163
39 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.39 R:0.10564 P:0.11035 F:0.10794
39 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.39 R:0.09162 P:0.10702 F:0.09872
39 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.39 R:0.09506 P:0.10828 F:0.10124
39 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.39 R:0.10077 P:0.11961 F:0.10938
39 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.39 R:0.09534 P:0.12296 F:0.10740
39 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.39 R:0.07114 P:0.06021 F:0.06522
39 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.39 R:0.07215 P:0.05638 F:0.06330
39 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.39 R:0.07850 P:0.06047 F:0.06832
39 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.39 R:0.07725 P:0.07128 F:0.07415
39 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.39 R:0.05474 P:0.04414 F:0.04887
39 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.39 R:0.05023 P:0.03288 F:0.03974
39 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.39 R:0.05924 P:0.03784 F:0.04618
39 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.39 R:0.05562 P:0.04925 F:0.05224
39 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.39 R:0.11332 P:0.13582 F:0.12355
39 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.39 R:0.10863 P:0.12896 F:0.11793
39 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.39 R:0.10181 P:0.12473 F:0.11211
39 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.39 R:0.10272 P:0.12581 F:0.11310
39 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.39 R:0.09666 P:0.10419 F:0.10028
39 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.39 R:0.09487 P:0.09712 F:0.09598
39 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.39 R:0.09579 P:0.10457 F:0.09999
39 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.39 R:0.09537 P:0.10035 F:0.09780
39 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.39 R:0.08817 P:0.09295 F:0.09050
39 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.39 R:0.08756 P:0.08869 F:0.08812
39 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.39 R:0.08513 P:0.09094 F:0.08794
39 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.39 R:0.08792 P:0.09233 F:0.09007
39 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.39 R:0.08052 P:0.07757 F:0.07902
39 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.39 R:0.06927 P:0.06802 F:0.06864
39 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.39 R:0.07612 P:0.07583 F:0.07597
39 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.39 R:0.07356 P:0.07281 F:0.07318
39 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.39 R:0.08472 P:0.08152 F:0.08309
39 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.39 R:0.08107 P:0.07849 F:0.07976
39 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.39 R:0.09222 P:0.09044 F:0.09132
39 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.39 R:0.08743 P:0.08497 F:0.08618
39 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.39 R:0.07429 P:0.08080 F:0.07741
39 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.39 R:0.08123 P:0.08401 F:0.08260
39 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.39 R:0.08010 P:0.08812 F:0.08392
39 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.39 R:0.07519 P:0.07938 F:0.07723
---------------------------------------------
39 ROUGE-SU4 Average_R: 0.09744 (95%-conf.int. 0.09123 - 0.10369)
39 ROUGE-SU4 Average_P: 0.05592 (95%-conf.int. 0.05220 - 0.05969)
39 ROUGE-SU4 Average_F: 0.07088 (95%-conf.int. 0.06630 - 0.07547)
.............................................
39 ROUGE-SU4 Eval D0703-A.M.100.A-A.39 R:0.10822 P:0.07510 F:0.08867
39 ROUGE-SU4 Eval D0703-A.M.100.A-C.39 R:0.08448 P:0.05904 F:0.06951
39 ROUGE-SU4 Eval D0703-A.M.100.A-D.39 R:0.10130 P:0.06908 F:0.08214
39 ROUGE-SU4 Eval D0703-A.M.100.A-J.39 R:0.10198 P:0.07028 F:0.08321
39 ROUGE-SU4 Eval D0703-B.M.100.A-A.39 R:0.09564 P:0.06404 F:0.07671
39 ROUGE-SU4 Eval D0703-B.M.100.A-C.39 R:0.10805 P:0.07041 F:0.08526
39 ROUGE-SU4 Eval D0703-B.M.100.A-D.39 R:0.10575 P:0.06891 F:0.08344
39 ROUGE-SU4 Eval D0703-B.M.100.A-J.39 R:0.10068 P:0.06629 F:0.07994
39 ROUGE-SU4 Eval D0703-C.M.100.A-A.39 R:0.13014 P:0.07708 F:0.09682
39 ROUGE-SU4 Eval D0703-C.M.100.A-C.39 R:0.11500 P:0.06998 F:0.08701
39 ROUGE-SU4 Eval D0703-C.M.100.A-D.39 R:0.11565 P:0.06897 F:0.08641
39 ROUGE-SU4 Eval D0703-C.M.100.A-J.39 R:0.12925 P:0.07708 F:0.09657
39 ROUGE-SU4 Eval D0706-A.M.100.B-B.39 R:0.07167 P:0.03931 F:0.05077
39 ROUGE-SU4 Eval D0706-A.M.100.B-D.39 R:0.07215 P:0.03931 F:0.05089
39 ROUGE-SU4 Eval D0706-A.M.100.B-E.39 R:0.05333 P:0.02925 F:0.03778
39 ROUGE-SU4 Eval D0706-A.M.100.B-I.39 R:0.07167 P:0.03931 F:0.05077
39 ROUGE-SU4 Eval D0706-B.M.100.B-B.39 R:0.05761 P:0.03104 F:0.04034
39 ROUGE-SU4 Eval D0706-B.M.100.B-D.39 R:0.05686 P:0.03074 F:0.03991
39 ROUGE-SU4 Eval D0706-B.M.100.B-E.39 R:0.05778 P:0.03134 F:0.04064
39 ROUGE-SU4 Eval D0706-B.M.100.B-I.39 R:0.05648 P:0.03074 F:0.03981
39 ROUGE-SU4 Eval D0706-C.M.100.B-B.39 R:0.07119 P:0.03846 F:0.04994
39 ROUGE-SU4 Eval D0706-C.M.100.B-D.39 R:0.08830 P:0.04770 F:0.06194
39 ROUGE-SU4 Eval D0706-C.M.100.B-E.39 R:0.08827 P:0.04800 F:0.06218
39 ROUGE-SU4 Eval D0706-C.M.100.B-I.39 R:0.08852 P:0.04830 F:0.06250
39 ROUGE-SU4 Eval D0711-A.M.100.C-A.39 R:0.08671 P:0.05928 F:0.07042
39 ROUGE-SU4 Eval D0711-A.M.100.C-B.39 R:0.09189 P:0.06197 F:0.07402
39 ROUGE-SU4 Eval D0711-A.M.100.C-C.39 R:0.08048 P:0.05427 F:0.06483
39 ROUGE-SU4 Eval D0711-A.M.100.C-F.39 R:0.09184 P:0.06236 F:0.07428
39 ROUGE-SU4 Eval D0711-B.M.100.C-A.39 R:0.09382 P:0.04775 F:0.06329
39 ROUGE-SU4 Eval D0711-B.M.100.C-B.39 R:0.09918 P:0.05012 F:0.06659
39 ROUGE-SU4 Eval D0711-B.M.100.C-C.39 R:0.08793 P:0.04537 F:0.05986
39 ROUGE-SU4 Eval D0711-B.M.100.C-F.39 R:0.09059 P:0.04626 F:0.06125
39 ROUGE-SU4 Eval D0711-C.M.100.C-A.39 R:0.15593 P:0.08550 F:0.11044
39 ROUGE-SU4 Eval D0711-C.M.100.C-B.39 R:0.16842 P:0.08922 F:0.11665
39 ROUGE-SU4 Eval D0711-C.M.100.C-C.39 R:0.12847 P:0.06877 F:0.08959
39 ROUGE-SU4 Eval D0711-C.M.100.C-F.39 R:0.13715 P:0.07342 F:0.09564
39 ROUGE-SU4 Eval D0716-A.M.100.D-C.39 R:0.20202 P:0.12320 F:0.15306
39 ROUGE-SU4 Eval D0716-A.M.100.D-D.39 R:0.21689 P:0.13005 F:0.16260
39 ROUGE-SU4 Eval D0716-A.M.100.D-E.39 R:0.20535 P:0.12355 F:0.15428
39 ROUGE-SU4 Eval D0716-A.M.100.D-F.39 R:0.19492 P:0.11807 F:0.14706
39 ROUGE-SU4 Eval D0716-B.M.100.D-C.39 R:0.16216 P:0.08233 F:0.10921
39 ROUGE-SU4 Eval D0716-B.M.100.D-D.39 R:0.17701 P:0.08805 F:0.11760
39 ROUGE-SU4 Eval D0716-B.M.100.D-E.39 R:0.16212 P:0.08148 F:0.10845
39 ROUGE-SU4 Eval D0716-B.M.100.D-F.39 R:0.17523 P:0.08776 F:0.11695
39 ROUGE-SU4 Eval D0716-C.M.100.D-C.39 R:0.11483 P:0.06603 F:0.08385
39 ROUGE-SU4 Eval D0716-C.M.100.D-D.39 R:0.12428 P:0.06955 F:0.08919
39 ROUGE-SU4 Eval D0716-C.M.100.D-E.39 R:0.12768 P:0.07244 F:0.09244
39 ROUGE-SU4 Eval D0716-C.M.100.D-F.39 R:0.12614 P:0.07083 F:0.09072
39 ROUGE-SU4 Eval D0721-A.M.100.E-B.39 R:0.07705 P:0.04455 F:0.05646
39 ROUGE-SU4 Eval D0721-A.M.100.E-C.39 R:0.07833 P:0.04653 F:0.05838
39 ROUGE-SU4 Eval D0721-A.M.100.E-E.39 R:0.06722 P:0.03993 F:0.05010
39 ROUGE-SU4 Eval D0721-A.M.100.E-G.39 R:0.06972 P:0.04224 F:0.05261
39 ROUGE-SU4 Eval D0721-B.M.100.E-B.39 R:0.11204 P:0.05867 F:0.07701
39 ROUGE-SU4 Eval D0721-B.M.100.E-C.39 R:0.10893 P:0.05838 F:0.07602
39 ROUGE-SU4 Eval D0721-B.M.100.E-E.39 R:0.11279 P:0.05867 F:0.07719
39 ROUGE-SU4 Eval D0721-B.M.100.E-G.39 R:0.09492 P:0.05020 F:0.06567
39 ROUGE-SU4 Eval D0721-C.M.100.E-B.39 R:0.11111 P:0.05810 F:0.07630
39 ROUGE-SU4 Eval D0721-C.M.100.E-C.39 R:0.10904 P:0.05663 F:0.07455
39 ROUGE-SU4 Eval D0721-C.M.100.E-E.39 R:0.11073 P:0.05692 F:0.07519
39 ROUGE-SU4 Eval D0721-C.M.100.E-G.39 R:0.10368 P:0.05458 F:0.07151
39 ROUGE-SU4 Eval D0726-A.M.100.F-A.39 R:0.08362 P:0.04910 F:0.06187
39 ROUGE-SU4 Eval D0726-A.M.100.F-E.39 R:0.07648 P:0.04476 F:0.05647
39 ROUGE-SU4 Eval D0726-A.M.100.F-F.39 R:0.08646 P:0.05077 F:0.06397
39 ROUGE-SU4 Eval D0726-A.M.100.F-G.39 R:0.08476 P:0.04977 F:0.06271
39 ROUGE-SU4 Eval D0726-B.M.100.F-A.39 R:0.07774 P:0.04306 F:0.05542
39 ROUGE-SU4 Eval D0726-B.M.100.F-E.39 R:0.08760 P:0.04771 F:0.06178
39 ROUGE-SU4 Eval D0726-B.M.100.F-F.39 R:0.09044 P:0.04926 F:0.06378
39 ROUGE-SU4 Eval D0726-B.M.100.F-G.39 R:0.09178 P:0.05050 F:0.06515
39 ROUGE-SU4 Eval D0726-C.M.100.F-A.39 R:0.09304 P:0.05022 F:0.06523
39 ROUGE-SU4 Eval D0726-C.M.100.F-E.39 R:0.09862 P:0.05268 F:0.06868
39 ROUGE-SU4 Eval D0726-C.M.100.F-F.39 R:0.10163 P:0.05391 F:0.07045
39 ROUGE-SU4 Eval D0726-C.M.100.F-G.39 R:0.09484 P:0.05206 F:0.06722
39 ROUGE-SU4 Eval D0727-A.M.100.G-A.39 R:0.12685 P:0.07727 F:0.09604
39 ROUGE-SU4 Eval D0727-A.M.100.G-F.39 R:0.10586 P:0.06514 F:0.08065
39 ROUGE-SU4 Eval D0727-A.M.100.G-G.39 R:0.11689 P:0.07242 F:0.08943
39 ROUGE-SU4 Eval D0727-A.M.100.G-H.39 R:0.12050 P:0.07415 F:0.09181
39 ROUGE-SU4 Eval D0727-B.M.100.G-A.39 R:0.12367 P:0.06579 F:0.08589
39 ROUGE-SU4 Eval D0727-B.M.100.G-F.39 R:0.09833 P:0.05545 F:0.07091
39 ROUGE-SU4 Eval D0727-B.M.100.G-G.39 R:0.12574 P:0.06642 F:0.08692
39 ROUGE-SU4 Eval D0727-B.M.100.G-H.39 R:0.11543 P:0.06140 F:0.08016
39 ROUGE-SU4 Eval D0727-C.M.100.G-A.39 R:0.09588 P:0.05710 F:0.07157
39 ROUGE-SU4 Eval D0727-C.M.100.G-F.39 R:0.10092 P:0.05810 F:0.07374
39 ROUGE-SU4 Eval D0727-C.M.100.G-G.39 R:0.09379 P:0.05511 F:0.06943
39 ROUGE-SU4 Eval D0727-C.M.100.G-H.39 R:0.10417 P:0.05976 F:0.07595
39 ROUGE-SU4 Eval D0736-A.M.100.H-G.39 R:0.07688 P:0.05020 F:0.06074
39 ROUGE-SU4 Eval D0736-A.M.100.H-H.39 R:0.09211 P:0.05904 F:0.07196
39 ROUGE-SU4 Eval D0736-A.M.100.H-I.39 R:0.10256 P:0.06747 F:0.08139
39 ROUGE-SU4 Eval D0736-A.M.100.H-J.39 R:0.09787 P:0.07028 F:0.08181
39 ROUGE-SU4 Eval D0736-B.M.100.H-G.39 R:0.05512 P:0.02478 F:0.03419
39 ROUGE-SU4 Eval D0736-B.M.100.H-H.39 R:0.05128 P:0.02124 F:0.03004
39 ROUGE-SU4 Eval D0736-B.M.100.H-I.39 R:0.06061 P:0.02478 F:0.03518
39 ROUGE-SU4 Eval D0736-B.M.100.H-J.39 R:0.06295 P:0.03097 F:0.04152
39 ROUGE-SU4 Eval D0736-C.M.100.H-G.39 R:0.03421 P:0.01489 F:0.02075
39 ROUGE-SU4 Eval D0736-C.M.100.H-H.39 R:0.03259 P:0.01109 F:0.01655
39 ROUGE-SU4 Eval D0736-C.M.100.H-I.39 R:0.03818 P:0.01299 F:0.01938
39 ROUGE-SU4 Eval D0736-C.M.100.H-J.39 R:0.03502 P:0.01711 F:0.02299
39 ROUGE-SU4 Eval D0740-A.M.100.I-D.39 R:0.11808 P:0.07622 F:0.09264
39 ROUGE-SU4 Eval D0740-A.M.100.I-H.39 R:0.11130 P:0.07257 F:0.08786
39 ROUGE-SU4 Eval D0740-A.M.100.I-I.39 R:0.11389 P:0.07476 F:0.09027
39 ROUGE-SU4 Eval D0740-A.M.100.I-J.39 R:0.10706 P:0.07075 F:0.08520
39 ROUGE-SU4 Eval D0740-B.M.100.I-D.39 R:0.09056 P:0.05255 F:0.06651
39 ROUGE-SU4 Eval D0740-B.M.100.I-H.39 R:0.08390 P:0.04771 F:0.06083
39 ROUGE-SU4 Eval D0740-B.M.100.I-I.39 R:0.09933 P:0.05706 F:0.07248
39 ROUGE-SU4 Eval D0740-B.M.100.I-J.39 R:0.08527 P:0.04965 F:0.06276
39 ROUGE-SU4 Eval D0740-C.M.100.I-D.39 R:0.10328 P:0.05575 F:0.07241
39 ROUGE-SU4 Eval D0740-C.M.100.I-H.39 R:0.09406 P:0.05044 F:0.06567
39 ROUGE-SU4 Eval D0740-C.M.100.I-I.39 R:0.09454 P:0.05103 F:0.06628
39 ROUGE-SU4 Eval D0740-C.M.100.I-J.39 R:0.10185 P:0.05516 F:0.07156
39 ROUGE-SU4 Eval D0743-A.M.100.J-B.39 R:0.05917 P:0.03233 F:0.04181
39 ROUGE-SU4 Eval D0743-A.M.100.J-H.39 R:0.05011 P:0.02817 F:0.03607
39 ROUGE-SU4 Eval D0743-A.M.100.J-I.39 R:0.05716 P:0.03173 F:0.04081
39 ROUGE-SU4 Eval D0743-A.M.100.J-J.39 R:0.05258 P:0.02966 F:0.03793
39 ROUGE-SU4 Eval D0743-B.M.100.J-B.39 R:0.07127 P:0.04050 F:0.05165
39 ROUGE-SU4 Eval D0743-B.M.100.J-H.39 R:0.06203 P:0.03583 F:0.04542
39 ROUGE-SU4 Eval D0743-B.M.100.J-I.39 R:0.07955 P:0.04579 F:0.05812
39 ROUGE-SU4 Eval D0743-B.M.100.J-J.39 R:0.07082 P:0.04143 F:0.05228
39 ROUGE-SU4 Eval D0743-C.M.100.J-B.39 R:0.06243 P:0.03841 F:0.04756
39 ROUGE-SU4 Eval D0743-C.M.100.J-H.39 R:0.06209 P:0.03808 F:0.04721
39 ROUGE-SU4 Eval D0743-C.M.100.J-I.39 R:0.07158 P:0.04375 F:0.05431
39 ROUGE-SU4 Eval D0743-C.M.100.J-J.39 R:0.05806 P:0.03607 F:0.04450
---------------------------------------------
40 ROUGE-1 Average_R: 0.37741 (95%-conf.int. 0.36522 - 0.38904)
40 ROUGE-1 Average_P: 0.24739 (95%-conf.int. 0.24026 - 0.25442)
40 ROUGE-1 Average_F: 0.29782 (95%-conf.int. 0.28953 - 0.30631)
.............................................
40 ROUGE-1 Eval D0703-A.M.100.A-A.40 R:0.40878 P:0.27816 F:0.33105
40 ROUGE-1 Eval D0703-A.M.100.A-C.40 R:0.40268 P:0.27586 F:0.32742
40 ROUGE-1 Eval D0703-A.M.100.A-D.40 R:0.39863 P:0.26667 F:0.31956
40 ROUGE-1 Eval D0703-A.M.100.A-J.40 R:0.40816 P:0.27586 F:0.32922
40 ROUGE-1 Eval D0703-B.M.100.A-A.40 R:0.37582 P:0.25386 F:0.30303
40 ROUGE-1 Eval D0703-B.M.100.A-C.40 R:0.38591 P:0.25386 F:0.30626
40 ROUGE-1 Eval D0703-B.M.100.A-D.40 R:0.38255 P:0.25166 F:0.30360
40 ROUGE-1 Eval D0703-B.M.100.A-J.40 R:0.38206 P:0.25386 F:0.30504
40 ROUGE-1 Eval D0703-C.M.100.A-A.40 R:0.36667 P:0.27160 F:0.31205
40 ROUGE-1 Eval D0703-C.M.100.A-C.40 R:0.36364 P:0.27654 F:0.31416
40 ROUGE-1 Eval D0703-C.M.100.A-D.40 R:0.35762 P:0.26667 F:0.30552
40 ROUGE-1 Eval D0703-C.M.100.A-J.40 R:0.36755 P:0.27407 F:0.31400
40 ROUGE-1 Eval D0706-A.M.100.B-B.40 R:0.39610 P:0.28046 F:0.32840
40 ROUGE-1 Eval D0706-A.M.100.B-D.40 R:0.36601 P:0.25747 F:0.30229
40 ROUGE-1 Eval D0706-A.M.100.B-E.40 R:0.32143 P:0.22759 F:0.26649
40 ROUGE-1 Eval D0706-A.M.100.B-I.40 R:0.38961 P:0.27586 F:0.32301
40 ROUGE-1 Eval D0706-B.M.100.B-B.40 R:0.34314 P:0.21739 F:0.26616
40 ROUGE-1 Eval D0706-B.M.100.B-D.40 R:0.36156 P:0.22981 F:0.28101
40 ROUGE-1 Eval D0706-B.M.100.B-E.40 R:0.34416 P:0.21946 F:0.26802
40 ROUGE-1 Eval D0706-B.M.100.B-I.40 R:0.36570 P:0.23395 F:0.28535
40 ROUGE-1 Eval D0706-C.M.100.B-B.40 R:0.36774 P:0.23899 F:0.28970
40 ROUGE-1 Eval D0706-C.M.100.B-D.40 R:0.35806 P:0.23270 F:0.28208
40 ROUGE-1 Eval D0706-C.M.100.B-E.40 R:0.38141 P:0.24948 F:0.30165
40 ROUGE-1 Eval D0706-C.M.100.B-I.40 R:0.40575 P:0.26625 F:0.32152
40 ROUGE-1 Eval D0711-A.M.100.C-A.40 R:0.39145 P:0.26984 F:0.31946
40 ROUGE-1 Eval D0711-A.M.100.C-B.40 R:0.35667 P:0.24263 F:0.28880
40 ROUGE-1 Eval D0711-A.M.100.C-C.40 R:0.36333 P:0.24717 F:0.29420
40 ROUGE-1 Eval D0711-A.M.100.C-F.40 R:0.38079 P:0.26077 F:0.30955
40 ROUGE-1 Eval D0711-B.M.100.C-A.40 R:0.34014 P:0.22831 F:0.27322
40 ROUGE-1 Eval D0711-B.M.100.C-B.40 R:0.37671 P:0.25114 F:0.30137
40 ROUGE-1 Eval D0711-B.M.100.C-C.40 R:0.35235 P:0.23973 F:0.28533
40 ROUGE-1 Eval D0711-B.M.100.C-F.40 R:0.37627 P:0.25342 F:0.30286
40 ROUGE-1 Eval D0711-C.M.100.C-A.40 R:0.37954 P:0.26995 F:0.31550
40 ROUGE-1 Eval D0711-C.M.100.C-B.40 R:0.36519 P:0.25117 F:0.29763
40 ROUGE-1 Eval D0711-C.M.100.C-C.40 R:0.37838 P:0.26291 F:0.31025
40 ROUGE-1 Eval D0711-C.M.100.C-F.40 R:0.36149 P:0.25117 F:0.29640
40 ROUGE-1 Eval D0716-A.M.100.D-C.40 R:0.51475 P:0.34430 F:0.41261
40 ROUGE-1 Eval D0716-A.M.100.D-D.40 R:0.52000 P:0.34211 F:0.41270
40 ROUGE-1 Eval D0716-A.M.100.D-E.40 R:0.51827 P:0.34211 F:0.41216
40 ROUGE-1 Eval D0716-A.M.100.D-F.40 R:0.52145 P:0.34649 F:0.41634
40 ROUGE-1 Eval D0716-B.M.100.D-C.40 R:0.37171 P:0.25977 F:0.30582
40 ROUGE-1 Eval D0716-B.M.100.D-D.40 R:0.39597 P:0.27126 F:0.32196
40 ROUGE-1 Eval D0716-B.M.100.D-E.40 R:0.34551 P:0.23908 F:0.28261
40 ROUGE-1 Eval D0716-B.M.100.D-F.40 R:0.36333 P:0.25057 F:0.29659
40 ROUGE-1 Eval D0716-C.M.100.D-C.40 R:0.42997 P:0.29333 F:0.34874
40 ROUGE-1 Eval D0716-C.M.100.D-D.40 R:0.45151 P:0.30000 F:0.36048
40 ROUGE-1 Eval D0716-C.M.100.D-E.40 R:0.46535 P:0.31333 F:0.37450
40 ROUGE-1 Eval D0716-C.M.100.D-F.40 R:0.45000 P:0.30000 F:0.36000
40 ROUGE-1 Eval D0721-A.M.100.E-B.40 R:0.29667 P:0.22306 F:0.25465
40 ROUGE-1 Eval D0721-A.M.100.E-C.40 R:0.29545 P:0.22807 F:0.25742
40 ROUGE-1 Eval D0721-A.M.100.E-E.40 R:0.28571 P:0.22055 F:0.24894
40 ROUGE-1 Eval D0721-A.M.100.E-G.40 R:0.29299 P:0.23058 F:0.25807
40 ROUGE-1 Eval D0721-B.M.100.E-B.40 R:0.33550 P:0.27249 F:0.30073
40 ROUGE-1 Eval D0721-B.M.100.E-C.40 R:0.33439 P:0.27778 F:0.30347
40 ROUGE-1 Eval D0721-B.M.100.E-E.40 R:0.31475 P:0.25397 F:0.28111
40 ROUGE-1 Eval D0721-B.M.100.E-G.40 R:0.32581 P:0.26720 F:0.29361
40 ROUGE-1 Eval D0721-C.M.100.E-B.40 R:0.41311 P:0.31579 F:0.35795
40 ROUGE-1 Eval D0721-C.M.100.E-C.40 R:0.38284 P:0.29073 F:0.33049
40 ROUGE-1 Eval D0721-C.M.100.E-E.40 R:0.35333 P:0.26566 F:0.30329
40 ROUGE-1 Eval D0721-C.M.100.E-G.40 R:0.39088 P:0.30075 F:0.33994
40 ROUGE-1 Eval D0726-A.M.100.F-A.40 R:0.45847 P:0.31081 F:0.37047
40 ROUGE-1 Eval D0726-A.M.100.F-E.40 R:0.44000 P:0.29730 F:0.35484
40 ROUGE-1 Eval D0726-A.M.100.F-F.40 R:0.45847 P:0.31081 F:0.37047
40 ROUGE-1 Eval D0726-A.M.100.F-G.40 R:0.44850 P:0.30405 F:0.36241
40 ROUGE-1 Eval D0726-B.M.100.F-A.40 R:0.33987 P:0.24940 F:0.28769
40 ROUGE-1 Eval D0726-B.M.100.F-E.40 R:0.34884 P:0.25180 F:0.29248
40 ROUGE-1 Eval D0726-B.M.100.F-F.40 R:0.35216 P:0.25420 F:0.29527
40 ROUGE-1 Eval D0726-B.M.100.F-G.40 R:0.32566 P:0.23741 F:0.27462
40 ROUGE-1 Eval D0726-C.M.100.F-A.40 R:0.32333 P:0.23951 F:0.27518
40 ROUGE-1 Eval D0726-C.M.100.F-E.40 R:0.32660 P:0.23951 F:0.27636
40 ROUGE-1 Eval D0726-C.M.100.F-F.40 R:0.27119 P:0.19753 F:0.22857
40 ROUGE-1 Eval D0726-C.M.100.F-G.40 R:0.25246 P:0.19012 F:0.21690
40 ROUGE-1 Eval D0727-A.M.100.G-A.40 R:0.40864 P:0.25625 F:0.31498
40 ROUGE-1 Eval D0727-A.M.100.G-F.40 R:0.40461 P:0.25625 F:0.31378
40 ROUGE-1 Eval D0727-A.M.100.G-G.40 R:0.37582 P:0.23958 F:0.29262
40 ROUGE-1 Eval D0727-A.M.100.G-H.40 R:0.40132 P:0.25417 F:0.31123
40 ROUGE-1 Eval D0727-B.M.100.G-A.40 R:0.37457 P:0.21002 F:0.26914
40 ROUGE-1 Eval D0727-B.M.100.G-F.40 R:0.36039 P:0.21387 F:0.26844
40 ROUGE-1 Eval D0727-B.M.100.G-G.40 R:0.33218 P:0.18497 F:0.23762
40 ROUGE-1 Eval D0727-B.M.100.G-H.40 R:0.35739 P:0.20039 F:0.25679
40 ROUGE-1 Eval D0727-C.M.100.G-A.40 R:0.33876 P:0.21010 F:0.25935
40 ROUGE-1 Eval D0727-C.M.100.G-F.40 R:0.35354 P:0.21212 F:0.26515
40 ROUGE-1 Eval D0727-C.M.100.G-G.40 R:0.34983 P:0.21414 F:0.26566
40 ROUGE-1 Eval D0727-C.M.100.G-H.40 R:0.37500 P:0.22424 F:0.28066
40 ROUGE-1 Eval D0736-A.M.100.H-G.40 R:0.34409 P:0.17978 F:0.23617
40 ROUGE-1 Eval D0736-A.M.100.H-H.40 R:0.40511 P:0.20787 F:0.27476
40 ROUGE-1 Eval D0736-A.M.100.H-I.40 R:0.37722 P:0.19850 F:0.26012
40 ROUGE-1 Eval D0736-A.M.100.H-J.40 R:0.36928 P:0.21161 F:0.26905
40 ROUGE-1 Eval D0736-B.M.100.H-G.40 R:0.61069 P:0.34188 F:0.43836
40 ROUGE-1 Eval D0736-B.M.100.H-H.40 R:0.63636 P:0.32906 F:0.43380
40 ROUGE-1 Eval D0736-B.M.100.H-I.40 R:0.62762 P:0.32051 F:0.42433
40 ROUGE-1 Eval D0736-B.M.100.H-J.40 R:0.58042 P:0.35470 F:0.44032
40 ROUGE-1 Eval D0736-C.M.100.H-G.40 R:0.42616 P:0.20404 F:0.27596
40 ROUGE-1 Eval D0736-C.M.100.H-H.40 R:0.47594 P:0.17980 F:0.26100
40 ROUGE-1 Eval D0736-C.M.100.H-I.40 R:0.42781 P:0.16162 F:0.23461
40 ROUGE-1 Eval D0736-C.M.100.H-J.40 R:0.41887 P:0.22424 F:0.29210
40 ROUGE-1 Eval D0740-A.M.100.I-D.40 R:0.35974 P:0.22428 F:0.27630
40 ROUGE-1 Eval D0740-A.M.100.I-H.40 R:0.33333 P:0.20988 F:0.25758
40 ROUGE-1 Eval D0740-A.M.100.I-I.40 R:0.37662 P:0.23868 F:0.29219
40 ROUGE-1 Eval D0740-A.M.100.I-J.40 R:0.34839 P:0.22222 F:0.27136
40 ROUGE-1 Eval D0740-B.M.100.I-D.40 R:0.33117 P:0.20238 F:0.25123
40 ROUGE-1 Eval D0740-B.M.100.I-H.40 R:0.32119 P:0.19246 F:0.24069
40 ROUGE-1 Eval D0740-B.M.100.I-I.40 R:0.34098 P:0.20635 F:0.25711
40 ROUGE-1 Eval D0740-B.M.100.I-J.40 R:0.33010 P:0.20238 F:0.25092
40 ROUGE-1 Eval D0740-C.M.100.I-D.40 R:0.42812 P:0.28450 F:0.34184
40 ROUGE-1 Eval D0740-C.M.100.I-H.40 R:0.39228 P:0.25902 F:0.31202
40 ROUGE-1 Eval D0740-C.M.100.I-I.40 R:0.40895 P:0.27176 F:0.32653
40 ROUGE-1 Eval D0740-C.M.100.I-J.40 R:0.41083 P:0.27389 F:0.32867
40 ROUGE-1 Eval D0743-A.M.100.J-B.40 R:0.35238 P:0.21637 F:0.26811
40 ROUGE-1 Eval D0743-A.M.100.J-H.40 R:0.33025 P:0.20858 F:0.25568
40 ROUGE-1 Eval D0743-A.M.100.J-I.40 R:0.35625 P:0.22222 F:0.27371
40 ROUGE-1 Eval D0743-A.M.100.J-J.40 R:0.33538 P:0.21248 F:0.26015
40 ROUGE-1 Eval D0743-B.M.100.J-B.40 R:0.23077 P:0.14634 F:0.17910
40 ROUGE-1 Eval D0743-B.M.100.J-H.40 R:0.24606 P:0.15854 F:0.19283
40 ROUGE-1 Eval D0743-B.M.100.J-I.40 R:0.25633 P:0.16463 F:0.20049
40 ROUGE-1 Eval D0743-B.M.100.J-J.40 R:0.24299 P:0.15854 F:0.19188
40 ROUGE-1 Eval D0743-C.M.100.J-B.40 R:0.32698 P:0.20808 F:0.25432
40 ROUGE-1 Eval D0743-C.M.100.J-H.40 R:0.30573 P:0.19394 F:0.23733
40 ROUGE-1 Eval D0743-C.M.100.J-I.40 R:0.35463 P:0.22424 F:0.27475
40 ROUGE-1 Eval D0743-C.M.100.J-J.40 R:0.28931 P:0.18586 F:0.22632
---------------------------------------------
40 ROUGE-2 Average_R: 0.11141 (95%-conf.int. 0.10016 - 0.12249)
40 ROUGE-2 Average_P: 0.07177 (95%-conf.int. 0.06526 - 0.07827)
40 ROUGE-2 Average_F: 0.08694 (95%-conf.int. 0.07889 - 0.09487)
.............................................
40 ROUGE-2 Eval D0703-A.M.100.A-A.40 R:0.15017 P:0.10185 F:0.12138
40 ROUGE-2 Eval D0703-A.M.100.A-C.40 R:0.14576 P:0.09954 F:0.11830
40 ROUGE-2 Eval D0703-A.M.100.A-D.40 R:0.14931 P:0.09954 F:0.11945
40 ROUGE-2 Eval D0703-A.M.100.A-J.40 R:0.14089 P:0.09491 F:0.11342
40 ROUGE-2 Eval D0703-B.M.100.A-A.40 R:0.09241 P:0.06222 F:0.07437
40 ROUGE-2 Eval D0703-B.M.100.A-C.40 R:0.09492 P:0.06222 F:0.07517
40 ROUGE-2 Eval D0703-B.M.100.A-D.40 R:0.10169 P:0.06667 F:0.08054
40 ROUGE-2 Eval D0703-B.M.100.A-J.40 R:0.10403 P:0.06889 F:0.08289
40 ROUGE-2 Eval D0703-C.M.100.A-A.40 R:0.13805 P:0.10199 F:0.11731
40 ROUGE-2 Eval D0703-C.M.100.A-C.40 R:0.13115 P:0.09950 F:0.11315
40 ROUGE-2 Eval D0703-C.M.100.A-D.40 R:0.12375 P:0.09204 F:0.10557
40 ROUGE-2 Eval D0703-C.M.100.A-J.40 R:0.14716 P:0.10945 F:0.12553
40 ROUGE-2 Eval D0706-A.M.100.B-B.40 R:0.12787 P:0.09028 F:0.10584
40 ROUGE-2 Eval D0706-A.M.100.B-D.40 R:0.11551 P:0.08102 F:0.09524
40 ROUGE-2 Eval D0706-A.M.100.B-E.40 R:0.06885 P:0.04861 F:0.05699
40 ROUGE-2 Eval D0706-A.M.100.B-I.40 R:0.12131 P:0.08565 F:0.10041
40 ROUGE-2 Eval D0706-B.M.100.B-B.40 R:0.10891 P:0.06875 F:0.08429
40 ROUGE-2 Eval D0706-B.M.100.B-D.40 R:0.08224 P:0.05208 F:0.06377
40 ROUGE-2 Eval D0706-B.M.100.B-E.40 R:0.08197 P:0.05208 F:0.06369
40 ROUGE-2 Eval D0706-B.M.100.B-I.40 R:0.10131 P:0.06458 F:0.07888
40 ROUGE-2 Eval D0706-C.M.100.B-B.40 R:0.10098 P:0.06540 F:0.07939
40 ROUGE-2 Eval D0706-C.M.100.B-D.40 R:0.09772 P:0.06329 F:0.07682
40 ROUGE-2 Eval D0706-C.M.100.B-E.40 R:0.11327 P:0.07384 F:0.08940
40 ROUGE-2 Eval D0706-C.M.100.B-I.40 R:0.11613 P:0.07595 F:0.09184
40 ROUGE-2 Eval D0711-A.M.100.C-A.40 R:0.08970 P:0.06164 F:0.07307
40 ROUGE-2 Eval D0711-A.M.100.C-B.40 R:0.06397 P:0.04338 F:0.05170
40 ROUGE-2 Eval D0711-A.M.100.C-C.40 R:0.06397 P:0.04338 F:0.05170
40 ROUGE-2 Eval D0711-A.M.100.C-F.40 R:0.09365 P:0.06393 F:0.07599
40 ROUGE-2 Eval D0711-B.M.100.C-A.40 R:0.03093 P:0.02069 F:0.02479
40 ROUGE-2 Eval D0711-B.M.100.C-B.40 R:0.05536 P:0.03678 F:0.04420
40 ROUGE-2 Eval D0711-B.M.100.C-C.40 R:0.04746 P:0.03218 F:0.03835
40 ROUGE-2 Eval D0711-B.M.100.C-F.40 R:0.04110 P:0.02759 F:0.03302
40 ROUGE-2 Eval D0711-C.M.100.C-A.40 R:0.03000 P:0.02128 F:0.02490
40 ROUGE-2 Eval D0711-C.M.100.C-B.40 R:0.02414 P:0.01655 F:0.01964
40 ROUGE-2 Eval D0711-C.M.100.C-C.40 R:0.03072 P:0.02128 F:0.02514
40 ROUGE-2 Eval D0711-C.M.100.C-F.40 R:0.03754 P:0.02600 F:0.03072
40 ROUGE-2 Eval D0716-A.M.100.D-C.40 R:0.21854 P:0.14570 F:0.17484
40 ROUGE-2 Eval D0716-A.M.100.D-D.40 R:0.23569 P:0.15453 F:0.18667
40 ROUGE-2 Eval D0716-A.M.100.D-E.40 R:0.22819 P:0.15011 F:0.18109
40 ROUGE-2 Eval D0716-A.M.100.D-F.40 R:0.24000 P:0.15894 F:0.19123
40 ROUGE-2 Eval D0716-B.M.100.D-C.40 R:0.13289 P:0.09259 F:0.10914
40 ROUGE-2 Eval D0716-B.M.100.D-D.40 R:0.13559 P:0.09259 F:0.11004
40 ROUGE-2 Eval D0716-B.M.100.D-E.40 R:0.09732 P:0.06713 F:0.07945
40 ROUGE-2 Eval D0716-B.M.100.D-F.40 R:0.13805 P:0.09491 F:0.11249
40 ROUGE-2 Eval D0716-C.M.100.D-C.40 R:0.14145 P:0.09620 F:0.11452
40 ROUGE-2 Eval D0716-C.M.100.D-D.40 R:0.14189 P:0.09396 F:0.11305
40 ROUGE-2 Eval D0716-C.M.100.D-E.40 R:0.14000 P:0.09396 F:0.11245
40 ROUGE-2 Eval D0716-C.M.100.D-F.40 R:0.13805 P:0.09172 F:0.11021
40 ROUGE-2 Eval D0721-A.M.100.E-B.40 R:0.07744 P:0.05808 F:0.06638
40 ROUGE-2 Eval D0721-A.M.100.E-C.40 R:0.06557 P:0.05051 F:0.05706
40 ROUGE-2 Eval D0721-A.M.100.E-E.40 R:0.05246 P:0.04040 F:0.04565
40 ROUGE-2 Eval D0721-A.M.100.E-G.40 R:0.07074 P:0.05556 F:0.06224
40 ROUGE-2 Eval D0721-B.M.100.E-B.40 R:0.06908 P:0.05600 F:0.06186
40 ROUGE-2 Eval D0721-B.M.100.E-C.40 R:0.06752 P:0.05600 F:0.06122
40 ROUGE-2 Eval D0721-B.M.100.E-E.40 R:0.05629 P:0.04533 F:0.05022
40 ROUGE-2 Eval D0721-B.M.100.E-G.40 R:0.05212 P:0.04267 F:0.04692
40 ROUGE-2 Eval D0721-C.M.100.E-B.40 R:0.12583 P:0.09596 F:0.10888
40 ROUGE-2 Eval D0721-C.M.100.E-C.40 R:0.12000 P:0.09091 F:0.10345
40 ROUGE-2 Eval D0721-C.M.100.E-E.40 R:0.08754 P:0.06566 F:0.07504
40 ROUGE-2 Eval D0721-C.M.100.E-G.40 R:0.12500 P:0.09596 F:0.10857
40 ROUGE-2 Eval D0726-A.M.100.F-A.40 R:0.20805 P:0.14059 F:0.16779
40 ROUGE-2 Eval D0726-A.M.100.F-E.40 R:0.18519 P:0.12472 F:0.14906
40 ROUGE-2 Eval D0726-A.M.100.F-F.40 R:0.20134 P:0.13605 F:0.16238
40 ROUGE-2 Eval D0726-A.M.100.F-G.40 R:0.17114 P:0.11565 F:0.13803
40 ROUGE-2 Eval D0726-B.M.100.F-A.40 R:0.08251 P:0.06039 F:0.06974
40 ROUGE-2 Eval D0726-B.M.100.F-E.40 R:0.08054 P:0.05797 F:0.06742
40 ROUGE-2 Eval D0726-B.M.100.F-F.40 R:0.08389 P:0.06039 F:0.07023
40 ROUGE-2 Eval D0726-B.M.100.F-G.40 R:0.06312 P:0.04589 F:0.05314
40 ROUGE-2 Eval D0726-C.M.100.F-A.40 R:0.10101 P:0.07463 F:0.08584
40 ROUGE-2 Eval D0726-C.M.100.F-E.40 R:0.09524 P:0.06965 F:0.08046
40 ROUGE-2 Eval D0726-C.M.100.F-F.40 R:0.06507 P:0.04726 F:0.05475
40 ROUGE-2 Eval D0726-C.M.100.F-G.40 R:0.05298 P:0.03980 F:0.04545
40 ROUGE-2 Eval D0727-A.M.100.G-A.40 R:0.10067 P:0.06289 F:0.07742
40 ROUGE-2 Eval D0727-A.M.100.G-F.40 R:0.11628 P:0.07338 F:0.08998
40 ROUGE-2 Eval D0727-A.M.100.G-G.40 R:0.09241 P:0.05870 F:0.07179
40 ROUGE-2 Eval D0727-A.M.100.G-H.40 R:0.11960 P:0.07547 F:0.09254
40 ROUGE-2 Eval D0727-B.M.100.G-A.40 R:0.05903 P:0.03295 F:0.04229
40 ROUGE-2 Eval D0727-B.M.100.G-F.40 R:0.07213 P:0.04264 F:0.05360
40 ROUGE-2 Eval D0727-B.M.100.G-G.40 R:0.04545 P:0.02519 F:0.03241
40 ROUGE-2 Eval D0727-B.M.100.G-H.40 R:0.05903 P:0.03295 F:0.04229
40 ROUGE-2 Eval D0727-C.M.100.G-A.40 R:0.03289 P:0.02033 F:0.02513
40 ROUGE-2 Eval D0727-C.M.100.G-F.40 R:0.03741 P:0.02236 F:0.02799
40 ROUGE-2 Eval D0727-C.M.100.G-G.40 R:0.04000 P:0.02439 F:0.03030
40 ROUGE-2 Eval D0727-C.M.100.G-H.40 R:0.05119 P:0.03049 F:0.03822
40 ROUGE-2 Eval D0736-A.M.100.H-G.40 R:0.12319 P:0.06403 F:0.08426
40 ROUGE-2 Eval D0736-A.M.100.H-H.40 R:0.15867 P:0.08098 F:0.10723
40 ROUGE-2 Eval D0736-A.M.100.H-I.40 R:0.15468 P:0.08098 F:0.10631
40 ROUGE-2 Eval D0736-A.M.100.H-J.40 R:0.12871 P:0.07345 F:0.09353
40 ROUGE-2 Eval D0736-B.M.100.H-G.40 R:0.33205 P:0.18495 F:0.23757
40 ROUGE-2 Eval D0736-B.M.100.H-H.40 R:0.38075 P:0.19570 F:0.25852
40 ROUGE-2 Eval D0736-B.M.100.H-I.40 R:0.36864 P:0.18710 F:0.24822
40 ROUGE-2 Eval D0736-B.M.100.H-J.40 R:0.32862 P:0.20000 F:0.24866
40 ROUGE-2 Eval D0736-C.M.100.H-G.40 R:0.16239 P:0.07724 F:0.10469
40 ROUGE-2 Eval D0736-C.M.100.H-H.40 R:0.21196 P:0.07927 F:0.11539
40 ROUGE-2 Eval D0736-C.M.100.H-I.40 R:0.12500 P:0.04675 F:0.06805
40 ROUGE-2 Eval D0736-C.M.100.H-J.40 R:0.15649 P:0.08333 F:0.10875
40 ROUGE-2 Eval D0740-A.M.100.I-D.40 R:0.09667 P:0.06004 F:0.07407
40 ROUGE-2 Eval D0740-A.M.100.I-H.40 R:0.08581 P:0.05383 F:0.06616
40 ROUGE-2 Eval D0740-A.M.100.I-I.40 R:0.12131 P:0.07660 F:0.09390
40 ROUGE-2 Eval D0740-A.M.100.I-J.40 R:0.09121 P:0.05797 F:0.07089
40 ROUGE-2 Eval D0740-B.M.100.I-D.40 R:0.09836 P:0.05988 F:0.07444
40 ROUGE-2 Eval D0740-B.M.100.I-H.40 R:0.10702 P:0.06387 F:0.08000
40 ROUGE-2 Eval D0740-B.M.100.I-I.40 R:0.10265 P:0.06188 F:0.07721
40 ROUGE-2 Eval D0740-B.M.100.I-J.40 R:0.09804 P:0.05988 F:0.07435
40 ROUGE-2 Eval D0740-C.M.100.I-D.40 R:0.16774 P:0.11111 F:0.13367
40 ROUGE-2 Eval D0740-C.M.100.I-H.40 R:0.12662 P:0.08333 F:0.10051
40 ROUGE-2 Eval D0740-C.M.100.I-I.40 R:0.17419 P:0.11538 F:0.13881
40 ROUGE-2 Eval D0740-C.M.100.I-J.40 R:0.16077 P:0.10684 F:0.12837
40 ROUGE-2 Eval D0743-A.M.100.J-B.40 R:0.09936 P:0.06078 F:0.07542
40 ROUGE-2 Eval D0743-A.M.100.J-H.40 R:0.06854 P:0.04314 F:0.05295
40 ROUGE-2 Eval D0743-A.M.100.J-I.40 R:0.08833 P:0.05490 F:0.06771
40 ROUGE-2 Eval D0743-A.M.100.J-J.40 R:0.07453 P:0.04706 F:0.05769
40 ROUGE-2 Eval D0743-B.M.100.J-B.40 R:0.03236 P:0.02045 F:0.02506
40 ROUGE-2 Eval D0743-B.M.100.J-H.40 R:0.03822 P:0.02454 F:0.02989
40 ROUGE-2 Eval D0743-B.M.100.J-I.40 R:0.04473 P:0.02863 F:0.03491
40 ROUGE-2 Eval D0743-B.M.100.J-J.40 R:0.04717 P:0.03067 F:0.03717
40 ROUGE-2 Eval D0743-C.M.100.J-B.40 R:0.06731 P:0.04268 F:0.05224
40 ROUGE-2 Eval D0743-C.M.100.J-H.40 R:0.06431 P:0.04065 F:0.04981
40 ROUGE-2 Eval D0743-C.M.100.J-I.40 R:0.07419 P:0.04675 F:0.05736
40 ROUGE-2 Eval D0743-C.M.100.J-J.40 R:0.05397 P:0.03455 F:0.04213
---------------------------------------------
40 ROUGE-3 Average_R: 0.05488 (95%-conf.int. 0.04545 - 0.06470)
40 ROUGE-3 Average_P: 0.03482 (95%-conf.int. 0.02944 - 0.04031)
40 ROUGE-3 Average_F: 0.04243 (95%-conf.int. 0.03566 - 0.04945)
.............................................
40 ROUGE-3 Eval D0703-A.M.100.A-A.40 R:0.07241 P:0.04895 F:0.05841
40 ROUGE-3 Eval D0703-A.M.100.A-C.40 R:0.06849 P:0.04662 F:0.05548
40 ROUGE-3 Eval D0703-A.M.100.A-D.40 R:0.07368 P:0.04895 F:0.05882
40 ROUGE-3 Eval D0703-A.M.100.A-J.40 R:0.05556 P:0.03730 F:0.04463
40 ROUGE-3 Eval D0703-B.M.100.A-A.40 R:0.03333 P:0.02237 F:0.02677
40 ROUGE-3 Eval D0703-B.M.100.A-C.40 R:0.02397 P:0.01566 F:0.01894
40 ROUGE-3 Eval D0703-B.M.100.A-D.40 R:0.04110 P:0.02685 F:0.03248
40 ROUGE-3 Eval D0703-B.M.100.A-J.40 R:0.04407 P:0.02908 F:0.03504
40 ROUGE-3 Eval D0703-C.M.100.A-A.40 R:0.07143 P:0.05263 F:0.06061
40 ROUGE-3 Eval D0703-C.M.100.A-C.40 R:0.06954 P:0.05263 F:0.05991
40 ROUGE-3 Eval D0703-C.M.100.A-D.40 R:0.05743 P:0.04261 F:0.04892
40 ROUGE-3 Eval D0703-C.M.100.A-J.40 R:0.08446 P:0.06266 F:0.07194
40 ROUGE-3 Eval D0706-A.M.100.B-B.40 R:0.05960 P:0.04196 F:0.04925
40 ROUGE-3 Eval D0706-A.M.100.B-D.40 R:0.05667 P:0.03963 F:0.04664
40 ROUGE-3 Eval D0706-A.M.100.B-E.40 R:0.01656 P:0.01166 F:0.01368
40 ROUGE-3 Eval D0706-A.M.100.B-I.40 R:0.06623 P:0.04662 F:0.05472
40 ROUGE-3 Eval D0706-B.M.100.B-B.40 R:0.04000 P:0.02516 F:0.03089
40 ROUGE-3 Eval D0706-B.M.100.B-D.40 R:0.02326 P:0.01468 F:0.01800
40 ROUGE-3 Eval D0706-B.M.100.B-E.40 R:0.02649 P:0.01677 F:0.02054
40 ROUGE-3 Eval D0706-B.M.100.B-I.40 R:0.03960 P:0.02516 F:0.03077
40 ROUGE-3 Eval D0706-C.M.100.B-B.40 R:0.05921 P:0.03822 F:0.04645
40 ROUGE-3 Eval D0706-C.M.100.B-D.40 R:0.05921 P:0.03822 F:0.04645
40 ROUGE-3 Eval D0706-C.M.100.B-E.40 R:0.06209 P:0.04034 F:0.04891
40 ROUGE-3 Eval D0706-C.M.100.B-I.40 R:0.06515 P:0.04246 F:0.05141
40 ROUGE-3 Eval D0711-A.M.100.C-A.40 R:0.04362 P:0.02989 F:0.03547
40 ROUGE-3 Eval D0711-A.M.100.C-B.40 R:0.03061 P:0.02069 F:0.02469
40 ROUGE-3 Eval D0711-A.M.100.C-C.40 R:0.02041 P:0.01379 F:0.01646
40 ROUGE-3 Eval D0711-A.M.100.C-F.40 R:0.04730 P:0.03218 F:0.03830
40 ROUGE-3 Eval D0711-B.M.100.C-A.40 R:0.00347 P:0.00231 F:0.00277
40 ROUGE-3 Eval D0711-B.M.100.C-B.40 R:0.00699 P:0.00463 F:0.00557
40 ROUGE-3 Eval D0711-B.M.100.C-C.40 R:0.00685 P:0.00463 F:0.00553
40 ROUGE-3 Eval D0711-B.M.100.C-F.40 R:0.00346 P:0.00231 F:0.00277
40 ROUGE-3 Eval D0711-C.M.100.C-A.40 R:0.00673 P:0.00476 F:0.00558
40 ROUGE-3 Eval D0711-C.M.100.C-B.40 R:0.00348 P:0.00238 F:0.00283
40 ROUGE-3 Eval D0711-C.M.100.C-C.40 R:0.00345 P:0.00238 F:0.00282
40 ROUGE-3 Eval D0711-C.M.100.C-F.40 R:0.00690 P:0.00476 F:0.00563
40 ROUGE-3 Eval D0716-A.M.100.D-C.40 R:0.11371 P:0.07556 F:0.09079
40 ROUGE-3 Eval D0716-A.M.100.D-D.40 R:0.13605 P:0.08889 F:0.10753
40 ROUGE-3 Eval D0716-A.M.100.D-E.40 R:0.12542 P:0.08222 F:0.09933
40 ROUGE-3 Eval D0716-A.M.100.D-F.40 R:0.13131 P:0.08667 F:0.10442
40 ROUGE-3 Eval D0716-B.M.100.D-C.40 R:0.06711 P:0.04662 F:0.05502
40 ROUGE-3 Eval D0716-B.M.100.D-D.40 R:0.06849 P:0.04662 F:0.05548
40 ROUGE-3 Eval D0716-B.M.100.D-E.40 R:0.03390 P:0.02331 F:0.02762
40 ROUGE-3 Eval D0716-B.M.100.D-F.40 R:0.07483 P:0.05128 F:0.06086
40 ROUGE-3 Eval D0716-C.M.100.D-C.40 R:0.06645 P:0.04505 F:0.05370
40 ROUGE-3 Eval D0716-C.M.100.D-D.40 R:0.05802 P:0.03829 F:0.04613
40 ROUGE-3 Eval D0716-C.M.100.D-E.40 R:0.05051 P:0.03378 F:0.04048
40 ROUGE-3 Eval D0716-C.M.100.D-F.40 R:0.05782 P:0.03829 F:0.04607
40 ROUGE-3 Eval D0721-A.M.100.E-B.40 R:0.03061 P:0.02290 F:0.02620
40 ROUGE-3 Eval D0721-A.M.100.E-C.40 R:0.02649 P:0.02036 F:0.02302
40 ROUGE-3 Eval D0721-A.M.100.E-E.40 R:0.00662 P:0.00509 F:0.00576
40 ROUGE-3 Eval D0721-A.M.100.E-G.40 R:0.02597 P:0.02036 F:0.02283
40 ROUGE-3 Eval D0721-B.M.100.E-B.40 R:0.01329 P:0.01075 F:0.01189
40 ROUGE-3 Eval D0721-B.M.100.E-C.40 R:0.01299 P:0.01075 F:0.01176
40 ROUGE-3 Eval D0721-B.M.100.E-E.40 R:0.00669 P:0.00538 F:0.00596
40 ROUGE-3 Eval D0721-B.M.100.E-G.40 R:0.00658 P:0.00538 F:0.00592
40 ROUGE-3 Eval D0721-C.M.100.E-B.40 R:0.07358 P:0.05598 F:0.06358
40 ROUGE-3 Eval D0721-C.M.100.E-C.40 R:0.06397 P:0.04835 F:0.05507
40 ROUGE-3 Eval D0721-C.M.100.E-E.40 R:0.05102 P:0.03817 F:0.04367
40 ROUGE-3 Eval D0721-C.M.100.E-G.40 R:0.08306 P:0.06361 F:0.07205
40 ROUGE-3 Eval D0726-A.M.100.F-A.40 R:0.14576 P:0.09817 F:0.11732
40 ROUGE-3 Eval D0726-A.M.100.F-E.40 R:0.12245 P:0.08219 F:0.09836
40 ROUGE-3 Eval D0726-A.M.100.F-F.40 R:0.13898 P:0.09361 F:0.11187
40 ROUGE-3 Eval D0726-A.M.100.F-G.40 R:0.10169 P:0.06849 F:0.08185
40 ROUGE-3 Eval D0726-B.M.100.F-A.40 R:0.03000 P:0.02190 F:0.02532
40 ROUGE-3 Eval D0726-B.M.100.F-E.40 R:0.02712 P:0.01946 F:0.02266
40 ROUGE-3 Eval D0726-B.M.100.F-F.40 R:0.02373 P:0.01703 F:0.01983
40 ROUGE-3 Eval D0726-B.M.100.F-G.40 R:0.01007 P:0.00730 F:0.00846
40 ROUGE-3 Eval D0726-C.M.100.F-A.40 R:0.03741 P:0.02757 F:0.03174
40 ROUGE-3 Eval D0726-C.M.100.F-E.40 R:0.03436 P:0.02506 F:0.02898
40 ROUGE-3 Eval D0726-C.M.100.F-F.40 R:0.02768 P:0.02005 F:0.02326
40 ROUGE-3 Eval D0726-C.M.100.F-G.40 R:0.01338 P:0.01003 F:0.01147
40 ROUGE-3 Eval D0727-A.M.100.G-A.40 R:0.03729 P:0.02321 F:0.02861
40 ROUGE-3 Eval D0727-A.M.100.G-F.40 R:0.06040 P:0.03797 F:0.04663
40 ROUGE-3 Eval D0727-A.M.100.G-G.40 R:0.04000 P:0.02532 F:0.03101
40 ROUGE-3 Eval D0727-A.M.100.G-H.40 R:0.06376 P:0.04008 F:0.04922
40 ROUGE-3 Eval D0727-B.M.100.G-A.40 R:0.02105 P:0.01170 F:0.01504
40 ROUGE-3 Eval D0727-B.M.100.G-F.40 R:0.02318 P:0.01365 F:0.01718
40 ROUGE-3 Eval D0727-B.M.100.G-G.40 R:0.01060 P:0.00585 F:0.00754
40 ROUGE-3 Eval D0727-B.M.100.G-H.40 R:0.01754 P:0.00975 F:0.01253
40 ROUGE-3 Eval D0727-C.M.100.G-A.40 R:0.00664 P:0.00409 F:0.00506
40 ROUGE-3 Eval D0727-C.M.100.G-F.40 R:0.00344 P:0.00204 F:0.00256
40 ROUGE-3 Eval D0727-C.M.100.G-G.40 R:0.01010 P:0.00613 F:0.00763
40 ROUGE-3 Eval D0727-C.M.100.G-H.40 R:0.01034 P:0.00613 F:0.00770
40 ROUGE-3 Eval D0736-A.M.100.H-G.40 R:0.05861 P:0.03030 F:0.03995
40 ROUGE-3 Eval D0736-A.M.100.H-H.40 R:0.08582 P:0.04356 F:0.05779
40 ROUGE-3 Eval D0736-A.M.100.H-I.40 R:0.08727 P:0.04545 F:0.05977
40 ROUGE-3 Eval D0736-A.M.100.H-J.40 R:0.07000 P:0.03977 F:0.05072
40 ROUGE-3 Eval D0736-B.M.100.H-G.40 R:0.25781 P:0.14286 F:0.18385
40 ROUGE-3 Eval D0736-B.M.100.H-H.40 R:0.30508 P:0.15584 F:0.20630
40 ROUGE-3 Eval D0736-B.M.100.H-I.40 R:0.29614 P:0.14935 F:0.19856
40 ROUGE-3 Eval D0736-B.M.100.H-J.40 R:0.26786 P:0.16234 F:0.20216
40 ROUGE-3 Eval D0736-C.M.100.H-G.40 R:0.07792 P:0.03681 F:0.05000
40 ROUGE-3 Eval D0736-C.M.100.H-H.40 R:0.09945 P:0.03681 F:0.05373
40 ROUGE-3 Eval D0736-C.M.100.H-I.40 R:0.03315 P:0.01227 F:0.01791
40 ROUGE-3 Eval D0736-C.M.100.H-J.40 R:0.05792 P:0.03067 F:0.04010
40 ROUGE-3 Eval D0740-A.M.100.I-D.40 R:0.03367 P:0.02083 F:0.02574
40 ROUGE-3 Eval D0740-A.M.100.I-H.40 R:0.04667 P:0.02917 F:0.03590
40 ROUGE-3 Eval D0740-A.M.100.I-I.40 R:0.05298 P:0.03333 F:0.04092
40 ROUGE-3 Eval D0740-A.M.100.I-J.40 R:0.03618 P:0.02292 F:0.02806
40 ROUGE-3 Eval D0740-B.M.100.I-D.40 R:0.04636 P:0.02811 F:0.03500
40 ROUGE-3 Eval D0740-B.M.100.I-H.40 R:0.06419 P:0.03815 F:0.04786
40 ROUGE-3 Eval D0740-B.M.100.I-I.40 R:0.05017 P:0.03012 F:0.03764
40 ROUGE-3 Eval D0740-B.M.100.I-J.40 R:0.04950 P:0.03012 F:0.03745
40 ROUGE-3 Eval D0740-C.M.100.I-D.40 R:0.12052 P:0.07957 F:0.09585
40 ROUGE-3 Eval D0740-C.M.100.I-H.40 R:0.06885 P:0.04516 F:0.05454
40 ROUGE-3 Eval D0740-C.M.100.I-I.40 R:0.11075 P:0.07312 F:0.08808
40 ROUGE-3 Eval D0740-C.M.100.I-J.40 R:0.10065 P:0.06667 F:0.08021
40 ROUGE-3 Eval D0743-A.M.100.J-B.40 R:0.04854 P:0.02959 F:0.03677
40 ROUGE-3 Eval D0743-A.M.100.J-H.40 R:0.02516 P:0.01578 F:0.01940
40 ROUGE-3 Eval D0743-A.M.100.J-I.40 R:0.04140 P:0.02564 F:0.03167
40 ROUGE-3 Eval D0743-A.M.100.J-J.40 R:0.02821 P:0.01775 F:0.02179
40 ROUGE-3 Eval D0743-B.M.100.J-B.40 R:0.00980 P:0.00617 F:0.00757
40 ROUGE-3 Eval D0743-B.M.100.J-H.40 R:0.00965 P:0.00617 F:0.00753
40 ROUGE-3 Eval D0743-B.M.100.J-I.40 R:0.01290 P:0.00823 F:0.01005
40 ROUGE-3 Eval D0743-B.M.100.J-J.40 R:0.01587 P:0.01029 F:0.01248
40 ROUGE-3 Eval D0743-C.M.100.J-B.40 R:0.01294 P:0.00818 F:0.01002
40 ROUGE-3 Eval D0743-C.M.100.J-H.40 R:0.01948 P:0.01227 F:0.01506
40 ROUGE-3 Eval D0743-C.M.100.J-I.40 R:0.01954 P:0.01227 F:0.01507
40 ROUGE-3 Eval D0743-C.M.100.J-J.40 R:0.00641 P:0.00409 F:0.00499
---------------------------------------------
40 ROUGE-4 Average_R: 0.03338 (95%-conf.int. 0.02593 - 0.04221)
40 ROUGE-4 Average_P: 0.02075 (95%-conf.int. 0.01650 - 0.02533)
40 ROUGE-4 Average_F: 0.02548 (95%-conf.int. 0.01996 - 0.03142)
.............................................
40 ROUGE-4 Eval D0703-A.M.100.A-A.40 R:0.04181 P:0.02817 F:0.03366
40 ROUGE-4 Eval D0703-A.M.100.A-C.40 R:0.03806 P:0.02582 F:0.03077
40 ROUGE-4 Eval D0703-A.M.100.A-D.40 R:0.04610 P:0.03052 F:0.03673
40 ROUGE-4 Eval D0703-A.M.100.A-J.40 R:0.02105 P:0.01408 F:0.01687
40 ROUGE-4 Eval D0703-B.M.100.A-A.40 R:0.01347 P:0.00901 F:0.01080
40 ROUGE-4 Eval D0703-B.M.100.A-C.40 R:0.00346 P:0.00225 F:0.00273
40 ROUGE-4 Eval D0703-B.M.100.A-D.40 R:0.01730 P:0.01126 F:0.01364
40 ROUGE-4 Eval D0703-B.M.100.A-J.40 R:0.01712 P:0.01126 F:0.01359
40 ROUGE-4 Eval D0703-C.M.100.A-A.40 R:0.03780 P:0.02778 F:0.03202
40 ROUGE-4 Eval D0703-C.M.100.A-C.40 R:0.03679 P:0.02778 F:0.03166
40 ROUGE-4 Eval D0703-C.M.100.A-D.40 R:0.03072 P:0.02273 F:0.02613
40 ROUGE-4 Eval D0703-C.M.100.A-J.40 R:0.04778 P:0.03535 F:0.04064
40 ROUGE-4 Eval D0706-A.M.100.B-B.40 R:0.03344 P:0.02347 F:0.02758
40 ROUGE-4 Eval D0706-A.M.100.B-D.40 R:0.03367 P:0.02347 F:0.02766
40 ROUGE-4 Eval D0706-A.M.100.B-E.40 R:0.00669 P:0.00469 F:0.00551
40 ROUGE-4 Eval D0706-A.M.100.B-I.40 R:0.03679 P:0.02582 F:0.03034
40 ROUGE-4 Eval D0706-B.M.100.B-B.40 R:0.01347 P:0.00844 F:0.01038
40 ROUGE-4 Eval D0706-B.M.100.B-D.40 R:0.00336 P:0.00211 F:0.00259
40 ROUGE-4 Eval D0706-B.M.100.B-E.40 R:0.01003 P:0.00633 F:0.00776
40 ROUGE-4 Eval D0706-B.M.100.B-I.40 R:0.01333 P:0.00844 F:0.01034
40 ROUGE-4 Eval D0706-C.M.100.B-B.40 R:0.03654 P:0.02350 F:0.02860
40 ROUGE-4 Eval D0706-C.M.100.B-D.40 R:0.03987 P:0.02564 F:0.03121
40 ROUGE-4 Eval D0706-C.M.100.B-E.40 R:0.04290 P:0.02778 F:0.03372
40 ROUGE-4 Eval D0706-C.M.100.B-I.40 R:0.03947 P:0.02564 F:0.03109
40 ROUGE-4 Eval D0711-A.M.100.C-A.40 R:0.03390 P:0.02315 F:0.02751
40 ROUGE-4 Eval D0711-A.M.100.C-B.40 R:0.02062 P:0.01389 F:0.01660
40 ROUGE-4 Eval D0711-A.M.100.C-C.40 R:0.01375 P:0.00926 F:0.01107
40 ROUGE-4 Eval D0711-A.M.100.C-F.40 R:0.03413 P:0.02315 F:0.02759
40 ROUGE-4 Eval D0711-B.M.100.C-A.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-B.M.100.C-B.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-B.M.100.C-C.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-B.M.100.C-F.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-C.M.100.C-A.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-C.M.100.C-B.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-C.M.100.C-C.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0711-C.M.100.C-F.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0716-A.M.100.D-C.40 R:0.05743 P:0.03803 F:0.04576
40 ROUGE-4 Eval D0716-A.M.100.D-D.40 R:0.08247 P:0.05369 F:0.06504
40 ROUGE-4 Eval D0716-A.M.100.D-E.40 R:0.07534 P:0.04922 F:0.05954
40 ROUGE-4 Eval D0716-A.M.100.D-F.40 R:0.07143 P:0.04698 F:0.05668
40 ROUGE-4 Eval D0716-B.M.100.D-C.40 R:0.03390 P:0.02347 F:0.02774
40 ROUGE-4 Eval D0716-B.M.100.D-D.40 R:0.03460 P:0.02347 F:0.02797
40 ROUGE-4 Eval D0716-B.M.100.D-E.40 R:0.01370 P:0.00939 F:0.01114
40 ROUGE-4 Eval D0716-B.M.100.D-F.40 R:0.04124 P:0.02817 F:0.03347
40 ROUGE-4 Eval D0716-C.M.100.D-C.40 R:0.02685 P:0.01814 F:0.02165
40 ROUGE-4 Eval D0716-C.M.100.D-D.40 R:0.02069 P:0.01361 F:0.01642
40 ROUGE-4 Eval D0716-C.M.100.D-E.40 R:0.01361 P:0.00907 F:0.01089
40 ROUGE-4 Eval D0716-C.M.100.D-F.40 R:0.02062 P:0.01361 F:0.01640
40 ROUGE-4 Eval D0721-A.M.100.E-B.40 R:0.01718 P:0.01282 F:0.01468
40 ROUGE-4 Eval D0721-A.M.100.E-C.40 R:0.01672 P:0.01282 F:0.01451
40 ROUGE-4 Eval D0721-A.M.100.E-E.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0721-A.M.100.E-G.40 R:0.01639 P:0.01282 F:0.01439
40 ROUGE-4 Eval D0721-B.M.100.E-B.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0721-B.M.100.E-C.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0721-B.M.100.E-E.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0721-B.M.100.E-G.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0721-C.M.100.E-B.40 R:0.04730 P:0.03590 F:0.04082
40 ROUGE-4 Eval D0721-C.M.100.E-C.40 R:0.03741 P:0.02821 F:0.03217
40 ROUGE-4 Eval D0721-C.M.100.E-E.40 R:0.03093 P:0.02308 F:0.02643
40 ROUGE-4 Eval D0721-C.M.100.E-G.40 R:0.05705 P:0.04359 F:0.04942
40 ROUGE-4 Eval D0726-A.M.100.F-A.40 R:0.11644 P:0.07816 F:0.09353
40 ROUGE-4 Eval D0726-A.M.100.F-E.40 R:0.08935 P:0.05977 F:0.07163
40 ROUGE-4 Eval D0726-A.M.100.F-F.40 R:0.10616 P:0.07126 F:0.08528
40 ROUGE-4 Eval D0726-A.M.100.F-G.40 R:0.06849 P:0.04598 F:0.05502
40 ROUGE-4 Eval D0726-B.M.100.F-A.40 R:0.01347 P:0.00980 F:0.01135
40 ROUGE-4 Eval D0726-B.M.100.F-E.40 R:0.01370 P:0.00980 F:0.01143
40 ROUGE-4 Eval D0726-B.M.100.F-F.40 R:0.01027 P:0.00735 F:0.00857
40 ROUGE-4 Eval D0726-B.M.100.F-G.40 R:0.00339 P:0.00245 F:0.00284
40 ROUGE-4 Eval D0726-C.M.100.F-A.40 R:0.00687 P:0.00505 F:0.00582
40 ROUGE-4 Eval D0726-C.M.100.F-E.40 R:0.00694 P:0.00505 F:0.00585
40 ROUGE-4 Eval D0726-C.M.100.F-F.40 R:0.00699 P:0.00505 F:0.00586
40 ROUGE-4 Eval D0726-C.M.100.F-G.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0727-A.M.100.G-A.40 R:0.02397 P:0.01486 F:0.01835
40 ROUGE-4 Eval D0727-A.M.100.G-F.40 R:0.04746 P:0.02972 F:0.03655
40 ROUGE-4 Eval D0727-A.M.100.G-G.40 R:0.02357 P:0.01486 F:0.01823
40 ROUGE-4 Eval D0727-A.M.100.G-H.40 R:0.04746 P:0.02972 F:0.03655
40 ROUGE-4 Eval D0727-B.M.100.G-A.40 R:0.00709 P:0.00392 F:0.00505
40 ROUGE-4 Eval D0727-B.M.100.G-F.40 R:0.00669 P:0.00392 F:0.00494
40 ROUGE-4 Eval D0727-B.M.100.G-G.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0727-B.M.100.G-H.40 R:0.00709 P:0.00392 F:0.00505
40 ROUGE-4 Eval D0727-C.M.100.G-A.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0727-C.M.100.G-F.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0727-C.M.100.G-G.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0727-C.M.100.G-H.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0736-A.M.100.H-G.40 R:0.04444 P:0.02286 F:0.03019
40 ROUGE-4 Eval D0736-A.M.100.H-H.40 R:0.06415 P:0.03238 F:0.04304
40 ROUGE-4 Eval D0736-A.M.100.H-I.40 R:0.06985 P:0.03619 F:0.04768
40 ROUGE-4 Eval D0736-A.M.100.H-J.40 R:0.05051 P:0.02857 F:0.03650
40 ROUGE-4 Eval D0736-B.M.100.H-G.40 R:0.20158 P:0.11111 F:0.14326
40 ROUGE-4 Eval D0736-B.M.100.H-H.40 R:0.25322 P:0.12854 F:0.17052
40 ROUGE-4 Eval D0736-B.M.100.H-I.40 R:0.23913 P:0.11983 F:0.15966
40 ROUGE-4 Eval D0736-B.M.100.H-J.40 R:0.22744 P:0.13725 F:0.17119
40 ROUGE-4 Eval D0736-C.M.100.H-G.40 R:0.05263 P:0.02469 F:0.03361
40 ROUGE-4 Eval D0736-C.M.100.H-H.40 R:0.06742 P:0.02469 F:0.03614
40 ROUGE-4 Eval D0736-C.M.100.H-I.40 R:0.01685 P:0.00617 F:0.00903
40 ROUGE-4 Eval D0736-C.M.100.H-J.40 R:0.03516 P:0.01852 F:0.02426
40 ROUGE-4 Eval D0740-A.M.100.I-D.40 R:0.01361 P:0.00839 F:0.01038
40 ROUGE-4 Eval D0740-A.M.100.I-H.40 R:0.03030 P:0.01887 F:0.02326
40 ROUGE-4 Eval D0740-A.M.100.I-I.40 R:0.03010 P:0.01887 F:0.02320
40 ROUGE-4 Eval D0740-A.M.100.I-J.40 R:0.01661 P:0.01048 F:0.01285
40 ROUGE-4 Eval D0740-B.M.100.I-D.40 R:0.02676 P:0.01616 F:0.02015
40 ROUGE-4 Eval D0740-B.M.100.I-H.40 R:0.04437 P:0.02626 F:0.03299
40 ROUGE-4 Eval D0740-B.M.100.I-I.40 R:0.03378 P:0.02020 F:0.02528
40 ROUGE-4 Eval D0740-B.M.100.I-J.40 R:0.02667 P:0.01616 F:0.02013
40 ROUGE-4 Eval D0740-C.M.100.I-D.40 R:0.08882 P:0.05844 F:0.07050
40 ROUGE-4 Eval D0740-C.M.100.I-H.40 R:0.03974 P:0.02597 F:0.03141
40 ROUGE-4 Eval D0740-C.M.100.I-I.40 R:0.07566 P:0.04978 F:0.06005
40 ROUGE-4 Eval D0740-C.M.100.I-J.40 R:0.07213 P:0.04762 F:0.05737
40 ROUGE-4 Eval D0743-A.M.100.J-B.40 R:0.03268 P:0.01984 F:0.02469
40 ROUGE-4 Eval D0743-A.M.100.J-H.40 R:0.01587 P:0.00992 F:0.01221
40 ROUGE-4 Eval D0743-A.M.100.J-I.40 R:0.03215 P:0.01984 F:0.02454
40 ROUGE-4 Eval D0743-A.M.100.J-J.40 R:0.01582 P:0.00992 F:0.01219
40 ROUGE-4 Eval D0743-B.M.100.J-B.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0743-B.M.100.J-H.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0743-B.M.100.J-I.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0743-B.M.100.J-J.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0743-C.M.100.J-B.40 R:0.00000 P:0.00000 F:0.00000
40 ROUGE-4 Eval D0743-C.M.100.J-H.40 R:0.00328 P:0.00206 F:0.00253
40 ROUGE-4 Eval D0743-C.M.100.J-I.40 R:0.00329 P:0.00206 F:0.00253
40 ROUGE-4 Eval D0743-C.M.100.J-J.40 R:0.00324 P:0.00206 F:0.00252
---------------------------------------------
40 ROUGE-L Average_R: 0.33132 (95%-conf.int. 0.31902 - 0.34341)
40 ROUGE-L Average_P: 0.21650 (95%-conf.int. 0.20973 - 0.22342)
40 ROUGE-L Average_F: 0.26096 (95%-conf.int. 0.25247 - 0.26913)
.............................................
40 ROUGE-L Eval D0703-A.M.100.A-A.40 R:0.35811 P:0.24368 F:0.29002
40 ROUGE-L Eval D0703-A.M.100.A-C.40 R:0.34228 P:0.23448 F:0.27831
40 ROUGE-L Eval D0703-A.M.100.A-D.40 R:0.35395 P:0.23678 F:0.28374
40 ROUGE-L Eval D0703-A.M.100.A-J.40 R:0.35034 P:0.23678 F:0.28258
40 ROUGE-L Eval D0703-B.M.100.A-A.40 R:0.32353 P:0.21854 F:0.26087
40 ROUGE-L Eval D0703-B.M.100.A-C.40 R:0.33221 P:0.21854 F:0.26364
40 ROUGE-L Eval D0703-B.M.100.A-D.40 R:0.33557 P:0.22075 F:0.26631
40 ROUGE-L Eval D0703-B.M.100.A-J.40 R:0.33555 P:0.22296 F:0.26791
40 ROUGE-L Eval D0703-C.M.100.A-A.40 R:0.31333 P:0.23210 F:0.26667
40 ROUGE-L Eval D0703-C.M.100.A-C.40 R:0.30195 P:0.22963 F:0.26087
40 ROUGE-L Eval D0703-C.M.100.A-D.40 R:0.30795 P:0.22963 F:0.26308
40 ROUGE-L Eval D0703-C.M.100.A-J.40 R:0.33444 P:0.24938 F:0.28571
40 ROUGE-L Eval D0706-A.M.100.B-B.40 R:0.36039 P:0.25517 F:0.29879
40 ROUGE-L Eval D0706-A.M.100.B-D.40 R:0.33007 P:0.23218 F:0.27260
40 ROUGE-L Eval D0706-A.M.100.B-E.40 R:0.28896 P:0.20460 F:0.23957
40 ROUGE-L Eval D0706-A.M.100.B-I.40 R:0.34740 P:0.24598 F:0.28802
40 ROUGE-L Eval D0706-B.M.100.B-B.40 R:0.31373 P:0.19876 F:0.24335
40 ROUGE-L Eval D0706-B.M.100.B-D.40 R:0.30945 P:0.19669 F:0.24051
40 ROUGE-L Eval D0706-B.M.100.B-E.40 R:0.30195 P:0.19255 F:0.23515
40 ROUGE-L Eval D0706-B.M.100.B-I.40 R:0.32362 P:0.20704 F:0.25252
40 ROUGE-L Eval D0706-C.M.100.B-B.40 R:0.31935 P:0.20755 F:0.25159
40 ROUGE-L Eval D0706-C.M.100.B-D.40 R:0.30000 P:0.19497 F:0.23634
40 ROUGE-L Eval D0706-C.M.100.B-E.40 R:0.31731 P:0.20755 F:0.25095
40 ROUGE-L Eval D0706-C.M.100.B-I.40 R:0.35463 P:0.23270 F:0.28101
40 ROUGE-L Eval D0711-A.M.100.C-A.40 R:0.35197 P:0.24263 F:0.28725
40 ROUGE-L Eval D0711-A.M.100.C-B.40 R:0.31667 P:0.21542 F:0.25641
40 ROUGE-L Eval D0711-A.M.100.C-C.40 R:0.33333 P:0.22676 F:0.26991
40 ROUGE-L Eval D0711-A.M.100.C-F.40 R:0.33113 P:0.22676 F:0.26918
40 ROUGE-L Eval D0711-B.M.100.C-A.40 R:0.27211 P:0.18265 F:0.21858
40 ROUGE-L Eval D0711-B.M.100.C-B.40 R:0.30479 P:0.20320 F:0.24384
40 ROUGE-L Eval D0711-B.M.100.C-C.40 R:0.26846 P:0.18265 F:0.21739
40 ROUGE-L Eval D0711-B.M.100.C-F.40 R:0.29492 P:0.19863 F:0.23738
40 ROUGE-L Eval D0711-C.M.100.C-A.40 R:0.33003 P:0.23474 F:0.27435
40 ROUGE-L Eval D0711-C.M.100.C-B.40 R:0.31741 P:0.21831 F:0.25869
40 ROUGE-L Eval D0711-C.M.100.C-C.40 R:0.32095 P:0.22300 F:0.26316
40 ROUGE-L Eval D0711-C.M.100.C-F.40 R:0.31419 P:0.21831 F:0.25762
40 ROUGE-L Eval D0716-A.M.100.D-C.40 R:0.45902 P:0.30702 F:0.36794
40 ROUGE-L Eval D0716-A.M.100.D-D.40 R:0.48000 P:0.31579 F:0.38095
40 ROUGE-L Eval D0716-A.M.100.D-E.40 R:0.47841 P:0.31579 F:0.38045
40 ROUGE-L Eval D0716-A.M.100.D-F.40 R:0.47855 P:0.31798 F:0.38208
40 ROUGE-L Eval D0716-B.M.100.D-C.40 R:0.30921 P:0.21609 F:0.25440
40 ROUGE-L Eval D0716-B.M.100.D-D.40 R:0.33557 P:0.22989 F:0.27285
40 ROUGE-L Eval D0716-B.M.100.D-E.40 R:0.28239 P:0.19540 F:0.23098
40 ROUGE-L Eval D0716-B.M.100.D-F.40 R:0.31000 P:0.21379 F:0.25306
40 ROUGE-L Eval D0716-C.M.100.D-C.40 R:0.38111 P:0.26000 F:0.30912
40 ROUGE-L Eval D0716-C.M.100.D-D.40 R:0.37793 P:0.25111 F:0.30174
40 ROUGE-L Eval D0716-C.M.100.D-E.40 R:0.39274 P:0.26444 F:0.31607
40 ROUGE-L Eval D0716-C.M.100.D-F.40 R:0.37667 P:0.25111 F:0.30133
40 ROUGE-L Eval D0721-A.M.100.E-B.40 R:0.27667 P:0.20802 F:0.23748
40 ROUGE-L Eval D0721-A.M.100.E-C.40 R:0.27273 P:0.21053 F:0.23763
40 ROUGE-L Eval D0721-A.M.100.E-E.40 R:0.25325 P:0.19549 F:0.22065
40 ROUGE-L Eval D0721-A.M.100.E-G.40 R:0.26115 P:0.20551 F:0.23001
40 ROUGE-L Eval D0721-B.M.100.E-B.40 R:0.24756 P:0.20106 F:0.22190
40 ROUGE-L Eval D0721-B.M.100.E-C.40 R:0.24841 P:0.20635 F:0.22543
40 ROUGE-L Eval D0721-B.M.100.E-E.40 R:0.23607 P:0.19048 F:0.21084
40 ROUGE-L Eval D0721-B.M.100.E-G.40 R:0.22903 P:0.18783 F:0.20639
40 ROUGE-L Eval D0721-C.M.100.E-B.40 R:0.35410 P:0.27068 F:0.30682
40 ROUGE-L Eval D0721-C.M.100.E-C.40 R:0.32673 P:0.24812 F:0.28205
40 ROUGE-L Eval D0721-C.M.100.E-E.40 R:0.29667 P:0.22306 F:0.25465
40 ROUGE-L Eval D0721-C.M.100.E-G.40 R:0.34528 P:0.26566 F:0.30028
40 ROUGE-L Eval D0726-A.M.100.F-A.40 R:0.41528 P:0.28153 F:0.33557
40 ROUGE-L Eval D0726-A.M.100.F-E.40 R:0.39667 P:0.26802 F:0.31989
40 ROUGE-L Eval D0726-A.M.100.F-F.40 R:0.41528 P:0.28153 F:0.33557
40 ROUGE-L Eval D0726-A.M.100.F-G.40 R:0.39867 P:0.27027 F:0.32215
40 ROUGE-L Eval D0726-B.M.100.F-A.40 R:0.28431 P:0.20863 F:0.24066
40 ROUGE-L Eval D0726-B.M.100.F-E.40 R:0.27243 P:0.19664 F:0.22841
40 ROUGE-L Eval D0726-B.M.100.F-F.40 R:0.27243 P:0.19664 F:0.22841
40 ROUGE-L Eval D0726-B.M.100.F-G.40 R:0.25987 P:0.18945 F:0.21914
40 ROUGE-L Eval D0726-C.M.100.F-A.40 R:0.29000 P:0.21481 F:0.24681
40 ROUGE-L Eval D0726-C.M.100.F-E.40 R:0.28283 P:0.20741 F:0.23932
40 ROUGE-L Eval D0726-C.M.100.F-F.40 R:0.24068 P:0.17531 F:0.20286
40 ROUGE-L Eval D0726-C.M.100.F-G.40 R:0.21967 P:0.16543 F:0.18873
40 ROUGE-L Eval D0727-A.M.100.G-A.40 R:0.37542 P:0.23542 F:0.28938
40 ROUGE-L Eval D0727-A.M.100.G-F.40 R:0.37829 P:0.23958 F:0.29337
40 ROUGE-L Eval D0727-A.M.100.G-G.40 R:0.35294 P:0.22500 F:0.27481
40 ROUGE-L Eval D0727-A.M.100.G-H.40 R:0.37500 P:0.23750 F:0.29082
40 ROUGE-L Eval D0727-B.M.100.G-A.40 R:0.34021 P:0.19075 F:0.24444
40 ROUGE-L Eval D0727-B.M.100.G-F.40 R:0.33442 P:0.19846 F:0.24910
40 ROUGE-L Eval D0727-B.M.100.G-G.40 R:0.30104 P:0.16763 F:0.21535
40 ROUGE-L Eval D0727-B.M.100.G-H.40 R:0.32646 P:0.18304 F:0.23456
40 ROUGE-L Eval D0727-C.M.100.G-A.40 R:0.28339 P:0.17576 F:0.21696
40 ROUGE-L Eval D0727-C.M.100.G-F.40 R:0.29630 P:0.17778 F:0.22223
40 ROUGE-L Eval D0727-C.M.100.G-G.40 R:0.29703 P:0.18182 F:0.22557
40 ROUGE-L Eval D0727-C.M.100.G-H.40 R:0.33108 P:0.19798 F:0.24779
40 ROUGE-L Eval D0736-A.M.100.H-G.40 R:0.32616 P:0.17041 F:0.22386
40 ROUGE-L Eval D0736-A.M.100.H-H.40 R:0.36861 P:0.18914 F:0.25000
40 ROUGE-L Eval D0736-A.M.100.H-I.40 R:0.35943 P:0.18914 F:0.24785
40 ROUGE-L Eval D0736-A.M.100.H-J.40 R:0.33660 P:0.19288 F:0.24523
40 ROUGE-L Eval D0736-B.M.100.H-G.40 R:0.57634 P:0.32265 F:0.41370
40 ROUGE-L Eval D0736-B.M.100.H-H.40 R:0.61570 P:0.31838 F:0.41972
40 ROUGE-L Eval D0736-B.M.100.H-I.40 R:0.58996 P:0.30128 F:0.39887
40 ROUGE-L Eval D0736-B.M.100.H-J.40 R:0.55594 P:0.33974 F:0.42175
40 ROUGE-L Eval D0736-C.M.100.H-G.40 R:0.38397 P:0.18384 F:0.24864
40 ROUGE-L Eval D0736-C.M.100.H-H.40 R:0.43316 P:0.16364 F:0.23754
40 ROUGE-L Eval D0736-C.M.100.H-I.40 R:0.35829 P:0.13535 F:0.19648
40 ROUGE-L Eval D0736-C.M.100.H-J.40 R:0.38868 P:0.20808 F:0.27105
40 ROUGE-L Eval D0740-A.M.100.I-D.40 R:0.32673 P:0.20370 F:0.25095
40 ROUGE-L Eval D0740-A.M.100.I-H.40 R:0.31046 P:0.19547 F:0.23990
40 ROUGE-L Eval D0740-A.M.100.I-I.40 R:0.34416 P:0.21811 F:0.26701
40 ROUGE-L Eval D0740-A.M.100.I-J.40 R:0.30968 P:0.19753 F:0.24121
40 ROUGE-L Eval D0740-B.M.100.I-D.40 R:0.29870 P:0.18254 F:0.22660
40 ROUGE-L Eval D0740-B.M.100.I-H.40 R:0.29139 P:0.17460 F:0.21836
40 ROUGE-L Eval D0740-B.M.100.I-I.40 R:0.30164 P:0.18254 F:0.22744
40 ROUGE-L Eval D0740-B.M.100.I-J.40 R:0.29450 P:0.18056 F:0.22387
40 ROUGE-L Eval D0740-C.M.100.I-D.40 R:0.38339 P:0.25478 F:0.30613
40 ROUGE-L Eval D0740-C.M.100.I-H.40 R:0.35370 P:0.23355 F:0.28133
40 ROUGE-L Eval D0740-C.M.100.I-I.40 R:0.35783 P:0.23779 F:0.28571
40 ROUGE-L Eval D0740-C.M.100.I-J.40 R:0.36306 P:0.24204 F:0.29045
40 ROUGE-L Eval D0743-A.M.100.J-B.40 R:0.32698 P:0.20078 F:0.24879
40 ROUGE-L Eval D0743-A.M.100.J-H.40 R:0.29321 P:0.18519 F:0.22700
40 ROUGE-L Eval D0743-A.M.100.J-I.40 R:0.31562 P:0.19688 F:0.24249
40 ROUGE-L Eval D0743-A.M.100.J-J.40 R:0.28923 P:0.18324 F:0.22435
40 ROUGE-L Eval D0743-B.M.100.J-B.40 R:0.20192 P:0.12805 F:0.15672
40 ROUGE-L Eval D0743-B.M.100.J-H.40 R:0.22397 P:0.14431 F:0.17552
40 ROUGE-L Eval D0743-B.M.100.J-I.40 R:0.22785 P:0.14634 F:0.17822
40 ROUGE-L Eval D0743-B.M.100.J-J.40 R:0.20872 P:0.13618 F:0.16482
40 ROUGE-L Eval D0743-C.M.100.J-B.40 R:0.26667 P:0.16970 F:0.20741
40 ROUGE-L Eval D0743-C.M.100.J-H.40 R:0.26433 P:0.16768 F:0.20519
40 ROUGE-L Eval D0743-C.M.100.J-I.40 R:0.29393 P:0.18586 F:0.22772
40 ROUGE-L Eval D0743-C.M.100.J-J.40 R:0.25157 P:0.16162 F:0.19680
---------------------------------------------
40 ROUGE-W-1.2 Average_R: 0.11940 (95%-conf.int. 0.11446 - 0.12454)
40 ROUGE-W-1.2 Average_P: 0.14133 (95%-conf.int. 0.13627 - 0.14637)
40 ROUGE-W-1.2 Average_F: 0.12885 (95%-conf.int. 0.12421 - 0.13362)
.............................................
40 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.40 R:0.13112 P:0.16066 F:0.14439
40 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.40 R:0.12487 P:0.15548 F:0.13850
40 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.40 R:0.12964 P:0.15989 F:0.14318
40 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.40 R:0.13239 P:0.15306 F:0.14198
40 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.40 R:0.10967 P:0.13736 F:0.12196
40 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.40 R:0.11158 P:0.13890 F:0.12375
40 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.40 R:0.11290 P:0.13930 F:0.12472
40 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.40 R:0.11589 P:0.14282 F:0.12795
40 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.40 R:0.10910 P:0.15026 F:0.12641
40 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.40 R:0.10361 P:0.14876 F:0.12215
40 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.40 R:0.10255 P:0.14513 F:0.12018
40 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.40 R:0.11764 P:0.15799 F:0.13486
40 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.40 R:0.12933 P:0.16433 F:0.14474
40 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.40 R:0.11783 P:0.15209 F:0.13279
40 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.40 R:0.09922 P:0.12740 F:0.11156
40 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.40 R:0.12140 P:0.15929 F:0.13779
40 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.40 R:0.11718 P:0.12858 F:0.12262
40 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.40 R:0.11065 P:0.12402 F:0.11695
40 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.40 R:0.11017 P:0.12400 F:0.11668
40 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.40 R:0.11488 P:0.13291 F:0.12324
40 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.40 R:0.11747 P:0.13030 F:0.12355
40 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.40 R:0.11134 P:0.12456 F:0.11758
40 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.40 R:0.11716 P:0.12981 F:0.12316
40 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.40 R:0.12873 P:0.14670 F:0.13713
40 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.40 R:0.12481 P:0.15512 F:0.13832
40 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.40 R:0.11005 P:0.13560 F:0.12150
40 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.40 R:0.11676 P:0.14263 F:0.12840
40 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.40 R:0.11834 P:0.14701 F:0.13113
40 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.40 R:0.09408 P:0.11267 F:0.10254
40 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.40 R:0.10044 P:0.12549 F:0.11158
40 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.40 R:0.08892 P:0.11364 F:0.09977
40 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.40 R:0.09650 P:0.12072 F:0.10726
40 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.40 R:0.11139 P:0.14812 F:0.12716
40 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.40 R:0.10843 P:0.13945 F:0.12200
40 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.40 R:0.10716 P:0.14137 F:0.12191
40 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.40 R:0.10570 P:0.14155 F:0.12103
40 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.40 R:0.16802 P:0.20531 F:0.18480
40 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.40 R:0.16776 P:0.21027 F:0.18662
40 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.40 R:0.16986 P:0.20939 F:0.18756
40 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.40 R:0.16304 P:0.20602 F:0.18203
40 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.40 R:0.11867 P:0.14468 F:0.13039
40 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.40 R:0.12326 P:0.15111 F:0.13577
40 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.40 R:0.10398 P:0.12809 F:0.11478
40 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.40 R:0.11816 P:0.14424 F:0.12990
40 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.40 R:0.13183 P:0.16763 F:0.14759
40 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.40 R:0.12574 P:0.16202 F:0.14159
40 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.40 R:0.13109 P:0.17105 F:0.14843
40 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.40 R:0.12460 P:0.16159 F:0.14070
40 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.40 R:0.10513 P:0.13894 F:0.11969
40 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.40 R:0.10126 P:0.13868 F:0.11705
40 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.40 R:0.09070 P:0.12577 F:0.10539
40 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.40 R:0.09799 P:0.13514 F:0.11361
40 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.40 R:0.08413 P:0.13210 F:0.10279
40 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.40 R:0.08472 P:0.13228 F:0.10329
40 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.40 R:0.07713 P:0.12216 F:0.09456
40 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.40 R:0.07367 P:0.12058 F:0.09146
40 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.40 R:0.12703 P:0.17872 F:0.14851
40 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.40 R:0.11661 P:0.16661 F:0.13720
40 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.40 R:0.10756 P:0.15094 F:0.12561
40 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.40 R:0.12371 P:0.17800 F:0.14597
40 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.40 R:0.15827 P:0.19014 F:0.17275
40 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.40 R:0.15291 P:0.18101 F:0.16578
40 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.40 R:0.15737 P:0.19002 F:0.17216
40 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.40 R:0.14665 P:0.17996 F:0.16161
40 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.40 R:0.10541 P:0.13606 F:0.11879
40 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.40 R:0.09703 P:0.12643 F:0.10980
40 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.40 R:0.09853 P:0.12921 F:0.11180
40 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.40 R:0.09298 P:0.12239 F:0.10568
40 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.40 R:0.10622 P:0.13817 F:0.12011
40 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.40 R:0.10317 P:0.13353 F:0.11640
40 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.40 R:0.08689 P:0.11335 F:0.09837
40 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.40 R:0.08155 P:0.10996 F:0.09365
40 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.40 R:0.13118 P:0.14479 F:0.13765
40 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.40 R:0.13335 P:0.15416 F:0.14300
40 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.40 R:0.12246 P:0.13827 F:0.12989
40 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.40 R:0.13301 P:0.15100 F:0.14144
40 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.40 R:0.11999 P:0.11804 F:0.11901
40 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.40 R:0.11298 P:0.12044 F:0.11659
40 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.40 R:0.10245 P:0.10218 F:0.10231
40 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.40 R:0.11107 P:0.11024 F:0.11065
40 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.40 R:0.09541 P:0.10641 F:0.10061
40 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.40 R:0.10007 P:0.11097 F:0.10524
40 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.40 R:0.09823 P:0.11069 F:0.10409
40 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.40 R:0.11107 P:0.11954 F:0.11515
40 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.40 R:0.12374 P:0.11449 F:0.11894
40 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.40 R:0.14393 P:0.12987 F:0.13654
40 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.40 R:0.13912 P:0.13081 F:0.13484
40 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.40 R:0.12606 P:0.12878 F:0.12741
40 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.40 R:0.22373 P:0.23184 F:0.22771
40 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.40 R:0.25006 P:0.23922 F:0.24452
40 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.40 R:0.23671 P:0.22327 F:0.22979
40 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.40 R:0.22047 P:0.24908 F:0.23390
40 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.40 R:0.15551 P:0.13525 F:0.14467
40 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.40 R:0.18021 P:0.12725 F:0.14917
40 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.40 R:0.13485 P:0.09293 F:0.11003
40 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.40 R:0.15457 P:0.14764 F:0.15103
40 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.40 R:0.11642 P:0.13351 F:0.12438
40 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.40 R:0.11618 P:0.13197 F:0.12357
40 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.40 R:0.12444 P:0.14587 F:0.13431
40 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.40 R:0.11091 P:0.12996 F:0.11968
40 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.40 R:0.10643 P:0.11950 F:0.11259
40 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.40 R:0.10809 P:0.11526 F:0.11156
40 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.40 R:0.10382 P:0.11806 F:0.11048
40 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.40 R:0.10617 P:0.11637 F:0.11104
40 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.40 R:0.13218 P:0.16952 F:0.14854
40 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.40 R:0.12384 P:0.15261 F:0.13673
40 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.40 R:0.12436 P:0.16162 F:0.14056
40 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.40 R:0.12757 P:0.16297 F:0.14311
40 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.40 R:0.11775 P:0.12604 F:0.12175
40 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.40 R:0.10531 P:0.11489 F:0.10989
40 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.40 R:0.11300 P:0.12507 F:0.11873
40 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.40 R:0.10447 P:0.11490 F:0.10944
40 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.40 R:0.07921 P:0.08412 F:0.08159
40 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.40 R:0.08959 P:0.09573 F:0.09256
40 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.40 R:0.09000 P:0.09742 F:0.09356
40 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.40 R:0.08571 P:0.09194 F:0.08872
40 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.40 R:0.09405 P:0.10476 F:0.09912
40 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.40 R:0.09728 P:0.10305 F:0.10008
40 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.40 R:0.10121 P:0.11404 F:0.10724
40 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.40 R:0.08947 P:0.09675 F:0.09297
---------------------------------------------
40 ROUGE-SU4 Average_R: 0.14458 (95%-conf.int. 0.13512 - 0.15433)
40 ROUGE-SU4 Average_P: 0.09324 (95%-conf.int. 0.08792 - 0.09845)
40 ROUGE-SU4 Average_F: 0.11293 (95%-conf.int. 0.10614 - 0.11971)
.............................................
40 ROUGE-SU4 Eval D0703-A.M.100.A-A.40 R:0.17303 P:0.11671 F:0.13940
40 ROUGE-SU4 Eval D0703-A.M.100.A-C.40 R:0.17299 P:0.11749 F:0.13994
40 ROUGE-SU4 Eval D0703-A.M.100.A-D.40 R:0.17020 P:0.11280 F:0.13568
40 ROUGE-SU4 Eval D0703-A.M.100.A-J.40 R:0.15851 P:0.10617 F:0.12716
40 ROUGE-SU4 Eval D0703-B.M.100.A-A.40 R:0.12304 P:0.08240 F:0.09870
40 ROUGE-SU4 Eval D0703-B.M.100.A-C.40 R:0.12586 P:0.08202 F:0.09932
40 ROUGE-SU4 Eval D0703-B.M.100.A-D.40 R:0.13506 P:0.08801 F:0.10657
40 ROUGE-SU4 Eval D0703-B.M.100.A-J.40 R:0.13538 P:0.08914 F:0.10750
40 ROUGE-SU4 Eval D0703-C.M.100.A-A.40 R:0.15411 P:0.11335 F:0.13062
40 ROUGE-SU4 Eval D0703-C.M.100.A-C.40 R:0.14833 P:0.11209 F:0.12769
40 ROUGE-SU4 Eval D0703-C.M.100.A-D.40 R:0.13492 P:0.09992 F:0.11481
40 ROUGE-SU4 Eval D0703-C.M.100.A-J.40 R:0.15420 P:0.11419 F:0.13121
40 ROUGE-SU4 Eval D0706-A.M.100.B-B.40 R:0.15444 P:0.10851 F:0.12746
40 ROUGE-SU4 Eval D0706-A.M.100.B-D.40 R:0.13311 P:0.09290 F:0.10943
40 ROUGE-SU4 Eval D0706-A.M.100.B-E.40 R:0.10444 P:0.07338 F:0.08620
40 ROUGE-SU4 Eval D0706-A.M.100.B-I.40 R:0.15056 P:0.10578 F:0.12426
40 ROUGE-SU4 Eval D0706-B.M.100.B-B.40 R:0.11857 P:0.07439 F:0.09142
40 ROUGE-SU4 Eval D0706-B.M.100.B-D.40 R:0.11260 P:0.07088 F:0.08700
40 ROUGE-SU4 Eval D0706-B.M.100.B-E.40 R:0.11278 P:0.07123 F:0.08731
40 ROUGE-SU4 Eval D0706-B.M.100.B-I.40 R:0.12514 P:0.07930 F:0.09708
40 ROUGE-SU4 Eval D0706-C.M.100.B-B.40 R:0.12472 P:0.08031 F:0.09771
40 ROUGE-SU4 Eval D0706-C.M.100.B-D.40 R:0.12417 P:0.07996 F:0.09728
40 ROUGE-SU4 Eval D0706-C.M.100.B-E.40 R:0.13103 P:0.08493 F:0.10306
40 ROUGE-SU4 Eval D0706-C.M.100.B-I.40 R:0.14098 P:0.09168 F:0.11111
40 ROUGE-SU4 Eval D0711-A.M.100.C-A.40 R:0.14583 P:0.09969 F:0.11842
40 ROUGE-SU4 Eval D0711-A.M.100.C-B.40 R:0.12215 P:0.08237 F:0.09839
40 ROUGE-SU4 Eval D0711-A.M.100.C-C.40 R:0.12158 P:0.08199 F:0.09794
40 ROUGE-SU4 Eval D0711-A.M.100.C-F.40 R:0.14342 P:0.09738 F:0.11600
40 ROUGE-SU4 Eval D0711-B.M.100.C-A.40 R:0.09091 P:0.06047 F:0.07263
40 ROUGE-SU4 Eval D0711-B.M.100.C-B.40 R:0.11737 P:0.07752 F:0.09337
40 ROUGE-SU4 Eval D0711-B.M.100.C-C.40 R:0.10805 P:0.07287 F:0.08704
40 ROUGE-SU4 Eval D0711-B.M.100.C-F.40 R:0.11092 P:0.07403 F:0.08880
40 ROUGE-SU4 Eval D0711-C.M.100.C-A.40 R:0.12429 P:0.08772 F:0.10285
40 ROUGE-SU4 Eval D0711-C.M.100.C-B.40 R:0.11287 P:0.07695 F:0.09151
40 ROUGE-SU4 Eval D0711-C.M.100.C-C.40 R:0.12963 P:0.08931 F:0.10576
40 ROUGE-SU4 Eval D0711-C.M.100.C-F.40 R:0.12095 P:0.08333 F:0.09868
40 ROUGE-SU4 Eval D0716-A.M.100.D-C.40 R:0.25533 P:0.16927 F:0.20358
40 ROUGE-SU4 Eval D0716-A.M.100.D-D.40 R:0.27568 P:0.17969 F:0.21757
40 ROUGE-SU4 Eval D0716-A.M.100.D-E.40 R:0.26280 P:0.17188 F:0.20783
40 ROUGE-SU4 Eval D0716-A.M.100.D-F.40 R:0.27006 P:0.17783 F:0.21445
40 ROUGE-SU4 Eval D0716-B.M.100.D-C.40 R:0.15203 P:0.10539 F:0.12448
40 ROUGE-SU4 Eval D0716-B.M.100.D-D.40 R:0.16609 P:0.11280 F:0.13435
40 ROUGE-SU4 Eval D0716-B.M.100.D-E.40 R:0.12116 P:0.08314 F:0.09861
40 ROUGE-SU4 Eval D0716-B.M.100.D-F.40 R:0.15183 P:0.10383 F:0.12332
40 ROUGE-SU4 Eval D0716-C.M.100.D-C.40 R:0.15217 P:0.10294 F:0.12280
40 ROUGE-SU4 Eval D0716-C.M.100.D-D.40 R:0.16438 P:0.10822 F:0.13052
40 ROUGE-SU4 Eval D0716-C.M.100.D-E.40 R:0.15819 P:0.10558 F:0.12664
40 ROUGE-SU4 Eval D0716-C.M.100.D-F.40 R:0.15925 P:0.10520 F:0.12670
40 ROUGE-SU4 Eval D0721-A.M.100.E-B.40 R:0.10274 P:0.07673 F:0.08785
40 ROUGE-SU4 Eval D0721-A.M.100.E-C.40 R:0.10056 P:0.07715 F:0.08731
40 ROUGE-SU4 Eval D0721-A.M.100.E-E.40 R:0.08389 P:0.06436 F:0.07284
40 ROUGE-SU4 Eval D0721-A.M.100.E-G.40 R:0.09532 P:0.07460 F:0.08370
40 ROUGE-SU4 Eval D0721-B.M.100.E-B.40 R:0.10925 P:0.08829 F:0.09766
40 ROUGE-SU4 Eval D0721-B.M.100.E-C.40 R:0.10294 P:0.08514 F:0.09320
40 ROUGE-SU4 Eval D0721-B.M.100.E-E.40 R:0.09371 P:0.07523 F:0.08346
40 ROUGE-SU4 Eval D0721-B.M.100.E-G.40 R:0.09603 P:0.07838 F:0.08631
40 ROUGE-SU4 Eval D0721-C.M.100.E-B.40 R:0.17733 P:0.13470 F:0.15310
40 ROUGE-SU4 Eval D0721-C.M.100.E-C.40 R:0.15876 P:0.11978 F:0.13654
40 ROUGE-SU4 Eval D0721-C.M.100.E-E.40 R:0.13527 P:0.10102 F:0.11566
40 ROUGE-SU4 Eval D0721-C.M.100.E-G.40 R:0.17224 P:0.13171 F:0.14927
40 ROUGE-SU4 Eval D0726-A.M.100.F-A.40 R:0.22412 P:0.15061 F:0.18015
40 ROUGE-SU4 Eval D0726-A.M.100.F-E.40 R:0.19806 P:0.13265 F:0.15889
40 ROUGE-SU4 Eval D0726-A.M.100.F-F.40 R:0.22071 P:0.14832 F:0.17741
40 ROUGE-SU4 Eval D0726-A.M.100.F-G.40 R:0.19909 P:0.13379 F:0.16004
40 ROUGE-SU4 Eval D0726-B.M.100.F-A.40 R:0.11409 P:0.08313 F:0.09618
40 ROUGE-SU4 Eval D0726-B.M.100.F-E.40 R:0.10751 P:0.07702 F:0.08975
40 ROUGE-SU4 Eval D0726-B.M.100.F-F.40 R:0.11377 P:0.08150 F:0.09497
40 ROUGE-SU4 Eval D0726-B.M.100.F-G.40 R:0.10191 P:0.07376 F:0.08558
40 ROUGE-SU4 Eval D0726-C.M.100.F-A.40 R:0.11016 P:0.08102 F:0.09337
40 ROUGE-SU4 Eval D0726-C.M.100.F-E.40 R:0.11246 P:0.08186 F:0.09475
40 ROUGE-SU4 Eval D0726-C.M.100.F-F.40 R:0.08537 P:0.06171 F:0.07164
40 ROUGE-SU4 Eval D0726-C.M.100.F-G.40 R:0.07856 P:0.05877 F:0.06724
40 ROUGE-SU4 Eval D0727-A.M.100.G-A.40 R:0.14903 P:0.09251 F:0.11416
40 ROUGE-SU4 Eval D0727-A.M.100.G-F.40 R:0.16441 P:0.10311 F:0.12674
40 ROUGE-SU4 Eval D0727-A.M.100.G-G.40 R:0.13199 P:0.08333 F:0.10216
40 ROUGE-SU4 Eval D0727-A.M.100.G-H.40 R:0.16498 P:0.10346 F:0.12717
40 ROUGE-SU4 Eval D0727-B.M.100.G-A.40 R:0.12426 P:0.06882 F:0.08858
40 ROUGE-SU4 Eval D0727-B.M.100.G-F.40 R:0.12278 P:0.07208 F:0.09083
40 ROUGE-SU4 Eval D0727-B.M.100.G-G.40 R:0.10676 P:0.05871 F:0.07576
40 ROUGE-SU4 Eval D0727-B.M.100.G-H.40 R:0.11307 P:0.06262 F:0.08060
40 ROUGE-SU4 Eval D0727-C.M.100.G-A.40 R:0.10758 P:0.06605 F:0.08185
40 ROUGE-SU4 Eval D0727-C.M.100.G-F.40 R:0.11246 P:0.06674 F:0.08377
40 ROUGE-SU4 Eval D0727-C.M.100.G-G.40 R:0.11243 P:0.06810 F:0.08482
40 ROUGE-SU4 Eval D0727-C.M.100.G-H.40 R:0.12731 P:0.07529 F:0.09462
40 ROUGE-SU4 Eval D0736-A.M.100.H-G.40 R:0.13776 P:0.07098 F:0.09369
40 ROUGE-SU4 Eval D0736-A.M.100.H-H.40 R:0.18233 P:0.09221 F:0.12248
40 ROUGE-SU4 Eval D0736-A.M.100.H-I.40 R:0.17216 P:0.08935 F:0.11764
40 ROUGE-SU4 Eval D0736-A.M.100.H-J.40 R:0.15660 P:0.08872 F:0.11327
40 ROUGE-SU4 Eval D0736-B.M.100.H-G.40 R:0.33530 P:0.18514 F:0.23856
40 ROUGE-SU4 Eval D0736-B.M.100.H-H.40 R:0.38604 P:0.19638 F:0.26033
40 ROUGE-SU4 Eval D0736-B.M.100.H-I.40 R:0.36797 P:0.18478 F:0.24602
40 ROUGE-SU4 Eval D0736-B.M.100.H-J.40 R:0.34353 P:0.20761 F:0.25881
40 ROUGE-SU4 Eval D0736-C.M.100.H-G.40 R:0.17758 P:0.08350 F:0.11359
40 ROUGE-SU4 Eval D0736-C.M.100.H-H.40 R:0.21508 P:0.07906 F:0.11562
40 ROUGE-SU4 Eval D0736-C.M.100.H-I.40 R:0.14711 P:0.05407 F:0.07908
40 ROUGE-SU4 Eval D0736-C.M.100.H-J.40 R:0.16537 P:0.08727 F:0.11425
40 ROUGE-SU4 Eval D0740-A.M.100.I-D.40 R:0.13672 P:0.08438 F:0.10435
40 ROUGE-SU4 Eval D0740-A.M.100.I-H.40 R:0.13367 P:0.08333 F:0.10266
40 ROUGE-SU4 Eval D0740-A.M.100.I-I.40 R:0.15944 P:0.10007 F:0.12296
40 ROUGE-SU4 Eval D0740-A.M.100.I-J.40 R:0.12914 P:0.08159 F:0.10000
40 ROUGE-SU4 Eval D0740-B.M.100.I-D.40 R:0.12056 P:0.07292 F:0.09087
40 ROUGE-SU4 Eval D0740-B.M.100.I-H.40 R:0.12018 P:0.07124 F:0.08945
40 ROUGE-SU4 Eval D0740-B.M.100.I-I.40 R:0.12738 P:0.07628 F:0.09542
40 ROUGE-SU4 Eval D0740-B.M.100.I-J.40 R:0.12016 P:0.07292 F:0.09076
40 ROUGE-SU4 Eval D0740-C.M.100.I-D.40 R:0.19891 P:0.13103 F:0.15799
40 ROUGE-SU4 Eval D0740-C.M.100.I-H.40 R:0.16172 P:0.10583 F:0.12794
40 ROUGE-SU4 Eval D0740-C.M.100.I-I.40 R:0.18142 P:0.11951 F:0.14410
40 ROUGE-SU4 Eval D0740-C.M.100.I-J.40 R:0.18627 P:0.12311 F:0.14824
40 ROUGE-SU4 Eval D0743-A.M.100.J-B.40 R:0.11509 P:0.06997 F:0.08703
40 ROUGE-SU4 Eval D0743-A.M.100.J-H.40 R:0.09388 P:0.05875 F:0.07227
40 ROUGE-SU4 Eval D0743-A.M.100.J-I.40 R:0.11378 P:0.07030 F:0.08690
40 ROUGE-SU4 Eval D0743-A.M.100.J-J.40 R:0.09464 P:0.05941 F:0.07300
40 ROUGE-SU4 Eval D0743-B.M.100.J-B.40 R:0.06360 P:0.03994 F:0.04907
40 ROUGE-SU4 Eval D0743-B.M.100.J-H.40 R:0.06580 P:0.04201 F:0.05128
40 ROUGE-SU4 Eval D0743-B.M.100.J-I.40 R:0.07413 P:0.04718 F:0.05766
40 ROUGE-SU4 Eval D0743-B.M.100.J-J.40 R:0.06709 P:0.04339 F:0.05270
40 ROUGE-SU4 Eval D0743-C.M.100.J-B.40 R:0.10261 P:0.06468 F:0.07935
40 ROUGE-SU4 Eval D0743-C.M.100.J-H.40 R:0.09641 P:0.06057 F:0.07440
40 ROUGE-SU4 Eval D0743-C.M.100.J-I.40 R:0.11803 P:0.07392 F:0.09091
40 ROUGE-SU4 Eval D0743-C.M.100.J-J.40 R:0.09194 P:0.05852 F:0.07152
---------------------------------------------
41 ROUGE-1 Average_R: 0.29978 (95%-conf.int. 0.28643 - 0.31330)
41 ROUGE-1 Average_P: 0.22460 (95%-conf.int. 0.21524 - 0.23415)
41 ROUGE-1 Average_F: 0.25494 (95%-conf.int. 0.24478 - 0.26560)
.............................................
41 ROUGE-1 Eval D0703-A.M.100.A-A.41 R:0.28378 P:0.33333 F:0.30657
41 ROUGE-1 Eval D0703-A.M.100.A-C.41 R:0.25168 P:0.29762 F:0.27273
41 ROUGE-1 Eval D0703-A.M.100.A-D.41 R:0.27148 P:0.31349 F:0.29098
41 ROUGE-1 Eval D0703-A.M.100.A-J.41 R:0.27211 P:0.31746 F:0.29304
41 ROUGE-1 Eval D0703-B.M.100.A-A.41 R:0.26144 P:0.21164 F:0.23392
41 ROUGE-1 Eval D0703-B.M.100.A-C.41 R:0.27517 P:0.21693 F:0.24260
41 ROUGE-1 Eval D0703-B.M.100.A-D.41 R:0.26846 P:0.21164 F:0.23669
41 ROUGE-1 Eval D0703-B.M.100.A-J.41 R:0.25249 P:0.20106 F:0.22386
41 ROUGE-1 Eval D0703-C.M.100.A-A.41 R:0.21333 P:0.22222 F:0.21768
41 ROUGE-1 Eval D0703-C.M.100.A-C.41 R:0.22403 P:0.23958 F:0.23154
41 ROUGE-1 Eval D0703-C.M.100.A-D.41 R:0.22185 P:0.23264 F:0.22712
41 ROUGE-1 Eval D0703-C.M.100.A-J.41 R:0.22185 P:0.23264 F:0.22712
41 ROUGE-1 Eval D0706-A.M.100.B-B.41 R:0.29545 P:0.18841 F:0.23009
41 ROUGE-1 Eval D0706-A.M.100.B-D.41 R:0.25163 P:0.15942 F:0.19518
41 ROUGE-1 Eval D0706-A.M.100.B-E.41 R:0.26623 P:0.16977 F:0.20733
41 ROUGE-1 Eval D0706-A.M.100.B-I.41 R:0.28896 P:0.18427 F:0.22504
41 ROUGE-1 Eval D0706-B.M.100.B-B.41 R:0.20915 P:0.15348 F:0.17704
41 ROUGE-1 Eval D0706-B.M.100.B-D.41 R:0.19218 P:0.14149 F:0.16298
41 ROUGE-1 Eval D0706-B.M.100.B-E.41 R:0.20455 P:0.15108 F:0.17380
41 ROUGE-1 Eval D0706-B.M.100.B-I.41 R:0.20388 P:0.15108 F:0.17355
41 ROUGE-1 Eval D0706-C.M.100.B-B.41 R:0.36774 P:0.25676 F:0.30239
41 ROUGE-1 Eval D0706-C.M.100.B-D.41 R:0.37742 P:0.26351 F:0.31034
41 ROUGE-1 Eval D0706-C.M.100.B-E.41 R:0.35256 P:0.24775 F:0.29101
41 ROUGE-1 Eval D0706-C.M.100.B-I.41 R:0.36741 P:0.25901 F:0.30383
41 ROUGE-1 Eval D0711-A.M.100.C-A.41 R:0.41447 P:0.28966 F:0.34100
41 ROUGE-1 Eval D0711-A.M.100.C-B.41 R:0.42000 P:0.28966 F:0.34286
41 ROUGE-1 Eval D0711-A.M.100.C-C.41 R:0.38000 P:0.26207 F:0.31020
41 ROUGE-1 Eval D0711-A.M.100.C-F.41 R:0.39735 P:0.27586 F:0.32564
41 ROUGE-1 Eval D0711-B.M.100.C-A.41 R:0.30952 P:0.20222 F:0.24462
41 ROUGE-1 Eval D0711-B.M.100.C-B.41 R:0.33904 P:0.22000 F:0.26685
41 ROUGE-1 Eval D0711-B.M.100.C-C.41 R:0.33893 P:0.22444 F:0.27005
41 ROUGE-1 Eval D0711-B.M.100.C-F.41 R:0.35593 P:0.23333 F:0.28188
41 ROUGE-1 Eval D0711-C.M.100.C-A.41 R:0.31023 P:0.23039 F:0.26441
41 ROUGE-1 Eval D0711-C.M.100.C-B.41 R:0.33788 P:0.24265 F:0.28245
41 ROUGE-1 Eval D0711-C.M.100.C-C.41 R:0.31419 P:0.22794 F:0.26420
41 ROUGE-1 Eval D0711-C.M.100.C-F.41 R:0.31081 P:0.22549 F:0.26136
41 ROUGE-1 Eval D0716-A.M.100.D-C.41 R:0.44590 P:0.32151 F:0.37362
41 ROUGE-1 Eval D0716-A.M.100.D-D.41 R:0.44667 P:0.31678 F:0.37068
41 ROUGE-1 Eval D0716-A.M.100.D-E.41 R:0.46844 P:0.33333 F:0.38950
41 ROUGE-1 Eval D0716-A.M.100.D-F.41 R:0.47525 P:0.34043 F:0.39670
41 ROUGE-1 Eval D0716-B.M.100.D-C.41 R:0.35197 P:0.27649 F:0.30970
41 ROUGE-1 Eval D0716-B.M.100.D-D.41 R:0.38926 P:0.29974 F:0.33868
41 ROUGE-1 Eval D0716-B.M.100.D-E.41 R:0.37874 P:0.29457 F:0.33139
41 ROUGE-1 Eval D0716-B.M.100.D-F.41 R:0.36667 P:0.28424 F:0.32024
41 ROUGE-1 Eval D0716-C.M.100.D-C.41 R:0.39739 P:0.29684 F:0.33983
41 ROUGE-1 Eval D0716-C.M.100.D-D.41 R:0.43478 P:0.31630 F:0.36620
41 ROUGE-1 Eval D0716-C.M.100.D-E.41 R:0.40924 P:0.30170 F:0.34734
41 ROUGE-1 Eval D0716-C.M.100.D-F.41 R:0.40667 P:0.29684 F:0.34318
41 ROUGE-1 Eval D0721-A.M.100.E-B.41 R:0.34333 P:0.22294 F:0.27034
41 ROUGE-1 Eval D0721-A.M.100.E-C.41 R:0.35065 P:0.23377 F:0.28052
41 ROUGE-1 Eval D0721-A.M.100.E-E.41 R:0.32468 P:0.21645 F:0.25974
41 ROUGE-1 Eval D0721-A.M.100.E-G.41 R:0.31847 P:0.21645 F:0.25773
41 ROUGE-1 Eval D0721-B.M.100.E-B.41 R:0.24756 P:0.22419 F:0.23530
41 ROUGE-1 Eval D0721-B.M.100.E-C.41 R:0.25796 P:0.23894 F:0.24809
41 ROUGE-1 Eval D0721-B.M.100.E-E.41 R:0.24590 P:0.22124 F:0.23292
41 ROUGE-1 Eval D0721-B.M.100.E-G.41 R:0.24839 P:0.22714 F:0.23729
41 ROUGE-1 Eval D0721-C.M.100.E-B.41 R:0.31475 P:0.25806 F:0.28360
41 ROUGE-1 Eval D0721-C.M.100.E-C.41 R:0.28713 P:0.23387 F:0.25778
41 ROUGE-1 Eval D0721-C.M.100.E-E.41 R:0.28000 P:0.22581 F:0.25000
41 ROUGE-1 Eval D0721-C.M.100.E-G.41 R:0.28339 P:0.23387 F:0.25626
41 ROUGE-1 Eval D0726-A.M.100.F-A.41 R:0.32226 P:0.20996 F:0.25426
41 ROUGE-1 Eval D0726-A.M.100.F-E.41 R:0.32667 P:0.21212 F:0.25722
41 ROUGE-1 Eval D0726-A.M.100.F-F.41 R:0.33887 P:0.22078 F:0.26737
41 ROUGE-1 Eval D0726-A.M.100.F-G.41 R:0.29900 P:0.19481 F:0.23591
41 ROUGE-1 Eval D0726-B.M.100.F-A.41 R:0.25163 P:0.20533 F:0.22613
41 ROUGE-1 Eval D0726-B.M.100.F-E.41 R:0.23588 P:0.18933 F:0.21006
41 ROUGE-1 Eval D0726-B.M.100.F-F.41 R:0.26246 P:0.21067 F:0.23373
41 ROUGE-1 Eval D0726-B.M.100.F-G.41 R:0.26974 P:0.21867 F:0.24153
41 ROUGE-1 Eval D0726-C.M.100.F-A.41 R:0.32333 P:0.22931 F:0.26832
41 ROUGE-1 Eval D0726-C.M.100.F-E.41 R:0.31650 P:0.22222 F:0.26111
41 ROUGE-1 Eval D0726-C.M.100.F-F.41 R:0.34576 P:0.24113 F:0.28412
41 ROUGE-1 Eval D0726-C.M.100.F-G.41 R:0.33770 P:0.24350 F:0.28297
41 ROUGE-1 Eval D0727-A.M.100.G-A.41 R:0.45183 P:0.31050 F:0.36806
41 ROUGE-1 Eval D0727-A.M.100.G-F.41 R:0.43421 P:0.30137 F:0.35580
41 ROUGE-1 Eval D0727-A.M.100.G-G.41 R:0.41830 P:0.29224 F:0.34409
41 ROUGE-1 Eval D0727-A.M.100.G-H.41 R:0.46382 P:0.32192 F:0.38006
41 ROUGE-1 Eval D0727-B.M.100.G-A.41 R:0.17869 P:0.21941 F:0.19697
41 ROUGE-1 Eval D0727-B.M.100.G-F.41 R:0.18506 P:0.24051 F:0.20917
41 ROUGE-1 Eval D0727-B.M.100.G-G.41 R:0.16955 P:0.20675 F:0.18631
41 ROUGE-1 Eval D0727-B.M.100.G-H.41 R:0.14777 P:0.18143 F:0.16288
41 ROUGE-1 Eval D0727-C.M.100.G-A.41 R:0.34853 P:0.23937 F:0.28382
41 ROUGE-1 Eval D0727-C.M.100.G-F.41 R:0.37710 P:0.25056 F:0.30107
41 ROUGE-1 Eval D0727-C.M.100.G-G.41 R:0.34653 P:0.23490 F:0.28000
41 ROUGE-1 Eval D0727-C.M.100.G-H.41 R:0.37500 P:0.24832 F:0.29879
41 ROUGE-1 Eval D0736-A.M.100.H-G.41 R:0.25806 P:0.21429 F:0.23415
41 ROUGE-1 Eval D0736-A.M.100.H-H.41 R:0.26642 P:0.21726 F:0.23934
41 ROUGE-1 Eval D0736-A.M.100.H-I.41 R:0.25979 P:0.21726 F:0.23663
41 ROUGE-1 Eval D0736-A.M.100.H-J.41 R:0.24837 P:0.22619 F:0.23676
41 ROUGE-1 Eval D0736-B.M.100.H-G.41 R:0.24427 P:0.15238 F:0.18768
41 ROUGE-1 Eval D0736-B.M.100.H-H.41 R:0.23554 P:0.13571 F:0.17220
41 ROUGE-1 Eval D0736-B.M.100.H-I.41 R:0.26778 P:0.15238 F:0.19423
41 ROUGE-1 Eval D0736-B.M.100.H-J.41 R:0.25524 P:0.17381 F:0.20680
41 ROUGE-1 Eval D0736-C.M.100.H-G.41 R:0.21519 P:0.12230 F:0.15596
41 ROUGE-1 Eval D0736-C.M.100.H-H.41 R:0.22460 P:0.10072 F:0.13907
41 ROUGE-1 Eval D0736-C.M.100.H-I.41 R:0.19251 P:0.08633 F:0.11920
41 ROUGE-1 Eval D0736-C.M.100.H-J.41 R:0.20377 P:0.12950 F:0.15836
41 ROUGE-1 Eval D0740-A.M.100.I-D.41 R:0.33333 P:0.23543 F:0.27595
41 ROUGE-1 Eval D0740-A.M.100.I-H.41 R:0.30065 P:0.21445 F:0.25034
41 ROUGE-1 Eval D0740-A.M.100.I-I.41 R:0.35714 P:0.25641 F:0.29851
41 ROUGE-1 Eval D0740-A.M.100.I-J.41 R:0.31935 P:0.23077 F:0.26793
41 ROUGE-1 Eval D0740-B.M.100.I-D.41 R:0.24026 P:0.15612 F:0.18926
41 ROUGE-1 Eval D0740-B.M.100.I-H.41 R:0.23510 P:0.14979 F:0.18299
41 ROUGE-1 Eval D0740-B.M.100.I-I.41 R:0.24918 P:0.16034 F:0.19512
41 ROUGE-1 Eval D0740-B.M.100.I-J.41 R:0.23625 P:0.15401 F:0.18646
41 ROUGE-1 Eval D0740-C.M.100.I-D.41 R:0.37061 P:0.27230 F:0.31394
41 ROUGE-1 Eval D0740-C.M.100.I-H.41 R:0.31511 P:0.23005 F:0.26594
41 ROUGE-1 Eval D0740-C.M.100.I-I.41 R:0.32907 P:0.24178 F:0.27875
41 ROUGE-1 Eval D0740-C.M.100.I-J.41 R:0.33758 P:0.24883 F:0.28649
41 ROUGE-1 Eval D0743-A.M.100.J-B.41 R:0.23492 P:0.16780 F:0.19577
41 ROUGE-1 Eval D0743-A.M.100.J-H.41 R:0.19753 P:0.14512 F:0.16732
41 ROUGE-1 Eval D0743-A.M.100.J-I.41 R:0.24063 P:0.17460 F:0.20236
41 ROUGE-1 Eval D0743-A.M.100.J-J.41 R:0.21538 P:0.15873 F:0.18277
41 ROUGE-1 Eval D0743-B.M.100.J-B.41 R:0.19231 P:0.12270 F:0.14981
41 ROUGE-1 Eval D0743-B.M.100.J-H.41 R:0.17666 P:0.11452 F:0.13896
41 ROUGE-1 Eval D0743-B.M.100.J-I.41 R:0.20253 P:0.13088 F:0.15901
41 ROUGE-1 Eval D0743-B.M.100.J-J.41 R:0.18692 P:0.12270 F:0.14815
41 ROUGE-1 Eval D0743-C.M.100.J-B.41 R:0.34286 P:0.25714 F:0.29388
41 ROUGE-1 Eval D0743-C.M.100.J-H.41 R:0.30255 P:0.22619 F:0.25886
41 ROUGE-1 Eval D0743-C.M.100.J-I.41 R:0.34185 P:0.25476 F:0.29195
41 ROUGE-1 Eval D0743-C.M.100.J-J.41 R:0.27987 P:0.21190 F:0.24119
---------------------------------------------
41 ROUGE-2 Average_R: 0.06188 (95%-conf.int. 0.05430 - 0.06990)
41 ROUGE-2 Average_P: 0.04643 (95%-conf.int. 0.04113 - 0.05216)
41 ROUGE-2 Average_F: 0.05267 (95%-conf.int. 0.04628 - 0.05933)
.............................................
41 ROUGE-2 Eval D0703-A.M.100.A-A.41 R:0.08191 P:0.09639 F:0.08856
41 ROUGE-2 Eval D0703-A.M.100.A-C.41 R:0.05085 P:0.06024 F:0.05515
41 ROUGE-2 Eval D0703-A.M.100.A-D.41 R:0.07292 P:0.08434 F:0.07822
41 ROUGE-2 Eval D0703-A.M.100.A-J.41 R:0.08247 P:0.09639 F:0.08889
41 ROUGE-2 Eval D0703-B.M.100.A-A.41 R:0.03300 P:0.02667 F:0.02950
41 ROUGE-2 Eval D0703-B.M.100.A-C.41 R:0.04068 P:0.03200 F:0.03582
41 ROUGE-2 Eval D0703-B.M.100.A-D.41 R:0.03390 P:0.02667 F:0.02985
41 ROUGE-2 Eval D0703-B.M.100.A-J.41 R:0.03356 P:0.02667 F:0.02972
41 ROUGE-2 Eval D0703-C.M.100.A-A.41 R:0.05051 P:0.05263 F:0.05155
41 ROUGE-2 Eval D0703-C.M.100.A-C.41 R:0.06230 P:0.06667 F:0.06441
41 ROUGE-2 Eval D0703-C.M.100.A-D.41 R:0.05686 P:0.05965 F:0.05822
41 ROUGE-2 Eval D0703-C.M.100.A-J.41 R:0.06020 P:0.06316 F:0.06164
41 ROUGE-2 Eval D0706-A.M.100.B-B.41 R:0.04918 P:0.03125 F:0.03822
41 ROUGE-2 Eval D0706-A.M.100.B-D.41 R:0.03300 P:0.02083 F:0.02554
41 ROUGE-2 Eval D0706-A.M.100.B-E.41 R:0.03607 P:0.02292 F:0.02803
41 ROUGE-2 Eval D0706-A.M.100.B-I.41 R:0.04918 P:0.03125 F:0.03822
41 ROUGE-2 Eval D0706-B.M.100.B-B.41 R:0.01650 P:0.01208 F:0.01395
41 ROUGE-2 Eval D0706-B.M.100.B-D.41 R:0.00987 P:0.00725 F:0.00836
41 ROUGE-2 Eval D0706-B.M.100.B-E.41 R:0.01311 P:0.00966 F:0.01112
41 ROUGE-2 Eval D0706-B.M.100.B-I.41 R:0.01961 P:0.01449 F:0.01667
41 ROUGE-2 Eval D0706-C.M.100.B-B.41 R:0.09772 P:0.06803 F:0.08022
41 ROUGE-2 Eval D0706-C.M.100.B-D.41 R:0.10423 P:0.07256 F:0.08556
41 ROUGE-2 Eval D0706-C.M.100.B-E.41 R:0.06796 P:0.04762 F:0.05600
41 ROUGE-2 Eval D0706-C.M.100.B-I.41 R:0.10000 P:0.07029 F:0.08255
41 ROUGE-2 Eval D0711-A.M.100.C-A.41 R:0.12625 P:0.08796 F:0.10368
41 ROUGE-2 Eval D0711-A.M.100.C-B.41 R:0.12458 P:0.08565 F:0.10151
41 ROUGE-2 Eval D0711-A.M.100.C-C.41 R:0.09428 P:0.06481 F:0.07682
41 ROUGE-2 Eval D0711-A.M.100.C-F.41 R:0.09699 P:0.06713 F:0.07934
41 ROUGE-2 Eval D0711-B.M.100.C-A.41 R:0.03093 P:0.02013 F:0.02439
41 ROUGE-2 Eval D0711-B.M.100.C-B.41 R:0.05882 P:0.03803 F:0.04619
41 ROUGE-2 Eval D0711-B.M.100.C-C.41 R:0.06102 P:0.04027 F:0.04852
41 ROUGE-2 Eval D0711-B.M.100.C-F.41 R:0.05479 P:0.03579 F:0.04330
41 ROUGE-2 Eval D0711-C.M.100.C-A.41 R:0.03667 P:0.02716 F:0.03121
41 ROUGE-2 Eval D0711-C.M.100.C-B.41 R:0.03448 P:0.02469 F:0.02878
41 ROUGE-2 Eval D0711-C.M.100.C-C.41 R:0.02389 P:0.01728 F:0.02005
41 ROUGE-2 Eval D0711-C.M.100.C-F.41 R:0.02730 P:0.01975 F:0.02292
41 ROUGE-2 Eval D0716-A.M.100.D-C.41 R:0.20199 P:0.14524 F:0.16898
41 ROUGE-2 Eval D0716-A.M.100.D-D.41 R:0.19865 P:0.14048 F:0.16458
41 ROUGE-2 Eval D0716-A.M.100.D-E.41 R:0.21477 P:0.15238 F:0.17827
41 ROUGE-2 Eval D0716-A.M.100.D-F.41 R:0.22667 P:0.16190 F:0.18889
41 ROUGE-2 Eval D0716-B.M.100.D-C.41 R:0.06645 P:0.05208 F:0.05839
41 ROUGE-2 Eval D0716-B.M.100.D-D.41 R:0.07119 P:0.05469 F:0.06186
41 ROUGE-2 Eval D0716-B.M.100.D-E.41 R:0.08054 P:0.06250 F:0.07038
41 ROUGE-2 Eval D0716-B.M.100.D-F.41 R:0.07407 P:0.05729 F:0.06461
41 ROUGE-2 Eval D0716-C.M.100.D-C.41 R:0.12500 P:0.09314 F:0.10674
41 ROUGE-2 Eval D0716-C.M.100.D-D.41 R:0.13176 P:0.09559 F:0.11080
41 ROUGE-2 Eval D0716-C.M.100.D-E.41 R:0.11333 P:0.08333 F:0.09604
41 ROUGE-2 Eval D0716-C.M.100.D-F.41 R:0.11111 P:0.08088 F:0.09362
41 ROUGE-2 Eval D0721-A.M.100.E-B.41 R:0.03704 P:0.02397 F:0.02911
41 ROUGE-2 Eval D0721-A.M.100.E-C.41 R:0.05574 P:0.03704 F:0.04451
41 ROUGE-2 Eval D0721-A.M.100.E-E.41 R:0.05246 P:0.03486 F:0.04189
41 ROUGE-2 Eval D0721-A.M.100.E-G.41 R:0.05145 P:0.03486 F:0.04156
41 ROUGE-2 Eval D0721-B.M.100.E-B.41 R:0.02961 P:0.02679 F:0.02813
41 ROUGE-2 Eval D0721-B.M.100.E-C.41 R:0.03537 P:0.03274 F:0.03400
41 ROUGE-2 Eval D0721-B.M.100.E-E.41 R:0.01987 P:0.01786 F:0.01881
41 ROUGE-2 Eval D0721-B.M.100.E-G.41 R:0.02280 P:0.02083 F:0.02177
41 ROUGE-2 Eval D0721-C.M.100.E-B.41 R:0.03642 P:0.02981 F:0.03279
41 ROUGE-2 Eval D0721-C.M.100.E-C.41 R:0.04000 P:0.03252 F:0.03587
41 ROUGE-2 Eval D0721-C.M.100.E-E.41 R:0.02694 P:0.02168 F:0.02403
41 ROUGE-2 Eval D0721-C.M.100.E-G.41 R:0.02632 P:0.02168 F:0.02378
41 ROUGE-2 Eval D0726-A.M.100.F-A.41 R:0.05369 P:0.03486 F:0.04227
41 ROUGE-2 Eval D0726-A.M.100.F-E.41 R:0.05724 P:0.03704 F:0.04498
41 ROUGE-2 Eval D0726-A.M.100.F-F.41 R:0.06376 P:0.04139 F:0.05020
41 ROUGE-2 Eval D0726-A.M.100.F-G.41 R:0.03691 P:0.02397 F:0.02906
41 ROUGE-2 Eval D0726-B.M.100.F-A.41 R:0.06931 P:0.05645 F:0.06222
41 ROUGE-2 Eval D0726-B.M.100.F-E.41 R:0.04362 P:0.03495 F:0.03881
41 ROUGE-2 Eval D0726-B.M.100.F-F.41 R:0.06376 P:0.05108 F:0.05672
41 ROUGE-2 Eval D0726-B.M.100.F-G.41 R:0.06312 P:0.05108 F:0.05647
41 ROUGE-2 Eval D0726-C.M.100.F-A.41 R:0.04714 P:0.03333 F:0.03905
41 ROUGE-2 Eval D0726-C.M.100.F-E.41 R:0.02721 P:0.01905 F:0.02241
41 ROUGE-2 Eval D0726-C.M.100.F-F.41 R:0.04110 P:0.02857 F:0.03371
41 ROUGE-2 Eval D0726-C.M.100.F-G.41 R:0.04636 P:0.03333 F:0.03878
41 ROUGE-2 Eval D0727-A.M.100.G-A.41 R:0.15436 P:0.10575 F:0.12551
41 ROUGE-2 Eval D0727-A.M.100.G-F.41 R:0.15282 P:0.10575 F:0.12500
41 ROUGE-2 Eval D0727-A.M.100.G-G.41 R:0.10561 P:0.07356 F:0.08672
41 ROUGE-2 Eval D0727-A.M.100.G-H.41 R:0.16611 P:0.11494 F:0.13587
41 ROUGE-2 Eval D0727-B.M.100.G-A.41 R:0.02431 P:0.02991 F:0.02682
41 ROUGE-2 Eval D0727-B.M.100.G-F.41 R:0.03279 P:0.04274 F:0.03711
41 ROUGE-2 Eval D0727-B.M.100.G-G.41 R:0.03147 P:0.03846 F:0.03462
41 ROUGE-2 Eval D0727-B.M.100.G-H.41 R:0.01389 P:0.01709 F:0.01532
41 ROUGE-2 Eval D0727-C.M.100.G-A.41 R:0.05592 P:0.03829 F:0.04546
41 ROUGE-2 Eval D0727-C.M.100.G-F.41 R:0.08844 P:0.05856 F:0.07046
41 ROUGE-2 Eval D0727-C.M.100.G-G.41 R:0.06000 P:0.04054 F:0.04839
41 ROUGE-2 Eval D0727-C.M.100.G-H.41 R:0.06826 P:0.04505 F:0.05428
41 ROUGE-2 Eval D0736-A.M.100.H-G.41 R:0.04348 P:0.03604 F:0.03941
41 ROUGE-2 Eval D0736-A.M.100.H-H.41 R:0.02583 P:0.02102 F:0.02318
41 ROUGE-2 Eval D0736-A.M.100.H-I.41 R:0.05036 P:0.04204 F:0.04583
41 ROUGE-2 Eval D0736-A.M.100.H-J.41 R:0.03960 P:0.03604 F:0.03774
41 ROUGE-2 Eval D0736-B.M.100.H-G.41 R:0.02317 P:0.01439 F:0.01775
41 ROUGE-2 Eval D0736-B.M.100.H-H.41 R:0.03766 P:0.02158 F:0.02744
41 ROUGE-2 Eval D0736-B.M.100.H-I.41 R:0.03390 P:0.01918 F:0.02450
41 ROUGE-2 Eval D0736-B.M.100.H-J.41 R:0.03534 P:0.02398 F:0.02857
41 ROUGE-2 Eval D0736-C.M.100.H-G.41 R:0.05983 P:0.03382 F:0.04321
41 ROUGE-2 Eval D0736-C.M.100.H-H.41 R:0.07065 P:0.03140 F:0.04348
41 ROUGE-2 Eval D0736-C.M.100.H-I.41 R:0.00543 P:0.00242 F:0.00335
41 ROUGE-2 Eval D0736-C.M.100.H-J.41 R:0.05344 P:0.03382 F:0.04142
41 ROUGE-2 Eval D0740-A.M.100.I-D.41 R:0.09667 P:0.06808 F:0.07989
41 ROUGE-2 Eval D0740-A.M.100.I-H.41 R:0.08251 P:0.05869 F:0.06859
41 ROUGE-2 Eval D0740-A.M.100.I-I.41 R:0.12787 P:0.09155 F:0.10670
41 ROUGE-2 Eval D0740-A.M.100.I-J.41 R:0.08795 P:0.06338 F:0.07367
41 ROUGE-2 Eval D0740-B.M.100.I-D.41 R:0.01967 P:0.01274 F:0.01546
41 ROUGE-2 Eval D0740-B.M.100.I-H.41 R:0.01338 P:0.00849 F:0.01039
41 ROUGE-2 Eval D0740-B.M.100.I-I.41 R:0.01656 P:0.01062 F:0.01294
41 ROUGE-2 Eval D0740-B.M.100.I-J.41 R:0.01961 P:0.01274 F:0.01545
41 ROUGE-2 Eval D0740-C.M.100.I-D.41 R:0.11935 P:0.08747 F:0.10095
41 ROUGE-2 Eval D0740-C.M.100.I-H.41 R:0.07792 P:0.05674 F:0.06566
41 ROUGE-2 Eval D0740-C.M.100.I-I.41 R:0.10000 P:0.07329 F:0.08459
41 ROUGE-2 Eval D0740-C.M.100.I-J.41 R:0.09003 P:0.06619 F:0.07629
41 ROUGE-2 Eval D0743-A.M.100.J-B.41 R:0.02885 P:0.02055 F:0.02400
41 ROUGE-2 Eval D0743-A.M.100.J-H.41 R:0.01558 P:0.01142 F:0.01318
41 ROUGE-2 Eval D0743-A.M.100.J-I.41 R:0.02839 P:0.02055 F:0.02384
41 ROUGE-2 Eval D0743-A.M.100.J-J.41 R:0.02174 P:0.01598 F:0.01842
41 ROUGE-2 Eval D0743-B.M.100.J-B.41 R:0.01618 P:0.01029 F:0.01258
41 ROUGE-2 Eval D0743-B.M.100.J-H.41 R:0.01274 P:0.00823 F:0.01000
41 ROUGE-2 Eval D0743-B.M.100.J-I.41 R:0.01917 P:0.01235 F:0.01502
41 ROUGE-2 Eval D0743-B.M.100.J-J.41 R:0.01887 P:0.01235 F:0.01493
41 ROUGE-2 Eval D0743-C.M.100.J-B.41 R:0.08333 P:0.06235 F:0.07133
41 ROUGE-2 Eval D0743-C.M.100.J-H.41 R:0.07074 P:0.05276 F:0.06044
41 ROUGE-2 Eval D0743-C.M.100.J-I.41 R:0.08710 P:0.06475 F:0.07428
41 ROUGE-2 Eval D0743-C.M.100.J-J.41 R:0.05714 P:0.04317 F:0.04918
---------------------------------------------
41 ROUGE-3 Average_R: 0.02470 (95%-conf.int. 0.01972 - 0.03023)
41 ROUGE-3 Average_P: 0.01800 (95%-conf.int. 0.01449 - 0.02193)
41 ROUGE-3 Average_F: 0.02070 (95%-conf.int. 0.01656 - 0.02525)
.............................................
41 ROUGE-3 Eval D0703-A.M.100.A-A.41 R:0.02414 P:0.02846 F:0.02612
41 ROUGE-3 Eval D0703-A.M.100.A-C.41 R:0.00342 P:0.00407 F:0.00372
41 ROUGE-3 Eval D0703-A.M.100.A-D.41 R:0.02456 P:0.02846 F:0.02637
41 ROUGE-3 Eval D0703-A.M.100.A-J.41 R:0.02083 P:0.02439 F:0.02247
41 ROUGE-3 Eval D0703-B.M.100.A-A.41 R:0.01667 P:0.01344 F:0.01488
41 ROUGE-3 Eval D0703-B.M.100.A-C.41 R:0.01712 P:0.01344 F:0.01506
41 ROUGE-3 Eval D0703-B.M.100.A-D.41 R:0.01712 P:0.01344 F:0.01506
41 ROUGE-3 Eval D0703-B.M.100.A-J.41 R:0.01017 P:0.00806 F:0.00899
41 ROUGE-3 Eval D0703-C.M.100.A-A.41 R:0.01701 P:0.01773 F:0.01736
41 ROUGE-3 Eval D0703-C.M.100.A-C.41 R:0.01987 P:0.02128 F:0.02055
41 ROUGE-3 Eval D0703-C.M.100.A-D.41 R:0.02027 P:0.02128 F:0.02076
41 ROUGE-3 Eval D0703-C.M.100.A-J.41 R:0.02365 P:0.02482 F:0.02422
41 ROUGE-3 Eval D0706-A.M.100.B-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-A.M.100.B-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-A.M.100.B-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-A.M.100.B-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-B.M.100.B-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-B.M.100.B-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-B.M.100.B-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-B.M.100.B-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0706-C.M.100.B-B.41 R:0.06579 P:0.04566 F:0.05391
41 ROUGE-3 Eval D0706-C.M.100.B-D.41 R:0.06579 P:0.04566 F:0.05391
41 ROUGE-3 Eval D0706-C.M.100.B-E.41 R:0.02941 P:0.02055 F:0.02419
41 ROUGE-3 Eval D0706-C.M.100.B-I.41 R:0.06515 P:0.04566 F:0.05369
41 ROUGE-3 Eval D0711-A.M.100.C-A.41 R:0.06376 P:0.04429 F:0.05227
41 ROUGE-3 Eval D0711-A.M.100.C-B.41 R:0.05782 P:0.03963 F:0.04703
41 ROUGE-3 Eval D0711-A.M.100.C-C.41 R:0.04082 P:0.02797 F:0.03319
41 ROUGE-3 Eval D0711-A.M.100.C-F.41 R:0.04054 P:0.02797 F:0.03310
41 ROUGE-3 Eval D0711-B.M.100.C-A.41 R:0.00694 P:0.00450 F:0.00546
41 ROUGE-3 Eval D0711-B.M.100.C-B.41 R:0.02098 P:0.01351 F:0.01644
41 ROUGE-3 Eval D0711-B.M.100.C-C.41 R:0.02397 P:0.01577 F:0.01902
41 ROUGE-3 Eval D0711-B.M.100.C-F.41 R:0.02076 P:0.01351 F:0.01637
41 ROUGE-3 Eval D0711-C.M.100.C-A.41 R:0.00337 P:0.00249 F:0.00286
41 ROUGE-3 Eval D0711-C.M.100.C-B.41 R:0.00348 P:0.00249 F:0.00290
41 ROUGE-3 Eval D0711-C.M.100.C-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0711-C.M.100.C-F.41 R:0.00345 P:0.00249 F:0.00289
41 ROUGE-3 Eval D0716-A.M.100.D-C.41 R:0.11371 P:0.08153 F:0.09497
41 ROUGE-3 Eval D0716-A.M.100.D-D.41 R:0.12585 P:0.08873 F:0.10408
41 ROUGE-3 Eval D0716-A.M.100.D-E.41 R:0.12881 P:0.09113 F:0.10674
41 ROUGE-3 Eval D0716-A.M.100.D-F.41 R:0.12795 P:0.09113 F:0.10645
41 ROUGE-3 Eval D0716-B.M.100.D-C.41 R:0.01342 P:0.01050 F:0.01178
41 ROUGE-3 Eval D0716-B.M.100.D-D.41 R:0.01370 P:0.01050 F:0.01189
41 ROUGE-3 Eval D0716-B.M.100.D-E.41 R:0.02373 P:0.01837 F:0.02071
41 ROUGE-3 Eval D0716-B.M.100.D-F.41 R:0.02041 P:0.01575 F:0.01778
41 ROUGE-3 Eval D0716-C.M.100.D-C.41 R:0.04983 P:0.03704 F:0.04249
41 ROUGE-3 Eval D0716-C.M.100.D-D.41 R:0.05802 P:0.04198 F:0.04871
41 ROUGE-3 Eval D0716-C.M.100.D-E.41 R:0.04040 P:0.02963 F:0.03419
41 ROUGE-3 Eval D0716-C.M.100.D-F.41 R:0.04422 P:0.03210 F:0.03720
41 ROUGE-3 Eval D0721-A.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-A.M.100.E-C.41 R:0.00662 P:0.00439 F:0.00528
41 ROUGE-3 Eval D0721-A.M.100.E-E.41 R:0.00662 P:0.00439 F:0.00528
41 ROUGE-3 Eval D0721-A.M.100.E-G.41 R:0.00649 P:0.00439 F:0.00524
41 ROUGE-3 Eval D0721-B.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-B.M.100.E-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-B.M.100.E-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-B.M.100.E-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-C.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-C.M.100.E-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-C.M.100.E-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0721-C.M.100.E-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0726-A.M.100.F-A.41 R:0.01695 P:0.01096 F:0.01331
41 ROUGE-3 Eval D0726-A.M.100.F-E.41 R:0.02041 P:0.01316 F:0.01600
41 ROUGE-3 Eval D0726-A.M.100.F-F.41 R:0.02034 P:0.01316 F:0.01598
41 ROUGE-3 Eval D0726-A.M.100.F-G.41 R:0.00339 P:0.00219 F:0.00266
41 ROUGE-3 Eval D0726-B.M.100.F-A.41 R:0.03333 P:0.02710 F:0.02989
41 ROUGE-3 Eval D0726-B.M.100.F-E.41 R:0.01356 P:0.01084 F:0.01205
41 ROUGE-3 Eval D0726-B.M.100.F-F.41 R:0.02712 P:0.02168 F:0.02410
41 ROUGE-3 Eval D0726-B.M.100.F-G.41 R:0.02685 P:0.02168 F:0.02399
41 ROUGE-3 Eval D0726-C.M.100.F-A.41 R:0.02041 P:0.01439 F:0.01688
41 ROUGE-3 Eval D0726-C.M.100.F-E.41 R:0.00344 P:0.00240 F:0.00283
41 ROUGE-3 Eval D0726-C.M.100.F-F.41 R:0.01730 P:0.01199 F:0.01416
41 ROUGE-3 Eval D0726-C.M.100.F-G.41 R:0.02007 P:0.01439 F:0.01676
41 ROUGE-3 Eval D0727-A.M.100.G-A.41 R:0.08814 P:0.06019 F:0.07153
41 ROUGE-3 Eval D0727-A.M.100.G-F.41 R:0.09396 P:0.06481 F:0.07671
41 ROUGE-3 Eval D0727-A.M.100.G-G.41 R:0.05000 P:0.03472 F:0.04098
41 ROUGE-3 Eval D0727-A.M.100.G-H.41 R:0.10067 P:0.06944 F:0.08219
41 ROUGE-3 Eval D0727-B.M.100.G-A.41 R:0.00351 P:0.00433 F:0.00388
41 ROUGE-3 Eval D0727-B.M.100.G-F.41 R:0.00662 P:0.00866 F:0.00750
41 ROUGE-3 Eval D0727-B.M.100.G-G.41 R:0.00707 P:0.00866 F:0.00778
41 ROUGE-3 Eval D0727-B.M.100.G-H.41 R:0.00351 P:0.00433 F:0.00388
41 ROUGE-3 Eval D0727-C.M.100.G-A.41 R:0.03322 P:0.02268 F:0.02696
41 ROUGE-3 Eval D0727-C.M.100.G-F.41 R:0.04467 P:0.02948 F:0.03552
41 ROUGE-3 Eval D0727-C.M.100.G-G.41 R:0.02020 P:0.01361 F:0.01626
41 ROUGE-3 Eval D0727-C.M.100.G-H.41 R:0.03448 P:0.02268 F:0.02736
41 ROUGE-3 Eval D0736-A.M.100.H-G.41 R:0.01099 P:0.00909 F:0.00995
41 ROUGE-3 Eval D0736-A.M.100.H-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0736-A.M.100.H-I.41 R:0.01091 P:0.00909 F:0.00992
41 ROUGE-3 Eval D0736-A.M.100.H-J.41 R:0.01000 P:0.00909 F:0.00952
41 ROUGE-3 Eval D0736-B.M.100.H-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0736-B.M.100.H-H.41 R:0.01271 P:0.00725 F:0.00923
41 ROUGE-3 Eval D0736-B.M.100.H-I.41 R:0.01288 P:0.00725 F:0.00928
41 ROUGE-3 Eval D0736-B.M.100.H-J.41 R:0.01071 P:0.00725 F:0.00865
41 ROUGE-3 Eval D0736-C.M.100.H-G.41 R:0.04329 P:0.02433 F:0.03115
41 ROUGE-3 Eval D0736-C.M.100.H-H.41 R:0.05525 P:0.02433 F:0.03378
41 ROUGE-3 Eval D0736-C.M.100.H-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0736-C.M.100.H-J.41 R:0.03861 P:0.02433 F:0.02985
41 ROUGE-3 Eval D0740-A.M.100.I-D.41 R:0.04377 P:0.03073 F:0.03611
41 ROUGE-3 Eval D0740-A.M.100.I-H.41 R:0.04667 P:0.03310 F:0.03873
41 ROUGE-3 Eval D0740-A.M.100.I-I.41 R:0.06623 P:0.04728 F:0.05517
41 ROUGE-3 Eval D0740-A.M.100.I-J.41 R:0.04276 P:0.03073 F:0.03576
41 ROUGE-3 Eval D0740-B.M.100.I-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0740-B.M.100.I-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0740-B.M.100.I-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0740-B.M.100.I-J.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0740-C.M.100.I-D.41 R:0.07818 P:0.05714 F:0.06602
41 ROUGE-3 Eval D0740-C.M.100.I-H.41 R:0.03934 P:0.02857 F:0.03310
41 ROUGE-3 Eval D0740-C.M.100.I-I.41 R:0.05863 P:0.04286 F:0.04952
41 ROUGE-3 Eval D0740-C.M.100.I-J.41 R:0.05844 P:0.04286 F:0.04945
41 ROUGE-3 Eval D0743-A.M.100.J-B.41 R:0.00324 P:0.00230 F:0.00269
41 ROUGE-3 Eval D0743-A.M.100.J-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-3 Eval D0743-A.M.100.J-I.41 R:0.00318 P:0.00230 F:0.00267
41 ROUGE-3 Eval D0743-A.M.100.J-J.41 R:0.00313 P:0.00230 F:0.00265
41 ROUGE-3 Eval D0743-B.M.100.J-B.41 R:0.00327 P:0.00207 F:0.00254
41 ROUGE-3 Eval D0743-B.M.100.J-H.41 R:0.00322 P:0.00207 F:0.00252
41 ROUGE-3 Eval D0743-B.M.100.J-I.41 R:0.00645 P:0.00414 F:0.00504
41 ROUGE-3 Eval D0743-B.M.100.J-J.41 R:0.00635 P:0.00414 F:0.00501
41 ROUGE-3 Eval D0743-C.M.100.J-B.41 R:0.02913 P:0.02174 F:0.02490
41 ROUGE-3 Eval D0743-C.M.100.J-H.41 R:0.01948 P:0.01449 F:0.01662
41 ROUGE-3 Eval D0743-C.M.100.J-I.41 R:0.02932 P:0.02174 F:0.02497
41 ROUGE-3 Eval D0743-C.M.100.J-J.41 R:0.00962 P:0.00725 F:0.00827
---------------------------------------------
41 ROUGE-4 Average_R: 0.01424 (95%-conf.int. 0.01069 - 0.01813)
41 ROUGE-4 Average_P: 0.01010 (95%-conf.int. 0.00768 - 0.01281)
41 ROUGE-4 Average_F: 0.01177 (95%-conf.int. 0.00890 - 0.01495)
.............................................
41 ROUGE-4 Eval D0703-A.M.100.A-A.41 R:0.00697 P:0.00823 F:0.00755
41 ROUGE-4 Eval D0703-A.M.100.A-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0703-A.M.100.A-D.41 R:0.00709 P:0.00823 F:0.00762
41 ROUGE-4 Eval D0703-A.M.100.A-J.41 R:0.00702 P:0.00823 F:0.00758
41 ROUGE-4 Eval D0703-B.M.100.A-A.41 R:0.00673 P:0.00542 F:0.00600
41 ROUGE-4 Eval D0703-B.M.100.A-C.41 R:0.00692 P:0.00542 F:0.00608
41 ROUGE-4 Eval D0703-B.M.100.A-D.41 R:0.00692 P:0.00542 F:0.00608
41 ROUGE-4 Eval D0703-B.M.100.A-J.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0703-C.M.100.A-A.41 R:0.00687 P:0.00717 F:0.00702
41 ROUGE-4 Eval D0703-C.M.100.A-C.41 R:0.00669 P:0.00717 F:0.00692
41 ROUGE-4 Eval D0703-C.M.100.A-D.41 R:0.00683 P:0.00717 F:0.00700
41 ROUGE-4 Eval D0703-C.M.100.A-J.41 R:0.01024 P:0.01075 F:0.01049
41 ROUGE-4 Eval D0706-A.M.100.B-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-A.M.100.B-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-A.M.100.B-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-A.M.100.B-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-B.M.100.B-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-B.M.100.B-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-B.M.100.B-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-B.M.100.B-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0706-C.M.100.B-B.41 R:0.05316 P:0.03678 F:0.04348
41 ROUGE-4 Eval D0706-C.M.100.B-D.41 R:0.05316 P:0.03678 F:0.04348
41 ROUGE-4 Eval D0706-C.M.100.B-E.41 R:0.01980 P:0.01379 F:0.01626
41 ROUGE-4 Eval D0706-C.M.100.B-I.41 R:0.05263 P:0.03678 F:0.04330
41 ROUGE-4 Eval D0711-A.M.100.C-A.41 R:0.03390 P:0.02347 F:0.02774
41 ROUGE-4 Eval D0711-A.M.100.C-B.41 R:0.02749 P:0.01878 F:0.02232
41 ROUGE-4 Eval D0711-A.M.100.C-C.41 R:0.01718 P:0.01174 F:0.01395
41 ROUGE-4 Eval D0711-A.M.100.C-F.41 R:0.02389 P:0.01643 F:0.01947
41 ROUGE-4 Eval D0711-B.M.100.C-A.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0711-B.M.100.C-B.41 R:0.00707 P:0.00454 F:0.00553
41 ROUGE-4 Eval D0711-B.M.100.C-C.41 R:0.00692 P:0.00454 F:0.00548
41 ROUGE-4 Eval D0711-B.M.100.C-F.41 R:0.00699 P:0.00454 F:0.00550
41 ROUGE-4 Eval D0711-C.M.100.C-A.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0711-C.M.100.C-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0711-C.M.100.C-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0711-C.M.100.C-F.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0716-A.M.100.D-C.41 R:0.06757 P:0.04831 F:0.05634
41 ROUGE-4 Eval D0716-A.M.100.D-D.41 R:0.08935 P:0.06280 F:0.07376
41 ROUGE-4 Eval D0716-A.M.100.D-E.41 R:0.08219 P:0.05797 F:0.06799
41 ROUGE-4 Eval D0716-A.M.100.D-F.41 R:0.07823 P:0.05556 F:0.06497
41 ROUGE-4 Eval D0716-B.M.100.D-C.41 R:0.00678 P:0.00529 F:0.00594
41 ROUGE-4 Eval D0716-B.M.100.D-D.41 R:0.00692 P:0.00529 F:0.00600
41 ROUGE-4 Eval D0716-B.M.100.D-E.41 R:0.01370 P:0.01058 F:0.01194
41 ROUGE-4 Eval D0716-B.M.100.D-F.41 R:0.01375 P:0.01058 F:0.01196
41 ROUGE-4 Eval D0716-C.M.100.D-C.41 R:0.02013 P:0.01493 F:0.01714
41 ROUGE-4 Eval D0716-C.M.100.D-D.41 R:0.02759 P:0.01990 F:0.02312
41 ROUGE-4 Eval D0716-C.M.100.D-E.41 R:0.01361 P:0.00995 F:0.01150
41 ROUGE-4 Eval D0716-C.M.100.D-F.41 R:0.02062 P:0.01493 F:0.01732
41 ROUGE-4 Eval D0721-A.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-A.M.100.E-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-A.M.100.E-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-A.M.100.E-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-B.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-B.M.100.E-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-B.M.100.E-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-B.M.100.E-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-C.M.100.E-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-C.M.100.E-C.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-C.M.100.E-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0721-C.M.100.E-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0726-A.M.100.F-A.41 R:0.01027 P:0.00662 F:0.00805
41 ROUGE-4 Eval D0726-A.M.100.F-E.41 R:0.01031 P:0.00662 F:0.00806
41 ROUGE-4 Eval D0726-A.M.100.F-F.41 R:0.01027 P:0.00662 F:0.00805
41 ROUGE-4 Eval D0726-A.M.100.F-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0726-B.M.100.F-A.41 R:0.02020 P:0.01639 F:0.01810
41 ROUGE-4 Eval D0726-B.M.100.F-E.41 R:0.00685 P:0.00546 F:0.00608
41 ROUGE-4 Eval D0726-B.M.100.F-F.41 R:0.01712 P:0.01366 F:0.01520
41 ROUGE-4 Eval D0726-B.M.100.F-G.41 R:0.01695 P:0.01366 F:0.01513
41 ROUGE-4 Eval D0726-C.M.100.F-A.41 R:0.01031 P:0.00725 F:0.00851
41 ROUGE-4 Eval D0726-C.M.100.F-E.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0726-C.M.100.F-F.41 R:0.01049 P:0.00725 F:0.00857
41 ROUGE-4 Eval D0726-C.M.100.F-G.41 R:0.01014 P:0.00725 F:0.00845
41 ROUGE-4 Eval D0727-A.M.100.G-A.41 R:0.05822 P:0.03963 F:0.04716
41 ROUGE-4 Eval D0727-A.M.100.G-F.41 R:0.06780 P:0.04662 F:0.05525
41 ROUGE-4 Eval D0727-A.M.100.G-G.41 R:0.02357 P:0.01632 F:0.01929
41 ROUGE-4 Eval D0727-A.M.100.G-H.41 R:0.07458 P:0.05128 F:0.06077
41 ROUGE-4 Eval D0727-B.M.100.G-A.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0727-B.M.100.G-F.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0727-B.M.100.G-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0727-B.M.100.G-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0727-C.M.100.G-A.41 R:0.02349 P:0.01598 F:0.01902
41 ROUGE-4 Eval D0727-C.M.100.G-F.41 R:0.02778 P:0.01826 F:0.02204
41 ROUGE-4 Eval D0727-C.M.100.G-G.41 R:0.01020 P:0.00685 F:0.00820
41 ROUGE-4 Eval D0727-C.M.100.G-H.41 R:0.02091 P:0.01370 F:0.01655
41 ROUGE-4 Eval D0736-A.M.100.H-G.41 R:0.00370 P:0.00306 F:0.00335
41 ROUGE-4 Eval D0736-A.M.100.H-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0736-A.M.100.H-I.41 R:0.00368 P:0.00306 F:0.00334
41 ROUGE-4 Eval D0736-A.M.100.H-J.41 R:0.00337 P:0.00306 F:0.00321
41 ROUGE-4 Eval D0736-B.M.100.H-G.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0736-B.M.100.H-H.41 R:0.00858 P:0.00487 F:0.00621
41 ROUGE-4 Eval D0736-B.M.100.H-I.41 R:0.00870 P:0.00487 F:0.00624
41 ROUGE-4 Eval D0736-B.M.100.H-J.41 R:0.00722 P:0.00487 F:0.00582
41 ROUGE-4 Eval D0736-C.M.100.H-G.41 R:0.03509 P:0.01961 F:0.02516
41 ROUGE-4 Eval D0736-C.M.100.H-H.41 R:0.04494 P:0.01961 F:0.02731
41 ROUGE-4 Eval D0736-C.M.100.H-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0736-C.M.100.H-J.41 R:0.03125 P:0.01961 F:0.02410
41 ROUGE-4 Eval D0740-A.M.100.I-D.41 R:0.02041 P:0.01429 F:0.01681
41 ROUGE-4 Eval D0740-A.M.100.I-H.41 R:0.03030 P:0.02143 F:0.02510
41 ROUGE-4 Eval D0740-A.M.100.I-I.41 R:0.03679 P:0.02619 F:0.03060
41 ROUGE-4 Eval D0740-A.M.100.I-J.41 R:0.02326 P:0.01667 F:0.01942
41 ROUGE-4 Eval D0740-B.M.100.I-D.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0740-B.M.100.I-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0740-B.M.100.I-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0740-B.M.100.I-J.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0740-C.M.100.I-D.41 R:0.06250 P:0.04556 F:0.05270
41 ROUGE-4 Eval D0740-C.M.100.I-H.41 R:0.02980 P:0.02158 F:0.02503
41 ROUGE-4 Eval D0740-C.M.100.I-I.41 R:0.04605 P:0.03357 F:0.03883
41 ROUGE-4 Eval D0740-C.M.100.I-J.41 R:0.04918 P:0.03597 F:0.04155
41 ROUGE-4 Eval D0743-A.M.100.J-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-A.M.100.J-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-A.M.100.J-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-A.M.100.J-J.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-B.M.100.J-B.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-B.M.100.J-H.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-B.M.100.J-I.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-B.M.100.J-J.41 R:0.00000 P:0.00000 F:0.00000
41 ROUGE-4 Eval D0743-C.M.100.J-B.41 R:0.00980 P:0.00730 F:0.00837
41 ROUGE-4 Eval D0743-C.M.100.J-H.41 R:0.00328 P:0.00243 F:0.00279
41 ROUGE-4 Eval D0743-C.M.100.J-I.41 R:0.00987 P:0.00730 F:0.00839
41 ROUGE-4 Eval D0743-C.M.100.J-J.41 R:0.00647 P:0.00487 F:0.00556
---------------------------------------------
41 ROUGE-L Average_R: 0.26296 (95%-conf.int. 0.25117 - 0.27574)
41 ROUGE-L Average_P: 0.19677 (95%-conf.int. 0.18841 - 0.20518)
41 ROUGE-L Average_F: 0.22349 (95%-conf.int. 0.21405 - 0.23343)
.............................................
41 ROUGE-L Eval D0703-A.M.100.A-A.41 R:0.22635 P:0.26587 F:0.24452
41 ROUGE-L Eval D0703-A.M.100.A-C.41 R:0.18456 P:0.21825 F:0.20000
41 ROUGE-L Eval D0703-A.M.100.A-D.41 R:0.21649 P:0.25000 F:0.23204
41 ROUGE-L Eval D0703-A.M.100.A-J.41 R:0.22789 P:0.26587 F:0.24542
41 ROUGE-L Eval D0703-B.M.100.A-A.41 R:0.22549 P:0.18254 F:0.20175
41 ROUGE-L Eval D0703-B.M.100.A-C.41 R:0.25168 P:0.19841 F:0.22189
41 ROUGE-L Eval D0703-B.M.100.A-D.41 R:0.23154 P:0.18254 F:0.20414
41 ROUGE-L Eval D0703-B.M.100.A-J.41 R:0.22924 P:0.18254 F:0.20324
41 ROUGE-L Eval D0703-C.M.100.A-A.41 R:0.19667 P:0.20486 F:0.20068
41 ROUGE-L Eval D0703-C.M.100.A-C.41 R:0.20455 P:0.21875 F:0.21141
41 ROUGE-L Eval D0703-C.M.100.A-D.41 R:0.20530 P:0.21528 F:0.21017
41 ROUGE-L Eval D0703-C.M.100.A-J.41 R:0.21523 P:0.22569 F:0.22034
41 ROUGE-L Eval D0706-A.M.100.B-B.41 R:0.27922 P:0.17805 F:0.21744
41 ROUGE-L Eval D0706-A.M.100.B-D.41 R:0.24183 P:0.15321 F:0.18758
41 ROUGE-L Eval D0706-A.M.100.B-E.41 R:0.25000 P:0.15942 F:0.19469
41 ROUGE-L Eval D0706-A.M.100.B-I.41 R:0.27273 P:0.17391 F:0.21239
41 ROUGE-L Eval D0706-B.M.100.B-B.41 R:0.18301 P:0.13429 F:0.15491
41 ROUGE-L Eval D0706-B.M.100.B-D.41 R:0.17264 P:0.12710 F:0.14641
41 ROUGE-L Eval D0706-B.M.100.B-E.41 R:0.18182 P:0.13429 F:0.15448
41 ROUGE-L Eval D0706-B.M.100.B-I.41 R:0.17476 P:0.12950 F:0.14876
41 ROUGE-L Eval D0706-C.M.100.B-B.41 R:0.34194 P:0.23874 F:0.28117
41 ROUGE-L Eval D0706-C.M.100.B-D.41 R:0.35161 P:0.24550 F:0.28913
41 ROUGE-L Eval D0706-C.M.100.B-E.41 R:0.32692 P:0.22973 F:0.26984
41 ROUGE-L Eval D0706-C.M.100.B-I.41 R:0.33866 P:0.23874 F:0.28005
41 ROUGE-L Eval D0711-A.M.100.C-A.41 R:0.36184 P:0.25287 F:0.29770
41 ROUGE-L Eval D0711-A.M.100.C-B.41 R:0.36667 P:0.25287 F:0.29932
41 ROUGE-L Eval D0711-A.M.100.C-C.41 R:0.33000 P:0.22759 F:0.26939
41 ROUGE-L Eval D0711-A.M.100.C-F.41 R:0.34437 P:0.23908 F:0.28222
41 ROUGE-L Eval D0711-B.M.100.C-A.41 R:0.25170 P:0.16444 F:0.19892
41 ROUGE-L Eval D0711-B.M.100.C-B.41 R:0.29110 P:0.18889 F:0.22911
41 ROUGE-L Eval D0711-B.M.100.C-C.41 R:0.27852 P:0.18444 F:0.22192
41 ROUGE-L Eval D0711-B.M.100.C-F.41 R:0.29831 P:0.19556 F:0.23625
41 ROUGE-L Eval D0711-C.M.100.C-A.41 R:0.23762 P:0.17647 F:0.20253
41 ROUGE-L Eval D0711-C.M.100.C-B.41 R:0.26280 P:0.18873 F:0.21969
41 ROUGE-L Eval D0711-C.M.100.C-C.41 R:0.22973 P:0.16667 F:0.19318
41 ROUGE-L Eval D0711-C.M.100.C-F.41 R:0.22973 P:0.16667 F:0.19318
41 ROUGE-L Eval D0716-A.M.100.D-C.41 R:0.42295 P:0.30496 F:0.35439
41 ROUGE-L Eval D0716-A.M.100.D-D.41 R:0.43000 P:0.30496 F:0.35684
41 ROUGE-L Eval D0716-A.M.100.D-E.41 R:0.44518 P:0.31678 F:0.37016
41 ROUGE-L Eval D0716-A.M.100.D-F.41 R:0.45875 P:0.32861 F:0.38292
41 ROUGE-L Eval D0716-B.M.100.D-C.41 R:0.29934 P:0.23514 F:0.26338
41 ROUGE-L Eval D0716-B.M.100.D-D.41 R:0.32886 P:0.25323 F:0.28613
41 ROUGE-L Eval D0716-B.M.100.D-E.41 R:0.32558 P:0.25323 F:0.28488
41 ROUGE-L Eval D0716-B.M.100.D-F.41 R:0.31333 P:0.24289 F:0.27365
41 ROUGE-L Eval D0716-C.M.100.D-C.41 R:0.35831 P:0.26764 F:0.30641
41 ROUGE-L Eval D0716-C.M.100.D-D.41 R:0.36789 P:0.26764 F:0.30986
41 ROUGE-L Eval D0716-C.M.100.D-E.41 R:0.34983 P:0.25791 F:0.29692
41 ROUGE-L Eval D0716-C.M.100.D-F.41 R:0.34333 P:0.25061 F:0.28973
41 ROUGE-L Eval D0721-A.M.100.E-B.41 R:0.30333 P:0.19697 F:0.23884
41 ROUGE-L Eval D0721-A.M.100.E-C.41 R:0.31818 P:0.21212 F:0.25454
41 ROUGE-L Eval D0721-A.M.100.E-E.41 R:0.28896 P:0.19264 F:0.23117
41 ROUGE-L Eval D0721-A.M.100.E-G.41 R:0.28981 P:0.19697 F:0.23454
41 ROUGE-L Eval D0721-B.M.100.E-B.41 R:0.21173 P:0.19174 F:0.20124
41 ROUGE-L Eval D0721-B.M.100.E-C.41 R:0.22293 P:0.20649 F:0.21440
41 ROUGE-L Eval D0721-B.M.100.E-E.41 R:0.20984 P:0.18879 F:0.19876
41 ROUGE-L Eval D0721-B.M.100.E-G.41 R:0.20968 P:0.19174 F:0.20031
41 ROUGE-L Eval D0721-C.M.100.E-B.41 R:0.28852 P:0.23656 F:0.25997
41 ROUGE-L Eval D0721-C.M.100.E-C.41 R:0.24422 P:0.19892 F:0.21925
41 ROUGE-L Eval D0721-C.M.100.E-E.41 R:0.24333 P:0.19624 F:0.21726
41 ROUGE-L Eval D0721-C.M.100.E-G.41 R:0.24104 P:0.19892 F:0.21796
41 ROUGE-L Eval D0726-A.M.100.F-A.41 R:0.27243 P:0.17749 F:0.21494
41 ROUGE-L Eval D0726-A.M.100.F-E.41 R:0.26333 P:0.17100 F:0.20735
41 ROUGE-L Eval D0726-A.M.100.F-F.41 R:0.28571 P:0.18615 F:0.22543
41 ROUGE-L Eval D0726-A.M.100.F-G.41 R:0.25581 P:0.16667 F:0.20184
41 ROUGE-L Eval D0726-B.M.100.F-A.41 R:0.22549 P:0.18400 F:0.20264
41 ROUGE-L Eval D0726-B.M.100.F-E.41 R:0.20930 P:0.16800 F:0.18639
41 ROUGE-L Eval D0726-B.M.100.F-F.41 R:0.23920 P:0.19200 F:0.21302
41 ROUGE-L Eval D0726-B.M.100.F-G.41 R:0.23684 P:0.19200 F:0.21208
41 ROUGE-L Eval D0726-C.M.100.F-A.41 R:0.26667 P:0.18913 F:0.22130
41 ROUGE-L Eval D0726-C.M.100.F-E.41 R:0.26936 P:0.18913 F:0.22223
41 ROUGE-L Eval D0726-C.M.100.F-F.41 R:0.29831 P:0.20804 F:0.24513
41 ROUGE-L Eval D0726-C.M.100.F-G.41 R:0.29836 P:0.21513 F:0.25000
41 ROUGE-L Eval D0727-A.M.100.G-A.41 R:0.41196 P:0.28311 F:0.33559
41 ROUGE-L Eval D0727-A.M.100.G-F.41 R:0.38158 P:0.26484 F:0.31267
41 ROUGE-L Eval D0727-A.M.100.G-G.41 R:0.37255 P:0.26027 F:0.30645
41 ROUGE-L Eval D0727-A.M.100.G-H.41 R:0.41447 P:0.28767 F:0.33962
41 ROUGE-L Eval D0727-B.M.100.G-A.41 R:0.15464 P:0.18987 F:0.17045
41 ROUGE-L Eval D0727-B.M.100.G-F.41 R:0.16558 P:0.21519 F:0.18715
41 ROUGE-L Eval D0727-B.M.100.G-G.41 R:0.15225 P:0.18565 F:0.16730
41 ROUGE-L Eval D0727-B.M.100.G-H.41 R:0.13746 P:0.16878 F:0.15152
41 ROUGE-L Eval D0727-C.M.100.G-A.41 R:0.30619 P:0.21029 F:0.24934
41 ROUGE-L Eval D0727-C.M.100.G-F.41 R:0.32660 P:0.21700 F:0.26075
41 ROUGE-L Eval D0727-C.M.100.G-G.41 R:0.29373 P:0.19911 F:0.23734
41 ROUGE-L Eval D0727-C.M.100.G-H.41 R:0.33108 P:0.21924 F:0.26380
41 ROUGE-L Eval D0736-A.M.100.H-G.41 R:0.22222 P:0.18452 F:0.20162
41 ROUGE-L Eval D0736-A.M.100.H-H.41 R:0.22993 P:0.18750 F:0.20656
41 ROUGE-L Eval D0736-A.M.100.H-I.41 R:0.23132 P:0.19345 F:0.21070
41 ROUGE-L Eval D0736-A.M.100.H-J.41 R:0.22222 P:0.20238 F:0.21184
41 ROUGE-L Eval D0736-B.M.100.H-G.41 R:0.21756 P:0.13571 F:0.16715
41 ROUGE-L Eval D0736-B.M.100.H-H.41 R:0.20248 P:0.11667 F:0.14804
41 ROUGE-L Eval D0736-B.M.100.H-I.41 R:0.23849 P:0.13571 F:0.17298
41 ROUGE-L Eval D0736-B.M.100.H-J.41 R:0.21678 P:0.14762 F:0.17564
41 ROUGE-L Eval D0736-C.M.100.H-G.41 R:0.19831 P:0.11271 F:0.14373
41 ROUGE-L Eval D0736-C.M.100.H-H.41 R:0.19786 P:0.08873 F:0.12252
41 ROUGE-L Eval D0736-C.M.100.H-I.41 R:0.16578 P:0.07434 F:0.10265
41 ROUGE-L Eval D0736-C.M.100.H-J.41 R:0.18868 P:0.11990 F:0.14662
41 ROUGE-L Eval D0740-A.M.100.I-D.41 R:0.29043 P:0.20513 F:0.24044
41 ROUGE-L Eval D0740-A.M.100.I-H.41 R:0.27124 P:0.19347 F:0.22585
41 ROUGE-L Eval D0740-A.M.100.I-I.41 R:0.31818 P:0.22844 F:0.26594
41 ROUGE-L Eval D0740-A.M.100.I-J.41 R:0.27419 P:0.19814 F:0.23004
41 ROUGE-L Eval D0740-B.M.100.I-D.41 R:0.21753 P:0.14135 F:0.17135
41 ROUGE-L Eval D0740-B.M.100.I-H.41 R:0.20199 P:0.12869 F:0.15722
41 ROUGE-L Eval D0740-B.M.100.I-I.41 R:0.20984 P:0.13502 F:0.16431
41 ROUGE-L Eval D0740-B.M.100.I-J.41 R:0.21359 P:0.13924 F:0.16858
41 ROUGE-L Eval D0740-C.M.100.I-D.41 R:0.32588 P:0.23944 F:0.27605
41 ROUGE-L Eval D0740-C.M.100.I-H.41 R:0.28617 P:0.20892 F:0.24152
41 ROUGE-L Eval D0740-C.M.100.I-I.41 R:0.28754 P:0.21127 F:0.24357
41 ROUGE-L Eval D0740-C.M.100.I-J.41 R:0.28981 P:0.21362 F:0.24595
41 ROUGE-L Eval D0743-A.M.100.J-B.41 R:0.20952 P:0.14966 F:0.17460
41 ROUGE-L Eval D0743-A.M.100.J-H.41 R:0.17593 P:0.12925 F:0.14902
41 ROUGE-L Eval D0743-A.M.100.J-I.41 R:0.21250 P:0.15420 F:0.17872
41 ROUGE-L Eval D0743-A.M.100.J-J.41 R:0.18769 P:0.13832 F:0.15927
41 ROUGE-L Eval D0743-B.M.100.J-B.41 R:0.16987 P:0.10838 F:0.13233
41 ROUGE-L Eval D0743-B.M.100.J-H.41 R:0.16088 P:0.10429 F:0.12655
41 ROUGE-L Eval D0743-B.M.100.J-I.41 R:0.18354 P:0.11861 F:0.14410
41 ROUGE-L Eval D0743-B.M.100.J-J.41 R:0.15888 P:0.10429 F:0.12592
41 ROUGE-L Eval D0743-C.M.100.J-B.41 R:0.30159 P:0.22619 F:0.25850
41 ROUGE-L Eval D0743-C.M.100.J-H.41 R:0.27707 P:0.20714 F:0.23706
41 ROUGE-L Eval D0743-C.M.100.J-I.41 R:0.30032 P:0.22381 F:0.25648
41 ROUGE-L Eval D0743-C.M.100.J-J.41 R:0.25472 P:0.19286 F:0.21952
---------------------------------------------
41 ROUGE-W-1.2 Average_R: 0.09344 (95%-conf.int. 0.08936 - 0.09801)
41 ROUGE-W-1.2 Average_P: 0.12704 (95%-conf.int. 0.12148 - 0.13272)
41 ROUGE-W-1.2 Average_F: 0.10685 (95%-conf.int. 0.10229 - 0.11175)
.............................................
41 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.41 R:0.08302 P:0.17559 F:0.11274
41 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.41 R:0.06483 P:0.13934 F:0.08849
41 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.41 R:0.07851 P:0.16715 F:0.10684
41 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.41 R:0.08851 P:0.17663 F:0.11793
41 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.41 R:0.08016 P:0.12032 F:0.09622
41 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.41 R:0.08775 P:0.13091 F:0.10507
41 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.41 R:0.08216 P:0.12149 F:0.09803
41 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.41 R:0.08126 P:0.12001 F:0.09690
41 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.41 R:0.06826 P:0.13220 F:0.09003
41 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.41 R:0.06890 P:0.13913 F:0.09216
41 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.41 R:0.07004 P:0.13940 F:0.09324
41 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.41 R:0.07574 P:0.14304 F:0.09904
41 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.41 R:0.09420 P:0.10781 F:0.10055
41 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.41 R:0.08091 P:0.09406 F:0.08699
41 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.41 R:0.08418 P:0.09734 F:0.09028
41 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.41 R:0.09111 P:0.10767 F:0.09870
41 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.41 R:0.06649 P:0.08451 F:0.07442
41 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.41 R:0.06141 P:0.07973 F:0.06938
41 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.41 R:0.06548 P:0.08536 F:0.07411
41 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.41 R:0.06069 P:0.08133 F:0.06951
41 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.41 R:0.12738 P:0.15180 F:0.13852
41 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.41 R:0.12762 P:0.15339 F:0.13932
41 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.41 R:0.11564 P:0.13765 F:0.12569
41 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.41 R:0.12483 P:0.15283 F:0.13742
41 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.41 R:0.13004 P:0.16384 F:0.14500
41 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.41 R:0.13235 P:0.16533 F:0.14701
41 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.41 R:0.11971 P:0.14826 F:0.13246
41 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.41 R:0.12153 P:0.15305 F:0.13548
41 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.41 R:0.08938 P:0.10418 F:0.09621
41 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.41 R:0.09685 P:0.11777 F:0.10629
41 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.41 R:0.09436 P:0.11739 F:0.10462
41 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.41 R:0.10043 P:0.12227 F:0.11028
41 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.41 R:0.08065 P:0.11197 F:0.09376
41 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.41 R:0.08789 P:0.11803 F:0.10075
41 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.41 R:0.07667 P:0.10562 F:0.08885
41 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.41 R:0.07456 P:0.10426 F:0.08694
41 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.41 R:0.15652 P:0.20618 F:0.17795
41 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.41 R:0.15607 P:0.21088 F:0.17938
41 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.41 R:0.16708 P:0.22203 F:0.19067
41 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.41 R:0.17019 P:0.23184 F:0.19629
41 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.41 R:0.11452 P:0.15693 F:0.13241
41 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.41 R:0.11956 P:0.16476 F:0.13857
41 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.41 R:0.12043 P:0.16675 F:0.13985
41 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.41 R:0.11271 P:0.15465 F:0.13039
41 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.41 R:0.11574 P:0.16114 F:0.13472
41 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.41 R:0.11546 P:0.16289 F:0.13513
41 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.41 R:0.10797 P:0.15425 F:0.12703
41 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.41 R:0.10972 P:0.15580 F:0.12876
41 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.41 R:0.11202 P:0.12786 F:0.11942
41 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.41 R:0.11559 P:0.13672 F:0.12527
41 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.41 R:0.10552 P:0.12637 F:0.11501
41 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.41 R:0.10689 P:0.12732 F:0.11621
41 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.41 R:0.07039 P:0.12324 F:0.08960
41 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.41 R:0.07649 P:0.13316 F:0.09717
41 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.41 R:0.06860 P:0.12114 F:0.08760
41 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.41 R:0.06844 P:0.12491 F:0.08843
41 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.41 R:0.09859 P:0.14878 F:0.11859
41 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.41 R:0.08455 P:0.12956 F:0.10232
41 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.41 R:0.08436 P:0.12697 F:0.10137
41 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.41 R:0.08248 P:0.12729 F:0.10010
41 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.41 R:0.09396 P:0.10848 F:0.10070
41 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.41 R:0.09455 P:0.10756 F:0.10064
41 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.41 R:0.09912 P:0.11502 F:0.10648
41 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.41 R:0.08861 P:0.10450 F:0.09590
41 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.41 R:0.09084 P:0.13038 F:0.10708
41 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.41 R:0.07453 P:0.10798 F:0.08819
41 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.41 R:0.08954 P:0.13058 F:0.10623
41 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.41 R:0.08985 P:0.13152 F:0.10676
41 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.41 R:0.09550 P:0.11894 F:0.10594
41 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.41 R:0.09736 P:0.12065 F:0.10776
41 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.41 R:0.10329 P:0.12900 F:0.11472
41 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.41 R:0.10603 P:0.13689 F:0.11950
41 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.41 R:0.14725 P:0.17812 F:0.16122
41 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.41 R:0.13688 P:0.17341 F:0.15299
41 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.41 R:0.12761 P:0.15790 F:0.14115
41 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.41 R:0.14449 P:0.17977 F:0.16021
41 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.41 R:0.06053 P:0.13041 F:0.08268
41 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.41 R:0.06269 P:0.14635 F:0.08778
41 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.41 R:0.05882 P:0.12847 F:0.08069
41 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.41 R:0.05305 P:0.11529 F:0.07266
41 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.41 R:0.09336 P:0.11531 F:0.10318
41 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.41 R:0.09800 P:0.12035 F:0.10803
41 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.41 R:0.09739 P:0.12152 F:0.10813
41 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.41 R:0.09958 P:0.11868 F:0.10829
41 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.41 R:0.08377 P:0.12318 F:0.09972
41 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.41 R:0.08642 P:0.12393 F:0.10183
41 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.41 R:0.08629 P:0.12894 F:0.10339
41 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.41 R:0.08167 P:0.13260 F:0.10108
41 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.41 R:0.07847 P:0.09061 F:0.08410
41 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.41 R:0.07547 P:0.08045 F:0.07788
41 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.41 R:0.08674 P:0.09117 F:0.08890
41 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.41 R:0.07819 P:0.09843 F:0.08715
41 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.41 R:0.07676 P:0.07925 F:0.07799
41 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.41 R:0.08108 P:0.06796 F:0.07394
41 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.41 R:0.06238 P:0.05103 F:0.05614
41 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.41 R:0.07348 P:0.08331 F:0.07809
41 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.41 R:0.10542 P:0.13696 F:0.11914
41 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.41 R:0.10287 P:0.13237 F:0.11577
41 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.41 R:0.11701 P:0.15539 F:0.13350
41 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.41 R:0.10007 P:0.13284 F:0.11415
41 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.41 R:0.07380 P:0.08810 F:0.08032
41 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.41 R:0.07202 P:0.08166 F:0.07654
41 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.41 R:0.07015 P:0.08481 F:0.07679
41 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.41 R:0.07444 P:0.08675 F:0.08012
41 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.41 R:0.11680 P:0.16562 F:0.13699
41 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.41 R:0.10297 P:0.14029 F:0.11877
41 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.41 R:0.10367 P:0.14897 F:0.12226
41 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.41 R:0.10370 P:0.14646 F:0.12143
41 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.41 R:0.07502 P:0.09340 F:0.08321
41 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.41 R:0.06464 P:0.08203 F:0.07230
41 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.41 R:0.07565 P:0.09741 F:0.08516
41 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.41 R:0.06733 P:0.08614 F:0.07558
41 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.41 R:0.06772 P:0.07236 F:0.06996
41 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.41 R:0.06528 P:0.07019 F:0.06765
41 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.41 R:0.07080 P:0.07711 F:0.07382
41 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.41 R:0.06512 P:0.07028 F:0.06760
41 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.41 R:0.10665 P:0.14002 F:0.12108
41 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.41 R:0.10213 P:0.12751 F:0.11342
41 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.41 R:0.10512 P:0.13959 F:0.11993
41 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.41 R:0.09573 P:0.12199 F:0.10728
---------------------------------------------
41 ROUGE-SU4 Average_R: 0.10161 (95%-conf.int. 0.09391 - 0.10993)
41 ROUGE-SU4 Average_P: 0.07558 (95%-conf.int. 0.07018 - 0.08131)
41 ROUGE-SU4 Average_F: 0.08606 (95%-conf.int. 0.07973 - 0.09279)
.............................................
41 ROUGE-SU4 Eval D0703-A.M.100.A-A.41 R:0.09838 P:0.11612 F:0.10652
41 ROUGE-SU4 Eval D0703-A.M.100.A-C.41 R:0.07356 P:0.08743 F:0.07990
41 ROUGE-SU4 Eval D0703-A.M.100.A-D.41 R:0.09658 P:0.11202 F:0.10373
41 ROUGE-SU4 Eval D0703-A.M.100.A-J.41 R:0.09266 P:0.10861 F:0.10000
41 ROUGE-SU4 Eval D0703-B.M.100.A-A.41 R:0.07830 P:0.06306 F:0.06986
41 ROUGE-SU4 Eval D0703-B.M.100.A-C.41 R:0.08793 P:0.06892 F:0.07727
41 ROUGE-SU4 Eval D0703-B.M.100.A-D.41 R:0.08563 P:0.06712 F:0.07525
41 ROUGE-SU4 Eval D0703-B.M.100.A-J.41 R:0.07964 P:0.06306 F:0.07039
41 ROUGE-SU4 Eval D0703-C.M.100.A-A.41 R:0.07249 P:0.07560 F:0.07401
41 ROUGE-SU4 Eval D0703-C.M.100.A-C.41 R:0.08111 P:0.08690 F:0.08391
41 ROUGE-SU4 Eval D0703-C.M.100.A-D.41 R:0.07880 P:0.08274 F:0.08072
41 ROUGE-SU4 Eval D0703-C.M.100.A-J.41 R:0.08277 P:0.08690 F:0.08478
41 ROUGE-SU4 Eval D0706-A.M.100.B-B.41 R:0.08944 P:0.05649 F:0.06925
41 ROUGE-SU4 Eval D0706-A.M.100.B-D.41 R:0.06991 P:0.04386 F:0.05390
41 ROUGE-SU4 Eval D0706-A.M.100.B-E.41 R:0.07389 P:0.04667 F:0.05721
41 ROUGE-SU4 Eval D0706-A.M.100.B-I.41 R:0.08556 P:0.05404 F:0.06624
41 ROUGE-SU4 Eval D0706-B.M.100.B-B.41 R:0.05369 P:0.03912 F:0.04526
41 ROUGE-SU4 Eval D0706-B.M.100.B-D.41 R:0.04738 P:0.03464 F:0.04002
41 ROUGE-SU4 Eval D0706-B.M.100.B-E.41 R:0.05222 P:0.03830 F:0.04419
41 ROUGE-SU4 Eval D0706-B.M.100.B-I.41 R:0.05371 P:0.03953 F:0.04554
41 ROUGE-SU4 Eval D0706-C.M.100.B-B.41 R:0.14901 P:0.10321 F:0.12195
41 ROUGE-SU4 Eval D0706-C.M.100.B-D.41 R:0.15121 P:0.10474 F:0.12376
41 ROUGE-SU4 Eval D0706-C.M.100.B-E.41 R:0.11623 P:0.08104 F:0.09550
41 ROUGE-SU4 Eval D0706-C.M.100.B-I.41 R:0.14754 P:0.10321 F:0.12146
41 ROUGE-SU4 Eval D0711-A.M.100.C-A.41 R:0.16779 P:0.11632 F:0.13739
41 ROUGE-SU4 Eval D0711-A.M.100.C-B.41 R:0.16952 P:0.11593 F:0.13769
41 ROUGE-SU4 Eval D0711-A.M.100.C-C.41 R:0.14269 P:0.09758 F:0.11590
41 ROUGE-SU4 Eval D0711-A.M.100.C-F.41 R:0.14342 P:0.09875 F:0.11697
41 ROUGE-SU4 Eval D0711-B.M.100.C-A.41 R:0.08275 P:0.05354 F:0.06501
41 ROUGE-SU4 Eval D0711-B.M.100.C-B.41 R:0.10681 P:0.06863 F:0.08357
41 ROUGE-SU4 Eval D0711-B.M.100.C-C.41 R:0.10632 P:0.06976 F:0.08424
41 ROUGE-SU4 Eval D0711-B.M.100.C-F.41 R:0.10859 P:0.07051 F:0.08550
41 ROUGE-SU4 Eval D0711-C.M.100.C-A.41 R:0.08983 P:0.06625 F:0.07626
41 ROUGE-SU4 Eval D0711-C.M.100.C-B.41 R:0.09825 P:0.07000 F:0.08175
41 ROUGE-SU4 Eval D0711-C.M.100.C-C.41 R:0.09028 P:0.06500 F:0.07558
41 ROUGE-SU4 Eval D0711-C.M.100.C-F.41 R:0.08854 P:0.06375 F:0.07413
41 ROUGE-SU4 Eval D0716-A.M.100.D-C.41 R:0.22783 P:0.16305 F:0.19007
41 ROUGE-SU4 Eval D0716-A.M.100.D-D.41 R:0.24429 P:0.17189 F:0.20179
41 ROUGE-SU4 Eval D0716-A.M.100.D-E.41 R:0.24744 P:0.17470 F:0.20480
41 ROUGE-SU4 Eval D0716-A.M.100.D-F.41 R:0.25424 P:0.18072 F:0.21127
41 ROUGE-SU4 Eval D0716-B.M.100.D-C.41 R:0.12050 P:0.09411 F:0.10568
41 ROUGE-SU4 Eval D0716-B.M.100.D-D.41 R:0.14080 P:0.10774 F:0.12207
41 ROUGE-SU4 Eval D0716-B.M.100.D-E.41 R:0.14050 P:0.10862 F:0.12252
41 ROUGE-SU4 Eval D0716-B.M.100.D-F.41 R:0.13470 P:0.10378 F:0.11724
41 ROUGE-SU4 Eval D0716-C.M.100.D-C.41 R:0.14604 P:0.10835 F:0.12440
41 ROUGE-SU4 Eval D0716-C.M.100.D-D.41 R:0.17010 P:0.12283 F:0.14265
41 ROUGE-SU4 Eval D0716-C.M.100.D-E.41 R:0.15028 P:0.11001 F:0.12703
41 ROUGE-SU4 Eval D0716-C.M.100.D-F.41 R:0.14897 P:0.10794 F:0.12518
41 ROUGE-SU4 Eval D0721-A.M.100.E-B.41 R:0.09646 P:0.06204 F:0.07551
41 ROUGE-SU4 Eval D0721-A.M.100.E-C.41 R:0.10500 P:0.06938 F:0.08355
41 ROUGE-SU4 Eval D0721-A.M.100.E-E.41 R:0.09667 P:0.06388 F:0.07693
41 ROUGE-SU4 Eval D0721-A.M.100.E-G.41 R:0.09259 P:0.06241 F:0.07456
41 ROUGE-SU4 Eval D0721-B.M.100.E-B.41 R:0.07191 P:0.06495 F:0.06825
41 ROUGE-SU4 Eval D0721-B.M.100.E-C.41 R:0.07516 P:0.06949 F:0.07221
41 ROUGE-SU4 Eval D0721-B.M.100.E-E.41 R:0.06566 P:0.05891 F:0.06210
41 ROUGE-SU4 Eval D0721-B.M.100.E-G.41 R:0.07450 P:0.06798 F:0.07109
41 ROUGE-SU4 Eval D0721-C.M.100.E-B.41 R:0.09540 P:0.07784 F:0.08573
41 ROUGE-SU4 Eval D0721-C.M.100.E-C.41 R:0.08531 P:0.06914 F:0.07638
41 ROUGE-SU4 Eval D0721-C.M.100.E-E.41 R:0.08048 P:0.06456 F:0.07165
41 ROUGE-SU4 Eval D0721-C.M.100.E-G.41 R:0.08194 P:0.06731 F:0.07391
41 ROUGE-SU4 Eval D0726-A.M.100.F-A.41 R:0.09272 P:0.05984 F:0.07274
41 ROUGE-SU4 Eval D0726-A.M.100.F-E.41 R:0.09589 P:0.06167 F:0.07506
41 ROUGE-SU4 Eval D0726-A.M.100.F-F.41 R:0.10011 P:0.06461 F:0.07853
41 ROUGE-SU4 Eval D0726-A.M.100.F-G.41 R:0.08362 P:0.05396 F:0.06559
41 ROUGE-SU4 Eval D0726-B.M.100.F-A.41 R:0.08837 P:0.07175 F:0.07920
41 ROUGE-SU4 Eval D0726-B.M.100.F-E.41 R:0.06712 P:0.05359 F:0.05960
41 ROUGE-SU4 Eval D0726-B.M.100.F-F.41 R:0.09101 P:0.07266 F:0.08081
41 ROUGE-SU4 Eval D0726-B.M.100.F-G.41 R:0.09234 P:0.07448 F:0.08245
41 ROUGE-SU4 Eval D0726-C.M.100.F-A.41 R:0.10160 P:0.07149 F:0.08393
41 ROUGE-SU4 Eval D0726-C.M.100.F-E.41 R:0.09170 P:0.06386 F:0.07529
41 ROUGE-SU4 Eval D0726-C.M.100.F-F.41 R:0.11208 P:0.07751 F:0.09164
41 ROUGE-SU4 Eval D0726-C.M.100.F-G.41 R:0.11167 P:0.07992 F:0.09316
41 ROUGE-SU4 Eval D0727-A.M.100.G-A.41 R:0.19397 P:0.13217 F:0.15721
41 ROUGE-SU4 Eval D0727-A.M.100.G-F.41 R:0.18581 P:0.12791 F:0.15152
41 ROUGE-SU4 Eval D0727-A.M.100.G-G.41 R:0.14933 P:0.10349 F:0.12225
41 ROUGE-SU4 Eval D0727-A.M.100.G-H.41 R:0.20158 P:0.13876 F:0.16437
41 ROUGE-SU4 Eval D0727-B.M.100.G-A.41 R:0.05241 P:0.06477 F:0.05794
41 ROUGE-SU4 Eval D0727-B.M.100.G-F.41 R:0.05611 P:0.07351 F:0.06364
41 ROUGE-SU4 Eval D0727-B.M.100.G-G.41 R:0.05042 P:0.06186 F:0.05556
41 ROUGE-SU4 Eval D0727-B.M.100.G-H.41 R:0.03946 P:0.04876 F:0.04362
41 ROUGE-SU4 Eval D0727-C.M.100.G-A.41 R:0.12375 P:0.08428 F:0.10027
41 ROUGE-SU4 Eval D0727-C.M.100.G-F.41 R:0.13552 P:0.08922 F:0.10760
41 ROUGE-SU4 Eval D0727-C.M.100.G-G.41 R:0.10904 P:0.07327 F:0.08765
41 ROUGE-SU4 Eval D0727-C.M.100.G-H.41 R:0.13252 P:0.08694 F:0.10500
41 ROUGE-SU4 Eval D0736-A.M.100.H-G.41 R:0.07319 P:0.06047 F:0.06622
41 ROUGE-SU4 Eval D0736-A.M.100.H-H.41 R:0.07268 P:0.05894 F:0.06509
41 ROUGE-SU4 Eval D0736-A.M.100.H-I.41 R:0.07448 P:0.06199 F:0.06766
41 ROUGE-SU4 Eval D0736-A.M.100.H-J.41 R:0.06879 P:0.06250 F:0.06549
41 ROUGE-SU4 Eval D0736-B.M.100.H-G.41 R:0.06562 P:0.04045 F:0.05005
41 ROUGE-SU4 Eval D0736-B.M.100.H-H.41 R:0.06695 P:0.03803 F:0.04851
41 ROUGE-SU4 Eval D0736-B.M.100.H-I.41 R:0.07359 P:0.04126 F:0.05287
41 ROUGE-SU4 Eval D0736-B.M.100.H-J.41 R:0.07254 P:0.04895 F:0.05845
41 ROUGE-SU4 Eval D0736-C.M.100.H-G.41 R:0.07787 P:0.04360 F:0.05590
41 ROUGE-SU4 Eval D0736-C.M.100.H-H.41 R:0.08752 P:0.03830 F:0.05328
41 ROUGE-SU4 Eval D0736-C.M.100.H-I.41 R:0.04097 P:0.01793 F:0.02494
41 ROUGE-SU4 Eval D0736-C.M.100.H-J.41 R:0.07263 P:0.04564 F:0.05606
41 ROUGE-SU4 Eval D0740-A.M.100.I-D.41 R:0.12994 P:0.09105 F:0.10707
41 ROUGE-SU4 Eval D0740-A.M.100.I-H.41 R:0.12192 P:0.08630 F:0.10106
41 ROUGE-SU4 Eval D0740-A.M.100.I-I.41 R:0.15333 P:0.10926 F:0.12760
41 ROUGE-SU4 Eval D0740-A.M.100.I-J.41 R:0.11865 P:0.08511 F:0.09912
41 ROUGE-SU4 Eval D0740-B.M.100.I-D.41 R:0.05778 P:0.03720 F:0.04526
41 ROUGE-SU4 Eval D0740-B.M.100.I-H.41 R:0.05385 P:0.03398 F:0.04167
41 ROUGE-SU4 Eval D0740-B.M.100.I-I.41 R:0.06004 P:0.03827 F:0.04674
41 ROUGE-SU4 Eval D0740-B.M.100.I-J.41 R:0.05648 P:0.03648 F:0.04433
41 ROUGE-SU4 Eval D0740-C.M.100.I-D.41 R:0.17377 P:0.12679 F:0.14661
41 ROUGE-SU4 Eval D0740-C.M.100.I-H.41 R:0.13531 P:0.09809 F:0.11373
41 ROUGE-SU4 Eval D0740-C.M.100.I-I.41 R:0.14481 P:0.10566 F:0.12218
41 ROUGE-SU4 Eval D0740-C.M.100.I-J.41 R:0.14815 P:0.10845 F:0.12523
41 ROUGE-SU4 Eval D0743-A.M.100.J-B.41 R:0.05972 P:0.04234 F:0.04955
41 ROUGE-SU4 Eval D0743-A.M.100.J-H.41 R:0.04536 P:0.03310 F:0.03827
41 ROUGE-SU4 Eval D0743-A.M.100.J-I.41 R:0.06036 P:0.04349 F:0.05055
41 ROUGE-SU4 Eval D0743-A.M.100.J-J.41 R:0.04890 P:0.03580 F:0.04134
41 ROUGE-SU4 Eval D0743-B.M.100.J-B.41 R:0.04879 P:0.03084 F:0.03779
41 ROUGE-SU4 Eval D0743-B.M.100.J-H.41 R:0.04207 P:0.02703 F:0.03291
41 ROUGE-SU4 Eval D0743-B.M.100.J-I.41 R:0.05249 P:0.03361 F:0.04098
41 ROUGE-SU4 Eval D0743-B.M.100.J-J.41 R:0.04633 P:0.03015 F:0.03653
41 ROUGE-SU4 Eval D0743-C.M.100.J-B.41 R:0.11618 P:0.08657 F:0.09921
41 ROUGE-SU4 Eval D0743-C.M.100.J-H.41 R:0.09368 P:0.06958 F:0.07985
41 ROUGE-SU4 Eval D0743-C.M.100.J-I.41 R:0.11639 P:0.08617 F:0.09903
41 ROUGE-SU4 Eval D0743-C.M.100.J-J.41 R:0.08602 P:0.06472 F:0.07387
---------------------------------------------
42 ROUGE-1 Average_R: 0.34210 (95%-conf.int. 0.33187 - 0.35155)
42 ROUGE-1 Average_P: 0.18315 (95%-conf.int. 0.17571 - 0.19010)
42 ROUGE-1 Average_F: 0.23778 (95%-conf.int. 0.22898 - 0.24575)
.............................................
42 ROUGE-1 Eval D0703-A.M.100.A-A.42 R:0.38851 P:0.22417 F:0.28430
42 ROUGE-1 Eval D0703-A.M.100.A-C.42 R:0.36242 P:0.21053 F:0.26634
42 ROUGE-1 Eval D0703-A.M.100.A-D.42 R:0.38144 P:0.21637 F:0.27612
42 ROUGE-1 Eval D0703-A.M.100.A-J.42 R:0.39456 P:0.22612 F:0.28748
42 ROUGE-1 Eval D0703-B.M.100.A-A.42 R:0.38562 P:0.22736 F:0.28606
42 ROUGE-1 Eval D0703-B.M.100.A-C.42 R:0.36913 P:0.21195 F:0.26928
42 ROUGE-1 Eval D0703-B.M.100.A-D.42 R:0.36913 P:0.21195 F:0.26928
42 ROUGE-1 Eval D0703-B.M.100.A-J.42 R:0.41196 P:0.23892 F:0.30244
42 ROUGE-1 Eval D0703-C.M.100.A-A.42 R:0.35667 P:0.23778 F:0.28534
42 ROUGE-1 Eval D0703-C.M.100.A-C.42 R:0.36039 P:0.24667 F:0.29288
42 ROUGE-1 Eval D0703-C.M.100.A-D.42 R:0.35430 P:0.23778 F:0.28457
42 ROUGE-1 Eval D0703-C.M.100.A-J.42 R:0.36424 P:0.24444 F:0.29255
42 ROUGE-1 Eval D0706-A.M.100.B-B.42 R:0.40260 P:0.20981 F:0.27586
42 ROUGE-1 Eval D0706-A.M.100.B-D.42 R:0.37255 P:0.19289 F:0.25418
42 ROUGE-1 Eval D0706-A.M.100.B-E.42 R:0.36364 P:0.18951 F:0.24917
42 ROUGE-1 Eval D0706-A.M.100.B-I.42 R:0.37338 P:0.19459 F:0.25584
42 ROUGE-1 Eval D0706-B.M.100.B-B.42 R:0.32026 P:0.17014 F:0.22222
42 ROUGE-1 Eval D0706-B.M.100.B-D.42 R:0.30293 P:0.16146 F:0.21065
42 ROUGE-1 Eval D0706-B.M.100.B-E.42 R:0.31169 P:0.16667 F:0.21720
42 ROUGE-1 Eval D0706-B.M.100.B-I.42 R:0.33333 P:0.17882 F:0.23277
42 ROUGE-1 Eval D0706-C.M.100.B-B.42 R:0.40323 P:0.24366 F:0.30376
42 ROUGE-1 Eval D0706-C.M.100.B-D.42 R:0.41290 P:0.24951 F:0.31105
42 ROUGE-1 Eval D0706-C.M.100.B-E.42 R:0.36538 P:0.22222 F:0.27636
42 ROUGE-1 Eval D0706-C.M.100.B-I.42 R:0.38019 P:0.23197 F:0.28814
42 ROUGE-1 Eval D0711-A.M.100.C-A.42 R:0.40461 P:0.23034 F:0.29356
42 ROUGE-1 Eval D0711-A.M.100.C-B.42 R:0.42333 P:0.23783 F:0.30456
42 ROUGE-1 Eval D0711-A.M.100.C-C.42 R:0.39000 P:0.21910 F:0.28057
42 ROUGE-1 Eval D0711-A.M.100.C-F.42 R:0.41391 P:0.23408 F:0.29904
42 ROUGE-1 Eval D0711-B.M.100.C-A.42 R:0.31973 P:0.16578 F:0.21835
42 ROUGE-1 Eval D0711-B.M.100.C-B.42 R:0.33904 P:0.17460 F:0.23050
42 ROUGE-1 Eval D0711-B.M.100.C-C.42 R:0.34228 P:0.17989 F:0.23583
42 ROUGE-1 Eval D0711-B.M.100.C-F.42 R:0.34237 P:0.17813 F:0.23434
42 ROUGE-1 Eval D0711-C.M.100.C-A.42 R:0.37954 P:0.20833 F:0.26900
42 ROUGE-1 Eval D0711-C.M.100.C-B.42 R:0.38225 P:0.20290 F:0.26509
42 ROUGE-1 Eval D0711-C.M.100.C-C.42 R:0.37500 P:0.20109 F:0.26180
42 ROUGE-1 Eval D0711-C.M.100.C-F.42 R:0.34797 P:0.18659 F:0.24292
42 ROUGE-1 Eval D0716-A.M.100.D-C.42 R:0.48852 P:0.27289 F:0.35017
42 ROUGE-1 Eval D0716-A.M.100.D-D.42 R:0.51000 P:0.28022 F:0.36170
42 ROUGE-1 Eval D0716-A.M.100.D-E.42 R:0.47176 P:0.26007 F:0.33530
42 ROUGE-1 Eval D0716-A.M.100.D-F.42 R:0.47525 P:0.26374 F:0.33923
42 ROUGE-1 Eval D0716-B.M.100.D-C.42 R:0.41118 P:0.23810 F:0.30157
42 ROUGE-1 Eval D0716-B.M.100.D-D.42 R:0.42282 P:0.24000 F:0.30620
42 ROUGE-1 Eval D0716-B.M.100.D-E.42 R:0.40532 P:0.23238 F:0.29540
42 ROUGE-1 Eval D0716-B.M.100.D-F.42 R:0.42667 P:0.24381 F:0.31030
42 ROUGE-1 Eval D0716-C.M.100.D-C.42 R:0.34853 P:0.20617 F:0.25908
42 ROUGE-1 Eval D0716-C.M.100.D-D.42 R:0.35117 P:0.20231 F:0.25672
42 ROUGE-1 Eval D0716-C.M.100.D-E.42 R:0.36964 P:0.21580 F:0.27251
42 ROUGE-1 Eval D0716-C.M.100.D-F.42 R:0.37000 P:0.21387 F:0.27106
42 ROUGE-1 Eval D0721-A.M.100.E-B.42 R:0.29667 P:0.14332 F:0.19327
42 ROUGE-1 Eval D0721-A.M.100.E-C.42 R:0.28571 P:0.14171 F:0.18945
42 ROUGE-1 Eval D0721-A.M.100.E-E.42 R:0.25974 P:0.12882 F:0.17222
42 ROUGE-1 Eval D0721-A.M.100.E-G.42 R:0.28025 P:0.14171 F:0.18824
42 ROUGE-1 Eval D0721-B.M.100.E-B.42 R:0.31596 P:0.15850 F:0.21110
42 ROUGE-1 Eval D0721-B.M.100.E-C.42 R:0.29618 P:0.15196 F:0.20086
42 ROUGE-1 Eval D0721-B.M.100.E-E.42 R:0.28197 P:0.14052 F:0.18757
42 ROUGE-1 Eval D0721-B.M.100.E-G.42 R:0.28065 P:0.14216 F:0.18872
42 ROUGE-1 Eval D0721-C.M.100.E-B.42 R:0.34754 P:0.19414 F:0.24912
42 ROUGE-1 Eval D0721-C.M.100.E-C.42 R:0.28713 P:0.15934 F:0.20495
42 ROUGE-1 Eval D0721-C.M.100.E-E.42 R:0.32000 P:0.17582 F:0.22695
42 ROUGE-1 Eval D0721-C.M.100.E-G.42 R:0.27036 P:0.15201 F:0.19460
42 ROUGE-1 Eval D0726-A.M.100.F-A.42 R:0.36877 P:0.21023 F:0.26779
42 ROUGE-1 Eval D0726-A.M.100.F-E.42 R:0.36333 P:0.20644 F:0.26328
42 ROUGE-1 Eval D0726-A.M.100.F-F.42 R:0.40199 P:0.22917 F:0.29192
42 ROUGE-1 Eval D0726-A.M.100.F-G.42 R:0.37209 P:0.21212 F:0.27020
42 ROUGE-1 Eval D0726-B.M.100.F-A.42 R:0.28758 P:0.15942 F:0.20513
42 ROUGE-1 Eval D0726-B.M.100.F-E.42 R:0.29568 P:0.16123 F:0.20867
42 ROUGE-1 Eval D0726-B.M.100.F-F.42 R:0.29568 P:0.16123 F:0.20867
42 ROUGE-1 Eval D0726-B.M.100.F-G.42 R:0.29934 P:0.16486 F:0.21262
42 ROUGE-1 Eval D0726-C.M.100.F-A.42 R:0.24333 P:0.10961 F:0.15114
42 ROUGE-1 Eval D0726-C.M.100.F-E.42 R:0.25589 P:0.11411 F:0.15784
42 ROUGE-1 Eval D0726-C.M.100.F-F.42 R:0.26441 P:0.11712 F:0.16233
42 ROUGE-1 Eval D0726-C.M.100.F-G.42 R:0.24918 P:0.11411 F:0.15654
42 ROUGE-1 Eval D0727-A.M.100.G-A.42 R:0.37542 P:0.19024 F:0.25252
42 ROUGE-1 Eval D0727-A.M.100.G-F.42 R:0.38158 P:0.19529 F:0.25836
42 ROUGE-1 Eval D0727-A.M.100.G-G.42 R:0.38235 P:0.19697 F:0.26000
42 ROUGE-1 Eval D0727-A.M.100.G-H.42 R:0.39145 P:0.20034 F:0.26504
42 ROUGE-1 Eval D0727-B.M.100.G-A.42 R:0.31615 P:0.15646 F:0.20933
42 ROUGE-1 Eval D0727-B.M.100.G-F.42 R:0.30195 P:0.15816 F:0.20759
42 ROUGE-1 Eval D0727-B.M.100.G-G.42 R:0.29412 P:0.14456 F:0.19385
42 ROUGE-1 Eval D0727-B.M.100.G-H.42 R:0.28866 P:0.14286 F:0.19113
42 ROUGE-1 Eval D0727-C.M.100.G-A.42 R:0.40717 P:0.19113 F:0.26015
42 ROUGE-1 Eval D0727-C.M.100.G-F.42 R:0.40067 P:0.18196 F:0.25026
42 ROUGE-1 Eval D0727-C.M.100.G-G.42 R:0.40264 P:0.18654 F:0.25496
42 ROUGE-1 Eval D0727-C.M.100.G-H.42 R:0.40541 P:0.18349 F:0.25264
42 ROUGE-1 Eval D0736-A.M.100.H-G.42 R:0.29032 P:0.11638 F:0.16615
42 ROUGE-1 Eval D0736-A.M.100.H-H.42 R:0.29927 P:0.11782 F:0.16908
42 ROUGE-1 Eval D0736-A.M.100.H-I.42 R:0.28470 P:0.11494 F:0.16376
42 ROUGE-1 Eval D0736-A.M.100.H-J.42 R:0.28431 P:0.12500 F:0.17365
42 ROUGE-1 Eval D0736-B.M.100.H-G.42 R:0.28244 P:0.11581 F:0.16427
42 ROUGE-1 Eval D0736-B.M.100.H-H.42 R:0.30579 P:0.11581 F:0.16800
42 ROUGE-1 Eval D0736-B.M.100.H-I.42 R:0.29289 P:0.10955 F:0.15946
42 ROUGE-1 Eval D0736-B.M.100.H-J.42 R:0.28671 P:0.12833 F:0.17730
42 ROUGE-1 Eval D0736-C.M.100.H-G.42 R:0.29114 P:0.11500 F:0.16487
42 ROUGE-1 Eval D0736-C.M.100.H-H.42 R:0.26738 P:0.08333 F:0.12706
42 ROUGE-1 Eval D0736-C.M.100.H-I.42 R:0.32086 P:0.10000 F:0.15248
42 ROUGE-1 Eval D0736-C.M.100.H-J.42 R:0.28679 P:0.12667 F:0.17573
42 ROUGE-1 Eval D0740-A.M.100.I-D.42 R:0.41254 P:0.20938 F:0.27778
42 ROUGE-1 Eval D0740-A.M.100.I-H.42 R:0.37908 P:0.19430 F:0.25692
42 ROUGE-1 Eval D0740-A.M.100.I-I.42 R:0.40260 P:0.20771 F:0.27404
42 ROUGE-1 Eval D0740-A.M.100.I-J.42 R:0.39032 P:0.20268 F:0.26681
42 ROUGE-1 Eval D0740-B.M.100.I-D.42 R:0.36364 P:0.21705 F:0.27184
42 ROUGE-1 Eval D0740-B.M.100.I-H.42 R:0.32119 P:0.18798 F:0.23716
42 ROUGE-1 Eval D0740-B.M.100.I-I.42 R:0.37049 P:0.21899 F:0.27527
42 ROUGE-1 Eval D0740-B.M.100.I-J.42 R:0.36570 P:0.21899 F:0.27394
42 ROUGE-1 Eval D0740-C.M.100.I-D.42 R:0.38019 P:0.20988 F:0.27046
42 ROUGE-1 Eval D0740-C.M.100.I-H.42 R:0.34084 P:0.18695 F:0.24146
42 ROUGE-1 Eval D0740-C.M.100.I-I.42 R:0.37061 P:0.20459 F:0.26364
42 ROUGE-1 Eval D0740-C.M.100.I-J.42 R:0.37580 P:0.20811 F:0.26788
42 ROUGE-1 Eval D0743-A.M.100.J-B.42 R:0.27937 P:0.14239 F:0.18864
42 ROUGE-1 Eval D0743-A.M.100.J-H.42 R:0.27469 P:0.14401 F:0.18896
42 ROUGE-1 Eval D0743-A.M.100.J-I.42 R:0.29063 P:0.15049 F:0.19830
42 ROUGE-1 Eval D0743-A.M.100.J-J.42 R:0.26769 P:0.14078 F:0.18452
42 ROUGE-1 Eval D0743-B.M.100.J-B.42 R:0.25321 P:0.15310 F:0.19082
42 ROUGE-1 Eval D0743-B.M.100.J-H.42 R:0.21767 P:0.13372 F:0.16567
42 ROUGE-1 Eval D0743-B.M.100.J-I.42 R:0.26899 P:0.16473 F:0.20433
42 ROUGE-1 Eval D0743-B.M.100.J-J.42 R:0.23676 P:0.14729 F:0.18160
42 ROUGE-1 Eval D0743-C.M.100.J-B.42 R:0.28571 P:0.15385 F:0.20000
42 ROUGE-1 Eval D0743-C.M.100.J-H.42 R:0.24841 P:0.13333 F:0.17352
42 ROUGE-1 Eval D0743-C.M.100.J-I.42 R:0.28435 P:0.15214 F:0.19822
42 ROUGE-1 Eval D0743-C.M.100.J-J.42 R:0.22013 P:0.11966 F:0.15504
---------------------------------------------
42 ROUGE-2 Average_R: 0.07050 (95%-conf.int. 0.06343 - 0.07807)
42 ROUGE-2 Average_P: 0.03813 (95%-conf.int. 0.03412 - 0.04232)
42 ROUGE-2 Average_F: 0.04936 (95%-conf.int. 0.04425 - 0.05471)
.............................................
42 ROUGE-2 Eval D0703-A.M.100.A-A.42 R:0.13652 P:0.07843 F:0.09963
42 ROUGE-2 Eval D0703-A.M.100.A-C.42 R:0.11186 P:0.06471 F:0.08199
42 ROUGE-2 Eval D0703-A.M.100.A-D.42 R:0.12500 P:0.07059 F:0.09023
42 ROUGE-2 Eval D0703-A.M.100.A-J.42 R:0.15120 P:0.08627 F:0.10986
42 ROUGE-2 Eval D0703-B.M.100.A-A.42 R:0.07591 P:0.04457 F:0.05616
42 ROUGE-2 Eval D0703-B.M.100.A-C.42 R:0.06102 P:0.03488 F:0.04439
42 ROUGE-2 Eval D0703-B.M.100.A-D.42 R:0.08475 P:0.04845 F:0.06165
42 ROUGE-2 Eval D0703-B.M.100.A-J.42 R:0.10067 P:0.05814 F:0.07371
42 ROUGE-2 Eval D0703-C.M.100.A-A.42 R:0.07407 P:0.04922 F:0.05914
42 ROUGE-2 Eval D0703-C.M.100.A-C.42 R:0.07541 P:0.05145 F:0.06117
42 ROUGE-2 Eval D0703-C.M.100.A-D.42 R:0.06020 P:0.04027 F:0.04826
42 ROUGE-2 Eval D0703-C.M.100.A-J.42 R:0.07023 P:0.04698 F:0.05630
42 ROUGE-2 Eval D0706-A.M.100.B-B.42 R:0.08197 P:0.04252 F:0.05599
42 ROUGE-2 Eval D0706-A.M.100.B-D.42 R:0.09241 P:0.04762 F:0.06285
42 ROUGE-2 Eval D0706-A.M.100.B-E.42 R:0.07213 P:0.03741 F:0.04927
42 ROUGE-2 Eval D0706-A.M.100.B-I.42 R:0.08852 P:0.04592 F:0.06047
42 ROUGE-2 Eval D0706-B.M.100.B-B.42 R:0.03300 P:0.01745 F:0.02283
42 ROUGE-2 Eval D0706-B.M.100.B-D.42 R:0.02632 P:0.01396 F:0.01824
42 ROUGE-2 Eval D0706-B.M.100.B-E.42 R:0.03607 P:0.01920 F:0.02506
42 ROUGE-2 Eval D0706-B.M.100.B-I.42 R:0.04248 P:0.02269 F:0.02958
42 ROUGE-2 Eval D0706-C.M.100.B-B.42 R:0.11401 P:0.06863 F:0.08568
42 ROUGE-2 Eval D0706-C.M.100.B-D.42 R:0.12704 P:0.07647 F:0.09547
42 ROUGE-2 Eval D0706-C.M.100.B-E.42 R:0.06796 P:0.04118 F:0.05128
42 ROUGE-2 Eval D0706-C.M.100.B-I.42 R:0.09032 P:0.05490 F:0.06829
42 ROUGE-2 Eval D0711-A.M.100.C-A.42 R:0.07641 P:0.04331 F:0.05528
42 ROUGE-2 Eval D0711-A.M.100.C-B.42 R:0.09428 P:0.05273 F:0.06763
42 ROUGE-2 Eval D0711-A.M.100.C-C.42 R:0.06397 P:0.03578 F:0.04589
42 ROUGE-2 Eval D0711-A.M.100.C-F.42 R:0.05686 P:0.03202 F:0.04097
42 ROUGE-2 Eval D0711-B.M.100.C-A.42 R:0.02749 P:0.01418 F:0.01871
42 ROUGE-2 Eval D0711-B.M.100.C-B.42 R:0.05536 P:0.02837 F:0.03751
42 ROUGE-2 Eval D0711-B.M.100.C-C.42 R:0.05085 P:0.02660 F:0.03493
42 ROUGE-2 Eval D0711-B.M.100.C-F.42 R:0.05137 P:0.02660 F:0.03505
42 ROUGE-2 Eval D0711-C.M.100.C-A.42 R:0.03333 P:0.01821 F:0.02355
42 ROUGE-2 Eval D0711-C.M.100.C-B.42 R:0.03448 P:0.01821 F:0.02383
42 ROUGE-2 Eval D0711-C.M.100.C-C.42 R:0.02730 P:0.01457 F:0.01900
42 ROUGE-2 Eval D0711-C.M.100.C-F.42 R:0.02730 P:0.01457 F:0.01900
42 ROUGE-2 Eval D0716-A.M.100.D-C.42 R:0.23179 P:0.12891 F:0.16568
42 ROUGE-2 Eval D0716-A.M.100.D-D.42 R:0.25253 P:0.13812 F:0.17857
42 ROUGE-2 Eval D0716-A.M.100.D-E.42 R:0.20805 P:0.11418 F:0.14744
42 ROUGE-2 Eval D0716-A.M.100.D-F.42 R:0.22000 P:0.12155 F:0.15659
42 ROUGE-2 Eval D0716-B.M.100.D-C.42 R:0.08638 P:0.04981 F:0.06319
42 ROUGE-2 Eval D0716-B.M.100.D-D.42 R:0.08814 P:0.04981 F:0.06365
42 ROUGE-2 Eval D0716-B.M.100.D-E.42 R:0.07383 P:0.04215 F:0.05366
42 ROUGE-2 Eval D0716-B.M.100.D-F.42 R:0.10438 P:0.05939 F:0.07571
42 ROUGE-2 Eval D0716-C.M.100.D-C.42 R:0.08882 P:0.05233 F:0.06586
42 ROUGE-2 Eval D0716-C.M.100.D-D.42 R:0.07095 P:0.04070 F:0.05173
42 ROUGE-2 Eval D0716-C.M.100.D-E.42 R:0.10667 P:0.06202 F:0.07844
42 ROUGE-2 Eval D0716-C.M.100.D-F.42 R:0.09428 P:0.05426 F:0.06888
42 ROUGE-2 Eval D0721-A.M.100.E-B.42 R:0.03704 P:0.01780 F:0.02404
42 ROUGE-2 Eval D0721-A.M.100.E-C.42 R:0.03934 P:0.01942 F:0.02600
42 ROUGE-2 Eval D0721-A.M.100.E-E.42 R:0.03607 P:0.01780 F:0.02384
42 ROUGE-2 Eval D0721-A.M.100.E-G.42 R:0.03537 P:0.01780 F:0.02368
42 ROUGE-2 Eval D0721-B.M.100.E-B.42 R:0.04934 P:0.02463 F:0.03286
42 ROUGE-2 Eval D0721-B.M.100.E-C.42 R:0.04502 P:0.02299 F:0.03044
42 ROUGE-2 Eval D0721-B.M.100.E-E.42 R:0.03642 P:0.01806 F:0.02415
42 ROUGE-2 Eval D0721-B.M.100.E-G.42 R:0.02606 P:0.01314 F:0.01747
42 ROUGE-2 Eval D0721-C.M.100.E-B.42 R:0.08278 P:0.04604 F:0.05917
42 ROUGE-2 Eval D0721-C.M.100.E-C.42 R:0.05667 P:0.03131 F:0.04034
42 ROUGE-2 Eval D0721-C.M.100.E-E.42 R:0.08418 P:0.04604 F:0.05952
42 ROUGE-2 Eval D0721-C.M.100.E-G.42 R:0.04605 P:0.02578 F:0.03305
42 ROUGE-2 Eval D0726-A.M.100.F-A.42 R:0.09396 P:0.05333 F:0.06804
42 ROUGE-2 Eval D0726-A.M.100.F-E.42 R:0.10774 P:0.06095 F:0.07786
42 ROUGE-2 Eval D0726-A.M.100.F-F.42 R:0.11409 P:0.06476 F:0.08262
42 ROUGE-2 Eval D0726-A.M.100.F-G.42 R:0.10738 P:0.06095 F:0.07776
42 ROUGE-2 Eval D0726-B.M.100.F-A.42 R:0.02970 P:0.01639 F:0.02112
42 ROUGE-2 Eval D0726-B.M.100.F-E.42 R:0.03356 P:0.01821 F:0.02361
42 ROUGE-2 Eval D0726-B.M.100.F-F.42 R:0.03020 P:0.01639 F:0.02125
42 ROUGE-2 Eval D0726-B.M.100.F-G.42 R:0.03654 P:0.02004 F:0.02588
42 ROUGE-2 Eval D0726-C.M.100.F-A.42 R:0.03030 P:0.01357 F:0.01874
42 ROUGE-2 Eval D0726-C.M.100.F-E.42 R:0.03741 P:0.01659 F:0.02299
42 ROUGE-2 Eval D0726-C.M.100.F-F.42 R:0.04110 P:0.01810 F:0.02513
42 ROUGE-2 Eval D0726-C.M.100.F-G.42 R:0.04305 P:0.01961 F:0.02695
42 ROUGE-2 Eval D0727-A.M.100.G-A.42 R:0.08389 P:0.04230 F:0.05624
42 ROUGE-2 Eval D0727-A.M.100.G-F.42 R:0.09967 P:0.05076 F:0.06726
42 ROUGE-2 Eval D0727-A.M.100.G-G.42 R:0.09571 P:0.04907 F:0.06488
42 ROUGE-2 Eval D0727-A.M.100.G-H.42 R:0.08970 P:0.04569 F:0.06054
42 ROUGE-2 Eval D0727-B.M.100.G-A.42 R:0.05903 P:0.02906 F:0.03895
42 ROUGE-2 Eval D0727-B.M.100.G-F.42 R:0.05574 P:0.02906 F:0.03820
42 ROUGE-2 Eval D0727-B.M.100.G-G.42 R:0.05594 P:0.02735 F:0.03674
42 ROUGE-2 Eval D0727-B.M.100.G-H.42 R:0.05556 P:0.02735 F:0.03666
42 ROUGE-2 Eval D0727-C.M.100.G-A.42 R:0.06250 P:0.02919 F:0.03979
42 ROUGE-2 Eval D0727-C.M.100.G-F.42 R:0.06122 P:0.02765 F:0.03809
42 ROUGE-2 Eval D0727-C.M.100.G-G.42 R:0.07667 P:0.03533 F:0.04837
42 ROUGE-2 Eval D0727-C.M.100.G-H.42 R:0.06143 P:0.02765 F:0.03814
42 ROUGE-2 Eval D0736-A.M.100.H-G.42 R:0.04710 P:0.01876 F:0.02683
42 ROUGE-2 Eval D0736-A.M.100.H-H.42 R:0.04428 P:0.01732 F:0.02490
42 ROUGE-2 Eval D0736-A.M.100.H-I.42 R:0.04676 P:0.01876 F:0.02678
42 ROUGE-2 Eval D0736-A.M.100.H-J.42 R:0.04290 P:0.01876 F:0.02610
42 ROUGE-2 Eval D0736-B.M.100.H-G.42 R:0.04247 P:0.01730 F:0.02459
42 ROUGE-2 Eval D0736-B.M.100.H-H.42 R:0.04603 P:0.01730 F:0.02515
42 ROUGE-2 Eval D0736-B.M.100.H-I.42 R:0.03390 P:0.01258 F:0.01835
42 ROUGE-2 Eval D0736-B.M.100.H-J.42 R:0.03180 P:0.01415 F:0.01959
42 ROUGE-2 Eval D0736-C.M.100.H-G.42 R:0.04701 P:0.01843 F:0.02648
42 ROUGE-2 Eval D0736-C.M.100.H-H.42 R:0.02174 P:0.00670 F:0.01024
42 ROUGE-2 Eval D0736-C.M.100.H-I.42 R:0.06522 P:0.02010 F:0.03073
42 ROUGE-2 Eval D0736-C.M.100.H-J.42 R:0.04580 P:0.02010 F:0.02794
42 ROUGE-2 Eval D0740-A.M.100.I-D.42 R:0.12667 P:0.06397 F:0.08501
42 ROUGE-2 Eval D0740-A.M.100.I-H.42 R:0.11881 P:0.06061 F:0.08027
42 ROUGE-2 Eval D0740-A.M.100.I-I.42 R:0.12459 P:0.06397 F:0.08454
42 ROUGE-2 Eval D0740-A.M.100.I-J.42 R:0.09446 P:0.04882 F:0.06437
42 ROUGE-2 Eval D0740-B.M.100.I-D.42 R:0.08525 P:0.05068 F:0.06357
42 ROUGE-2 Eval D0740-B.M.100.I-H.42 R:0.06020 P:0.03509 F:0.04434
42 ROUGE-2 Eval D0740-B.M.100.I-I.42 R:0.07616 P:0.04483 F:0.05644
42 ROUGE-2 Eval D0740-B.M.100.I-J.42 R:0.08497 P:0.05068 F:0.06349
42 ROUGE-2 Eval D0740-C.M.100.I-D.42 R:0.11613 P:0.06383 F:0.08238
42 ROUGE-2 Eval D0740-C.M.100.I-H.42 R:0.07468 P:0.04078 F:0.05275
42 ROUGE-2 Eval D0740-C.M.100.I-I.42 R:0.10645 P:0.05851 F:0.07551
42 ROUGE-2 Eval D0740-C.M.100.I-J.42 R:0.09968 P:0.05496 F:0.07085
42 ROUGE-2 Eval D0743-A.M.100.J-B.42 R:0.03205 P:0.01626 F:0.02157
42 ROUGE-2 Eval D0743-A.M.100.J-H.42 R:0.01869 P:0.00976 F:0.01282
42 ROUGE-2 Eval D0743-A.M.100.J-I.42 R:0.02839 P:0.01463 F:0.01931
42 ROUGE-2 Eval D0743-A.M.100.J-J.42 R:0.02484 P:0.01301 F:0.01708
42 ROUGE-2 Eval D0743-B.M.100.J-B.42 R:0.03883 P:0.02339 F:0.02919
42 ROUGE-2 Eval D0743-B.M.100.J-H.42 R:0.03185 P:0.01949 F:0.02418
42 ROUGE-2 Eval D0743-B.M.100.J-I.42 R:0.04153 P:0.02534 F:0.03148
42 ROUGE-2 Eval D0743-B.M.100.J-J.42 R:0.03145 P:0.01949 F:0.02407
42 ROUGE-2 Eval D0743-C.M.100.J-B.42 R:0.04808 P:0.02577 F:0.03356
42 ROUGE-2 Eval D0743-C.M.100.J-H.42 R:0.03215 P:0.01718 F:0.02239
42 ROUGE-2 Eval D0743-C.M.100.J-I.42 R:0.04516 P:0.02405 F:0.03139
42 ROUGE-2 Eval D0743-C.M.100.J-J.42 R:0.01905 P:0.01031 F:0.01338
---------------------------------------------
42 ROUGE-3 Average_R: 0.02168 (95%-conf.int. 0.01742 - 0.02638)
42 ROUGE-3 Average_P: 0.01186 (95%-conf.int. 0.00951 - 0.01449)
42 ROUGE-3 Average_F: 0.01530 (95%-conf.int. 0.01226 - 0.01863)
.............................................
42 ROUGE-3 Eval D0703-A.M.100.A-A.42 R:0.05862 P:0.03353 F:0.04266
42 ROUGE-3 Eval D0703-A.M.100.A-C.42 R:0.03767 P:0.02170 F:0.02754
42 ROUGE-3 Eval D0703-A.M.100.A-D.42 R:0.04912 P:0.02761 F:0.03535
42 ROUGE-3 Eval D0703-A.M.100.A-J.42 R:0.06250 P:0.03550 F:0.04528
42 ROUGE-3 Eval D0703-B.M.100.A-A.42 R:0.03667 P:0.02144 F:0.02706
42 ROUGE-3 Eval D0703-B.M.100.A-C.42 R:0.01370 P:0.00780 F:0.00994
42 ROUGE-3 Eval D0703-B.M.100.A-D.42 R:0.03767 P:0.02144 F:0.02733
42 ROUGE-3 Eval D0703-B.M.100.A-J.42 R:0.04407 P:0.02534 F:0.03218
42 ROUGE-3 Eval D0703-C.M.100.A-A.42 R:0.01020 P:0.00676 F:0.00813
42 ROUGE-3 Eval D0703-C.M.100.A-C.42 R:0.00993 P:0.00676 F:0.00804
42 ROUGE-3 Eval D0703-C.M.100.A-D.42 R:0.00338 P:0.00225 F:0.00270
42 ROUGE-3 Eval D0703-C.M.100.A-J.42 R:0.00676 P:0.00450 F:0.00540
42 ROUGE-3 Eval D0706-A.M.100.B-B.42 R:0.00993 P:0.00513 F:0.00677
42 ROUGE-3 Eval D0706-A.M.100.B-D.42 R:0.01667 P:0.00855 F:0.01130
42 ROUGE-3 Eval D0706-A.M.100.B-E.42 R:0.00662 P:0.00342 F:0.00451
42 ROUGE-3 Eval D0706-A.M.100.B-I.42 R:0.01656 P:0.00855 F:0.01128
42 ROUGE-3 Eval D0706-B.M.100.B-B.42 R:0.00333 P:0.00175 F:0.00229
42 ROUGE-3 Eval D0706-B.M.100.B-D.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0706-B.M.100.B-E.42 R:0.00331 P:0.00175 F:0.00229
42 ROUGE-3 Eval D0706-B.M.100.B-I.42 R:0.00330 P:0.00175 F:0.00229
42 ROUGE-3 Eval D0706-C.M.100.B-B.42 R:0.06908 P:0.04142 F:0.05179
42 ROUGE-3 Eval D0706-C.M.100.B-D.42 R:0.06908 P:0.04142 F:0.05179
42 ROUGE-3 Eval D0706-C.M.100.B-E.42 R:0.02288 P:0.01381 F:0.01722
42 ROUGE-3 Eval D0706-C.M.100.B-I.42 R:0.04560 P:0.02761 F:0.03439
42 ROUGE-3 Eval D0711-A.M.100.C-A.42 R:0.01678 P:0.00947 F:0.01211
42 ROUGE-3 Eval D0711-A.M.100.C-B.42 R:0.02041 P:0.01136 F:0.01460
42 ROUGE-3 Eval D0711-A.M.100.C-C.42 R:0.01361 P:0.00758 F:0.00974
42 ROUGE-3 Eval D0711-A.M.100.C-F.42 R:0.01014 P:0.00568 F:0.00728
42 ROUGE-3 Eval D0711-B.M.100.C-A.42 R:0.00347 P:0.00178 F:0.00235
42 ROUGE-3 Eval D0711-B.M.100.C-B.42 R:0.01049 P:0.00535 F:0.00709
42 ROUGE-3 Eval D0711-B.M.100.C-C.42 R:0.00685 P:0.00357 F:0.00469
42 ROUGE-3 Eval D0711-B.M.100.C-F.42 R:0.01038 P:0.00535 F:0.00706
42 ROUGE-3 Eval D0711-C.M.100.C-A.42 R:0.01010 P:0.00549 F:0.00711
42 ROUGE-3 Eval D0711-C.M.100.C-B.42 R:0.01045 P:0.00549 F:0.00720
42 ROUGE-3 Eval D0711-C.M.100.C-C.42 R:0.00690 P:0.00366 F:0.00478
42 ROUGE-3 Eval D0711-C.M.100.C-F.42 R:0.00345 P:0.00183 F:0.00239
42 ROUGE-3 Eval D0716-A.M.100.D-C.42 R:0.12375 P:0.06852 F:0.08820
42 ROUGE-3 Eval D0716-A.M.100.D-D.42 R:0.14626 P:0.07963 F:0.10312
42 ROUGE-3 Eval D0716-A.M.100.D-E.42 R:0.10508 P:0.05741 F:0.07425
42 ROUGE-3 Eval D0716-A.M.100.D-F.42 R:0.11111 P:0.06111 F:0.07885
42 ROUGE-3 Eval D0716-B.M.100.D-C.42 R:0.03356 P:0.01927 F:0.02448
42 ROUGE-3 Eval D0716-B.M.100.D-D.42 R:0.03082 P:0.01734 F:0.02219
42 ROUGE-3 Eval D0716-B.M.100.D-E.42 R:0.02373 P:0.01349 F:0.01720
42 ROUGE-3 Eval D0716-B.M.100.D-F.42 R:0.04422 P:0.02505 F:0.03198
42 ROUGE-3 Eval D0716-C.M.100.D-C.42 R:0.03987 P:0.02339 F:0.02948
42 ROUGE-3 Eval D0716-C.M.100.D-D.42 R:0.02048 P:0.01170 F:0.01489
42 ROUGE-3 Eval D0716-C.M.100.D-E.42 R:0.04714 P:0.02729 F:0.03457
42 ROUGE-3 Eval D0716-C.M.100.D-F.42 R:0.04422 P:0.02534 F:0.03222
42 ROUGE-3 Eval D0721-A.M.100.E-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0721-A.M.100.E-C.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0721-A.M.100.E-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0721-A.M.100.E-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0721-B.M.100.E-B.42 R:0.00997 P:0.00495 F:0.00662
42 ROUGE-3 Eval D0721-B.M.100.E-C.42 R:0.00974 P:0.00495 F:0.00656
42 ROUGE-3 Eval D0721-B.M.100.E-E.42 R:0.00669 P:0.00330 F:0.00442
42 ROUGE-3 Eval D0721-B.M.100.E-G.42 R:0.00329 P:0.00165 F:0.00220
42 ROUGE-3 Eval D0721-C.M.100.E-B.42 R:0.03344 P:0.01852 F:0.02384
42 ROUGE-3 Eval D0721-C.M.100.E-C.42 R:0.02357 P:0.01296 F:0.01672
42 ROUGE-3 Eval D0721-C.M.100.E-E.42 R:0.03401 P:0.01852 F:0.02398
42 ROUGE-3 Eval D0721-C.M.100.E-G.42 R:0.00997 P:0.00556 F:0.00714
42 ROUGE-3 Eval D0726-A.M.100.F-A.42 R:0.02712 P:0.01533 F:0.01959
42 ROUGE-3 Eval D0726-A.M.100.F-E.42 R:0.04082 P:0.02299 F:0.02941
42 ROUGE-3 Eval D0726-A.M.100.F-F.42 R:0.04068 P:0.02299 F:0.02938
42 ROUGE-3 Eval D0726-A.M.100.F-G.42 R:0.03390 P:0.01916 F:0.02448
42 ROUGE-3 Eval D0726-B.M.100.F-A.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0726-B.M.100.F-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0726-B.M.100.F-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0726-B.M.100.F-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0726-C.M.100.F-A.42 R:0.00340 P:0.00152 F:0.00210
42 ROUGE-3 Eval D0726-C.M.100.F-E.42 R:0.00344 P:0.00152 F:0.00211
42 ROUGE-3 Eval D0726-C.M.100.F-F.42 R:0.00692 P:0.00303 F:0.00421
42 ROUGE-3 Eval D0726-C.M.100.F-G.42 R:0.00669 P:0.00303 F:0.00417
42 ROUGE-3 Eval D0727-A.M.100.G-A.42 R:0.01017 P:0.00510 F:0.00679
42 ROUGE-3 Eval D0727-A.M.100.G-F.42 R:0.02685 P:0.01361 F:0.01806
42 ROUGE-3 Eval D0727-A.M.100.G-G.42 R:0.02667 P:0.01361 F:0.01802
42 ROUGE-3 Eval D0727-A.M.100.G-H.42 R:0.02685 P:0.01361 F:0.01806
42 ROUGE-3 Eval D0727-B.M.100.G-A.42 R:0.01053 P:0.00515 F:0.00692
42 ROUGE-3 Eval D0727-B.M.100.G-F.42 R:0.00662 P:0.00344 F:0.00453
42 ROUGE-3 Eval D0727-B.M.100.G-G.42 R:0.01060 P:0.00515 F:0.00693
42 ROUGE-3 Eval D0727-B.M.100.G-H.42 R:0.01404 P:0.00687 F:0.00923
42 ROUGE-3 Eval D0727-C.M.100.G-A.42 R:0.01329 P:0.00617 F:0.00843
42 ROUGE-3 Eval D0727-C.M.100.G-F.42 R:0.00687 P:0.00309 F:0.00426
42 ROUGE-3 Eval D0727-C.M.100.G-G.42 R:0.01347 P:0.00617 F:0.00846
42 ROUGE-3 Eval D0727-C.M.100.G-H.42 R:0.00690 P:0.00309 F:0.00427
42 ROUGE-3 Eval D0736-A.M.100.H-G.42 R:0.01465 P:0.00580 F:0.00831
42 ROUGE-3 Eval D0736-A.M.100.H-H.42 R:0.01493 P:0.00580 F:0.00835
42 ROUGE-3 Eval D0736-A.M.100.H-I.42 R:0.00727 P:0.00290 F:0.00415
42 ROUGE-3 Eval D0736-A.M.100.H-J.42 R:0.00667 P:0.00290 F:0.00404
42 ROUGE-3 Eval D0736-B.M.100.H-G.42 R:0.00781 P:0.00316 F:0.00450
42 ROUGE-3 Eval D0736-B.M.100.H-H.42 R:0.00847 P:0.00316 F:0.00460
42 ROUGE-3 Eval D0736-B.M.100.H-I.42 R:0.00429 P:0.00158 F:0.00231
42 ROUGE-3 Eval D0736-B.M.100.H-J.42 R:0.00357 P:0.00158 F:0.00219
42 ROUGE-3 Eval D0736-C.M.100.H-G.42 R:0.01732 P:0.00673 F:0.00969
42 ROUGE-3 Eval D0736-C.M.100.H-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0736-C.M.100.H-I.42 R:0.02210 P:0.00673 F:0.01032
42 ROUGE-3 Eval D0736-C.M.100.H-J.42 R:0.01544 P:0.00673 F:0.00937
42 ROUGE-3 Eval D0740-A.M.100.I-D.42 R:0.04040 P:0.02030 F:0.02702
42 ROUGE-3 Eval D0740-A.M.100.I-H.42 R:0.05000 P:0.02538 F:0.03367
42 ROUGE-3 Eval D0740-A.M.100.I-I.42 R:0.04967 P:0.02538 F:0.03359
42 ROUGE-3 Eval D0740-A.M.100.I-J.42 R:0.02961 P:0.01523 F:0.02011
42 ROUGE-3 Eval D0740-B.M.100.I-D.42 R:0.02980 P:0.01765 F:0.02217
42 ROUGE-3 Eval D0740-B.M.100.I-H.42 R:0.02027 P:0.01176 F:0.01488
42 ROUGE-3 Eval D0740-B.M.100.I-I.42 R:0.02007 P:0.01176 F:0.01483
42 ROUGE-3 Eval D0740-B.M.100.I-J.42 R:0.02970 P:0.01765 F:0.02214
42 ROUGE-3 Eval D0740-C.M.100.I-D.42 R:0.05212 P:0.02852 F:0.03687
42 ROUGE-3 Eval D0740-C.M.100.I-H.42 R:0.01967 P:0.01070 F:0.01386
42 ROUGE-3 Eval D0740-C.M.100.I-I.42 R:0.04235 P:0.02317 F:0.02995
42 ROUGE-3 Eval D0740-C.M.100.I-J.42 R:0.04221 P:0.02317 F:0.02992
42 ROUGE-3 Eval D0743-A.M.100.J-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0743-A.M.100.J-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0743-A.M.100.J-I.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0743-A.M.100.J-J.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-3 Eval D0743-B.M.100.J-B.42 R:0.00980 P:0.00588 F:0.00735
42 ROUGE-3 Eval D0743-B.M.100.J-H.42 R:0.00322 P:0.00196 F:0.00244
42 ROUGE-3 Eval D0743-B.M.100.J-I.42 R:0.00645 P:0.00392 F:0.00488
42 ROUGE-3 Eval D0743-B.M.100.J-J.42 R:0.00952 P:0.00588 F:0.00727
42 ROUGE-3 Eval D0743-C.M.100.J-B.42 R:0.00647 P:0.00345 F:0.00450
42 ROUGE-3 Eval D0743-C.M.100.J-H.42 R:0.00649 P:0.00345 F:0.00451
42 ROUGE-3 Eval D0743-C.M.100.J-I.42 R:0.00651 P:0.00345 F:0.00451
42 ROUGE-3 Eval D0743-C.M.100.J-J.42 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
42 ROUGE-4 Average_R: 0.01019 (95%-conf.int. 0.00744 - 0.01333)
42 ROUGE-4 Average_P: 0.00559 (95%-conf.int. 0.00406 - 0.00737)
42 ROUGE-4 Average_F: 0.00721 (95%-conf.int. 0.00525 - 0.00947)
.............................................
42 ROUGE-4 Eval D0703-A.M.100.A-A.42 R:0.02439 P:0.01389 F:0.01770
42 ROUGE-4 Eval D0703-A.M.100.A-C.42 R:0.01038 P:0.00595 F:0.00756
42 ROUGE-4 Eval D0703-A.M.100.A-D.42 R:0.02482 P:0.01389 F:0.01781
42 ROUGE-4 Eval D0703-A.M.100.A-J.42 R:0.02456 P:0.01389 F:0.01774
42 ROUGE-4 Eval D0703-B.M.100.A-A.42 R:0.02357 P:0.01373 F:0.01735
42 ROUGE-4 Eval D0703-B.M.100.A-C.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0703-B.M.100.A-D.42 R:0.02422 P:0.01373 F:0.01753
42 ROUGE-4 Eval D0703-B.M.100.A-J.42 R:0.02397 P:0.01373 F:0.01746
42 ROUGE-4 Eval D0703-C.M.100.A-A.42 R:0.00344 P:0.00227 F:0.00274
42 ROUGE-4 Eval D0703-C.M.100.A-C.42 R:0.00334 P:0.00227 F:0.00270
42 ROUGE-4 Eval D0703-C.M.100.A-D.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0703-C.M.100.A-J.42 R:0.00341 P:0.00227 F:0.00273
42 ROUGE-4 Eval D0706-A.M.100.B-B.42 R:0.00334 P:0.00172 F:0.00227
42 ROUGE-4 Eval D0706-A.M.100.B-D.42 R:0.00673 P:0.00344 F:0.00455
42 ROUGE-4 Eval D0706-A.M.100.B-E.42 R:0.00334 P:0.00172 F:0.00227
42 ROUGE-4 Eval D0706-A.M.100.B-I.42 R:0.00669 P:0.00344 F:0.00454
42 ROUGE-4 Eval D0706-B.M.100.B-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0706-B.M.100.B-D.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0706-B.M.100.B-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0706-B.M.100.B-I.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0706-C.M.100.B-B.42 R:0.05648 P:0.03373 F:0.04224
42 ROUGE-4 Eval D0706-C.M.100.B-D.42 R:0.05648 P:0.03373 F:0.04224
42 ROUGE-4 Eval D0706-C.M.100.B-E.42 R:0.01650 P:0.00992 F:0.01239
42 ROUGE-4 Eval D0706-C.M.100.B-I.42 R:0.03947 P:0.02381 F:0.02970
42 ROUGE-4 Eval D0711-A.M.100.C-A.42 R:0.00339 P:0.00190 F:0.00244
42 ROUGE-4 Eval D0711-A.M.100.C-B.42 R:0.00344 P:0.00190 F:0.00245
42 ROUGE-4 Eval D0711-A.M.100.C-C.42 R:0.00344 P:0.00190 F:0.00245
42 ROUGE-4 Eval D0711-A.M.100.C-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0711-B.M.100.C-A.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0711-B.M.100.C-B.42 R:0.00353 P:0.00179 F:0.00238
42 ROUGE-4 Eval D0711-B.M.100.C-C.42 R:0.00346 P:0.00179 F:0.00236
42 ROUGE-4 Eval D0711-B.M.100.C-F.42 R:0.00350 P:0.00179 F:0.00237
42 ROUGE-4 Eval D0711-C.M.100.C-A.42 R:0.00340 P:0.00184 F:0.00239
42 ROUGE-4 Eval D0711-C.M.100.C-B.42 R:0.00352 P:0.00184 F:0.00242
42 ROUGE-4 Eval D0711-C.M.100.C-C.42 R:0.00348 P:0.00184 F:0.00241
42 ROUGE-4 Eval D0711-C.M.100.C-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0716-A.M.100.D-C.42 R:0.07770 P:0.04283 F:0.05522
42 ROUGE-4 Eval D0716-A.M.100.D-D.42 R:0.09966 P:0.05400 F:0.07005
42 ROUGE-4 Eval D0716-A.M.100.D-E.42 R:0.06849 P:0.03724 F:0.04825
42 ROUGE-4 Eval D0716-A.M.100.D-F.42 R:0.06122 P:0.03352 F:0.04332
42 ROUGE-4 Eval D0716-B.M.100.D-C.42 R:0.01356 P:0.00775 F:0.00986
42 ROUGE-4 Eval D0716-B.M.100.D-D.42 R:0.01384 P:0.00775 F:0.00994
42 ROUGE-4 Eval D0716-B.M.100.D-E.42 R:0.00685 P:0.00388 F:0.00495
42 ROUGE-4 Eval D0716-B.M.100.D-F.42 R:0.01718 P:0.00969 F:0.01239
42 ROUGE-4 Eval D0716-C.M.100.D-C.42 R:0.01678 P:0.00980 F:0.01237
42 ROUGE-4 Eval D0716-C.M.100.D-D.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0716-C.M.100.D-E.42 R:0.01701 P:0.00980 F:0.01244
42 ROUGE-4 Eval D0716-C.M.100.D-F.42 R:0.01718 P:0.00980 F:0.01248
42 ROUGE-4 Eval D0721-A.M.100.E-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-A.M.100.E-C.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-A.M.100.E-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-A.M.100.E-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-B.M.100.E-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-B.M.100.E-C.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-B.M.100.E-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-B.M.100.E-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0721-C.M.100.E-B.42 R:0.01689 P:0.00931 F:0.01200
42 ROUGE-4 Eval D0721-C.M.100.E-C.42 R:0.01361 P:0.00745 F:0.00963
42 ROUGE-4 Eval D0721-C.M.100.E-E.42 R:0.01718 P:0.00931 F:0.01208
42 ROUGE-4 Eval D0721-C.M.100.E-G.42 R:0.00336 P:0.00186 F:0.00239
42 ROUGE-4 Eval D0726-A.M.100.F-A.42 R:0.01027 P:0.00578 F:0.00740
42 ROUGE-4 Eval D0726-A.M.100.F-E.42 R:0.01031 P:0.00578 F:0.00741
42 ROUGE-4 Eval D0726-A.M.100.F-F.42 R:0.01027 P:0.00578 F:0.00740
42 ROUGE-4 Eval D0726-A.M.100.F-G.42 R:0.01027 P:0.00578 F:0.00740
42 ROUGE-4 Eval D0726-B.M.100.F-A.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-B.M.100.F-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-B.M.100.F-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-B.M.100.F-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-C.M.100.F-A.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-C.M.100.F-E.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-C.M.100.F-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0726-C.M.100.F-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0727-A.M.100.G-A.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0727-A.M.100.G-F.42 R:0.00678 P:0.00342 F:0.00455
42 ROUGE-4 Eval D0727-A.M.100.G-G.42 R:0.00673 P:0.00342 F:0.00454
42 ROUGE-4 Eval D0727-A.M.100.G-H.42 R:0.00678 P:0.00342 F:0.00455
42 ROUGE-4 Eval D0727-B.M.100.G-A.42 R:0.00355 P:0.00173 F:0.00233
42 ROUGE-4 Eval D0727-B.M.100.G-F.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0727-B.M.100.G-G.42 R:0.00357 P:0.00173 F:0.00233
42 ROUGE-4 Eval D0727-B.M.100.G-H.42 R:0.00355 P:0.00173 F:0.00233
42 ROUGE-4 Eval D0727-C.M.100.G-A.42 R:0.00336 P:0.00155 F:0.00212
42 ROUGE-4 Eval D0727-C.M.100.G-F.42 R:0.00347 P:0.00155 F:0.00214
42 ROUGE-4 Eval D0727-C.M.100.G-G.42 R:0.00340 P:0.00155 F:0.00213
42 ROUGE-4 Eval D0727-C.M.100.G-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-A.M.100.H-G.42 R:0.00741 P:0.00291 F:0.00418
42 ROUGE-4 Eval D0736-A.M.100.H-H.42 R:0.00755 P:0.00291 F:0.00420
42 ROUGE-4 Eval D0736-A.M.100.H-I.42 R:0.00368 P:0.00146 F:0.00209
42 ROUGE-4 Eval D0736-A.M.100.H-J.42 R:0.00337 P:0.00146 F:0.00204
42 ROUGE-4 Eval D0736-B.M.100.H-G.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-B.M.100.H-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-B.M.100.H-I.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-B.M.100.H-J.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-C.M.100.H-G.42 R:0.00877 P:0.00338 F:0.00488
42 ROUGE-4 Eval D0736-C.M.100.H-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0736-C.M.100.H-I.42 R:0.01124 P:0.00338 F:0.00520
42 ROUGE-4 Eval D0736-C.M.100.H-J.42 R:0.00781 P:0.00338 F:0.00472
42 ROUGE-4 Eval D0740-A.M.100.I-D.42 R:0.02041 P:0.01020 F:0.01360
42 ROUGE-4 Eval D0740-A.M.100.I-H.42 R:0.03367 P:0.01701 F:0.02260
42 ROUGE-4 Eval D0740-A.M.100.I-I.42 R:0.03010 P:0.01531 F:0.02030
42 ROUGE-4 Eval D0740-A.M.100.I-J.42 R:0.01661 P:0.00850 F:0.01125
42 ROUGE-4 Eval D0740-B.M.100.I-D.42 R:0.01338 P:0.00789 F:0.00993
42 ROUGE-4 Eval D0740-B.M.100.I-H.42 R:0.00683 P:0.00394 F:0.00500
42 ROUGE-4 Eval D0740-B.M.100.I-I.42 R:0.00676 P:0.00394 F:0.00498
42 ROUGE-4 Eval D0740-B.M.100.I-J.42 R:0.01333 P:0.00789 F:0.00991
42 ROUGE-4 Eval D0740-C.M.100.I-D.42 R:0.02961 P:0.01613 F:0.02088
42 ROUGE-4 Eval D0740-C.M.100.I-H.42 R:0.00993 P:0.00538 F:0.00698
42 ROUGE-4 Eval D0740-C.M.100.I-I.42 R:0.02632 P:0.01434 F:0.01857
42 ROUGE-4 Eval D0740-C.M.100.I-J.42 R:0.02295 P:0.01254 F:0.01622
42 ROUGE-4 Eval D0743-A.M.100.J-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-A.M.100.J-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-A.M.100.J-I.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-A.M.100.J-J.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-B.M.100.J-B.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-B.M.100.J-H.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-B.M.100.J-I.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-B.M.100.J-J.42 R:0.00000 P:0.00000 F:0.00000
42 ROUGE-4 Eval D0743-C.M.100.J-B.42 R:0.00327 P:0.00174 F:0.00227
42 ROUGE-4 Eval D0743-C.M.100.J-H.42 R:0.00328 P:0.00174 F:0.00227
42 ROUGE-4 Eval D0743-C.M.100.J-I.42 R:0.00329 P:0.00174 F:0.00228
42 ROUGE-4 Eval D0743-C.M.100.J-J.42 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
42 ROUGE-L Average_R: 0.30640 (95%-conf.int. 0.29659 - 0.31542)
42 ROUGE-L Average_P: 0.16367 (95%-conf.int. 0.15702 - 0.17000)
42 ROUGE-L Average_F: 0.21263 (95%-conf.int. 0.20476 - 0.21980)
.............................................
42 ROUGE-L Eval D0703-A.M.100.A-A.42 R:0.33784 P:0.19493 F:0.24722
42 ROUGE-L Eval D0703-A.M.100.A-C.42 R:0.30201 P:0.17544 F:0.22195
42 ROUGE-L Eval D0703-A.M.100.A-D.42 R:0.31959 P:0.18129 F:0.23135
42 ROUGE-L Eval D0703-A.M.100.A-J.42 R:0.34354 P:0.19688 F:0.25031
42 ROUGE-L Eval D0703-B.M.100.A-A.42 R:0.33333 P:0.19653 F:0.24727
42 ROUGE-L Eval D0703-B.M.100.A-C.42 R:0.32215 P:0.18497 F:0.23501
42 ROUGE-L Eval D0703-B.M.100.A-D.42 R:0.32215 P:0.18497 F:0.23501
42 ROUGE-L Eval D0703-B.M.100.A-J.42 R:0.35880 P:0.20809 F:0.26341
42 ROUGE-L Eval D0703-C.M.100.A-A.42 R:0.31333 P:0.20889 F:0.25067
42 ROUGE-L Eval D0703-C.M.100.A-C.42 R:0.30844 P:0.21111 F:0.25066
42 ROUGE-L Eval D0703-C.M.100.A-D.42 R:0.30132 P:0.20222 F:0.24202
42 ROUGE-L Eval D0703-C.M.100.A-J.42 R:0.32450 P:0.21778 F:0.26064
42 ROUGE-L Eval D0706-A.M.100.B-B.42 R:0.34416 P:0.17936 F:0.23582
42 ROUGE-L Eval D0706-A.M.100.B-D.42 R:0.31699 P:0.16413 F:0.21628
42 ROUGE-L Eval D0706-A.M.100.B-E.42 R:0.31169 P:0.16244 F:0.21357
42 ROUGE-L Eval D0706-A.M.100.B-I.42 R:0.31494 P:0.16413 F:0.21580
42 ROUGE-L Eval D0706-B.M.100.B-B.42 R:0.28431 P:0.15104 F:0.19728
42 ROUGE-L Eval D0706-B.M.100.B-D.42 R:0.25733 P:0.13715 F:0.17893
42 ROUGE-L Eval D0706-B.M.100.B-E.42 R:0.28247 P:0.15104 F:0.19683
42 ROUGE-L Eval D0706-B.M.100.B-I.42 R:0.29773 P:0.15972 F:0.20791
42 ROUGE-L Eval D0706-C.M.100.B-B.42 R:0.37419 P:0.22612 F:0.28189
42 ROUGE-L Eval D0706-C.M.100.B-D.42 R:0.37097 P:0.22417 F:0.27946
42 ROUGE-L Eval D0706-C.M.100.B-E.42 R:0.32051 P:0.19493 F:0.24242
42 ROUGE-L Eval D0706-C.M.100.B-I.42 R:0.33227 P:0.20273 F:0.25182
42 ROUGE-L Eval D0711-A.M.100.C-A.42 R:0.36842 P:0.20974 F:0.26730
42 ROUGE-L Eval D0711-A.M.100.C-B.42 R:0.38333 P:0.21536 F:0.27578
42 ROUGE-L Eval D0711-A.M.100.C-C.42 R:0.34667 P:0.19476 F:0.24940
42 ROUGE-L Eval D0711-A.M.100.C-F.42 R:0.36424 P:0.20599 F:0.26316
42 ROUGE-L Eval D0711-B.M.100.C-A.42 R:0.30612 P:0.15873 F:0.20906
42 ROUGE-L Eval D0711-B.M.100.C-B.42 R:0.31849 P:0.16402 F:0.21653
42 ROUGE-L Eval D0711-B.M.100.C-C.42 R:0.32215 P:0.16931 F:0.22196
42 ROUGE-L Eval D0711-B.M.100.C-F.42 R:0.32542 P:0.16931 F:0.22274
42 ROUGE-L Eval D0711-C.M.100.C-A.42 R:0.32343 P:0.17754 F:0.22924
42 ROUGE-L Eval D0711-C.M.100.C-B.42 R:0.33106 P:0.17572 F:0.22958
42 ROUGE-L Eval D0711-C.M.100.C-C.42 R:0.32095 P:0.17210 F:0.22406
42 ROUGE-L Eval D0711-C.M.100.C-F.42 R:0.29730 P:0.15942 F:0.20755
42 ROUGE-L Eval D0716-A.M.100.D-C.42 R:0.43934 P:0.24542 F:0.31492
42 ROUGE-L Eval D0716-A.M.100.D-D.42 R:0.47000 P:0.25824 F:0.33333
42 ROUGE-L Eval D0716-A.M.100.D-E.42 R:0.43522 P:0.23993 F:0.30933
42 ROUGE-L Eval D0716-A.M.100.D-F.42 R:0.43234 P:0.23993 F:0.30860
42 ROUGE-L Eval D0716-B.M.100.D-C.42 R:0.37171 P:0.21524 F:0.27262
42 ROUGE-L Eval D0716-B.M.100.D-D.42 R:0.38926 P:0.22095 F:0.28189
42 ROUGE-L Eval D0716-B.M.100.D-E.42 R:0.35548 P:0.20381 F:0.25908
42 ROUGE-L Eval D0716-B.M.100.D-F.42 R:0.38000 P:0.21714 F:0.27636
42 ROUGE-L Eval D0716-C.M.100.D-C.42 R:0.31596 P:0.18690 F:0.23487
42 ROUGE-L Eval D0716-C.M.100.D-D.42 R:0.30769 P:0.17726 F:0.22494
42 ROUGE-L Eval D0716-C.M.100.D-E.42 R:0.33003 P:0.19268 F:0.24331
42 ROUGE-L Eval D0716-C.M.100.D-F.42 R:0.31667 P:0.18304 F:0.23199
42 ROUGE-L Eval D0721-A.M.100.E-B.42 R:0.26667 P:0.12882 F:0.17372
42 ROUGE-L Eval D0721-A.M.100.E-C.42 R:0.25325 P:0.12560 F:0.16792
42 ROUGE-L Eval D0721-A.M.100.E-E.42 R:0.23377 P:0.11594 F:0.15500
42 ROUGE-L Eval D0721-A.M.100.E-G.42 R:0.25159 P:0.12721 F:0.16898
42 ROUGE-L Eval D0721-B.M.100.E-B.42 R:0.27036 P:0.13562 F:0.18063
42 ROUGE-L Eval D0721-B.M.100.E-C.42 R:0.27389 P:0.14052 F:0.18574
42 ROUGE-L Eval D0721-B.M.100.E-E.42 R:0.24262 P:0.12092 F:0.16140
42 ROUGE-L Eval D0721-B.M.100.E-G.42 R:0.23226 P:0.11765 F:0.15619
42 ROUGE-L Eval D0721-C.M.100.E-B.42 R:0.32459 P:0.18132 F:0.23267
42 ROUGE-L Eval D0721-C.M.100.E-C.42 R:0.26073 P:0.14469 F:0.18610
42 ROUGE-L Eval D0721-C.M.100.E-E.42 R:0.30333 P:0.16667 F:0.21513
42 ROUGE-L Eval D0721-C.M.100.E-G.42 R:0.25733 P:0.14469 F:0.18523
42 ROUGE-L Eval D0726-A.M.100.F-A.42 R:0.33555 P:0.19129 F:0.24367
42 ROUGE-L Eval D0726-A.M.100.F-E.42 R:0.34333 P:0.19508 F:0.24879
42 ROUGE-L Eval D0726-A.M.100.F-F.42 R:0.35880 P:0.20455 F:0.26056
42 ROUGE-L Eval D0726-A.M.100.F-G.42 R:0.33887 P:0.19318 F:0.24608
42 ROUGE-L Eval D0726-B.M.100.F-A.42 R:0.26471 P:0.14674 F:0.18881
42 ROUGE-L Eval D0726-B.M.100.F-E.42 R:0.26246 P:0.14312 F:0.18523
42 ROUGE-L Eval D0726-B.M.100.F-F.42 R:0.25581 P:0.13949 F:0.18054
42 ROUGE-L Eval D0726-B.M.100.F-G.42 R:0.26645 P:0.14674 F:0.18925
42 ROUGE-L Eval D0726-C.M.100.F-A.42 R:0.23000 P:0.10360 F:0.14285
42 ROUGE-L Eval D0726-C.M.100.F-E.42 R:0.24242 P:0.10811 F:0.14953
42 ROUGE-L Eval D0726-C.M.100.F-F.42 R:0.25085 P:0.11111 F:0.15401
42 ROUGE-L Eval D0726-C.M.100.F-G.42 R:0.23934 P:0.10961 F:0.15036
42 ROUGE-L Eval D0727-A.M.100.G-A.42 R:0.35548 P:0.18013 F:0.23910
42 ROUGE-L Eval D0727-A.M.100.G-F.42 R:0.34539 P:0.17677 F:0.23385
42 ROUGE-L Eval D0727-A.M.100.G-G.42 R:0.35294 P:0.18182 F:0.24000
42 ROUGE-L Eval D0727-A.M.100.G-H.42 R:0.36842 P:0.18855 F:0.24944
42 ROUGE-L Eval D0727-B.M.100.G-A.42 R:0.28179 P:0.13946 F:0.18658
42 ROUGE-L Eval D0727-B.M.100.G-F.42 R:0.27597 P:0.14456 F:0.18973
42 ROUGE-L Eval D0727-B.M.100.G-G.42 R:0.27682 P:0.13605 F:0.18244
42 ROUGE-L Eval D0727-B.M.100.G-H.42 R:0.26460 P:0.13095 F:0.17520
42 ROUGE-L Eval D0727-C.M.100.G-A.42 R:0.36482 P:0.17125 F:0.23309
42 ROUGE-L Eval D0727-C.M.100.G-F.42 R:0.37037 P:0.16820 F:0.23134
42 ROUGE-L Eval D0727-C.M.100.G-G.42 R:0.36304 P:0.16820 F:0.22989
42 ROUGE-L Eval D0727-C.M.100.G-H.42 R:0.37838 P:0.17125 F:0.23579
42 ROUGE-L Eval D0736-A.M.100.H-G.42 R:0.27240 P:0.10920 F:0.15590
42 ROUGE-L Eval D0736-A.M.100.H-H.42 R:0.27737 P:0.10920 F:0.15671
42 ROUGE-L Eval D0736-A.M.100.H-I.42 R:0.27046 P:0.10920 F:0.15558
42 ROUGE-L Eval D0736-A.M.100.H-J.42 R:0.27451 P:0.12069 F:0.16767
42 ROUGE-L Eval D0736-B.M.100.H-G.42 R:0.24809 P:0.10172 F:0.14428
42 ROUGE-L Eval D0736-B.M.100.H-H.42 R:0.27686 P:0.10485 F:0.15210
42 ROUGE-L Eval D0736-B.M.100.H-I.42 R:0.26778 P:0.10016 F:0.14579
42 ROUGE-L Eval D0736-B.M.100.H-J.42 R:0.25874 P:0.11581 F:0.16000
42 ROUGE-L Eval D0736-C.M.100.H-G.42 R:0.29114 P:0.11500 F:0.16487
42 ROUGE-L Eval D0736-C.M.100.H-H.42 R:0.25134 P:0.07833 F:0.11944
42 ROUGE-L Eval D0736-C.M.100.H-I.42 R:0.30481 P:0.09500 F:0.14485
42 ROUGE-L Eval D0736-C.M.100.H-J.42 R:0.27547 P:0.12167 F:0.16879
42 ROUGE-L Eval D0740-A.M.100.I-D.42 R:0.37954 P:0.19263 F:0.25556
42 ROUGE-L Eval D0740-A.M.100.I-H.42 R:0.34641 P:0.17755 F:0.23477
42 ROUGE-L Eval D0740-A.M.100.I-I.42 R:0.36039 P:0.18593 F:0.24530
42 ROUGE-L Eval D0740-A.M.100.I-J.42 R:0.35161 P:0.18258 F:0.24035
42 ROUGE-L Eval D0740-B.M.100.I-D.42 R:0.29870 P:0.17829 F:0.22330
42 ROUGE-L Eval D0740-B.M.100.I-H.42 R:0.25828 P:0.15116 F:0.19071
42 ROUGE-L Eval D0740-B.M.100.I-I.42 R:0.29180 P:0.17248 F:0.21681
42 ROUGE-L Eval D0740-B.M.100.I-J.42 R:0.28803 P:0.17248 F:0.21576
42 ROUGE-L Eval D0740-C.M.100.I-D.42 R:0.35783 P:0.19753 F:0.25455
42 ROUGE-L Eval D0740-C.M.100.I-H.42 R:0.32154 P:0.17637 F:0.22779
42 ROUGE-L Eval D0740-C.M.100.I-I.42 R:0.35463 P:0.19577 F:0.25227
42 ROUGE-L Eval D0740-C.M.100.I-J.42 R:0.34713 P:0.19224 F:0.24745
42 ROUGE-L Eval D0743-A.M.100.J-B.42 R:0.24762 P:0.12621 F:0.16720
42 ROUGE-L Eval D0743-A.M.100.J-H.42 R:0.24074 P:0.12621 F:0.16560
42 ROUGE-L Eval D0743-A.M.100.J-I.42 R:0.25625 P:0.13269 F:0.17484
42 ROUGE-L Eval D0743-A.M.100.J-J.42 R:0.22769 P:0.11974 F:0.15694
42 ROUGE-L Eval D0743-B.M.100.J-B.42 R:0.21474 P:0.12984 F:0.16183
42 ROUGE-L Eval D0743-B.M.100.J-H.42 R:0.19558 P:0.12016 F:0.14886
42 ROUGE-L Eval D0743-B.M.100.J-I.42 R:0.23734 P:0.14535 F:0.18029
42 ROUGE-L Eval D0743-B.M.100.J-J.42 R:0.21495 P:0.13372 F:0.16487
42 ROUGE-L Eval D0743-C.M.100.J-B.42 R:0.24127 P:0.12991 F:0.16889
42 ROUGE-L Eval D0743-C.M.100.J-H.42 R:0.22293 P:0.11966 F:0.15573
42 ROUGE-L Eval D0743-C.M.100.J-I.42 R:0.23323 P:0.12479 F:0.16259
42 ROUGE-L Eval D0743-C.M.100.J-J.42 R:0.18868 P:0.10256 F:0.13289
---------------------------------------------
42 ROUGE-W-1.2 Average_R: 0.10578 (95%-conf.int. 0.10257 - 0.10893)
42 ROUGE-W-1.2 Average_P: 0.10253 (95%-conf.int. 0.09827 - 0.10665)
42 ROUGE-W-1.2 Average_F: 0.10370 (95%-conf.int. 0.10000 - 0.10715)
.............................................
42 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.42 R:0.09743 P:0.10123 F:0.09929
42 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.42 R:0.10463 P:0.11047 F:0.10747
42 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.42 R:0.09916 P:0.10370 F:0.10138
42 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.42 R:0.10663 P:0.10453 F:0.10557
42 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.42 R:0.11325 P:0.12380 F:0.11829
42 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.42 R:0.10571 P:0.11486 F:0.11010
42 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.42 R:0.10940 P:0.11782 F:0.11345
42 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.42 R:0.12375 P:0.13311 F:0.12826
42 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.42 R:0.10386 P:0.12874 F:0.11497
42 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.42 R:0.09996 P:0.12917 F:0.11270
42 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.42 R:0.09576 P:0.12198 F:0.10729
42 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.42 R:0.11182 P:0.13516 F:0.12239
42 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.42 R:0.12122 P:0.11337 F:0.11716
42 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.42 R:0.11114 P:0.10560 F:0.10830
42 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.42 R:0.10955 P:0.10353 F:0.10645
42 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.42 R:0.11116 P:0.10735 F:0.10922
42 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.42 R:0.09864 P:0.09075 F:0.09453
42 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.42 R:0.08805 P:0.08276 F:0.08532
42 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.42 R:0.09569 P:0.09031 F:0.09292
42 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.42 R:0.09802 P:0.09509 F:0.09653
42 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.42 R:0.13991 P:0.14430 F:0.14207
42 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.42 R:0.13850 P:0.14407 F:0.14123
42 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.42 R:0.11454 P:0.11801 F:0.11625
42 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.42 R:0.12274 P:0.13006 F:0.12629
42 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.42 R:0.12372 P:0.12698 F:0.12533
42 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.42 R:0.12955 P:0.13183 F:0.13068
42 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.42 R:0.11665 P:0.11769 F:0.11717
42 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.42 R:0.12145 P:0.12459 F:0.12300
42 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.42 R:0.10548 P:0.09758 F:0.10138
42 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.42 R:0.10608 P:0.10239 F:0.10420
42 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.42 R:0.10698 P:0.10562 F:0.10630
42 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.42 R:0.10845 P:0.10480 F:0.10659
42 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.42 R:0.10569 P:0.10846 F:0.10706
42 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.42 R:0.10782 P:0.10702 F:0.10742
42 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.42 R:0.10122 P:0.10306 F:0.10213
42 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.42 R:0.09573 P:0.09893 F:0.09730
42 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.42 R:0.16107 P:0.16438 F:0.16271
42 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.42 R:0.16674 P:0.17455 F:0.17056
42 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.42 R:0.15206 P:0.15654 F:0.15427
42 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.42 R:0.14851 P:0.15673 F:0.15251
42 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.42 R:0.12539 P:0.12665 F:0.12602
42 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.42 R:0.12680 P:0.12880 F:0.12779
42 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.42 R:0.12364 P:0.12619 F:0.12490
42 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.42 R:0.12855 P:0.13001 F:0.12928
42 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.42 R:0.10819 P:0.11928 F:0.11346
42 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.42 R:0.10095 P:0.11279 F:0.10654
42 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.42 R:0.10899 P:0.12332 F:0.11571
42 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.42 R:0.10358 P:0.11647 F:0.10965
42 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.42 R:0.09451 P:0.08026 F:0.08680
42 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.42 R:0.08830 P:0.07770 F:0.08266
42 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.42 R:0.08224 P:0.07328 F:0.07750
42 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.42 R:0.08919 P:0.07903 F:0.08380
42 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.42 R:0.09067 P:0.08792 F:0.08927
42 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.42 R:0.09344 P:0.09010 F:0.09174
42 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.42 R:0.07780 P:0.07610 F:0.07694
42 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.42 R:0.07564 P:0.07646 F:0.07605
42 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.42 R:0.11518 P:0.11842 F:0.11678
42 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.42 R:0.09222 P:0.09628 F:0.09421
42 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.42 R:0.10827 P:0.11103 F:0.10963
42 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.42 R:0.08980 P:0.09443 F:0.09206
42 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.42 R:0.11872 P:0.11993 F:0.11932
42 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.42 R:0.12377 P:0.12320 F:0.12348
42 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.42 R:0.12970 P:0.13170 F:0.13069
42 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.42 R:0.12160 P:0.12548 F:0.12351
42 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.42 R:0.09396 P:0.09162 F:0.09278
42 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.42 R:0.08992 P:0.08852 F:0.08921
42 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.42 R:0.08720 P:0.08639 F:0.08679
42 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.42 R:0.09038 P:0.08988 F:0.09013
42 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.42 R:0.08133 P:0.06433 F:0.07184
42 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.42 R:0.08708 P:0.06853 F:0.07670
42 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.42 R:0.08810 P:0.06988 F:0.07794
42 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.42 R:0.08507 P:0.06975 F:0.07665
42 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.42 R:0.12483 P:0.11134 F:0.11770
42 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.42 R:0.11933 P:0.11147 F:0.11527
42 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.42 R:0.12346 P:0.11264 F:0.11780
42 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.42 R:0.12874 P:0.11810 F:0.12319
42 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.42 R:0.10237 P:0.08889 F:0.09515
42 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.42 R:0.09486 P:0.08926 F:0.09197
42 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.42 R:0.09886 P:0.08703 F:0.09257
42 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.42 R:0.09432 P:0.08262 F:0.08808
42 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.42 R:0.12687 P:0.10711 F:0.11616
42 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.42 R:0.12656 P:0.10622 F:0.11550
42 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.42 R:0.12357 P:0.10538 F:0.11375
42 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.42 R:0.13226 P:0.10774 F:0.11875
42 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.42 R:0.09899 P:0.07027 F:0.08219
42 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.42 R:0.10212 P:0.07070 F:0.08355
42 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.42 R:0.09623 P:0.06942 F:0.08066
42 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.42 R:0.09627 P:0.07546 F:0.08460
42 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.42 R:0.08780 P:0.06663 F:0.07576
42 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.42 R:0.09484 P:0.06645 F:0.07815
42 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.42 R:0.09308 P:0.06430 F:0.07606
42 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.42 R:0.08697 P:0.07196 F:0.07876
42 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.42 R:0.09408 P:0.06750 F:0.07860
42 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.42 R:0.09415 P:0.05485 F:0.06932
42 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.42 R:0.09972 P:0.05669 F:0.07229
42 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.42 R:0.08853 P:0.06976 F:0.07803
42 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.42 R:0.13160 P:0.12286 F:0.12708
42 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.42 R:0.12223 P:0.11302 F:0.11744
42 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.42 R:0.12389 P:0.11822 F:0.12099
42 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.42 R:0.11873 P:0.11326 F:0.11593
42 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.42 R:0.10199 P:0.11185 F:0.10669
42 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.42 R:0.09145 P:0.09525 F:0.09331
42 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.42 R:0.09746 P:0.10824 F:0.10257
42 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.42 R:0.10208 P:0.10929 F:0.10556
42 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.42 R:0.12151 P:0.12945 F:0.12535
42 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.42 R:0.11195 P:0.11460 F:0.11326
42 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.42 R:0.11671 P:0.12600 F:0.12118
42 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.42 R:0.11742 P:0.12460 F:0.12090
42 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.42 R:0.08918 P:0.07924 F:0.08392
42 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.42 R:0.08651 P:0.07834 F:0.08222
42 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.42 R:0.08887 P:0.08165 F:0.08511
42 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.42 R:0.08276 P:0.07555 F:0.07899
42 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.42 R:0.08175 P:0.08278 F:0.08226
42 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.42 R:0.07692 P:0.07837 F:0.07764
42 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.42 R:0.08953 P:0.09240 F:0.09094
42 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.42 R:0.08491 P:0.08684 F:0.08586
42 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.42 R:0.08723 P:0.08222 F:0.08465
42 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.42 R:0.08442 P:0.07567 F:0.07981
42 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.42 R:0.08520 P:0.08123 F:0.08317
42 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.42 R:0.07179 P:0.06568 F:0.06860
---------------------------------------------
42 ROUGE-SU4 Average_R: 0.11496 (95%-conf.int. 0.10855 - 0.12188)
42 ROUGE-SU4 Average_P: 0.06118 (95%-conf.int. 0.05709 - 0.06538)
42 ROUGE-SU4 Average_F: 0.07960 (95%-conf.int. 0.07444 - 0.08486)
.............................................
42 ROUGE-SU4 Eval D0703-A.M.100.A-A.42 R:0.15278 P:0.08713 F:0.11097
42 ROUGE-SU4 Eval D0703-A.M.100.A-C.42 R:0.12874 P:0.07393 F:0.09392
42 ROUGE-SU4 Eval D0703-A.M.100.A-D.42 R:0.14841 P:0.08317 F:0.10660
42 ROUGE-SU4 Eval D0703-A.M.100.A-J.42 R:0.15618 P:0.08845 F:0.11294
42 ROUGE-SU4 Eval D0703-B.M.100.A-A.42 R:0.15101 P:0.08806 F:0.11125
42 ROUGE-SU4 Eval D0703-B.M.100.A-C.42 R:0.12701 P:0.07208 F:0.09197
42 ROUGE-SU4 Eval D0703-B.M.100.A-D.42 R:0.13966 P:0.07926 F:0.10113
42 ROUGE-SU4 Eval D0703-B.M.100.A-J.42 R:0.16610 P:0.09524 F:0.12106
42 ROUGE-SU4 Eval D0703-C.M.100.A-A.42 R:0.12329 P:0.08145 F:0.09809
42 ROUGE-SU4 Eval D0703-C.M.100.A-C.42 R:0.12333 P:0.08371 F:0.09973
42 ROUGE-SU4 Eval D0703-C.M.100.A-D.42 R:0.11905 P:0.07919 F:0.09511
42 ROUGE-SU4 Eval D0703-C.M.100.A-J.42 R:0.12415 P:0.08258 F:0.09919
42 ROUGE-SU4 Eval D0706-A.M.100.B-B.42 R:0.12667 P:0.06518 F:0.08607
42 ROUGE-SU4 Eval D0706-A.M.100.B-D.42 R:0.11689 P:0.05975 F:0.07908
42 ROUGE-SU4 Eval D0706-A.M.100.B-E.42 R:0.10944 P:0.05632 F:0.07437
42 ROUGE-SU4 Eval D0706-A.M.100.B-I.42 R:0.11611 P:0.05975 F:0.07890
42 ROUGE-SU4 Eval D0706-B.M.100.B-B.42 R:0.09284 P:0.04871 F:0.06390
42 ROUGE-SU4 Eval D0706-B.M.100.B-D.42 R:0.07971 P:0.04196 F:0.05498
42 ROUGE-SU4 Eval D0706-B.M.100.B-E.42 R:0.09056 P:0.04783 F:0.06260
42 ROUGE-SU4 Eval D0706-B.M.100.B-I.42 R:0.09745 P:0.05164 F:0.06751
42 ROUGE-SU4 Eval D0706-C.M.100.B-B.42 R:0.16722 P:0.10000 F:0.12516
42 ROUGE-SU4 Eval D0706-C.M.100.B-D.42 R:0.17550 P:0.10495 F:0.13135
42 ROUGE-SU4 Eval D0706-C.M.100.B-E.42 R:0.12993 P:0.07822 F:0.09765
42 ROUGE-SU4 Eval D0706-C.M.100.B-I.42 R:0.14590 P:0.08812 F:0.10988
42 ROUGE-SU4 Eval D0711-A.M.100.C-A.42 R:0.12950 P:0.07288 F:0.09327
42 ROUGE-SU4 Eval D0711-A.M.100.C-B.42 R:0.13813 P:0.07668 F:0.09862
42 ROUGE-SU4 Eval D0711-A.M.100.C-C.42 R:0.12329 P:0.06844 F:0.08802
42 ROUGE-SU4 Eval D0711-A.M.100.C-F.42 R:0.12868 P:0.07193 F:0.09228
42 ROUGE-SU4 Eval D0711-B.M.100.C-A.42 R:0.09149 P:0.04681 F:0.06193
42 ROUGE-SU4 Eval D0711-B.M.100.C-B.42 R:0.10857 P:0.05516 F:0.07315
42 ROUGE-SU4 Eval D0711-B.M.100.C-C.42 R:0.10977 P:0.05695 F:0.07499
42 ROUGE-SU4 Eval D0711-B.M.100.C-F.42 R:0.10685 P:0.05486 F:0.07250
42 ROUGE-SU4 Eval D0711-C.M.100.C-A.42 R:0.11073 P:0.06005 F:0.07787
42 ROUGE-SU4 Eval D0711-C.M.100.C-B.42 R:0.10994 P:0.05760 F:0.07559
42 ROUGE-SU4 Eval D0711-C.M.100.C-C.42 R:0.10822 P:0.05729 F:0.07492
42 ROUGE-SU4 Eval D0711-C.M.100.C-F.42 R:0.09317 P:0.04933 F:0.06451
42 ROUGE-SU4 Eval D0716-A.M.100.D-C.42 R:0.25758 P:0.14219 F:0.18323
42 ROUGE-SU4 Eval D0716-A.M.100.D-D.42 R:0.27797 P:0.15087 F:0.19558
42 ROUGE-SU4 Eval D0716-A.M.100.D-E.42 R:0.23948 P:0.13042 F:0.16887
42 ROUGE-SU4 Eval D0716-A.M.100.D-F.42 R:0.24633 P:0.13507 F:0.17447
42 ROUGE-SU4 Eval D0716-B.M.100.D-C.42 R:0.14809 P:0.08478 F:0.10783
42 ROUGE-SU4 Eval D0716-B.M.100.D-D.42 R:0.15632 P:0.08769 F:0.11235
42 ROUGE-SU4 Eval D0716-B.M.100.D-E.42 R:0.13709 P:0.07769 F:0.09918
42 ROUGE-SU4 Eval D0716-B.M.100.D-F.42 R:0.15639 P:0.08833 F:0.11290
42 ROUGE-SU4 Eval D0716-C.M.100.D-C.42 R:0.12486 P:0.07306 F:0.09218
42 ROUGE-SU4 Eval D0716-C.M.100.D-D.42 R:0.12027 P:0.06849 F:0.08728
42 ROUGE-SU4 Eval D0716-C.M.100.D-E.42 R:0.13559 P:0.07828 F:0.09926
42 ROUGE-SU4 Eval D0716-C.M.100.D-F.42 R:0.13584 P:0.07763 F:0.09880
42 ROUGE-SU4 Eval D0721-A.M.100.E-B.42 R:0.08619 P:0.04105 F:0.05561
42 ROUGE-SU4 Eval D0721-A.M.100.E-C.42 R:0.07833 P:0.03834 F:0.05148
42 ROUGE-SU4 Eval D0721-A.M.100.E-E.42 R:0.07167 P:0.03507 F:0.04710
42 ROUGE-SU4 Eval D0721-A.M.100.E-G.42 R:0.07625 P:0.03806 F:0.05078
42 ROUGE-SU4 Eval D0721-B.M.100.E-B.42 R:0.08584 P:0.04249 F:0.05684
42 ROUGE-SU4 Eval D0721-B.M.100.E-C.42 R:0.08061 P:0.04084 F:0.05421
42 ROUGE-SU4 Eval D0721-B.M.100.E-E.42 R:0.07351 P:0.03615 F:0.04847
42 ROUGE-SU4 Eval D0721-B.M.100.E-G.42 R:0.07064 P:0.03532 F:0.04709
42 ROUGE-SU4 Eval D0721-C.M.100.E-B.42 R:0.12570 P:0.06939 F:0.08942
42 ROUGE-SU4 Eval D0721-C.M.100.E-C.42 R:0.09266 P:0.05081 F:0.06563
42 ROUGE-SU4 Eval D0721-C.M.100.E-E.42 R:0.11815 P:0.06413 F:0.08314
42 ROUGE-SU4 Eval D0721-C.M.100.E-G.42 R:0.08305 P:0.04616 F:0.05934
42 ROUGE-SU4 Eval D0726-A.M.100.F-A.42 R:0.11718 P:0.06603 F:0.08446
42 ROUGE-SU4 Eval D0726-A.M.100.F-E.42 R:0.12100 P:0.06795 F:0.08703
42 ROUGE-SU4 Eval D0726-A.M.100.F-F.42 R:0.13595 P:0.07660 F:0.09799
42 ROUGE-SU4 Eval D0726-A.M.100.F-G.42 R:0.12287 P:0.06923 F:0.08856
42 ROUGE-SU4 Eval D0726-B.M.100.F-A.42 R:0.08221 P:0.04504 F:0.05820
42 ROUGE-SU4 Eval D0726-B.M.100.F-E.42 R:0.08362 P:0.04504 F:0.05855
42 ROUGE-SU4 Eval D0726-B.M.100.F-F.42 R:0.08362 P:0.04504 F:0.05855
42 ROUGE-SU4 Eval D0726-B.M.100.F-G.42 R:0.08277 P:0.04504 F:0.05834
42 ROUGE-SU4 Eval D0726-C.M.100.F-A.42 R:0.06450 P:0.02862 F:0.03965
42 ROUGE-SU4 Eval D0726-C.M.100.F-E.42 R:0.06747 P:0.02964 F:0.04119
42 ROUGE-SU4 Eval D0726-C.M.100.F-F.42 R:0.07201 P:0.03141 F:0.04374
42 ROUGE-SU4 Eval D0726-C.M.100.F-G.42 R:0.06902 P:0.03116 F:0.04294
42 ROUGE-SU4 Eval D0727-A.M.100.G-A.42 R:0.12116 P:0.06058 F:0.08077
42 ROUGE-SU4 Eval D0727-A.M.100.G-F.42 R:0.13345 P:0.06741 F:0.08957
42 ROUGE-SU4 Eval D0727-A.M.100.G-G.42 R:0.12808 P:0.06513 F:0.08635
42 ROUGE-SU4 Eval D0727-A.M.100.G-H.42 R:0.13457 P:0.06797 F:0.09032
42 ROUGE-SU4 Eval D0727-B.M.100.G-A.42 R:0.09482 P:0.04626 F:0.06218
42 ROUGE-SU4 Eval D0727-B.M.100.G-F.42 R:0.09611 P:0.04971 F:0.06553
42 ROUGE-SU4 Eval D0727-B.M.100.G-G.42 R:0.09015 P:0.04368 F:0.05885
42 ROUGE-SU4 Eval D0727-B.M.100.G-H.42 R:0.08834 P:0.04310 F:0.05793
42 ROUGE-SU4 Eval D0727-C.M.100.G-A.42 R:0.12932 P:0.05986 F:0.08184
42 ROUGE-SU4 Eval D0727-C.M.100.G-F.42 R:0.12630 P:0.05650 F:0.07807
42 ROUGE-SU4 Eval D0727-C.M.100.G-G.42 R:0.13220 P:0.06037 F:0.08289
42 ROUGE-SU4 Eval D0727-C.M.100.G-H.42 R:0.13137 P:0.05857 F:0.08102
42 ROUGE-SU4 Eval D0736-A.M.100.H-G.42 R:0.08610 P:0.03391 F:0.04866
42 ROUGE-SU4 Eval D0736-A.M.100.H-H.42 R:0.09398 P:0.03634 F:0.05241
42 ROUGE-SU4 Eval D0736-A.M.100.H-I.42 R:0.08791 P:0.03488 F:0.04994
42 ROUGE-SU4 Eval D0736-A.M.100.H-J.42 R:0.08781 P:0.03803 F:0.05307
42 ROUGE-SU4 Eval D0736-B.M.100.H-G.42 R:0.08005 P:0.03222 F:0.04595
42 ROUGE-SU4 Eval D0736-B.M.100.H-H.42 R:0.09046 P:0.03354 F:0.04894
42 ROUGE-SU4 Eval D0736-B.M.100.H-I.42 R:0.08658 P:0.03170 F:0.04641
42 ROUGE-SU4 Eval D0736-B.M.100.H-J.42 R:0.08453 P:0.03724 F:0.05170
42 ROUGE-SU4 Eval D0736-C.M.100.H-G.42 R:0.09534 P:0.03688 F:0.05319
42 ROUGE-SU4 Eval D0736-C.M.100.H-H.42 R:0.06890 P:0.02083 F:0.03199
42 ROUGE-SU4 Eval D0736-C.M.100.H-I.42 R:0.11359 P:0.03435 F:0.05275
42 ROUGE-SU4 Eval D0736-C.M.100.H-J.42 R:0.08949 P:0.03885 F:0.05418
42 ROUGE-SU4 Eval D0740-A.M.100.I-D.42 R:0.16215 P:0.08121 F:0.10822
42 ROUGE-SU4 Eval D0740-A.M.100.I-H.42 R:0.14597 P:0.07385 F:0.09808
42 ROUGE-SU4 Eval D0740-A.M.100.I-I.42 R:0.15778 P:0.08036 F:0.10649
42 ROUGE-SU4 Eval D0740-A.M.100.I-J.42 R:0.14183 P:0.07272 F:0.09614
42 ROUGE-SU4 Eval D0740-B.M.100.I-D.42 R:0.11889 P:0.07021 F:0.08828
42 ROUGE-SU4 Eval D0740-B.M.100.I-H.42 R:0.09467 P:0.05479 F:0.06941
42 ROUGE-SU4 Eval D0740-B.M.100.I-I.42 R:0.12009 P:0.07021 F:0.08861
42 ROUGE-SU4 Eval D0740-B.M.100.I-J.42 R:0.11739 P:0.06955 F:0.08735
42 ROUGE-SU4 Eval D0740-C.M.100.I-D.42 R:0.16339 P:0.08915 F:0.11536
42 ROUGE-SU4 Eval D0740-C.M.100.I-H.42 R:0.13366 P:0.07245 F:0.09397
42 ROUGE-SU4 Eval D0740-C.M.100.I-I.42 R:0.15464 P:0.08438 F:0.10918
42 ROUGE-SU4 Eval D0740-C.M.100.I-J.42 R:0.15196 P:0.08318 F:0.10751
42 ROUGE-SU4 Eval D0743-A.M.100.J-B.42 R:0.08089 P:0.04071 F:0.05416
42 ROUGE-SU4 Eval D0743-A.M.100.J-H.42 R:0.07015 P:0.03634 F:0.04788
42 ROUGE-SU4 Eval D0743-A.M.100.J-I.42 R:0.07853 P:0.04016 F:0.05314
42 ROUGE-SU4 Eval D0743-A.M.100.J-J.42 R:0.06940 P:0.03607 F:0.04747
42 ROUGE-SU4 Eval D0743-B.M.100.J-B.42 R:0.07182 P:0.04298 F:0.05378
42 ROUGE-SU4 Eval D0743-B.M.100.J-H.42 R:0.05879 P:0.03576 F:0.04447
42 ROUGE-SU4 Eval D0743-B.M.100.J-I.42 R:0.07522 P:0.04560 F:0.05678
42 ROUGE-SU4 Eval D0743-B.M.100.J-J.42 R:0.06337 P:0.03904 F:0.04831
42 ROUGE-SU4 Eval D0743-C.M.100.J-B.42 R:0.09283 P:0.04939 F:0.06448
42 ROUGE-SU4 Eval D0743-C.M.100.J-H.42 R:0.07789 P:0.04131 F:0.05399
42 ROUGE-SU4 Eval D0743-C.M.100.J-I.42 R:0.08962 P:0.04737 F:0.06198
42 ROUGE-SU4 Eval D0743-C.M.100.J-J.42 R:0.06075 P:0.03264 F:0.04246
---------------------------------------------
43 ROUGE-1 Average_R: 0.33492 (95%-conf.int. 0.32516 - 0.34540)
43 ROUGE-1 Average_P: 0.21688 (95%-conf.int. 0.20875 - 0.22508)
43 ROUGE-1 Average_F: 0.26260 (95%-conf.int. 0.25370 - 0.27207)
.............................................
43 ROUGE-1 Eval D0703-A.M.100.A-A.43 R:0.40878 P:0.27069 F:0.32570
43 ROUGE-1 Eval D0703-A.M.100.A-C.43 R:0.37584 P:0.25056 F:0.30067
43 ROUGE-1 Eval D0703-A.M.100.A-D.43 R:0.37113 P:0.24161 F:0.29268
43 ROUGE-1 Eval D0703-A.M.100.A-J.43 R:0.40136 P:0.26398 F:0.31849
43 ROUGE-1 Eval D0703-B.M.100.A-A.43 R:0.35621 P:0.24385 F:0.28951
43 ROUGE-1 Eval D0703-B.M.100.A-C.43 R:0.35570 P:0.23714 F:0.28456
43 ROUGE-1 Eval D0703-B.M.100.A-D.43 R:0.36577 P:0.24385 F:0.29262
43 ROUGE-1 Eval D0703-B.M.100.A-J.43 R:0.33887 P:0.22819 F:0.27273
43 ROUGE-1 Eval D0703-C.M.100.A-A.43 R:0.36667 P:0.26190 F:0.30555
43 ROUGE-1 Eval D0703-C.M.100.A-C.43 R:0.37013 P:0.27143 F:0.31319
43 ROUGE-1 Eval D0703-C.M.100.A-D.43 R:0.36755 P:0.26429 F:0.30748
43 ROUGE-1 Eval D0703-C.M.100.A-J.43 R:0.38079 P:0.27381 F:0.31856
43 ROUGE-1 Eval D0706-A.M.100.B-B.43 R:0.36688 P:0.23690 F:0.28790
43 ROUGE-1 Eval D0706-A.M.100.B-D.43 R:0.36928 P:0.23690 F:0.28864
43 ROUGE-1 Eval D0706-A.M.100.B-E.43 R:0.31818 P:0.20545 F:0.24968
43 ROUGE-1 Eval D0706-A.M.100.B-I.43 R:0.36039 P:0.23270 F:0.28280
43 ROUGE-1 Eval D0706-B.M.100.B-B.43 R:0.23203 P:0.13004 F:0.16667
43 ROUGE-1 Eval D0706-B.M.100.B-D.43 R:0.21824 P:0.12271 F:0.15709
43 ROUGE-1 Eval D0706-B.M.100.B-E.43 R:0.23701 P:0.13370 F:0.17096
43 ROUGE-1 Eval D0706-B.M.100.B-I.43 R:0.24919 P:0.14103 F:0.18012
43 ROUGE-1 Eval D0706-C.M.100.B-B.43 R:0.25161 P:0.17450 F:0.20608
43 ROUGE-1 Eval D0706-C.M.100.B-D.43 R:0.28065 P:0.19463 F:0.22986
43 ROUGE-1 Eval D0706-C.M.100.B-E.43 R:0.26603 P:0.18568 F:0.21871
43 ROUGE-1 Eval D0706-C.M.100.B-I.43 R:0.29073 P:0.20358 F:0.23947
43 ROUGE-1 Eval D0711-A.M.100.C-A.43 R:0.39803 P:0.28605 F:0.33287
43 ROUGE-1 Eval D0711-A.M.100.C-B.43 R:0.41333 P:0.29314 F:0.34301
43 ROUGE-1 Eval D0711-A.M.100.C-C.43 R:0.38667 P:0.27423 F:0.32089
43 ROUGE-1 Eval D0711-A.M.100.C-F.43 R:0.41391 P:0.29551 F:0.34483
43 ROUGE-1 Eval D0711-B.M.100.C-A.43 R:0.32653 P:0.20126 F:0.24903
43 ROUGE-1 Eval D0711-B.M.100.C-B.43 R:0.31507 P:0.19287 F:0.23927
43 ROUGE-1 Eval D0711-B.M.100.C-C.43 R:0.30201 P:0.18868 F:0.23226
43 ROUGE-1 Eval D0711-B.M.100.C-F.43 R:0.28814 P:0.17820 F:0.22021
43 ROUGE-1 Eval D0711-C.M.100.C-A.43 R:0.31683 P:0.21477 F:0.25600
43 ROUGE-1 Eval D0711-C.M.100.C-B.43 R:0.35495 P:0.23266 F:0.28108
43 ROUGE-1 Eval D0711-C.M.100.C-C.43 R:0.33108 P:0.21924 F:0.26380
43 ROUGE-1 Eval D0711-C.M.100.C-F.43 R:0.32095 P:0.21253 F:0.25572
43 ROUGE-1 Eval D0716-A.M.100.D-C.43 R:0.41311 P:0.28188 F:0.33511
43 ROUGE-1 Eval D0716-A.M.100.D-D.43 R:0.42000 P:0.28188 F:0.33735
43 ROUGE-1 Eval D0716-A.M.100.D-E.43 R:0.42857 P:0.28859 F:0.34492
43 ROUGE-1 Eval D0716-A.M.100.D-F.43 R:0.40594 P:0.27517 F:0.32800
43 ROUGE-1 Eval D0716-B.M.100.D-C.43 R:0.41776 P:0.24330 F:0.30751
43 ROUGE-1 Eval D0716-B.M.100.D-D.43 R:0.41275 P:0.23563 F:0.30000
43 ROUGE-1 Eval D0716-B.M.100.D-E.43 R:0.39535 P:0.22797 F:0.28919
43 ROUGE-1 Eval D0716-B.M.100.D-F.43 R:0.40000 P:0.22989 F:0.29197
43 ROUGE-1 Eval D0716-C.M.100.D-C.43 R:0.41042 P:0.30000 F:0.34663
43 ROUGE-1 Eval D0716-C.M.100.D-D.43 R:0.49833 P:0.35476 F:0.41446
43 ROUGE-1 Eval D0716-C.M.100.D-E.43 R:0.46205 P:0.33333 F:0.38727
43 ROUGE-1 Eval D0716-C.M.100.D-F.43 R:0.47667 P:0.34048 F:0.39723
43 ROUGE-1 Eval D0721-A.M.100.E-B.43 R:0.32333 P:0.21700 F:0.25970
43 ROUGE-1 Eval D0721-A.M.100.E-C.43 R:0.29870 P:0.20582 F:0.24371
43 ROUGE-1 Eval D0721-A.M.100.E-E.43 R:0.31494 P:0.21700 F:0.25695
43 ROUGE-1 Eval D0721-A.M.100.E-G.43 R:0.30255 P:0.21253 F:0.24967
43 ROUGE-1 Eval D0721-B.M.100.E-B.43 R:0.32573 P:0.22523 F:0.26631
43 ROUGE-1 Eval D0721-B.M.100.E-C.43 R:0.30892 P:0.21847 F:0.25594
43 ROUGE-1 Eval D0721-B.M.100.E-E.43 R:0.29836 P:0.20495 F:0.24299
43 ROUGE-1 Eval D0721-B.M.100.E-G.43 R:0.30000 P:0.20946 F:0.24668
43 ROUGE-1 Eval D0721-C.M.100.E-B.43 R:0.35410 P:0.26087 F:0.30042
43 ROUGE-1 Eval D0721-C.M.100.E-C.43 R:0.33993 P:0.24879 F:0.28731
43 ROUGE-1 Eval D0721-C.M.100.E-E.43 R:0.33000 P:0.23913 F:0.27731
43 ROUGE-1 Eval D0721-C.M.100.E-G.43 R:0.34853 P:0.25845 F:0.29681
43 ROUGE-1 Eval D0726-A.M.100.F-A.43 R:0.43189 P:0.28889 F:0.34620
43 ROUGE-1 Eval D0726-A.M.100.F-E.43 R:0.38667 P:0.25778 F:0.30934
43 ROUGE-1 Eval D0726-A.M.100.F-F.43 R:0.43189 P:0.28889 F:0.34620
43 ROUGE-1 Eval D0726-A.M.100.F-G.43 R:0.40532 P:0.27111 F:0.32490
43 ROUGE-1 Eval D0726-B.M.100.F-A.43 R:0.27124 P:0.18202 F:0.21785
43 ROUGE-1 Eval D0726-B.M.100.F-E.43 R:0.27575 P:0.18202 F:0.21929
43 ROUGE-1 Eval D0726-B.M.100.F-F.43 R:0.27575 P:0.18202 F:0.21929
43 ROUGE-1 Eval D0726-B.M.100.F-G.43 R:0.28618 P:0.19079 F:0.22895
43 ROUGE-1 Eval D0726-C.M.100.F-A.43 R:0.31000 P:0.20946 F:0.25000
43 ROUGE-1 Eval D0726-C.M.100.F-E.43 R:0.30640 P:0.20495 F:0.24561
43 ROUGE-1 Eval D0726-C.M.100.F-F.43 R:0.32881 P:0.21847 F:0.26252
43 ROUGE-1 Eval D0726-C.M.100.F-G.43 R:0.31803 P:0.21847 F:0.25901
43 ROUGE-1 Eval D0727-A.M.100.G-A.43 R:0.41528 P:0.25562 F:0.31645
43 ROUGE-1 Eval D0727-A.M.100.G-F.43 R:0.42434 P:0.26380 F:0.32534
43 ROUGE-1 Eval D0727-A.M.100.G-G.43 R:0.39216 P:0.24540 F:0.30189
43 ROUGE-1 Eval D0727-A.M.100.G-H.43 R:0.40789 P:0.25358 F:0.31274
43 ROUGE-1 Eval D0727-B.M.100.G-A.43 R:0.35739 P:0.21268 F:0.26667
43 ROUGE-1 Eval D0727-B.M.100.G-F.43 R:0.37013 P:0.23313 F:0.28607
43 ROUGE-1 Eval D0727-B.M.100.G-G.43 R:0.35986 P:0.21268 F:0.26735
43 ROUGE-1 Eval D0727-B.M.100.G-H.43 R:0.35739 P:0.21268 F:0.26667
43 ROUGE-1 Eval D0727-C.M.100.G-A.43 R:0.29967 P:0.16850 F:0.21571
43 ROUGE-1 Eval D0727-C.M.100.G-F.43 R:0.30303 P:0.16484 F:0.21353
43 ROUGE-1 Eval D0727-C.M.100.G-G.43 R:0.29703 P:0.16484 F:0.21202
43 ROUGE-1 Eval D0727-C.M.100.G-H.43 R:0.31757 P:0.17216 F:0.22328
43 ROUGE-1 Eval D0736-A.M.100.H-G.43 R:0.31183 P:0.18012 F:0.22834
43 ROUGE-1 Eval D0736-A.M.100.H-H.43 R:0.34307 P:0.19462 F:0.24835
43 ROUGE-1 Eval D0736-A.M.100.H-I.43 R:0.30605 P:0.17805 F:0.22513
43 ROUGE-1 Eval D0736-A.M.100.H-J.43 R:0.31373 P:0.19876 F:0.24335
43 ROUGE-1 Eval D0736-B.M.100.H-G.43 R:0.31679 P:0.17400 F:0.22462
43 ROUGE-1 Eval D0736-B.M.100.H-H.43 R:0.33058 P:0.16771 F:0.22253
43 ROUGE-1 Eval D0736-B.M.100.H-I.43 R:0.34310 P:0.17191 F:0.22905
43 ROUGE-1 Eval D0736-B.M.100.H-J.43 R:0.32867 P:0.19706 F:0.24639
43 ROUGE-1 Eval D0736-C.M.100.H-G.43 R:0.29114 P:0.14375 F:0.19247
43 ROUGE-1 Eval D0736-C.M.100.H-H.43 R:0.35829 P:0.13958 F:0.20090
43 ROUGE-1 Eval D0736-C.M.100.H-I.43 R:0.35829 P:0.13958 F:0.20090
43 ROUGE-1 Eval D0736-C.M.100.H-J.43 R:0.32075 P:0.17708 F:0.22818
43 ROUGE-1 Eval D0740-A.M.100.I-D.43 R:0.29043 P:0.19172 F:0.23097
43 ROUGE-1 Eval D0740-A.M.100.I-H.43 R:0.28431 P:0.18954 F:0.22745
43 ROUGE-1 Eval D0740-A.M.100.I-I.43 R:0.29545 P:0.19826 F:0.23729
43 ROUGE-1 Eval D0740-A.M.100.I-J.43 R:0.30323 P:0.20479 F:0.24447
43 ROUGE-1 Eval D0740-B.M.100.I-D.43 R:0.29870 P:0.17625 F:0.22169
43 ROUGE-1 Eval D0740-B.M.100.I-H.43 R:0.27483 P:0.15900 F:0.20145
43 ROUGE-1 Eval D0740-B.M.100.I-I.43 R:0.31803 P:0.18582 F:0.23458
43 ROUGE-1 Eval D0740-B.M.100.I-J.43 R:0.28479 P:0.16858 F:0.21179
43 ROUGE-1 Eval D0740-C.M.100.I-D.43 R:0.35783 P:0.24889 F:0.29358
43 ROUGE-1 Eval D0740-C.M.100.I-H.43 R:0.35048 P:0.24222 F:0.28646
43 ROUGE-1 Eval D0740-C.M.100.I-I.43 R:0.35144 P:0.24444 F:0.28833
43 ROUGE-1 Eval D0740-C.M.100.I-J.43 R:0.36943 P:0.25778 F:0.30367
43 ROUGE-1 Eval D0743-A.M.100.J-B.43 R:0.25397 P:0.16461 F:0.19975
43 ROUGE-1 Eval D0743-A.M.100.J-H.43 R:0.22531 P:0.15021 F:0.18025
43 ROUGE-1 Eval D0743-A.M.100.J-I.43 R:0.26563 P:0.17490 F:0.21092
43 ROUGE-1 Eval D0743-A.M.100.J-J.43 R:0.22769 P:0.15226 F:0.18249
43 ROUGE-1 Eval D0743-B.M.100.J-B.43 R:0.21795 P:0.13992 F:0.17043
43 ROUGE-1 Eval D0743-B.M.100.J-H.43 R:0.19874 P:0.12963 F:0.15691
43 ROUGE-1 Eval D0743-B.M.100.J-I.43 R:0.20886 P:0.13580 F:0.16459
43 ROUGE-1 Eval D0743-B.M.100.J-J.43 R:0.20872 P:0.13786 F:0.16605
43 ROUGE-1 Eval D0743-C.M.100.J-B.43 R:0.34603 P:0.23747 F:0.28165
43 ROUGE-1 Eval D0743-C.M.100.J-H.43 R:0.28025 P:0.19172 F:0.22768
43 ROUGE-1 Eval D0743-C.M.100.J-I.43 R:0.31949 P:0.21786 F:0.25906
43 ROUGE-1 Eval D0743-C.M.100.J-J.43 R:0.31132 P:0.21569 F:0.25483
---------------------------------------------
43 ROUGE-2 Average_R: 0.06884 (95%-conf.int. 0.06173 - 0.07628)
43 ROUGE-2 Average_P: 0.04457 (95%-conf.int. 0.03977 - 0.04976)
43 ROUGE-2 Average_F: 0.05396 (95%-conf.int. 0.04835 - 0.06005)
.............................................
43 ROUGE-2 Eval D0703-A.M.100.A-A.43 R:0.13993 P:0.09234 F:0.11126
43 ROUGE-2 Eval D0703-A.M.100.A-C.43 R:0.11525 P:0.07658 F:0.09202
43 ROUGE-2 Eval D0703-A.M.100.A-D.43 R:0.12847 P:0.08333 F:0.10109
43 ROUGE-2 Eval D0703-A.M.100.A-J.43 R:0.15120 P:0.09910 F:0.11973
43 ROUGE-2 Eval D0703-B.M.100.A-A.43 R:0.04620 P:0.03153 F:0.03748
43 ROUGE-2 Eval D0703-B.M.100.A-C.43 R:0.04746 P:0.03153 F:0.03789
43 ROUGE-2 Eval D0703-B.M.100.A-D.43 R:0.04407 P:0.02928 F:0.03518
43 ROUGE-2 Eval D0703-B.M.100.A-J.43 R:0.04362 P:0.02928 F:0.03504
43 ROUGE-2 Eval D0703-C.M.100.A-A.43 R:0.09428 P:0.06715 F:0.07844
43 ROUGE-2 Eval D0703-C.M.100.A-C.43 R:0.08852 P:0.06475 F:0.07479
43 ROUGE-2 Eval D0703-C.M.100.A-D.43 R:0.07358 P:0.05276 F:0.06145
43 ROUGE-2 Eval D0703-C.M.100.A-J.43 R:0.10368 P:0.07434 F:0.08659
43 ROUGE-2 Eval D0706-A.M.100.B-B.43 R:0.11148 P:0.07173 F:0.08729
43 ROUGE-2 Eval D0706-A.M.100.B-D.43 R:0.13531 P:0.08650 F:0.10553
43 ROUGE-2 Eval D0706-A.M.100.B-E.43 R:0.08852 P:0.05696 F:0.06932
43 ROUGE-2 Eval D0706-A.M.100.B-I.43 R:0.11803 P:0.07595 F:0.09243
43 ROUGE-2 Eval D0706-B.M.100.B-B.43 R:0.05281 P:0.02947 F:0.03783
43 ROUGE-2 Eval D0706-B.M.100.B-D.43 R:0.02303 P:0.01289 F:0.01653
43 ROUGE-2 Eval D0706-B.M.100.B-E.43 R:0.07213 P:0.04052 F:0.05189
43 ROUGE-2 Eval D0706-B.M.100.B-I.43 R:0.06863 P:0.03867 F:0.04947
43 ROUGE-2 Eval D0706-C.M.100.B-B.43 R:0.00326 P:0.00225 F:0.00266
43 ROUGE-2 Eval D0706-C.M.100.B-D.43 R:0.02606 P:0.01802 F:0.02131
43 ROUGE-2 Eval D0706-C.M.100.B-E.43 R:0.02589 P:0.01802 F:0.02125
43 ROUGE-2 Eval D0706-C.M.100.B-I.43 R:0.02258 P:0.01577 F:0.01857
43 ROUGE-2 Eval D0711-A.M.100.C-A.43 R:0.05316 P:0.03810 F:0.04439
43 ROUGE-2 Eval D0711-A.M.100.C-B.43 R:0.05387 P:0.03810 F:0.04463
43 ROUGE-2 Eval D0711-A.M.100.C-C.43 R:0.04377 P:0.03095 F:0.03626
43 ROUGE-2 Eval D0711-A.M.100.C-F.43 R:0.05017 P:0.03571 F:0.04172
43 ROUGE-2 Eval D0711-B.M.100.C-A.43 R:0.05498 P:0.03376 F:0.04183
43 ROUGE-2 Eval D0711-B.M.100.C-B.43 R:0.05882 P:0.03586 F:0.04456
43 ROUGE-2 Eval D0711-B.M.100.C-C.43 R:0.04746 P:0.02954 F:0.03641
43 ROUGE-2 Eval D0711-B.M.100.C-F.43 R:0.03425 P:0.02110 F:0.02611
43 ROUGE-2 Eval D0711-C.M.100.C-A.43 R:0.05000 P:0.03378 F:0.04032
43 ROUGE-2 Eval D0711-C.M.100.C-B.43 R:0.05517 P:0.03604 F:0.04360
43 ROUGE-2 Eval D0711-C.M.100.C-C.43 R:0.04096 P:0.02703 F:0.03257
43 ROUGE-2 Eval D0711-C.M.100.C-F.43 R:0.03754 P:0.02477 F:0.02985
43 ROUGE-2 Eval D0716-A.M.100.D-C.43 R:0.11921 P:0.08108 F:0.09652
43 ROUGE-2 Eval D0716-A.M.100.D-D.43 R:0.10774 P:0.07207 F:0.08637
43 ROUGE-2 Eval D0716-A.M.100.D-E.43 R:0.12416 P:0.08333 F:0.09973
43 ROUGE-2 Eval D0716-A.M.100.D-F.43 R:0.12000 P:0.08108 F:0.09677
43 ROUGE-2 Eval D0716-B.M.100.D-C.43 R:0.10963 P:0.06358 F:0.08048
43 ROUGE-2 Eval D0716-B.M.100.D-D.43 R:0.10169 P:0.05780 F:0.07371
43 ROUGE-2 Eval D0716-B.M.100.D-E.43 R:0.08725 P:0.05010 F:0.06365
43 ROUGE-2 Eval D0716-B.M.100.D-F.43 R:0.11448 P:0.06551 F:0.08333
43 ROUGE-2 Eval D0716-C.M.100.D-C.43 R:0.13158 P:0.09592 F:0.11096
43 ROUGE-2 Eval D0716-C.M.100.D-D.43 R:0.20946 P:0.14868 F:0.17391
43 ROUGE-2 Eval D0716-C.M.100.D-E.43 R:0.18000 P:0.12950 F:0.15063
43 ROUGE-2 Eval D0716-C.M.100.D-F.43 R:0.19192 P:0.13669 F:0.15966
43 ROUGE-2 Eval D0721-A.M.100.E-B.43 R:0.08754 P:0.05856 F:0.07018
43 ROUGE-2 Eval D0721-A.M.100.E-C.43 R:0.06230 P:0.04279 F:0.05073
43 ROUGE-2 Eval D0721-A.M.100.E-E.43 R:0.08197 P:0.05631 F:0.06676
43 ROUGE-2 Eval D0721-A.M.100.E-G.43 R:0.07395 P:0.05180 F:0.06092
43 ROUGE-2 Eval D0721-B.M.100.E-B.43 R:0.05592 P:0.03855 F:0.04564
43 ROUGE-2 Eval D0721-B.M.100.E-C.43 R:0.08682 P:0.06122 F:0.07181
43 ROUGE-2 Eval D0721-B.M.100.E-E.43 R:0.04967 P:0.03401 F:0.04037
43 ROUGE-2 Eval D0721-B.M.100.E-G.43 R:0.08143 P:0.05669 F:0.06684
43 ROUGE-2 Eval D0721-C.M.100.E-B.43 R:0.07616 P:0.05596 F:0.06452
43 ROUGE-2 Eval D0721-C.M.100.E-C.43 R:0.07667 P:0.05596 F:0.06470
43 ROUGE-2 Eval D0721-C.M.100.E-E.43 R:0.05051 P:0.03650 F:0.04238
43 ROUGE-2 Eval D0721-C.M.100.E-G.43 R:0.06579 P:0.04866 F:0.05594
43 ROUGE-2 Eval D0726-A.M.100.F-A.43 R:0.17785 P:0.11857 F:0.14228
43 ROUGE-2 Eval D0726-A.M.100.F-E.43 R:0.13468 P:0.08949 F:0.10753
43 ROUGE-2 Eval D0726-A.M.100.F-F.43 R:0.17450 P:0.11633 F:0.13960
43 ROUGE-2 Eval D0726-A.M.100.F-G.43 R:0.12752 P:0.08501 F:0.10201
43 ROUGE-2 Eval D0726-B.M.100.F-A.43 R:0.04950 P:0.03311 F:0.03968
43 ROUGE-2 Eval D0726-B.M.100.F-E.43 R:0.04362 P:0.02870 F:0.03462
43 ROUGE-2 Eval D0726-B.M.100.F-F.43 R:0.04027 P:0.02649 F:0.03196
43 ROUGE-2 Eval D0726-B.M.100.F-G.43 R:0.03654 P:0.02428 F:0.02917
43 ROUGE-2 Eval D0726-C.M.100.F-A.43 R:0.03704 P:0.02494 F:0.02981
43 ROUGE-2 Eval D0726-C.M.100.F-E.43 R:0.05102 P:0.03401 F:0.04081
43 ROUGE-2 Eval D0726-C.M.100.F-F.43 R:0.05137 P:0.03401 F:0.04093
43 ROUGE-2 Eval D0726-C.M.100.F-G.43 R:0.04305 P:0.02948 F:0.03500
43 ROUGE-2 Eval D0727-A.M.100.G-A.43 R:0.10403 P:0.06379 F:0.07909
43 ROUGE-2 Eval D0727-A.M.100.G-F.43 R:0.12292 P:0.07613 F:0.09403
43 ROUGE-2 Eval D0727-A.M.100.G-G.43 R:0.10561 P:0.06584 F:0.08111
43 ROUGE-2 Eval D0727-A.M.100.G-H.43 R:0.11628 P:0.07202 F:0.08895
43 ROUGE-2 Eval D0727-B.M.100.G-A.43 R:0.02431 P:0.01440 F:0.01809
43 ROUGE-2 Eval D0727-B.M.100.G-F.43 R:0.03279 P:0.02058 F:0.02529
43 ROUGE-2 Eval D0727-B.M.100.G-G.43 R:0.03497 P:0.02058 F:0.02591
43 ROUGE-2 Eval D0727-B.M.100.G-H.43 R:0.03125 P:0.01852 F:0.02326
43 ROUGE-2 Eval D0727-C.M.100.G-A.43 R:0.01645 P:0.00921 F:0.01181
43 ROUGE-2 Eval D0727-C.M.100.G-F.43 R:0.02041 P:0.01105 F:0.01434
43 ROUGE-2 Eval D0727-C.M.100.G-G.43 R:0.02000 P:0.01105 F:0.01424
43 ROUGE-2 Eval D0727-C.M.100.G-H.43 R:0.02389 P:0.01289 F:0.01675
43 ROUGE-2 Eval D0736-A.M.100.H-G.43 R:0.03623 P:0.02083 F:0.02645
43 ROUGE-2 Eval D0736-A.M.100.H-H.43 R:0.03690 P:0.02083 F:0.02663
43 ROUGE-2 Eval D0736-A.M.100.H-I.43 R:0.02518 P:0.01458 F:0.01847
43 ROUGE-2 Eval D0736-A.M.100.H-J.43 R:0.02970 P:0.01875 F:0.02299
43 ROUGE-2 Eval D0736-B.M.100.H-G.43 R:0.05019 P:0.02743 F:0.03547
43 ROUGE-2 Eval D0736-B.M.100.H-H.43 R:0.06695 P:0.03376 F:0.04489
43 ROUGE-2 Eval D0736-B.M.100.H-I.43 R:0.07203 P:0.03586 F:0.04788
43 ROUGE-2 Eval D0736-B.M.100.H-J.43 R:0.07067 P:0.04219 F:0.05284
43 ROUGE-2 Eval D0736-C.M.100.H-G.43 R:0.05128 P:0.02516 F:0.03376
43 ROUGE-2 Eval D0736-C.M.100.H-H.43 R:0.11413 P:0.04403 F:0.06355
43 ROUGE-2 Eval D0736-C.M.100.H-I.43 R:0.09783 P:0.03774 F:0.05447
43 ROUGE-2 Eval D0736-C.M.100.H-J.43 R:0.08015 P:0.04403 F:0.05684
43 ROUGE-2 Eval D0740-A.M.100.I-D.43 R:0.06000 P:0.03947 F:0.04762
43 ROUGE-2 Eval D0740-A.M.100.I-H.43 R:0.05281 P:0.03509 F:0.04216
43 ROUGE-2 Eval D0740-A.M.100.I-I.43 R:0.03934 P:0.02632 F:0.03154
43 ROUGE-2 Eval D0740-A.M.100.I-J.43 R:0.05537 P:0.03728 F:0.04456
43 ROUGE-2 Eval D0740-B.M.100.I-D.43 R:0.05902 P:0.03468 F:0.04369
43 ROUGE-2 Eval D0740-B.M.100.I-H.43 R:0.04682 P:0.02697 F:0.03423
43 ROUGE-2 Eval D0740-B.M.100.I-I.43 R:0.06954 P:0.04046 F:0.05116
43 ROUGE-2 Eval D0740-B.M.100.I-J.43 R:0.06209 P:0.03661 F:0.04606
43 ROUGE-2 Eval D0740-C.M.100.I-D.43 R:0.03548 P:0.02461 F:0.02906
43 ROUGE-2 Eval D0740-C.M.100.I-H.43 R:0.04545 P:0.03132 F:0.03708
43 ROUGE-2 Eval D0740-C.M.100.I-I.43 R:0.04516 P:0.03132 F:0.03699
43 ROUGE-2 Eval D0740-C.M.100.I-J.43 R:0.05788 P:0.04027 F:0.04750
43 ROUGE-2 Eval D0743-A.M.100.J-B.43 R:0.03846 P:0.02484 F:0.03018
43 ROUGE-2 Eval D0743-A.M.100.J-H.43 R:0.02804 P:0.01863 F:0.02239
43 ROUGE-2 Eval D0743-A.M.100.J-I.43 R:0.03785 P:0.02484 F:0.03000
43 ROUGE-2 Eval D0743-A.M.100.J-J.43 R:0.01863 P:0.01242 F:0.01490
43 ROUGE-2 Eval D0743-B.M.100.J-B.43 R:0.01942 P:0.01242 F:0.01515
43 ROUGE-2 Eval D0743-B.M.100.J-H.43 R:0.01592 P:0.01035 F:0.01254
43 ROUGE-2 Eval D0743-B.M.100.J-I.43 R:0.00639 P:0.00414 F:0.00502
43 ROUGE-2 Eval D0743-B.M.100.J-J.43 R:0.01572 P:0.01035 F:0.01248
43 ROUGE-2 Eval D0743-C.M.100.J-B.43 R:0.07372 P:0.05044 F:0.05990
43 ROUGE-2 Eval D0743-C.M.100.J-H.43 R:0.01608 P:0.01096 F:0.01304
43 ROUGE-2 Eval D0743-C.M.100.J-I.43 R:0.07419 P:0.05044 F:0.06005
43 ROUGE-2 Eval D0743-C.M.100.J-J.43 R:0.06667 P:0.04605 F:0.05447
---------------------------------------------
43 ROUGE-3 Average_R: 0.02539 (95%-conf.int. 0.02114 - 0.03011)
43 ROUGE-3 Average_P: 0.01647 (95%-conf.int. 0.01361 - 0.01972)
43 ROUGE-3 Average_F: 0.01992 (95%-conf.int. 0.01650 - 0.02388)
.............................................
43 ROUGE-3 Eval D0703-A.M.100.A-A.43 R:0.04828 P:0.03175 F:0.03831
43 ROUGE-3 Eval D0703-A.M.100.A-C.43 R:0.02740 P:0.01814 F:0.02183
43 ROUGE-3 Eval D0703-A.M.100.A-D.43 R:0.04912 P:0.03175 F:0.03857
43 ROUGE-3 Eval D0703-A.M.100.A-J.43 R:0.05208 P:0.03401 F:0.04115
43 ROUGE-3 Eval D0703-B.M.100.A-A.43 R:0.01000 P:0.00680 F:0.00810
43 ROUGE-3 Eval D0703-B.M.100.A-C.43 R:0.01027 P:0.00680 F:0.00818
43 ROUGE-3 Eval D0703-B.M.100.A-D.43 R:0.01027 P:0.00680 F:0.00818
43 ROUGE-3 Eval D0703-B.M.100.A-J.43 R:0.01017 P:0.00680 F:0.00815
43 ROUGE-3 Eval D0703-C.M.100.A-A.43 R:0.02381 P:0.01691 F:0.01978
43 ROUGE-3 Eval D0703-C.M.100.A-C.43 R:0.02318 P:0.01691 F:0.01955
43 ROUGE-3 Eval D0703-C.M.100.A-D.43 R:0.01689 P:0.01208 F:0.01409
43 ROUGE-3 Eval D0703-C.M.100.A-J.43 R:0.02703 P:0.01932 F:0.02253
43 ROUGE-3 Eval D0706-A.M.100.B-B.43 R:0.04967 P:0.03185 F:0.03881
43 ROUGE-3 Eval D0706-A.M.100.B-D.43 R:0.06667 P:0.04246 F:0.05188
43 ROUGE-3 Eval D0706-A.M.100.B-E.43 R:0.02980 P:0.01911 F:0.02329
43 ROUGE-3 Eval D0706-A.M.100.B-I.43 R:0.05298 P:0.03397 F:0.04140
43 ROUGE-3 Eval D0706-B.M.100.B-B.43 R:0.03667 P:0.02037 F:0.02619
43 ROUGE-3 Eval D0706-B.M.100.B-D.43 R:0.01661 P:0.00926 F:0.01189
43 ROUGE-3 Eval D0706-B.M.100.B-E.43 R:0.05298 P:0.02963 F:0.03801
43 ROUGE-3 Eval D0706-B.M.100.B-I.43 R:0.05281 P:0.02963 F:0.03796
43 ROUGE-3 Eval D0706-C.M.100.B-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0706-C.M.100.B-D.43 R:0.01316 P:0.00907 F:0.01074
43 ROUGE-3 Eval D0706-C.M.100.B-E.43 R:0.01307 P:0.00907 F:0.01071
43 ROUGE-3 Eval D0706-C.M.100.B-I.43 R:0.01303 P:0.00907 F:0.01070
43 ROUGE-3 Eval D0711-A.M.100.C-A.43 R:0.01007 P:0.00719 F:0.00839
43 ROUGE-3 Eval D0711-A.M.100.C-B.43 R:0.01020 P:0.00719 F:0.00843
43 ROUGE-3 Eval D0711-A.M.100.C-C.43 R:0.01020 P:0.00719 F:0.00843
43 ROUGE-3 Eval D0711-A.M.100.C-F.43 R:0.01014 P:0.00719 F:0.00841
43 ROUGE-3 Eval D0711-B.M.100.C-A.43 R:0.01389 P:0.00849 F:0.01054
43 ROUGE-3 Eval D0711-B.M.100.C-B.43 R:0.01399 P:0.00849 F:0.01057
43 ROUGE-3 Eval D0711-B.M.100.C-C.43 R:0.00685 P:0.00425 F:0.00525
43 ROUGE-3 Eval D0711-B.M.100.C-F.43 R:0.00692 P:0.00425 F:0.00527
43 ROUGE-3 Eval D0711-C.M.100.C-A.43 R:0.00673 P:0.00454 F:0.00542
43 ROUGE-3 Eval D0711-C.M.100.C-B.43 R:0.00697 P:0.00454 F:0.00550
43 ROUGE-3 Eval D0711-C.M.100.C-C.43 R:0.00345 P:0.00227 F:0.00274
43 ROUGE-3 Eval D0711-C.M.100.C-F.43 R:0.00345 P:0.00227 F:0.00274
43 ROUGE-3 Eval D0716-A.M.100.D-C.43 R:0.04682 P:0.03175 F:0.03784
43 ROUGE-3 Eval D0716-A.M.100.D-D.43 R:0.03401 P:0.02268 F:0.02721
43 ROUGE-3 Eval D0716-A.M.100.D-E.43 R:0.04068 P:0.02721 F:0.03261
43 ROUGE-3 Eval D0716-A.M.100.D-F.43 R:0.04040 P:0.02721 F:0.03252
43 ROUGE-3 Eval D0716-B.M.100.D-C.43 R:0.04027 P:0.02326 F:0.02949
43 ROUGE-3 Eval D0716-B.M.100.D-D.43 R:0.03767 P:0.02132 F:0.02723
43 ROUGE-3 Eval D0716-B.M.100.D-E.43 R:0.02712 P:0.01550 F:0.01973
43 ROUGE-3 Eval D0716-B.M.100.D-F.43 R:0.04762 P:0.02713 F:0.03457
43 ROUGE-3 Eval D0716-C.M.100.D-C.43 R:0.05316 P:0.03865 F:0.04476
43 ROUGE-3 Eval D0716-C.M.100.D-D.43 R:0.11945 P:0.08454 F:0.09901
43 ROUGE-3 Eval D0716-C.M.100.D-E.43 R:0.09091 P:0.06522 F:0.07595
43 ROUGE-3 Eval D0716-C.M.100.D-F.43 R:0.11224 P:0.07971 F:0.09322
43 ROUGE-3 Eval D0721-A.M.100.E-B.43 R:0.02381 P:0.01587 F:0.01905
43 ROUGE-3 Eval D0721-A.M.100.E-C.43 R:0.00993 P:0.00680 F:0.00807
43 ROUGE-3 Eval D0721-A.M.100.E-E.43 R:0.02318 P:0.01587 F:0.01884
43 ROUGE-3 Eval D0721-A.M.100.E-G.43 R:0.02273 P:0.01587 F:0.01869
43 ROUGE-3 Eval D0721-B.M.100.E-B.43 R:0.02326 P:0.01598 F:0.01894
43 ROUGE-3 Eval D0721-B.M.100.E-C.43 R:0.04221 P:0.02968 F:0.03485
43 ROUGE-3 Eval D0721-B.M.100.E-E.43 R:0.02007 P:0.01370 F:0.01628
43 ROUGE-3 Eval D0721-B.M.100.E-G.43 R:0.04276 P:0.02968 F:0.03504
43 ROUGE-3 Eval D0721-C.M.100.E-B.43 R:0.03344 P:0.02451 F:0.02829
43 ROUGE-3 Eval D0721-C.M.100.E-C.43 R:0.03030 P:0.02206 F:0.02553
43 ROUGE-3 Eval D0721-C.M.100.E-E.43 R:0.01361 P:0.00980 F:0.01139
43 ROUGE-3 Eval D0721-C.M.100.E-G.43 R:0.03322 P:0.02451 F:0.02821
43 ROUGE-3 Eval D0726-A.M.100.F-A.43 R:0.12542 P:0.08333 F:0.10013
43 ROUGE-3 Eval D0726-A.M.100.F-E.43 R:0.09184 P:0.06081 F:0.07317
43 ROUGE-3 Eval D0726-A.M.100.F-F.43 R:0.11864 P:0.07883 F:0.09472
43 ROUGE-3 Eval D0726-A.M.100.F-G.43 R:0.08136 P:0.05405 F:0.06495
43 ROUGE-3 Eval D0726-B.M.100.F-A.43 R:0.01333 P:0.00889 F:0.01067
43 ROUGE-3 Eval D0726-B.M.100.F-E.43 R:0.01356 P:0.00889 F:0.01074
43 ROUGE-3 Eval D0726-B.M.100.F-F.43 R:0.00678 P:0.00444 F:0.00537
43 ROUGE-3 Eval D0726-B.M.100.F-G.43 R:0.00671 P:0.00444 F:0.00534
43 ROUGE-3 Eval D0726-C.M.100.F-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0726-C.M.100.F-E.43 R:0.00344 P:0.00228 F:0.00274
43 ROUGE-3 Eval D0726-C.M.100.F-F.43 R:0.00346 P:0.00228 F:0.00275
43 ROUGE-3 Eval D0726-C.M.100.F-G.43 R:0.00334 P:0.00228 F:0.00271
43 ROUGE-3 Eval D0727-A.M.100.G-A.43 R:0.03729 P:0.02277 F:0.02827
43 ROUGE-3 Eval D0727-A.M.100.G-F.43 R:0.06711 P:0.04141 F:0.05122
43 ROUGE-3 Eval D0727-A.M.100.G-G.43 R:0.04667 P:0.02899 F:0.03576
43 ROUGE-3 Eval D0727-A.M.100.G-H.43 R:0.07047 P:0.04348 F:0.05378
43 ROUGE-3 Eval D0727-B.M.100.G-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0727-B.M.100.G-F.43 R:0.00331 P:0.00207 F:0.00255
43 ROUGE-3 Eval D0727-B.M.100.G-G.43 R:0.00353 P:0.00207 F:0.00261
43 ROUGE-3 Eval D0727-B.M.100.G-H.43 R:0.00351 P:0.00207 F:0.00260
43 ROUGE-3 Eval D0727-C.M.100.G-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0727-C.M.100.G-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0727-C.M.100.G-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0727-C.M.100.G-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0736-A.M.100.H-G.43 R:0.01465 P:0.00839 F:0.01067
43 ROUGE-3 Eval D0736-A.M.100.H-H.43 R:0.01493 P:0.00839 F:0.01074
43 ROUGE-3 Eval D0736-A.M.100.H-I.43 R:0.00727 P:0.00419 F:0.00532
43 ROUGE-3 Eval D0736-A.M.100.H-J.43 R:0.00667 P:0.00419 F:0.00515
43 ROUGE-3 Eval D0736-B.M.100.H-G.43 R:0.00391 P:0.00212 F:0.00275
43 ROUGE-3 Eval D0736-B.M.100.H-H.43 R:0.01695 P:0.00849 F:0.01131
43 ROUGE-3 Eval D0736-B.M.100.H-I.43 R:0.02146 P:0.01062 F:0.01421
43 ROUGE-3 Eval D0736-B.M.100.H-J.43 R:0.01786 P:0.01062 F:0.01332
43 ROUGE-3 Eval D0736-C.M.100.H-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0736-C.M.100.H-H.43 R:0.03867 P:0.01477 F:0.02138
43 ROUGE-3 Eval D0736-C.M.100.H-I.43 R:0.03867 P:0.01477 F:0.02138
43 ROUGE-3 Eval D0736-C.M.100.H-J.43 R:0.02703 P:0.01477 F:0.01910
43 ROUGE-3 Eval D0740-A.M.100.I-D.43 R:0.02357 P:0.01545 F:0.01867
43 ROUGE-3 Eval D0740-A.M.100.I-H.43 R:0.02333 P:0.01545 F:0.01859
43 ROUGE-3 Eval D0740-A.M.100.I-I.43 R:0.00662 P:0.00442 F:0.00530
43 ROUGE-3 Eval D0740-A.M.100.I-J.43 R:0.01645 P:0.01104 F:0.01321
43 ROUGE-3 Eval D0740-B.M.100.I-D.43 R:0.00993 P:0.00581 F:0.00733
43 ROUGE-3 Eval D0740-B.M.100.I-H.43 R:0.01014 P:0.00581 F:0.00739
43 ROUGE-3 Eval D0740-B.M.100.I-I.43 R:0.01672 P:0.00969 F:0.01227
43 ROUGE-3 Eval D0740-B.M.100.I-J.43 R:0.01320 P:0.00775 F:0.00977
43 ROUGE-3 Eval D0740-C.M.100.I-D.43 R:0.00977 P:0.00676 F:0.00799
43 ROUGE-3 Eval D0740-C.M.100.I-H.43 R:0.01639 P:0.01126 F:0.01335
43 ROUGE-3 Eval D0740-C.M.100.I-I.43 R:0.01303 P:0.00901 F:0.01065
43 ROUGE-3 Eval D0740-C.M.100.I-J.43 R:0.01948 P:0.01351 F:0.01595
43 ROUGE-3 Eval D0743-A.M.100.J-B.43 R:0.01618 P:0.01042 F:0.01268
43 ROUGE-3 Eval D0743-A.M.100.J-H.43 R:0.01258 P:0.00833 F:0.01002
43 ROUGE-3 Eval D0743-A.M.100.J-I.43 R:0.01592 P:0.01042 F:0.01260
43 ROUGE-3 Eval D0743-A.M.100.J-J.43 R:0.00313 P:0.00208 F:0.00250
43 ROUGE-3 Eval D0743-B.M.100.J-B.43 R:0.00327 P:0.00208 F:0.00254
43 ROUGE-3 Eval D0743-B.M.100.J-H.43 R:0.00322 P:0.00208 F:0.00253
43 ROUGE-3 Eval D0743-B.M.100.J-I.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0743-B.M.100.J-J.43 R:0.00317 P:0.00208 F:0.00251
43 ROUGE-3 Eval D0743-C.M.100.J-B.43 R:0.02913 P:0.01987 F:0.02363
43 ROUGE-3 Eval D0743-C.M.100.J-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-3 Eval D0743-C.M.100.J-I.43 R:0.02932 P:0.01987 F:0.02369
43 ROUGE-3 Eval D0743-C.M.100.J-J.43 R:0.02885 P:0.01987 F:0.02353
---------------------------------------------
43 ROUGE-4 Average_R: 0.01289 (95%-conf.int. 0.00986 - 0.01632)
43 ROUGE-4 Average_P: 0.00830 (95%-conf.int. 0.00629 - 0.01057)
43 ROUGE-4 Average_F: 0.01007 (95%-conf.int. 0.00763 - 0.01278)
.............................................
43 ROUGE-4 Eval D0703-A.M.100.A-A.43 R:0.02091 P:0.01370 F:0.01655
43 ROUGE-4 Eval D0703-A.M.100.A-C.43 R:0.01038 P:0.00685 F:0.00825
43 ROUGE-4 Eval D0703-A.M.100.A-D.43 R:0.02837 P:0.01826 F:0.02222
43 ROUGE-4 Eval D0703-A.M.100.A-J.43 R:0.02456 P:0.01598 F:0.01936
43 ROUGE-4 Eval D0703-B.M.100.A-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0703-B.M.100.A-C.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0703-B.M.100.A-D.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0703-B.M.100.A-J.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0703-C.M.100.A-A.43 R:0.01031 P:0.00730 F:0.00855
43 ROUGE-4 Eval D0703-C.M.100.A-C.43 R:0.01003 P:0.00730 F:0.00845
43 ROUGE-4 Eval D0703-C.M.100.A-D.43 R:0.00683 P:0.00487 F:0.00569
43 ROUGE-4 Eval D0703-C.M.100.A-J.43 R:0.01365 P:0.00973 F:0.01136
43 ROUGE-4 Eval D0706-A.M.100.B-B.43 R:0.03344 P:0.02137 F:0.02608
43 ROUGE-4 Eval D0706-A.M.100.B-D.43 R:0.04377 P:0.02778 F:0.03399
43 ROUGE-4 Eval D0706-A.M.100.B-E.43 R:0.02007 P:0.01282 F:0.01565
43 ROUGE-4 Eval D0706-A.M.100.B-I.43 R:0.03344 P:0.02137 F:0.02608
43 ROUGE-4 Eval D0706-B.M.100.B-B.43 R:0.03030 P:0.01676 F:0.02158
43 ROUGE-4 Eval D0706-B.M.100.B-D.43 R:0.01342 P:0.00745 F:0.00958
43 ROUGE-4 Eval D0706-B.M.100.B-E.43 R:0.04348 P:0.02421 F:0.03110
43 ROUGE-4 Eval D0706-B.M.100.B-I.43 R:0.04333 P:0.02421 F:0.03106
43 ROUGE-4 Eval D0706-C.M.100.B-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0706-C.M.100.B-D.43 R:0.00664 P:0.00457 F:0.00541
43 ROUGE-4 Eval D0706-C.M.100.B-E.43 R:0.00660 P:0.00457 F:0.00540
43 ROUGE-4 Eval D0706-C.M.100.B-I.43 R:0.00658 P:0.00457 F:0.00539
43 ROUGE-4 Eval D0711-A.M.100.C-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-A.M.100.C-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-A.M.100.C-C.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-A.M.100.C-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-B.M.100.C-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-B.M.100.C-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-B.M.100.C-C.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-B.M.100.C-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-C.M.100.C-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-C.M.100.C-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-C.M.100.C-C.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0711-C.M.100.C-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0716-A.M.100.D-C.43 R:0.01014 P:0.00685 F:0.00818
43 ROUGE-4 Eval D0716-A.M.100.D-D.43 R:0.00687 P:0.00457 F:0.00549
43 ROUGE-4 Eval D0716-A.M.100.D-E.43 R:0.00685 P:0.00457 F:0.00548
43 ROUGE-4 Eval D0716-A.M.100.D-F.43 R:0.00680 P:0.00457 F:0.00547
43 ROUGE-4 Eval D0716-B.M.100.D-C.43 R:0.01356 P:0.00780 F:0.00990
43 ROUGE-4 Eval D0716-B.M.100.D-D.43 R:0.01384 P:0.00780 F:0.00998
43 ROUGE-4 Eval D0716-B.M.100.D-E.43 R:0.00685 P:0.00390 F:0.00497
43 ROUGE-4 Eval D0716-B.M.100.D-F.43 R:0.01718 P:0.00975 F:0.01244
43 ROUGE-4 Eval D0716-C.M.100.D-C.43 R:0.01678 P:0.01217 F:0.01411
43 ROUGE-4 Eval D0716-C.M.100.D-D.43 R:0.06897 P:0.04866 F:0.05706
43 ROUGE-4 Eval D0716-C.M.100.D-E.43 R:0.05442 P:0.03893 F:0.04539
43 ROUGE-4 Eval D0716-C.M.100.D-F.43 R:0.06529 P:0.04623 F:0.05413
43 ROUGE-4 Eval D0721-A.M.100.E-B.43 R:0.01031 P:0.00685 F:0.00823
43 ROUGE-4 Eval D0721-A.M.100.E-C.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0721-A.M.100.E-E.43 R:0.01003 P:0.00685 F:0.00814
43 ROUGE-4 Eval D0721-A.M.100.E-G.43 R:0.00984 P:0.00685 F:0.00808
43 ROUGE-4 Eval D0721-B.M.100.E-B.43 R:0.01007 P:0.00690 F:0.00819
43 ROUGE-4 Eval D0721-B.M.100.E-C.43 R:0.02295 P:0.01609 F:0.01892
43 ROUGE-4 Eval D0721-B.M.100.E-E.43 R:0.01351 P:0.00920 F:0.01095
43 ROUGE-4 Eval D0721-B.M.100.E-G.43 R:0.02326 P:0.01609 F:0.01902
43 ROUGE-4 Eval D0721-C.M.100.E-B.43 R:0.02027 P:0.01481 F:0.01712
43 ROUGE-4 Eval D0721-C.M.100.E-C.43 R:0.01701 P:0.01235 F:0.01431
43 ROUGE-4 Eval D0721-C.M.100.E-E.43 R:0.00344 P:0.00247 F:0.00288
43 ROUGE-4 Eval D0721-C.M.100.E-G.43 R:0.02013 P:0.01481 F:0.01706
43 ROUGE-4 Eval D0726-A.M.100.F-A.43 R:0.10274 P:0.06803 F:0.08186
43 ROUGE-4 Eval D0726-A.M.100.F-E.43 R:0.06873 P:0.04535 F:0.05464
43 ROUGE-4 Eval D0726-A.M.100.F-F.43 R:0.09247 P:0.06122 F:0.07367
43 ROUGE-4 Eval D0726-A.M.100.F-G.43 R:0.05479 P:0.03628 F:0.04365
43 ROUGE-4 Eval D0726-B.M.100.F-A.43 R:0.00673 P:0.00447 F:0.00537
43 ROUGE-4 Eval D0726-B.M.100.F-E.43 R:0.00685 P:0.00447 F:0.00541
43 ROUGE-4 Eval D0726-B.M.100.F-F.43 R:0.00342 P:0.00224 F:0.00271
43 ROUGE-4 Eval D0726-B.M.100.F-G.43 R:0.00339 P:0.00224 F:0.00270
43 ROUGE-4 Eval D0726-C.M.100.F-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0726-C.M.100.F-E.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0726-C.M.100.F-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0726-C.M.100.F-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-A.M.100.G-A.43 R:0.02397 P:0.01458 F:0.01813
43 ROUGE-4 Eval D0727-A.M.100.G-F.43 R:0.05085 P:0.03125 F:0.03871
43 ROUGE-4 Eval D0727-A.M.100.G-G.43 R:0.02694 P:0.01667 F:0.02060
43 ROUGE-4 Eval D0727-A.M.100.G-H.43 R:0.05085 P:0.03125 F:0.03871
43 ROUGE-4 Eval D0727-B.M.100.G-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-B.M.100.G-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-B.M.100.G-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-B.M.100.G-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-C.M.100.G-A.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-C.M.100.G-F.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-C.M.100.G-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0727-C.M.100.G-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0736-A.M.100.H-G.43 R:0.00741 P:0.00422 F:0.00538
43 ROUGE-4 Eval D0736-A.M.100.H-H.43 R:0.00755 P:0.00422 F:0.00541
43 ROUGE-4 Eval D0736-A.M.100.H-I.43 R:0.00368 P:0.00211 F:0.00268
43 ROUGE-4 Eval D0736-A.M.100.H-J.43 R:0.00337 P:0.00211 F:0.00260
43 ROUGE-4 Eval D0736-B.M.100.H-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0736-B.M.100.H-H.43 R:0.00858 P:0.00427 F:0.00570
43 ROUGE-4 Eval D0736-B.M.100.H-I.43 R:0.00870 P:0.00427 F:0.00573
43 ROUGE-4 Eval D0736-B.M.100.H-J.43 R:0.00722 P:0.00427 F:0.00537
43 ROUGE-4 Eval D0736-C.M.100.H-G.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0736-C.M.100.H-H.43 R:0.02247 P:0.00849 F:0.01232
43 ROUGE-4 Eval D0736-C.M.100.H-I.43 R:0.02247 P:0.00849 F:0.01232
43 ROUGE-4 Eval D0736-C.M.100.H-J.43 R:0.01563 P:0.00849 F:0.01100
43 ROUGE-4 Eval D0740-A.M.100.I-D.43 R:0.00680 P:0.00444 F:0.00537
43 ROUGE-4 Eval D0740-A.M.100.I-H.43 R:0.00673 P:0.00444 F:0.00535
43 ROUGE-4 Eval D0740-A.M.100.I-I.43 R:0.00334 P:0.00222 F:0.00267
43 ROUGE-4 Eval D0740-A.M.100.I-J.43 R:0.00332 P:0.00222 F:0.00266
43 ROUGE-4 Eval D0740-B.M.100.I-D.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0740-B.M.100.I-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0740-B.M.100.I-I.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0740-B.M.100.I-J.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0740-C.M.100.I-D.43 R:0.00329 P:0.00227 F:0.00269
43 ROUGE-4 Eval D0740-C.M.100.I-H.43 R:0.00662 P:0.00454 F:0.00539
43 ROUGE-4 Eval D0740-C.M.100.I-I.43 R:0.00329 P:0.00227 F:0.00269
43 ROUGE-4 Eval D0740-C.M.100.I-J.43 R:0.00656 P:0.00454 F:0.00537
43 ROUGE-4 Eval D0743-A.M.100.J-B.43 R:0.00980 P:0.00629 F:0.00766
43 ROUGE-4 Eval D0743-A.M.100.J-H.43 R:0.00952 P:0.00629 F:0.00758
43 ROUGE-4 Eval D0743-A.M.100.J-I.43 R:0.00965 P:0.00629 F:0.00762
43 ROUGE-4 Eval D0743-A.M.100.J-J.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-B.M.100.J-B.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-B.M.100.J-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-B.M.100.J-I.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-B.M.100.J-J.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-C.M.100.J-B.43 R:0.00980 P:0.00667 F:0.00794
43 ROUGE-4 Eval D0743-C.M.100.J-H.43 R:0.00000 P:0.00000 F:0.00000
43 ROUGE-4 Eval D0743-C.M.100.J-I.43 R:0.00987 P:0.00667 F:0.00796
43 ROUGE-4 Eval D0743-C.M.100.J-J.43 R:0.00971 P:0.00667 F:0.00791
---------------------------------------------
43 ROUGE-L Average_R: 0.29280 (95%-conf.int. 0.28360 - 0.30185)
43 ROUGE-L Average_P: 0.18938 (95%-conf.int. 0.18230 - 0.19666)
43 ROUGE-L Average_F: 0.22941 (95%-conf.int. 0.22155 - 0.23735)
.............................................
43 ROUGE-L Eval D0703-A.M.100.A-A.43 R:0.35811 P:0.23714 F:0.28533
43 ROUGE-L Eval D0703-A.M.100.A-C.43 R:0.32215 P:0.21477 F:0.25772
43 ROUGE-L Eval D0703-A.M.100.A-D.43 R:0.32302 P:0.21029 F:0.25474
43 ROUGE-L Eval D0703-A.M.100.A-J.43 R:0.37075 P:0.24385 F:0.29420
43 ROUGE-L Eval D0703-B.M.100.A-A.43 R:0.28431 P:0.19463 F:0.23107
43 ROUGE-L Eval D0703-B.M.100.A-C.43 R:0.30201 P:0.20134 F:0.24161
43 ROUGE-L Eval D0703-B.M.100.A-D.43 R:0.30201 P:0.20134 F:0.24161
43 ROUGE-L Eval D0703-B.M.100.A-J.43 R:0.27907 P:0.18792 F:0.22460
43 ROUGE-L Eval D0703-C.M.100.A-A.43 R:0.33333 P:0.23810 F:0.27778
43 ROUGE-L Eval D0703-C.M.100.A-C.43 R:0.30519 P:0.22381 F:0.25824
43 ROUGE-L Eval D0703-C.M.100.A-D.43 R:0.30464 P:0.21905 F:0.25485
43 ROUGE-L Eval D0703-C.M.100.A-J.43 R:0.33444 P:0.24048 F:0.27978
43 ROUGE-L Eval D0706-A.M.100.B-B.43 R:0.34416 P:0.22222 F:0.27006
43 ROUGE-L Eval D0706-A.M.100.B-D.43 R:0.33987 P:0.21803 F:0.26565
43 ROUGE-L Eval D0706-A.M.100.B-E.43 R:0.29545 P:0.19078 F:0.23185
43 ROUGE-L Eval D0706-A.M.100.B-I.43 R:0.33766 P:0.21803 F:0.26497
43 ROUGE-L Eval D0706-B.M.100.B-B.43 R:0.21895 P:0.12271 F:0.15728
43 ROUGE-L Eval D0706-B.M.100.B-D.43 R:0.19870 P:0.11172 F:0.14302
43 ROUGE-L Eval D0706-B.M.100.B-E.43 R:0.21753 P:0.12271 F:0.15691
43 ROUGE-L Eval D0706-B.M.100.B-I.43 R:0.23301 P:0.13187 F:0.16842
43 ROUGE-L Eval D0706-C.M.100.B-B.43 R:0.23548 P:0.16331 F:0.19286
43 ROUGE-L Eval D0706-C.M.100.B-D.43 R:0.26452 P:0.18345 F:0.21665
43 ROUGE-L Eval D0706-C.M.100.B-E.43 R:0.24038 P:0.16779 F:0.19763
43 ROUGE-L Eval D0706-C.M.100.B-I.43 R:0.27157 P:0.19016 F:0.22369
43 ROUGE-L Eval D0711-A.M.100.C-A.43 R:0.32566 P:0.23404 F:0.27235
43 ROUGE-L Eval D0711-A.M.100.C-B.43 R:0.34333 P:0.24350 F:0.28492
43 ROUGE-L Eval D0711-A.M.100.C-C.43 R:0.31333 P:0.22222 F:0.26002
43 ROUGE-L Eval D0711-A.M.100.C-F.43 R:0.33113 P:0.23641 F:0.27587
43 ROUGE-L Eval D0711-B.M.100.C-A.43 R:0.27211 P:0.16771 F:0.20752
43 ROUGE-L Eval D0711-B.M.100.C-B.43 R:0.26027 P:0.15933 F:0.19766
43 ROUGE-L Eval D0711-B.M.100.C-C.43 R:0.25839 P:0.16143 F:0.19871
43 ROUGE-L Eval D0711-B.M.100.C-F.43 R:0.23729 P:0.14675 F:0.18135
43 ROUGE-L Eval D0711-C.M.100.C-A.43 R:0.27723 P:0.18792 F:0.22400
43 ROUGE-L Eval D0711-C.M.100.C-B.43 R:0.30717 P:0.20134 F:0.24324
43 ROUGE-L Eval D0711-C.M.100.C-C.43 R:0.27365 P:0.18121 F:0.21804
43 ROUGE-L Eval D0711-C.M.100.C-F.43 R:0.27365 P:0.18121 F:0.21804
43 ROUGE-L Eval D0716-A.M.100.D-C.43 R:0.36393 P:0.24832 F:0.29521
43 ROUGE-L Eval D0716-A.M.100.D-D.43 R:0.37333 P:0.25056 F:0.29987
43 ROUGE-L Eval D0716-A.M.100.D-E.43 R:0.38870 P:0.26174 F:0.31283
43 ROUGE-L Eval D0716-A.M.100.D-F.43 R:0.36304 P:0.24609 F:0.29334
43 ROUGE-L Eval D0716-B.M.100.D-C.43 R:0.39145 P:0.22797 F:0.28814
43 ROUGE-L Eval D0716-B.M.100.D-D.43 R:0.38591 P:0.22031 F:0.28049
43 ROUGE-L Eval D0716-B.M.100.D-E.43 R:0.36545 P:0.21073 F:0.26732
43 ROUGE-L Eval D0716-B.M.100.D-F.43 R:0.38333 P:0.22031 F:0.27981
43 ROUGE-L Eval D0716-C.M.100.D-C.43 R:0.32899 P:0.24048 F:0.27786
43 ROUGE-L Eval D0716-C.M.100.D-D.43 R:0.42475 P:0.30238 F:0.35327
43 ROUGE-L Eval D0716-C.M.100.D-E.43 R:0.37954 P:0.27381 F:0.31812
43 ROUGE-L Eval D0716-C.M.100.D-F.43 R:0.40667 P:0.29048 F:0.33889
43 ROUGE-L Eval D0721-A.M.100.E-B.43 R:0.28333 P:0.19016 F:0.22758
43 ROUGE-L Eval D0721-A.M.100.E-C.43 R:0.25974 P:0.17897 F:0.21192
43 ROUGE-L Eval D0721-A.M.100.E-E.43 R:0.27273 P:0.18792 F:0.22252
43 ROUGE-L Eval D0721-A.M.100.E-G.43 R:0.26752 P:0.18792 F:0.22076
43 ROUGE-L Eval D0721-B.M.100.E-B.43 R:0.28339 P:0.19595 F:0.23169
43 ROUGE-L Eval D0721-B.M.100.E-C.43 R:0.27707 P:0.19595 F:0.22955
43 ROUGE-L Eval D0721-B.M.100.E-E.43 R:0.25574 P:0.17568 F:0.20828
43 ROUGE-L Eval D0721-B.M.100.E-G.43 R:0.26129 P:0.18243 F:0.21485
43 ROUGE-L Eval D0721-C.M.100.E-B.43 R:0.30820 P:0.22705 F:0.26147
43 ROUGE-L Eval D0721-C.M.100.E-C.43 R:0.29703 P:0.21739 F:0.25105
43 ROUGE-L Eval D0721-C.M.100.E-E.43 R:0.28000 P:0.20290 F:0.23530
43 ROUGE-L Eval D0721-C.M.100.E-G.43 R:0.29967 P:0.22222 F:0.25520
43 ROUGE-L Eval D0726-A.M.100.F-A.43 R:0.40199 P:0.26889 F:0.32224
43 ROUGE-L Eval D0726-A.M.100.F-E.43 R:0.35667 P:0.23778 F:0.28534
43 ROUGE-L Eval D0726-A.M.100.F-F.43 R:0.39867 P:0.26667 F:0.31958
43 ROUGE-L Eval D0726-A.M.100.F-G.43 R:0.36877 P:0.24667 F:0.29561
43 ROUGE-L Eval D0726-B.M.100.F-A.43 R:0.24510 P:0.16447 F:0.19685
43 ROUGE-L Eval D0726-B.M.100.F-E.43 R:0.25581 P:0.16886 F:0.20343
43 ROUGE-L Eval D0726-B.M.100.F-F.43 R:0.24252 P:0.16009 F:0.19287
43 ROUGE-L Eval D0726-B.M.100.F-G.43 R:0.24671 P:0.16447 F:0.19737
43 ROUGE-L Eval D0726-C.M.100.F-A.43 R:0.26000 P:0.17568 F:0.20968
43 ROUGE-L Eval D0726-C.M.100.F-E.43 R:0.26936 P:0.18018 F:0.21592
43 ROUGE-L Eval D0726-C.M.100.F-F.43 R:0.28136 P:0.18694 F:0.22463
43 ROUGE-L Eval D0726-C.M.100.F-G.43 R:0.26230 P:0.18018 F:0.21362
43 ROUGE-L Eval D0727-A.M.100.G-A.43 R:0.36545 P:0.22495 F:0.27848
43 ROUGE-L Eval D0727-A.M.100.G-F.43 R:0.37171 P:0.23108 F:0.28499
43 ROUGE-L Eval D0727-A.M.100.G-G.43 R:0.35294 P:0.22086 F:0.27170
43 ROUGE-L Eval D0727-A.M.100.G-H.43 R:0.37171 P:0.23108 F:0.28499
43 ROUGE-L Eval D0727-B.M.100.G-A.43 R:0.28866 P:0.17178 F:0.21539
43 ROUGE-L Eval D0727-B.M.100.G-F.43 R:0.31494 P:0.19836 F:0.24341
43 ROUGE-L Eval D0727-B.M.100.G-G.43 R:0.30104 P:0.17791 F:0.22365
43 ROUGE-L Eval D0727-B.M.100.G-H.43 R:0.29553 P:0.17587 F:0.22051
43 ROUGE-L Eval D0727-C.M.100.G-A.43 R:0.27036 P:0.15201 F:0.19460
43 ROUGE-L Eval D0727-C.M.100.G-F.43 R:0.26936 P:0.14652 F:0.18980
43 ROUGE-L Eval D0727-C.M.100.G-G.43 R:0.25743 P:0.14286 F:0.18375
43 ROUGE-L Eval D0727-C.M.100.G-H.43 R:0.28041 P:0.15201 F:0.19715
43 ROUGE-L Eval D0736-A.M.100.H-G.43 R:0.26523 P:0.15321 F:0.19423
43 ROUGE-L Eval D0736-A.M.100.H-H.43 R:0.28832 P:0.16356 F:0.20872
43 ROUGE-L Eval D0736-A.M.100.H-I.43 R:0.24555 P:0.14286 F:0.18063
43 ROUGE-L Eval D0736-A.M.100.H-J.43 R:0.26471 P:0.16770 F:0.20532
43 ROUGE-L Eval D0736-B.M.100.H-G.43 R:0.27099 P:0.14885 F:0.19215
43 ROUGE-L Eval D0736-B.M.100.H-H.43 R:0.28099 P:0.14256 F:0.18915
43 ROUGE-L Eval D0736-B.M.100.H-I.43 R:0.30962 P:0.15514 F:0.20671
43 ROUGE-L Eval D0736-B.M.100.H-J.43 R:0.28322 P:0.16981 F:0.21232
43 ROUGE-L Eval D0736-C.M.100.H-G.43 R:0.26160 P:0.12917 F:0.17295
43 ROUGE-L Eval D0736-C.M.100.H-H.43 R:0.32086 P:0.12500 F:0.17991
43 ROUGE-L Eval D0736-C.M.100.H-I.43 R:0.31016 P:0.12083 F:0.17391
43 ROUGE-L Eval D0736-C.M.100.H-J.43 R:0.29434 P:0.16250 F:0.20940
43 ROUGE-L Eval D0740-A.M.100.I-D.43 R:0.25083 P:0.16558 F:0.19948
43 ROUGE-L Eval D0740-A.M.100.I-H.43 R:0.25490 P:0.16993 F:0.20392
43 ROUGE-L Eval D0740-A.M.100.I-I.43 R:0.25325 P:0.16993 F:0.20339
43 ROUGE-L Eval D0740-A.M.100.I-J.43 R:0.26774 P:0.18083 F:0.21587
43 ROUGE-L Eval D0740-B.M.100.I-D.43 R:0.27273 P:0.16092 F:0.20241
43 ROUGE-L Eval D0740-B.M.100.I-H.43 R:0.25166 P:0.14559 F:0.18446
43 ROUGE-L Eval D0740-B.M.100.I-I.43 R:0.28525 P:0.16667 F:0.21040
43 ROUGE-L Eval D0740-B.M.100.I-J.43 R:0.26861 P:0.15900 F:0.19976
43 ROUGE-L Eval D0740-C.M.100.I-D.43 R:0.29073 P:0.20222 F:0.23853
43 ROUGE-L Eval D0740-C.M.100.I-H.43 R:0.29582 P:0.20444 F:0.24178
43 ROUGE-L Eval D0740-C.M.100.I-I.43 R:0.28754 P:0.20000 F:0.23591
43 ROUGE-L Eval D0740-C.M.100.I-J.43 R:0.29618 P:0.20667 F:0.24346
43 ROUGE-L Eval D0743-A.M.100.J-B.43 R:0.21587 P:0.13992 F:0.16979
43 ROUGE-L Eval D0743-A.M.100.J-H.43 R:0.19444 P:0.12963 F:0.15555
43 ROUGE-L Eval D0743-A.M.100.J-I.43 R:0.22812 P:0.15021 F:0.18114
43 ROUGE-L Eval D0743-A.M.100.J-J.43 R:0.19385 P:0.12963 F:0.15537
43 ROUGE-L Eval D0743-B.M.100.J-B.43 R:0.19551 P:0.12551 F:0.15288
43 ROUGE-L Eval D0743-B.M.100.J-H.43 R:0.17666 P:0.11523 F:0.13948
43 ROUGE-L Eval D0743-B.M.100.J-I.43 R:0.18671 P:0.12140 F:0.14713
43 ROUGE-L Eval D0743-B.M.100.J-J.43 R:0.18069 P:0.11934 F:0.14374
43 ROUGE-L Eval D0743-C.M.100.J-B.43 R:0.31111 P:0.21351 F:0.25323
43 ROUGE-L Eval D0743-C.M.100.J-H.43 R:0.25478 P:0.17429 F:0.20699
43 ROUGE-L Eval D0743-C.M.100.J-I.43 R:0.28754 P:0.19608 F:0.23316
43 ROUGE-L Eval D0743-C.M.100.J-J.43 R:0.28931 P:0.20044 F:0.23681
---------------------------------------------
43 ROUGE-W-1.2 Average_R: 0.10353 (95%-conf.int. 0.10011 - 0.10700)
43 ROUGE-W-1.2 Average_P: 0.12147 (95%-conf.int. 0.11674 - 0.12629)
43 ROUGE-W-1.2 Average_F: 0.11140 (95%-conf.int. 0.10767 - 0.11518)
.............................................
43 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.43 R:0.12726 P:0.15174 F:0.13843
43 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.43 R:0.11383 P:0.13793 F:0.12473
43 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.43 R:0.11778 P:0.14136 F:0.12850
43 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.43 R:0.13975 P:0.15724 F:0.14798
43 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.43 R:0.09328 P:0.11841 F:0.10435
43 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.43 R:0.09921 P:0.12516 F:0.11068
43 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.43 R:0.09852 P:0.12319 F:0.10948
43 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.43 R:0.09287 P:0.11599 F:0.10315
43 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.43 R:0.11141 P:0.14797 F:0.12711
43 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.43 R:0.09883 P:0.13683 F:0.11477
43 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.43 R:0.09647 P:0.13166 F:0.11135
43 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.43 R:0.11426 P:0.14797 F:0.12895
43 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.43 R:0.12465 P:0.14444 F:0.13382
43 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.43 R:0.12219 P:0.14384 F:0.13213
43 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.43 R:0.10515 P:0.12312 F:0.11343
43 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.43 R:0.12090 P:0.14466 F:0.13172
43 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.43 R:0.08335 P:0.08090 F:0.08211
43 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.43 R:0.07202 P:0.07141 F:0.07171
43 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.43 R:0.08256 P:0.08220 F:0.08238
43 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.43 R:0.08501 P:0.08700 F:0.08599
43 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.43 R:0.08477 P:0.10034 F:0.09190
43 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.43 R:0.09245 P:0.11037 F:0.10062
43 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.43 R:0.08456 P:0.09998 F:0.09163
43 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.43 R:0.09451 P:0.11493 F:0.10372
43 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.43 R:0.11202 P:0.14514 F:0.12645
43 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.43 R:0.11565 P:0.14856 F:0.13006
43 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.43 R:0.10542 P:0.13425 F:0.11810
43 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.43 R:0.11409 P:0.14776 F:0.12876
43 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.43 R:0.09806 P:0.10783 F:0.10271
43 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.43 R:0.09105 P:0.10445 F:0.09729
43 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.43 R:0.08839 P:0.10374 F:0.09545
43 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.43 R:0.08122 P:0.09329 F:0.08684
43 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.43 R:0.09617 P:0.12187 F:0.10751
43 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.43 R:0.10167 P:0.12463 F:0.11199
43 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.43 R:0.09045 P:0.11372 F:0.10076
43 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.43 R:0.08844 P:0.11288 F:0.09918
43 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.43 R:0.13496 P:0.16823 F:0.14977
43 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.43 R:0.12859 P:0.16443 F:0.14432
43 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.43 R:0.13414 P:0.16868 F:0.14944
43 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.43 R:0.12490 P:0.16101 F:0.14067
43 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.43 R:0.14085 P:0.14310 F:0.14197
43 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.43 R:0.13461 P:0.13752 F:0.13605
43 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.43 R:0.12775 P:0.13114 F:0.12942
43 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.43 R:0.13625 P:0.13859 F:0.13741
43 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.43 R:0.11226 P:0.15295 F:0.12948
43 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.43 R:0.14991 P:0.20696 F:0.17387
43 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.43 R:0.13292 P:0.18583 F:0.15498
43 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.43 R:0.14054 P:0.19529 F:0.16345
43 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.43 R:0.10312 P:0.12165 F:0.11162
43 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.43 R:0.09247 P:0.11304 F:0.10173
43 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.43 R:0.09777 P:0.12102 F:0.10816
43 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.43 R:0.09673 P:0.11907 F:0.10674
43 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.43 R:0.09580 P:0.12805 F:0.10960
43 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.43 R:0.09778 P:0.12997 F:0.11160
43 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.43 R:0.08640 P:0.11650 F:0.09922
43 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.43 R:0.09012 P:0.12558 F:0.10494
43 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.43 R:0.10784 P:0.14623 F:0.12413
43 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.43 R:0.10125 P:0.13942 F:0.11731
43 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.43 R:0.09425 P:0.12747 F:0.10837
43 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.43 R:0.10248 P:0.14212 F:0.11909
43 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.43 R:0.15560 P:0.18444 F:0.16880
43 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.43 R:0.13965 P:0.16311 F:0.15047
43 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.43 R:0.15436 P:0.18390 F:0.16784
43 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.43 R:0.13257 P:0.16051 F:0.14521
43 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.43 R:0.09041 P:0.10671 F:0.09789
43 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.43 R:0.09122 P:0.10869 F:0.09919
43 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.43 R:0.08686 P:0.10417 F:0.09473
43 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.43 R:0.08896 P:0.10708 F:0.09718
43 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.43 R:0.09396 P:0.11148 F:0.10197
43 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.43 R:0.09895 P:0.11682 F:0.10715
43 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.43 R:0.09920 P:0.11804 F:0.10780
43 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.43 R:0.09520 P:0.11709 F:0.10502
43 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.43 R:0.13041 P:0.14130 F:0.13564
43 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.43 R:0.13103 P:0.14869 F:0.13930
43 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.43 R:0.12558 P:0.13918 F:0.13203
43 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.43 R:0.13184 P:0.14691 F:0.13897
43 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.43 R:0.10089 P:0.10535 F:0.10307
43 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.43 R:0.10812 P:0.12233 F:0.11479
43 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.43 R:0.10584 P:0.11204 F:0.10885
43 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.43 R:0.10600 P:0.11165 F:0.10875
43 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.43 R:0.09053 P:0.09154 F:0.09103
43 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.43 R:0.09006 P:0.09054 F:0.09030
43 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.43 R:0.08573 P:0.08757 F:0.08664
43 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.43 R:0.09536 P:0.09305 F:0.09419
43 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.43 R:0.09636 P:0.09857 F:0.09745
43 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.43 R:0.10361 P:0.10336 F:0.10348
43 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.43 R:0.08917 P:0.09269 F:0.09090
43 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.43 R:0.09271 P:0.10471 F:0.09835
43 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.43 R:0.09562 P:0.09721 F:0.09641
43 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.43 R:0.10142 P:0.09519 F:0.09821
43 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.43 R:0.11360 P:0.10513 F:0.10920
43 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.43 R:0.10068 P:0.11160 F:0.10586
43 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.43 R:0.09690 P:0.08692 F:0.09164
43 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.43 R:0.12644 P:0.09207 F:0.10655
43 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.43 R:0.11788 P:0.08378 F:0.09795
43 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.43 R:0.11008 P:0.10843 F:0.10925
43 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.43 R:0.09068 P:0.11011 F:0.09945
43 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.43 R:0.09314 P:0.11203 F:0.10172
43 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.43 R:0.08783 P:0.10901 F:0.09728
43 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.43 R:0.09351 P:0.11602 F:0.10356
43 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.43 R:0.09641 P:0.10452 F:0.10030
43 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.43 R:0.09220 P:0.09492 F:0.09354
43 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.43 R:0.09867 P:0.10833 F:0.10327
43 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.43 R:0.09693 P:0.10258 F:0.09967
43 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.43 R:0.09452 P:0.12688 F:0.10834
43 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.43 R:0.10018 P:0.12921 F:0.11286
43 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.43 R:0.09272 P:0.12613 F:0.10687
43 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.43 R:0.09722 P:0.12999 F:0.11124
43 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.43 R:0.07783 P:0.08794 F:0.08258
43 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.43 R:0.07143 P:0.08226 F:0.07646
43 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.43 R:0.08078 P:0.09438 F:0.08705
43 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.43 R:0.06923 P:0.08037 F:0.07439
43 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.43 R:0.07408 P:0.07965 F:0.07676
43 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.43 R:0.06942 P:0.07509 F:0.07214
43 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.43 R:0.07039 P:0.07713 F:0.07361
43 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.43 R:0.07036 P:0.07640 F:0.07326
43 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.43 R:0.11330 P:0.13611 F:0.12366
43 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.43 R:0.09347 P:0.10678 F:0.09968
43 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.43 R:0.10747 P:0.13060 F:0.11791
43 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.43 R:0.11111 P:0.12956 F:0.11963
---------------------------------------------
43 ROUGE-SU4 Average_R: 0.11336 (95%-conf.int. 0.10692 - 0.12005)
43 ROUGE-SU4 Average_P: 0.07293 (95%-conf.int. 0.06847 - 0.07804)
43 ROUGE-SU4 Average_F: 0.08852 (95%-conf.int. 0.08333 - 0.09440)
.............................................
43 ROUGE-SU4 Eval D0703-A.M.100.A-A.43 R:0.15451 P:0.10137 F:0.12242
43 ROUGE-SU4 Eval D0703-A.M.100.A-C.43 R:0.13621 P:0.08998 F:0.10837
43 ROUGE-SU4 Eval D0703-A.M.100.A-D.43 R:0.14900 P:0.09605 F:0.11680
43 ROUGE-SU4 Eval D0703-A.M.100.A-J.43 R:0.15152 P:0.09871 F:0.11954
43 ROUGE-SU4 Eval D0703-B.M.100.A-A.43 R:0.10850 P:0.07365 F:0.08774
43 ROUGE-SU4 Eval D0703-B.M.100.A-C.43 R:0.11667 P:0.07707 F:0.09282
43 ROUGE-SU4 Eval D0703-B.M.100.A-D.43 R:0.11609 P:0.07669 F:0.09236
43 ROUGE-SU4 Eval D0703-B.M.100.A-J.43 R:0.10808 P:0.07213 F:0.08652
43 ROUGE-SU4 Eval D0703-C.M.100.A-A.43 R:0.12500 P:0.08859 F:0.10369
43 ROUGE-SU4 Eval D0703-C.M.100.A-C.43 R:0.12500 P:0.09102 F:0.10534
43 ROUGE-SU4 Eval D0703-C.M.100.A-D.43 R:0.12188 P:0.08697 F:0.10151
43 ROUGE-SU4 Eval D0703-C.M.100.A-J.43 R:0.13152 P:0.09385 F:0.10954
43 ROUGE-SU4 Eval D0706-A.M.100.B-B.43 R:0.14167 P:0.09062 F:0.11054
43 ROUGE-SU4 Eval D0706-A.M.100.B-D.43 R:0.15157 P:0.09630 F:0.11777
43 ROUGE-SU4 Eval D0706-A.M.100.B-E.43 R:0.11000 P:0.07036 F:0.08582
43 ROUGE-SU4 Eval D0706-A.M.100.B-I.43 R:0.13778 P:0.08813 F:0.10750
43 ROUGE-SU4 Eval D0706-B.M.100.B-B.43 R:0.08166 P:0.04523 F:0.05822
43 ROUGE-SU4 Eval D0706-B.M.100.B-D.43 R:0.06243 P:0.03470 F:0.04461
43 ROUGE-SU4 Eval D0706-B.M.100.B-E.43 R:0.09167 P:0.05112 F:0.06564
43 ROUGE-SU4 Eval D0706-B.M.100.B-I.43 R:0.09468 P:0.05297 F:0.06793
43 ROUGE-SU4 Eval D0706-C.M.100.B-B.43 R:0.06567 P:0.04518 F:0.05353
43 ROUGE-SU4 Eval D0706-C.M.100.B-D.43 R:0.08664 P:0.05961 F:0.07063
43 ROUGE-SU4 Eval D0706-C.M.100.B-E.43 R:0.08114 P:0.05619 F:0.06640
43 ROUGE-SU4 Eval D0706-C.M.100.B-I.43 R:0.08470 P:0.05885 F:0.06945
43 ROUGE-SU4 Eval D0711-A.M.100.C-A.43 R:0.13176 P:0.09398 F:0.10971
43 ROUGE-SU4 Eval D0711-A.M.100.C-B.43 R:0.13527 P:0.09518 F:0.11174
43 ROUGE-SU4 Eval D0711-A.M.100.C-C.43 R:0.12272 P:0.08635 F:0.10137
43 ROUGE-SU4 Eval D0711-A.M.100.C-F.43 R:0.13492 P:0.09558 F:0.11189
43 ROUGE-SU4 Eval D0711-B.M.100.C-A.43 R:0.10373 P:0.06326 F:0.07859
43 ROUGE-SU4 Eval D0711-B.M.100.C-B.43 R:0.10211 P:0.06183 F:0.07702
43 ROUGE-SU4 Eval D0711-B.M.100.C-C.43 R:0.09655 P:0.05970 F:0.07378
43 ROUGE-SU4 Eval D0711-B.M.100.C-F.43 R:0.08130 P:0.04975 F:0.06173
43 ROUGE-SU4 Eval D0711-C.M.100.C-A.43 R:0.10565 P:0.07099 F:0.08492
43 ROUGE-SU4 Eval D0711-C.M.100.C-B.43 R:0.12164 P:0.07897 F:0.09577
43 ROUGE-SU4 Eval D0711-C.M.100.C-C.43 R:0.11227 P:0.07365 F:0.08895
43 ROUGE-SU4 Eval D0711-C.M.100.C-F.43 R:0.10185 P:0.06682 F:0.08070
43 ROUGE-SU4 Eval D0716-A.M.100.D-C.43 R:0.16330 P:0.11048 F:0.13179
43 ROUGE-SU4 Eval D0716-A.M.100.D-D.43 R:0.17123 P:0.11390 F:0.13680
43 ROUGE-SU4 Eval D0716-A.M.100.D-E.43 R:0.17008 P:0.11352 F:0.13616
43 ROUGE-SU4 Eval D0716-A.M.100.D-F.43 R:0.15819 P:0.10630 F:0.12715
43 ROUGE-SU4 Eval D0716-B.M.100.D-C.43 R:0.15766 P:0.09079 F:0.11523
43 ROUGE-SU4 Eval D0716-B.M.100.D-D.43 R:0.15977 P:0.09014 F:0.11525
43 ROUGE-SU4 Eval D0716-B.M.100.D-E.43 R:0.13823 P:0.07879 F:0.10037
43 ROUGE-SU4 Eval D0716-B.M.100.D-F.43 R:0.15582 P:0.08852 F:0.11290
43 ROUGE-SU4 Eval D0716-C.M.100.D-C.43 R:0.16388 P:0.11893 F:0.13783
43 ROUGE-SU4 Eval D0716-C.M.100.D-D.43 R:0.25773 P:0.18204 F:0.21337
43 ROUGE-SU4 Eval D0716-C.M.100.D-E.43 R:0.21921 P:0.15696 F:0.18293
43 ROUGE-SU4 Eval D0716-C.M.100.D-F.43 R:0.24087 P:0.17071 F:0.19981
43 ROUGE-SU4 Eval D0721-A.M.100.E-B.43 R:0.10674 P:0.07099 F:0.08527
43 ROUGE-SU4 Eval D0721-A.M.100.E-C.43 R:0.08889 P:0.06074 F:0.07217
43 ROUGE-SU4 Eval D0721-A.M.100.E-E.43 R:0.09889 P:0.06758 F:0.08029
43 ROUGE-SU4 Eval D0721-A.M.100.E-G.43 R:0.09477 P:0.06606 F:0.07785
43 ROUGE-SU4 Eval D0721-B.M.100.E-B.43 R:0.11204 P:0.07683 F:0.09115
43 ROUGE-SU4 Eval D0721-B.M.100.E-C.43 R:0.12255 P:0.08601 F:0.10108
43 ROUGE-SU4 Eval D0721-B.M.100.E-E.43 R:0.09371 P:0.06384 F:0.07594
43 ROUGE-SU4 Eval D0721-B.M.100.E-G.43 R:0.11479 P:0.07951 F:0.09395
43 ROUGE-SU4 Eval D0721-C.M.100.E-B.43 R:0.12682 P:0.09278 F:0.10716
43 ROUGE-SU4 Eval D0721-C.M.100.E-C.43 R:0.11582 P:0.08415 F:0.09748
43 ROUGE-SU4 Eval D0721-C.M.100.E-E.43 R:0.09589 P:0.06897 F:0.08023
43 ROUGE-SU4 Eval D0721-C.M.100.E-G.43 R:0.12096 P:0.08908 F:0.10260
43 ROUGE-SU4 Eval D0726-A.M.100.F-A.43 R:0.20990 P:0.13914 F:0.16735
43 ROUGE-SU4 Eval D0726-A.M.100.F-E.43 R:0.16210 P:0.10709 F:0.12897
43 ROUGE-SU4 Eval D0726-A.M.100.F-F.43 R:0.20421 P:0.13537 F:0.16281
43 ROUGE-SU4 Eval D0726-A.M.100.F-G.43 R:0.17349 P:0.11501 F:0.13832
43 ROUGE-SU4 Eval D0726-B.M.100.F-A.43 R:0.07103 P:0.04725 F:0.05675
43 ROUGE-SU4 Eval D0726-B.M.100.F-E.43 R:0.07167 P:0.04688 F:0.05668
43 ROUGE-SU4 Eval D0726-B.M.100.F-F.43 R:0.07110 P:0.04650 F:0.05623
43 ROUGE-SU4 Eval D0726-B.M.100.F-G.43 R:0.07095 P:0.04688 F:0.05646
43 ROUGE-SU4 Eval D0726-C.M.100.F-A.43 R:0.08505 P:0.05696 F:0.06823
43 ROUGE-SU4 Eval D0726-C.M.100.F-E.43 R:0.08535 P:0.05657 F:0.06804
43 ROUGE-SU4 Eval D0726-C.M.100.F-F.43 R:0.09524 P:0.06269 F:0.07561
43 ROUGE-SU4 Eval D0726-C.M.100.F-G.43 R:0.08474 P:0.05772 F:0.06867
43 ROUGE-SU4 Eval D0727-A.M.100.G-A.43 R:0.15188 P:0.09252 F:0.11499
43 ROUGE-SU4 Eval D0727-A.M.100.G-F.43 R:0.17399 P:0.10707 F:0.13256
43 ROUGE-SU4 Eval D0727-A.M.100.G-G.43 R:0.13870 P:0.08593 F:0.10612
43 ROUGE-SU4 Eval D0727-A.M.100.G-H.43 R:0.16948 P:0.10430 F:0.12913
43 ROUGE-SU4 Eval D0727-B.M.100.G-A.43 R:0.09246 P:0.05440 F:0.06850
43 ROUGE-SU4 Eval D0727-B.M.100.G-F.43 R:0.10278 P:0.06410 F:0.07896
43 ROUGE-SU4 Eval D0727-B.M.100.G-G.43 R:0.09668 P:0.05648 F:0.07130
43 ROUGE-SU4 Eval D0727-B.M.100.G-H.43 R:0.10012 P:0.05891 F:0.07418
43 ROUGE-SU4 Eval D0727-C.M.100.G-A.43 R:0.09197 P:0.05112 F:0.06571
43 ROUGE-SU4 Eval D0727-C.M.100.G-F.43 R:0.09343 P:0.05019 F:0.06530
43 ROUGE-SU4 Eval D0727-C.M.100.G-G.43 R:0.08757 P:0.04802 F:0.06203
43 ROUGE-SU4 Eval D0727-C.M.100.G-H.43 R:0.10475 P:0.05607 F:0.07304
43 ROUGE-SU4 Eval D0736-A.M.100.H-G.43 R:0.08364 P:0.04772 F:0.06077
43 ROUGE-SU4 Eval D0736-A.M.100.H-H.43 R:0.09148 P:0.05123 F:0.06568
43 ROUGE-SU4 Eval D0736-A.M.100.H-I.43 R:0.07998 P:0.04596 F:0.05838
43 ROUGE-SU4 Eval D0736-A.M.100.H-J.43 R:0.08445 P:0.05298 F:0.06511
43 ROUGE-SU4 Eval D0736-B.M.100.H-G.43 R:0.09908 P:0.05366 F:0.06962
43 ROUGE-SU4 Eval D0736-B.M.100.H-H.43 R:0.11040 P:0.05508 F:0.07349
43 ROUGE-SU4 Eval D0736-B.M.100.H-I.43 R:0.11328 P:0.05579 F:0.07476
43 ROUGE-SU4 Eval D0736-B.M.100.H-J.43 R:0.11091 P:0.06574 F:0.08255
43 ROUGE-SU4 Eval D0736-C.M.100.H-G.43 R:0.08515 P:0.04131 F:0.05563
43 ROUGE-SU4 Eval D0736-C.M.100.H-H.43 R:0.12477 P:0.04732 F:0.06862
43 ROUGE-SU4 Eval D0736-C.M.100.H-I.43 R:0.11825 P:0.04484 F:0.06502
43 ROUGE-SU4 Eval D0736-C.M.100.H-J.43 R:0.10700 P:0.05826 F:0.07544
43 ROUGE-SU4 Eval D0740-A.M.100.I-D.43 R:0.09661 P:0.06319 F:0.07641
43 ROUGE-SU4 Eval D0740-A.M.100.I-H.43 R:0.09060 P:0.05987 F:0.07210
43 ROUGE-SU4 Eval D0740-A.M.100.I-I.43 R:0.09000 P:0.05987 F:0.07191
43 ROUGE-SU4 Eval D0740-A.M.100.I-J.43 R:0.09272 P:0.06208 F:0.07437
43 ROUGE-SU4 Eval D0740-B.M.100.I-D.43 R:0.08556 P:0.04994 F:0.06307
43 ROUGE-SU4 Eval D0740-B.M.100.I-H.43 R:0.07653 P:0.04377 F:0.05569
43 ROUGE-SU4 Eval D0740-B.M.100.I-I.43 R:0.09596 P:0.05545 F:0.07029
43 ROUGE-SU4 Eval D0740-B.M.100.I-J.43 R:0.08749 P:0.05123 F:0.06462
43 ROUGE-SU4 Eval D0740-C.M.100.I-D.43 R:0.10656 P:0.07353 F:0.08702
43 ROUGE-SU4 Eval D0740-C.M.100.I-H.43 R:0.11001 P:0.07541 F:0.08948
43 ROUGE-SU4 Eval D0740-C.M.100.I-I.43 R:0.10984 P:0.07579 F:0.08969
43 ROUGE-SU4 Eval D0740-C.M.100.I-J.43 R:0.11983 P:0.08296 F:0.09804
43 ROUGE-SU4 Eval D0743-A.M.100.J-B.43 R:0.07600 P:0.04881 F:0.05944
43 ROUGE-SU4 Eval D0743-A.M.100.J-H.43 R:0.06435 P:0.04254 F:0.05122
43 ROUGE-SU4 Eval D0743-A.M.100.J-I.43 R:0.07746 P:0.05056 F:0.06118
43 ROUGE-SU4 Eval D0743-A.M.100.J-J.43 R:0.05889 P:0.03905 F:0.04696
43 ROUGE-SU4 Eval D0743-B.M.100.J-B.43 R:0.05592 P:0.03556 F:0.04347
43 ROUGE-SU4 Eval D0743-B.M.100.J-H.43 R:0.04854 P:0.03138 F:0.03812
43 ROUGE-SU4 Eval D0743-B.M.100.J-I.43 R:0.05141 P:0.03312 F:0.04029
43 ROUGE-SU4 Eval D0743-B.M.100.J-J.43 R:0.05325 P:0.03487 F:0.04214
43 ROUGE-SU4 Eval D0743-C.M.100.J-B.43 R:0.11998 P:0.08167 F:0.09719
43 ROUGE-SU4 Eval D0743-C.M.100.J-H.43 R:0.07026 P:0.04767 F:0.05680
43 ROUGE-SU4 Eval D0743-C.M.100.J-I.43 R:0.11257 P:0.07613 F:0.09083
43 ROUGE-SU4 Eval D0743-C.M.100.J-J.43 R:0.10591 P:0.07280 F:0.08629
---------------------------------------------
44 ROUGE-1 Average_R: 0.38490 (95%-conf.int. 0.37467 - 0.39495)
44 ROUGE-1 Average_P: 0.21572 (95%-conf.int. 0.20972 - 0.22145)
44 ROUGE-1 Average_F: 0.27590 (95%-conf.int. 0.26900 - 0.28295)
.............................................
44 ROUGE-1 Eval D0703-A.M.100.A-A.44 R:0.36486 P:0.20930 F:0.26601
44 ROUGE-1 Eval D0703-A.M.100.A-C.44 R:0.32886 P:0.18992 F:0.24078
44 ROUGE-1 Eval D0703-A.M.100.A-D.44 R:0.34364 P:0.19380 F:0.24783
44 ROUGE-1 Eval D0703-A.M.100.A-J.44 R:0.35714 P:0.20349 F:0.25926
44 ROUGE-1 Eval D0703-B.M.100.A-A.44 R:0.46732 P:0.27713 F:0.34793
44 ROUGE-1 Eval D0703-B.M.100.A-C.44 R:0.47651 P:0.27519 F:0.34889
44 ROUGE-1 Eval D0703-B.M.100.A-D.44 R:0.45973 P:0.26550 F:0.33661
44 ROUGE-1 Eval D0703-B.M.100.A-J.44 R:0.48173 P:0.28101 F:0.35496
44 ROUGE-1 Eval D0703-C.M.100.A-A.44 R:0.41333 P:0.22711 F:0.29315
44 ROUGE-1 Eval D0703-C.M.100.A-C.44 R:0.38961 P:0.21978 F:0.28103
44 ROUGE-1 Eval D0703-C.M.100.A-D.44 R:0.40397 P:0.22344 F:0.28773
44 ROUGE-1 Eval D0703-C.M.100.A-J.44 R:0.42715 P:0.23626 F:0.30424
44 ROUGE-1 Eval D0706-A.M.100.B-B.44 R:0.35714 P:0.20952 F:0.26410
44 ROUGE-1 Eval D0706-A.M.100.B-D.44 R:0.34314 P:0.20000 F:0.25271
44 ROUGE-1 Eval D0706-A.M.100.B-E.44 R:0.31494 P:0.18476 F:0.23289
44 ROUGE-1 Eval D0706-A.M.100.B-I.44 R:0.35065 P:0.20571 F:0.25930
44 ROUGE-1 Eval D0706-B.M.100.B-B.44 R:0.33007 P:0.19349 F:0.24397
44 ROUGE-1 Eval D0706-B.M.100.B-D.44 R:0.32573 P:0.19157 F:0.24125
44 ROUGE-1 Eval D0706-B.M.100.B-E.44 R:0.28896 P:0.17050 F:0.21446
44 ROUGE-1 Eval D0706-B.M.100.B-I.44 R:0.34304 P:0.20307 F:0.25512
44 ROUGE-1 Eval D0706-C.M.100.B-B.44 R:0.35484 P:0.22634 F:0.27638
44 ROUGE-1 Eval D0706-C.M.100.B-D.44 R:0.36452 P:0.23251 F:0.28392
44 ROUGE-1 Eval D0706-C.M.100.B-E.44 R:0.33974 P:0.21811 F:0.26567
44 ROUGE-1 Eval D0706-C.M.100.B-I.44 R:0.37700 P:0.24280 F:0.29537
44 ROUGE-1 Eval D0711-A.M.100.C-A.44 R:0.37829 P:0.22287 F:0.28049
44 ROUGE-1 Eval D0711-A.M.100.C-B.44 R:0.39333 P:0.22868 F:0.28921
44 ROUGE-1 Eval D0711-A.M.100.C-C.44 R:0.36667 P:0.21318 F:0.26961
44 ROUGE-1 Eval D0711-A.M.100.C-F.44 R:0.41391 P:0.24225 F:0.30563
44 ROUGE-1 Eval D0711-B.M.100.C-A.44 R:0.38776 P:0.21111 F:0.27338
44 ROUGE-1 Eval D0711-B.M.100.C-B.44 R:0.36986 P:0.20000 F:0.25961
44 ROUGE-1 Eval D0711-B.M.100.C-C.44 R:0.36913 P:0.20370 F:0.26253
44 ROUGE-1 Eval D0711-B.M.100.C-F.44 R:0.36949 P:0.20185 F:0.26108
44 ROUGE-1 Eval D0711-C.M.100.C-A.44 R:0.44884 P:0.26511 F:0.33333
44 ROUGE-1 Eval D0711-C.M.100.C-B.44 R:0.44027 P:0.25146 F:0.32010
44 ROUGE-1 Eval D0711-C.M.100.C-C.44 R:0.44932 P:0.25926 F:0.32880
44 ROUGE-1 Eval D0711-C.M.100.C-F.44 R:0.42905 P:0.24756 F:0.31396
44 ROUGE-1 Eval D0716-A.M.100.D-C.44 R:0.48197 P:0.27684 F:0.35168
44 ROUGE-1 Eval D0716-A.M.100.D-D.44 R:0.47333 P:0.26742 F:0.34176
44 ROUGE-1 Eval D0716-A.M.100.D-E.44 R:0.52159 P:0.29567 F:0.37740
44 ROUGE-1 Eval D0716-A.M.100.D-F.44 R:0.49835 P:0.28437 F:0.36211
44 ROUGE-1 Eval D0716-B.M.100.D-C.44 R:0.45724 P:0.26628 F:0.33656
44 ROUGE-1 Eval D0716-B.M.100.D-D.44 R:0.47315 P:0.27011 F:0.34390
44 ROUGE-1 Eval D0716-B.M.100.D-E.44 R:0.44518 P:0.25670 F:0.32563
44 ROUGE-1 Eval D0716-B.M.100.D-F.44 R:0.45000 P:0.25862 F:0.32847
44 ROUGE-1 Eval D0716-C.M.100.D-C.44 R:0.36808 P:0.20035 F:0.25947
44 ROUGE-1 Eval D0716-C.M.100.D-D.44 R:0.36120 P:0.19149 F:0.25029
44 ROUGE-1 Eval D0716-C.M.100.D-E.44 R:0.38614 P:0.20745 F:0.26990
44 ROUGE-1 Eval D0716-C.M.100.D-F.44 R:0.38333 P:0.20390 F:0.26620
44 ROUGE-1 Eval D0721-A.M.100.E-B.44 R:0.39667 P:0.21558 F:0.27934
44 ROUGE-1 Eval D0721-A.M.100.E-C.44 R:0.38636 P:0.21558 F:0.27674
44 ROUGE-1 Eval D0721-A.M.100.E-E.44 R:0.38312 P:0.21377 F:0.27442
44 ROUGE-1 Eval D0721-A.M.100.E-G.44 R:0.40446 P:0.23007 F:0.29330
44 ROUGE-1 Eval D0721-B.M.100.E-B.44 R:0.41368 P:0.24612 F:0.30862
44 ROUGE-1 Eval D0721-B.M.100.E-C.44 R:0.41401 P:0.25194 F:0.31325
44 ROUGE-1 Eval D0721-B.M.100.E-E.44 R:0.39016 P:0.23062 F:0.28989
44 ROUGE-1 Eval D0721-B.M.100.E-G.44 R:0.40323 P:0.24225 F:0.30267
44 ROUGE-1 Eval D0721-C.M.100.E-B.44 R:0.39344 P:0.25000 F:0.30573
44 ROUGE-1 Eval D0721-C.M.100.E-C.44 R:0.34653 P:0.21875 F:0.26820
44 ROUGE-1 Eval D0721-C.M.100.E-E.44 R:0.34333 P:0.21458 F:0.26410
44 ROUGE-1 Eval D0721-C.M.100.E-G.44 R:0.32899 P:0.21042 F:0.25667
44 ROUGE-1 Eval D0726-A.M.100.F-A.44 R:0.40864 P:0.22283 F:0.28840
44 ROUGE-1 Eval D0726-A.M.100.F-E.44 R:0.38000 P:0.20652 F:0.26760
44 ROUGE-1 Eval D0726-A.M.100.F-F.44 R:0.41196 P:0.22464 F:0.29074
44 ROUGE-1 Eval D0726-A.M.100.F-G.44 R:0.39535 P:0.21558 F:0.27902
44 ROUGE-1 Eval D0726-B.M.100.F-A.44 R:0.38235 P:0.19598 F:0.25914
44 ROUGE-1 Eval D0726-B.M.100.F-E.44 R:0.36213 P:0.18258 F:0.24276
44 ROUGE-1 Eval D0726-B.M.100.F-F.44 R:0.38206 P:0.19263 F:0.25612
44 ROUGE-1 Eval D0726-B.M.100.F-G.44 R:0.37829 P:0.19263 F:0.25527
44 ROUGE-1 Eval D0726-C.M.100.F-A.44 R:0.38333 P:0.20721 F:0.26901
44 ROUGE-1 Eval D0726-C.M.100.F-E.44 R:0.40067 P:0.21441 F:0.27934
44 ROUGE-1 Eval D0726-C.M.100.F-F.44 R:0.40678 P:0.21622 F:0.28236
44 ROUGE-1 Eval D0726-C.M.100.F-G.44 R:0.38361 P:0.21081 F:0.27209
44 ROUGE-1 Eval D0727-A.M.100.G-A.44 R:0.43522 P:0.22279 F:0.29471
44 ROUGE-1 Eval D0727-A.M.100.G-F.44 R:0.45395 P:0.23469 F:0.30941
44 ROUGE-1 Eval D0727-A.M.100.G-G.44 R:0.42484 P:0.22109 F:0.29083
44 ROUGE-1 Eval D0727-A.M.100.G-H.44 R:0.44408 P:0.22959 F:0.30269
44 ROUGE-1 Eval D0727-B.M.100.G-A.44 R:0.40893 P:0.22797 F:0.29274
44 ROUGE-1 Eval D0727-B.M.100.G-F.44 R:0.41558 P:0.24521 F:0.30843
44 ROUGE-1 Eval D0727-B.M.100.G-G.44 R:0.38062 P:0.21073 F:0.27127
44 ROUGE-1 Eval D0727-B.M.100.G-H.44 R:0.40206 P:0.22414 F:0.28782
44 ROUGE-1 Eval D0727-C.M.100.G-A.44 R:0.42997 P:0.23656 F:0.30520
44 ROUGE-1 Eval D0727-C.M.100.G-F.44 R:0.46128 P:0.24552 F:0.32047
44 ROUGE-1 Eval D0727-C.M.100.G-G.44 R:0.41584 P:0.22581 F:0.29269
44 ROUGE-1 Eval D0727-C.M.100.G-H.44 R:0.44932 P:0.23835 F:0.31147
44 ROUGE-1 Eval D0736-A.M.100.H-G.44 R:0.34409 P:0.17112 F:0.22857
44 ROUGE-1 Eval D0736-A.M.100.H-H.44 R:0.38321 P:0.18717 F:0.25150
44 ROUGE-1 Eval D0736-A.M.100.H-I.44 R:0.34875 P:0.17469 F:0.23278
44 ROUGE-1 Eval D0736-A.M.100.H-J.44 R:0.34641 P:0.18895 F:0.24452
44 ROUGE-1 Eval D0736-B.M.100.H-G.44 R:0.44656 P:0.22414 F:0.29847
44 ROUGE-1 Eval D0736-B.M.100.H-H.44 R:0.45455 P:0.21073 F:0.28796
44 ROUGE-1 Eval D0736-B.M.100.H-I.44 R:0.49791 P:0.22797 F:0.31275
44 ROUGE-1 Eval D0736-B.M.100.H-J.44 R:0.46853 P:0.25670 F:0.33168
44 ROUGE-1 Eval D0736-C.M.100.H-G.44 R:0.41772 P:0.17838 F:0.25000
44 ROUGE-1 Eval D0736-C.M.100.H-H.44 R:0.40107 P:0.13514 F:0.20216
44 ROUGE-1 Eval D0736-C.M.100.H-I.44 R:0.48663 P:0.16396 F:0.24528
44 ROUGE-1 Eval D0736-C.M.100.H-J.44 R:0.40377 P:0.19279 F:0.26097
44 ROUGE-1 Eval D0740-A.M.100.I-D.44 R:0.33333 P:0.20654 F:0.25505
44 ROUGE-1 Eval D0740-A.M.100.I-H.44 R:0.32353 P:0.20245 F:0.24905
44 ROUGE-1 Eval D0740-A.M.100.I-I.44 R:0.34091 P:0.21472 F:0.26349
44 ROUGE-1 Eval D0740-A.M.100.I-J.44 R:0.33226 P:0.21063 F:0.25782
44 ROUGE-1 Eval D0740-B.M.100.I-D.44 R:0.29870 P:0.17726 F:0.22249
44 ROUGE-1 Eval D0740-B.M.100.I-H.44 R:0.29139 P:0.16956 F:0.21438
44 ROUGE-1 Eval D0740-B.M.100.I-I.44 R:0.31148 P:0.18304 F:0.23058
44 ROUGE-1 Eval D0740-B.M.100.I-J.44 R:0.27508 P:0.16378 F:0.20532
44 ROUGE-1 Eval D0740-C.M.100.I-D.44 R:0.36102 P:0.21773 F:0.27164
44 ROUGE-1 Eval D0740-C.M.100.I-H.44 R:0.33441 P:0.20039 F:0.25061
44 ROUGE-1 Eval D0740-C.M.100.I-I.44 R:0.34824 P:0.21002 F:0.26202
44 ROUGE-1 Eval D0740-C.M.100.I-J.44 R:0.38535 P:0.23314 F:0.29052
44 ROUGE-1 Eval D0743-A.M.100.J-B.44 R:0.31111 P:0.17658 F:0.22529
44 ROUGE-1 Eval D0743-A.M.100.J-H.44 R:0.28086 P:0.16396 F:0.20705
44 ROUGE-1 Eval D0743-A.M.100.J-I.44 R:0.31875 P:0.18378 F:0.23314
44 ROUGE-1 Eval D0743-A.M.100.J-J.44 R:0.27692 P:0.16216 F:0.20454
44 ROUGE-1 Eval D0743-B.M.100.J-B.44 R:0.28205 P:0.14815 F:0.19426
44 ROUGE-1 Eval D0743-B.M.100.J-H.44 R:0.27129 P:0.14478 F:0.18880
44 ROUGE-1 Eval D0743-B.M.100.J-I.44 R:0.30063 P:0.15993 F:0.20879
44 ROUGE-1 Eval D0743-B.M.100.J-J.44 R:0.27414 P:0.14815 F:0.19235
44 ROUGE-1 Eval D0743-C.M.100.J-B.44 R:0.35873 P:0.22828 F:0.27901
44 ROUGE-1 Eval D0743-C.M.100.J-H.44 R:0.34076 P:0.21616 F:0.26452
44 ROUGE-1 Eval D0743-C.M.100.J-I.44 R:0.37380 P:0.23636 F:0.28960
44 ROUGE-1 Eval D0743-C.M.100.J-J.44 R:0.31761 P:0.20404 F:0.24846
---------------------------------------------
44 ROUGE-2 Average_R: 0.09423 (95%-conf.int. 0.08728 - 0.10138)
44 ROUGE-2 Average_P: 0.05231 (95%-conf.int. 0.04867 - 0.05624)
44 ROUGE-2 Average_F: 0.06712 (95%-conf.int. 0.06246 - 0.07208)
.............................................
44 ROUGE-2 Eval D0703-A.M.100.A-A.44 R:0.13652 P:0.07797 F:0.09925
44 ROUGE-2 Eval D0703-A.M.100.A-C.44 R:0.11186 P:0.06433 F:0.08168
44 ROUGE-2 Eval D0703-A.M.100.A-D.44 R:0.12500 P:0.07018 F:0.08989
44 ROUGE-2 Eval D0703-A.M.100.A-J.44 R:0.12027 P:0.06823 F:0.08707
44 ROUGE-2 Eval D0703-B.M.100.A-A.44 R:0.17162 P:0.10136 F:0.12745
44 ROUGE-2 Eval D0703-B.M.100.A-C.44 R:0.16271 P:0.09357 F:0.11881
44 ROUGE-2 Eval D0703-B.M.100.A-D.44 R:0.16949 P:0.09747 F:0.12377
44 ROUGE-2 Eval D0703-B.M.100.A-J.44 R:0.18121 P:0.10526 F:0.13317
44 ROUGE-2 Eval D0703-C.M.100.A-A.44 R:0.16162 P:0.08840 F:0.11429
44 ROUGE-2 Eval D0703-C.M.100.A-C.44 R:0.13115 P:0.07366 F:0.09434
44 ROUGE-2 Eval D0703-C.M.100.A-D.44 R:0.14716 P:0.08103 F:0.10451
44 ROUGE-2 Eval D0703-C.M.100.A-J.44 R:0.16054 P:0.08840 F:0.11402
44 ROUGE-2 Eval D0706-A.M.100.B-B.44 R:0.05902 P:0.03448 F:0.04353
44 ROUGE-2 Eval D0706-A.M.100.B-D.44 R:0.06601 P:0.03831 F:0.04848
44 ROUGE-2 Eval D0706-A.M.100.B-E.44 R:0.05246 P:0.03065 F:0.03869
44 ROUGE-2 Eval D0706-A.M.100.B-I.44 R:0.06885 P:0.04023 F:0.05079
44 ROUGE-2 Eval D0706-B.M.100.B-B.44 R:0.10561 P:0.06166 F:0.07786
44 ROUGE-2 Eval D0706-B.M.100.B-D.44 R:0.08224 P:0.04817 F:0.06075
44 ROUGE-2 Eval D0706-B.M.100.B-E.44 R:0.05246 P:0.03083 F:0.03884
44 ROUGE-2 Eval D0706-B.M.100.B-I.44 R:0.09477 P:0.05588 F:0.07031
44 ROUGE-2 Eval D0706-C.M.100.B-B.44 R:0.08469 P:0.05383 F:0.06582
44 ROUGE-2 Eval D0706-C.M.100.B-D.44 R:0.09121 P:0.05797 F:0.07089
44 ROUGE-2 Eval D0706-C.M.100.B-E.44 R:0.04207 P:0.02692 F:0.03283
44 ROUGE-2 Eval D0706-C.M.100.B-I.44 R:0.09355 P:0.06004 F:0.07314
44 ROUGE-2 Eval D0711-A.M.100.C-A.44 R:0.05316 P:0.03119 F:0.03931
44 ROUGE-2 Eval D0711-A.M.100.C-B.44 R:0.05051 P:0.02924 F:0.03704
44 ROUGE-2 Eval D0711-A.M.100.C-C.44 R:0.04040 P:0.02339 F:0.02963
44 ROUGE-2 Eval D0711-A.M.100.C-F.44 R:0.05686 P:0.03314 F:0.04187
44 ROUGE-2 Eval D0711-B.M.100.C-A.44 R:0.05842 P:0.03166 F:0.04107
44 ROUGE-2 Eval D0711-B.M.100.C-B.44 R:0.08304 P:0.04469 F:0.05811
44 ROUGE-2 Eval D0711-B.M.100.C-C.44 R:0.06441 P:0.03538 F:0.04567
44 ROUGE-2 Eval D0711-B.M.100.C-F.44 R:0.06164 P:0.03352 F:0.04343
44 ROUGE-2 Eval D0711-C.M.100.C-A.44 R:0.10667 P:0.06275 F:0.07902
44 ROUGE-2 Eval D0711-C.M.100.C-B.44 R:0.10690 P:0.06078 F:0.07750
44 ROUGE-2 Eval D0711-C.M.100.C-C.44 R:0.08532 P:0.04902 F:0.06227
44 ROUGE-2 Eval D0711-C.M.100.C-F.44 R:0.09898 P:0.05686 F:0.07223
44 ROUGE-2 Eval D0716-A.M.100.D-C.44 R:0.17219 P:0.09848 F:0.12530
44 ROUGE-2 Eval D0716-A.M.100.D-D.44 R:0.14815 P:0.08333 F:0.10666
44 ROUGE-2 Eval D0716-A.M.100.D-E.44 R:0.19799 P:0.11174 F:0.14286
44 ROUGE-2 Eval D0716-A.M.100.D-F.44 R:0.18333 P:0.10417 F:0.13285
44 ROUGE-2 Eval D0716-B.M.100.D-C.44 R:0.08306 P:0.04817 F:0.06098
44 ROUGE-2 Eval D0716-B.M.100.D-D.44 R:0.08475 P:0.04817 F:0.06143
44 ROUGE-2 Eval D0716-B.M.100.D-E.44 R:0.07047 P:0.04046 F:0.05141
44 ROUGE-2 Eval D0716-B.M.100.D-F.44 R:0.09428 P:0.05395 F:0.06863
44 ROUGE-2 Eval D0716-C.M.100.D-C.44 R:0.08882 P:0.04813 F:0.06243
44 ROUGE-2 Eval D0716-C.M.100.D-D.44 R:0.09122 P:0.04813 F:0.06301
44 ROUGE-2 Eval D0716-C.M.100.D-E.44 R:0.07667 P:0.04100 F:0.05343
44 ROUGE-2 Eval D0716-C.M.100.D-F.44 R:0.09428 P:0.04991 F:0.06527
44 ROUGE-2 Eval D0721-A.M.100.E-B.44 R:0.08754 P:0.04736 F:0.06147
44 ROUGE-2 Eval D0721-A.M.100.E-C.44 R:0.09180 P:0.05100 F:0.06557
44 ROUGE-2 Eval D0721-A.M.100.E-E.44 R:0.09180 P:0.05100 F:0.06557
44 ROUGE-2 Eval D0721-A.M.100.E-G.44 R:0.10289 P:0.05829 F:0.07442
44 ROUGE-2 Eval D0721-B.M.100.E-B.44 R:0.06579 P:0.03899 F:0.04896
44 ROUGE-2 Eval D0721-B.M.100.E-C.44 R:0.07074 P:0.04288 F:0.05339
44 ROUGE-2 Eval D0721-B.M.100.E-E.44 R:0.06291 P:0.03704 F:0.04663
44 ROUGE-2 Eval D0721-B.M.100.E-G.44 R:0.05537 P:0.03314 F:0.04146
44 ROUGE-2 Eval D0721-C.M.100.E-B.44 R:0.10265 P:0.06499 F:0.07959
44 ROUGE-2 Eval D0721-C.M.100.E-C.44 R:0.10000 P:0.06289 F:0.07722
44 ROUGE-2 Eval D0721-C.M.100.E-E.44 R:0.10101 P:0.06289 F:0.07752
44 ROUGE-2 Eval D0721-C.M.100.E-G.44 R:0.10526 P:0.06709 F:0.08195
44 ROUGE-2 Eval D0726-A.M.100.F-A.44 R:0.06711 P:0.03643 F:0.04722
44 ROUGE-2 Eval D0726-A.M.100.F-E.44 R:0.05724 P:0.03097 F:0.04019
44 ROUGE-2 Eval D0726-A.M.100.F-F.44 R:0.07718 P:0.04189 F:0.05431
44 ROUGE-2 Eval D0726-A.M.100.F-G.44 R:0.06040 P:0.03279 F:0.04250
44 ROUGE-2 Eval D0726-B.M.100.F-A.44 R:0.08251 P:0.04209 F:0.05574
44 ROUGE-2 Eval D0726-B.M.100.F-E.44 R:0.05369 P:0.02694 F:0.03588
44 ROUGE-2 Eval D0726-B.M.100.F-F.44 R:0.07383 P:0.03704 F:0.04933
44 ROUGE-2 Eval D0726-B.M.100.F-G.44 R:0.06977 P:0.03535 F:0.04692
44 ROUGE-2 Eval D0726-C.M.100.F-A.44 R:0.06734 P:0.03623 F:0.04711
44 ROUGE-2 Eval D0726-C.M.100.F-E.44 R:0.07823 P:0.04167 F:0.05438
44 ROUGE-2 Eval D0726-C.M.100.F-F.44 R:0.07534 P:0.03986 F:0.05214
44 ROUGE-2 Eval D0726-C.M.100.F-G.44 R:0.06291 P:0.03442 F:0.04450
44 ROUGE-2 Eval D0727-A.M.100.G-A.44 R:0.12081 P:0.06154 F:0.08154
44 ROUGE-2 Eval D0727-A.M.100.G-F.44 R:0.14950 P:0.07692 F:0.10158
44 ROUGE-2 Eval D0727-A.M.100.G-G.44 R:0.12871 P:0.06667 F:0.08784
44 ROUGE-2 Eval D0727-A.M.100.G-H.44 R:0.14950 P:0.07692 F:0.10158
44 ROUGE-2 Eval D0727-B.M.100.G-A.44 R:0.09028 P:0.05010 F:0.06444
44 ROUGE-2 Eval D0727-B.M.100.G-F.44 R:0.10164 P:0.05973 F:0.07524
44 ROUGE-2 Eval D0727-B.M.100.G-G.44 R:0.06294 P:0.03468 F:0.04472
44 ROUGE-2 Eval D0727-B.M.100.G-H.44 R:0.09375 P:0.05202 F:0.06691
44 ROUGE-2 Eval D0727-C.M.100.G-A.44 R:0.12500 P:0.06847 F:0.08848
44 ROUGE-2 Eval D0727-C.M.100.G-F.44 R:0.17347 P:0.09189 F:0.12014
44 ROUGE-2 Eval D0727-C.M.100.G-G.44 R:0.10333 P:0.05586 F:0.07252
44 ROUGE-2 Eval D0727-C.M.100.G-H.44 R:0.15358 P:0.08108 F:0.10613
44 ROUGE-2 Eval D0736-A.M.100.H-G.44 R:0.10145 P:0.05018 F:0.06715
44 ROUGE-2 Eval D0736-A.M.100.H-H.44 R:0.10332 P:0.05018 F:0.06755
44 ROUGE-2 Eval D0736-A.M.100.H-I.44 R:0.10072 P:0.05018 F:0.06699
44 ROUGE-2 Eval D0736-A.M.100.H-J.44 R:0.07921 P:0.04301 F:0.05575
44 ROUGE-2 Eval D0736-B.M.100.H-G.44 R:0.10811 P:0.05395 F:0.07198
44 ROUGE-2 Eval D0736-B.M.100.H-H.44 R:0.15481 P:0.07129 F:0.09762
44 ROUGE-2 Eval D0736-B.M.100.H-I.44 R:0.17797 P:0.08092 F:0.11125
44 ROUGE-2 Eval D0736-B.M.100.H-J.44 R:0.16254 P:0.08863 F:0.11471
44 ROUGE-2 Eval D0736-C.M.100.H-G.44 R:0.12393 P:0.05254 F:0.07379
44 ROUGE-2 Eval D0736-C.M.100.H-H.44 R:0.10870 P:0.03623 F:0.05435
44 ROUGE-2 Eval D0736-C.M.100.H-I.44 R:0.14130 P:0.04710 F:0.07065
44 ROUGE-2 Eval D0736-C.M.100.H-J.44 R:0.11450 P:0.05435 F:0.07371
44 ROUGE-2 Eval D0740-A.M.100.I-D.44 R:0.10333 P:0.06379 F:0.07888
44 ROUGE-2 Eval D0740-A.M.100.I-H.44 R:0.08251 P:0.05144 F:0.06337
44 ROUGE-2 Eval D0740-A.M.100.I-I.44 R:0.08525 P:0.05350 F:0.06574
44 ROUGE-2 Eval D0740-A.M.100.I-J.44 R:0.07492 P:0.04733 F:0.05801
44 ROUGE-2 Eval D0740-B.M.100.I-D.44 R:0.03934 P:0.02326 F:0.02923
44 ROUGE-2 Eval D0740-B.M.100.I-H.44 R:0.04348 P:0.02519 F:0.03190
44 ROUGE-2 Eval D0740-B.M.100.I-I.44 R:0.04967 P:0.02907 F:0.03668
44 ROUGE-2 Eval D0740-B.M.100.I-J.44 R:0.03595 P:0.02132 F:0.02677
44 ROUGE-2 Eval D0740-C.M.100.I-D.44 R:0.10323 P:0.06202 F:0.07749
44 ROUGE-2 Eval D0740-C.M.100.I-H.44 R:0.07792 P:0.04651 F:0.05825
44 ROUGE-2 Eval D0740-C.M.100.I-I.44 R:0.08387 P:0.05039 F:0.06296
44 ROUGE-2 Eval D0740-C.M.100.I-J.44 R:0.11254 P:0.06783 F:0.08464
44 ROUGE-2 Eval D0743-A.M.100.J-B.44 R:0.07051 P:0.03986 F:0.05093
44 ROUGE-2 Eval D0743-A.M.100.J-H.44 R:0.04361 P:0.02536 F:0.03207
44 ROUGE-2 Eval D0743-A.M.100.J-I.44 R:0.06940 P:0.03986 F:0.05064
44 ROUGE-2 Eval D0743-A.M.100.J-J.44 R:0.04348 P:0.02536 F:0.03204
44 ROUGE-2 Eval D0743-B.M.100.J-B.44 R:0.04854 P:0.02538 F:0.03333
44 ROUGE-2 Eval D0743-B.M.100.J-H.44 R:0.03185 P:0.01692 F:0.02210
44 ROUGE-2 Eval D0743-B.M.100.J-I.44 R:0.04792 P:0.02538 F:0.03318
44 ROUGE-2 Eval D0743-B.M.100.J-J.44 R:0.03459 P:0.01861 F:0.02420
44 ROUGE-2 Eval D0743-C.M.100.J-B.44 R:0.06731 P:0.04268 F:0.05224
44 ROUGE-2 Eval D0743-C.M.100.J-H.44 R:0.04823 P:0.03049 F:0.03736
44 ROUGE-2 Eval D0743-C.M.100.J-I.44 R:0.07419 P:0.04675 F:0.05736
44 ROUGE-2 Eval D0743-C.M.100.J-J.44 R:0.06032 P:0.03862 F:0.04709
---------------------------------------------
44 ROUGE-3 Average_R: 0.03722 (95%-conf.int. 0.03244 - 0.04238)
44 ROUGE-3 Average_P: 0.02048 (95%-conf.int. 0.01793 - 0.02321)
44 ROUGE-3 Average_F: 0.02636 (95%-conf.int. 0.02298 - 0.02987)
.............................................
44 ROUGE-3 Eval D0703-A.M.100.A-A.44 R:0.06207 P:0.03529 F:0.04500
44 ROUGE-3 Eval D0703-A.M.100.A-C.44 R:0.04795 P:0.02745 F:0.03491
44 ROUGE-3 Eval D0703-A.M.100.A-D.44 R:0.05263 P:0.02941 F:0.03773
44 ROUGE-3 Eval D0703-A.M.100.A-J.44 R:0.04514 P:0.02549 F:0.03258
44 ROUGE-3 Eval D0703-B.M.100.A-A.44 R:0.07667 P:0.04510 F:0.05679
44 ROUGE-3 Eval D0703-B.M.100.A-C.44 R:0.06164 P:0.03529 F:0.04488
44 ROUGE-3 Eval D0703-B.M.100.A-D.44 R:0.06507 P:0.03725 F:0.04738
44 ROUGE-3 Eval D0703-B.M.100.A-J.44 R:0.08136 P:0.04706 F:0.05963
44 ROUGE-3 Eval D0703-C.M.100.A-A.44 R:0.07823 P:0.04259 F:0.05515
44 ROUGE-3 Eval D0703-C.M.100.A-C.44 R:0.05960 P:0.03333 F:0.04275
44 ROUGE-3 Eval D0703-C.M.100.A-D.44 R:0.07432 P:0.04074 F:0.05263
44 ROUGE-3 Eval D0703-C.M.100.A-J.44 R:0.08108 P:0.04444 F:0.05741
44 ROUGE-3 Eval D0706-A.M.100.B-B.44 R:0.01325 P:0.00771 F:0.00975
44 ROUGE-3 Eval D0706-A.M.100.B-D.44 R:0.01667 P:0.00963 F:0.01221
44 ROUGE-3 Eval D0706-A.M.100.B-E.44 R:0.00993 P:0.00578 F:0.00731
44 ROUGE-3 Eval D0706-A.M.100.B-I.44 R:0.01987 P:0.01156 F:0.01462
44 ROUGE-3 Eval D0706-B.M.100.B-B.44 R:0.03000 P:0.01744 F:0.02206
44 ROUGE-3 Eval D0706-B.M.100.B-D.44 R:0.02326 P:0.01357 F:0.01714
44 ROUGE-3 Eval D0706-B.M.100.B-E.44 R:0.00662 P:0.00388 F:0.00489
44 ROUGE-3 Eval D0706-B.M.100.B-I.44 R:0.02970 P:0.01744 F:0.02198
44 ROUGE-3 Eval D0706-C.M.100.B-B.44 R:0.04605 P:0.02917 F:0.03572
44 ROUGE-3 Eval D0706-C.M.100.B-D.44 R:0.04605 P:0.02917 F:0.03572
44 ROUGE-3 Eval D0706-C.M.100.B-E.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-3 Eval D0706-C.M.100.B-I.44 R:0.04560 P:0.02917 F:0.03558
44 ROUGE-3 Eval D0711-A.M.100.C-A.44 R:0.01007 P:0.00588 F:0.00742
44 ROUGE-3 Eval D0711-A.M.100.C-B.44 R:0.01020 P:0.00588 F:0.00746
44 ROUGE-3 Eval D0711-A.M.100.C-C.44 R:0.00340 P:0.00196 F:0.00249
44 ROUGE-3 Eval D0711-A.M.100.C-F.44 R:0.00676 P:0.00392 F:0.00496
44 ROUGE-3 Eval D0711-B.M.100.C-A.44 R:0.00694 P:0.00375 F:0.00487
44 ROUGE-3 Eval D0711-B.M.100.C-B.44 R:0.01399 P:0.00749 F:0.00976
44 ROUGE-3 Eval D0711-B.M.100.C-C.44 R:0.00685 P:0.00375 F:0.00485
44 ROUGE-3 Eval D0711-B.M.100.C-F.44 R:0.01384 P:0.00749 F:0.00972
44 ROUGE-3 Eval D0711-C.M.100.C-A.44 R:0.07071 P:0.04142 F:0.05224
44 ROUGE-3 Eval D0711-C.M.100.C-B.44 R:0.06969 P:0.03945 F:0.05038
44 ROUGE-3 Eval D0711-C.M.100.C-C.44 R:0.05172 P:0.02959 F:0.03764
44 ROUGE-3 Eval D0711-C.M.100.C-F.44 R:0.06552 P:0.03748 F:0.04768
44 ROUGE-3 Eval D0716-A.M.100.D-C.44 R:0.08696 P:0.04952 F:0.06310
44 ROUGE-3 Eval D0716-A.M.100.D-D.44 R:0.06803 P:0.03810 F:0.04884
44 ROUGE-3 Eval D0716-A.M.100.D-E.44 R:0.09492 P:0.05333 F:0.06829
44 ROUGE-3 Eval D0716-A.M.100.D-F.44 R:0.08418 P:0.04762 F:0.06083
44 ROUGE-3 Eval D0716-B.M.100.D-C.44 R:0.01678 P:0.00969 F:0.01229
44 ROUGE-3 Eval D0716-B.M.100.D-D.44 R:0.02397 P:0.01357 F:0.01733
44 ROUGE-3 Eval D0716-B.M.100.D-E.44 R:0.01356 P:0.00775 F:0.00986
44 ROUGE-3 Eval D0716-B.M.100.D-F.44 R:0.02721 P:0.01550 F:0.01975
44 ROUGE-3 Eval D0716-C.M.100.D-C.44 R:0.04319 P:0.02330 F:0.03027
44 ROUGE-3 Eval D0716-C.M.100.D-D.44 R:0.04778 P:0.02509 F:0.03290
44 ROUGE-3 Eval D0716-C.M.100.D-E.44 R:0.02694 P:0.01434 F:0.01872
44 ROUGE-3 Eval D0716-C.M.100.D-F.44 R:0.04422 P:0.02330 F:0.03052
44 ROUGE-3 Eval D0721-A.M.100.E-B.44 R:0.01701 P:0.00916 F:0.01191
44 ROUGE-3 Eval D0721-A.M.100.E-C.44 R:0.02649 P:0.01465 F:0.01887
44 ROUGE-3 Eval D0721-A.M.100.E-E.44 R:0.01987 P:0.01099 F:0.01415
44 ROUGE-3 Eval D0721-A.M.100.E-G.44 R:0.02597 P:0.01465 F:0.01873
44 ROUGE-3 Eval D0721-B.M.100.E-B.44 R:0.00664 P:0.00392 F:0.00493
44 ROUGE-3 Eval D0721-B.M.100.E-C.44 R:0.01299 P:0.00784 F:0.00978
44 ROUGE-3 Eval D0721-B.M.100.E-E.44 R:0.01338 P:0.00784 F:0.00989
44 ROUGE-3 Eval D0721-B.M.100.E-G.44 R:0.00658 P:0.00392 F:0.00491
44 ROUGE-3 Eval D0721-C.M.100.E-B.44 R:0.04348 P:0.02743 F:0.03364
44 ROUGE-3 Eval D0721-C.M.100.E-C.44 R:0.04377 P:0.02743 F:0.03373
44 ROUGE-3 Eval D0721-C.M.100.E-E.44 R:0.05102 P:0.03165 F:0.03907
44 ROUGE-3 Eval D0721-C.M.100.E-G.44 R:0.06312 P:0.04008 F:0.04903
44 ROUGE-3 Eval D0726-A.M.100.F-A.44 R:0.01356 P:0.00733 F:0.00952
44 ROUGE-3 Eval D0726-A.M.100.F-E.44 R:0.00680 P:0.00366 F:0.00476
44 ROUGE-3 Eval D0726-A.M.100.F-F.44 R:0.01356 P:0.00733 F:0.00952
44 ROUGE-3 Eval D0726-A.M.100.F-G.44 R:0.00678 P:0.00366 F:0.00475
44 ROUGE-3 Eval D0726-B.M.100.F-A.44 R:0.03333 P:0.01692 F:0.02245
44 ROUGE-3 Eval D0726-B.M.100.F-E.44 R:0.02034 P:0.01015 F:0.01354
44 ROUGE-3 Eval D0726-B.M.100.F-F.44 R:0.03051 P:0.01523 F:0.02032
44 ROUGE-3 Eval D0726-B.M.100.F-G.44 R:0.02685 P:0.01354 F:0.01800
44 ROUGE-3 Eval D0726-C.M.100.F-A.44 R:0.02041 P:0.01093 F:0.01424
44 ROUGE-3 Eval D0726-C.M.100.F-E.44 R:0.02062 P:0.01093 F:0.01429
44 ROUGE-3 Eval D0726-C.M.100.F-F.44 R:0.02422 P:0.01275 F:0.01671
44 ROUGE-3 Eval D0726-C.M.100.F-G.44 R:0.01672 P:0.00911 F:0.01179
44 ROUGE-3 Eval D0727-A.M.100.G-A.44 R:0.04407 P:0.02234 F:0.02965
44 ROUGE-3 Eval D0727-A.M.100.G-F.44 R:0.07718 P:0.03952 F:0.05227
44 ROUGE-3 Eval D0727-A.M.100.G-G.44 R:0.05333 P:0.02749 F:0.03628
44 ROUGE-3 Eval D0727-A.M.100.G-H.44 R:0.07718 P:0.03952 F:0.05227
44 ROUGE-3 Eval D0727-B.M.100.G-A.44 R:0.03860 P:0.02132 F:0.02747
44 ROUGE-3 Eval D0727-B.M.100.G-F.44 R:0.03642 P:0.02132 F:0.02690
44 ROUGE-3 Eval D0727-B.M.100.G-G.44 R:0.01413 P:0.00775 F:0.01001
44 ROUGE-3 Eval D0727-B.M.100.G-H.44 R:0.03509 P:0.01938 F:0.02497
44 ROUGE-3 Eval D0727-C.M.100.G-A.44 R:0.06977 P:0.03804 F:0.04924
44 ROUGE-3 Eval D0727-C.M.100.G-F.44 R:0.10997 P:0.05797 F:0.07592
44 ROUGE-3 Eval D0727-C.M.100.G-G.44 R:0.05387 P:0.02899 F:0.03769
44 ROUGE-3 Eval D0727-C.M.100.G-H.44 R:0.09310 P:0.04891 F:0.06413
44 ROUGE-3 Eval D0736-A.M.100.H-G.44 R:0.05861 P:0.02883 F:0.03865
44 ROUGE-3 Eval D0736-A.M.100.H-H.44 R:0.06343 P:0.03063 F:0.04131
44 ROUGE-3 Eval D0736-A.M.100.H-I.44 R:0.06182 P:0.03063 F:0.04096
44 ROUGE-3 Eval D0736-A.M.100.H-J.44 R:0.03333 P:0.01802 F:0.02339
44 ROUGE-3 Eval D0736-B.M.100.H-G.44 R:0.04297 P:0.02132 F:0.02850
44 ROUGE-3 Eval D0736-B.M.100.H-H.44 R:0.10169 P:0.04651 F:0.06383
44 ROUGE-3 Eval D0736-B.M.100.H-I.44 R:0.11588 P:0.05233 F:0.07210
44 ROUGE-3 Eval D0736-B.M.100.H-J.44 R:0.10000 P:0.05426 F:0.07035
44 ROUGE-3 Eval D0736-C.M.100.H-G.44 R:0.04329 P:0.01821 F:0.02564
44 ROUGE-3 Eval D0736-C.M.100.H-H.44 R:0.02762 P:0.00911 F:0.01370
44 ROUGE-3 Eval D0736-C.M.100.H-I.44 R:0.03315 P:0.01093 F:0.01644
44 ROUGE-3 Eval D0736-C.M.100.H-J.44 R:0.03475 P:0.01639 F:0.02227
44 ROUGE-3 Eval D0740-A.M.100.I-D.44 R:0.03704 P:0.02277 F:0.02820
44 ROUGE-3 Eval D0740-A.M.100.I-H.44 R:0.03000 P:0.01863 F:0.02299
44 ROUGE-3 Eval D0740-A.M.100.I-I.44 R:0.02318 P:0.01449 F:0.01783
44 ROUGE-3 Eval D0740-A.M.100.I-J.44 R:0.01974 P:0.01242 F:0.01525
44 ROUGE-3 Eval D0740-B.M.100.I-D.44 R:0.00331 P:0.00195 F:0.00245
44 ROUGE-3 Eval D0740-B.M.100.I-H.44 R:0.00676 P:0.00390 F:0.00495
44 ROUGE-3 Eval D0740-B.M.100.I-I.44 R:0.00669 P:0.00390 F:0.00493
44 ROUGE-3 Eval D0740-B.M.100.I-J.44 R:0.00330 P:0.00195 F:0.00245
44 ROUGE-3 Eval D0740-C.M.100.I-D.44 R:0.04560 P:0.02729 F:0.03415
44 ROUGE-3 Eval D0740-C.M.100.I-H.44 R:0.02295 P:0.01365 F:0.01712
44 ROUGE-3 Eval D0740-C.M.100.I-I.44 R:0.03909 P:0.02339 F:0.02927
44 ROUGE-3 Eval D0740-C.M.100.I-J.44 R:0.04870 P:0.02924 F:0.03654
44 ROUGE-3 Eval D0743-A.M.100.J-B.44 R:0.01942 P:0.01093 F:0.01399
44 ROUGE-3 Eval D0743-A.M.100.J-H.44 R:0.01572 P:0.00911 F:0.01154
44 ROUGE-3 Eval D0743-A.M.100.J-I.44 R:0.01911 P:0.01093 F:0.01391
44 ROUGE-3 Eval D0743-A.M.100.J-J.44 R:0.00313 P:0.00182 F:0.00230
44 ROUGE-3 Eval D0743-B.M.100.J-B.44 R:0.01634 P:0.00850 F:0.01118
44 ROUGE-3 Eval D0743-B.M.100.J-H.44 R:0.00643 P:0.00340 F:0.00445
44 ROUGE-3 Eval D0743-B.M.100.J-I.44 R:0.01935 P:0.01020 F:0.01336
44 ROUGE-3 Eval D0743-B.M.100.J-J.44 R:0.01587 P:0.00850 F:0.01107
44 ROUGE-3 Eval D0743-C.M.100.J-B.44 R:0.02265 P:0.01431 F:0.01754
44 ROUGE-3 Eval D0743-C.M.100.J-H.44 R:0.00974 P:0.00613 F:0.00752
44 ROUGE-3 Eval D0743-C.M.100.J-I.44 R:0.02280 P:0.01431 F:0.01758
44 ROUGE-3 Eval D0743-C.M.100.J-J.44 R:0.01282 P:0.00818 F:0.00999
---------------------------------------------
44 ROUGE-4 Average_R: 0.01880 (95%-conf.int. 0.01510 - 0.02234)
44 ROUGE-4 Average_P: 0.01026 (95%-conf.int. 0.00834 - 0.01216)
44 ROUGE-4 Average_F: 0.01324 (95%-conf.int. 0.01073 - 0.01568)
.............................................
44 ROUGE-4 Eval D0703-A.M.100.A-A.44 R:0.02787 P:0.01578 F:0.02015
44 ROUGE-4 Eval D0703-A.M.100.A-C.44 R:0.02076 P:0.01183 F:0.01507
44 ROUGE-4 Eval D0703-A.M.100.A-D.44 R:0.02482 P:0.01381 F:0.01775
44 ROUGE-4 Eval D0703-A.M.100.A-J.44 R:0.01053 P:0.00592 F:0.00758
44 ROUGE-4 Eval D0703-B.M.100.A-A.44 R:0.04040 P:0.02367 F:0.02985
44 ROUGE-4 Eval D0703-B.M.100.A-C.44 R:0.02076 P:0.01183 F:0.01507
44 ROUGE-4 Eval D0703-B.M.100.A-D.44 R:0.02076 P:0.01183 F:0.01507
44 ROUGE-4 Eval D0703-B.M.100.A-J.44 R:0.04110 P:0.02367 F:0.03004
44 ROUGE-4 Eval D0703-C.M.100.A-A.44 R:0.04124 P:0.02235 F:0.02899
44 ROUGE-4 Eval D0703-C.M.100.A-C.44 R:0.03010 P:0.01676 F:0.02153
44 ROUGE-4 Eval D0703-C.M.100.A-D.44 R:0.03754 P:0.02048 F:0.02650
44 ROUGE-4 Eval D0703-C.M.100.A-J.44 R:0.04437 P:0.02421 F:0.03133
44 ROUGE-4 Eval D0706-A.M.100.B-B.44 R:0.00334 P:0.00194 F:0.00245
44 ROUGE-4 Eval D0706-A.M.100.B-D.44 R:0.00673 P:0.00388 F:0.00492
44 ROUGE-4 Eval D0706-A.M.100.B-E.44 R:0.00334 P:0.00194 F:0.00245
44 ROUGE-4 Eval D0706-A.M.100.B-I.44 R:0.00669 P:0.00388 F:0.00491
44 ROUGE-4 Eval D0706-B.M.100.B-B.44 R:0.02020 P:0.01170 F:0.01482
44 ROUGE-4 Eval D0706-B.M.100.B-D.44 R:0.01678 P:0.00975 F:0.01233
44 ROUGE-4 Eval D0706-B.M.100.B-E.44 R:0.00334 P:0.00195 F:0.00246
44 ROUGE-4 Eval D0706-B.M.100.B-I.44 R:0.02000 P:0.01170 F:0.01476
44 ROUGE-4 Eval D0706-C.M.100.B-B.44 R:0.03987 P:0.02516 F:0.03085
44 ROUGE-4 Eval D0706-C.M.100.B-D.44 R:0.03987 P:0.02516 F:0.03085
44 ROUGE-4 Eval D0706-C.M.100.B-E.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0706-C.M.100.B-I.44 R:0.03947 P:0.02516 F:0.03073
44 ROUGE-4 Eval D0711-A.M.100.C-A.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-A.M.100.C-B.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-A.M.100.C-C.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-A.M.100.C-F.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-B.M.100.C-A.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-B.M.100.C-B.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-B.M.100.C-C.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-B.M.100.C-F.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0711-C.M.100.C-A.44 R:0.05102 P:0.02976 F:0.03759
44 ROUGE-4 Eval D0711-C.M.100.C-B.44 R:0.04930 P:0.02778 F:0.03554
44 ROUGE-4 Eval D0711-C.M.100.C-C.44 R:0.03484 P:0.01984 F:0.02528
44 ROUGE-4 Eval D0711-C.M.100.C-F.44 R:0.05226 P:0.02976 F:0.03792
44 ROUGE-4 Eval D0716-A.M.100.D-C.44 R:0.03378 P:0.01916 F:0.02445
44 ROUGE-4 Eval D0716-A.M.100.D-D.44 R:0.02749 P:0.01533 F:0.01968
44 ROUGE-4 Eval D0716-A.M.100.D-E.44 R:0.03767 P:0.02107 F:0.02702
44 ROUGE-4 Eval D0716-A.M.100.D-F.44 R:0.03401 P:0.01916 F:0.02451
44 ROUGE-4 Eval D0716-B.M.100.D-C.44 R:0.00339 P:0.00195 F:0.00248
44 ROUGE-4 Eval D0716-B.M.100.D-D.44 R:0.00692 P:0.00390 F:0.00499
44 ROUGE-4 Eval D0716-B.M.100.D-E.44 R:0.00342 P:0.00195 F:0.00248
44 ROUGE-4 Eval D0716-B.M.100.D-F.44 R:0.00687 P:0.00390 F:0.00498
44 ROUGE-4 Eval D0716-C.M.100.D-C.44 R:0.02349 P:0.01261 F:0.01641
44 ROUGE-4 Eval D0716-C.M.100.D-D.44 R:0.02759 P:0.01441 F:0.01893
44 ROUGE-4 Eval D0716-C.M.100.D-E.44 R:0.00680 P:0.00360 F:0.00471
44 ROUGE-4 Eval D0716-C.M.100.D-F.44 R:0.02405 P:0.01261 F:0.01655
44 ROUGE-4 Eval D0721-A.M.100.E-B.44 R:0.00344 P:0.00184 F:0.00240
44 ROUGE-4 Eval D0721-A.M.100.E-C.44 R:0.00669 P:0.00368 F:0.00475
44 ROUGE-4 Eval D0721-A.M.100.E-E.44 R:0.00334 P:0.00184 F:0.00237
44 ROUGE-4 Eval D0721-A.M.100.E-G.44 R:0.00656 P:0.00368 F:0.00472
44 ROUGE-4 Eval D0721-B.M.100.E-B.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0721-B.M.100.E-C.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0721-B.M.100.E-E.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0721-B.M.100.E-G.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0721-C.M.100.E-B.44 R:0.02703 P:0.01699 F:0.02087
44 ROUGE-4 Eval D0721-C.M.100.E-C.44 R:0.02721 P:0.01699 F:0.02092
44 ROUGE-4 Eval D0721-C.M.100.E-E.44 R:0.03436 P:0.02123 F:0.02624
44 ROUGE-4 Eval D0721-C.M.100.E-G.44 R:0.04362 P:0.02760 F:0.03381
44 ROUGE-4 Eval D0726-A.M.100.F-A.44 R:0.00685 P:0.00368 F:0.00479
44 ROUGE-4 Eval D0726-A.M.100.F-E.44 R:0.00344 P:0.00184 F:0.00240
44 ROUGE-4 Eval D0726-A.M.100.F-F.44 R:0.00685 P:0.00368 F:0.00479
44 ROUGE-4 Eval D0726-A.M.100.F-G.44 R:0.00342 P:0.00184 F:0.00239
44 ROUGE-4 Eval D0726-B.M.100.F-A.44 R:0.00673 P:0.00340 F:0.00452
44 ROUGE-4 Eval D0726-B.M.100.F-E.44 R:0.00685 P:0.00340 F:0.00454
44 ROUGE-4 Eval D0726-B.M.100.F-F.44 R:0.00342 P:0.00170 F:0.00227
44 ROUGE-4 Eval D0726-B.M.100.F-G.44 R:0.00339 P:0.00170 F:0.00226
44 ROUGE-4 Eval D0726-C.M.100.F-A.44 R:0.00344 P:0.00183 F:0.00239
44 ROUGE-4 Eval D0726-C.M.100.F-E.44 R:0.00347 P:0.00183 F:0.00240
44 ROUGE-4 Eval D0726-C.M.100.F-F.44 R:0.00350 P:0.00183 F:0.00240
44 ROUGE-4 Eval D0726-C.M.100.F-G.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0727-A.M.100.G-A.44 R:0.02397 P:0.01209 F:0.01607
44 ROUGE-4 Eval D0727-A.M.100.G-F.44 R:0.05085 P:0.02591 F:0.03433
44 ROUGE-4 Eval D0727-A.M.100.G-G.44 R:0.02694 P:0.01382 F:0.01827
44 ROUGE-4 Eval D0727-A.M.100.G-H.44 R:0.05085 P:0.02591 F:0.03433
44 ROUGE-4 Eval D0727-B.M.100.G-A.44 R:0.01773 P:0.00975 F:0.01258
44 ROUGE-4 Eval D0727-B.M.100.G-F.44 R:0.01672 P:0.00975 F:0.01232
44 ROUGE-4 Eval D0727-B.M.100.G-G.44 R:0.00357 P:0.00195 F:0.00252
44 ROUGE-4 Eval D0727-B.M.100.G-H.44 R:0.01418 P:0.00780 F:0.01006
44 ROUGE-4 Eval D0727-C.M.100.G-A.44 R:0.05034 P:0.02732 F:0.03542
44 ROUGE-4 Eval D0727-C.M.100.G-F.44 R:0.07986 P:0.04189 F:0.05495
44 ROUGE-4 Eval D0727-C.M.100.G-G.44 R:0.04082 P:0.02186 F:0.02847
44 ROUGE-4 Eval D0727-C.M.100.G-H.44 R:0.06620 P:0.03461 F:0.04546
44 ROUGE-4 Eval D0736-A.M.100.H-G.44 R:0.03704 P:0.01812 F:0.02434
44 ROUGE-4 Eval D0736-A.M.100.H-H.44 R:0.04528 P:0.02174 F:0.02938
44 ROUGE-4 Eval D0736-A.M.100.H-I.44 R:0.04412 P:0.02174 F:0.02913
44 ROUGE-4 Eval D0736-A.M.100.H-J.44 R:0.01684 P:0.00906 F:0.01178
44 ROUGE-4 Eval D0736-B.M.100.H-G.44 R:0.01581 P:0.00780 F:0.01045
44 ROUGE-4 Eval D0736-B.M.100.H-H.44 R:0.07296 P:0.03314 F:0.04558
44 ROUGE-4 Eval D0736-B.M.100.H-I.44 R:0.08261 P:0.03704 F:0.05115
44 ROUGE-4 Eval D0736-B.M.100.H-J.44 R:0.07220 P:0.03899 F:0.05064
44 ROUGE-4 Eval D0736-C.M.100.H-G.44 R:0.02193 P:0.00916 F:0.01292
44 ROUGE-4 Eval D0736-C.M.100.H-H.44 R:0.01685 P:0.00549 F:0.00828
44 ROUGE-4 Eval D0736-C.M.100.H-I.44 R:0.01124 P:0.00366 F:0.00552
44 ROUGE-4 Eval D0736-C.M.100.H-J.44 R:0.01953 P:0.00916 F:0.01247
44 ROUGE-4 Eval D0740-A.M.100.I-D.44 R:0.01020 P:0.00625 F:0.00775
44 ROUGE-4 Eval D0740-A.M.100.I-H.44 R:0.01010 P:0.00625 F:0.00772
44 ROUGE-4 Eval D0740-A.M.100.I-I.44 R:0.00669 P:0.00417 F:0.00514
44 ROUGE-4 Eval D0740-A.M.100.I-J.44 R:0.00332 P:0.00208 F:0.00256
44 ROUGE-4 Eval D0740-B.M.100.I-D.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0740-B.M.100.I-H.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0740-B.M.100.I-I.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0740-B.M.100.I-J.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0740-C.M.100.I-D.44 R:0.01974 P:0.01176 F:0.01474
44 ROUGE-4 Eval D0740-C.M.100.I-H.44 R:0.00331 P:0.00196 F:0.00246
44 ROUGE-4 Eval D0740-C.M.100.I-I.44 R:0.01645 P:0.00980 F:0.01228
44 ROUGE-4 Eval D0740-C.M.100.I-J.44 R:0.01967 P:0.01176 F:0.01472
44 ROUGE-4 Eval D0743-A.M.100.J-B.44 R:0.00980 P:0.00549 F:0.00704
44 ROUGE-4 Eval D0743-A.M.100.J-H.44 R:0.00952 P:0.00549 F:0.00696
44 ROUGE-4 Eval D0743-A.M.100.J-I.44 R:0.00965 P:0.00549 F:0.00700
44 ROUGE-4 Eval D0743-A.M.100.J-J.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0743-B.M.100.J-B.44 R:0.00660 P:0.00342 F:0.00451
44 ROUGE-4 Eval D0743-B.M.100.J-H.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0743-B.M.100.J-I.44 R:0.00651 P:0.00342 F:0.00448
44 ROUGE-4 Eval D0743-B.M.100.J-J.44 R:0.00641 P:0.00342 F:0.00446
44 ROUGE-4 Eval D0743-C.M.100.J-B.44 R:0.00654 P:0.00412 F:0.00506
44 ROUGE-4 Eval D0743-C.M.100.J-H.44 R:0.00000 P:0.00000 F:0.00000
44 ROUGE-4 Eval D0743-C.M.100.J-I.44 R:0.00658 P:0.00412 F:0.00507
44 ROUGE-4 Eval D0743-C.M.100.J-J.44 R:0.00647 P:0.00412 F:0.00503
---------------------------------------------
44 ROUGE-L Average_R: 0.34071 (95%-conf.int. 0.33224 - 0.34959)
44 ROUGE-L Average_P: 0.19097 (95%-conf.int. 0.18598 - 0.19573)
44 ROUGE-L Average_F: 0.24425 (95%-conf.int. 0.23843 - 0.25002)
.............................................
44 ROUGE-L Eval D0703-A.M.100.A-A.44 R:0.34797 P:0.19961 F:0.25369
44 ROUGE-L Eval D0703-A.M.100.A-C.44 R:0.30537 P:0.17636 F:0.22359
44 ROUGE-L Eval D0703-A.M.100.A-D.44 R:0.32646 P:0.18411 F:0.23544
44 ROUGE-L Eval D0703-A.M.100.A-J.44 R:0.34354 P:0.19574 F:0.24939
44 ROUGE-L Eval D0703-B.M.100.A-A.44 R:0.40196 P:0.23837 F:0.29927
44 ROUGE-L Eval D0703-B.M.100.A-C.44 R:0.38926 P:0.22481 F:0.28501
44 ROUGE-L Eval D0703-B.M.100.A-D.44 R:0.40604 P:0.23450 F:0.29730
44 ROUGE-L Eval D0703-B.M.100.A-J.44 R:0.42857 P:0.25000 F:0.31579
44 ROUGE-L Eval D0703-C.M.100.A-A.44 R:0.37667 P:0.20696 F:0.26714
44 ROUGE-L Eval D0703-C.M.100.A-C.44 R:0.33442 P:0.18864 F:0.24122
44 ROUGE-L Eval D0703-C.M.100.A-D.44 R:0.36424 P:0.20147 F:0.25944
44 ROUGE-L Eval D0703-C.M.100.A-J.44 R:0.37086 P:0.20513 F:0.26415
44 ROUGE-L Eval D0706-A.M.100.B-B.44 R:0.32468 P:0.19048 F:0.24010
44 ROUGE-L Eval D0706-A.M.100.B-D.44 R:0.31373 P:0.18286 F:0.23105
44 ROUGE-L Eval D0706-A.M.100.B-E.44 R:0.28896 P:0.16952 F:0.21368
44 ROUGE-L Eval D0706-A.M.100.B-I.44 R:0.31169 P:0.18286 F:0.23049
44 ROUGE-L Eval D0706-B.M.100.B-B.44 R:0.30065 P:0.17625 F:0.22223
44 ROUGE-L Eval D0706-B.M.100.B-D.44 R:0.28013 P:0.16475 F:0.20748
44 ROUGE-L Eval D0706-B.M.100.B-E.44 R:0.25325 P:0.14943 F:0.18796
44 ROUGE-L Eval D0706-B.M.100.B-I.44 R:0.29773 P:0.17625 F:0.22142
44 ROUGE-L Eval D0706-C.M.100.B-B.44 R:0.33871 P:0.21605 F:0.26382
44 ROUGE-L Eval D0706-C.M.100.B-D.44 R:0.32903 P:0.20988 F:0.25628
44 ROUGE-L Eval D0706-C.M.100.B-E.44 R:0.29808 P:0.19136 F:0.23309
44 ROUGE-L Eval D0706-C.M.100.B-I.44 R:0.33546 P:0.21605 F:0.26283
44 ROUGE-L Eval D0711-A.M.100.C-A.44 R:0.32566 P:0.19186 F:0.24146
44 ROUGE-L Eval D0711-A.M.100.C-B.44 R:0.33333 P:0.19380 F:0.24510
44 ROUGE-L Eval D0711-A.M.100.C-C.44 R:0.30000 P:0.17442 F:0.22059
44 ROUGE-L Eval D0711-A.M.100.C-F.44 R:0.33444 P:0.19574 F:0.24695
44 ROUGE-L Eval D0711-B.M.100.C-A.44 R:0.32993 P:0.17963 F:0.23261
44 ROUGE-L Eval D0711-B.M.100.C-B.44 R:0.32192 P:0.17407 F:0.22596
44 ROUGE-L Eval D0711-B.M.100.C-C.44 R:0.31544 P:0.17407 F:0.22434
44 ROUGE-L Eval D0711-B.M.100.C-F.44 R:0.32542 P:0.17778 F:0.22994
44 ROUGE-L Eval D0711-C.M.100.C-A.44 R:0.38944 P:0.23002 F:0.28922
44 ROUGE-L Eval D0711-C.M.100.C-B.44 R:0.37884 P:0.21637 F:0.27543
44 ROUGE-L Eval D0711-C.M.100.C-C.44 R:0.37500 P:0.21637 F:0.27441
44 ROUGE-L Eval D0711-C.M.100.C-F.44 R:0.36149 P:0.20858 F:0.26453
44 ROUGE-L Eval D0716-A.M.100.D-C.44 R:0.40984 P:0.23540 F:0.29904
44 ROUGE-L Eval D0716-A.M.100.D-D.44 R:0.40000 P:0.22599 F:0.28881
44 ROUGE-L Eval D0716-A.M.100.D-E.44 R:0.44518 P:0.25235 F:0.32211
44 ROUGE-L Eval D0716-A.M.100.D-F.44 R:0.43234 P:0.24670 F:0.31414
44 ROUGE-L Eval D0716-B.M.100.D-C.44 R:0.40132 P:0.23372 F:0.29540
44 ROUGE-L Eval D0716-B.M.100.D-D.44 R:0.42282 P:0.24138 F:0.30732
44 ROUGE-L Eval D0716-B.M.100.D-E.44 R:0.39867 P:0.22989 F:0.29162
44 ROUGE-L Eval D0716-B.M.100.D-F.44 R:0.40333 P:0.23180 F:0.29440
44 ROUGE-L Eval D0716-C.M.100.D-C.44 R:0.32899 P:0.17908 F:0.23192
44 ROUGE-L Eval D0716-C.M.100.D-D.44 R:0.32776 P:0.17376 F:0.22712
44 ROUGE-L Eval D0716-C.M.100.D-E.44 R:0.33333 P:0.17908 F:0.23299
44 ROUGE-L Eval D0716-C.M.100.D-F.44 R:0.33000 P:0.17553 F:0.22917
44 ROUGE-L Eval D0721-A.M.100.E-B.44 R:0.36667 P:0.19928 F:0.25822
44 ROUGE-L Eval D0721-A.M.100.E-C.44 R:0.34740 P:0.19384 F:0.24884
44 ROUGE-L Eval D0721-A.M.100.E-E.44 R:0.33766 P:0.18841 F:0.24186
44 ROUGE-L Eval D0721-A.M.100.E-G.44 R:0.37261 P:0.21196 F:0.27021
44 ROUGE-L Eval D0721-B.M.100.E-B.44 R:0.34202 P:0.20349 F:0.25517
44 ROUGE-L Eval D0721-B.M.100.E-C.44 R:0.35669 P:0.21705 F:0.26988
44 ROUGE-L Eval D0721-B.M.100.E-E.44 R:0.32459 P:0.19186 F:0.24117
44 ROUGE-L Eval D0721-B.M.100.E-G.44 R:0.33548 P:0.20155 F:0.25181
44 ROUGE-L Eval D0721-C.M.100.E-B.44 R:0.35082 P:0.22292 F:0.27261
44 ROUGE-L Eval D0721-C.M.100.E-C.44 R:0.30363 P:0.19167 F:0.23500
44 ROUGE-L Eval D0721-C.M.100.E-E.44 R:0.29667 P:0.18542 F:0.22821
44 ROUGE-L Eval D0721-C.M.100.E-G.44 R:0.30293 P:0.19375 F:0.23634
44 ROUGE-L Eval D0726-A.M.100.F-A.44 R:0.35880 P:0.19565 F:0.25322
44 ROUGE-L Eval D0726-A.M.100.F-E.44 R:0.34333 P:0.18659 F:0.24178
44 ROUGE-L Eval D0726-A.M.100.F-F.44 R:0.36545 P:0.19928 F:0.25792
44 ROUGE-L Eval D0726-A.M.100.F-G.44 R:0.33887 P:0.18478 F:0.23915
44 ROUGE-L Eval D0726-B.M.100.F-A.44 R:0.34314 P:0.17588 F:0.23256
44 ROUGE-L Eval D0726-B.M.100.F-E.44 R:0.31561 P:0.15913 F:0.21158
44 ROUGE-L Eval D0726-B.M.100.F-F.44 R:0.33555 P:0.16918 F:0.22495
44 ROUGE-L Eval D0726-B.M.100.F-G.44 R:0.34211 P:0.17420 F:0.23085
44 ROUGE-L Eval D0726-C.M.100.F-A.44 R:0.35000 P:0.18919 F:0.24561
44 ROUGE-L Eval D0726-C.M.100.F-E.44 R:0.35354 P:0.18919 F:0.24648
44 ROUGE-L Eval D0726-C.M.100.F-F.44 R:0.35593 P:0.18919 F:0.24706
44 ROUGE-L Eval D0726-C.M.100.F-G.44 R:0.34426 P:0.18919 F:0.24419
44 ROUGE-L Eval D0727-A.M.100.G-A.44 R:0.40199 P:0.20578 F:0.27221
44 ROUGE-L Eval D0727-A.M.100.G-F.44 R:0.41447 P:0.21429 F:0.28251
44 ROUGE-L Eval D0727-A.M.100.G-G.44 R:0.39216 P:0.20408 F:0.26846
44 ROUGE-L Eval D0727-A.M.100.G-H.44 R:0.41118 P:0.21259 F:0.28027
44 ROUGE-L Eval D0727-B.M.100.G-A.44 R:0.36426 P:0.20307 F:0.26077
44 ROUGE-L Eval D0727-B.M.100.G-F.44 R:0.37662 P:0.22222 F:0.27952
44 ROUGE-L Eval D0727-B.M.100.G-G.44 R:0.34256 P:0.18966 F:0.24415
44 ROUGE-L Eval D0727-B.M.100.G-H.44 R:0.37113 P:0.20690 F:0.26568
44 ROUGE-L Eval D0727-C.M.100.G-A.44 R:0.40717 P:0.22401 F:0.28901
44 ROUGE-L Eval D0727-C.M.100.G-F.44 R:0.43771 P:0.23297 F:0.30409
44 ROUGE-L Eval D0727-C.M.100.G-G.44 R:0.38614 P:0.20968 F:0.27178
44 ROUGE-L Eval D0727-C.M.100.G-H.44 R:0.41554 P:0.22043 F:0.28806
44 ROUGE-L Eval D0736-A.M.100.H-G.44 R:0.31541 P:0.15686 F:0.20952
44 ROUGE-L Eval D0736-A.M.100.H-H.44 R:0.34307 P:0.16756 F:0.22515
44 ROUGE-L Eval D0736-A.M.100.H-I.44 R:0.31317 P:0.15686 F:0.20902
44 ROUGE-L Eval D0736-A.M.100.H-J.44 R:0.31373 P:0.17112 F:0.22145
44 ROUGE-L Eval D0736-B.M.100.H-G.44 R:0.38168 P:0.19157 F:0.25510
44 ROUGE-L Eval D0736-B.M.100.H-H.44 R:0.40496 P:0.18774 F:0.25655
44 ROUGE-L Eval D0736-B.M.100.H-I.44 R:0.43096 P:0.19732 F:0.27070
44 ROUGE-L Eval D0736-B.M.100.H-J.44 R:0.40559 P:0.22222 F:0.28713
44 ROUGE-L Eval D0736-C.M.100.H-G.44 R:0.35865 P:0.15315 F:0.21464
44 ROUGE-L Eval D0736-C.M.100.H-H.44 R:0.34225 P:0.11532 F:0.17251
44 ROUGE-L Eval D0736-C.M.100.H-I.44 R:0.40107 P:0.13514 F:0.20216
44 ROUGE-L Eval D0736-C.M.100.H-J.44 R:0.36604 P:0.17477 F:0.23658
44 ROUGE-L Eval D0740-A.M.100.I-D.44 R:0.30693 P:0.19018 F:0.23485
44 ROUGE-L Eval D0740-A.M.100.I-H.44 R:0.29739 P:0.18609 F:0.22893
44 ROUGE-L Eval D0740-A.M.100.I-I.44 R:0.31169 P:0.19632 F:0.24090
44 ROUGE-L Eval D0740-A.M.100.I-J.44 R:0.30645 P:0.19427 F:0.23779
44 ROUGE-L Eval D0740-B.M.100.I-D.44 R:0.26623 P:0.15800 F:0.19831
44 ROUGE-L Eval D0740-B.M.100.I-H.44 R:0.26490 P:0.15414 F:0.19488
44 ROUGE-L Eval D0740-B.M.100.I-I.44 R:0.27213 P:0.15992 F:0.20145
44 ROUGE-L Eval D0740-B.M.100.I-J.44 R:0.25566 P:0.15222 F:0.19082
44 ROUGE-L Eval D0740-C.M.100.I-D.44 R:0.30032 P:0.18112 F:0.22596
44 ROUGE-L Eval D0740-C.M.100.I-H.44 R:0.28617 P:0.17148 F:0.21445
44 ROUGE-L Eval D0740-C.M.100.I-I.44 R:0.28115 P:0.16956 F:0.21154
44 ROUGE-L Eval D0740-C.M.100.I-J.44 R:0.31210 P:0.18882 F:0.23529
44 ROUGE-L Eval D0743-A.M.100.J-B.44 R:0.27619 P:0.15676 F:0.20000
44 ROUGE-L Eval D0743-A.M.100.J-H.44 R:0.25617 P:0.14955 F:0.18885
44 ROUGE-L Eval D0743-A.M.100.J-I.44 R:0.28750 P:0.16577 F:0.21029
44 ROUGE-L Eval D0743-A.M.100.J-J.44 R:0.24615 P:0.14414 F:0.18181
44 ROUGE-L Eval D0743-B.M.100.J-B.44 R:0.25962 P:0.13636 F:0.17881
44 ROUGE-L Eval D0743-B.M.100.J-H.44 R:0.24921 P:0.13300 F:0.17344
44 ROUGE-L Eval D0743-B.M.100.J-I.44 R:0.27532 P:0.14646 F:0.19121
44 ROUGE-L Eval D0743-B.M.100.J-J.44 R:0.23988 P:0.12963 F:0.16831
44 ROUGE-L Eval D0743-C.M.100.J-B.44 R:0.31111 P:0.19798 F:0.24198
44 ROUGE-L Eval D0743-C.M.100.J-H.44 R:0.29936 P:0.18990 F:0.23239
44 ROUGE-L Eval D0743-C.M.100.J-I.44 R:0.32907 P:0.20808 F:0.25495
44 ROUGE-L Eval D0743-C.M.100.J-J.44 R:0.28931 P:0.18586 F:0.22632
---------------------------------------------
44 ROUGE-W-1.2 Average_R: 0.11913 (95%-conf.int. 0.11590 - 0.12229)
44 ROUGE-W-1.2 Average_P: 0.12106 (95%-conf.int. 0.11775 - 0.12423)
44 ROUGE-W-1.2 Average_F: 0.11977 (95%-conf.int. 0.11664 - 0.12283)
.............................................
44 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.44 R:0.12275 P:0.12679 F:0.12474
44 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.44 R:0.10653 P:0.11182 F:0.10911
44 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.44 R:0.11682 P:0.12146 F:0.11909
44 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.44 R:0.12452 P:0.12136 F:0.12292
44 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.44 R:0.13871 P:0.15252 F:0.14529
44 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.44 R:0.13071 P:0.14285 F:0.13651
44 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.44 R:0.13827 P:0.14979 F:0.14380
44 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.44 R:0.14822 P:0.16036 F:0.15405
44 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.44 R:0.13037 P:0.13319 F:0.13176
44 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.44 R:0.11233 P:0.11964 F:0.11587
44 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.44 R:0.12070 P:0.12671 F:0.12363
44 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.44 R:0.13255 P:0.13205 F:0.13230
44 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.44 R:0.11246 P:0.11840 F:0.11535
44 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.44 R:0.10657 P:0.11398 F:0.11015
44 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.44 R:0.09683 P:0.10301 F:0.09982
44 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.44 R:0.10416 P:0.11323 F:0.10851
44 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.44 R:0.11456 P:0.11631 F:0.11543
44 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.44 R:0.10324 P:0.10708 F:0.10512
44 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.44 R:0.09272 P:0.09657 F:0.09461
44 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.44 R:0.10760 P:0.11519 F:0.11127
44 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.44 R:0.12127 P:0.13203 F:0.12642
44 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.44 R:0.11732 P:0.12882 F:0.12280
44 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.44 R:0.10228 P:0.11123 F:0.10657
44 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.44 R:0.12151 P:0.13591 F:0.12831
44 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.44 R:0.11078 P:0.11767 F:0.11412
44 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.44 R:0.11258 P:0.11855 F:0.11549
44 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.44 R:0.10216 P:0.10666 F:0.10436
44 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.44 R:0.11344 P:0.12044 F:0.11684
44 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.44 R:0.11435 P:0.11108 F:0.11269
44 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.44 R:0.10870 P:0.11016 F:0.10943
44 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.44 R:0.10425 P:0.10807 F:0.10613
44 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.44 R:0.11023 P:0.11184 F:0.11103
44 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.44 R:0.13041 P:0.14400 F:0.13687
44 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.44 R:0.12565 P:0.13420 F:0.12978
44 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.44 R:0.12421 P:0.13608 F:0.12987
44 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.44 R:0.11864 P:0.13194 F:0.12494
44 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.44 R:0.15234 P:0.15986 F:0.15601
44 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.44 R:0.14002 P:0.15071 F:0.14517
44 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.44 R:0.16064 P:0.17005 F:0.16521
44 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.44 R:0.15427 P:0.16740 F:0.16057
44 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.44 R:0.14097 P:0.14322 F:0.14209
44 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.44 R:0.14593 P:0.14909 F:0.14749
44 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.44 R:0.13820 P:0.14186 F:0.14001
44 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.44 R:0.14053 P:0.14295 F:0.14173
44 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.44 R:0.11112 P:0.11274 F:0.11192
44 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.44 R:0.10855 P:0.11160 F:0.11005
44 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.44 R:0.10729 P:0.11171 F:0.10946
44 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.44 R:0.10748 P:0.11122 F:0.10932
44 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.44 R:0.13544 P:0.12938 F:0.13234
44 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.44 R:0.12885 P:0.12755 F:0.12820
44 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.44 R:0.12274 P:0.12303 F:0.12288
44 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.44 R:0.13643 P:0.13600 F:0.13621
44 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.44 R:0.10887 P:0.12522 F:0.11647
44 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.44 R:0.11669 P:0.13346 F:0.12451
44 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.44 R:0.10138 P:0.11762 F:0.10890
44 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.44 R:0.10326 P:0.12380 F:0.11260
44 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.44 R:0.12570 P:0.14701 F:0.13552
44 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.44 R:0.10755 P:0.12773 F:0.11677
44 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.44 R:0.10733 P:0.12521 F:0.11558
44 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.44 R:0.11030 P:0.13192 F:0.12015
44 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.44 R:0.12417 P:0.11999 F:0.12204
44 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.44 R:0.12129 P:0.11549 F:0.11832
44 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.44 R:0.12705 P:0.12339 F:0.12519
44 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.44 R:0.11560 P:0.11411 F:0.11485
44 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.44 R:0.12467 P:0.11240 F:0.11822
44 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.44 R:0.10881 P:0.09903 F:0.10369
44 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.44 R:0.11869 P:0.10872 F:0.11349
44 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.44 R:0.11971 P:0.11006 F:0.11468
44 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.44 R:0.12064 P:0.11451 F:0.11750
44 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.44 R:0.11733 P:0.11081 F:0.11398
44 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.44 R:0.11948 P:0.11373 F:0.11653
44 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.44 R:0.11273 P:0.11092 F:0.11182
44 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.44 R:0.14264 P:0.12852 F:0.13521
44 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.44 R:0.15219 P:0.14362 F:0.14778
44 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.44 R:0.14580 P:0.13437 F:0.13985
44 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.44 R:0.15171 P:0.14060 F:0.14594
44 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.44 R:0.12734 P:0.12455 F:0.12593
44 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.44 R:0.12937 P:0.13712 F:0.13313
44 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.44 R:0.11787 P:0.11688 F:0.11737
44 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.44 R:0.12958 P:0.12787 F:0.12872
44 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.44 R:0.13102 P:0.12964 F:0.13033
44 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.44 R:0.14140 P:0.13910 F:0.14024
44 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.44 R:0.13137 P:0.13131 F:0.13134
44 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.44 R:0.13587 P:0.12972 F:0.13272
44 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.44 R:0.11777 P:0.10372 F:0.11030
44 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.44 R:0.12798 P:0.10992 F:0.11826
44 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.44 R:0.11674 P:0.10448 F:0.11027
44 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.44 R:0.11193 P:0.10884 F:0.11036
44 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.44 R:0.13761 P:0.12785 F:0.13255
44 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.44 R:0.15844 P:0.13589 F:0.14630
44 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.44 R:0.16425 P:0.13889 F:0.15051
44 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.44 R:0.14861 P:0.15052 F:0.14956
44 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.44 R:0.12526 P:0.09717 F:0.10944
44 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.44 R:0.13686 P:0.08619 F:0.10577
44 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.44 R:0.13645 P:0.08387 F:0.10389
44 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.44 R:0.12245 P:0.10431 F:0.11265
44 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.44 R:0.10947 P:0.12477 F:0.11662
44 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.44 R:0.10557 P:0.11918 F:0.11196
44 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.44 R:0.10897 P:0.12695 F:0.11727
44 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.44 R:0.10608 P:0.12354 F:0.11415
44 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.44 R:0.08958 P:0.09767 F:0.09345
44 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.44 R:0.09343 P:0.09674 F:0.09506
44 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.44 R:0.08997 P:0.09935 F:0.09443
44 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.44 R:0.08855 P:0.09425 F:0.09131
44 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.44 R:0.10944 P:0.12738 F:0.11773
44 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.44 R:0.10377 P:0.11605 F:0.10957
44 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.44 R:0.09809 P:0.11568 F:0.10616
44 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.44 R:0.11298 P:0.13098 F:0.12132
44 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.44 R:0.09995 P:0.09889 F:0.09942
44 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.44 R:0.09105 P:0.09181 F:0.09143
44 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.44 R:0.10087 P:0.10320 F:0.10202
44 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.44 R:0.08721 P:0.08865 F:0.08792
44 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.44 R:0.09616 P:0.08459 F:0.09000
44 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.44 R:0.09460 P:0.08372 F:0.08883
44 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.44 R:0.10138 P:0.09089 F:0.09585
44 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.44 R:0.09279 P:0.08244 F:0.08731
44 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.44 R:0.11005 P:0.12258 F:0.11598
44 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.44 R:0.10221 P:0.10827 F:0.10515
44 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.44 R:0.11163 P:0.12578 F:0.11828
44 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.44 R:0.10227 P:0.11059 F:0.10627
---------------------------------------------
44 ROUGE-SU4 Average_R: 0.13755 (95%-conf.int. 0.13098 - 0.14402)
44 ROUGE-SU4 Average_P: 0.07598 (95%-conf.int. 0.07247 - 0.07957)
44 ROUGE-SU4 Average_F: 0.09767 (95%-conf.int. 0.09325 - 0.10216)
.............................................
44 ROUGE-SU4 Eval D0703-A.M.100.A-A.44 R:0.15509 P:0.08793 F:0.11223
44 ROUGE-SU4 Eval D0703-A.M.100.A-C.44 R:0.12644 P:0.07218 F:0.09190
44 ROUGE-SU4 Eval D0703-A.M.100.A-D.44 R:0.14311 P:0.07972 F:0.10240
44 ROUGE-SU4 Eval D0703-A.M.100.A-J.44 R:0.13695 P:0.07710 F:0.09866
44 ROUGE-SU4 Eval D0703-B.M.100.A-A.44 R:0.19631 P:0.11516 F:0.14516
44 ROUGE-SU4 Eval D0703-B.M.100.A-C.44 R:0.18333 P:0.10466 F:0.13325
44 ROUGE-SU4 Eval D0703-B.M.100.A-D.44 R:0.19023 P:0.10860 F:0.13827
44 ROUGE-SU4 Eval D0703-B.M.100.A-J.44 R:0.20705 P:0.11942 F:0.15147
44 ROUGE-SU4 Eval D0703-C.M.100.A-A.44 R:0.17751 P:0.09634 F:0.12490
44 ROUGE-SU4 Eval D0703-C.M.100.A-C.44 R:0.14889 P:0.08302 F:0.10660
44 ROUGE-SU4 Eval D0703-C.M.100.A-D.44 R:0.15760 P:0.08612 F:0.11138
44 ROUGE-SU4 Eval D0703-C.M.100.A-J.44 R:0.18254 P:0.09975 F:0.12900
44 ROUGE-SU4 Eval D0706-A.M.100.B-B.44 R:0.11333 P:0.06576 F:0.08323
44 ROUGE-SU4 Eval D0706-A.M.100.B-D.44 R:0.10682 P:0.06157 F:0.07812
44 ROUGE-SU4 Eval D0706-A.M.100.B-E.44 R:0.09722 P:0.05642 F:0.07140
44 ROUGE-SU4 Eval D0706-A.M.100.B-I.44 R:0.11167 P:0.06480 F:0.08201
44 ROUGE-SU4 Eval D0706-B.M.100.B-B.44 R:0.11745 P:0.06809 F:0.08620
44 ROUGE-SU4 Eval D0706-B.M.100.B-D.44 R:0.10256 P:0.05966 F:0.07544
44 ROUGE-SU4 Eval D0706-B.M.100.B-E.44 R:0.08167 P:0.04767 F:0.06020
44 ROUGE-SU4 Eval D0706-B.M.100.B-I.44 R:0.11406 P:0.06680 F:0.08426
44 ROUGE-SU4 Eval D0706-C.M.100.B-B.44 R:0.13024 P:0.08229 F:0.10086
44 ROUGE-SU4 Eval D0706-C.M.100.B-D.44 R:0.13576 P:0.08577 F:0.10512
44 ROUGE-SU4 Eval D0706-C.M.100.B-E.44 R:0.09430 P:0.05997 F:0.07332
44 ROUGE-SU4 Eval D0706-C.M.100.B-I.44 R:0.13607 P:0.08682 F:0.10600
44 ROUGE-SU4 Eval D0711-A.M.100.C-A.44 R:0.11768 P:0.06857 F:0.08665
44 ROUGE-SU4 Eval D0711-A.M.100.C-B.44 R:0.11701 P:0.06726 F:0.08542
44 ROUGE-SU4 Eval D0711-A.M.100.C-C.44 R:0.10445 P:0.06004 F:0.07625
44 ROUGE-SU4 Eval D0711-A.M.100.C-F.44 R:0.12585 P:0.07283 F:0.09227
44 ROUGE-SU4 Eval D0711-B.M.100.C-A.44 R:0.11655 P:0.06266 F:0.08150
44 ROUGE-SU4 Eval D0711-B.M.100.C-B.44 R:0.11737 P:0.06266 F:0.08170
44 ROUGE-SU4 Eval D0711-B.M.100.C-C.44 R:0.11149 P:0.06078 F:0.07867
44 ROUGE-SU4 Eval D0711-B.M.100.C-F.44 R:0.11498 P:0.06203 F:0.08059
44 ROUGE-SU4 Eval D0711-C.M.100.C-A.44 R:0.17006 P:0.09934 F:0.12542
44 ROUGE-SU4 Eval D0711-C.M.100.C-B.44 R:0.16608 P:0.09373 F:0.11983
44 ROUGE-SU4 Eval D0711-C.M.100.C-C.44 R:0.15683 P:0.08944 F:0.11391
44 ROUGE-SU4 Eval D0711-C.M.100.C-F.44 R:0.15914 P:0.09076 F:0.11559
44 ROUGE-SU4 Eval D0716-A.M.100.D-C.44 R:0.20426 P:0.11600 F:0.14797
44 ROUGE-SU4 Eval D0716-A.M.100.D-D.44 R:0.19806 P:0.11058 F:0.14192
44 ROUGE-SU4 Eval D0716-A.M.100.D-E.44 R:0.22526 P:0.12620 F:0.16177
44 ROUGE-SU4 Eval D0716-A.M.100.D-F.44 R:0.21186 P:0.11950 F:0.15281
44 ROUGE-SU4 Eval D0716-B.M.100.D-C.44 R:0.17342 P:0.09987 F:0.12675
44 ROUGE-SU4 Eval D0716-B.M.100.D-D.44 R:0.18966 P:0.10700 F:0.13681
44 ROUGE-SU4 Eval D0716-B.M.100.D-E.44 R:0.16041 P:0.09144 F:0.11648
44 ROUGE-SU4 Eval D0716-B.M.100.D-F.44 R:0.17352 P:0.09857 F:0.12572
44 ROUGE-SU4 Eval D0716-C.M.100.D-C.44 R:0.11761 P:0.06325 F:0.08226
44 ROUGE-SU4 Eval D0716-C.M.100.D-D.44 R:0.12428 P:0.06505 F:0.08540
44 ROUGE-SU4 Eval D0716-C.M.100.D-E.44 R:0.11186 P:0.05935 F:0.07755
44 ROUGE-SU4 Eval D0716-C.M.100.D-F.44 R:0.12728 P:0.06685 F:0.08766
44 ROUGE-SU4 Eval D0721-A.M.100.E-B.44 R:0.14612 P:0.07843 F:0.10207
44 ROUGE-SU4 Eval D0721-A.M.100.E-C.44 R:0.13778 P:0.07598 F:0.09795
44 ROUGE-SU4 Eval D0721-A.M.100.E-E.44 R:0.13889 P:0.07659 F:0.09873
44 ROUGE-SU4 Eval D0721-A.M.100.E-G.44 R:0.14815 P:0.08333 F:0.10666
44 ROUGE-SU4 Eval D0721-B.M.100.E-B.44 R:0.12319 P:0.07251 F:0.09129
44 ROUGE-SU4 Eval D0721-B.M.100.E-C.44 R:0.12745 P:0.07677 F:0.09582
44 ROUGE-SU4 Eval D0721-B.M.100.E-E.44 R:0.11336 P:0.06627 F:0.08364
44 ROUGE-SU4 Eval D0721-B.M.100.E-G.44 R:0.12252 P:0.07283 F:0.09136
44 ROUGE-SU4 Eval D0721-C.M.100.E-B.44 R:0.15488 P:0.09746 F:0.11964
44 ROUGE-SU4 Eval D0721-C.M.100.E-C.44 R:0.13051 P:0.08157 F:0.10039
44 ROUGE-SU4 Eval D0721-C.M.100.E-E.44 R:0.13699 P:0.08475 F:0.10472
44 ROUGE-SU4 Eval D0721-C.M.100.E-G.44 R:0.13378 P:0.08475 F:0.10376
44 ROUGE-SU4 Eval D0726-A.M.100.F-A.44 R:0.12514 P:0.06740 F:0.08761
44 ROUGE-SU4 Eval D0726-A.M.100.F-E.44 R:0.11587 P:0.06219 F:0.08094
44 ROUGE-SU4 Eval D0726-A.M.100.F-F.44 R:0.13424 P:0.07230 F:0.09398
44 ROUGE-SU4 Eval D0726-A.M.100.F-G.44 R:0.12173 P:0.06556 F:0.08522
44 ROUGE-SU4 Eval D0726-B.M.100.F-A.44 R:0.13367 P:0.06763 F:0.08982
44 ROUGE-SU4 Eval D0726-B.M.100.F-E.44 R:0.11149 P:0.05546 F:0.07407
44 ROUGE-SU4 Eval D0726-B.M.100.F-F.44 R:0.12685 P:0.06310 F:0.08428
44 ROUGE-SU4 Eval D0726-B.M.100.F-G.44 R:0.12950 P:0.06508 F:0.08663
44 ROUGE-SU4 Eval D0726-C.M.100.F-A.44 R:0.13128 P:0.07008 F:0.09138
44 ROUGE-SU4 Eval D0726-C.M.100.F-E.44 R:0.13783 P:0.07282 F:0.09529
44 ROUGE-SU4 Eval D0726-C.M.100.F-F.44 R:0.13705 P:0.07191 F:0.09433
44 ROUGE-SU4 Eval D0726-C.M.100.F-G.44 R:0.12626 P:0.06856 F:0.08887
44 ROUGE-SU4 Eval D0727-A.M.100.G-A.44 R:0.17463 P:0.08822 F:0.11722
44 ROUGE-SU4 Eval D0727-A.M.100.G-F.44 R:0.20383 P:0.10402 F:0.13774
44 ROUGE-SU4 Eval D0727-A.M.100.G-G.44 R:0.16275 P:0.08362 F:0.11048
44 ROUGE-SU4 Eval D0727-A.M.100.G-H.44 R:0.20608 P:0.10517 F:0.13927
44 ROUGE-SU4 Eval D0727-B.M.100.G-A.44 R:0.14605 P:0.08042 F:0.10373
44 ROUGE-SU4 Eval D0727-B.M.100.G-F.44 R:0.15222 P:0.08885 F:0.11221
44 ROUGE-SU4 Eval D0727-B.M.100.G-G.44 R:0.12040 P:0.06582 F:0.08511
44 ROUGE-SU4 Eval D0727-B.M.100.G-H.44 R:0.14723 P:0.08106 F:0.10456
44 ROUGE-SU4 Eval D0727-C.M.100.G-A.44 R:0.18339 P:0.09970 F:0.12917
44 ROUGE-SU4 Eval D0727-C.M.100.G-F.44 R:0.20646 P:0.10848 F:0.14223
44 ROUGE-SU4 Eval D0727-C.M.100.G-G.44 R:0.15989 P:0.08576 F:0.11164
44 ROUGE-SU4 Eval D0727-C.M.100.G-H.44 R:0.19907 P:0.10424 F:0.13683
44 ROUGE-SU4 Eval D0736-A.M.100.H-G.44 R:0.12177 P:0.05967 F:0.08009
44 ROUGE-SU4 Eval D0736-A.M.100.H-H.44 R:0.14474 P:0.06962 F:0.09402
44 ROUGE-SU4 Eval D0736-A.M.100.H-I.44 R:0.13187 P:0.06510 F:0.08717
44 ROUGE-SU4 Eval D0736-A.M.100.H-J.44 R:0.11913 P:0.06420 F:0.08344
44 ROUGE-SU4 Eval D0736-B.M.100.H-G.44 R:0.15617 P:0.07717 F:0.10330
44 ROUGE-SU4 Eval D0736-B.M.100.H-H.44 R:0.19872 P:0.09047 F:0.12433
44 ROUGE-SU4 Eval D0736-B.M.100.H-I.44 R:0.21501 P:0.09663 F:0.13334
44 ROUGE-SU4 Eval D0736-B.M.100.H-J.44 R:0.19664 P:0.10636 F:0.13805
44 ROUGE-SU4 Eval D0736-C.M.100.H-G.44 R:0.15939 P:0.06673 F:0.09407
44 ROUGE-SU4 Eval D0736-C.M.100.H-H.44 R:0.14525 P:0.04753 F:0.07162
44 ROUGE-SU4 Eval D0736-C.M.100.H-I.44 R:0.18250 P:0.05972 F:0.08999
44 ROUGE-SU4 Eval D0736-C.M.100.H-J.44 R:0.14527 P:0.06825 F:0.09287
44 ROUGE-SU4 Eval D0740-A.M.100.I-D.44 R:0.12373 P:0.07588 F:0.09407
44 ROUGE-SU4 Eval D0740-A.M.100.I-H.44 R:0.11130 P:0.06895 F:0.08515
44 ROUGE-SU4 Eval D0740-A.M.100.I-I.44 R:0.11444 P:0.07138 F:0.08792
44 ROUGE-SU4 Eval D0740-A.M.100.I-J.44 R:0.11093 P:0.06965 F:0.08557
44 ROUGE-SU4 Eval D0740-B.M.100.I-D.44 R:0.07778 P:0.04566 F:0.05754
44 ROUGE-SU4 Eval D0740-B.M.100.I-H.44 R:0.07596 P:0.04371 F:0.05549
44 ROUGE-SU4 Eval D0740-B.M.100.I-I.44 R:0.08754 P:0.05088 F:0.06436
44 ROUGE-SU4 Eval D0740-B.M.100.I-J.44 R:0.07586 P:0.04468 F:0.05624
44 ROUGE-SU4 Eval D0740-C.M.100.I-D.44 R:0.13333 P:0.07958 F:0.09967
44 ROUGE-SU4 Eval D0740-C.M.100.I-H.44 R:0.11386 P:0.06751 F:0.08476
44 ROUGE-SU4 Eval D0740-C.M.100.I-I.44 R:0.12350 P:0.07371 F:0.09232
44 ROUGE-SU4 Eval D0740-C.M.100.I-J.44 R:0.14597 P:0.08741 F:0.10934
44 ROUGE-SU4 Eval D0743-A.M.100.J-B.44 R:0.10043 P:0.05637 F:0.07221
44 ROUGE-SU4 Eval D0743-A.M.100.J-H.44 R:0.08597 P:0.04966 F:0.06295
44 ROUGE-SU4 Eval D0743-A.M.100.J-I.44 R:0.10150 P:0.05789 F:0.07373
44 ROUGE-SU4 Eval D0743-A.M.100.J-J.44 R:0.07834 P:0.04540 F:0.05749
44 ROUGE-SU4 Eval D0743-B.M.100.J-B.44 R:0.08169 P:0.04238 F:0.05581
44 ROUGE-SU4 Eval D0743-B.M.100.J-H.44 R:0.07066 P:0.03726 F:0.04879
44 ROUGE-SU4 Eval D0743-B.M.100.J-I.44 R:0.08874 P:0.04664 F:0.06114
44 ROUGE-SU4 Eval D0743-B.M.100.J-J.44 R:0.07668 P:0.04096 F:0.05340
44 ROUGE-SU4 Eval D0743-C.M.100.J-B.44 R:0.11618 P:0.07324 F:0.08984
44 ROUGE-SU4 Eval D0743-C.M.100.J-H.44 R:0.09368 P:0.05886 F:0.07230
44 ROUGE-SU4 Eval D0743-C.M.100.J-I.44 R:0.12186 P:0.07632 F:0.09386
44 ROUGE-SU4 Eval D0743-C.M.100.J-J.44 R:0.10000 P:0.06366 F:0.07780
---------------------------------------------
45 ROUGE-1 Average_R: 0.36705 (95%-conf.int. 0.35538 - 0.37870)
45 ROUGE-1 Average_P: 0.22736 (95%-conf.int. 0.22025 - 0.23424)
45 ROUGE-1 Average_F: 0.27995 (95%-conf.int. 0.27148 - 0.28773)
.............................................
45 ROUGE-1 Eval D0703-A.M.100.A-A.45 R:0.41216 P:0.27477 F:0.32973
45 ROUGE-1 Eval D0703-A.M.100.A-C.45 R:0.39262 P:0.26351 F:0.31536
45 ROUGE-1 Eval D0703-A.M.100.A-D.45 R:0.39175 P:0.25676 F:0.31021
45 ROUGE-1 Eval D0703-A.M.100.A-J.45 R:0.39116 P:0.25901 F:0.31165
45 ROUGE-1 Eval D0703-B.M.100.A-A.45 R:0.37908 P:0.25607 F:0.30566
45 ROUGE-1 Eval D0703-B.M.100.A-C.45 R:0.38926 P:0.25607 F:0.30892
45 ROUGE-1 Eval D0703-B.M.100.A-D.45 R:0.38926 P:0.25607 F:0.30892
45 ROUGE-1 Eval D0703-B.M.100.A-J.45 R:0.38870 P:0.25828 F:0.31034
45 ROUGE-1 Eval D0703-C.M.100.A-A.45 R:0.41000 P:0.25466 F:0.31418
45 ROUGE-1 Eval D0703-C.M.100.A-C.45 R:0.38312 P:0.24431 F:0.29836
45 ROUGE-1 Eval D0703-C.M.100.A-D.45 R:0.39073 P:0.24431 F:0.30064
45 ROUGE-1 Eval D0703-C.M.100.A-J.45 R:0.41060 P:0.25673 F:0.31593
45 ROUGE-1 Eval D0706-A.M.100.B-B.45 R:0.37338 P:0.22417 F:0.28015
45 ROUGE-1 Eval D0706-A.M.100.B-D.45 R:0.36275 P:0.21637 F:0.27106
45 ROUGE-1 Eval D0706-A.M.100.B-E.45 R:0.30844 P:0.18519 F:0.23143
45 ROUGE-1 Eval D0706-A.M.100.B-I.45 R:0.35065 P:0.21053 F:0.26310
45 ROUGE-1 Eval D0706-B.M.100.B-B.45 R:0.33007 P:0.20782 F:0.25505
45 ROUGE-1 Eval D0706-B.M.100.B-D.45 R:0.31270 P:0.19753 F:0.24212
45 ROUGE-1 Eval D0706-B.M.100.B-E.45 R:0.30195 P:0.19136 F:0.23426
45 ROUGE-1 Eval D0706-B.M.100.B-I.45 R:0.33333 P:0.21193 F:0.25912
45 ROUGE-1 Eval D0706-C.M.100.B-B.45 R:0.41613 P:0.26708 F:0.32535
45 ROUGE-1 Eval D0706-C.M.100.B-D.45 R:0.41935 P:0.26915 F:0.32787
45 ROUGE-1 Eval D0706-C.M.100.B-E.45 R:0.41987 P:0.27122 F:0.32956
45 ROUGE-1 Eval D0706-C.M.100.B-I.45 R:0.41214 P:0.26708 F:0.32412
45 ROUGE-1 Eval D0711-A.M.100.C-A.45 R:0.34539 P:0.21212 F:0.26283
45 ROUGE-1 Eval D0711-A.M.100.C-B.45 R:0.36667 P:0.22222 F:0.27673
45 ROUGE-1 Eval D0711-A.M.100.C-C.45 R:0.33333 P:0.20202 F:0.25157
45 ROUGE-1 Eval D0711-A.M.100.C-F.45 R:0.36755 P:0.22424 F:0.27854
45 ROUGE-1 Eval D0711-B.M.100.C-A.45 R:0.34694 P:0.20859 F:0.26054
45 ROUGE-1 Eval D0711-B.M.100.C-B.45 R:0.37671 P:0.22495 F:0.28169
45 ROUGE-1 Eval D0711-B.M.100.C-C.45 R:0.34564 P:0.21063 F:0.26175
45 ROUGE-1 Eval D0711-B.M.100.C-F.45 R:0.36610 P:0.22086 F:0.27551
45 ROUGE-1 Eval D0711-C.M.100.C-A.45 R:0.43564 P:0.27329 F:0.33588
45 ROUGE-1 Eval D0711-C.M.100.C-B.45 R:0.46758 P:0.28364 F:0.35309
45 ROUGE-1 Eval D0711-C.M.100.C-C.45 R:0.47635 P:0.29193 F:0.36201
45 ROUGE-1 Eval D0711-C.M.100.C-F.45 R:0.45946 P:0.28157 F:0.34916
45 ROUGE-1 Eval D0716-A.M.100.D-C.45 R:0.47213 P:0.31579 F:0.37845
45 ROUGE-1 Eval D0716-A.M.100.D-D.45 R:0.46333 P:0.30482 F:0.36772
45 ROUGE-1 Eval D0716-A.M.100.D-E.45 R:0.49502 P:0.32675 F:0.39366
45 ROUGE-1 Eval D0716-A.M.100.D-F.45 R:0.45545 P:0.30263 F:0.36364
45 ROUGE-1 Eval D0716-B.M.100.D-C.45 R:0.45395 P:0.26437 F:0.33414
45 ROUGE-1 Eval D0716-B.M.100.D-D.45 R:0.46644 P:0.26628 F:0.33902
45 ROUGE-1 Eval D0716-B.M.100.D-E.45 R:0.45847 P:0.26437 F:0.33536
45 ROUGE-1 Eval D0716-B.M.100.D-F.45 R:0.45667 P:0.26245 F:0.33333
45 ROUGE-1 Eval D0716-C.M.100.D-C.45 R:0.36156 P:0.24503 F:0.29210
45 ROUGE-1 Eval D0716-C.M.100.D-D.45 R:0.37124 P:0.24503 F:0.29521
45 ROUGE-1 Eval D0716-C.M.100.D-E.45 R:0.40924 P:0.27373 F:0.32804
45 ROUGE-1 Eval D0716-C.M.100.D-F.45 R:0.39667 P:0.26269 F:0.31607
45 ROUGE-1 Eval D0721-A.M.100.E-B.45 R:0.31667 P:0.20971 F:0.25232
45 ROUGE-1 Eval D0721-A.M.100.E-C.45 R:0.30519 P:0.20751 F:0.24704
45 ROUGE-1 Eval D0721-A.M.100.E-E.45 R:0.28896 P:0.19647 F:0.23390
45 ROUGE-1 Eval D0721-A.M.100.E-G.45 R:0.29936 P:0.20751 F:0.24511
45 ROUGE-1 Eval D0721-B.M.100.E-B.45 R:0.37785 P:0.22351 F:0.28087
45 ROUGE-1 Eval D0721-B.M.100.E-C.45 R:0.36943 P:0.22351 F:0.27851
45 ROUGE-1 Eval D0721-B.M.100.E-E.45 R:0.37705 P:0.22158 F:0.27913
45 ROUGE-1 Eval D0721-B.M.100.E-G.45 R:0.36129 P:0.21580 F:0.27021
45 ROUGE-1 Eval D0721-C.M.100.E-B.45 R:0.39344 P:0.25000 F:0.30573
45 ROUGE-1 Eval D0721-C.M.100.E-C.45 R:0.33663 P:0.21250 F:0.26054
45 ROUGE-1 Eval D0721-C.M.100.E-E.45 R:0.35667 P:0.22292 F:0.27436
45 ROUGE-1 Eval D0721-C.M.100.E-G.45 R:0.30619 P:0.19583 F:0.23888
45 ROUGE-1 Eval D0726-A.M.100.F-A.45 R:0.40199 P:0.26889 F:0.32224
45 ROUGE-1 Eval D0726-A.M.100.F-E.45 R:0.36333 P:0.24222 F:0.29066
45 ROUGE-1 Eval D0726-A.M.100.F-F.45 R:0.40199 P:0.26889 F:0.32224
45 ROUGE-1 Eval D0726-A.M.100.F-G.45 R:0.39867 P:0.26667 F:0.31958
45 ROUGE-1 Eval D0726-B.M.100.F-A.45 R:0.35294 P:0.22360 F:0.27376
45 ROUGE-1 Eval D0726-B.M.100.F-E.45 R:0.33223 P:0.20704 F:0.25510
45 ROUGE-1 Eval D0726-B.M.100.F-F.45 R:0.34884 P:0.21739 F:0.26786
45 ROUGE-1 Eval D0726-B.M.100.F-G.45 R:0.34211 P:0.21532 F:0.26430
45 ROUGE-1 Eval D0726-C.M.100.F-A.45 R:0.35333 P:0.21545 F:0.26768
45 ROUGE-1 Eval D0726-C.M.100.F-E.45 R:0.34680 P:0.20935 F:0.26109
45 ROUGE-1 Eval D0726-C.M.100.F-F.45 R:0.31864 P:0.19106 F:0.23888
45 ROUGE-1 Eval D0726-C.M.100.F-G.45 R:0.30492 P:0.18902 F:0.23337
45 ROUGE-1 Eval D0727-A.M.100.G-A.45 R:0.38870 P:0.26000 F:0.31158
45 ROUGE-1 Eval D0727-A.M.100.G-F.45 R:0.40789 P:0.27556 F:0.32891
45 ROUGE-1 Eval D0727-A.M.100.G-G.45 R:0.37255 P:0.25333 F:0.30159
45 ROUGE-1 Eval D0727-A.M.100.G-H.45 R:0.39145 P:0.26444 F:0.31565
45 ROUGE-1 Eval D0727-B.M.100.G-A.45 R:0.34021 P:0.20625 F:0.25681
45 ROUGE-1 Eval D0727-B.M.100.G-F.45 R:0.32792 P:0.21042 F:0.25635
45 ROUGE-1 Eval D0727-B.M.100.G-G.45 R:0.30104 P:0.18125 F:0.22627
45 ROUGE-1 Eval D0727-B.M.100.G-H.45 R:0.32302 P:0.19583 F:0.24384
45 ROUGE-1 Eval D0727-C.M.100.G-A.45 R:0.35179 P:0.21818 F:0.26932
45 ROUGE-1 Eval D0727-C.M.100.G-F.45 R:0.36027 P:0.21616 F:0.27020
45 ROUGE-1 Eval D0727-C.M.100.G-G.45 R:0.36964 P:0.22626 F:0.28070
45 ROUGE-1 Eval D0727-C.M.100.G-H.45 R:0.38514 P:0.23030 F:0.28824
45 ROUGE-1 Eval D0736-A.M.100.H-G.45 R:0.26523 P:0.15041 F:0.19196
45 ROUGE-1 Eval D0736-A.M.100.H-H.45 R:0.29562 P:0.16463 F:0.21148
45 ROUGE-1 Eval D0736-A.M.100.H-I.45 R:0.27758 P:0.15854 F:0.20181
45 ROUGE-1 Eval D0736-A.M.100.H-J.45 R:0.26797 P:0.16667 F:0.20552
45 ROUGE-1 Eval D0736-B.M.100.H-G.45 R:0.40076 P:0.19022 F:0.25799
45 ROUGE-1 Eval D0736-B.M.100.H-H.45 R:0.44628 P:0.19565 F:0.27204
45 ROUGE-1 Eval D0736-B.M.100.H-I.45 R:0.45188 P:0.19565 F:0.27307
45 ROUGE-1 Eval D0736-B.M.100.H-J.45 R:0.45105 P:0.23370 F:0.30788
45 ROUGE-1 Eval D0736-C.M.100.H-G.45 R:0.45570 P:0.20571 F:0.28346
45 ROUGE-1 Eval D0736-C.M.100.H-H.45 R:0.58824 P:0.20952 F:0.30899
45 ROUGE-1 Eval D0736-C.M.100.H-I.45 R:0.47059 P:0.16762 F:0.24719
45 ROUGE-1 Eval D0736-C.M.100.H-J.45 R:0.48679 P:0.24571 F:0.32658
45 ROUGE-1 Eval D0740-A.M.100.I-D.45 R:0.30033 P:0.17739 F:0.22304
45 ROUGE-1 Eval D0740-A.M.100.I-H.45 R:0.30392 P:0.18129 F:0.22711
45 ROUGE-1 Eval D0740-A.M.100.I-I.45 R:0.31494 P:0.18908 F:0.23630
45 ROUGE-1 Eval D0740-A.M.100.I-J.45 R:0.30323 P:0.18324 F:0.22844
45 ROUGE-1 Eval D0740-B.M.100.I-D.45 R:0.36688 P:0.25111 F:0.29815
45 ROUGE-1 Eval D0740-B.M.100.I-H.45 R:0.35099 P:0.23556 F:0.28192
45 ROUGE-1 Eval D0740-B.M.100.I-I.45 R:0.35738 P:0.24222 F:0.28874
45 ROUGE-1 Eval D0740-B.M.100.I-J.45 R:0.35599 P:0.24444 F:0.28985
45 ROUGE-1 Eval D0740-C.M.100.I-D.45 R:0.39617 P:0.27928 F:0.32761
45 ROUGE-1 Eval D0740-C.M.100.I-H.45 R:0.36013 P:0.25225 F:0.29669
45 ROUGE-1 Eval D0740-C.M.100.I-I.45 R:0.38019 P:0.26802 F:0.31440
45 ROUGE-1 Eval D0740-C.M.100.I-J.45 R:0.38854 P:0.27477 F:0.32190
45 ROUGE-1 Eval D0743-A.M.100.J-B.45 R:0.24762 P:0.15205 F:0.18841
45 ROUGE-1 Eval D0743-A.M.100.J-H.45 R:0.22222 P:0.14035 F:0.17204
45 ROUGE-1 Eval D0743-A.M.100.J-I.45 R:0.25938 P:0.16179 F:0.19928
45 ROUGE-1 Eval D0743-A.M.100.J-J.45 R:0.21538 P:0.13645 F:0.16706
45 ROUGE-1 Eval D0743-B.M.100.J-B.45 R:0.25641 P:0.16260 F:0.19900
45 ROUGE-1 Eval D0743-B.M.100.J-H.45 R:0.23028 P:0.14837 F:0.18047
45 ROUGE-1 Eval D0743-B.M.100.J-I.45 R:0.24367 P:0.15650 F:0.19059
45 ROUGE-1 Eval D0743-B.M.100.J-J.45 R:0.24611 P:0.16057 F:0.19434
45 ROUGE-1 Eval D0743-C.M.100.J-B.45 R:0.36508 P:0.25054 F:0.29715
45 ROUGE-1 Eval D0743-C.M.100.J-H.45 R:0.31210 P:0.21351 F:0.25356
45 ROUGE-1 Eval D0743-C.M.100.J-I.45 R:0.36741 P:0.25054 F:0.29792
45 ROUGE-1 Eval D0743-C.M.100.J-J.45 R:0.32704 P:0.22658 F:0.26770
---------------------------------------------
45 ROUGE-2 Average_R: 0.09568 (95%-conf.int. 0.08750 - 0.10488)
45 ROUGE-2 Average_P: 0.05874 (95%-conf.int. 0.05383 - 0.06387)
45 ROUGE-2 Average_F: 0.07249 (95%-conf.int. 0.06656 - 0.07915)
.............................................
45 ROUGE-2 Eval D0703-A.M.100.A-A.45 R:0.14334 P:0.09524 F:0.11444
45 ROUGE-2 Eval D0703-A.M.100.A-C.45 R:0.13559 P:0.09070 F:0.10869
45 ROUGE-2 Eval D0703-A.M.100.A-D.45 R:0.13542 P:0.08844 F:0.10700
45 ROUGE-2 Eval D0703-A.M.100.A-J.45 R:0.12027 P:0.07937 F:0.09563
45 ROUGE-2 Eval D0703-B.M.100.A-A.45 R:0.13861 P:0.09333 F:0.11155
45 ROUGE-2 Eval D0703-B.M.100.A-C.45 R:0.11186 P:0.07333 F:0.08859
45 ROUGE-2 Eval D0703-B.M.100.A-D.45 R:0.12542 P:0.08222 F:0.09933
45 ROUGE-2 Eval D0703-B.M.100.A-J.45 R:0.13758 P:0.09111 F:0.10962
45 ROUGE-2 Eval D0703-C.M.100.A-A.45 R:0.08081 P:0.05000 F:0.06178
45 ROUGE-2 Eval D0703-C.M.100.A-C.45 R:0.08197 P:0.05208 F:0.06369
45 ROUGE-2 Eval D0703-C.M.100.A-D.45 R:0.07692 P:0.04792 F:0.05905
45 ROUGE-2 Eval D0703-C.M.100.A-J.45 R:0.07023 P:0.04375 F:0.05391
45 ROUGE-2 Eval D0706-A.M.100.B-B.45 R:0.12787 P:0.07647 F:0.09571
45 ROUGE-2 Eval D0706-A.M.100.B-D.45 R:0.13531 P:0.08039 F:0.10086
45 ROUGE-2 Eval D0706-A.M.100.B-E.45 R:0.09508 P:0.05686 F:0.07116
45 ROUGE-2 Eval D0706-A.M.100.B-I.45 R:0.12459 P:0.07451 F:0.09325
45 ROUGE-2 Eval D0706-B.M.100.B-B.45 R:0.08251 P:0.05176 F:0.06361
45 ROUGE-2 Eval D0706-B.M.100.B-D.45 R:0.06579 P:0.04141 F:0.05083
45 ROUGE-2 Eval D0706-B.M.100.B-E.45 R:0.04262 P:0.02692 F:0.03300
45 ROUGE-2 Eval D0706-B.M.100.B-I.45 R:0.07516 P:0.04762 F:0.05830
45 ROUGE-2 Eval D0706-C.M.100.B-B.45 R:0.07492 P:0.04792 F:0.05845
45 ROUGE-2 Eval D0706-C.M.100.B-D.45 R:0.08143 P:0.05208 F:0.06353
45 ROUGE-2 Eval D0706-C.M.100.B-E.45 R:0.08091 P:0.05208 F:0.06337
45 ROUGE-2 Eval D0706-C.M.100.B-I.45 R:0.06452 P:0.04167 F:0.05064
45 ROUGE-2 Eval D0711-A.M.100.C-A.45 R:0.04983 P:0.03049 F:0.03783
45 ROUGE-2 Eval D0711-A.M.100.C-B.45 R:0.06734 P:0.04065 F:0.05070
45 ROUGE-2 Eval D0711-A.M.100.C-C.45 R:0.04040 P:0.02439 F:0.03042
45 ROUGE-2 Eval D0711-A.M.100.C-F.45 R:0.05351 P:0.03252 F:0.04045
45 ROUGE-2 Eval D0711-B.M.100.C-A.45 R:0.06529 P:0.03909 F:0.04890
45 ROUGE-2 Eval D0711-B.M.100.C-B.45 R:0.08304 P:0.04938 F:0.06193
45 ROUGE-2 Eval D0711-B.M.100.C-C.45 R:0.06780 P:0.04115 F:0.05122
45 ROUGE-2 Eval D0711-B.M.100.C-F.45 R:0.07192 P:0.04321 F:0.05399
45 ROUGE-2 Eval D0711-C.M.100.C-A.45 R:0.14667 P:0.09167 F:0.11282
45 ROUGE-2 Eval D0711-C.M.100.C-B.45 R:0.17241 P:0.10417 F:0.12987
45 ROUGE-2 Eval D0711-C.M.100.C-C.45 R:0.19454 P:0.11875 F:0.14748
45 ROUGE-2 Eval D0711-C.M.100.C-F.45 R:0.18089 P:0.11042 F:0.13713
45 ROUGE-2 Eval D0716-A.M.100.D-C.45 R:0.20199 P:0.13466 F:0.16159
45 ROUGE-2 Eval D0716-A.M.100.D-D.45 R:0.20539 P:0.13466 F:0.16267
45 ROUGE-2 Eval D0716-A.M.100.D-E.45 R:0.22148 P:0.14570 F:0.17577
45 ROUGE-2 Eval D0716-A.M.100.D-F.45 R:0.20333 P:0.13466 F:0.16202
45 ROUGE-2 Eval D0716-B.M.100.D-C.45 R:0.12292 P:0.07129 F:0.09024
45 ROUGE-2 Eval D0716-B.M.100.D-D.45 R:0.13898 P:0.07900 F:0.10074
45 ROUGE-2 Eval D0716-B.M.100.D-E.45 R:0.13087 P:0.07514 F:0.09547
45 ROUGE-2 Eval D0716-B.M.100.D-F.45 R:0.14141 P:0.08092 F:0.10294
45 ROUGE-2 Eval D0716-C.M.100.D-C.45 R:0.08224 P:0.05556 F:0.06632
45 ROUGE-2 Eval D0716-C.M.100.D-D.45 R:0.07770 P:0.05111 F:0.06166
45 ROUGE-2 Eval D0716-C.M.100.D-E.45 R:0.10667 P:0.07111 F:0.08533
45 ROUGE-2 Eval D0716-C.M.100.D-F.45 R:0.09428 P:0.06222 F:0.07497
45 ROUGE-2 Eval D0721-A.M.100.E-B.45 R:0.05724 P:0.03778 F:0.04552
45 ROUGE-2 Eval D0721-A.M.100.E-C.45 R:0.03934 P:0.02667 F:0.03179
45 ROUGE-2 Eval D0721-A.M.100.E-E.45 R:0.06230 P:0.04222 F:0.05033
45 ROUGE-2 Eval D0721-A.M.100.E-G.45 R:0.04823 P:0.03333 F:0.03942
45 ROUGE-2 Eval D0721-B.M.100.E-B.45 R:0.06579 P:0.03876 F:0.04878
45 ROUGE-2 Eval D0721-B.M.100.E-C.45 R:0.07074 P:0.04264 F:0.05321
45 ROUGE-2 Eval D0721-B.M.100.E-E.45 R:0.06954 P:0.04070 F:0.05135
45 ROUGE-2 Eval D0721-B.M.100.E-G.45 R:0.05863 P:0.03488 F:0.04374
45 ROUGE-2 Eval D0721-C.M.100.E-B.45 R:0.11921 P:0.07547 F:0.09243
45 ROUGE-2 Eval D0721-C.M.100.E-C.45 R:0.10667 P:0.06709 F:0.08237
45 ROUGE-2 Eval D0721-C.M.100.E-E.45 R:0.11785 P:0.07338 F:0.09044
45 ROUGE-2 Eval D0721-C.M.100.E-G.45 R:0.08553 P:0.05451 F:0.06658
45 ROUGE-2 Eval D0726-A.M.100.F-A.45 R:0.18456 P:0.12304 F:0.14765
45 ROUGE-2 Eval D0726-A.M.100.F-E.45 R:0.13805 P:0.09172 F:0.11021
45 ROUGE-2 Eval D0726-A.M.100.F-F.45 R:0.17785 P:0.11857 F:0.14228
45 ROUGE-2 Eval D0726-A.M.100.F-G.45 R:0.14430 P:0.09620 F:0.11544
45 ROUGE-2 Eval D0726-B.M.100.F-A.45 R:0.06271 P:0.03958 F:0.04853
45 ROUGE-2 Eval D0726-B.M.100.F-E.45 R:0.05034 P:0.03125 F:0.03856
45 ROUGE-2 Eval D0726-B.M.100.F-F.45 R:0.05369 P:0.03333 F:0.04113
45 ROUGE-2 Eval D0726-B.M.100.F-G.45 R:0.05316 P:0.03333 F:0.04097
45 ROUGE-2 Eval D0726-C.M.100.F-A.45 R:0.07744 P:0.04703 F:0.05852
45 ROUGE-2 Eval D0726-C.M.100.F-E.45 R:0.07483 P:0.04499 F:0.05619
45 ROUGE-2 Eval D0726-C.M.100.F-F.45 R:0.06507 P:0.03885 F:0.04865
45 ROUGE-2 Eval D0726-C.M.100.F-G.45 R:0.05629 P:0.03476 F:0.04298
45 ROUGE-2 Eval D0727-A.M.100.G-A.45 R:0.06040 P:0.04027 F:0.04832
45 ROUGE-2 Eval D0727-A.M.100.G-F.45 R:0.07973 P:0.05369 F:0.06417
45 ROUGE-2 Eval D0727-A.M.100.G-G.45 R:0.06271 P:0.04251 F:0.05067
45 ROUGE-2 Eval D0727-A.M.100.G-H.45 R:0.07641 P:0.05145 F:0.06149
45 ROUGE-2 Eval D0727-B.M.100.G-A.45 R:0.08681 P:0.05241 F:0.06536
45 ROUGE-2 Eval D0727-B.M.100.G-F.45 R:0.07869 P:0.05031 F:0.06138
45 ROUGE-2 Eval D0727-B.M.100.G-G.45 R:0.04895 P:0.02935 F:0.03670
45 ROUGE-2 Eval D0727-B.M.100.G-H.45 R:0.08333 P:0.05031 F:0.06274
45 ROUGE-2 Eval D0727-C.M.100.G-A.45 R:0.02632 P:0.01626 F:0.02010
45 ROUGE-2 Eval D0727-C.M.100.G-F.45 R:0.03061 P:0.01829 F:0.02290
45 ROUGE-2 Eval D0727-C.M.100.G-G.45 R:0.03667 P:0.02236 F:0.02778
45 ROUGE-2 Eval D0727-C.M.100.G-H.45 R:0.03754 P:0.02236 F:0.02803
45 ROUGE-2 Eval D0736-A.M.100.H-G.45 R:0.04348 P:0.02454 F:0.03137
45 ROUGE-2 Eval D0736-A.M.100.H-H.45 R:0.04059 P:0.02249 F:0.02894
45 ROUGE-2 Eval D0736-A.M.100.H-I.45 R:0.04317 P:0.02454 F:0.03129
45 ROUGE-2 Eval D0736-A.M.100.H-J.45 R:0.03300 P:0.02045 F:0.02525
45 ROUGE-2 Eval D0736-B.M.100.H-G.45 R:0.10425 P:0.04918 F:0.06683
45 ROUGE-2 Eval D0736-B.M.100.H-H.45 R:0.16736 P:0.07286 F:0.10152
45 ROUGE-2 Eval D0736-B.M.100.H-I.45 R:0.16102 P:0.06922 F:0.09682
45 ROUGE-2 Eval D0736-B.M.100.H-J.45 R:0.16961 P:0.08743 F:0.11538
45 ROUGE-2 Eval D0736-C.M.100.H-G.45 R:0.14530 P:0.06513 F:0.08994
45 ROUGE-2 Eval D0736-C.M.100.H-H.45 R:0.27174 P:0.09579 F:0.14165
45 ROUGE-2 Eval D0736-C.M.100.H-I.45 R:0.16304 P:0.05747 F:0.08498
45 ROUGE-2 Eval D0736-C.M.100.H-J.45 R:0.18321 P:0.09195 F:0.12245
45 ROUGE-2 Eval D0740-A.M.100.I-D.45 R:0.07000 P:0.04118 F:0.05185
45 ROUGE-2 Eval D0740-A.M.100.I-H.45 R:0.06601 P:0.03922 F:0.04920
45 ROUGE-2 Eval D0740-A.M.100.I-I.45 R:0.06885 P:0.04118 F:0.05154
45 ROUGE-2 Eval D0740-A.M.100.I-J.45 R:0.06189 P:0.03725 F:0.04651
45 ROUGE-2 Eval D0740-B.M.100.I-D.45 R:0.11148 P:0.07606 F:0.09043
45 ROUGE-2 Eval D0740-B.M.100.I-H.45 R:0.10702 P:0.07159 F:0.08579
45 ROUGE-2 Eval D0740-B.M.100.I-I.45 R:0.10265 P:0.06935 F:0.08278
45 ROUGE-2 Eval D0740-B.M.100.I-J.45 R:0.10458 P:0.07159 F:0.08500
45 ROUGE-2 Eval D0740-C.M.100.I-D.45 R:0.15161 P:0.10658 F:0.12517
45 ROUGE-2 Eval D0740-C.M.100.I-H.45 R:0.11039 P:0.07710 F:0.09079
45 ROUGE-2 Eval D0740-C.M.100.I-I.45 R:0.13548 P:0.09524 F:0.11185
45 ROUGE-2 Eval D0740-C.M.100.I-J.45 R:0.13505 P:0.09524 F:0.11170
45 ROUGE-2 Eval D0743-A.M.100.J-B.45 R:0.03846 P:0.02353 F:0.02920
45 ROUGE-2 Eval D0743-A.M.100.J-H.45 R:0.02804 P:0.01765 F:0.02166
45 ROUGE-2 Eval D0743-A.M.100.J-I.45 R:0.03470 P:0.02157 F:0.02660
45 ROUGE-2 Eval D0743-A.M.100.J-J.45 R:0.01242 P:0.00784 F:0.00961
45 ROUGE-2 Eval D0743-B.M.100.J-B.45 R:0.04207 P:0.02658 F:0.03258
45 ROUGE-2 Eval D0743-B.M.100.J-H.45 R:0.03822 P:0.02454 F:0.02989
45 ROUGE-2 Eval D0743-B.M.100.J-I.45 R:0.03195 P:0.02045 F:0.02494
45 ROUGE-2 Eval D0743-B.M.100.J-J.45 R:0.04088 P:0.02658 F:0.03221
45 ROUGE-2 Eval D0743-C.M.100.J-B.45 R:0.10256 P:0.07018 F:0.08334
45 ROUGE-2 Eval D0743-C.M.100.J-H.45 R:0.06752 P:0.04605 F:0.05476
45 ROUGE-2 Eval D0743-C.M.100.J-I.45 R:0.10968 P:0.07456 F:0.08877
45 ROUGE-2 Eval D0743-C.M.100.J-J.45 R:0.09524 P:0.06579 F:0.07782
---------------------------------------------
45 ROUGE-3 Average_R: 0.04065 (95%-conf.int. 0.03491 - 0.04684)
45 ROUGE-3 Average_P: 0.02462 (95%-conf.int. 0.02130 - 0.02812)
45 ROUGE-3 Average_F: 0.03050 (95%-conf.int. 0.02633 - 0.03497)
.............................................
45 ROUGE-3 Eval D0703-A.M.100.A-A.45 R:0.06552 P:0.04338 F:0.05220
45 ROUGE-3 Eval D0703-A.M.100.A-C.45 R:0.05479 P:0.03653 F:0.04383
45 ROUGE-3 Eval D0703-A.M.100.A-D.45 R:0.05965 P:0.03881 F:0.04702
45 ROUGE-3 Eval D0703-A.M.100.A-J.45 R:0.03819 P:0.02511 F:0.03030
45 ROUGE-3 Eval D0703-B.M.100.A-A.45 R:0.07000 P:0.04698 F:0.05622
45 ROUGE-3 Eval D0703-B.M.100.A-C.45 R:0.03767 P:0.02461 F:0.02977
45 ROUGE-3 Eval D0703-B.M.100.A-D.45 R:0.05137 P:0.03356 F:0.04060
45 ROUGE-3 Eval D0703-B.M.100.A-J.45 R:0.06441 P:0.04251 F:0.05122
45 ROUGE-3 Eval D0703-C.M.100.A-A.45 R:0.01701 P:0.01048 F:0.01297
45 ROUGE-3 Eval D0703-C.M.100.A-C.45 R:0.01987 P:0.01258 F:0.01541
45 ROUGE-3 Eval D0703-C.M.100.A-D.45 R:0.01351 P:0.00839 F:0.01035
45 ROUGE-3 Eval D0703-C.M.100.A-J.45 R:0.01014 P:0.00629 F:0.00776
45 ROUGE-3 Eval D0706-A.M.100.B-B.45 R:0.05298 P:0.03156 F:0.03956
45 ROUGE-3 Eval D0706-A.M.100.B-D.45 R:0.06667 P:0.03945 F:0.04957
45 ROUGE-3 Eval D0706-A.M.100.B-E.45 R:0.03311 P:0.01972 F:0.02472
45 ROUGE-3 Eval D0706-A.M.100.B-I.45 R:0.05629 P:0.03353 F:0.04203
45 ROUGE-3 Eval D0706-B.M.100.B-B.45 R:0.03667 P:0.02292 F:0.02821
45 ROUGE-3 Eval D0706-B.M.100.B-D.45 R:0.02326 P:0.01458 F:0.01792
45 ROUGE-3 Eval D0706-B.M.100.B-E.45 R:0.01325 P:0.00833 F:0.01023
45 ROUGE-3 Eval D0706-B.M.100.B-I.45 R:0.03630 P:0.02292 F:0.02810
45 ROUGE-3 Eval D0706-C.M.100.B-B.45 R:0.02303 P:0.01468 F:0.01793
45 ROUGE-3 Eval D0706-C.M.100.B-D.45 R:0.02632 P:0.01677 F:0.02049
45 ROUGE-3 Eval D0706-C.M.100.B-E.45 R:0.02614 P:0.01677 F:0.02043
45 ROUGE-3 Eval D0706-C.M.100.B-I.45 R:0.01303 P:0.00839 F:0.01021
45 ROUGE-3 Eval D0711-A.M.100.C-A.45 R:0.01342 P:0.00818 F:0.01016
45 ROUGE-3 Eval D0711-A.M.100.C-B.45 R:0.01361 P:0.00818 F:0.01022
45 ROUGE-3 Eval D0711-A.M.100.C-C.45 R:0.00340 P:0.00204 F:0.00255
45 ROUGE-3 Eval D0711-A.M.100.C-F.45 R:0.01014 P:0.00613 F:0.00764
45 ROUGE-3 Eval D0711-B.M.100.C-A.45 R:0.01736 P:0.01035 F:0.01297
45 ROUGE-3 Eval D0711-B.M.100.C-B.45 R:0.02448 P:0.01449 F:0.01820
45 ROUGE-3 Eval D0711-B.M.100.C-C.45 R:0.01712 P:0.01035 F:0.01290
45 ROUGE-3 Eval D0711-B.M.100.C-F.45 R:0.02422 P:0.01449 F:0.01813
45 ROUGE-3 Eval D0711-C.M.100.C-A.45 R:0.09091 P:0.05660 F:0.06976
45 ROUGE-3 Eval D0711-C.M.100.C-B.45 R:0.10801 P:0.06499 F:0.08115
45 ROUGE-3 Eval D0711-C.M.100.C-C.45 R:0.12759 P:0.07757 F:0.09648
45 ROUGE-3 Eval D0711-C.M.100.C-F.45 R:0.10690 P:0.06499 F:0.08084
45 ROUGE-3 Eval D0716-A.M.100.D-C.45 R:0.09030 P:0.06000 F:0.07210
45 ROUGE-3 Eval D0716-A.M.100.D-D.45 R:0.10544 P:0.06889 F:0.08333
45 ROUGE-3 Eval D0716-A.M.100.D-E.45 R:0.10169 P:0.06667 F:0.08054
45 ROUGE-3 Eval D0716-A.M.100.D-F.45 R:0.09764 P:0.06444 F:0.07764
45 ROUGE-3 Eval D0716-B.M.100.D-C.45 R:0.04027 P:0.02326 F:0.02949
45 ROUGE-3 Eval D0716-B.M.100.D-D.45 R:0.05137 P:0.02907 F:0.03713
45 ROUGE-3 Eval D0716-B.M.100.D-E.45 R:0.04407 P:0.02519 F:0.03206
45 ROUGE-3 Eval D0716-B.M.100.D-F.45 R:0.04762 P:0.02713 F:0.03457
45 ROUGE-3 Eval D0716-C.M.100.D-C.45 R:0.03987 P:0.02685 F:0.03209
45 ROUGE-3 Eval D0716-C.M.100.D-D.45 R:0.02389 P:0.01566 F:0.01892
45 ROUGE-3 Eval D0716-C.M.100.D-E.45 R:0.04714 P:0.03132 F:0.03764
45 ROUGE-3 Eval D0716-C.M.100.D-F.45 R:0.04082 P:0.02685 F:0.03239
45 ROUGE-3 Eval D0721-A.M.100.E-B.45 R:0.01361 P:0.00895 F:0.01080
45 ROUGE-3 Eval D0721-A.M.100.E-C.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-3 Eval D0721-A.M.100.E-E.45 R:0.01325 P:0.00895 F:0.01068
45 ROUGE-3 Eval D0721-A.M.100.E-G.45 R:0.01299 P:0.00895 F:0.01060
45 ROUGE-3 Eval D0721-B.M.100.E-B.45 R:0.01993 P:0.01170 F:0.01474
45 ROUGE-3 Eval D0721-B.M.100.E-C.45 R:0.02273 P:0.01365 F:0.01706
45 ROUGE-3 Eval D0721-B.M.100.E-E.45 R:0.03010 P:0.01754 F:0.02216
45 ROUGE-3 Eval D0721-B.M.100.E-G.45 R:0.01645 P:0.00975 F:0.01224
45 ROUGE-3 Eval D0721-C.M.100.E-B.45 R:0.06355 P:0.04008 F:0.04916
45 ROUGE-3 Eval D0721-C.M.100.E-C.45 R:0.05051 P:0.03165 F:0.03892
45 ROUGE-3 Eval D0721-C.M.100.E-E.45 R:0.06463 P:0.04008 F:0.04948
45 ROUGE-3 Eval D0721-C.M.100.E-G.45 R:0.05316 P:0.03376 F:0.04130
45 ROUGE-3 Eval D0726-A.M.100.F-A.45 R:0.12881 P:0.08559 F:0.10284
45 ROUGE-3 Eval D0726-A.M.100.F-E.45 R:0.08844 P:0.05856 F:0.07046
45 ROUGE-3 Eval D0726-A.M.100.F-F.45 R:0.11864 P:0.07883 F:0.09472
45 ROUGE-3 Eval D0726-A.M.100.F-G.45 R:0.08136 P:0.05405 F:0.06495
45 ROUGE-3 Eval D0726-B.M.100.F-A.45 R:0.01333 P:0.00839 F:0.01030
45 ROUGE-3 Eval D0726-B.M.100.F-E.45 R:0.00678 P:0.00419 F:0.00518
45 ROUGE-3 Eval D0726-B.M.100.F-F.45 R:0.01356 P:0.00839 F:0.01037
45 ROUGE-3 Eval D0726-B.M.100.F-G.45 R:0.00671 P:0.00419 F:0.00516
45 ROUGE-3 Eval D0726-C.M.100.F-A.45 R:0.02381 P:0.01440 F:0.01795
45 ROUGE-3 Eval D0726-C.M.100.F-E.45 R:0.02062 P:0.01235 F:0.01545
45 ROUGE-3 Eval D0726-C.M.100.F-F.45 R:0.01730 P:0.01029 F:0.01290
45 ROUGE-3 Eval D0726-C.M.100.F-G.45 R:0.01003 P:0.00617 F:0.00764
45 ROUGE-3 Eval D0727-A.M.100.G-A.45 R:0.02034 P:0.01351 F:0.01624
45 ROUGE-3 Eval D0727-A.M.100.G-F.45 R:0.03356 P:0.02252 F:0.02695
45 ROUGE-3 Eval D0727-A.M.100.G-G.45 R:0.02333 P:0.01577 F:0.01882
45 ROUGE-3 Eval D0727-A.M.100.G-H.45 R:0.03356 P:0.02252 F:0.02695
45 ROUGE-3 Eval D0727-B.M.100.G-A.45 R:0.03158 P:0.01899 F:0.02372
45 ROUGE-3 Eval D0727-B.M.100.G-F.45 R:0.02318 P:0.01477 F:0.01804
45 ROUGE-3 Eval D0727-B.M.100.G-G.45 R:0.01060 P:0.00633 F:0.00793
45 ROUGE-3 Eval D0727-B.M.100.G-H.45 R:0.02807 P:0.01688 F:0.02108
45 ROUGE-3 Eval D0727-C.M.100.G-A.45 R:0.00664 P:0.00409 F:0.00506
45 ROUGE-3 Eval D0727-C.M.100.G-F.45 R:0.00687 P:0.00409 F:0.00513
45 ROUGE-3 Eval D0727-C.M.100.G-G.45 R:0.01010 P:0.00613 F:0.00763
45 ROUGE-3 Eval D0727-C.M.100.G-H.45 R:0.00690 P:0.00409 F:0.00514
45 ROUGE-3 Eval D0736-A.M.100.H-G.45 R:0.01832 P:0.01029 F:0.01318
45 ROUGE-3 Eval D0736-A.M.100.H-H.45 R:0.01493 P:0.00823 F:0.01061
45 ROUGE-3 Eval D0736-A.M.100.H-I.45 R:0.01091 P:0.00617 F:0.00788
45 ROUGE-3 Eval D0736-A.M.100.H-J.45 R:0.01000 P:0.00617 F:0.00763
45 ROUGE-3 Eval D0736-B.M.100.H-G.45 R:0.04688 P:0.02198 F:0.02993
45 ROUGE-3 Eval D0736-B.M.100.H-H.45 R:0.11017 P:0.04762 F:0.06650
45 ROUGE-3 Eval D0736-B.M.100.H-I.45 R:0.10300 P:0.04396 F:0.06162
45 ROUGE-3 Eval D0736-B.M.100.H-J.45 R:0.11071 P:0.05678 F:0.07506
45 ROUGE-3 Eval D0736-C.M.100.H-G.45 R:0.06926 P:0.03083 F:0.04267
45 ROUGE-3 Eval D0736-C.M.100.H-H.45 R:0.16022 P:0.05588 F:0.08286
45 ROUGE-3 Eval D0736-C.M.100.H-I.45 R:0.09392 P:0.03276 F:0.04858
45 ROUGE-3 Eval D0736-C.M.100.H-J.45 R:0.09653 P:0.04817 F:0.06427
45 ROUGE-3 Eval D0740-A.M.100.I-D.45 R:0.01347 P:0.00789 F:0.00995
45 ROUGE-3 Eval D0740-A.M.100.I-H.45 R:0.01333 P:0.00789 F:0.00991
45 ROUGE-3 Eval D0740-A.M.100.I-I.45 R:0.01325 P:0.00789 F:0.00989
45 ROUGE-3 Eval D0740-A.M.100.I-J.45 R:0.00987 P:0.00592 F:0.00740
45 ROUGE-3 Eval D0740-B.M.100.I-D.45 R:0.05629 P:0.03829 F:0.04558
45 ROUGE-3 Eval D0740-B.M.100.I-H.45 R:0.05405 P:0.03604 F:0.04324
45 ROUGE-3 Eval D0740-B.M.100.I-I.45 R:0.04682 P:0.03153 F:0.03768
45 ROUGE-3 Eval D0740-B.M.100.I-J.45 R:0.06271 P:0.04279 F:0.05087
45 ROUGE-3 Eval D0740-C.M.100.I-D.45 R:0.08143 P:0.05708 F:0.06711
45 ROUGE-3 Eval D0740-C.M.100.I-H.45 R:0.04590 P:0.03196 F:0.03768
45 ROUGE-3 Eval D0740-C.M.100.I-I.45 R:0.06189 P:0.04338 F:0.05101
45 ROUGE-3 Eval D0740-C.M.100.I-J.45 R:0.06494 P:0.04566 F:0.05362
45 ROUGE-3 Eval D0743-A.M.100.J-B.45 R:0.01618 P:0.00986 F:0.01225
45 ROUGE-3 Eval D0743-A.M.100.J-H.45 R:0.01572 P:0.00986 F:0.01212
45 ROUGE-3 Eval D0743-A.M.100.J-I.45 R:0.01592 P:0.00986 F:0.01218
45 ROUGE-3 Eval D0743-A.M.100.J-J.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-3 Eval D0743-B.M.100.J-B.45 R:0.00980 P:0.00617 F:0.00757
45 ROUGE-3 Eval D0743-B.M.100.J-H.45 R:0.00643 P:0.00412 F:0.00502
45 ROUGE-3 Eval D0743-B.M.100.J-I.45 R:0.00323 P:0.00206 F:0.00252
45 ROUGE-3 Eval D0743-B.M.100.J-J.45 R:0.00952 P:0.00617 F:0.00749
45 ROUGE-3 Eval D0743-C.M.100.J-B.45 R:0.03236 P:0.02208 F:0.02625
45 ROUGE-3 Eval D0743-C.M.100.J-H.45 R:0.01623 P:0.01104 F:0.01314
45 ROUGE-3 Eval D0743-C.M.100.J-I.45 R:0.03909 P:0.02649 F:0.03158
45 ROUGE-3 Eval D0743-C.M.100.J-J.45 R:0.02885 P:0.01987 F:0.02353
---------------------------------------------
45 ROUGE-4 Average_R: 0.02216 (95%-conf.int. 0.01750 - 0.02743)
45 ROUGE-4 Average_P: 0.01315 (95%-conf.int. 0.01051 - 0.01596)
45 ROUGE-4 Average_F: 0.01638 (95%-conf.int. 0.01304 - 0.02006)
.............................................
45 ROUGE-4 Eval D0703-A.M.100.A-A.45 R:0.04181 P:0.02759 F:0.03324
45 ROUGE-4 Eval D0703-A.M.100.A-C.45 R:0.03114 P:0.02069 F:0.02486
45 ROUGE-4 Eval D0703-A.M.100.A-D.45 R:0.03901 P:0.02529 F:0.03069
45 ROUGE-4 Eval D0703-A.M.100.A-J.45 R:0.01404 P:0.00920 F:0.01112
45 ROUGE-4 Eval D0703-B.M.100.A-A.45 R:0.03704 P:0.02477 F:0.02969
45 ROUGE-4 Eval D0703-B.M.100.A-C.45 R:0.01384 P:0.00901 F:0.01091
45 ROUGE-4 Eval D0703-B.M.100.A-D.45 R:0.02422 P:0.01577 F:0.01910
45 ROUGE-4 Eval D0703-B.M.100.A-J.45 R:0.03767 P:0.02477 F:0.02989
45 ROUGE-4 Eval D0703-C.M.100.A-A.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0703-C.M.100.A-C.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0703-C.M.100.A-D.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0703-C.M.100.A-J.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0706-A.M.100.B-B.45 R:0.03344 P:0.01984 F:0.02490
45 ROUGE-4 Eval D0706-A.M.100.B-D.45 R:0.04377 P:0.02579 F:0.03246
45 ROUGE-4 Eval D0706-A.M.100.B-E.45 R:0.02007 P:0.01190 F:0.01494
45 ROUGE-4 Eval D0706-A.M.100.B-I.45 R:0.03344 P:0.01984 F:0.02490
45 ROUGE-4 Eval D0706-B.M.100.B-B.45 R:0.02357 P:0.01468 F:0.01809
45 ROUGE-4 Eval D0706-B.M.100.B-D.45 R:0.01678 P:0.01048 F:0.01290
45 ROUGE-4 Eval D0706-B.M.100.B-E.45 R:0.00669 P:0.00419 F:0.00515
45 ROUGE-4 Eval D0706-B.M.100.B-I.45 R:0.02333 P:0.01468 F:0.01802
45 ROUGE-4 Eval D0706-C.M.100.B-B.45 R:0.00997 P:0.00633 F:0.00774
45 ROUGE-4 Eval D0706-C.M.100.B-D.45 R:0.00997 P:0.00633 F:0.00774
45 ROUGE-4 Eval D0706-C.M.100.B-E.45 R:0.00990 P:0.00633 F:0.00772
45 ROUGE-4 Eval D0706-C.M.100.B-I.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-A.M.100.C-A.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-A.M.100.C-B.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-A.M.100.C-C.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-A.M.100.C-F.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-B.M.100.C-A.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-B.M.100.C-B.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-B.M.100.C-C.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-B.M.100.C-F.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0711-C.M.100.C-A.45 R:0.06803 P:0.04219 F:0.05208
45 ROUGE-4 Eval D0711-C.M.100.C-B.45 R:0.07746 P:0.04641 F:0.05804
45 ROUGE-4 Eval D0711-C.M.100.C-C.45 R:0.09756 P:0.05907 F:0.07359
45 ROUGE-4 Eval D0711-C.M.100.C-F.45 R:0.08014 P:0.04852 F:0.06044
45 ROUGE-4 Eval D0716-A.M.100.D-C.45 R:0.04730 P:0.03132 F:0.03769
45 ROUGE-4 Eval D0716-A.M.100.D-D.45 R:0.06529 P:0.04251 F:0.05149
45 ROUGE-4 Eval D0716-A.M.100.D-E.45 R:0.06164 P:0.04027 F:0.04871
45 ROUGE-4 Eval D0716-A.M.100.D-F.45 R:0.05102 P:0.03356 F:0.04049
45 ROUGE-4 Eval D0716-B.M.100.D-C.45 R:0.00339 P:0.00195 F:0.00248
45 ROUGE-4 Eval D0716-B.M.100.D-D.45 R:0.00346 P:0.00195 F:0.00249
45 ROUGE-4 Eval D0716-B.M.100.D-E.45 R:0.00342 P:0.00195 F:0.00248
45 ROUGE-4 Eval D0716-B.M.100.D-F.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0716-C.M.100.D-C.45 R:0.01342 P:0.00901 F:0.01078
45 ROUGE-4 Eval D0716-C.M.100.D-D.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0716-C.M.100.D-E.45 R:0.01361 P:0.00901 F:0.01084
45 ROUGE-4 Eval D0716-C.M.100.D-F.45 R:0.01375 P:0.00901 F:0.01089
45 ROUGE-4 Eval D0721-A.M.100.E-B.45 R:0.01031 P:0.00676 F:0.00817
45 ROUGE-4 Eval D0721-A.M.100.E-C.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0721-A.M.100.E-E.45 R:0.01003 P:0.00676 F:0.00808
45 ROUGE-4 Eval D0721-A.M.100.E-G.45 R:0.00984 P:0.00676 F:0.00801
45 ROUGE-4 Eval D0721-B.M.100.E-B.45 R:0.00671 P:0.00392 F:0.00495
45 ROUGE-4 Eval D0721-B.M.100.E-C.45 R:0.00328 P:0.00196 F:0.00245
45 ROUGE-4 Eval D0721-B.M.100.E-E.45 R:0.00676 P:0.00392 F:0.00496
45 ROUGE-4 Eval D0721-B.M.100.E-G.45 R:0.00332 P:0.00196 F:0.00246
45 ROUGE-4 Eval D0721-C.M.100.E-B.45 R:0.04054 P:0.02548 F:0.03129
45 ROUGE-4 Eval D0721-C.M.100.E-C.45 R:0.03061 P:0.01911 F:0.02353
45 ROUGE-4 Eval D0721-C.M.100.E-E.45 R:0.04124 P:0.02548 F:0.03150
45 ROUGE-4 Eval D0721-C.M.100.E-G.45 R:0.04027 P:0.02548 F:0.03121
45 ROUGE-4 Eval D0726-A.M.100.F-A.45 R:0.10274 P:0.06803 F:0.08186
45 ROUGE-4 Eval D0726-A.M.100.F-E.45 R:0.06873 P:0.04535 F:0.05464
45 ROUGE-4 Eval D0726-A.M.100.F-F.45 R:0.09247 P:0.06122 F:0.07367
45 ROUGE-4 Eval D0726-A.M.100.F-G.45 R:0.05479 P:0.03628 F:0.04365
45 ROUGE-4 Eval D0726-B.M.100.F-A.45 R:0.00337 P:0.00211 F:0.00260
45 ROUGE-4 Eval D0726-B.M.100.F-E.45 R:0.00342 P:0.00211 F:0.00261
45 ROUGE-4 Eval D0726-B.M.100.F-F.45 R:0.00342 P:0.00211 F:0.00261
45 ROUGE-4 Eval D0726-B.M.100.F-G.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0726-C.M.100.F-A.45 R:0.00344 P:0.00207 F:0.00258
45 ROUGE-4 Eval D0726-C.M.100.F-E.45 R:0.00347 P:0.00207 F:0.00259
45 ROUGE-4 Eval D0726-C.M.100.F-F.45 R:0.00350 P:0.00207 F:0.00260
45 ROUGE-4 Eval D0726-C.M.100.F-G.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0727-A.M.100.G-A.45 R:0.00342 P:0.00227 F:0.00273
45 ROUGE-4 Eval D0727-A.M.100.G-F.45 R:0.01017 P:0.00680 F:0.00815
45 ROUGE-4 Eval D0727-A.M.100.G-G.45 R:0.00673 P:0.00454 F:0.00542
45 ROUGE-4 Eval D0727-A.M.100.G-H.45 R:0.01017 P:0.00680 F:0.00815
45 ROUGE-4 Eval D0727-B.M.100.G-A.45 R:0.00709 P:0.00425 F:0.00531
45 ROUGE-4 Eval D0727-B.M.100.G-F.45 R:0.00669 P:0.00425 F:0.00520
45 ROUGE-4 Eval D0727-B.M.100.G-G.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0727-B.M.100.G-H.45 R:0.00709 P:0.00425 F:0.00531
45 ROUGE-4 Eval D0727-C.M.100.G-A.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0727-C.M.100.G-F.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0727-C.M.100.G-G.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0727-C.M.100.G-H.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0736-A.M.100.H-G.45 R:0.00741 P:0.00414 F:0.00531
45 ROUGE-4 Eval D0736-A.M.100.H-H.45 R:0.00755 P:0.00414 F:0.00535
45 ROUGE-4 Eval D0736-A.M.100.H-I.45 R:0.00368 P:0.00207 F:0.00265
45 ROUGE-4 Eval D0736-A.M.100.H-J.45 R:0.00337 P:0.00207 F:0.00256
45 ROUGE-4 Eval D0736-B.M.100.H-G.45 R:0.03162 P:0.01473 F:0.02010
45 ROUGE-4 Eval D0736-B.M.100.H-H.45 R:0.09013 P:0.03867 F:0.05412
45 ROUGE-4 Eval D0736-B.M.100.H-I.45 R:0.08261 P:0.03499 F:0.04916
45 ROUGE-4 Eval D0736-B.M.100.H-J.45 R:0.08664 P:0.04420 F:0.05854
45 ROUGE-4 Eval D0736-C.M.100.H-G.45 R:0.04825 P:0.02132 F:0.02957
45 ROUGE-4 Eval D0736-C.M.100.H-H.45 R:0.12360 P:0.04264 F:0.06341
45 ROUGE-4 Eval D0736-C.M.100.H-I.45 R:0.07865 P:0.02713 F:0.04034
45 ROUGE-4 Eval D0736-C.M.100.H-J.45 R:0.07422 P:0.03682 F:0.04922
45 ROUGE-4 Eval D0740-A.M.100.I-D.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0740-A.M.100.I-H.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0740-A.M.100.I-I.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0740-A.M.100.I-J.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0740-B.M.100.I-D.45 R:0.03010 P:0.02041 F:0.02433
45 ROUGE-4 Eval D0740-B.M.100.I-H.45 R:0.03413 P:0.02268 F:0.02725
45 ROUGE-4 Eval D0740-B.M.100.I-I.45 R:0.02027 P:0.01361 F:0.01629
45 ROUGE-4 Eval D0740-B.M.100.I-J.45 R:0.03667 P:0.02494 F:0.02969
45 ROUGE-4 Eval D0740-C.M.100.I-D.45 R:0.05921 P:0.04138 F:0.04871
45 ROUGE-4 Eval D0740-C.M.100.I-H.45 R:0.02649 P:0.01839 F:0.02171
45 ROUGE-4 Eval D0740-C.M.100.I-I.45 R:0.04276 P:0.02989 F:0.03519
45 ROUGE-4 Eval D0740-C.M.100.I-J.45 R:0.04918 P:0.03448 F:0.04054
45 ROUGE-4 Eval D0743-A.M.100.J-B.45 R:0.00980 P:0.00595 F:0.00740
45 ROUGE-4 Eval D0743-A.M.100.J-H.45 R:0.00952 P:0.00595 F:0.00732
45 ROUGE-4 Eval D0743-A.M.100.J-I.45 R:0.00965 P:0.00595 F:0.00736
45 ROUGE-4 Eval D0743-A.M.100.J-J.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0743-B.M.100.J-B.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0743-B.M.100.J-H.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0743-B.M.100.J-I.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0743-B.M.100.J-J.45 R:0.00000 P:0.00000 F:0.00000
45 ROUGE-4 Eval D0743-C.M.100.J-B.45 R:0.00980 P:0.00667 F:0.00794
45 ROUGE-4 Eval D0743-C.M.100.J-H.45 R:0.00328 P:0.00222 F:0.00265
45 ROUGE-4 Eval D0743-C.M.100.J-I.45 R:0.01316 P:0.00889 F:0.01061
45 ROUGE-4 Eval D0743-C.M.100.J-J.45 R:0.01294 P:0.00889 F:0.01054
---------------------------------------------
45 ROUGE-L Average_R: 0.32342 (95%-conf.int. 0.31223 - 0.33435)
45 ROUGE-L Average_P: 0.20010 (95%-conf.int. 0.19377 - 0.20617)
45 ROUGE-L Average_F: 0.24648 (95%-conf.int. 0.23884 - 0.25384)
.............................................
45 ROUGE-L Eval D0703-A.M.100.A-A.45 R:0.35473 P:0.23649 F:0.28379
45 ROUGE-L Eval D0703-A.M.100.A-C.45 R:0.31208 P:0.20946 F:0.25067
45 ROUGE-L Eval D0703-A.M.100.A-D.45 R:0.32990 P:0.21622 F:0.26123
45 ROUGE-L Eval D0703-A.M.100.A-J.45 R:0.32653 P:0.21622 F:0.26017
45 ROUGE-L Eval D0703-B.M.100.A-A.45 R:0.30719 P:0.20751 F:0.24770
45 ROUGE-L Eval D0703-B.M.100.A-C.45 R:0.31879 P:0.20971 F:0.25299
45 ROUGE-L Eval D0703-B.M.100.A-D.45 R:0.33557 P:0.22075 F:0.26631
45 ROUGE-L Eval D0703-B.M.100.A-J.45 R:0.33555 P:0.22296 F:0.26791
45 ROUGE-L Eval D0703-C.M.100.A-A.45 R:0.34667 P:0.21532 F:0.26565
45 ROUGE-L Eval D0703-C.M.100.A-C.45 R:0.33442 P:0.21325 F:0.26043
45 ROUGE-L Eval D0703-C.M.100.A-D.45 R:0.32781 P:0.20497 F:0.25223
45 ROUGE-L Eval D0703-C.M.100.A-J.45 R:0.35762 P:0.22360 F:0.27516
45 ROUGE-L Eval D0706-A.M.100.B-B.45 R:0.34091 P:0.20468 F:0.25579
45 ROUGE-L Eval D0706-A.M.100.B-D.45 R:0.32680 P:0.19493 F:0.24420
45 ROUGE-L Eval D0706-A.M.100.B-E.45 R:0.28247 P:0.16959 F:0.21194
45 ROUGE-L Eval D0706-A.M.100.B-I.45 R:0.32792 P:0.19688 F:0.24604
45 ROUGE-L Eval D0706-B.M.100.B-B.45 R:0.30065 P:0.18930 F:0.23232
45 ROUGE-L Eval D0706-B.M.100.B-D.45 R:0.28013 P:0.17695 F:0.21689
45 ROUGE-L Eval D0706-B.M.100.B-E.45 R:0.26623 P:0.16872 F:0.20654
45 ROUGE-L Eval D0706-B.M.100.B-I.45 R:0.29450 P:0.18724 F:0.22893
45 ROUGE-L Eval D0706-C.M.100.B-B.45 R:0.36452 P:0.23395 F:0.28499
45 ROUGE-L Eval D0706-C.M.100.B-D.45 R:0.36774 P:0.23602 F:0.28751
45 ROUGE-L Eval D0706-C.M.100.B-E.45 R:0.35577 P:0.22981 F:0.27924
45 ROUGE-L Eval D0706-C.M.100.B-I.45 R:0.34824 P:0.22567 F:0.27387
45 ROUGE-L Eval D0711-A.M.100.C-A.45 R:0.28618 P:0.17576 F:0.21777
45 ROUGE-L Eval D0711-A.M.100.C-B.45 R:0.31000 P:0.18788 F:0.23396
45 ROUGE-L Eval D0711-A.M.100.C-C.45 R:0.26667 P:0.16162 F:0.20126
45 ROUGE-L Eval D0711-A.M.100.C-F.45 R:0.29139 P:0.17778 F:0.22083
45 ROUGE-L Eval D0711-B.M.100.C-A.45 R:0.31973 P:0.19223 F:0.24010
45 ROUGE-L Eval D0711-B.M.100.C-B.45 R:0.33219 P:0.19836 F:0.24840
45 ROUGE-L Eval D0711-B.M.100.C-C.45 R:0.31208 P:0.19018 F:0.23634
45 ROUGE-L Eval D0711-B.M.100.C-F.45 R:0.32881 P:0.19836 F:0.24744
45 ROUGE-L Eval D0711-C.M.100.C-A.45 R:0.39604 P:0.24845 F:0.30535
45 ROUGE-L Eval D0711-C.M.100.C-B.45 R:0.41980 P:0.25466 F:0.31701
45 ROUGE-L Eval D0711-C.M.100.C-C.45 R:0.42230 P:0.25880 F:0.32093
45 ROUGE-L Eval D0711-C.M.100.C-F.45 R:0.41892 P:0.25673 F:0.31836
45 ROUGE-L Eval D0716-A.M.100.D-C.45 R:0.41967 P:0.28070 F:0.33640
45 ROUGE-L Eval D0716-A.M.100.D-D.45 R:0.40000 P:0.26316 F:0.31746
45 ROUGE-L Eval D0716-A.M.100.D-E.45 R:0.44186 P:0.29167 F:0.35139
45 ROUGE-L Eval D0716-A.M.100.D-F.45 R:0.40594 P:0.26974 F:0.32411
45 ROUGE-L Eval D0716-B.M.100.D-C.45 R:0.40461 P:0.23563 F:0.29782
45 ROUGE-L Eval D0716-B.M.100.D-D.45 R:0.41946 P:0.23946 F:0.30487
45 ROUGE-L Eval D0716-B.M.100.D-E.45 R:0.41528 P:0.23946 F:0.30376
45 ROUGE-L Eval D0716-B.M.100.D-F.45 R:0.42667 P:0.24521 F:0.31144
45 ROUGE-L Eval D0716-C.M.100.D-C.45 R:0.31596 P:0.21413 F:0.25526
45 ROUGE-L Eval D0716-C.M.100.D-D.45 R:0.30435 P:0.20088 F:0.24202
45 ROUGE-L Eval D0716-C.M.100.D-E.45 R:0.34653 P:0.23179 F:0.27778
45 ROUGE-L Eval D0716-C.M.100.D-F.45 R:0.32333 P:0.21413 F:0.25764
45 ROUGE-L Eval D0721-A.M.100.E-B.45 R:0.26667 P:0.17660 F:0.21248
45 ROUGE-L Eval D0721-A.M.100.E-C.45 R:0.25649 P:0.17439 F:0.20762
45 ROUGE-L Eval D0721-A.M.100.E-E.45 R:0.24351 P:0.16556 F:0.19711
45 ROUGE-L Eval D0721-A.M.100.E-G.45 R:0.25796 P:0.17881 F:0.21121
45 ROUGE-L Eval D0721-B.M.100.E-B.45 R:0.31270 P:0.18497 F:0.23244
45 ROUGE-L Eval D0721-B.M.100.E-C.45 R:0.32166 P:0.19461 F:0.24250
45 ROUGE-L Eval D0721-B.M.100.E-E.45 R:0.32131 P:0.18882 F:0.23786
45 ROUGE-L Eval D0721-B.M.100.E-G.45 R:0.29677 P:0.17726 F:0.22195
45 ROUGE-L Eval D0721-C.M.100.E-B.45 R:0.34754 P:0.22083 F:0.27006
45 ROUGE-L Eval D0721-C.M.100.E-C.45 R:0.28713 P:0.18125 F:0.22222
45 ROUGE-L Eval D0721-C.M.100.E-E.45 R:0.30667 P:0.19167 F:0.23590
45 ROUGE-L Eval D0721-C.M.100.E-G.45 R:0.28339 P:0.18125 F:0.22109
45 ROUGE-L Eval D0726-A.M.100.F-A.45 R:0.38870 P:0.26000 F:0.31158
45 ROUGE-L Eval D0726-A.M.100.F-E.45 R:0.35000 P:0.23333 F:0.28000
45 ROUGE-L Eval D0726-A.M.100.F-F.45 R:0.38870 P:0.26000 F:0.31158
45 ROUGE-L Eval D0726-A.M.100.F-G.45 R:0.37874 P:0.25333 F:0.30359
45 ROUGE-L Eval D0726-B.M.100.F-A.45 R:0.31373 P:0.19876 F:0.24335
45 ROUGE-L Eval D0726-B.M.100.F-E.45 R:0.29900 P:0.18634 F:0.22959
45 ROUGE-L Eval D0726-B.M.100.F-F.45 R:0.31561 P:0.19669 F:0.24235
45 ROUGE-L Eval D0726-B.M.100.F-G.45 R:0.30921 P:0.19462 F:0.23888
45 ROUGE-L Eval D0726-C.M.100.F-A.45 R:0.30667 P:0.18699 F:0.23232
45 ROUGE-L Eval D0726-C.M.100.F-E.45 R:0.29966 P:0.18089 F:0.22560
45 ROUGE-L Eval D0726-C.M.100.F-F.45 R:0.27119 P:0.16260 F:0.20330
45 ROUGE-L Eval D0726-C.M.100.F-G.45 R:0.25574 P:0.15854 F:0.19574
45 ROUGE-L Eval D0727-A.M.100.G-A.45 R:0.33887 P:0.22667 F:0.27164
45 ROUGE-L Eval D0727-A.M.100.G-F.45 R:0.35197 P:0.23778 F:0.28382
45 ROUGE-L Eval D0727-A.M.100.G-G.45 R:0.32026 P:0.21778 F:0.25926
45 ROUGE-L Eval D0727-A.M.100.G-H.45 R:0.34211 P:0.23111 F:0.27586
45 ROUGE-L Eval D0727-B.M.100.G-A.45 R:0.31615 P:0.19167 F:0.23865
45 ROUGE-L Eval D0727-B.M.100.G-F.45 R:0.30195 P:0.19375 F:0.23604
45 ROUGE-L Eval D0727-B.M.100.G-G.45 R:0.27336 P:0.16458 F:0.20546
45 ROUGE-L Eval D0727-B.M.100.G-H.45 R:0.28866 P:0.17500 F:0.21790
45 ROUGE-L Eval D0727-C.M.100.G-A.45 R:0.30293 P:0.18788 F:0.23192
45 ROUGE-L Eval D0727-C.M.100.G-F.45 R:0.30640 P:0.18384 F:0.22980
45 ROUGE-L Eval D0727-C.M.100.G-G.45 R:0.32343 P:0.19798 F:0.24561
45 ROUGE-L Eval D0727-C.M.100.G-H.45 R:0.34459 P:0.20606 F:0.25790
45 ROUGE-L Eval D0736-A.M.100.H-G.45 R:0.24731 P:0.14024 F:0.17898
45 ROUGE-L Eval D0736-A.M.100.H-H.45 R:0.27372 P:0.15244 F:0.19582
45 ROUGE-L Eval D0736-A.M.100.H-I.45 R:0.25267 P:0.14431 F:0.18370
45 ROUGE-L Eval D0736-A.M.100.H-J.45 R:0.24837 P:0.15447 F:0.19048
45 ROUGE-L Eval D0736-B.M.100.H-G.45 R:0.36641 P:0.17391 F:0.23587
45 ROUGE-L Eval D0736-B.M.100.H-H.45 R:0.41736 P:0.18297 F:0.25441
45 ROUGE-L Eval D0736-B.M.100.H-I.45 R:0.41841 P:0.18116 F:0.25285
45 ROUGE-L Eval D0736-B.M.100.H-J.45 R:0.41958 P:0.21739 F:0.28639
45 ROUGE-L Eval D0736-C.M.100.H-G.45 R:0.40928 P:0.18476 F:0.25459
45 ROUGE-L Eval D0736-C.M.100.H-H.45 R:0.52406 P:0.18667 F:0.27528
45 ROUGE-L Eval D0736-C.M.100.H-I.45 R:0.41176 P:0.14667 F:0.21630
45 ROUGE-L Eval D0736-C.M.100.H-J.45 R:0.44528 P:0.22476 F:0.29873
45 ROUGE-L Eval D0740-A.M.100.I-D.45 R:0.27723 P:0.16374 F:0.20588
45 ROUGE-L Eval D0740-A.M.100.I-H.45 R:0.28431 P:0.16959 F:0.21245
45 ROUGE-L Eval D0740-A.M.100.I-I.45 R:0.29221 P:0.17544 F:0.21925
45 ROUGE-L Eval D0740-A.M.100.I-J.45 R:0.28065 P:0.16959 F:0.21142
45 ROUGE-L Eval D0740-B.M.100.I-D.45 R:0.33766 P:0.23111 F:0.27440
45 ROUGE-L Eval D0740-B.M.100.I-H.45 R:0.31126 P:0.20889 F:0.25000
45 ROUGE-L Eval D0740-B.M.100.I-I.45 R:0.31803 P:0.21556 F:0.25696
45 ROUGE-L Eval D0740-B.M.100.I-J.45 R:0.32686 P:0.22444 F:0.26614
45 ROUGE-L Eval D0740-C.M.100.I-D.45 R:0.35144 P:0.24775 F:0.29062
45 ROUGE-L Eval D0740-C.M.100.I-H.45 R:0.32476 P:0.22748 F:0.26755
45 ROUGE-L Eval D0740-C.M.100.I-I.45 R:0.32907 P:0.23198 F:0.27212
45 ROUGE-L Eval D0740-C.M.100.I-J.45 R:0.33758 P:0.23874 F:0.27968
45 ROUGE-L Eval D0743-A.M.100.J-B.45 R:0.21905 P:0.13450 F:0.16667
45 ROUGE-L Eval D0743-A.M.100.J-H.45 R:0.19136 P:0.12086 F:0.14815
45 ROUGE-L Eval D0743-A.M.100.J-I.45 R:0.22812 P:0.14230 F:0.17527
45 ROUGE-L Eval D0743-A.M.100.J-J.45 R:0.18462 P:0.11696 F:0.14320
45 ROUGE-L Eval D0743-B.M.100.J-B.45 R:0.22115 P:0.14024 F:0.17164
45 ROUGE-L Eval D0743-B.M.100.J-H.45 R:0.19558 P:0.12602 F:0.15328
45 ROUGE-L Eval D0743-B.M.100.J-I.45 R:0.20886 P:0.13415 F:0.16337
45 ROUGE-L Eval D0743-B.M.100.J-J.45 R:0.20872 P:0.13618 F:0.16482
45 ROUGE-L Eval D0743-C.M.100.J-B.45 R:0.30476 P:0.20915 F:0.24806
45 ROUGE-L Eval D0743-C.M.100.J-H.45 R:0.28025 P:0.19172 F:0.22768
45 ROUGE-L Eval D0743-C.M.100.J-I.45 R:0.30990 P:0.21133 F:0.25129
45 ROUGE-L Eval D0743-C.M.100.J-J.45 R:0.28616 P:0.19826 F:0.23424
---------------------------------------------
45 ROUGE-W-1.2 Average_R: 0.11439 (95%-conf.int. 0.11004 - 0.11873)
45 ROUGE-W-1.2 Average_P: 0.12828 (95%-conf.int. 0.12384 - 0.13253)
45 ROUGE-W-1.2 Average_F: 0.12048 (95%-conf.int. 0.11638 - 0.12436)
.............................................
45 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.45 R:0.12445 P:0.14940 F:0.13579
45 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.45 R:0.10893 P:0.13288 F:0.11972
45 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.45 R:0.12010 P:0.14513 F:0.13143
45 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.45 R:0.11900 P:0.13479 F:0.12640
45 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.45 R:0.10648 P:0.13337 F:0.11842
45 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.45 R:0.10626 P:0.13227 F:0.11785
45 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.45 R:0.11437 P:0.14112 F:0.12634
45 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.45 R:0.11618 P:0.14318 F:0.12827
45 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.45 R:0.11380 P:0.13142 F:0.12198
45 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.45 R:0.10768 P:0.12965 F:0.11765
45 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.45 R:0.10553 P:0.12523 F:0.11454
45 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.45 R:0.11876 P:0.13374 F:0.12581
45 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.45 R:0.12648 P:0.13627 F:0.13119
45 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.45 R:0.11969 P:0.13101 F:0.12509
45 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.45 R:0.10442 P:0.11369 F:0.10886
45 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.45 R:0.11987 P:0.13336 F:0.12626
45 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.45 R:0.10718 P:0.11688 F:0.11182
45 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.45 R:0.09650 P:0.10750 F:0.10170
45 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.45 R:0.09223 P:0.10317 F:0.09739
45 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.45 R:0.09975 P:0.11469 F:0.10670
45 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.45 R:0.12229 P:0.13396 F:0.12786
45 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.45 R:0.12378 P:0.13675 F:0.12994
45 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.45 R:0.12156 P:0.13302 F:0.12703
45 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.45 R:0.12401 P:0.13957 F:0.13133
45 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.45 R:0.10237 P:0.11334 F:0.10758
45 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.45 R:0.11094 P:0.12178 F:0.11611
45 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.45 R:0.09228 P:0.10043 F:0.09618
45 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.45 R:0.10390 P:0.11499 F:0.10916
45 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.45 R:0.10974 P:0.11771 F:0.11359
45 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.45 R:0.11347 P:0.12698 F:0.11985
45 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.45 R:0.10638 P:0.12179 F:0.11356
45 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.45 R:0.11193 P:0.12540 F:0.11828
45 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.45 R:0.13783 P:0.16165 F:0.14879
45 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.45 R:0.14436 P:0.16376 F:0.15345
45 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.45 R:0.14720 P:0.17128 F:0.15833
45 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.45 R:0.14150 P:0.16713 F:0.15325
45 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.45 R:0.15398 P:0.18815 F:0.16936
45 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.45 R:0.14184 P:0.17778 F:0.15779
45 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.45 R:0.15650 P:0.19292 F:0.17281
45 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.45 R:0.14073 P:0.17783 F:0.15712
45 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.45 R:0.14612 P:0.14844 F:0.14727
45 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.45 R:0.15008 P:0.15333 F:0.15169
45 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.45 R:0.14913 P:0.15309 F:0.15108
45 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.45 R:0.15195 P:0.15456 F:0.15324
45 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.45 R:0.11121 P:0.14048 F:0.12414
45 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.45 R:0.10209 P:0.13067 F:0.11463
45 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.45 R:0.11651 P:0.15102 F:0.13154
45 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.45 R:0.11013 P:0.14188 F:0.12400
45 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.45 R:0.09735 P:0.11332 F:0.10473
45 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.45 R:0.09239 P:0.11145 F:0.10103
45 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.45 R:0.08892 P:0.10861 F:0.09778
45 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.45 R:0.09295 P:0.11290 F:0.10196
45 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.45 R:0.10397 P:0.11890 F:0.11093
45 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.45 R:0.10759 P:0.12234 F:0.11449
45 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.45 R:0.10315 P:0.11899 F:0.11051
45 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.45 R:0.09473 P:0.11292 F:0.10303
45 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.45 R:0.12008 P:0.14043 F:0.12946
45 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.45 R:0.09969 P:0.11840 F:0.10824
45 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.45 R:0.10816 P:0.12617 F:0.11647
45 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.45 R:0.09805 P:0.11728 F:0.10681
45 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.45 R:0.15347 P:0.18191 F:0.16648
45 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.45 R:0.13996 P:0.16347 F:0.15080
45 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.45 R:0.15172 P:0.18076 F:0.16497
45 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.45 R:0.14058 P:0.17021 F:0.15398
45 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.45 R:0.11364 P:0.12664 F:0.11979
45 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.45 R:0.10295 P:0.11582 F:0.10901
45 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.45 R:0.11061 P:0.12523 F:0.11747
45 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.45 R:0.10776 P:0.12246 F:0.11464
45 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.45 R:0.10164 P:0.10883 F:0.10511
45 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.45 R:0.09952 P:0.10603 F:0.10267
45 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.45 R:0.09493 P:0.10193 F:0.09831
45 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.45 R:0.08443 P:0.09372 F:0.08883
45 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.45 R:0.12431 P:0.14636 F:0.13444
45 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.45 R:0.12618 P:0.15560 F:0.13935
45 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.45 R:0.11128 P:0.13402 F:0.12160
45 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.45 R:0.12588 P:0.15244 F:0.13789
45 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.45 R:0.11585 P:0.12323 F:0.11943
45 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.45 R:0.10620 P:0.12241 F:0.11373
45 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.45 R:0.09864 P:0.10638 F:0.10236
45 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.45 R:0.10661 P:0.11441 F:0.11037
45 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.45 R:0.10380 P:0.11577 F:0.10946
45 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.45 R:0.10292 P:0.11413 F:0.10824
45 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.45 R:0.10814 P:0.12185 F:0.11459
45 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.45 R:0.11717 P:0.12611 F:0.12148
45 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.45 R:0.09169 P:0.09207 F:0.09188
45 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.45 R:0.09980 P:0.09774 F:0.09876
45 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.45 R:0.09153 P:0.09340 F:0.09246
45 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.45 R:0.08726 P:0.09675 F:0.09176
45 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.45 R:0.13229 P:0.11622 F:0.12374
45 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.45 R:0.15913 P:0.12906 F:0.14253
45 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.45 R:0.15954 P:0.12758 F:0.14178
45 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.45 R:0.15515 P:0.14860 F:0.15180
45 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.45 R:0.15865 P:0.13011 F:0.14297
45 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.45 R:0.20966 P:0.13958 F:0.16759
45 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.45 R:0.16041 P:0.10423 F:0.12636
45 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.45 R:0.17365 P:0.15639 F:0.16457
45 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.45 R:0.09151 P:0.09942 F:0.09530
45 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.45 R:0.09931 P:0.10687 F:0.10295
45 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.45 R:0.09319 P:0.10350 F:0.09807
45 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.45 R:0.09156 P:0.10165 F:0.09634
45 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.45 R:0.11846 P:0.14896 F:0.13197
45 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.45 R:0.11477 P:0.13707 F:0.12493
45 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.45 R:0.11018 P:0.14032 F:0.12344
45 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.45 R:0.11935 P:0.14651 F:0.13154
45 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.45 R:0.12068 P:0.16418 F:0.13911
45 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.45 R:0.11036 P:0.14426 F:0.12505
45 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.45 R:0.10987 P:0.15147 F:0.12736
45 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.45 R:0.11557 P:0.15661 F:0.13300
45 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.45 R:0.07331 P:0.07846 F:0.07580
45 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.45 R:0.06513 P:0.07105 F:0.06796
45 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.45 R:0.07471 P:0.08270 F:0.07850
45 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.45 R:0.06552 P:0.07205 F:0.06863
45 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.45 R:0.08369 P:0.08888 F:0.08621
45 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.45 R:0.07783 P:0.08317 F:0.08041
45 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.45 R:0.07935 P:0.08589 F:0.08249
45 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.45 R:0.08259 P:0.08860 F:0.08549
45 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.45 R:0.11363 P:0.13650 F:0.12402
45 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.45 R:0.09883 P:0.11290 F:0.10540
45 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.45 R:0.10931 P:0.13283 F:0.11993
45 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.45 R:0.10477 P:0.12217 F:0.11280
---------------------------------------------
45 ROUGE-SU4 Average_R: 0.13431 (95%-conf.int. 0.12664 - 0.14222)
45 ROUGE-SU4 Average_P: 0.08198 (95%-conf.int. 0.07749 - 0.08636)
45 ROUGE-SU4 Average_F: 0.10144 (95%-conf.int. 0.09611 - 0.10689)
.............................................
45 ROUGE-SU4 Eval D0703-A.M.100.A-A.45 R:0.16609 P:0.10971 F:0.13214
45 ROUGE-SU4 Eval D0703-A.M.100.A-C.45 R:0.15747 P:0.10474 F:0.12580
45 ROUGE-SU4 Eval D0703-A.M.100.A-D.45 R:0.15548 P:0.10092 F:0.12240
45 ROUGE-SU4 Eval D0703-A.M.100.A-J.45 R:0.14161 P:0.09289 F:0.11219
45 ROUGE-SU4 Eval D0703-B.M.100.A-A.45 R:0.15436 P:0.10337 F:0.12382
45 ROUGE-SU4 Eval D0703-B.M.100.A-C.45 R:0.14080 P:0.09176 F:0.11111
45 ROUGE-SU4 Eval D0703-B.M.100.A-D.45 R:0.15287 P:0.09963 F:0.12064
45 ROUGE-SU4 Eval D0703-B.M.100.A-J.45 R:0.16155 P:0.10637 F:0.12828
45 ROUGE-SU4 Eval D0703-C.M.100.A-A.45 R:0.14840 P:0.09123 F:0.11300
45 ROUGE-SU4 Eval D0703-C.M.100.A-C.45 R:0.13611 P:0.08596 F:0.10537
45 ROUGE-SU4 Eval D0703-C.M.100.A-D.45 R:0.13322 P:0.08246 F:0.10187
45 ROUGE-SU4 Eval D0703-C.M.100.A-J.45 R:0.14172 P:0.08772 F:0.10837
45 ROUGE-SU4 Eval D0706-A.M.100.B-B.45 R:0.14944 P:0.08878 F:0.11139
45 ROUGE-SU4 Eval D0706-A.M.100.B-D.45 R:0.15380 P:0.09076 F:0.11416
45 ROUGE-SU4 Eval D0706-A.M.100.B-E.45 R:0.10722 P:0.06370 F:0.07992
45 ROUGE-SU4 Eval D0706-A.M.100.B-I.45 R:0.13722 P:0.08152 F:0.10228
45 ROUGE-SU4 Eval D0706-B.M.100.B-B.45 R:0.11186 P:0.06974 F:0.08592
45 ROUGE-SU4 Eval D0706-B.M.100.B-D.45 R:0.09365 P:0.05858 F:0.07208
45 ROUGE-SU4 Eval D0706-B.M.100.B-E.45 R:0.08833 P:0.05544 F:0.06812
45 ROUGE-SU4 Eval D0706-B.M.100.B-I.45 R:0.10853 P:0.06834 F:0.08387
45 ROUGE-SU4 Eval D0706-C.M.100.B-B.45 R:0.13742 P:0.08737 F:0.10682
45 ROUGE-SU4 Eval D0706-C.M.100.B-D.45 R:0.13576 P:0.08632 F:0.10554
45 ROUGE-SU4 Eval D0706-C.M.100.B-E.45 R:0.13706 P:0.08772 F:0.10697
45 ROUGE-SU4 Eval D0706-C.M.100.B-I.45 R:0.12568 P:0.08070 F:0.09829
45 ROUGE-SU4 Eval D0711-A.M.100.C-A.45 R:0.10642 P:0.06468 F:0.08046
45 ROUGE-SU4 Eval D0711-A.M.100.C-B.45 R:0.11473 P:0.06879 F:0.08601
45 ROUGE-SU4 Eval D0711-A.M.100.C-C.45 R:0.09132 P:0.05476 F:0.06846
45 ROUGE-SU4 Eval D0711-A.M.100.C-F.45 R:0.11168 P:0.06742 F:0.08408
45 ROUGE-SU4 Eval D0711-B.M.100.C-A.45 R:0.10664 P:0.06341 F:0.07953
45 ROUGE-SU4 Eval D0711-B.M.100.C-B.45 R:0.11972 P:0.07069 F:0.08889
45 ROUGE-SU4 Eval D0711-B.M.100.C-C.45 R:0.10287 P:0.06202 F:0.07738
45 ROUGE-SU4 Eval D0711-B.M.100.C-F.45 R:0.11731 P:0.06999 F:0.08767
45 ROUGE-SU4 Eval D0711-C.M.100.C-A.45 R:0.19831 P:0.12316 F:0.15195
45 ROUGE-SU4 Eval D0711-C.M.100.C-B.45 R:0.21404 P:0.12842 F:0.16053
45 ROUGE-SU4 Eval D0711-C.M.100.C-C.45 R:0.23958 P:0.14526 F:0.18086
45 ROUGE-SU4 Eval D0711-C.M.100.C-F.45 R:0.21875 P:0.13263 F:0.16514
45 ROUGE-SU4 Eval D0716-A.M.100.D-C.45 R:0.21886 P:0.14509 F:0.17450
45 ROUGE-SU4 Eval D0716-A.M.100.D-D.45 R:0.22432 P:0.14621 F:0.17703
45 ROUGE-SU4 Eval D0716-A.M.100.D-E.45 R:0.23094 P:0.15104 F:0.18263
45 ROUGE-SU4 Eval D0716-A.M.100.D-F.45 R:0.21130 P:0.13914 F:0.16779
45 ROUGE-SU4 Eval D0716-B.M.100.D-C.45 R:0.18131 P:0.10441 F:0.13251
45 ROUGE-SU4 Eval D0716-B.M.100.D-D.45 R:0.19023 P:0.10733 F:0.13723
45 ROUGE-SU4 Eval D0716-B.M.100.D-E.45 R:0.17918 P:0.10214 F:0.13011
45 ROUGE-SU4 Eval D0716-B.M.100.D-F.45 R:0.18893 P:0.10733 F:0.13689
45 ROUGE-SU4 Eval D0716-C.M.100.D-C.45 R:0.12375 P:0.08315 F:0.09947
45 ROUGE-SU4 Eval D0716-C.M.100.D-D.45 R:0.12543 P:0.08202 F:0.09918
45 ROUGE-SU4 Eval D0716-C.M.100.D-E.45 R:0.14237 P:0.09438 F:0.11351
45 ROUGE-SU4 Eval D0716-C.M.100.D-F.45 R:0.13699 P:0.08989 F:0.10855
45 ROUGE-SU4 Eval D0721-A.M.100.E-B.45 R:0.10274 P:0.06742 F:0.08141
45 ROUGE-SU4 Eval D0721-A.M.100.E-C.45 R:0.08889 P:0.05993 F:0.07159
45 ROUGE-SU4 Eval D0721-A.M.100.E-E.45 R:0.08889 P:0.05993 F:0.07159
45 ROUGE-SU4 Eval D0721-A.M.100.E-G.45 R:0.09041 P:0.06217 F:0.07368
45 ROUGE-SU4 Eval D0721-B.M.100.E-B.45 R:0.12263 P:0.07175 F:0.09053
45 ROUGE-SU4 Eval D0721-B.M.100.E-C.45 R:0.11383 P:0.06817 F:0.08527
45 ROUGE-SU4 Eval D0721-B.M.100.E-E.45 R:0.12346 P:0.07175 F:0.09076
45 ROUGE-SU4 Eval D0721-B.M.100.E-G.45 R:0.11369 P:0.06719 F:0.08446
45 ROUGE-SU4 Eval D0721-C.M.100.E-B.45 R:0.15095 P:0.09499 F:0.11660
45 ROUGE-SU4 Eval D0721-C.M.100.E-C.45 R:0.12429 P:0.07768 F:0.09561
45 ROUGE-SU4 Eval D0721-C.M.100.E-E.45 R:0.14098 P:0.08722 F:0.10777
45 ROUGE-SU4 Eval D0721-C.M.100.E-G.45 R:0.11650 P:0.07380 F:0.09036
45 ROUGE-SU4 Eval D0726-A.M.100.F-A.45 R:0.19966 P:0.13235 F:0.15918
45 ROUGE-SU4 Eval D0726-A.M.100.F-E.45 R:0.15639 P:0.10332 F:0.12443
45 ROUGE-SU4 Eval D0726-A.M.100.F-F.45 R:0.19397 P:0.12858 F:0.15465
45 ROUGE-SU4 Eval D0726-A.M.100.F-G.45 R:0.16894 P:0.11199 F:0.13469
45 ROUGE-SU4 Eval D0726-B.M.100.F-A.45 R:0.11521 P:0.07228 F:0.08883
45 ROUGE-SU4 Eval D0726-B.M.100.F-E.45 R:0.10125 P:0.06246 F:0.07726
45 ROUGE-SU4 Eval D0726-B.M.100.F-F.45 R:0.11092 P:0.06842 F:0.08463
45 ROUGE-SU4 Eval D0726-B.M.100.F-G.45 R:0.11149 P:0.06947 F:0.08560
45 ROUGE-SU4 Eval D0726-C.M.100.F-A.45 R:0.11815 P:0.07128 F:0.08892
45 ROUGE-SU4 Eval D0726-C.M.100.F-E.45 R:0.11419 P:0.06818 F:0.08538
45 ROUGE-SU4 Eval D0726-C.M.100.F-F.45 R:0.10279 P:0.06095 F:0.07652
45 ROUGE-SU4 Eval D0726-C.M.100.F-G.45 R:0.10101 P:0.06198 F:0.07682
45 ROUGE-SU4 Eval D0727-A.M.100.G-A.45 R:0.12571 P:0.08333 F:0.10022
45 ROUGE-SU4 Eval D0727-A.M.100.G-F.45 R:0.13795 P:0.09238 F:0.11066
45 ROUGE-SU4 Eval D0727-A.M.100.G-G.45 R:0.11018 P:0.07428 F:0.08874
45 ROUGE-SU4 Eval D0727-A.M.100.G-H.45 R:0.13345 P:0.08937 F:0.10705
45 ROUGE-SU4 Eval D0727-B.M.100.G-A.45 R:0.11720 P:0.07027 F:0.08786
45 ROUGE-SU4 Eval D0727-B.M.100.G-F.45 R:0.11000 P:0.06992 F:0.08550
45 ROUGE-SU4 Eval D0727-B.M.100.G-G.45 R:0.09905 P:0.05897 F:0.07393
45 ROUGE-SU4 Eval D0727-B.M.100.G-H.45 R:0.11837 P:0.07097 F:0.08874
45 ROUGE-SU4 Eval D0727-C.M.100.G-A.45 R:0.10591 P:0.06502 F:0.08057
45 ROUGE-SU4 Eval D0727-C.M.100.G-F.45 R:0.11303 P:0.06708 F:0.08419
45 ROUGE-SU4 Eval D0727-C.M.100.G-G.45 R:0.11412 P:0.06913 F:0.08610
45 ROUGE-SU4 Eval D0727-C.M.100.G-H.45 R:0.11979 P:0.07084 F:0.08903
45 ROUGE-SU4 Eval D0736-A.M.100.H-G.45 R:0.08057 P:0.04511 F:0.05784
45 ROUGE-SU4 Eval D0736-A.M.100.H-H.45 R:0.09211 P:0.05062 F:0.06533
45 ROUGE-SU4 Eval D0736-A.M.100.H-I.45 R:0.08364 P:0.04718 F:0.06033
45 ROUGE-SU4 Eval D0736-A.M.100.H-J.45 R:0.07830 P:0.04821 F:0.05968
45 ROUGE-SU4 Eval D0736-B.M.100.H-G.45 R:0.15026 P:0.07016 F:0.09566
45 ROUGE-SU4 Eval D0736-B.M.100.H-H.45 R:0.20655 P:0.08885 F:0.12425
45 ROUGE-SU4 Eval D0736-B.M.100.H-I.45 R:0.20058 P:0.08517 F:0.11957
45 ROUGE-SU4 Eval D0736-B.M.100.H-J.45 R:0.20384 P:0.10417 F:0.13788
45 ROUGE-SU4 Eval D0736-C.M.100.H-G.45 R:0.19068 P:0.08446 F:0.11707
45 ROUGE-SU4 Eval D0736-C.M.100.H-H.45 R:0.29516 P:0.10219 F:0.15182
45 ROUGE-SU4 Eval D0736-C.M.100.H-I.45 R:0.20298 P:0.07028 F:0.10441
45 ROUGE-SU4 Eval D0736-C.M.100.H-J.45 R:0.22244 P:0.11057 F:0.14771
45 ROUGE-SU4 Eval D0740-A.M.100.I-D.45 R:0.09944 P:0.05809 F:0.07334
45 ROUGE-SU4 Eval D0740-A.M.100.I-H.45 R:0.09787 P:0.05776 F:0.07265
45 ROUGE-SU4 Eval D0740-A.M.100.I-I.45 R:0.10611 P:0.06304 F:0.07909
45 ROUGE-SU4 Eval D0740-A.M.100.I-J.45 R:0.09492 P:0.05677 F:0.07105
45 ROUGE-SU4 Eval D0740-B.M.100.I-D.45 R:0.12444 P:0.08446 F:0.10062
45 ROUGE-SU4 Eval D0740-B.M.100.I-H.45 R:0.12132 P:0.08069 F:0.09692
45 ROUGE-SU4 Eval D0740-B.M.100.I-I.45 R:0.12290 P:0.08258 F:0.09878
45 ROUGE-SU4 Eval D0740-B.M.100.I-J.45 R:0.12957 P:0.08824 F:0.10498
45 ROUGE-SU4 Eval D0740-C.M.100.I-D.45 R:0.17869 P:0.12500 F:0.14710
45 ROUGE-SU4 Eval D0740-C.M.100.I-H.45 R:0.14356 P:0.09977 F:0.11772
45 ROUGE-SU4 Eval D0740-C.M.100.I-I.45 R:0.15355 P:0.10742 F:0.12641
45 ROUGE-SU4 Eval D0740-C.M.100.I-J.45 R:0.16394 P:0.11506 F:0.13522
45 ROUGE-SU4 Eval D0743-A.M.100.J-B.45 R:0.07112 P:0.04323 F:0.05377
45 ROUGE-SU4 Eval D0743-A.M.100.J-H.45 R:0.06171 P:0.03861 F:0.04750
45 ROUGE-SU4 Eval D0743-A.M.100.J-I.45 R:0.07318 P:0.04521 F:0.05589
45 ROUGE-SU4 Eval D0743-A.M.100.J-J.45 R:0.05152 P:0.03234 F:0.03974
45 ROUGE-SU4 Eval D0743-B.M.100.J-B.45 R:0.06963 P:0.04373 F:0.05372
45 ROUGE-SU4 Eval D0743-B.M.100.J-H.45 R:0.05933 P:0.03788 F:0.04624
45 ROUGE-SU4 Eval D0743-B.M.100.J-I.45 R:0.06602 P:0.04201 F:0.05135
45 ROUGE-SU4 Eval D0743-B.M.100.J-J.45 R:0.06283 P:0.04063 F:0.04935
45 ROUGE-SU4 Eval D0743-C.M.100.J-B.45 R:0.13409 P:0.09128 F:0.10862
45 ROUGE-SU4 Eval D0743-C.M.100.J-H.45 R:0.10185 P:0.06911 F:0.08235
45 ROUGE-SU4 Eval D0743-C.M.100.J-I.45 R:0.14262 P:0.09645 F:0.11508
45 ROUGE-SU4 Eval D0743-C.M.100.J-J.45 R:0.12151 P:0.08352 F:0.09900
---------------------------------------------
46 ROUGE-1 Average_R: 0.35849 (95%-conf.int. 0.34705 - 0.36955)
46 ROUGE-1 Average_P: 0.19934 (95%-conf.int. 0.19191 - 0.20670)
46 ROUGE-1 Average_F: 0.25537 (95%-conf.int. 0.24686 - 0.26410)
.............................................
46 ROUGE-1 Eval D0703-A.M.100.A-A.46 R:0.37162 P:0.24609 F:0.29610
46 ROUGE-1 Eval D0703-A.M.100.A-C.46 R:0.32215 P:0.21477 F:0.25772
46 ROUGE-1 Eval D0703-A.M.100.A-D.46 R:0.35052 P:0.22819 F:0.27643
46 ROUGE-1 Eval D0703-A.M.100.A-J.46 R:0.36054 P:0.23714 F:0.28610
46 ROUGE-1 Eval D0703-B.M.100.A-A.46 R:0.51634 P:0.28623 F:0.36830
46 ROUGE-1 Eval D0703-B.M.100.A-C.46 R:0.47651 P:0.25725 F:0.33412
46 ROUGE-1 Eval D0703-B.M.100.A-D.46 R:0.47315 P:0.25543 F:0.33176
46 ROUGE-1 Eval D0703-B.M.100.A-J.46 R:0.52824 P:0.28804 F:0.37280
46 ROUGE-1 Eval D0703-C.M.100.A-A.46 R:0.40000 P:0.19512 F:0.26229
46 ROUGE-1 Eval D0703-C.M.100.A-C.46 R:0.39286 P:0.19675 F:0.26219
46 ROUGE-1 Eval D0703-C.M.100.A-D.46 R:0.39073 P:0.19187 F:0.25736
46 ROUGE-1 Eval D0703-C.M.100.A-J.46 R:0.40066 P:0.19675 F:0.26391
46 ROUGE-1 Eval D0706-A.M.100.B-B.46 R:0.36364 P:0.18211 F:0.24268
46 ROUGE-1 Eval D0706-A.M.100.B-D.46 R:0.33660 P:0.16748 F:0.22367
46 ROUGE-1 Eval D0706-A.M.100.B-E.46 R:0.32468 P:0.16260 F:0.21668
46 ROUGE-1 Eval D0706-A.M.100.B-I.46 R:0.36039 P:0.18049 F:0.24052
46 ROUGE-1 Eval D0706-B.M.100.B-B.46 R:0.21895 P:0.12204 F:0.15672
46 ROUGE-1 Eval D0706-B.M.100.B-D.46 R:0.23127 P:0.12933 F:0.16589
46 ROUGE-1 Eval D0706-B.M.100.B-E.46 R:0.24026 P:0.13479 F:0.17270
46 ROUGE-1 Eval D0706-B.M.100.B-I.46 R:0.24595 P:0.13843 F:0.17715
46 ROUGE-1 Eval D0706-C.M.100.B-B.46 R:0.32581 P:0.19461 F:0.24367
46 ROUGE-1 Eval D0706-C.M.100.B-D.46 R:0.36452 P:0.21773 F:0.27262
46 ROUGE-1 Eval D0706-C.M.100.B-E.46 R:0.33013 P:0.19846 F:0.24790
46 ROUGE-1 Eval D0706-C.M.100.B-I.46 R:0.33866 P:0.20424 F:0.25481
46 ROUGE-1 Eval D0711-A.M.100.C-A.46 R:0.32895 P:0.19048 F:0.24126
46 ROUGE-1 Eval D0711-A.M.100.C-B.46 R:0.35000 P:0.20000 F:0.25455
46 ROUGE-1 Eval D0711-A.M.100.C-C.46 R:0.34000 P:0.19429 F:0.24728
46 ROUGE-1 Eval D0711-A.M.100.C-F.46 R:0.35430 P:0.20381 F:0.25877
46 ROUGE-1 Eval D0711-B.M.100.C-A.46 R:0.32993 P:0.18908 F:0.24039
46 ROUGE-1 Eval D0711-B.M.100.C-B.46 R:0.34247 P:0.19493 F:0.24845
46 ROUGE-1 Eval D0711-B.M.100.C-C.46 R:0.31879 P:0.18519 F:0.23428
46 ROUGE-1 Eval D0711-B.M.100.C-F.46 R:0.35254 P:0.20273 F:0.25743
46 ROUGE-1 Eval D0711-C.M.100.C-A.46 R:0.39274 P:0.21558 F:0.27836
46 ROUGE-1 Eval D0711-C.M.100.C-B.46 R:0.39932 P:0.21196 F:0.27693
46 ROUGE-1 Eval D0711-C.M.100.C-C.46 R:0.43581 P:0.23370 F:0.30425
46 ROUGE-1 Eval D0711-C.M.100.C-F.46 R:0.41892 P:0.22464 F:0.29246
46 ROUGE-1 Eval D0716-A.M.100.D-C.46 R:0.44918 P:0.26550 F:0.33374
46 ROUGE-1 Eval D0716-A.M.100.D-D.46 R:0.46667 P:0.27132 F:0.34314
46 ROUGE-1 Eval D0716-A.M.100.D-E.46 R:0.48505 P:0.28295 F:0.35741
46 ROUGE-1 Eval D0716-A.M.100.D-F.46 R:0.45545 P:0.26744 F:0.33700
46 ROUGE-1 Eval D0716-B.M.100.D-C.46 R:0.41447 P:0.19811 F:0.26808
46 ROUGE-1 Eval D0716-B.M.100.D-D.46 R:0.43289 P:0.20283 F:0.27623
46 ROUGE-1 Eval D0716-B.M.100.D-E.46 R:0.41528 P:0.19654 F:0.26681
46 ROUGE-1 Eval D0716-B.M.100.D-F.46 R:0.40333 P:0.19025 F:0.25854
46 ROUGE-1 Eval D0716-C.M.100.D-C.46 R:0.41042 P:0.26087 F:0.31899
46 ROUGE-1 Eval D0716-C.M.100.D-D.46 R:0.38796 P:0.24017 F:0.29668
46 ROUGE-1 Eval D0716-C.M.100.D-E.46 R:0.46535 P:0.29193 F:0.35878
46 ROUGE-1 Eval D0716-C.M.100.D-F.46 R:0.42333 P:0.26294 F:0.32439
46 ROUGE-1 Eval D0721-A.M.100.E-B.46 R:0.31333 P:0.18008 F:0.22871
46 ROUGE-1 Eval D0721-A.M.100.E-C.46 R:0.31494 P:0.18582 F:0.23373
46 ROUGE-1 Eval D0721-A.M.100.E-E.46 R:0.28247 P:0.16667 F:0.20964
46 ROUGE-1 Eval D0721-A.M.100.E-G.46 R:0.29936 P:0.18008 F:0.22488
46 ROUGE-1 Eval D0721-B.M.100.E-B.46 R:0.38436 P:0.21731 F:0.27764
46 ROUGE-1 Eval D0721-B.M.100.E-C.46 R:0.37261 P:0.21547 F:0.27305
46 ROUGE-1 Eval D0721-B.M.100.E-E.46 R:0.37377 P:0.20994 F:0.26886
46 ROUGE-1 Eval D0721-B.M.100.E-G.46 R:0.35484 P:0.20258 F:0.25791
46 ROUGE-1 Eval D0721-C.M.100.E-B.46 R:0.38689 P:0.24431 F:0.29950
46 ROUGE-1 Eval D0721-C.M.100.E-C.46 R:0.34653 P:0.21739 F:0.26717
46 ROUGE-1 Eval D0721-C.M.100.E-E.46 R:0.34000 P:0.21118 F:0.26054
46 ROUGE-1 Eval D0721-C.M.100.E-G.46 R:0.32899 P:0.20911 F:0.25570
46 ROUGE-1 Eval D0726-A.M.100.F-A.46 R:0.40532 P:0.25259 F:0.31123
46 ROUGE-1 Eval D0726-A.M.100.F-E.46 R:0.37000 P:0.22981 F:0.28352
46 ROUGE-1 Eval D0726-A.M.100.F-F.46 R:0.39867 P:0.24845 F:0.30612
46 ROUGE-1 Eval D0726-A.M.100.F-G.46 R:0.40199 P:0.25052 F:0.30867
46 ROUGE-1 Eval D0726-B.M.100.F-A.46 R:0.41503 P:0.24053 F:0.30456
46 ROUGE-1 Eval D0726-B.M.100.F-E.46 R:0.40532 P:0.23106 F:0.29433
46 ROUGE-1 Eval D0726-B.M.100.F-F.46 R:0.40199 P:0.22917 F:0.29192
46 ROUGE-1 Eval D0726-B.M.100.F-G.46 R:0.39145 P:0.22538 F:0.28606
46 ROUGE-1 Eval D0726-C.M.100.F-A.46 R:0.38000 P:0.27941 F:0.32203
46 ROUGE-1 Eval D0726-C.M.100.F-E.46 R:0.35017 P:0.25490 F:0.29503
46 ROUGE-1 Eval D0726-C.M.100.F-F.46 R:0.36949 P:0.26716 F:0.31010
46 ROUGE-1 Eval D0726-C.M.100.F-G.46 R:0.34426 P:0.25735 F:0.29453
46 ROUGE-1 Eval D0727-A.M.100.G-A.46 R:0.39867 P:0.18779 F:0.25532
46 ROUGE-1 Eval D0727-A.M.100.G-F.46 R:0.39803 P:0.18936 F:0.25663
46 ROUGE-1 Eval D0727-A.M.100.G-G.46 R:0.37908 P:0.18153 F:0.24550
46 ROUGE-1 Eval D0727-A.M.100.G-H.46 R:0.39474 P:0.18779 F:0.25450
46 ROUGE-1 Eval D0727-B.M.100.G-A.46 R:0.35052 P:0.17436 F:0.23288
46 ROUGE-1 Eval D0727-B.M.100.G-F.46 R:0.34416 P:0.18120 F:0.23741
46 ROUGE-1 Eval D0727-B.M.100.G-G.46 R:0.31834 P:0.15726 F:0.21052
46 ROUGE-1 Eval D0727-B.M.100.G-H.46 R:0.30928 P:0.15385 F:0.20548
46 ROUGE-1 Eval D0727-C.M.100.G-A.46 R:0.34853 P:0.19176 F:0.24740
46 ROUGE-1 Eval D0727-C.M.100.G-F.46 R:0.34680 P:0.18459 F:0.24094
46 ROUGE-1 Eval D0727-C.M.100.G-G.46 R:0.34983 P:0.18996 F:0.24622
46 ROUGE-1 Eval D0727-C.M.100.G-H.46 R:0.34122 P:0.18100 F:0.23653
46 ROUGE-1 Eval D0736-A.M.100.H-G.46 R:0.32258 P:0.15228 F:0.20689
46 ROUGE-1 Eval D0736-A.M.100.H-H.46 R:0.36861 P:0.17090 F:0.23353
46 ROUGE-1 Eval D0736-A.M.100.H-I.46 R:0.35231 P:0.16751 F:0.22706
46 ROUGE-1 Eval D0736-A.M.100.H-J.46 R:0.34641 P:0.17936 F:0.23635
46 ROUGE-1 Eval D0736-B.M.100.H-G.46 R:0.35878 P:0.18217 F:0.24165
46 ROUGE-1 Eval D0736-B.M.100.H-H.46 R:0.42975 P:0.20155 F:0.27441
46 ROUGE-1 Eval D0736-B.M.100.H-I.46 R:0.43515 P:0.20155 F:0.27550
46 ROUGE-1 Eval D0736-B.M.100.H-J.46 R:0.43357 P:0.24031 F:0.30923
46 ROUGE-1 Eval D0736-C.M.100.H-G.46 R:0.38819 P:0.17625 F:0.24243
46 ROUGE-1 Eval D0736-C.M.100.H-H.46 R:0.33155 P:0.11877 F:0.17489
46 ROUGE-1 Eval D0736-C.M.100.H-I.46 R:0.45455 P:0.16284 F:0.23978
46 ROUGE-1 Eval D0736-C.M.100.H-J.46 R:0.40000 P:0.20307 F:0.26938
46 ROUGE-1 Eval D0740-A.M.100.I-D.46 R:0.31023 P:0.18217 F:0.22955
46 ROUGE-1 Eval D0740-A.M.100.I-H.46 R:0.29739 P:0.17636 F:0.22142
46 ROUGE-1 Eval D0740-A.M.100.I-I.46 R:0.32143 P:0.19186 F:0.24029
46 ROUGE-1 Eval D0740-A.M.100.I-J.46 R:0.29355 P:0.17636 F:0.22034
46 ROUGE-1 Eval D0740-B.M.100.I-D.46 R:0.25000 P:0.13230 F:0.17303
46 ROUGE-1 Eval D0740-B.M.100.I-H.46 R:0.25166 P:0.13058 F:0.17194
46 ROUGE-1 Eval D0740-B.M.100.I-I.46 R:0.28525 P:0.14948 F:0.19616
46 ROUGE-1 Eval D0740-B.M.100.I-J.46 R:0.26214 P:0.13918 F:0.18182
46 ROUGE-1 Eval D0740-C.M.100.I-D.46 R:0.39936 P:0.24225 F:0.30157
46 ROUGE-1 Eval D0740-C.M.100.I-H.46 R:0.35691 P:0.21512 F:0.26844
46 ROUGE-1 Eval D0740-C.M.100.I-I.46 R:0.38978 P:0.23643 F:0.29433
46 ROUGE-1 Eval D0740-C.M.100.I-J.46 R:0.39809 P:0.24225 F:0.30121
46 ROUGE-1 Eval D0743-A.M.100.J-B.46 R:0.23492 P:0.11526 F:0.15465
46 ROUGE-1 Eval D0743-A.M.100.J-H.46 R:0.23148 P:0.11682 F:0.15528
46 ROUGE-1 Eval D0743-A.M.100.J-I.46 R:0.24688 P:0.12305 F:0.16424
46 ROUGE-1 Eval D0743-A.M.100.J-J.46 R:0.23077 P:0.11682 F:0.15512
46 ROUGE-1 Eval D0743-B.M.100.J-B.46 R:0.26923 P:0.15054 F:0.19311
46 ROUGE-1 Eval D0743-B.M.100.J-H.46 R:0.25552 P:0.14516 F:0.18514
46 ROUGE-1 Eval D0743-B.M.100.J-I.46 R:0.26266 P:0.14875 F:0.18994
46 ROUGE-1 Eval D0743-B.M.100.J-J.46 R:0.26480 P:0.15233 F:0.19340
46 ROUGE-1 Eval D0743-C.M.100.J-B.46 R:0.32698 P:0.17428 F:0.22737
46 ROUGE-1 Eval D0743-C.M.100.J-H.46 R:0.29936 P:0.15905 F:0.20773
46 ROUGE-1 Eval D0743-C.M.100.J-I.46 R:0.34185 P:0.18105 F:0.23673
46 ROUGE-1 Eval D0743-C.M.100.J-J.46 R:0.30818 P:0.16582 F:0.21562
---------------------------------------------
46 ROUGE-2 Average_R: 0.09180 (95%-conf.int. 0.08289 - 0.10130)
46 ROUGE-2 Average_P: 0.05066 (95%-conf.int. 0.04583 - 0.05584)
46 ROUGE-2 Average_F: 0.06506 (95%-conf.int. 0.05904 - 0.07161)
.............................................
46 ROUGE-2 Eval D0703-A.M.100.A-A.46 R:0.11945 P:0.07883 F:0.09498
46 ROUGE-2 Eval D0703-A.M.100.A-C.46 R:0.08814 P:0.05856 F:0.07037
46 ROUGE-2 Eval D0703-A.M.100.A-D.46 R:0.11458 P:0.07432 F:0.09016
46 ROUGE-2 Eval D0703-A.M.100.A-J.46 R:0.13058 P:0.08559 F:0.10340
46 ROUGE-2 Eval D0703-B.M.100.A-A.46 R:0.25743 P:0.14208 F:0.18310
46 ROUGE-2 Eval D0703-B.M.100.A-C.46 R:0.17627 P:0.09472 F:0.12322
46 ROUGE-2 Eval D0703-B.M.100.A-D.46 R:0.21356 P:0.11475 F:0.14929
46 ROUGE-2 Eval D0703-B.M.100.A-J.46 R:0.25839 P:0.14026 F:0.18182
46 ROUGE-2 Eval D0703-C.M.100.A-A.46 R:0.12121 P:0.05882 F:0.07920
46 ROUGE-2 Eval D0703-C.M.100.A-C.46 R:0.11475 P:0.05719 F:0.07634
46 ROUGE-2 Eval D0703-C.M.100.A-D.46 R:0.12040 P:0.05882 F:0.07903
46 ROUGE-2 Eval D0703-C.M.100.A-J.46 R:0.11371 P:0.05556 F:0.07465
46 ROUGE-2 Eval D0706-A.M.100.B-B.46 R:0.10164 P:0.05065 F:0.06761
46 ROUGE-2 Eval D0706-A.M.100.B-D.46 R:0.10231 P:0.05065 F:0.06776
46 ROUGE-2 Eval D0706-A.M.100.B-E.46 R:0.07213 P:0.03595 F:0.04798
46 ROUGE-2 Eval D0706-A.M.100.B-I.46 R:0.09836 P:0.04902 F:0.06543
46 ROUGE-2 Eval D0706-B.M.100.B-B.46 R:0.02310 P:0.01282 F:0.01649
46 ROUGE-2 Eval D0706-B.M.100.B-D.46 R:0.04276 P:0.02381 F:0.03059
46 ROUGE-2 Eval D0706-B.M.100.B-E.46 R:0.03279 P:0.01832 F:0.02351
46 ROUGE-2 Eval D0706-B.M.100.B-I.46 R:0.03922 P:0.02198 F:0.02817
46 ROUGE-2 Eval D0706-C.M.100.B-B.46 R:0.08795 P:0.05233 F:0.06562
46 ROUGE-2 Eval D0706-C.M.100.B-D.46 R:0.10423 P:0.06202 F:0.07777
46 ROUGE-2 Eval D0706-C.M.100.B-E.46 R:0.06796 P:0.04070 F:0.05091
46 ROUGE-2 Eval D0706-C.M.100.B-I.46 R:0.10968 P:0.06589 F:0.08232
46 ROUGE-2 Eval D0711-A.M.100.C-A.46 R:0.03987 P:0.02299 F:0.02916
46 ROUGE-2 Eval D0711-A.M.100.C-B.46 R:0.05387 P:0.03065 F:0.03907
46 ROUGE-2 Eval D0711-A.M.100.C-C.46 R:0.04377 P:0.02490 F:0.03174
46 ROUGE-2 Eval D0711-A.M.100.C-F.46 R:0.04348 P:0.02490 F:0.03167
46 ROUGE-2 Eval D0711-B.M.100.C-A.46 R:0.03436 P:0.01961 F:0.02497
46 ROUGE-2 Eval D0711-B.M.100.C-B.46 R:0.04498 P:0.02549 F:0.03254
46 ROUGE-2 Eval D0711-B.M.100.C-C.46 R:0.03729 P:0.02157 F:0.02733
46 ROUGE-2 Eval D0711-B.M.100.C-F.46 R:0.04795 P:0.02745 F:0.03491
46 ROUGE-2 Eval D0711-C.M.100.C-A.46 R:0.09333 P:0.05100 F:0.06596
46 ROUGE-2 Eval D0711-C.M.100.C-B.46 R:0.09655 P:0.05100 F:0.06674
46 ROUGE-2 Eval D0711-C.M.100.C-C.46 R:0.11604 P:0.06193 F:0.08076
46 ROUGE-2 Eval D0711-C.M.100.C-F.46 R:0.14334 P:0.07650 F:0.09976
46 ROUGE-2 Eval D0716-A.M.100.D-C.46 R:0.18212 P:0.10721 F:0.13497
46 ROUGE-2 Eval D0716-A.M.100.D-D.46 R:0.19192 P:0.11111 F:0.14074
46 ROUGE-2 Eval D0716-A.M.100.D-E.46 R:0.18456 P:0.10721 F:0.13563
46 ROUGE-2 Eval D0716-A.M.100.D-F.46 R:0.17333 P:0.10136 F:0.12792
46 ROUGE-2 Eval D0716-B.M.100.D-C.46 R:0.10299 P:0.04897 F:0.06638
46 ROUGE-2 Eval D0716-B.M.100.D-D.46 R:0.12203 P:0.05687 F:0.07758
46 ROUGE-2 Eval D0716-B.M.100.D-E.46 R:0.11074 P:0.05213 F:0.07089
46 ROUGE-2 Eval D0716-B.M.100.D-F.46 R:0.12795 P:0.06003 F:0.08172
46 ROUGE-2 Eval D0716-C.M.100.D-C.46 R:0.11842 P:0.07500 F:0.09184
46 ROUGE-2 Eval D0716-C.M.100.D-D.46 R:0.08108 P:0.05000 F:0.06186
46 ROUGE-2 Eval D0716-C.M.100.D-E.46 R:0.14000 P:0.08750 F:0.10769
46 ROUGE-2 Eval D0716-C.M.100.D-F.46 R:0.11111 P:0.06875 F:0.08494
46 ROUGE-2 Eval D0721-A.M.100.E-B.46 R:0.03704 P:0.02119 F:0.02696
46 ROUGE-2 Eval D0721-A.M.100.E-C.46 R:0.05246 P:0.03083 F:0.03884
46 ROUGE-2 Eval D0721-A.M.100.E-E.46 R:0.04590 P:0.02697 F:0.03398
46 ROUGE-2 Eval D0721-A.M.100.E-G.46 R:0.05145 P:0.03083 F:0.03856
46 ROUGE-2 Eval D0721-B.M.100.E-B.46 R:0.11842 P:0.06667 F:0.08531
46 ROUGE-2 Eval D0721-B.M.100.E-C.46 R:0.08360 P:0.04815 F:0.06111
46 ROUGE-2 Eval D0721-B.M.100.E-E.46 R:0.10927 P:0.06111 F:0.07838
46 ROUGE-2 Eval D0721-B.M.100.E-G.46 R:0.10098 P:0.05741 F:0.07320
46 ROUGE-2 Eval D0721-C.M.100.E-B.46 R:0.09934 P:0.06250 F:0.07673
46 ROUGE-2 Eval D0721-C.M.100.E-C.46 R:0.08667 P:0.05417 F:0.06667
46 ROUGE-2 Eval D0721-C.M.100.E-E.46 R:0.07407 P:0.04583 F:0.05662
46 ROUGE-2 Eval D0721-C.M.100.E-G.46 R:0.06908 P:0.04375 F:0.05357
46 ROUGE-2 Eval D0726-A.M.100.F-A.46 R:0.19799 P:0.12292 F:0.15167
46 ROUGE-2 Eval D0726-A.M.100.F-E.46 R:0.16835 P:0.10417 F:0.12870
46 ROUGE-2 Eval D0726-A.M.100.F-F.46 R:0.19128 P:0.11875 F:0.14653
46 ROUGE-2 Eval D0726-A.M.100.F-G.46 R:0.17785 P:0.11042 F:0.13625
46 ROUGE-2 Eval D0726-B.M.100.F-A.46 R:0.08911 P:0.05143 F:0.06522
46 ROUGE-2 Eval D0726-B.M.100.F-E.46 R:0.07047 P:0.04000 F:0.05103
46 ROUGE-2 Eval D0726-B.M.100.F-F.46 R:0.07047 P:0.04000 F:0.05103
46 ROUGE-2 Eval D0726-B.M.100.F-G.46 R:0.05980 P:0.03429 F:0.04359
46 ROUGE-2 Eval D0726-C.M.100.F-A.46 R:0.06061 P:0.04444 F:0.05128
46 ROUGE-2 Eval D0726-C.M.100.F-E.46 R:0.05102 P:0.03704 F:0.04292
46 ROUGE-2 Eval D0726-C.M.100.F-F.46 R:0.04795 P:0.03457 F:0.04018
46 ROUGE-2 Eval D0726-C.M.100.F-G.46 R:0.04305 P:0.03210 F:0.03678
46 ROUGE-2 Eval D0727-A.M.100.G-A.46 R:0.06040 P:0.02830 F:0.03854
46 ROUGE-2 Eval D0727-A.M.100.G-F.46 R:0.06977 P:0.03302 F:0.04483
46 ROUGE-2 Eval D0727-A.M.100.G-G.46 R:0.04950 P:0.02358 F:0.03194
46 ROUGE-2 Eval D0727-A.M.100.G-H.46 R:0.06977 P:0.03302 F:0.04483
46 ROUGE-2 Eval D0727-B.M.100.G-A.46 R:0.04861 P:0.02405 F:0.03218
46 ROUGE-2 Eval D0727-B.M.100.G-F.46 R:0.05574 P:0.02921 F:0.03833
46 ROUGE-2 Eval D0727-B.M.100.G-G.46 R:0.03497 P:0.01718 F:0.02304
46 ROUGE-2 Eval D0727-B.M.100.G-H.46 R:0.04514 P:0.02234 F:0.02989
46 ROUGE-2 Eval D0727-C.M.100.G-A.46 R:0.04276 P:0.02342 F:0.03026
46 ROUGE-2 Eval D0727-C.M.100.G-F.46 R:0.05782 P:0.03063 F:0.04005
46 ROUGE-2 Eval D0727-C.M.100.G-G.46 R:0.05333 P:0.02883 F:0.03743
46 ROUGE-2 Eval D0727-C.M.100.G-H.46 R:0.03754 P:0.01982 F:0.02594
46 ROUGE-2 Eval D0736-A.M.100.H-G.46 R:0.11232 P:0.05272 F:0.07176
46 ROUGE-2 Eval D0736-A.M.100.H-H.46 R:0.11070 P:0.05102 F:0.06985
46 ROUGE-2 Eval D0736-A.M.100.H-I.46 R:0.12230 P:0.05782 F:0.07852
46 ROUGE-2 Eval D0736-A.M.100.H-J.46 R:0.09241 P:0.04762 F:0.06285
46 ROUGE-2 Eval D0736-B.M.100.H-G.46 R:0.08494 P:0.04288 F:0.05699
46 ROUGE-2 Eval D0736-B.M.100.H-H.46 R:0.17573 P:0.08187 F:0.11170
46 ROUGE-2 Eval D0736-B.M.100.H-I.46 R:0.19492 P:0.08967 F:0.12283
46 ROUGE-2 Eval D0736-B.M.100.H-J.46 R:0.18375 P:0.10136 F:0.13065
46 ROUGE-2 Eval D0736-C.M.100.H-G.46 R:0.14103 P:0.06358 F:0.08765
46 ROUGE-2 Eval D0736-C.M.100.H-H.46 R:0.09239 P:0.03276 F:0.04837
46 ROUGE-2 Eval D0736-C.M.100.H-I.46 R:0.19022 P:0.06744 F:0.09958
46 ROUGE-2 Eval D0736-C.M.100.H-J.46 R:0.15649 P:0.07900 F:0.10500
46 ROUGE-2 Eval D0740-A.M.100.I-D.46 R:0.05333 P:0.03119 F:0.03936
46 ROUGE-2 Eval D0740-A.M.100.I-H.46 R:0.05281 P:0.03119 F:0.03922
46 ROUGE-2 Eval D0740-A.M.100.I-I.46 R:0.04918 P:0.02924 F:0.03667
46 ROUGE-2 Eval D0740-A.M.100.I-J.46 R:0.05212 P:0.03119 F:0.03903
46 ROUGE-2 Eval D0740-B.M.100.I-D.46 R:0.03279 P:0.01727 F:0.02262
46 ROUGE-2 Eval D0740-B.M.100.I-H.46 R:0.04682 P:0.02418 F:0.03189
46 ROUGE-2 Eval D0740-B.M.100.I-I.46 R:0.05298 P:0.02763 F:0.03632
46 ROUGE-2 Eval D0740-B.M.100.I-J.46 R:0.04575 P:0.02418 F:0.03164
46 ROUGE-2 Eval D0740-C.M.100.I-D.46 R:0.13871 P:0.08382 F:0.10450
46 ROUGE-2 Eval D0740-C.M.100.I-H.46 R:0.10714 P:0.06433 F:0.08039
46 ROUGE-2 Eval D0740-C.M.100.I-I.46 R:0.13548 P:0.08187 F:0.10206
46 ROUGE-2 Eval D0740-C.M.100.I-J.46 R:0.14148 P:0.08577 F:0.10680
46 ROUGE-2 Eval D0743-A.M.100.J-B.46 R:0.02885 P:0.01408 F:0.01892
46 ROUGE-2 Eval D0743-A.M.100.J-H.46 R:0.02181 P:0.01095 F:0.01458
46 ROUGE-2 Eval D0743-A.M.100.J-I.46 R:0.01893 P:0.00939 F:0.01255
46 ROUGE-2 Eval D0743-A.M.100.J-J.46 R:0.02484 P:0.01252 F:0.01665
46 ROUGE-2 Eval D0743-B.M.100.J-B.46 R:0.04854 P:0.02703 F:0.03472
46 ROUGE-2 Eval D0743-B.M.100.J-H.46 R:0.04140 P:0.02342 F:0.02992
46 ROUGE-2 Eval D0743-B.M.100.J-I.46 R:0.04473 P:0.02523 F:0.03226
46 ROUGE-2 Eval D0743-B.M.100.J-J.46 R:0.04717 P:0.02703 F:0.03437
46 ROUGE-2 Eval D0743-C.M.100.J-B.46 R:0.04487 P:0.02381 F:0.03111
46 ROUGE-2 Eval D0743-C.M.100.J-H.46 R:0.04823 P:0.02551 F:0.03337
46 ROUGE-2 Eval D0743-C.M.100.J-I.46 R:0.04516 P:0.02381 F:0.03118
46 ROUGE-2 Eval D0743-C.M.100.J-J.46 R:0.03492 P:0.01871 F:0.02437
---------------------------------------------
46 ROUGE-3 Average_R: 0.04091 (95%-conf.int. 0.03414 - 0.04839)
46 ROUGE-3 Average_P: 0.02248 (95%-conf.int. 0.01876 - 0.02643)
46 ROUGE-3 Average_F: 0.02891 (95%-conf.int. 0.02415 - 0.03398)
.............................................
46 ROUGE-3 Eval D0703-A.M.100.A-A.46 R:0.04828 P:0.03175 F:0.03831
46 ROUGE-3 Eval D0703-A.M.100.A-C.46 R:0.02740 P:0.01814 F:0.02183
46 ROUGE-3 Eval D0703-A.M.100.A-D.46 R:0.05263 P:0.03401 F:0.04132
46 ROUGE-3 Eval D0703-A.M.100.A-J.46 R:0.04861 P:0.03175 F:0.03841
46 ROUGE-3 Eval D0703-B.M.100.A-A.46 R:0.17000 P:0.09341 F:0.12057
46 ROUGE-3 Eval D0703-B.M.100.A-C.46 R:0.08904 P:0.04762 F:0.06205
46 ROUGE-3 Eval D0703-B.M.100.A-D.46 R:0.12671 P:0.06777 F:0.08831
46 ROUGE-3 Eval D0703-B.M.100.A-J.46 R:0.17288 P:0.09341 F:0.12129
46 ROUGE-3 Eval D0703-C.M.100.A-A.46 R:0.05782 P:0.02791 F:0.03765
46 ROUGE-3 Eval D0703-C.M.100.A-C.46 R:0.05298 P:0.02627 F:0.03512
46 ROUGE-3 Eval D0703-C.M.100.A-D.46 R:0.05068 P:0.02463 F:0.03315
46 ROUGE-3 Eval D0703-C.M.100.A-J.46 R:0.06081 P:0.02956 F:0.03978
46 ROUGE-3 Eval D0706-A.M.100.B-B.46 R:0.02649 P:0.01314 F:0.01757
46 ROUGE-3 Eval D0706-A.M.100.B-D.46 R:0.03333 P:0.01642 F:0.02200
46 ROUGE-3 Eval D0706-A.M.100.B-E.46 R:0.00662 P:0.00328 F:0.00439
46 ROUGE-3 Eval D0706-A.M.100.B-I.46 R:0.03311 P:0.01642 F:0.02195
46 ROUGE-3 Eval D0706-B.M.100.B-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0706-B.M.100.B-D.46 R:0.00664 P:0.00368 F:0.00474
46 ROUGE-3 Eval D0706-B.M.100.B-E.46 R:0.00662 P:0.00368 F:0.00473
46 ROUGE-3 Eval D0706-B.M.100.B-I.46 R:0.00660 P:0.00368 F:0.00473
46 ROUGE-3 Eval D0706-C.M.100.B-B.46 R:0.05921 P:0.03509 F:0.04407
46 ROUGE-3 Eval D0706-C.M.100.B-D.46 R:0.06250 P:0.03704 F:0.04651
46 ROUGE-3 Eval D0706-C.M.100.B-E.46 R:0.02288 P:0.01365 F:0.01710
46 ROUGE-3 Eval D0706-C.M.100.B-I.46 R:0.07166 P:0.04288 F:0.05365
46 ROUGE-3 Eval D0711-A.M.100.C-A.46 R:0.01342 P:0.00771 F:0.00979
46 ROUGE-3 Eval D0711-A.M.100.C-B.46 R:0.01361 P:0.00771 F:0.00984
46 ROUGE-3 Eval D0711-A.M.100.C-C.46 R:0.01020 P:0.00578 F:0.00738
46 ROUGE-3 Eval D0711-A.M.100.C-F.46 R:0.00338 P:0.00193 F:0.00246
46 ROUGE-3 Eval D0711-B.M.100.C-A.46 R:0.00347 P:0.00197 F:0.00251
46 ROUGE-3 Eval D0711-B.M.100.C-B.46 R:0.00699 P:0.00394 F:0.00504
46 ROUGE-3 Eval D0711-B.M.100.C-C.46 R:0.00342 P:0.00197 F:0.00250
46 ROUGE-3 Eval D0711-B.M.100.C-F.46 R:0.00692 P:0.00394 F:0.00502
46 ROUGE-3 Eval D0711-C.M.100.C-A.46 R:0.05724 P:0.03114 F:0.04034
46 ROUGE-3 Eval D0711-C.M.100.C-B.46 R:0.06272 P:0.03297 F:0.04322
46 ROUGE-3 Eval D0711-C.M.100.C-C.46 R:0.07931 P:0.04212 F:0.05502
46 ROUGE-3 Eval D0711-C.M.100.C-F.46 R:0.10000 P:0.05311 F:0.06937
46 ROUGE-3 Eval D0716-A.M.100.D-C.46 R:0.09365 P:0.05490 F:0.06922
46 ROUGE-3 Eval D0716-A.M.100.D-D.46 R:0.10544 P:0.06078 F:0.07711
46 ROUGE-3 Eval D0716-A.M.100.D-E.46 R:0.09153 P:0.05294 F:0.06708
46 ROUGE-3 Eval D0716-A.M.100.D-F.46 R:0.08418 P:0.04902 F:0.06196
46 ROUGE-3 Eval D0716-B.M.100.D-C.46 R:0.03020 P:0.01429 F:0.01940
46 ROUGE-3 Eval D0716-B.M.100.D-D.46 R:0.03767 P:0.01746 F:0.02386
46 ROUGE-3 Eval D0716-B.M.100.D-E.46 R:0.02712 P:0.01270 F:0.01730
46 ROUGE-3 Eval D0716-B.M.100.D-F.46 R:0.04762 P:0.02222 F:0.03030
46 ROUGE-3 Eval D0716-C.M.100.D-C.46 R:0.05316 P:0.03354 F:0.04113
46 ROUGE-3 Eval D0716-C.M.100.D-D.46 R:0.02048 P:0.01258 F:0.01559
46 ROUGE-3 Eval D0716-C.M.100.D-E.46 R:0.05724 P:0.03564 F:0.04393
46 ROUGE-3 Eval D0716-C.M.100.D-F.46 R:0.05102 P:0.03145 F:0.03891
46 ROUGE-3 Eval D0721-A.M.100.E-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0721-A.M.100.E-C.46 R:0.00662 P:0.00388 F:0.00489
46 ROUGE-3 Eval D0721-A.M.100.E-E.46 R:0.00662 P:0.00388 F:0.00489
46 ROUGE-3 Eval D0721-A.M.100.E-G.46 R:0.00649 P:0.00388 F:0.00486
46 ROUGE-3 Eval D0721-B.M.100.E-B.46 R:0.06312 P:0.03538 F:0.04534
46 ROUGE-3 Eval D0721-B.M.100.E-C.46 R:0.02922 P:0.01676 F:0.02130
46 ROUGE-3 Eval D0721-B.M.100.E-E.46 R:0.06020 P:0.03352 F:0.04306
46 ROUGE-3 Eval D0721-B.M.100.E-G.46 R:0.05592 P:0.03166 F:0.04043
46 ROUGE-3 Eval D0721-C.M.100.E-B.46 R:0.06020 P:0.03774 F:0.04639
46 ROUGE-3 Eval D0721-C.M.100.E-C.46 R:0.05051 P:0.03145 F:0.03876
46 ROUGE-3 Eval D0721-C.M.100.E-E.46 R:0.04082 P:0.02516 F:0.03113
46 ROUGE-3 Eval D0721-C.M.100.E-G.46 R:0.03987 P:0.02516 F:0.03085
46 ROUGE-3 Eval D0726-A.M.100.F-A.46 R:0.13559 P:0.08386 F:0.10363
46 ROUGE-3 Eval D0726-A.M.100.F-E.46 R:0.11224 P:0.06918 F:0.08560
46 ROUGE-3 Eval D0726-A.M.100.F-F.46 R:0.12881 P:0.07966 F:0.09844
46 ROUGE-3 Eval D0726-A.M.100.F-G.46 R:0.10169 P:0.06289 F:0.07772
46 ROUGE-3 Eval D0726-B.M.100.F-A.46 R:0.04000 P:0.02299 F:0.02920
46 ROUGE-3 Eval D0726-B.M.100.F-E.46 R:0.03051 P:0.01724 F:0.02203
46 ROUGE-3 Eval D0726-B.M.100.F-F.46 R:0.03051 P:0.01724 F:0.02203
46 ROUGE-3 Eval D0726-B.M.100.F-G.46 R:0.02013 P:0.01149 F:0.01463
46 ROUGE-3 Eval D0726-C.M.100.F-A.46 R:0.01701 P:0.01244 F:0.01437
46 ROUGE-3 Eval D0726-C.M.100.F-E.46 R:0.01375 P:0.00995 F:0.01155
46 ROUGE-3 Eval D0726-C.M.100.F-F.46 R:0.01384 P:0.00995 F:0.01158
46 ROUGE-3 Eval D0726-C.M.100.F-G.46 R:0.00669 P:0.00498 F:0.00571
46 ROUGE-3 Eval D0727-A.M.100.G-A.46 R:0.00339 P:0.00158 F:0.00216
46 ROUGE-3 Eval D0727-A.M.100.G-F.46 R:0.00671 P:0.00316 F:0.00430
46 ROUGE-3 Eval D0727-A.M.100.G-G.46 R:0.00333 P:0.00158 F:0.00214
46 ROUGE-3 Eval D0727-A.M.100.G-H.46 R:0.00671 P:0.00316 F:0.00430
46 ROUGE-3 Eval D0727-B.M.100.G-A.46 R:0.01404 P:0.00691 F:0.00926
46 ROUGE-3 Eval D0727-B.M.100.G-F.46 R:0.01325 P:0.00691 F:0.00908
46 ROUGE-3 Eval D0727-B.M.100.G-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0727-B.M.100.G-H.46 R:0.01404 P:0.00691 F:0.00926
46 ROUGE-3 Eval D0727-C.M.100.G-A.46 R:0.00664 P:0.00362 F:0.00469
46 ROUGE-3 Eval D0727-C.M.100.G-F.46 R:0.01031 P:0.00543 F:0.00711
46 ROUGE-3 Eval D0727-C.M.100.G-G.46 R:0.01010 P:0.00543 F:0.00706
46 ROUGE-3 Eval D0727-C.M.100.G-H.46 R:0.00345 P:0.00181 F:0.00237
46 ROUGE-3 Eval D0736-A.M.100.H-G.46 R:0.05861 P:0.02735 F:0.03730
46 ROUGE-3 Eval D0736-A.M.100.H-H.46 R:0.06343 P:0.02906 F:0.03986
46 ROUGE-3 Eval D0736-A.M.100.H-I.46 R:0.06182 P:0.02906 F:0.03954
46 ROUGE-3 Eval D0736-A.M.100.H-J.46 R:0.03333 P:0.01709 F:0.02259
46 ROUGE-3 Eval D0736-B.M.100.H-G.46 R:0.02734 P:0.01373 F:0.01828
46 ROUGE-3 Eval D0736-B.M.100.H-H.46 R:0.11864 P:0.05490 F:0.07506
46 ROUGE-3 Eval D0736-B.M.100.H-I.46 R:0.13305 P:0.06078 F:0.08344
46 ROUGE-3 Eval D0736-B.M.100.H-J.46 R:0.11786 P:0.06471 F:0.08355
46 ROUGE-3 Eval D0736-C.M.100.H-G.46 R:0.08225 P:0.03682 F:0.05087
46 ROUGE-3 Eval D0736-C.M.100.H-H.46 R:0.04972 P:0.01744 F:0.02582
46 ROUGE-3 Eval D0736-C.M.100.H-I.46 R:0.11050 P:0.03876 F:0.05739
46 ROUGE-3 Eval D0736-C.M.100.H-J.46 R:0.09266 P:0.04651 F:0.06193
46 ROUGE-3 Eval D0740-A.M.100.I-D.46 R:0.01010 P:0.00588 F:0.00743
46 ROUGE-3 Eval D0740-A.M.100.I-H.46 R:0.01333 P:0.00784 F:0.00987
46 ROUGE-3 Eval D0740-A.M.100.I-I.46 R:0.00662 P:0.00392 F:0.00492
46 ROUGE-3 Eval D0740-A.M.100.I-J.46 R:0.00987 P:0.00588 F:0.00737
46 ROUGE-3 Eval D0740-B.M.100.I-D.46 R:0.00331 P:0.00174 F:0.00228
46 ROUGE-3 Eval D0740-B.M.100.I-H.46 R:0.01351 P:0.00694 F:0.00917
46 ROUGE-3 Eval D0740-B.M.100.I-I.46 R:0.01672 P:0.00868 F:0.01143
46 ROUGE-3 Eval D0740-B.M.100.I-J.46 R:0.01650 P:0.00868 F:0.01138
46 ROUGE-3 Eval D0740-C.M.100.I-D.46 R:0.07492 P:0.04510 F:0.05631
46 ROUGE-3 Eval D0740-C.M.100.I-H.46 R:0.04918 P:0.02941 F:0.03681
46 ROUGE-3 Eval D0740-C.M.100.I-I.46 R:0.06189 P:0.03725 F:0.04651
46 ROUGE-3 Eval D0740-C.M.100.I-J.46 R:0.06818 P:0.04118 F:0.05135
46 ROUGE-3 Eval D0743-A.M.100.J-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0743-A.M.100.J-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0743-A.M.100.J-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0743-A.M.100.J-J.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-3 Eval D0743-B.M.100.J-B.46 R:0.00654 P:0.00362 F:0.00466
46 ROUGE-3 Eval D0743-B.M.100.J-H.46 R:0.00643 P:0.00362 F:0.00463
46 ROUGE-3 Eval D0743-B.M.100.J-I.46 R:0.00645 P:0.00362 F:0.00464
46 ROUGE-3 Eval D0743-B.M.100.J-J.46 R:0.00952 P:0.00543 F:0.00692
46 ROUGE-3 Eval D0743-C.M.100.J-B.46 R:0.00971 P:0.00513 F:0.00671
46 ROUGE-3 Eval D0743-C.M.100.J-H.46 R:0.00974 P:0.00513 F:0.00672
46 ROUGE-3 Eval D0743-C.M.100.J-I.46 R:0.00977 P:0.00513 F:0.00673
46 ROUGE-3 Eval D0743-C.M.100.J-J.46 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
46 ROUGE-4 Average_R: 0.02438 (95%-conf.int. 0.01898 - 0.02991)
46 ROUGE-4 Average_P: 0.01325 (95%-conf.int. 0.01033 - 0.01626)
46 ROUGE-4 Average_F: 0.01710 (95%-conf.int. 0.01333 - 0.02104)
.............................................
46 ROUGE-4 Eval D0703-A.M.100.A-A.46 R:0.02439 P:0.01598 F:0.01931
46 ROUGE-4 Eval D0703-A.M.100.A-C.46 R:0.01384 P:0.00913 F:0.01100
46 ROUGE-4 Eval D0703-A.M.100.A-D.46 R:0.03191 P:0.02055 F:0.02500
46 ROUGE-4 Eval D0703-A.M.100.A-J.46 R:0.02456 P:0.01598 F:0.01936
46 ROUGE-4 Eval D0703-B.M.100.A-A.46 R:0.12458 P:0.06814 F:0.08810
46 ROUGE-4 Eval D0703-B.M.100.A-C.46 R:0.04844 P:0.02578 F:0.03365
46 ROUGE-4 Eval D0703-B.M.100.A-D.46 R:0.07958 P:0.04236 F:0.05529
46 ROUGE-4 Eval D0703-B.M.100.A-J.46 R:0.12671 P:0.06814 F:0.08862
46 ROUGE-4 Eval D0703-C.M.100.A-A.46 R:0.02749 P:0.01320 F:0.01784
46 ROUGE-4 Eval D0703-C.M.100.A-C.46 R:0.02676 P:0.01320 F:0.01768
46 ROUGE-4 Eval D0703-C.M.100.A-D.46 R:0.02389 P:0.01155 F:0.01557
46 ROUGE-4 Eval D0703-C.M.100.A-J.46 R:0.03413 P:0.01650 F:0.02225
46 ROUGE-4 Eval D0706-A.M.100.B-B.46 R:0.01672 P:0.00825 F:0.01105
46 ROUGE-4 Eval D0706-A.M.100.B-D.46 R:0.02020 P:0.00990 F:0.01329
46 ROUGE-4 Eval D0706-A.M.100.B-E.46 R:0.00334 P:0.00165 F:0.00221
46 ROUGE-4 Eval D0706-A.M.100.B-I.46 R:0.02007 P:0.00990 F:0.01326
46 ROUGE-4 Eval D0706-B.M.100.B-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0706-B.M.100.B-D.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0706-B.M.100.B-E.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0706-B.M.100.B-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0706-C.M.100.B-B.46 R:0.04651 P:0.02745 F:0.03452
46 ROUGE-4 Eval D0706-C.M.100.B-D.46 R:0.04983 P:0.02941 F:0.03699
46 ROUGE-4 Eval D0706-C.M.100.B-E.46 R:0.00990 P:0.00588 F:0.00738
46 ROUGE-4 Eval D0706-C.M.100.B-I.46 R:0.05263 P:0.03137 F:0.03931
46 ROUGE-4 Eval D0711-A.M.100.C-A.46 R:0.00339 P:0.00194 F:0.00247
46 ROUGE-4 Eval D0711-A.M.100.C-B.46 R:0.00344 P:0.00194 F:0.00248
46 ROUGE-4 Eval D0711-A.M.100.C-C.46 R:0.00344 P:0.00194 F:0.00248
46 ROUGE-4 Eval D0711-A.M.100.C-F.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0711-B.M.100.C-A.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0711-B.M.100.C-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0711-B.M.100.C-C.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0711-B.M.100.C-F.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0711-C.M.100.C-A.46 R:0.04762 P:0.02578 F:0.03345
46 ROUGE-4 Eval D0711-C.M.100.C-B.46 R:0.05282 P:0.02762 F:0.03627
46 ROUGE-4 Eval D0711-C.M.100.C-C.46 R:0.06620 P:0.03499 F:0.04578
46 ROUGE-4 Eval D0711-C.M.100.C-F.46 R:0.08362 P:0.04420 F:0.05783
46 ROUGE-4 Eval D0716-A.M.100.D-C.46 R:0.04730 P:0.02761 F:0.03487
46 ROUGE-4 Eval D0716-A.M.100.D-D.46 R:0.06873 P:0.03945 F:0.05013
46 ROUGE-4 Eval D0716-A.M.100.D-E.46 R:0.05479 P:0.03156 F:0.04005
46 ROUGE-4 Eval D0716-A.M.100.D-F.46 R:0.04422 P:0.02564 F:0.03246
46 ROUGE-4 Eval D0716-B.M.100.D-C.46 R:0.01356 P:0.00638 F:0.00868
46 ROUGE-4 Eval D0716-B.M.100.D-D.46 R:0.01730 P:0.00797 F:0.01091
46 ROUGE-4 Eval D0716-B.M.100.D-E.46 R:0.01027 P:0.00478 F:0.00652
46 ROUGE-4 Eval D0716-B.M.100.D-F.46 R:0.02062 P:0.00957 F:0.01307
46 ROUGE-4 Eval D0716-C.M.100.D-C.46 R:0.01678 P:0.01055 F:0.01295
46 ROUGE-4 Eval D0716-C.M.100.D-D.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0716-C.M.100.D-E.46 R:0.01701 P:0.01055 F:0.01302
46 ROUGE-4 Eval D0716-C.M.100.D-F.46 R:0.01718 P:0.01055 F:0.01307
46 ROUGE-4 Eval D0721-A.M.100.E-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0721-A.M.100.E-C.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0721-A.M.100.E-E.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0721-A.M.100.E-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0721-B.M.100.E-B.46 R:0.04027 P:0.02247 F:0.02884
46 ROUGE-4 Eval D0721-B.M.100.E-C.46 R:0.00984 P:0.00562 F:0.00715
46 ROUGE-4 Eval D0721-B.M.100.E-E.46 R:0.04392 P:0.02434 F:0.03132
46 ROUGE-4 Eval D0721-B.M.100.E-G.46 R:0.03654 P:0.02060 F:0.02635
46 ROUGE-4 Eval D0721-C.M.100.E-B.46 R:0.03716 P:0.02321 F:0.02857
46 ROUGE-4 Eval D0721-C.M.100.E-C.46 R:0.03061 P:0.01899 F:0.02344
46 ROUGE-4 Eval D0721-C.M.100.E-E.46 R:0.02062 P:0.01266 F:0.01569
46 ROUGE-4 Eval D0721-C.M.100.E-G.46 R:0.02349 P:0.01477 F:0.01814
46 ROUGE-4 Eval D0726-A.M.100.F-A.46 R:0.10959 P:0.06751 F:0.08355
46 ROUGE-4 Eval D0726-A.M.100.F-E.46 R:0.08247 P:0.05063 F:0.06274
46 ROUGE-4 Eval D0726-A.M.100.F-F.46 R:0.09932 P:0.06118 F:0.07572
46 ROUGE-4 Eval D0726-A.M.100.F-G.46 R:0.06849 P:0.04219 F:0.05222
46 ROUGE-4 Eval D0726-B.M.100.F-A.46 R:0.01347 P:0.00771 F:0.00981
46 ROUGE-4 Eval D0726-B.M.100.F-E.46 R:0.01370 P:0.00771 F:0.00987
46 ROUGE-4 Eval D0726-B.M.100.F-F.46 R:0.01027 P:0.00578 F:0.00740
46 ROUGE-4 Eval D0726-B.M.100.F-G.46 R:0.00339 P:0.00193 F:0.00246
46 ROUGE-4 Eval D0726-C.M.100.F-A.46 R:0.00344 P:0.00251 F:0.00290
46 ROUGE-4 Eval D0726-C.M.100.F-E.46 R:0.00347 P:0.00251 F:0.00291
46 ROUGE-4 Eval D0726-C.M.100.F-F.46 R:0.00350 P:0.00251 F:0.00292
46 ROUGE-4 Eval D0726-C.M.100.F-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-A.M.100.G-A.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-A.M.100.G-F.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-A.M.100.G-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-A.M.100.G-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-B.M.100.G-A.46 R:0.00709 P:0.00347 F:0.00466
46 ROUGE-4 Eval D0727-B.M.100.G-F.46 R:0.00669 P:0.00347 F:0.00457
46 ROUGE-4 Eval D0727-B.M.100.G-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-B.M.100.G-H.46 R:0.00709 P:0.00347 F:0.00466
46 ROUGE-4 Eval D0727-C.M.100.G-A.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-C.M.100.G-F.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-C.M.100.G-G.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0727-C.M.100.G-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0736-A.M.100.H-G.46 R:0.03704 P:0.01718 F:0.02347
46 ROUGE-4 Eval D0736-A.M.100.H-H.46 R:0.04528 P:0.02062 F:0.02834
46 ROUGE-4 Eval D0736-A.M.100.H-I.46 R:0.04412 P:0.02062 F:0.02810
46 ROUGE-4 Eval D0736-A.M.100.H-J.46 R:0.01684 P:0.00859 F:0.01138
46 ROUGE-4 Eval D0736-B.M.100.H-G.46 R:0.01581 P:0.00789 F:0.01053
46 ROUGE-4 Eval D0736-B.M.100.H-H.46 R:0.09871 P:0.04536 F:0.06216
46 ROUGE-4 Eval D0736-B.M.100.H-I.46 R:0.10870 P:0.04931 F:0.06784
46 ROUGE-4 Eval D0736-B.M.100.H-J.46 R:0.09386 P:0.05128 F:0.06632
46 ROUGE-4 Eval D0736-C.M.100.H-G.46 R:0.05263 P:0.02339 F:0.03239
46 ROUGE-4 Eval D0736-C.M.100.H-H.46 R:0.03371 P:0.01170 F:0.01737
46 ROUGE-4 Eval D0736-C.M.100.H-I.46 R:0.06742 P:0.02339 F:0.03473
46 ROUGE-4 Eval D0736-C.M.100.H-J.46 R:0.05859 P:0.02924 F:0.03901
46 ROUGE-4 Eval D0740-A.M.100.I-D.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0740-A.M.100.I-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0740-A.M.100.I-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0740-A.M.100.I-J.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0740-B.M.100.I-D.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0740-B.M.100.I-H.46 R:0.00341 P:0.00175 F:0.00231
46 ROUGE-4 Eval D0740-B.M.100.I-I.46 R:0.00338 P:0.00175 F:0.00231
46 ROUGE-4 Eval D0740-B.M.100.I-J.46 R:0.00333 P:0.00175 F:0.00229
46 ROUGE-4 Eval D0740-C.M.100.I-D.46 R:0.04605 P:0.02761 F:0.03452
46 ROUGE-4 Eval D0740-C.M.100.I-H.46 R:0.02980 P:0.01775 F:0.02225
46 ROUGE-4 Eval D0740-C.M.100.I-I.46 R:0.03289 P:0.01972 F:0.02466
46 ROUGE-4 Eval D0740-C.M.100.I-J.46 R:0.03934 P:0.02367 F:0.02956
46 ROUGE-4 Eval D0743-A.M.100.J-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-A.M.100.J-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-A.M.100.J-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-A.M.100.J-J.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-B.M.100.J-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-B.M.100.J-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-B.M.100.J-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-B.M.100.J-J.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-C.M.100.J-B.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-C.M.100.J-H.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-C.M.100.J-I.46 R:0.00000 P:0.00000 F:0.00000
46 ROUGE-4 Eval D0743-C.M.100.J-J.46 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
46 ROUGE-L Average_R: 0.32316 (95%-conf.int. 0.31244 - 0.33376)
46 ROUGE-L Average_P: 0.17931 (95%-conf.int. 0.17298 - 0.18578)
46 ROUGE-L Average_F: 0.22988 (95%-conf.int. 0.22222 - 0.23763)
.............................................
46 ROUGE-L Eval D0703-A.M.100.A-A.46 R:0.32432 P:0.21477 F:0.25841
46 ROUGE-L Eval D0703-A.M.100.A-C.46 R:0.27181 P:0.18121 F:0.21745
46 ROUGE-L Eval D0703-A.M.100.A-D.46 R:0.31959 P:0.20805 F:0.25203
46 ROUGE-L Eval D0703-A.M.100.A-J.46 R:0.32653 P:0.21477 F:0.25911
46 ROUGE-L Eval D0703-B.M.100.A-A.46 R:0.46078 P:0.25543 F:0.32867
46 ROUGE-L Eval D0703-B.M.100.A-C.46 R:0.41611 P:0.22464 F:0.29177
46 ROUGE-L Eval D0703-B.M.100.A-D.46 R:0.42953 P:0.23188 F:0.30117
46 ROUGE-L Eval D0703-B.M.100.A-J.46 R:0.48837 P:0.26630 F:0.34466
46 ROUGE-L Eval D0703-C.M.100.A-A.46 R:0.37333 P:0.18211 F:0.24480
46 ROUGE-L Eval D0703-C.M.100.A-C.46 R:0.35390 P:0.17724 F:0.23619
46 ROUGE-L Eval D0703-C.M.100.A-D.46 R:0.35099 P:0.17236 F:0.23119
46 ROUGE-L Eval D0703-C.M.100.A-J.46 R:0.37748 P:0.18537 F:0.24864
46 ROUGE-L Eval D0706-A.M.100.B-B.46 R:0.34091 P:0.17073 F:0.22752
46 ROUGE-L Eval D0706-A.M.100.B-D.46 R:0.31373 P:0.15610 F:0.20847
46 ROUGE-L Eval D0706-A.M.100.B-E.46 R:0.30519 P:0.15285 F:0.20369
46 ROUGE-L Eval D0706-A.M.100.B-I.46 R:0.33766 P:0.16911 F:0.22536
46 ROUGE-L Eval D0706-B.M.100.B-B.46 R:0.19935 P:0.11111 F:0.14269
46 ROUGE-L Eval D0706-B.M.100.B-D.46 R:0.20195 P:0.11293 F:0.14486
46 ROUGE-L Eval D0706-B.M.100.B-E.46 R:0.21104 P:0.11840 F:0.15169
46 ROUGE-L Eval D0706-B.M.100.B-I.46 R:0.21683 P:0.12204 F:0.15618
46 ROUGE-L Eval D0706-C.M.100.B-B.46 R:0.30000 P:0.17919 F:0.22437
46 ROUGE-L Eval D0706-C.M.100.B-D.46 R:0.33871 P:0.20231 F:0.25332
46 ROUGE-L Eval D0706-C.M.100.B-E.46 R:0.30769 P:0.18497 F:0.23105
46 ROUGE-L Eval D0706-C.M.100.B-I.46 R:0.31629 P:0.19075 F:0.23798
46 ROUGE-L Eval D0711-A.M.100.C-A.46 R:0.28947 P:0.16762 F:0.21230
46 ROUGE-L Eval D0711-A.M.100.C-B.46 R:0.30333 P:0.17333 F:0.22060
46 ROUGE-L Eval D0711-A.M.100.C-C.46 R:0.28667 P:0.16381 F:0.20849
46 ROUGE-L Eval D0711-A.M.100.C-F.46 R:0.30464 P:0.17524 F:0.22249
46 ROUGE-L Eval D0711-B.M.100.C-A.46 R:0.28231 P:0.16179 F:0.20570
46 ROUGE-L Eval D0711-B.M.100.C-B.46 R:0.28767 P:0.16374 F:0.20869
46 ROUGE-L Eval D0711-B.M.100.C-C.46 R:0.27517 P:0.15984 F:0.20222
46 ROUGE-L Eval D0711-B.M.100.C-F.46 R:0.30508 P:0.17544 F:0.22277
46 ROUGE-L Eval D0711-C.M.100.C-A.46 R:0.36304 P:0.19928 F:0.25731
46 ROUGE-L Eval D0711-C.M.100.C-B.46 R:0.35836 P:0.19022 F:0.24852
46 ROUGE-L Eval D0711-C.M.100.C-C.46 R:0.39527 P:0.21196 F:0.27595
46 ROUGE-L Eval D0711-C.M.100.C-F.46 R:0.39865 P:0.21377 F:0.27830
46 ROUGE-L Eval D0716-A.M.100.D-C.46 R:0.40328 P:0.23837 F:0.29963
46 ROUGE-L Eval D0716-A.M.100.D-D.46 R:0.43000 P:0.25000 F:0.31618
46 ROUGE-L Eval D0716-A.M.100.D-E.46 R:0.44186 P:0.25775 F:0.32558
46 ROUGE-L Eval D0716-A.M.100.D-F.46 R:0.41254 P:0.24225 F:0.30525
46 ROUGE-L Eval D0716-B.M.100.D-C.46 R:0.37500 P:0.17925 F:0.24256
46 ROUGE-L Eval D0716-B.M.100.D-D.46 R:0.39597 P:0.18553 F:0.25267
46 ROUGE-L Eval D0716-B.M.100.D-E.46 R:0.37542 P:0.17767 F:0.24119
46 ROUGE-L Eval D0716-B.M.100.D-F.46 R:0.37000 P:0.17453 F:0.23718
46 ROUGE-L Eval D0716-C.M.100.D-C.46 R:0.36156 P:0.22981 F:0.28101
46 ROUGE-L Eval D0716-C.M.100.D-D.46 R:0.33110 P:0.20497 F:0.25320
46 ROUGE-L Eval D0716-C.M.100.D-E.46 R:0.41254 P:0.25880 F:0.31807
46 ROUGE-L Eval D0716-C.M.100.D-F.46 R:0.37333 P:0.23188 F:0.28608
46 ROUGE-L Eval D0721-A.M.100.E-B.46 R:0.27333 P:0.15709 F:0.19951
46 ROUGE-L Eval D0721-A.M.100.E-C.46 R:0.27922 P:0.16475 F:0.20723
46 ROUGE-L Eval D0721-A.M.100.E-E.46 R:0.26623 P:0.15709 F:0.19759
46 ROUGE-L Eval D0721-A.M.100.E-G.46 R:0.26433 P:0.15900 F:0.19856
46 ROUGE-L Eval D0721-B.M.100.E-B.46 R:0.33876 P:0.19153 F:0.24471
46 ROUGE-L Eval D0721-B.M.100.E-C.46 R:0.34076 P:0.19705 F:0.24970
46 ROUGE-L Eval D0721-B.M.100.E-E.46 R:0.32787 P:0.18416 F:0.23585
46 ROUGE-L Eval D0721-B.M.100.E-G.46 R:0.31290 P:0.17864 F:0.22743
46 ROUGE-L Eval D0721-C.M.100.E-B.46 R:0.32787 P:0.20704 F:0.25381
46 ROUGE-L Eval D0721-C.M.100.E-C.46 R:0.28713 P:0.18012 F:0.22137
46 ROUGE-L Eval D0721-C.M.100.E-E.46 R:0.27667 P:0.17184 F:0.21200
46 ROUGE-L Eval D0721-C.M.100.E-G.46 R:0.28339 P:0.18012 F:0.22025
46 ROUGE-L Eval D0726-A.M.100.F-A.46 R:0.37874 P:0.23602 F:0.29081
46 ROUGE-L Eval D0726-A.M.100.F-E.46 R:0.35333 P:0.21946 F:0.27075
46 ROUGE-L Eval D0726-A.M.100.F-F.46 R:0.37542 P:0.23395 F:0.28826
46 ROUGE-L Eval D0726-A.M.100.F-G.46 R:0.36877 P:0.22981 F:0.28316
46 ROUGE-L Eval D0726-B.M.100.F-A.46 R:0.35294 P:0.20455 F:0.25900
46 ROUGE-L Eval D0726-B.M.100.F-E.46 R:0.34884 P:0.19886 F:0.25332
46 ROUGE-L Eval D0726-B.M.100.F-F.46 R:0.33223 P:0.18939 F:0.24125
46 ROUGE-L Eval D0726-B.M.100.F-G.46 R:0.33224 P:0.19129 F:0.24279
46 ROUGE-L Eval D0726-C.M.100.F-A.46 R:0.33000 P:0.24265 F:0.27966
46 ROUGE-L Eval D0726-C.M.100.F-E.46 R:0.30976 P:0.22549 F:0.26099
46 ROUGE-L Eval D0726-C.M.100.F-F.46 R:0.30847 P:0.22304 F:0.25889
46 ROUGE-L Eval D0726-C.M.100.F-G.46 R:0.28525 P:0.21324 F:0.24404
46 ROUGE-L Eval D0727-A.M.100.G-A.46 R:0.37209 P:0.17527 F:0.23829
46 ROUGE-L Eval D0727-A.M.100.G-F.46 R:0.36513 P:0.17371 F:0.23542
46 ROUGE-L Eval D0727-A.M.100.G-G.46 R:0.34641 P:0.16588 F:0.22434
46 ROUGE-L Eval D0727-A.M.100.G-H.46 R:0.36842 P:0.17527 F:0.23754
46 ROUGE-L Eval D0727-B.M.100.G-A.46 R:0.32990 P:0.16410 F:0.21918
46 ROUGE-L Eval D0727-B.M.100.G-F.46 R:0.32143 P:0.16923 F:0.22172
46 ROUGE-L Eval D0727-B.M.100.G-G.46 R:0.28374 P:0.14017 F:0.18764
46 ROUGE-L Eval D0727-B.M.100.G-H.46 R:0.28522 P:0.14188 F:0.18950
46 ROUGE-L Eval D0727-C.M.100.G-A.46 R:0.31596 P:0.17384 F:0.22428
46 ROUGE-L Eval D0727-C.M.100.G-F.46 R:0.31313 P:0.16667 F:0.21755
46 ROUGE-L Eval D0727-C.M.100.G-G.46 R:0.31353 P:0.17025 F:0.22067
46 ROUGE-L Eval D0727-C.M.100.G-H.46 R:0.31419 P:0.16667 F:0.21780
46 ROUGE-L Eval D0736-A.M.100.H-G.46 R:0.30108 P:0.14213 F:0.19310
46 ROUGE-L Eval D0736-A.M.100.H-H.46 R:0.33577 P:0.15567 F:0.21272
46 ROUGE-L Eval D0736-A.M.100.H-I.46 R:0.32028 P:0.15228 F:0.20642
46 ROUGE-L Eval D0736-A.M.100.H-J.46 R:0.31699 P:0.16413 F:0.21628
46 ROUGE-L Eval D0736-B.M.100.H-G.46 R:0.33206 P:0.16860 F:0.22365
46 ROUGE-L Eval D0736-B.M.100.H-H.46 R:0.40496 P:0.18992 F:0.25857
46 ROUGE-L Eval D0736-B.M.100.H-I.46 R:0.41423 P:0.19186 F:0.26225
46 ROUGE-L Eval D0736-B.M.100.H-J.46 R:0.41259 P:0.22868 F:0.29426
46 ROUGE-L Eval D0736-C.M.100.H-G.46 R:0.37131 P:0.16858 F:0.23188
46 ROUGE-L Eval D0736-C.M.100.H-H.46 R:0.31551 P:0.11303 F:0.16644
46 ROUGE-L Eval D0736-C.M.100.H-I.46 R:0.43316 P:0.15517 F:0.22849
46 ROUGE-L Eval D0736-C.M.100.H-J.46 R:0.38491 P:0.19540 F:0.25921
46 ROUGE-L Eval D0740-A.M.100.I-D.46 R:0.28713 P:0.16860 F:0.21245
46 ROUGE-L Eval D0740-A.M.100.I-H.46 R:0.28758 P:0.17054 F:0.21411
46 ROUGE-L Eval D0740-A.M.100.I-I.46 R:0.29545 P:0.17636 F:0.22088
46 ROUGE-L Eval D0740-A.M.100.I-J.46 R:0.27419 P:0.16473 F:0.20581
46 ROUGE-L Eval D0740-B.M.100.I-D.46 R:0.21753 P:0.11512 F:0.15056
46 ROUGE-L Eval D0740-B.M.100.I-H.46 R:0.21854 P:0.11340 F:0.14932
46 ROUGE-L Eval D0740-B.M.100.I-I.46 R:0.24262 P:0.12715 F:0.16686
46 ROUGE-L Eval D0740-B.M.100.I-J.46 R:0.22330 P:0.11856 F:0.15488
46 ROUGE-L Eval D0740-C.M.100.I-D.46 R:0.35463 P:0.21512 F:0.26779
46 ROUGE-L Eval D0740-C.M.100.I-H.46 R:0.34084 P:0.20543 F:0.25635
46 ROUGE-L Eval D0740-C.M.100.I-I.46 R:0.34824 P:0.21124 F:0.26297
46 ROUGE-L Eval D0740-C.M.100.I-J.46 R:0.35669 P:0.21705 F:0.26988
46 ROUGE-L Eval D0743-A.M.100.J-B.46 R:0.21587 P:0.10592 F:0.14211
46 ROUGE-L Eval D0743-A.M.100.J-H.46 R:0.21296 P:0.10748 F:0.14286
46 ROUGE-L Eval D0743-A.M.100.J-I.46 R:0.22187 P:0.11059 F:0.14761
46 ROUGE-L Eval D0743-A.M.100.J-J.46 R:0.20923 P:0.10592 F:0.14064
46 ROUGE-L Eval D0743-B.M.100.J-B.46 R:0.25000 P:0.13978 F:0.17931
46 ROUGE-L Eval D0743-B.M.100.J-H.46 R:0.23028 P:0.13082 F:0.16685
46 ROUGE-L Eval D0743-B.M.100.J-I.46 R:0.23734 P:0.13441 F:0.17163
46 ROUGE-L Eval D0743-B.M.100.J-J.46 R:0.23988 P:0.13799 F:0.17520
46 ROUGE-L Eval D0743-C.M.100.J-B.46 R:0.27937 P:0.14890 F:0.19426
46 ROUGE-L Eval D0743-C.M.100.J-H.46 R:0.27389 P:0.14552 F:0.19006
46 ROUGE-L Eval D0743-C.M.100.J-I.46 R:0.29073 P:0.15398 F:0.20133
46 ROUGE-L Eval D0743-C.M.100.J-J.46 R:0.27044 P:0.14552 F:0.18922
---------------------------------------------
46 ROUGE-W-1.2 Average_R: 0.11399 (95%-conf.int. 0.10993 - 0.11811)
46 ROUGE-W-1.2 Average_P: 0.11481 (95%-conf.int. 0.11053 - 0.11924)
46 ROUGE-W-1.2 Average_F: 0.11392 (95%-conf.int. 0.11003 - 0.11790)
.............................................
46 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.46 R:0.11354 P:0.13538 F:0.12350
46 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.46 R:0.09357 P:0.11338 F:0.10253
46 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.46 R:0.11586 P:0.13905 F:0.12640
46 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.46 R:0.12231 P:0.13761 F:0.12951
46 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.46 R:0.16185 P:0.16636 F:0.16407
46 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.46 R:0.13998 P:0.14300 F:0.14147
46 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.46 R:0.14895 P:0.15083 F:0.14988
46 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.46 R:0.17043 P:0.17237 F:0.17139
46 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.46 R:0.12710 P:0.11527 F:0.12090
46 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.46 R:0.11803 P:0.11161 F:0.11473
46 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.46 R:0.11581 P:0.10794 F:0.11174
46 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.46 R:0.13086 P:0.11573 F:0.12283
46 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.46 R:0.11703 P:0.10518 F:0.11079
46 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.46 R:0.10757 P:0.09821 F:0.10268
46 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.46 R:0.10205 P:0.09268 F:0.09714
46 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.46 R:0.11333 P:0.10517 F:0.10910
46 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.46 R:0.07303 P:0.07050 F:0.07174
46 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.46 R:0.07300 P:0.07199 F:0.07249
46 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.46 R:0.07626 P:0.07552 F:0.07589
46 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.46 R:0.07594 P:0.07729 F:0.07661
46 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.46 R:0.11510 P:0.11734 F:0.11621
46 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.46 R:0.11738 P:0.12070 F:0.11902
46 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.46 R:0.10178 P:0.10364 F:0.10270
46 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.46 R:0.11164 P:0.11693 F:0.11422
46 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.46 R:0.09995 P:0.10435 F:0.10210
46 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.46 R:0.10425 P:0.10790 F:0.10604
46 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.46 R:0.09893 P:0.10151 F:0.10020
46 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.46 R:0.10544 P:0.11003 F:0.10769
46 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.46 R:0.09531 P:0.09746 F:0.09637
46 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.46 R:0.09256 P:0.09874 F:0.09555
46 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.46 R:0.08840 P:0.09646 F:0.09225
46 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.46 R:0.09958 P:0.10635 F:0.10285
46 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.46 R:0.12250 P:0.12571 F:0.12408
46 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.46 R:0.12321 P:0.12229 F:0.12275
46 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.46 R:0.13578 P:0.13825 F:0.13700
46 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.46 R:0.13805 P:0.14267 F:0.14032
46 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.46 R:0.14737 P:0.15914 F:0.15303
46 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.46 R:0.15319 P:0.16968 F:0.16101
46 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.46 R:0.15768 P:0.17177 F:0.16442
46 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.46 R:0.14083 P:0.15727 F:0.14860
46 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.46 R:0.13812 P:0.11517 F:0.12561
46 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.46 R:0.14000 P:0.11739 F:0.12770
46 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.46 R:0.13413 P:0.11301 F:0.12267
46 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.46 R:0.13447 P:0.11227 F:0.12237
46 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.46 R:0.12437 P:0.14734 F:0.13488
46 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.46 R:0.10788 P:0.12951 F:0.11771
46 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.46 R:0.13574 P:0.16503 F:0.14896
46 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.46 R:0.12414 P:0.14999 F:0.13585
46 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.46 R:0.10378 P:0.10483 F:0.10430
46 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.46 R:0.10362 P:0.10847 F:0.10599
46 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.46 R:0.09729 P:0.10312 F:0.10012
46 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.46 R:0.09992 P:0.10533 F:0.10255
46 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.46 R:0.10908 P:0.11922 F:0.11392
46 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.46 R:0.11284 P:0.12264 F:0.11754
46 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.46 R:0.10361 P:0.11423 F:0.10866
46 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.46 R:0.09629 P:0.10971 F:0.10256
46 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.46 R:0.11467 P:0.13327 F:0.12327
46 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.46 R:0.10042 P:0.11853 F:0.10873
46 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.46 R:0.09559 P:0.11082 F:0.10264
46 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.46 R:0.09831 P:0.11686 F:0.10679
46 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.46 R:0.14418 P:0.15923 F:0.15133
46 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.46 R:0.13904 P:0.15129 F:0.14491
46 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.46 R:0.15164 P:0.16832 F:0.15955
46 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.46 R:0.13533 P:0.15266 F:0.14347
46 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.46 R:0.12989 P:0.13241 F:0.13114
46 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.46 R:0.12339 P:0.12698 F:0.12516
46 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.46 R:0.11578 P:0.11991 F:0.11781
46 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.46 R:0.11751 P:0.12217 F:0.11979
46 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.46 R:0.11618 P:0.15001 F:0.13095
46 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.46 R:0.10833 P:0.13917 F:0.12183
46 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.46 R:0.10781 P:0.13959 F:0.12166
46 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.46 R:0.09923 P:0.13282 F:0.11359
46 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.46 R:0.13194 P:0.10939 F:0.11961
46 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.46 R:0.12942 P:0.11238 F:0.12030
46 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.46 R:0.12073 P:0.10239 F:0.11081
46 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.46 R:0.13251 P:0.11300 F:0.12198
46 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.46 R:0.11597 P:0.10122 F:0.10809
46 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.46 R:0.11060 P:0.10460 F:0.10752
46 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.46 R:0.09867 P:0.08731 F:0.09264
46 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.46 R:0.10078 P:0.08874 F:0.09438
46 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.46 R:0.10901 P:0.10786 F:0.10843
46 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.46 R:0.10489 P:0.10318 F:0.10403
46 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.46 R:0.10402 P:0.10397 F:0.10399
46 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.46 R:0.10566 P:0.10088 F:0.10321
46 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.46 R:0.11398 P:0.09529 F:0.10380
46 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.46 R:0.12682 P:0.10340 F:0.11392
46 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.46 R:0.11959 P:0.10160 F:0.10986
46 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.46 R:0.11391 P:0.10514 F:0.10935
46 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.46 R:0.11734 P:0.11028 F:0.11370
46 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.46 R:0.15691 P:0.13615 F:0.14579
46 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.46 R:0.16394 P:0.14025 F:0.15117
46 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.46 R:0.15479 P:0.15860 F:0.15667
46 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.46 R:0.14354 P:0.11839 F:0.12976
46 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.46 R:0.12134 P:0.08125 F:0.09733
46 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.46 R:0.17233 P:0.11262 F:0.13622
46 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.46 R:0.14933 P:0.13526 F:0.14195
46 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.46 R:0.09452 P:0.10209 F:0.09816
46 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.46 R:0.09860 P:0.10548 F:0.10192
46 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.46 R:0.09552 P:0.10546 F:0.10024
46 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.46 R:0.09049 P:0.09987 F:0.09495
46 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.46 R:0.07533 P:0.07325 F:0.07428
46 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.46 R:0.07908 P:0.07303 F:0.07593
46 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.46 R:0.08156 P:0.08032 F:0.08094
46 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.46 R:0.07958 P:0.07554 F:0.07751
46 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.46 R:0.11923 P:0.13957 F:0.12860
46 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.46 R:0.11832 P:0.13309 F:0.12527
46 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.46 R:0.11603 P:0.13764 F:0.12591
46 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.46 R:0.12004 P:0.13997 F:0.12924
46 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.46 R:0.07489 P:0.06405 F:0.06905
46 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.46 R:0.07422 P:0.06470 F:0.06913
46 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.46 R:0.07450 P:0.06589 F:0.06993
46 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.46 R:0.07501 P:0.06592 F:0.07017
46 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.46 R:0.09558 P:0.08950 F:0.09244
46 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.46 R:0.08978 P:0.08459 F:0.08711
46 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.46 R:0.08965 P:0.08556 F:0.08756
46 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.46 R:0.09381 P:0.08873 F:0.09120
46 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.46 R:0.09892 P:0.09229 F:0.09549
46 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.46 R:0.10087 P:0.08950 F:0.09485
46 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.46 R:0.10305 P:0.09726 F:0.10007
46 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.46 R:0.09614 P:0.08707 F:0.09138
---------------------------------------------
46 ROUGE-SU4 Average_R: 0.13156 (95%-conf.int. 0.12384 - 0.14014)
46 ROUGE-SU4 Average_P: 0.07231 (95%-conf.int. 0.06780 - 0.07731)
46 ROUGE-SU4 Average_F: 0.09301 (95%-conf.int. 0.08748 - 0.09932)
.............................................
46 ROUGE-SU4 Eval D0703-A.M.100.A-A.46 R:0.14120 P:0.09263 F:0.11187
46 ROUGE-SU4 Eval D0703-A.M.100.A-C.46 R:0.11034 P:0.07289 F:0.08779
46 ROUGE-SU4 Eval D0703-A.M.100.A-D.46 R:0.13899 P:0.08960 F:0.10896
46 ROUGE-SU4 Eval D0703-A.M.100.A-J.46 R:0.13811 P:0.08998 F:0.10897
46 ROUGE-SU4 Eval D0703-B.M.100.A-A.46 R:0.26678 P:0.14614 F:0.18884
46 ROUGE-SU4 Eval D0703-B.M.100.A-C.46 R:0.20172 P:0.10754 F:0.14029
46 ROUGE-SU4 Eval D0703-B.M.100.A-D.46 R:0.22586 P:0.12040 F:0.15707
46 ROUGE-SU4 Eval D0703-B.M.100.A-J.46 R:0.27816 P:0.14982 F:0.19475
46 ROUGE-SU4 Eval D0703-C.M.100.A-A.46 R:0.15639 P:0.07523 F:0.10159
46 ROUGE-SU4 Eval D0703-C.M.100.A-C.46 R:0.15389 P:0.07606 F:0.10180
46 ROUGE-SU4 Eval D0703-C.M.100.A-D.46 R:0.14456 P:0.07002 F:0.09434
46 ROUGE-SU4 Eval D0703-C.M.100.A-J.46 R:0.16213 P:0.07853 F:0.10581
46 ROUGE-SU4 Eval D0706-A.M.100.B-B.46 R:0.12500 P:0.06178 F:0.08269
46 ROUGE-SU4 Eval D0706-A.M.100.B-D.46 R:0.11298 P:0.05546 F:0.07440
46 ROUGE-SU4 Eval D0706-A.M.100.B-E.46 R:0.09667 P:0.04778 F:0.06395
46 ROUGE-SU4 Eval D0706-A.M.100.B-I.46 R:0.12111 P:0.05986 F:0.08012
46 ROUGE-SU4 Eval D0706-B.M.100.B-B.46 R:0.06096 P:0.03358 F:0.04331
46 ROUGE-SU4 Eval D0706-B.M.100.B-D.46 R:0.06522 P:0.03604 F:0.04643
46 ROUGE-SU4 Eval D0706-B.M.100.B-E.46 R:0.06556 P:0.03635 F:0.04677
46 ROUGE-SU4 Eval D0706-B.M.100.B-I.46 R:0.07032 P:0.03913 F:0.05028
46 ROUGE-SU4 Eval D0706-C.M.100.B-B.46 R:0.13576 P:0.08023 F:0.10086
46 ROUGE-SU4 Eval D0706-C.M.100.B-D.46 R:0.15673 P:0.09263 F:0.11644
46 ROUGE-SU4 Eval D0706-C.M.100.B-E.46 R:0.12281 P:0.07306 F:0.09162
46 ROUGE-SU4 Eval D0706-C.M.100.B-I.46 R:0.15191 P:0.09067 F:0.11356
46 ROUGE-SU4 Eval D0711-A.M.100.C-A.46 R:0.10248 P:0.05867 F:0.07462
46 ROUGE-SU4 Eval D0711-A.M.100.C-B.46 R:0.10388 P:0.05867 F:0.07499
46 ROUGE-SU4 Eval D0711-A.M.100.C-C.46 R:0.10331 P:0.05835 F:0.07458
46 ROUGE-SU4 Eval D0711-A.M.100.C-F.46 R:0.11111 P:0.06319 F:0.08056
46 ROUGE-SU4 Eval D0711-B.M.100.C-A.46 R:0.09207 P:0.05215 F:0.06659
46 ROUGE-SU4 Eval D0711-B.M.100.C-B.46 R:0.09742 P:0.05479 F:0.07014
46 ROUGE-SU4 Eval D0711-B.M.100.C-C.46 R:0.09195 P:0.05281 F:0.06709
46 ROUGE-SU4 Eval D0711-B.M.100.C-F.46 R:0.10221 P:0.05809 F:0.07408
46 ROUGE-SU4 Eval D0711-C.M.100.C-A.46 R:0.15424 P:0.08364 F:0.10846
46 ROUGE-SU4 Eval D0711-C.M.100.C-B.46 R:0.16023 P:0.08395 F:0.11018
46 ROUGE-SU4 Eval D0711-C.M.100.C-C.46 R:0.18519 P:0.09804 F:0.12821
46 ROUGE-SU4 Eval D0711-C.M.100.C-F.46 R:0.19444 P:0.10294 F:0.13461
46 ROUGE-SU4 Eval D0716-A.M.100.D-C.46 R:0.22222 P:0.12992 F:0.16397
46 ROUGE-SU4 Eval D0716-A.M.100.D-D.46 R:0.24087 P:0.13845 F:0.17583
46 ROUGE-SU4 Eval D0716-A.M.100.D-E.46 R:0.23436 P:0.13517 F:0.17145
46 ROUGE-SU4 Eval D0716-A.M.100.D-F.46 R:0.21695 P:0.12598 F:0.15940
46 ROUGE-SU4 Eval D0716-B.M.100.D-C.46 R:0.15766 P:0.07431 F:0.10101
46 ROUGE-SU4 Eval D0716-B.M.100.D-D.46 R:0.17414 P:0.08041 F:0.11002
46 ROUGE-SU4 Eval D0716-B.M.100.D-E.46 R:0.15358 P:0.07166 F:0.09772
46 ROUGE-SU4 Eval D0716-B.M.100.D-F.46 R:0.15696 P:0.07298 F:0.09963
46 ROUGE-SU4 Eval D0716-C.M.100.D-C.46 R:0.15775 P:0.09930 F:0.12188
46 ROUGE-SU4 Eval D0716-C.M.100.D-D.46 R:0.13631 P:0.08351 F:0.10357
46 ROUGE-SU4 Eval D0716-C.M.100.D-E.46 R:0.17684 P:0.10982 F:0.13550
46 ROUGE-SU4 Eval D0716-C.M.100.D-F.46 R:0.15411 P:0.09474 F:0.11734
46 ROUGE-SU4 Eval D0721-A.M.100.E-B.46 R:0.08790 P:0.04994 F:0.06369
46 ROUGE-SU4 Eval D0721-A.M.100.E-C.46 R:0.09389 P:0.05480 F:0.06921
46 ROUGE-SU4 Eval D0721-A.M.100.E-E.46 R:0.08333 P:0.04864 F:0.06143
46 ROUGE-SU4 Eval D0721-A.M.100.E-G.46 R:0.08878 P:0.05285 F:0.06626
46 ROUGE-SU4 Eval D0721-B.M.100.E-B.46 R:0.15496 P:0.08660 F:0.11111
46 ROUGE-SU4 Eval D0721-B.M.100.E-C.46 R:0.13072 P:0.07477 F:0.09513
46 ROUGE-SU4 Eval D0721-B.M.100.E-E.46 R:0.15208 P:0.08442 F:0.10857
46 ROUGE-SU4 Eval D0721-B.M.100.E-G.46 R:0.14073 P:0.07944 F:0.10155
46 ROUGE-SU4 Eval D0721-C.M.100.E-B.46 R:0.15039 P:0.09404 F:0.11572
46 ROUGE-SU4 Eval D0721-C.M.100.E-C.46 R:0.12994 P:0.08070 F:0.09956
46 ROUGE-SU4 Eval D0721-C.M.100.E-E.46 R:0.11701 P:0.07193 F:0.08909
46 ROUGE-SU4 Eval D0721-C.M.100.E-G.46 R:0.11817 P:0.07439 F:0.09130
46 ROUGE-SU4 Eval D0726-A.M.100.F-A.46 R:0.21160 P:0.13053 F:0.16146
46 ROUGE-SU4 Eval D0726-A.M.100.F-E.46 R:0.17751 P:0.10912 F:0.13516
46 ROUGE-SU4 Eval D0726-A.M.100.F-F.46 R:0.20819 P:0.12842 F:0.15885
46 ROUGE-SU4 Eval D0726-A.M.100.F-G.46 R:0.19340 P:0.11930 F:0.14757
46 ROUGE-SU4 Eval D0726-B.M.100.F-A.46 R:0.14541 P:0.08333 F:0.10595
46 ROUGE-SU4 Eval D0726-B.M.100.F-E.46 R:0.13140 P:0.07404 F:0.09471
46 ROUGE-SU4 Eval D0726-B.M.100.F-F.46 R:0.13595 P:0.07660 F:0.09799
46 ROUGE-SU4 Eval D0726-B.M.100.F-G.46 R:0.13457 P:0.07660 F:0.09763
46 ROUGE-SU4 Eval D0726-C.M.100.F-A.46 R:0.12100 P:0.08833 F:0.10212
46 ROUGE-SU4 Eval D0726-C.M.100.F-E.46 R:0.11073 P:0.08000 F:0.09289
46 ROUGE-SU4 Eval D0726-C.M.100.F-F.46 R:0.11382 P:0.08167 F:0.09510
46 ROUGE-SU4 Eval D0726-C.M.100.F-G.46 R:0.10101 P:0.07500 F:0.08608
46 ROUGE-SU4 Eval D0727-A.M.100.G-A.46 R:0.11945 P:0.05547 F:0.07576
46 ROUGE-SU4 Eval D0727-A.M.100.G-F.46 R:0.12500 P:0.05864 F:0.07983
46 ROUGE-SU4 Eval D0727-A.M.100.G-G.46 R:0.10515 P:0.04966 F:0.06746
46 ROUGE-SU4 Eval D0727-A.M.100.G-H.46 R:0.12556 P:0.05890 F:0.08019
46 ROUGE-SU4 Eval D0727-B.M.100.G-A.46 R:0.10247 P:0.05026 F:0.06744
46 ROUGE-SU4 Eval D0727-B.M.100.G-F.46 R:0.10500 P:0.05459 F:0.07183
46 ROUGE-SU4 Eval D0727-B.M.100.G-G.46 R:0.08956 P:0.04362 F:0.05867
46 ROUGE-SU4 Eval D0727-B.M.100.G-H.46 R:0.09482 P:0.04650 F:0.06240
46 ROUGE-SU4 Eval D0727-C.M.100.G-A.46 R:0.10033 P:0.05455 F:0.07067
46 ROUGE-SU4 Eval D0727-C.M.100.G-F.46 R:0.09977 P:0.05242 F:0.06873
46 ROUGE-SU4 Eval D0727-C.M.100.G-G.46 R:0.10000 P:0.05364 F:0.06983
46 ROUGE-SU4 Eval D0727-C.M.100.G-H.46 R:0.09433 P:0.04939 F:0.06483
46 ROUGE-SU4 Eval D0736-A.M.100.H-G.46 R:0.11747 P:0.05460 F:0.07455
46 ROUGE-SU4 Eval D0736-A.M.100.H-H.46 R:0.14536 P:0.06632 F:0.09108
46 ROUGE-SU4 Eval D0736-A.M.100.H-I.46 R:0.13858 P:0.06489 F:0.08839
46 ROUGE-SU4 Eval D0736-A.M.100.H-J.46 R:0.12136 P:0.06204 F:0.08211
46 ROUGE-SU4 Eval D0736-B.M.100.H-G.46 R:0.12270 P:0.06135 F:0.08180
46 ROUGE-SU4 Eval D0736-B.M.100.H-H.46 R:0.20442 P:0.09416 F:0.12893
46 ROUGE-SU4 Eval D0736-B.M.100.H-I.46 R:0.21140 P:0.09613 F:0.13216
46 ROUGE-SU4 Eval D0736-B.M.100.H-J.46 R:0.20204 P:0.11056 F:0.14291
46 ROUGE-SU4 Eval D0736-C.M.100.H-G.46 R:0.16812 P:0.07490 F:0.10363
46 ROUGE-SU4 Eval D0736-C.M.100.H-H.46 R:0.12011 P:0.04183 F:0.06205
46 ROUGE-SU4 Eval D0736-C.M.100.H-I.46 R:0.19832 P:0.06907 F:0.10246
46 ROUGE-SU4 Eval D0736-C.M.100.H-J.46 R:0.17121 P:0.08560 F:0.11414
46 ROUGE-SU4 Eval D0740-A.M.100.I-D.46 R:0.09944 P:0.05774 F:0.07306
46 ROUGE-SU4 Eval D0740-A.M.100.I-H.46 R:0.09676 P:0.05676 F:0.07155
46 ROUGE-SU4 Eval D0740-A.M.100.I-I.46 R:0.10389 P:0.06135 F:0.07714
46 ROUGE-SU4 Eval D0740-A.M.100.I-J.46 R:0.09161 P:0.05446 F:0.06831
46 ROUGE-SU4 Eval D0740-B.M.100.I-D.46 R:0.07222 P:0.03775 F:0.04958
46 ROUGE-SU4 Eval D0740-B.M.100.I-H.46 R:0.07653 P:0.03920 F:0.05184
46 ROUGE-SU4 Eval D0740-B.M.100.I-I.46 R:0.08923 P:0.04617 F:0.06085
46 ROUGE-SU4 Eval D0740-B.M.100.I-J.46 R:0.08084 P:0.04239 F:0.05562
46 ROUGE-SU4 Eval D0740-C.M.100.I-D.46 R:0.16831 P:0.10105 F:0.12628
46 ROUGE-SU4 Eval D0740-C.M.100.I-H.46 R:0.14136 P:0.08432 F:0.10563
46 ROUGE-SU4 Eval D0740-C.M.100.I-I.46 R:0.16393 P:0.09843 F:0.12300
46 ROUGE-SU4 Eval D0740-C.M.100.I-J.46 R:0.16939 P:0.10203 F:0.12735
46 ROUGE-SU4 Eval D0743-A.M.100.J-B.46 R:0.06243 P:0.03023 F:0.04074
46 ROUGE-SU4 Eval D0743-A.M.100.J-H.46 R:0.06118 P:0.03049 F:0.04070
46 ROUGE-SU4 Eval D0743-A.M.100.J-I.46 R:0.06197 P:0.03049 F:0.04087
46 ROUGE-SU4 Eval D0743-A.M.100.J-J.46 R:0.05731 P:0.02865 F:0.03820
46 ROUGE-SU4 Eval D0743-B.M.100.J-B.46 R:0.07785 P:0.04303 F:0.05542
46 ROUGE-SU4 Eval D0743-B.M.100.J-H.46 R:0.06580 P:0.03697 F:0.04734
46 ROUGE-SU4 Eval D0743-B.M.100.J-I.46 R:0.07576 P:0.04242 F:0.05439
46 ROUGE-SU4 Eval D0743-B.M.100.J-J.46 R:0.07242 P:0.04121 F:0.05253
46 ROUGE-SU4 Eval D0743-C.M.100.J-B.46 R:0.09175 P:0.04831 F:0.06329
46 ROUGE-SU4 Eval D0743-C.M.100.J-H.46 R:0.08388 P:0.04403 F:0.05775
46 ROUGE-SU4 Eval D0743-C.M.100.J-I.46 R:0.09399 P:0.04917 F:0.06456
46 ROUGE-SU4 Eval D0743-C.M.100.J-J.46 R:0.08226 P:0.04374 F:0.05711
---------------------------------------------
47 ROUGE-1 Average_R: 0.36600 (95%-conf.int. 0.35549 - 0.37556)
47 ROUGE-1 Average_P: 0.21970 (95%-conf.int. 0.21304 - 0.22666)
47 ROUGE-1 Average_F: 0.27393 (95%-conf.int. 0.26631 - 0.28166)
.............................................
47 ROUGE-1 Eval D0703-A.M.100.A-A.47 R:0.39527 P:0.23636 F:0.29583
47 ROUGE-1 Eval D0703-A.M.100.A-C.47 R:0.35235 P:0.21212 F:0.26482
47 ROUGE-1 Eval D0703-A.M.100.A-D.47 R:0.36770 P:0.21616 F:0.27226
47 ROUGE-1 Eval D0703-A.M.100.A-J.47 R:0.39116 P:0.23232 F:0.29151
47 ROUGE-1 Eval D0703-B.M.100.A-A.47 R:0.35948 P:0.23965 F:0.28758
47 ROUGE-1 Eval D0703-B.M.100.A-C.47 R:0.39933 P:0.25926 F:0.31440
47 ROUGE-1 Eval D0703-B.M.100.A-D.47 R:0.36913 P:0.23965 F:0.29062
47 ROUGE-1 Eval D0703-B.M.100.A-J.47 R:0.37874 P:0.24837 F:0.30000
47 ROUGE-1 Eval D0703-C.M.100.A-A.47 R:0.41000 P:0.24405 F:0.30597
47 ROUGE-1 Eval D0703-C.M.100.A-C.47 R:0.41883 P:0.25595 F:0.31773
47 ROUGE-1 Eval D0703-C.M.100.A-D.47 R:0.41391 P:0.24802 F:0.31018
47 ROUGE-1 Eval D0703-C.M.100.A-J.47 R:0.43046 P:0.25794 F:0.32258
47 ROUGE-1 Eval D0706-A.M.100.B-B.47 R:0.34740 P:0.19490 F:0.24971
47 ROUGE-1 Eval D0706-A.M.100.B-D.47 R:0.33333 P:0.18579 F:0.23859
47 ROUGE-1 Eval D0706-A.M.100.B-E.47 R:0.27922 P:0.15665 F:0.20070
47 ROUGE-1 Eval D0706-A.M.100.B-I.47 R:0.33766 P:0.18944 F:0.24271
47 ROUGE-1 Eval D0706-B.M.100.B-B.47 R:0.33660 P:0.21458 F:0.26208
47 ROUGE-1 Eval D0706-B.M.100.B-D.47 R:0.29642 P:0.18958 F:0.23126
47 ROUGE-1 Eval D0706-B.M.100.B-E.47 R:0.29221 P:0.18750 F:0.22843
47 ROUGE-1 Eval D0706-B.M.100.B-I.47 R:0.35275 P:0.22708 F:0.27630
47 ROUGE-1 Eval D0706-C.M.100.B-B.47 R:0.38710 P:0.24242 F:0.29813
47 ROUGE-1 Eval D0706-C.M.100.B-D.47 R:0.40968 P:0.25657 F:0.31553
47 ROUGE-1 Eval D0706-C.M.100.B-E.47 R:0.37179 P:0.23434 F:0.28748
47 ROUGE-1 Eval D0706-C.M.100.B-I.47 R:0.40256 P:0.25455 F:0.31189
47 ROUGE-1 Eval D0711-A.M.100.C-A.47 R:0.32895 P:0.18832 F:0.23952
47 ROUGE-1 Eval D0711-A.M.100.C-B.47 R:0.36667 P:0.20716 F:0.26475
47 ROUGE-1 Eval D0711-A.M.100.C-C.47 R:0.34333 P:0.19397 F:0.24789
47 ROUGE-1 Eval D0711-A.M.100.C-F.47 R:0.36424 P:0.20716 F:0.26411
47 ROUGE-1 Eval D0711-B.M.100.C-A.47 R:0.33673 P:0.20625 F:0.25581
47 ROUGE-1 Eval D0711-B.M.100.C-B.47 R:0.32192 P:0.19583 F:0.24352
47 ROUGE-1 Eval D0711-B.M.100.C-C.47 R:0.31208 P:0.19375 F:0.23907
47 ROUGE-1 Eval D0711-B.M.100.C-F.47 R:0.33220 P:0.20417 F:0.25290
47 ROUGE-1 Eval D0711-C.M.100.C-A.47 R:0.41914 P:0.26294 F:0.32315
47 ROUGE-1 Eval D0711-C.M.100.C-B.47 R:0.39932 P:0.24224 F:0.30155
47 ROUGE-1 Eval D0711-C.M.100.C-C.47 R:0.41892 P:0.25673 F:0.31836
47 ROUGE-1 Eval D0711-C.M.100.C-F.47 R:0.39865 P:0.24431 F:0.30296
47 ROUGE-1 Eval D0716-A.M.100.D-C.47 R:0.44918 P:0.26095 F:0.33012
47 ROUGE-1 Eval D0716-A.M.100.D-D.47 R:0.44333 P:0.25333 F:0.32242
47 ROUGE-1 Eval D0716-A.M.100.D-E.47 R:0.46512 P:0.26667 F:0.33899
47 ROUGE-1 Eval D0716-A.M.100.D-F.47 R:0.45875 P:0.26476 F:0.33575
47 ROUGE-1 Eval D0716-B.M.100.D-C.47 R:0.47368 P:0.30000 F:0.36735
47 ROUGE-1 Eval D0716-B.M.100.D-D.47 R:0.48322 P:0.30000 F:0.37018
47 ROUGE-1 Eval D0716-B.M.100.D-E.47 R:0.47176 P:0.29583 F:0.36363
47 ROUGE-1 Eval D0716-B.M.100.D-F.47 R:0.44667 P:0.27917 F:0.34359
47 ROUGE-1 Eval D0716-C.M.100.D-C.47 R:0.42671 P:0.26789 F:0.32914
47 ROUGE-1 Eval D0716-C.M.100.D-D.47 R:0.44816 P:0.27403 F:0.34010
47 ROUGE-1 Eval D0716-C.M.100.D-E.47 R:0.45875 P:0.28425 F:0.35101
47 ROUGE-1 Eval D0716-C.M.100.D-F.47 R:0.46333 P:0.28425 F:0.35234
47 ROUGE-1 Eval D0721-A.M.100.E-B.47 R:0.31000 P:0.19375 F:0.23846
47 ROUGE-1 Eval D0721-A.M.100.E-C.47 R:0.29870 P:0.19167 F:0.23350
47 ROUGE-1 Eval D0721-A.M.100.E-E.47 R:0.27597 P:0.17708 F:0.21573
47 ROUGE-1 Eval D0721-A.M.100.E-G.47 R:0.29618 P:0.19375 F:0.23426
47 ROUGE-1 Eval D0721-B.M.100.E-B.47 R:0.36482 P:0.24724 F:0.29474
47 ROUGE-1 Eval D0721-B.M.100.E-C.47 R:0.35350 P:0.24503 F:0.28944
47 ROUGE-1 Eval D0721-B.M.100.E-E.47 R:0.33770 P:0.22737 F:0.27176
47 ROUGE-1 Eval D0721-B.M.100.E-G.47 R:0.34194 P:0.23400 F:0.27786
47 ROUGE-1 Eval D0721-C.M.100.E-B.47 R:0.38033 P:0.25778 F:0.30729
47 ROUGE-1 Eval D0721-C.M.100.E-C.47 R:0.33333 P:0.22444 F:0.26826
47 ROUGE-1 Eval D0721-C.M.100.E-E.47 R:0.33000 P:0.22000 F:0.26400
47 ROUGE-1 Eval D0721-C.M.100.E-G.47 R:0.31922 P:0.21778 F:0.25892
47 ROUGE-1 Eval D0726-A.M.100.F-A.47 R:0.45183 P:0.28333 F:0.34827
47 ROUGE-1 Eval D0726-A.M.100.F-E.47 R:0.41667 P:0.26042 F:0.32052
47 ROUGE-1 Eval D0726-A.M.100.F-F.47 R:0.44850 P:0.28125 F:0.34571
47 ROUGE-1 Eval D0726-A.M.100.F-G.47 R:0.44850 P:0.28125 F:0.34571
47 ROUGE-1 Eval D0726-B.M.100.F-A.47 R:0.33660 P:0.18559 F:0.23926
47 ROUGE-1 Eval D0726-B.M.100.F-E.47 R:0.35216 P:0.19099 F:0.24766
47 ROUGE-1 Eval D0726-B.M.100.F-F.47 R:0.35880 P:0.19459 F:0.25233
47 ROUGE-1 Eval D0726-B.M.100.F-G.47 R:0.35855 P:0.19640 F:0.25379
47 ROUGE-1 Eval D0726-C.M.100.F-A.47 R:0.38333 P:0.23517 F:0.29150
47 ROUGE-1 Eval D0726-C.M.100.F-E.47 R:0.36364 P:0.22086 F:0.27481
47 ROUGE-1 Eval D0726-C.M.100.F-F.47 R:0.38305 P:0.23108 F:0.28826
47 ROUGE-1 Eval D0726-C.M.100.F-G.47 R:0.35410 P:0.22086 F:0.27204
47 ROUGE-1 Eval D0727-A.M.100.G-A.47 R:0.38870 P:0.22941 F:0.28853
47 ROUGE-1 Eval D0727-A.M.100.G-F.47 R:0.38158 P:0.22745 F:0.28501
47 ROUGE-1 Eval D0727-A.M.100.G-G.47 R:0.35621 P:0.21373 F:0.26716
47 ROUGE-1 Eval D0727-A.M.100.G-H.47 R:0.37500 P:0.22353 F:0.28010
47 ROUGE-1 Eval D0727-B.M.100.G-A.47 R:0.37113 P:0.20930 F:0.26766
47 ROUGE-1 Eval D0727-B.M.100.G-F.47 R:0.34740 P:0.20736 F:0.25970
47 ROUGE-1 Eval D0727-B.M.100.G-G.47 R:0.32526 P:0.18217 F:0.23354
47 ROUGE-1 Eval D0727-B.M.100.G-H.47 R:0.36082 P:0.20349 F:0.26022
47 ROUGE-1 Eval D0727-C.M.100.G-A.47 R:0.38762 P:0.21441 F:0.27610
47 ROUGE-1 Eval D0727-C.M.100.G-F.47 R:0.39057 P:0.20901 F:0.27230
47 ROUGE-1 Eval D0727-C.M.100.G-G.47 R:0.35974 P:0.19640 F:0.25408
47 ROUGE-1 Eval D0727-C.M.100.G-H.47 R:0.40878 P:0.21802 F:0.28437
47 ROUGE-1 Eval D0736-A.M.100.H-G.47 R:0.31541 P:0.17255 F:0.22307
47 ROUGE-1 Eval D0736-A.M.100.H-H.47 R:0.33577 P:0.18039 F:0.23469
47 ROUGE-1 Eval D0736-A.M.100.H-I.47 R:0.33096 P:0.18235 F:0.23514
47 ROUGE-1 Eval D0736-A.M.100.H-J.47 R:0.32353 P:0.19412 F:0.24265
47 ROUGE-1 Eval D0736-B.M.100.H-G.47 R:0.35115 P:0.18814 F:0.24501
47 ROUGE-1 Eval D0736-B.M.100.H-H.47 R:0.35537 P:0.17587 F:0.23529
47 ROUGE-1 Eval D0736-B.M.100.H-I.47 R:0.39749 P:0.19427 F:0.26099
47 ROUGE-1 Eval D0736-B.M.100.H-J.47 R:0.36713 P:0.21472 F:0.27096
47 ROUGE-1 Eval D0736-C.M.100.H-G.47 R:0.37975 P:0.16304 F:0.22813
47 ROUGE-1 Eval D0736-C.M.100.H-H.47 R:0.34225 P:0.11594 F:0.17321
47 ROUGE-1 Eval D0736-C.M.100.H-I.47 R:0.45989 P:0.15580 F:0.23275
47 ROUGE-1 Eval D0736-C.M.100.H-J.47 R:0.37358 P:0.17935 F:0.24235
47 ROUGE-1 Eval D0740-A.M.100.I-D.47 R:0.35974 P:0.20762 F:0.26329
47 ROUGE-1 Eval D0740-A.M.100.I-H.47 R:0.36275 P:0.21143 F:0.26715
47 ROUGE-1 Eval D0740-A.M.100.I-I.47 R:0.37987 P:0.22286 F:0.28091
47 ROUGE-1 Eval D0740-A.M.100.I-J.47 R:0.37419 P:0.22095 F:0.27784
47 ROUGE-1 Eval D0740-B.M.100.I-D.47 R:0.32792 P:0.21042 F:0.25635
47 ROUGE-1 Eval D0740-B.M.100.I-H.47 R:0.31126 P:0.19583 F:0.24041
47 ROUGE-1 Eval D0740-B.M.100.I-I.47 R:0.32459 P:0.20625 F:0.25223
47 ROUGE-1 Eval D0740-B.M.100.I-J.47 R:0.32039 P:0.20625 F:0.25095
47 ROUGE-1 Eval D0740-C.M.100.I-D.47 R:0.42492 P:0.27033 F:0.33044
47 ROUGE-1 Eval D0740-C.M.100.I-H.47 R:0.39871 P:0.25203 F:0.30884
47 ROUGE-1 Eval D0740-C.M.100.I-I.47 R:0.44409 P:0.28252 F:0.34534
47 ROUGE-1 Eval D0740-C.M.100.I-J.47 R:0.44904 P:0.28659 F:0.34988
47 ROUGE-1 Eval D0743-A.M.100.J-B.47 R:0.23492 P:0.13628 F:0.17249
47 ROUGE-1 Eval D0743-A.M.100.J-H.47 R:0.20370 P:0.12155 F:0.15225
47 ROUGE-1 Eval D0743-A.M.100.J-I.47 R:0.25938 P:0.15285 F:0.19235
47 ROUGE-1 Eval D0743-A.M.100.J-J.47 R:0.21846 P:0.13076 F:0.16360
47 ROUGE-1 Eval D0743-B.M.100.J-B.47 R:0.25962 P:0.15517 F:0.19424
47 ROUGE-1 Eval D0743-B.M.100.J-H.47 R:0.27445 P:0.16667 F:0.20739
47 ROUGE-1 Eval D0743-B.M.100.J-I.47 R:0.29430 P:0.17816 F:0.22196
47 ROUGE-1 Eval D0743-B.M.100.J-J.47 R:0.27103 P:0.16667 F:0.20641
47 ROUGE-1 Eval D0743-C.M.100.J-B.47 R:0.35873 P:0.24945 F:0.29427
47 ROUGE-1 Eval D0743-C.M.100.J-H.47 R:0.31847 P:0.22075 F:0.26076
47 ROUGE-1 Eval D0743-C.M.100.J-I.47 R:0.36102 P:0.24945 F:0.29504
47 ROUGE-1 Eval D0743-C.M.100.J-J.47 R:0.31447 P:0.22075 F:0.25940
---------------------------------------------
47 ROUGE-2 Average_R: 0.09458 (95%-conf.int. 0.08697 - 0.10205)
47 ROUGE-2 Average_P: 0.05666 (95%-conf.int. 0.05193 - 0.06139)
47 ROUGE-2 Average_F: 0.07070 (95%-conf.int. 0.06502 - 0.07650)
.............................................
47 ROUGE-2 Eval D0703-A.M.100.A-A.47 R:0.12628 P:0.07520 F:0.09426
47 ROUGE-2 Eval D0703-A.M.100.A-C.47 R:0.10169 P:0.06098 F:0.07624
47 ROUGE-2 Eval D0703-A.M.100.A-D.47 R:0.11458 P:0.06707 F:0.08461
47 ROUGE-2 Eval D0703-A.M.100.A-J.47 R:0.13058 P:0.07724 F:0.09706
47 ROUGE-2 Eval D0703-B.M.100.A-A.47 R:0.09241 P:0.06140 F:0.07378
47 ROUGE-2 Eval D0703-B.M.100.A-C.47 R:0.09153 P:0.05921 F:0.07191
47 ROUGE-2 Eval D0703-B.M.100.A-D.47 R:0.09492 P:0.06140 F:0.07457
47 ROUGE-2 Eval D0703-B.M.100.A-J.47 R:0.11409 P:0.07456 F:0.09018
47 ROUGE-2 Eval D0703-C.M.100.A-A.47 R:0.06061 P:0.03593 F:0.04512
47 ROUGE-2 Eval D0703-C.M.100.A-C.47 R:0.07213 P:0.04391 F:0.05459
47 ROUGE-2 Eval D0703-C.M.100.A-D.47 R:0.07023 P:0.04192 F:0.05250
47 ROUGE-2 Eval D0703-C.M.100.A-J.47 R:0.07692 P:0.04591 F:0.05750
47 ROUGE-2 Eval D0706-A.M.100.B-B.47 R:0.11475 P:0.06410 F:0.08225
47 ROUGE-2 Eval D0706-A.M.100.B-D.47 R:0.11881 P:0.06593 F:0.08480
47 ROUGE-2 Eval D0706-A.M.100.B-E.47 R:0.05246 P:0.02930 F:0.03760
47 ROUGE-2 Eval D0706-A.M.100.B-I.47 R:0.11803 P:0.06593 F:0.08460
47 ROUGE-2 Eval D0706-B.M.100.B-B.47 R:0.09901 P:0.06289 F:0.07692
47 ROUGE-2 Eval D0706-B.M.100.B-D.47 R:0.06908 P:0.04403 F:0.05378
47 ROUGE-2 Eval D0706-B.M.100.B-E.47 R:0.05246 P:0.03354 F:0.04092
47 ROUGE-2 Eval D0706-B.M.100.B-I.47 R:0.09477 P:0.06080 F:0.07408
47 ROUGE-2 Eval D0706-C.M.100.B-B.47 R:0.12378 P:0.07724 F:0.09512
47 ROUGE-2 Eval D0706-C.M.100.B-D.47 R:0.12052 P:0.07520 F:0.09261
47 ROUGE-2 Eval D0706-C.M.100.B-E.47 R:0.08091 P:0.05081 F:0.06242
47 ROUGE-2 Eval D0706-C.M.100.B-I.47 R:0.13226 P:0.08333 F:0.10224
47 ROUGE-2 Eval D0711-A.M.100.C-A.47 R:0.05316 P:0.03030 F:0.03860
47 ROUGE-2 Eval D0711-A.M.100.C-B.47 R:0.07071 P:0.03977 F:0.05091
47 ROUGE-2 Eval D0711-A.M.100.C-C.47 R:0.05387 P:0.03030 F:0.03878
47 ROUGE-2 Eval D0711-A.M.100.C-F.47 R:0.06355 P:0.03598 F:0.04595
47 ROUGE-2 Eval D0711-B.M.100.C-A.47 R:0.03780 P:0.02306 F:0.02865
47 ROUGE-2 Eval D0711-B.M.100.C-B.47 R:0.05190 P:0.03145 F:0.03917
47 ROUGE-2 Eval D0711-B.M.100.C-C.47 R:0.04068 P:0.02516 F:0.03109
47 ROUGE-2 Eval D0711-B.M.100.C-F.47 R:0.04452 P:0.02725 F:0.03381
47 ROUGE-2 Eval D0711-C.M.100.C-A.47 R:0.09667 P:0.06042 F:0.07436
47 ROUGE-2 Eval D0711-C.M.100.C-B.47 R:0.09655 P:0.05833 F:0.07272
47 ROUGE-2 Eval D0711-C.M.100.C-C.47 R:0.11263 P:0.06875 F:0.08538
47 ROUGE-2 Eval D0711-C.M.100.C-F.47 R:0.10239 P:0.06250 F:0.07762
47 ROUGE-2 Eval D0716-A.M.100.D-C.47 R:0.16556 P:0.09579 F:0.12136
47 ROUGE-2 Eval D0716-A.M.100.D-D.47 R:0.19192 P:0.10920 F:0.13920
47 ROUGE-2 Eval D0716-A.M.100.D-E.47 R:0.20470 P:0.11686 F:0.14878
47 ROUGE-2 Eval D0716-A.M.100.D-F.47 R:0.19000 P:0.10920 F:0.13869
47 ROUGE-2 Eval D0716-B.M.100.D-C.47 R:0.20930 P:0.13208 F:0.16196
47 ROUGE-2 Eval D0716-B.M.100.D-D.47 R:0.20000 P:0.12369 F:0.15285
47 ROUGE-2 Eval D0716-B.M.100.D-E.47 R:0.19799 P:0.12369 F:0.15226
47 ROUGE-2 Eval D0716-B.M.100.D-F.47 R:0.19865 P:0.12369 F:0.15245
47 ROUGE-2 Eval D0716-C.M.100.D-C.47 R:0.12829 P:0.08025 F:0.09874
47 ROUGE-2 Eval D0716-C.M.100.D-D.47 R:0.15203 P:0.09259 F:0.11509
47 ROUGE-2 Eval D0716-C.M.100.D-E.47 R:0.14333 P:0.08848 F:0.10942
47 ROUGE-2 Eval D0716-C.M.100.D-F.47 R:0.14815 P:0.09053 F:0.11238
47 ROUGE-2 Eval D0721-A.M.100.E-B.47 R:0.06061 P:0.03774 F:0.04652
47 ROUGE-2 Eval D0721-A.M.100.E-C.47 R:0.05246 P:0.03354 F:0.04092
47 ROUGE-2 Eval D0721-A.M.100.E-E.47 R:0.05902 P:0.03774 F:0.04604
47 ROUGE-2 Eval D0721-A.M.100.E-G.47 R:0.05466 P:0.03564 F:0.04315
47 ROUGE-2 Eval D0721-B.M.100.E-B.47 R:0.07237 P:0.04889 F:0.05836
47 ROUGE-2 Eval D0721-B.M.100.E-C.47 R:0.07395 P:0.05111 F:0.06044
47 ROUGE-2 Eval D0721-B.M.100.E-E.47 R:0.05629 P:0.03778 F:0.04521
47 ROUGE-2 Eval D0721-B.M.100.E-G.47 R:0.05212 P:0.03556 F:0.04228
47 ROUGE-2 Eval D0721-C.M.100.E-B.47 R:0.09603 P:0.06488 F:0.07744
47 ROUGE-2 Eval D0721-C.M.100.E-C.47 R:0.08333 P:0.05593 F:0.06693
47 ROUGE-2 Eval D0721-C.M.100.E-E.47 R:0.07071 P:0.04698 F:0.05645
47 ROUGE-2 Eval D0721-C.M.100.E-G.47 R:0.07895 P:0.05369 F:0.06391
47 ROUGE-2 Eval D0726-A.M.100.F-A.47 R:0.20470 P:0.12788 F:0.15742
47 ROUGE-2 Eval D0726-A.M.100.F-E.47 R:0.17845 P:0.11111 F:0.13695
47 ROUGE-2 Eval D0726-A.M.100.F-F.47 R:0.19799 P:0.12369 F:0.15226
47 ROUGE-2 Eval D0726-A.M.100.F-G.47 R:0.18456 P:0.11530 F:0.14193
47 ROUGE-2 Eval D0726-B.M.100.F-A.47 R:0.07591 P:0.04167 F:0.05380
47 ROUGE-2 Eval D0726-B.M.100.F-E.47 R:0.07383 P:0.03986 F:0.05177
47 ROUGE-2 Eval D0726-B.M.100.F-F.47 R:0.07383 P:0.03986 F:0.05177
47 ROUGE-2 Eval D0726-B.M.100.F-G.47 R:0.06645 P:0.03623 F:0.04689
47 ROUGE-2 Eval D0726-C.M.100.F-A.47 R:0.07744 P:0.04733 F:0.05875
47 ROUGE-2 Eval D0726-C.M.100.F-E.47 R:0.07483 P:0.04527 F:0.05641
47 ROUGE-2 Eval D0726-C.M.100.F-F.47 R:0.07534 P:0.04527 F:0.05656
47 ROUGE-2 Eval D0726-C.M.100.F-G.47 R:0.06623 P:0.04115 F:0.05076
47 ROUGE-2 Eval D0727-A.M.100.G-A.47 R:0.11074 P:0.06509 F:0.08199
47 ROUGE-2 Eval D0727-A.M.100.G-F.47 R:0.10631 P:0.06312 F:0.07921
47 ROUGE-2 Eval D0727-A.M.100.G-G.47 R:0.08911 P:0.05325 F:0.06666
47 ROUGE-2 Eval D0727-A.M.100.G-H.47 R:0.10299 P:0.06114 F:0.07673
47 ROUGE-2 Eval D0727-B.M.100.G-A.47 R:0.11111 P:0.06238 F:0.07990
47 ROUGE-2 Eval D0727-B.M.100.G-F.47 R:0.08852 P:0.05263 F:0.06601
47 ROUGE-2 Eval D0727-B.M.100.G-G.47 R:0.08392 P:0.04678 F:0.06007
47 ROUGE-2 Eval D0727-B.M.100.G-H.47 R:0.10764 P:0.06043 F:0.07740
47 ROUGE-2 Eval D0727-C.M.100.G-A.47 R:0.08882 P:0.04891 F:0.06308
47 ROUGE-2 Eval D0727-C.M.100.G-F.47 R:0.08503 P:0.04529 F:0.05910
47 ROUGE-2 Eval D0727-C.M.100.G-G.47 R:0.06667 P:0.03623 F:0.04695
47 ROUGE-2 Eval D0727-C.M.100.G-H.47 R:0.10239 P:0.05435 F:0.07101
47 ROUGE-2 Eval D0736-A.M.100.H-G.47 R:0.10870 P:0.05917 F:0.07663
47 ROUGE-2 Eval D0736-A.M.100.H-H.47 R:0.09594 P:0.05128 F:0.06684
47 ROUGE-2 Eval D0736-A.M.100.H-I.47 R:0.11871 P:0.06509 F:0.08408
47 ROUGE-2 Eval D0736-A.M.100.H-J.47 R:0.08251 P:0.04931 F:0.06173
47 ROUGE-2 Eval D0736-B.M.100.H-G.47 R:0.05792 P:0.03086 F:0.04027
47 ROUGE-2 Eval D0736-B.M.100.H-H.47 R:0.06695 P:0.03292 F:0.04414
47 ROUGE-2 Eval D0736-B.M.100.H-I.47 R:0.06356 P:0.03086 F:0.04155
47 ROUGE-2 Eval D0736-B.M.100.H-J.47 R:0.07067 P:0.04115 F:0.05201
47 ROUGE-2 Eval D0736-C.M.100.H-G.47 R:0.10256 P:0.04372 F:0.06131
47 ROUGE-2 Eval D0736-C.M.100.H-H.47 R:0.07609 P:0.02550 F:0.03820
47 ROUGE-2 Eval D0736-C.M.100.H-I.47 R:0.13043 P:0.04372 F:0.06549
47 ROUGE-2 Eval D0736-C.M.100.H-J.47 R:0.08397 P:0.04007 F:0.05425
47 ROUGE-2 Eval D0740-A.M.100.I-D.47 R:0.06000 P:0.03448 F:0.04379
47 ROUGE-2 Eval D0740-A.M.100.I-H.47 R:0.06931 P:0.04023 F:0.05091
47 ROUGE-2 Eval D0740-A.M.100.I-I.47 R:0.06557 P:0.03831 F:0.04836
47 ROUGE-2 Eval D0740-A.M.100.I-J.47 R:0.06189 P:0.03640 F:0.04584
47 ROUGE-2 Eval D0740-B.M.100.I-D.47 R:0.06230 P:0.03983 F:0.04859
47 ROUGE-2 Eval D0740-B.M.100.I-H.47 R:0.06355 P:0.03983 F:0.04897
47 ROUGE-2 Eval D0740-B.M.100.I-I.47 R:0.06291 P:0.03983 F:0.04878
47 ROUGE-2 Eval D0740-B.M.100.I-J.47 R:0.06863 P:0.04403 F:0.05364
47 ROUGE-2 Eval D0740-C.M.100.I-D.47 R:0.13226 P:0.08384 F:0.10263
47 ROUGE-2 Eval D0740-C.M.100.I-H.47 R:0.12338 P:0.07771 F:0.09536
47 ROUGE-2 Eval D0740-C.M.100.I-I.47 R:0.15161 P:0.09611 F:0.11764
47 ROUGE-2 Eval D0740-C.M.100.I-J.47 R:0.14469 P:0.09202 F:0.11250
47 ROUGE-2 Eval D0743-A.M.100.J-B.47 R:0.03526 P:0.02037 F:0.02582
47 ROUGE-2 Eval D0743-A.M.100.J-H.47 R:0.01869 P:0.01111 F:0.01394
47 ROUGE-2 Eval D0743-A.M.100.J-I.47 R:0.03155 P:0.01852 F:0.02334
47 ROUGE-2 Eval D0743-A.M.100.J-J.47 R:0.02795 P:0.01667 F:0.02088
47 ROUGE-2 Eval D0743-B.M.100.J-B.47 R:0.03883 P:0.02312 F:0.02898
47 ROUGE-2 Eval D0743-B.M.100.J-H.47 R:0.03503 P:0.02119 F:0.02641
47 ROUGE-2 Eval D0743-B.M.100.J-I.47 R:0.04792 P:0.02890 F:0.03606
47 ROUGE-2 Eval D0743-B.M.100.J-J.47 R:0.04088 P:0.02505 F:0.03106
47 ROUGE-2 Eval D0743-C.M.100.J-B.47 R:0.09936 P:0.06889 F:0.08137
47 ROUGE-2 Eval D0743-C.M.100.J-H.47 R:0.07395 P:0.05111 F:0.06044
47 ROUGE-2 Eval D0743-C.M.100.J-I.47 R:0.10645 P:0.07333 F:0.08684
47 ROUGE-2 Eval D0743-C.M.100.J-J.47 R:0.08571 P:0.06000 F:0.07059
---------------------------------------------
47 ROUGE-3 Average_R: 0.03880 (95%-conf.int. 0.03294 - 0.04482)
47 ROUGE-3 Average_P: 0.02318 (95%-conf.int. 0.01945 - 0.02689)
47 ROUGE-3 Average_F: 0.02895 (95%-conf.int. 0.02438 - 0.03349)
.............................................
47 ROUGE-3 Eval D0703-A.M.100.A-A.47 R:0.04483 P:0.02658 F:0.03337
47 ROUGE-3 Eval D0703-A.M.100.A-C.47 R:0.02740 P:0.01636 F:0.02049
47 ROUGE-3 Eval D0703-A.M.100.A-D.47 R:0.05263 P:0.03067 F:0.03876
47 ROUGE-3 Eval D0703-A.M.100.A-J.47 R:0.05208 P:0.03067 F:0.03861
47 ROUGE-3 Eval D0703-B.M.100.A-A.47 R:0.03333 P:0.02208 F:0.02656
47 ROUGE-3 Eval D0703-B.M.100.A-C.47 R:0.02397 P:0.01545 F:0.01879
47 ROUGE-3 Eval D0703-B.M.100.A-D.47 R:0.04110 P:0.02649 F:0.03222
47 ROUGE-3 Eval D0703-B.M.100.A-J.47 R:0.04407 P:0.02870 F:0.03476
47 ROUGE-3 Eval D0703-C.M.100.A-A.47 R:0.01361 P:0.00803 F:0.01010
47 ROUGE-3 Eval D0703-C.M.100.A-C.47 R:0.01987 P:0.01205 F:0.01500
47 ROUGE-3 Eval D0703-C.M.100.A-D.47 R:0.02027 P:0.01205 F:0.01511
47 ROUGE-3 Eval D0703-C.M.100.A-J.47 R:0.02703 P:0.01606 F:0.02015
47 ROUGE-3 Eval D0706-A.M.100.B-B.47 R:0.05629 P:0.03131 F:0.04024
47 ROUGE-3 Eval D0706-A.M.100.B-D.47 R:0.06000 P:0.03315 F:0.04271
47 ROUGE-3 Eval D0706-A.M.100.B-E.47 R:0.00331 P:0.00184 F:0.00237
47 ROUGE-3 Eval D0706-A.M.100.B-I.47 R:0.05960 P:0.03315 F:0.04260
47 ROUGE-3 Eval D0706-B.M.100.B-B.47 R:0.05000 P:0.03165 F:0.03876
47 ROUGE-3 Eval D0706-B.M.100.B-D.47 R:0.03654 P:0.02321 F:0.02839
47 ROUGE-3 Eval D0706-B.M.100.B-E.47 R:0.01325 P:0.00844 F:0.01031
47 ROUGE-3 Eval D0706-B.M.100.B-I.47 R:0.04950 P:0.03165 F:0.03861
47 ROUGE-3 Eval D0706-C.M.100.B-B.47 R:0.07895 P:0.04908 F:0.06053
47 ROUGE-3 Eval D0706-C.M.100.B-D.47 R:0.06908 P:0.04294 F:0.05296
47 ROUGE-3 Eval D0706-C.M.100.B-E.47 R:0.03922 P:0.02454 F:0.03019
47 ROUGE-3 Eval D0706-C.M.100.B-I.47 R:0.08795 P:0.05521 F:0.06784
47 ROUGE-3 Eval D0711-A.M.100.C-A.47 R:0.01342 P:0.00762 F:0.00972
47 ROUGE-3 Eval D0711-A.M.100.C-B.47 R:0.01701 P:0.00952 F:0.01221
47 ROUGE-3 Eval D0711-A.M.100.C-C.47 R:0.00680 P:0.00381 F:0.00488
47 ROUGE-3 Eval D0711-A.M.100.C-F.47 R:0.01351 P:0.00762 F:0.00974
47 ROUGE-3 Eval D0711-B.M.100.C-A.47 R:0.00347 P:0.00211 F:0.00262
47 ROUGE-3 Eval D0711-B.M.100.C-B.47 R:0.01049 P:0.00633 F:0.00790
47 ROUGE-3 Eval D0711-B.M.100.C-C.47 R:0.00685 P:0.00422 F:0.00522
47 ROUGE-3 Eval D0711-B.M.100.C-F.47 R:0.01038 P:0.00633 F:0.00786
47 ROUGE-3 Eval D0711-C.M.100.C-A.47 R:0.05387 P:0.03354 F:0.04134
47 ROUGE-3 Eval D0711-C.M.100.C-B.47 R:0.05923 P:0.03564 F:0.04450
47 ROUGE-3 Eval D0711-C.M.100.C-C.47 R:0.07931 P:0.04822 F:0.05998
47 ROUGE-3 Eval D0711-C.M.100.C-F.47 R:0.06552 P:0.03983 F:0.04954
47 ROUGE-3 Eval D0716-A.M.100.D-C.47 R:0.07692 P:0.04432 F:0.05624
47 ROUGE-3 Eval D0716-A.M.100.D-D.47 R:0.10204 P:0.05780 F:0.07380
47 ROUGE-3 Eval D0716-A.M.100.D-E.47 R:0.10847 P:0.06166 F:0.07863
47 ROUGE-3 Eval D0716-A.M.100.D-F.47 R:0.09764 P:0.05588 F:0.07108
47 ROUGE-3 Eval D0716-B.M.100.D-C.47 R:0.12416 P:0.07806 F:0.09586
47 ROUGE-3 Eval D0716-B.M.100.D-D.47 R:0.13014 P:0.08017 F:0.09922
47 ROUGE-3 Eval D0716-B.M.100.D-E.47 R:0.12203 P:0.07595 F:0.09363
47 ROUGE-3 Eval D0716-B.M.100.D-F.47 R:0.14286 P:0.08861 F:0.10938
47 ROUGE-3 Eval D0716-C.M.100.D-C.47 R:0.05648 P:0.03520 F:0.04337
47 ROUGE-3 Eval D0716-C.M.100.D-D.47 R:0.06143 P:0.03727 F:0.04639
47 ROUGE-3 Eval D0716-C.M.100.D-E.47 R:0.05387 P:0.03313 F:0.04103
47 ROUGE-3 Eval D0716-C.M.100.D-F.47 R:0.06122 P:0.03727 F:0.04633
47 ROUGE-3 Eval D0721-A.M.100.E-B.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-3 Eval D0721-A.M.100.E-C.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-3 Eval D0721-A.M.100.E-E.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-3 Eval D0721-A.M.100.E-G.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-3 Eval D0721-B.M.100.E-B.47 R:0.00997 P:0.00671 F:0.00802
47 ROUGE-3 Eval D0721-B.M.100.E-C.47 R:0.00974 P:0.00671 F:0.00795
47 ROUGE-3 Eval D0721-B.M.100.E-E.47 R:0.00334 P:0.00224 F:0.00268
47 ROUGE-3 Eval D0721-B.M.100.E-G.47 R:0.00658 P:0.00447 F:0.00532
47 ROUGE-3 Eval D0721-C.M.100.E-B.47 R:0.04348 P:0.02928 F:0.03499
47 ROUGE-3 Eval D0721-C.M.100.E-C.47 R:0.03367 P:0.02252 F:0.02699
47 ROUGE-3 Eval D0721-C.M.100.E-E.47 R:0.03061 P:0.02027 F:0.02439
47 ROUGE-3 Eval D0721-C.M.100.E-G.47 R:0.03322 P:0.02252 F:0.02684
47 ROUGE-3 Eval D0726-A.M.100.F-A.47 R:0.14237 P:0.08861 F:0.10923
47 ROUGE-3 Eval D0726-A.M.100.F-E.47 R:0.10884 P:0.06751 F:0.08333
47 ROUGE-3 Eval D0726-A.M.100.F-F.47 R:0.13220 P:0.08228 F:0.10143
47 ROUGE-3 Eval D0726-A.M.100.F-G.47 R:0.10508 P:0.06540 F:0.08062
47 ROUGE-3 Eval D0726-B.M.100.F-A.47 R:0.01333 P:0.00729 F:0.00943
47 ROUGE-3 Eval D0726-B.M.100.F-E.47 R:0.00678 P:0.00364 F:0.00474
47 ROUGE-3 Eval D0726-B.M.100.F-F.47 R:0.01356 P:0.00729 F:0.00948
47 ROUGE-3 Eval D0726-B.M.100.F-G.47 R:0.00671 P:0.00364 F:0.00472
47 ROUGE-3 Eval D0726-C.M.100.F-A.47 R:0.02381 P:0.01449 F:0.01802
47 ROUGE-3 Eval D0726-C.M.100.F-E.47 R:0.01718 P:0.01035 F:0.01292
47 ROUGE-3 Eval D0726-C.M.100.F-F.47 R:0.02422 P:0.01449 F:0.01813
47 ROUGE-3 Eval D0726-C.M.100.F-G.47 R:0.01672 P:0.01035 F:0.01279
47 ROUGE-3 Eval D0727-A.M.100.G-A.47 R:0.04068 P:0.02381 F:0.03004
47 ROUGE-3 Eval D0727-A.M.100.G-F.47 R:0.05034 P:0.02976 F:0.03741
47 ROUGE-3 Eval D0727-A.M.100.G-G.47 R:0.03333 P:0.01984 F:0.02487
47 ROUGE-3 Eval D0727-A.M.100.G-H.47 R:0.05705 P:0.03373 F:0.04239
47 ROUGE-3 Eval D0727-B.M.100.G-A.47 R:0.04912 P:0.02745 F:0.03522
47 ROUGE-3 Eval D0727-B.M.100.G-F.47 R:0.02318 P:0.01373 F:0.01725
47 ROUGE-3 Eval D0727-B.M.100.G-G.47 R:0.02827 P:0.01569 F:0.02018
47 ROUGE-3 Eval D0727-B.M.100.G-H.47 R:0.04561 P:0.02549 F:0.03270
47 ROUGE-3 Eval D0727-C.M.100.G-A.47 R:0.03654 P:0.02004 F:0.02588
47 ROUGE-3 Eval D0727-C.M.100.G-F.47 R:0.02749 P:0.01457 F:0.01905
47 ROUGE-3 Eval D0727-C.M.100.G-G.47 R:0.01347 P:0.00729 F:0.00946
47 ROUGE-3 Eval D0727-C.M.100.G-H.47 R:0.03448 P:0.01821 F:0.02383
47 ROUGE-3 Eval D0736-A.M.100.H-G.47 R:0.05495 P:0.02976 F:0.03861
47 ROUGE-3 Eval D0736-A.M.100.H-H.47 R:0.05597 P:0.02976 F:0.03886
47 ROUGE-3 Eval D0736-A.M.100.H-I.47 R:0.06182 P:0.03373 F:0.04365
47 ROUGE-3 Eval D0736-A.M.100.H-J.47 R:0.03333 P:0.01984 F:0.02487
47 ROUGE-3 Eval D0736-B.M.100.H-G.47 R:0.01172 P:0.00621 F:0.00812
47 ROUGE-3 Eval D0736-B.M.100.H-H.47 R:0.01271 P:0.00621 F:0.00834
47 ROUGE-3 Eval D0736-B.M.100.H-I.47 R:0.02575 P:0.01242 F:0.01676
47 ROUGE-3 Eval D0736-B.M.100.H-J.47 R:0.02143 P:0.01242 F:0.01573
47 ROUGE-3 Eval D0736-C.M.100.H-G.47 R:0.05195 P:0.02198 F:0.03089
47 ROUGE-3 Eval D0736-C.M.100.H-H.47 R:0.02762 P:0.00916 F:0.01376
47 ROUGE-3 Eval D0736-C.M.100.H-I.47 R:0.06077 P:0.02015 F:0.03026
47 ROUGE-3 Eval D0736-C.M.100.H-J.47 R:0.03089 P:0.01465 F:0.01987
47 ROUGE-3 Eval D0740-A.M.100.I-D.47 R:0.01010 P:0.00578 F:0.00735
47 ROUGE-3 Eval D0740-A.M.100.I-H.47 R:0.00667 P:0.00385 F:0.00488
47 ROUGE-3 Eval D0740-A.M.100.I-I.47 R:0.00662 P:0.00385 F:0.00487
47 ROUGE-3 Eval D0740-A.M.100.I-J.47 R:0.00658 P:0.00385 F:0.00486
47 ROUGE-3 Eval D0740-B.M.100.I-D.47 R:0.00662 P:0.00422 F:0.00515
47 ROUGE-3 Eval D0740-B.M.100.I-H.47 R:0.01351 P:0.00844 F:0.01039
47 ROUGE-3 Eval D0740-B.M.100.I-I.47 R:0.01338 P:0.00844 F:0.01035
47 ROUGE-3 Eval D0740-B.M.100.I-J.47 R:0.01650 P:0.01055 F:0.01287
47 ROUGE-3 Eval D0740-C.M.100.I-D.47 R:0.06515 P:0.04115 F:0.05044
47 ROUGE-3 Eval D0740-C.M.100.I-H.47 R:0.04918 P:0.03086 F:0.03792
47 ROUGE-3 Eval D0740-C.M.100.I-I.47 R:0.06840 P:0.04321 F:0.05296
47 ROUGE-3 Eval D0740-C.M.100.I-J.47 R:0.06169 P:0.03909 F:0.04786
47 ROUGE-3 Eval D0743-A.M.100.J-B.47 R:0.00324 P:0.00186 F:0.00236
47 ROUGE-3 Eval D0743-A.M.100.J-H.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-3 Eval D0743-A.M.100.J-I.47 R:0.00318 P:0.00186 F:0.00235
47 ROUGE-3 Eval D0743-A.M.100.J-J.47 R:0.00313 P:0.00186 F:0.00233
47 ROUGE-3 Eval D0743-B.M.100.J-B.47 R:0.00980 P:0.00581 F:0.00730
47 ROUGE-3 Eval D0743-B.M.100.J-H.47 R:0.00965 P:0.00581 F:0.00725
47 ROUGE-3 Eval D0743-B.M.100.J-I.47 R:0.01290 P:0.00775 F:0.00968
47 ROUGE-3 Eval D0743-B.M.100.J-J.47 R:0.01587 P:0.00969 F:0.01203
47 ROUGE-3 Eval D0743-C.M.100.J-B.47 R:0.03236 P:0.02237 F:0.02645
47 ROUGE-3 Eval D0743-C.M.100.J-H.47 R:0.02273 P:0.01566 F:0.01854
47 ROUGE-3 Eval D0743-C.M.100.J-I.47 R:0.04235 P:0.02908 F:0.03448
47 ROUGE-3 Eval D0743-C.M.100.J-J.47 R:0.02885 P:0.02013 F:0.02371
---------------------------------------------
47 ROUGE-4 Average_R: 0.02134 (95%-conf.int. 0.01679 - 0.02586)
47 ROUGE-4 Average_P: 0.01265 (95%-conf.int. 0.00995 - 0.01542)
47 ROUGE-4 Average_F: 0.01584 (95%-conf.int. 0.01249 - 0.01930)
.............................................
47 ROUGE-4 Eval D0703-A.M.100.A-A.47 R:0.01742 P:0.01029 F:0.01294
47 ROUGE-4 Eval D0703-A.M.100.A-C.47 R:0.01038 P:0.00617 F:0.00774
47 ROUGE-4 Eval D0703-A.M.100.A-D.47 R:0.02482 P:0.01440 F:0.01823
47 ROUGE-4 Eval D0703-A.M.100.A-J.47 R:0.02105 P:0.01235 F:0.01557
47 ROUGE-4 Eval D0703-B.M.100.A-A.47 R:0.01347 P:0.00889 F:0.01071
47 ROUGE-4 Eval D0703-B.M.100.A-C.47 R:0.00346 P:0.00222 F:0.00270
47 ROUGE-4 Eval D0703-B.M.100.A-D.47 R:0.01730 P:0.01111 F:0.01353
47 ROUGE-4 Eval D0703-B.M.100.A-J.47 R:0.01712 P:0.01111 F:0.01348
47 ROUGE-4 Eval D0703-C.M.100.A-A.47 R:0.00687 P:0.00404 F:0.00509
47 ROUGE-4 Eval D0703-C.M.100.A-C.47 R:0.00669 P:0.00404 F:0.00504
47 ROUGE-4 Eval D0703-C.M.100.A-D.47 R:0.00683 P:0.00404 F:0.00508
47 ROUGE-4 Eval D0703-C.M.100.A-J.47 R:0.01024 P:0.00606 F:0.00761
47 ROUGE-4 Eval D0706-A.M.100.B-B.47 R:0.04348 P:0.02407 F:0.03099
47 ROUGE-4 Eval D0706-A.M.100.B-D.47 R:0.04377 P:0.02407 F:0.03106
47 ROUGE-4 Eval D0706-A.M.100.B-E.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0706-A.M.100.B-I.47 R:0.04348 P:0.02407 F:0.03099
47 ROUGE-4 Eval D0706-B.M.100.B-B.47 R:0.03030 P:0.01911 F:0.02344
47 ROUGE-4 Eval D0706-B.M.100.B-D.47 R:0.02685 P:0.01699 F:0.02081
47 ROUGE-4 Eval D0706-B.M.100.B-E.47 R:0.00334 P:0.00212 F:0.00259
47 ROUGE-4 Eval D0706-B.M.100.B-I.47 R:0.03000 P:0.01911 F:0.02335
47 ROUGE-4 Eval D0706-C.M.100.B-B.47 R:0.06312 P:0.03909 F:0.04828
47 ROUGE-4 Eval D0706-C.M.100.B-D.47 R:0.05316 P:0.03292 F:0.04066
47 ROUGE-4 Eval D0706-C.M.100.B-E.47 R:0.02970 P:0.01852 F:0.02281
47 ROUGE-4 Eval D0706-C.M.100.B-I.47 R:0.07237 P:0.04527 F:0.05570
47 ROUGE-4 Eval D0711-A.M.100.C-A.47 R:0.00339 P:0.00192 F:0.00245
47 ROUGE-4 Eval D0711-A.M.100.C-B.47 R:0.00344 P:0.00192 F:0.00246
47 ROUGE-4 Eval D0711-A.M.100.C-C.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0711-A.M.100.C-F.47 R:0.00341 P:0.00192 F:0.00246
47 ROUGE-4 Eval D0711-B.M.100.C-A.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0711-B.M.100.C-B.47 R:0.00353 P:0.00212 F:0.00265
47 ROUGE-4 Eval D0711-B.M.100.C-C.47 R:0.00346 P:0.00212 F:0.00263
47 ROUGE-4 Eval D0711-B.M.100.C-F.47 R:0.00350 P:0.00212 F:0.00264
47 ROUGE-4 Eval D0711-C.M.100.C-A.47 R:0.03401 P:0.02110 F:0.02604
47 ROUGE-4 Eval D0711-C.M.100.C-B.47 R:0.03873 P:0.02321 F:0.02903
47 ROUGE-4 Eval D0711-C.M.100.C-C.47 R:0.06272 P:0.03797 F:0.04730
47 ROUGE-4 Eval D0711-C.M.100.C-F.47 R:0.05226 P:0.03165 F:0.03942
47 ROUGE-4 Eval D0716-A.M.100.D-C.47 R:0.04054 P:0.02326 F:0.02956
47 ROUGE-4 Eval D0716-A.M.100.D-D.47 R:0.06529 P:0.03682 F:0.04709
47 ROUGE-4 Eval D0716-A.M.100.D-E.47 R:0.06507 P:0.03682 F:0.04703
47 ROUGE-4 Eval D0716-A.M.100.D-F.47 R:0.05442 P:0.03101 F:0.03951
47 ROUGE-4 Eval D0716-B.M.100.D-C.47 R:0.07797 P:0.04883 F:0.06005
47 ROUGE-4 Eval D0716-B.M.100.D-D.47 R:0.08304 P:0.05096 F:0.06316
47 ROUGE-4 Eval D0716-B.M.100.D-E.47 R:0.08219 P:0.05096 F:0.06291
47 ROUGE-4 Eval D0716-B.M.100.D-F.47 R:0.09622 P:0.05945 F:0.07349
47 ROUGE-4 Eval D0716-C.M.100.D-C.47 R:0.02349 P:0.01458 F:0.01799
47 ROUGE-4 Eval D0716-C.M.100.D-D.47 R:0.02414 P:0.01458 F:0.01818
47 ROUGE-4 Eval D0716-C.M.100.D-E.47 R:0.02041 P:0.01250 F:0.01550
47 ROUGE-4 Eval D0716-C.M.100.D-F.47 R:0.02405 P:0.01458 F:0.01815
47 ROUGE-4 Eval D0721-A.M.100.E-B.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-A.M.100.E-C.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-A.M.100.E-E.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-A.M.100.E-G.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-B.M.100.E-B.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-B.M.100.E-C.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-B.M.100.E-E.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-B.M.100.E-G.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0721-C.M.100.E-B.47 R:0.02027 P:0.01361 F:0.01629
47 ROUGE-4 Eval D0721-C.M.100.E-C.47 R:0.01361 P:0.00907 F:0.01089
47 ROUGE-4 Eval D0721-C.M.100.E-E.47 R:0.01375 P:0.00907 F:0.01093
47 ROUGE-4 Eval D0721-C.M.100.E-G.47 R:0.01342 P:0.00907 F:0.01082
47 ROUGE-4 Eval D0726-A.M.100.F-A.47 R:0.10959 P:0.06794 F:0.08388
47 ROUGE-4 Eval D0726-A.M.100.F-E.47 R:0.07904 P:0.04883 F:0.06037
47 ROUGE-4 Eval D0726-A.M.100.F-F.47 R:0.09932 P:0.06157 F:0.07602
47 ROUGE-4 Eval D0726-A.M.100.F-G.47 R:0.07192 P:0.04459 F:0.05505
47 ROUGE-4 Eval D0726-B.M.100.F-A.47 R:0.00337 P:0.00183 F:0.00237
47 ROUGE-4 Eval D0726-B.M.100.F-E.47 R:0.00342 P:0.00183 F:0.00238
47 ROUGE-4 Eval D0726-B.M.100.F-F.47 R:0.00342 P:0.00183 F:0.00238
47 ROUGE-4 Eval D0726-B.M.100.F-G.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0726-C.M.100.F-A.47 R:0.00344 P:0.00208 F:0.00259
47 ROUGE-4 Eval D0726-C.M.100.F-E.47 R:0.00347 P:0.00208 F:0.00260
47 ROUGE-4 Eval D0726-C.M.100.F-F.47 R:0.00350 P:0.00208 F:0.00261
47 ROUGE-4 Eval D0726-C.M.100.F-G.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0727-A.M.100.G-A.47 R:0.02397 P:0.01397 F:0.01765
47 ROUGE-4 Eval D0727-A.M.100.G-F.47 R:0.03729 P:0.02196 F:0.02764
47 ROUGE-4 Eval D0727-A.M.100.G-G.47 R:0.01347 P:0.00798 F:0.01002
47 ROUGE-4 Eval D0727-A.M.100.G-H.47 R:0.03729 P:0.02196 F:0.02764
47 ROUGE-4 Eval D0727-B.M.100.G-A.47 R:0.01773 P:0.00986 F:0.01267
47 ROUGE-4 Eval D0727-B.M.100.G-F.47 R:0.00669 P:0.00394 F:0.00496
47 ROUGE-4 Eval D0727-B.M.100.G-G.47 R:0.01071 P:0.00592 F:0.00763
47 ROUGE-4 Eval D0727-B.M.100.G-H.47 R:0.01773 P:0.00986 F:0.01267
47 ROUGE-4 Eval D0727-C.M.100.G-A.47 R:0.02349 P:0.01282 F:0.01659
47 ROUGE-4 Eval D0727-C.M.100.G-F.47 R:0.02083 P:0.01099 F:0.01439
47 ROUGE-4 Eval D0727-C.M.100.G-G.47 R:0.00340 P:0.00183 F:0.00238
47 ROUGE-4 Eval D0727-C.M.100.G-H.47 R:0.02439 P:0.01282 F:0.01681
47 ROUGE-4 Eval D0736-A.M.100.H-G.47 R:0.03333 P:0.01796 F:0.02334
47 ROUGE-4 Eval D0736-A.M.100.H-H.47 R:0.04151 P:0.02196 F:0.02872
47 ROUGE-4 Eval D0736-A.M.100.H-I.47 R:0.04044 P:0.02196 F:0.02846
47 ROUGE-4 Eval D0736-A.M.100.H-J.47 R:0.01684 P:0.00998 F:0.01253
47 ROUGE-4 Eval D0736-B.M.100.H-G.47 R:0.00395 P:0.00208 F:0.00273
47 ROUGE-4 Eval D0736-B.M.100.H-H.47 R:0.00858 P:0.00417 F:0.00561
47 ROUGE-4 Eval D0736-B.M.100.H-I.47 R:0.01304 P:0.00625 F:0.00845
47 ROUGE-4 Eval D0736-B.M.100.H-J.47 R:0.01083 P:0.00625 F:0.00793
47 ROUGE-4 Eval D0736-C.M.100.H-G.47 R:0.03070 P:0.01289 F:0.01816
47 ROUGE-4 Eval D0736-C.M.100.H-H.47 R:0.01685 P:0.00552 F:0.00832
47 ROUGE-4 Eval D0736-C.M.100.H-I.47 R:0.03933 P:0.01289 F:0.01942
47 ROUGE-4 Eval D0736-C.M.100.H-J.47 R:0.01563 P:0.00737 F:0.01002
47 ROUGE-4 Eval D0740-A.M.100.I-D.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0740-A.M.100.I-H.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0740-A.M.100.I-I.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0740-A.M.100.I-J.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0740-B.M.100.I-D.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0740-B.M.100.I-H.47 R:0.00341 P:0.00212 F:0.00261
47 ROUGE-4 Eval D0740-B.M.100.I-I.47 R:0.00338 P:0.00212 F:0.00261
47 ROUGE-4 Eval D0740-B.M.100.I-J.47 R:0.00333 P:0.00212 F:0.00259
47 ROUGE-4 Eval D0740-C.M.100.I-D.47 R:0.02961 P:0.01863 F:0.02287
47 ROUGE-4 Eval D0740-C.M.100.I-H.47 R:0.01656 P:0.01035 F:0.01274
47 ROUGE-4 Eval D0740-C.M.100.I-I.47 R:0.02961 P:0.01863 F:0.02287
47 ROUGE-4 Eval D0740-C.M.100.I-J.47 R:0.02295 P:0.01449 F:0.01776
47 ROUGE-4 Eval D0743-A.M.100.J-B.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-A.M.100.J-H.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-A.M.100.J-I.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-A.M.100.J-J.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-B.M.100.J-B.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-B.M.100.J-H.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-B.M.100.J-I.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-B.M.100.J-J.47 R:0.00000 P:0.00000 F:0.00000
47 ROUGE-4 Eval D0743-C.M.100.J-B.47 R:0.00980 P:0.00676 F:0.00800
47 ROUGE-4 Eval D0743-C.M.100.J-H.47 R:0.00656 P:0.00450 F:0.00534
47 ROUGE-4 Eval D0743-C.M.100.J-I.47 R:0.01645 P:0.01126 F:0.01337
47 ROUGE-4 Eval D0743-C.M.100.J-J.47 R:0.01618 P:0.01126 F:0.01328
---------------------------------------------
47 ROUGE-L Average_R: 0.32373 (95%-conf.int. 0.31343 - 0.33259)
47 ROUGE-L Average_P: 0.19412 (95%-conf.int. 0.18800 - 0.20049)
47 ROUGE-L Average_F: 0.24215 (95%-conf.int. 0.23457 - 0.24951)
.............................................
47 ROUGE-L Eval D0703-A.M.100.A-A.47 R:0.34459 P:0.20606 F:0.25790
47 ROUGE-L Eval D0703-A.M.100.A-C.47 R:0.29866 P:0.17980 F:0.22447
47 ROUGE-L Eval D0703-A.M.100.A-D.47 R:0.32990 P:0.19394 F:0.24428
47 ROUGE-L Eval D0703-A.M.100.A-J.47 R:0.35034 P:0.20808 F:0.26109
47 ROUGE-L Eval D0703-B.M.100.A-A.47 R:0.29085 P:0.19390 F:0.23268
47 ROUGE-L Eval D0703-B.M.100.A-C.47 R:0.32550 P:0.21133 F:0.25627
47 ROUGE-L Eval D0703-B.M.100.A-D.47 R:0.31208 P:0.20261 F:0.24570
47 ROUGE-L Eval D0703-B.M.100.A-J.47 R:0.31894 P:0.20915 F:0.25263
47 ROUGE-L Eval D0703-C.M.100.A-A.47 R:0.36000 P:0.21429 F:0.26866
47 ROUGE-L Eval D0703-C.M.100.A-C.47 R:0.36688 P:0.22421 F:0.27833
47 ROUGE-L Eval D0703-C.M.100.A-D.47 R:0.36755 P:0.22024 F:0.27544
47 ROUGE-L Eval D0703-C.M.100.A-J.47 R:0.40066 P:0.24008 F:0.30025
47 ROUGE-L Eval D0706-A.M.100.B-B.47 R:0.32143 P:0.18033 F:0.23104
47 ROUGE-L Eval D0706-A.M.100.B-D.47 R:0.30719 P:0.17122 F:0.21988
47 ROUGE-L Eval D0706-A.M.100.B-E.47 R:0.25325 P:0.14208 F:0.18203
47 ROUGE-L Eval D0706-A.M.100.B-I.47 R:0.30844 P:0.17304 F:0.22170
47 ROUGE-L Eval D0706-B.M.100.B-B.47 R:0.30719 P:0.19583 F:0.23918
47 ROUGE-L Eval D0706-B.M.100.B-D.47 R:0.27362 P:0.17500 F:0.21347
47 ROUGE-L Eval D0706-B.M.100.B-E.47 R:0.27273 P:0.17500 F:0.21320
47 ROUGE-L Eval D0706-B.M.100.B-I.47 R:0.32686 P:0.21042 F:0.25602
47 ROUGE-L Eval D0706-C.M.100.B-B.47 R:0.36129 P:0.22626 F:0.27826
47 ROUGE-L Eval D0706-C.M.100.B-D.47 R:0.37419 P:0.23434 F:0.28820
47 ROUGE-L Eval D0706-C.M.100.B-E.47 R:0.33654 P:0.21212 F:0.26022
47 ROUGE-L Eval D0706-C.M.100.B-I.47 R:0.36422 P:0.23030 F:0.28218
47 ROUGE-L Eval D0711-A.M.100.C-A.47 R:0.27303 P:0.15631 F:0.19880
47 ROUGE-L Eval D0711-A.M.100.C-B.47 R:0.30667 P:0.17326 F:0.22142
47 ROUGE-L Eval D0711-A.M.100.C-C.47 R:0.29000 P:0.16384 F:0.20938
47 ROUGE-L Eval D0711-A.M.100.C-F.47 R:0.29470 P:0.16761 F:0.21369
47 ROUGE-L Eval D0711-B.M.100.C-A.47 R:0.28571 P:0.17500 F:0.21705
47 ROUGE-L Eval D0711-B.M.100.C-B.47 R:0.27397 P:0.16667 F:0.20726
47 ROUGE-L Eval D0711-B.M.100.C-C.47 R:0.26846 P:0.16667 F:0.20566
47 ROUGE-L Eval D0711-B.M.100.C-F.47 R:0.28136 P:0.17292 F:0.21420
47 ROUGE-L Eval D0711-C.M.100.C-A.47 R:0.37294 P:0.23395 F:0.28753
47 ROUGE-L Eval D0711-C.M.100.C-B.47 R:0.36860 P:0.22360 F:0.27835
47 ROUGE-L Eval D0711-C.M.100.C-C.47 R:0.38176 P:0.23395 F:0.29011
47 ROUGE-L Eval D0711-C.M.100.C-F.47 R:0.35135 P:0.21532 F:0.26701
47 ROUGE-L Eval D0716-A.M.100.D-C.47 R:0.41311 P:0.24000 F:0.30361
47 ROUGE-L Eval D0716-A.M.100.D-D.47 R:0.41000 P:0.23429 F:0.29819
47 ROUGE-L Eval D0716-A.M.100.D-E.47 R:0.42857 P:0.24571 F:0.31234
47 ROUGE-L Eval D0716-A.M.100.D-F.47 R:0.42574 P:0.24571 F:0.31159
47 ROUGE-L Eval D0716-B.M.100.D-C.47 R:0.41447 P:0.26250 F:0.32143
47 ROUGE-L Eval D0716-B.M.100.D-D.47 R:0.43289 P:0.26875 F:0.33162
47 ROUGE-L Eval D0716-B.M.100.D-E.47 R:0.40864 P:0.25625 F:0.31498
47 ROUGE-L Eval D0716-B.M.100.D-F.47 R:0.40000 P:0.25000 F:0.30769
47 ROUGE-L Eval D0716-C.M.100.D-C.47 R:0.37785 P:0.23722 F:0.29146
47 ROUGE-L Eval D0716-C.M.100.D-D.47 R:0.37793 P:0.23108 F:0.28680
47 ROUGE-L Eval D0716-C.M.100.D-E.47 R:0.39604 P:0.24540 F:0.30303
47 ROUGE-L Eval D0716-C.M.100.D-F.47 R:0.39667 P:0.24335 F:0.30165
47 ROUGE-L Eval D0721-A.M.100.E-B.47 R:0.27667 P:0.17292 F:0.21282
47 ROUGE-L Eval D0721-A.M.100.E-C.47 R:0.26299 P:0.16875 F:0.20558
47 ROUGE-L Eval D0721-A.M.100.E-E.47 R:0.24675 P:0.15833 F:0.19289
47 ROUGE-L Eval D0721-A.M.100.E-G.47 R:0.25796 P:0.16875 F:0.20403
47 ROUGE-L Eval D0721-B.M.100.E-B.47 R:0.28339 P:0.19205 F:0.22895
47 ROUGE-L Eval D0721-B.M.100.E-C.47 R:0.27707 P:0.19205 F:0.22686
47 ROUGE-L Eval D0721-B.M.100.E-E.47 R:0.25574 P:0.17219 F:0.20581
47 ROUGE-L Eval D0721-B.M.100.E-G.47 R:0.26129 P:0.17881 F:0.21232
47 ROUGE-L Eval D0721-C.M.100.E-B.47 R:0.31803 P:0.21556 F:0.25696
47 ROUGE-L Eval D0721-C.M.100.E-C.47 R:0.27393 P:0.18444 F:0.22045
47 ROUGE-L Eval D0721-C.M.100.E-E.47 R:0.27000 P:0.18000 F:0.21600
47 ROUGE-L Eval D0721-C.M.100.E-G.47 R:0.27362 P:0.18667 F:0.22193
47 ROUGE-L Eval D0726-A.M.100.F-A.47 R:0.42193 P:0.26458 F:0.32522
47 ROUGE-L Eval D0726-A.M.100.F-E.47 R:0.39333 P:0.24583 F:0.30256
47 ROUGE-L Eval D0726-A.M.100.F-F.47 R:0.41860 P:0.26250 F:0.32266
47 ROUGE-L Eval D0726-A.M.100.F-G.47 R:0.41196 P:0.25833 F:0.31754
47 ROUGE-L Eval D0726-B.M.100.F-A.47 R:0.32026 P:0.17658 F:0.22764
47 ROUGE-L Eval D0726-B.M.100.F-E.47 R:0.31894 P:0.17297 F:0.22430
47 ROUGE-L Eval D0726-B.M.100.F-F.47 R:0.32226 P:0.17477 F:0.22663
47 ROUGE-L Eval D0726-B.M.100.F-G.47 R:0.33553 P:0.18378 F:0.23748
47 ROUGE-L Eval D0726-C.M.100.F-A.47 R:0.33333 P:0.20450 F:0.25349
47 ROUGE-L Eval D0726-C.M.100.F-E.47 R:0.31987 P:0.19427 F:0.24173
47 ROUGE-L Eval D0726-C.M.100.F-F.47 R:0.33220 P:0.20041 F:0.25000
47 ROUGE-L Eval D0726-C.M.100.F-G.47 R:0.30820 P:0.19223 F:0.23678
47 ROUGE-L Eval D0727-A.M.100.G-A.47 R:0.37542 P:0.22157 F:0.27867
47 ROUGE-L Eval D0727-A.M.100.G-F.47 R:0.36842 P:0.21961 F:0.27519
47 ROUGE-L Eval D0727-A.M.100.G-G.47 R:0.34314 P:0.20588 F:0.25735
47 ROUGE-L Eval D0727-A.M.100.G-H.47 R:0.36513 P:0.21765 F:0.27273
47 ROUGE-L Eval D0727-B.M.100.G-A.47 R:0.35395 P:0.19961 F:0.25526
47 ROUGE-L Eval D0727-B.M.100.G-F.47 R:0.33766 P:0.20155 F:0.25243
47 ROUGE-L Eval D0727-B.M.100.G-G.47 R:0.31488 P:0.17636 F:0.22609
47 ROUGE-L Eval D0727-B.M.100.G-H.47 R:0.34708 P:0.19574 F:0.25031
47 ROUGE-L Eval D0727-C.M.100.G-A.47 R:0.36482 P:0.20180 F:0.25986
47 ROUGE-L Eval D0727-C.M.100.G-F.47 R:0.35690 P:0.19099 F:0.24882
47 ROUGE-L Eval D0727-C.M.100.G-G.47 R:0.33663 P:0.18378 F:0.23776
47 ROUGE-L Eval D0727-C.M.100.G-H.47 R:0.38851 P:0.20721 F:0.27027
47 ROUGE-L Eval D0736-A.M.100.H-G.47 R:0.29032 P:0.15882 F:0.20532
47 ROUGE-L Eval D0736-A.M.100.H-H.47 R:0.30292 P:0.16275 F:0.21174
47 ROUGE-L Eval D0736-A.M.100.H-I.47 R:0.30249 P:0.16667 F:0.21492
47 ROUGE-L Eval D0736-A.M.100.H-J.47 R:0.29412 P:0.17647 F:0.22059
47 ROUGE-L Eval D0736-B.M.100.H-G.47 R:0.29771 P:0.15951 F:0.20772
47 ROUGE-L Eval D0736-B.M.100.H-H.47 R:0.29752 P:0.14724 F:0.19699
47 ROUGE-L Eval D0736-B.M.100.H-I.47 R:0.33473 P:0.16360 F:0.21978
47 ROUGE-L Eval D0736-B.M.100.H-J.47 R:0.31818 P:0.18609 F:0.23483
47 ROUGE-L Eval D0736-C.M.100.H-G.47 R:0.33755 P:0.14493 F:0.20279
47 ROUGE-L Eval D0736-C.M.100.H-H.47 R:0.28342 P:0.09601 F:0.14343
47 ROUGE-L Eval D0736-C.M.100.H-I.47 R:0.39037 P:0.13225 F:0.19757
47 ROUGE-L Eval D0736-C.M.100.H-J.47 R:0.33208 P:0.15942 F:0.21542
47 ROUGE-L Eval D0740-A.M.100.I-D.47 R:0.33003 P:0.19048 F:0.24155
47 ROUGE-L Eval D0740-A.M.100.I-H.47 R:0.31373 P:0.18286 F:0.23105
47 ROUGE-L Eval D0740-A.M.100.I-I.47 R:0.33117 P:0.19429 F:0.24490
47 ROUGE-L Eval D0740-A.M.100.I-J.47 R:0.33548 P:0.19810 F:0.24910
47 ROUGE-L Eval D0740-B.M.100.I-D.47 R:0.27597 P:0.17708 F:0.21573
47 ROUGE-L Eval D0740-B.M.100.I-H.47 R:0.26490 P:0.16667 F:0.20461
47 ROUGE-L Eval D0740-B.M.100.I-I.47 R:0.26557 P:0.16875 F:0.20637
47 ROUGE-L Eval D0740-B.M.100.I-J.47 R:0.27184 P:0.17500 F:0.21293
47 ROUGE-L Eval D0740-C.M.100.I-D.47 R:0.37380 P:0.23780 F:0.29068
47 ROUGE-L Eval D0740-C.M.100.I-H.47 R:0.35691 P:0.22561 F:0.27646
47 ROUGE-L Eval D0740-C.M.100.I-I.47 R:0.38658 P:0.24593 F:0.30062
47 ROUGE-L Eval D0740-C.M.100.I-J.47 R:0.38854 P:0.24797 F:0.30273
47 ROUGE-L Eval D0743-A.M.100.J-B.47 R:0.21905 P:0.12707 F:0.16084
47 ROUGE-L Eval D0743-A.M.100.J-H.47 R:0.18827 P:0.11234 F:0.14072
47 ROUGE-L Eval D0743-A.M.100.J-I.47 R:0.23750 P:0.13996 F:0.17613
47 ROUGE-L Eval D0743-A.M.100.J-J.47 R:0.19692 P:0.11786 F:0.14746
47 ROUGE-L Eval D0743-B.M.100.J-B.47 R:0.20833 P:0.12452 F:0.15587
47 ROUGE-L Eval D0743-B.M.100.J-H.47 R:0.22082 P:0.13410 F:0.16687
47 ROUGE-L Eval D0743-B.M.100.J-I.47 R:0.24367 P:0.14751 F:0.18377
47 ROUGE-L Eval D0743-B.M.100.J-J.47 R:0.22741 P:0.13985 F:0.17319
47 ROUGE-L Eval D0743-C.M.100.J-B.47 R:0.29841 P:0.20751 F:0.24479
47 ROUGE-L Eval D0743-C.M.100.J-H.47 R:0.28344 P:0.19647 F:0.23207
47 ROUGE-L Eval D0743-C.M.100.J-I.47 R:0.30351 P:0.20971 F:0.24804
47 ROUGE-L Eval D0743-C.M.100.J-J.47 R:0.27673 P:0.19426 F:0.22827
---------------------------------------------
47 ROUGE-W-1.2 Average_R: 0.11496 (95%-conf.int. 0.11094 - 0.11866)
47 ROUGE-W-1.2 Average_P: 0.12492 (95%-conf.int. 0.12058 - 0.12926)
47 ROUGE-W-1.2 Average_F: 0.11938 (95%-conf.int. 0.11530 - 0.12324)
.............................................
47 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.47 R:0.11950 P:0.12867 F:0.12392
47 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.47 R:0.10201 P:0.11163 F:0.10660
47 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.47 R:0.11856 P:0.12850 F:0.12333
47 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.47 R:0.12946 P:0.13154 F:0.13049
47 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.47 R:0.10683 P:0.13205 F:0.11811
47 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.47 R:0.11179 P:0.13734 F:0.12325
47 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.47 R:0.11128 P:0.13551 F:0.12221
47 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.47 R:0.11758 P:0.14301 F:0.12905
47 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.47 R:0.11622 P:0.12862 F:0.12211
47 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.47 R:0.11574 P:0.13354 F:0.12400
47 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.47 R:0.11609 P:0.13203 F:0.12355
47 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.47 R:0.13254 P:0.14304 F:0.13759
47 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.47 R:0.12056 P:0.12138 F:0.12097
47 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.47 R:0.11211 P:0.11466 F:0.11337
47 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.47 R:0.09116 P:0.09274 F:0.09194
47 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.47 R:0.11214 P:0.11658 F:0.11432
47 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.47 R:0.11377 P:0.12562 F:0.11940
47 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.47 R:0.09353 P:0.10549 F:0.09915
47 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.47 R:0.09761 P:0.11055 F:0.10368
47 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.47 R:0.11231 P:0.13074 F:0.12083
47 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.47 R:0.13938 P:0.14899 F:0.14402
47 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.47 R:0.14269 P:0.15383 F:0.14805
47 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.47 R:0.12683 P:0.13542 F:0.13098
47 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.47 R:0.13967 P:0.15338 F:0.14620
47 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.47 R:0.09409 P:0.09712 F:0.09558
47 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.47 R:0.10761 P:0.11012 F:0.10885
47 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.47 R:0.10002 P:0.10148 F:0.10074
47 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.47 R:0.10236 P:0.10561 F:0.10396
47 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.47 R:0.09938 P:0.10860 F:0.10379
47 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.47 R:0.09162 P:0.10446 F:0.09762
47 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.47 R:0.09020 P:0.10520 F:0.09712
47 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.47 R:0.09439 P:0.10774 F:0.10062
47 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.47 R:0.12437 P:0.14587 F:0.13426
47 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.47 R:0.12431 P:0.14102 F:0.13214
47 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.47 R:0.12811 P:0.14907 F:0.13780
47 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.47 R:0.11670 P:0.13784 F:0.12639
47 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.47 R:0.15462 P:0.16411 F:0.15922
47 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.47 R:0.15064 P:0.16400 F:0.15704
47 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.47 R:0.16479 P:0.17644 F:0.17042
47 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.47 R:0.16066 P:0.17633 F:0.16813
47 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.47 R:0.15969 P:0.17643 F:0.16764
47 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.47 R:0.16305 P:0.18116 F:0.17163
47 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.47 R:0.15413 P:0.17206 F:0.16260
47 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.47 R:0.15083 P:0.16686 F:0.15844
47 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.47 R:0.12896 P:0.15091 F:0.13907
47 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.47 R:0.12460 P:0.14774 F:0.13519
47 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.47 R:0.13079 P:0.15705 F:0.14272
47 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.47 R:0.13265 P:0.15831 F:0.14435
47 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.47 R:0.10022 P:0.11010 F:0.10493
47 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.47 R:0.09401 P:0.10703 F:0.10010
47 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.47 R:0.08797 P:0.10141 F:0.09421
47 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.47 R:0.09446 P:0.10828 F:0.10090
47 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.47 R:0.09461 P:0.12395 F:0.10731
47 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.47 R:0.09463 P:0.12328 F:0.10707
47 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.47 R:0.08303 P:0.10973 F:0.09453
47 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.47 R:0.08322 P:0.11366 F:0.09609
47 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.47 R:0.09952 P:0.12415 F:0.11048
47 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.47 R:0.08331 P:0.10554 F:0.09312
47 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.47 R:0.09150 P:0.11385 F:0.10146
47 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.47 R:0.08606 P:0.10980 F:0.09649
47 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.47 R:0.16234 P:0.18041 F:0.17090
47 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.47 R:0.15777 P:0.17275 F:0.16492
47 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.47 R:0.16457 P:0.18381 F:0.17366
47 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.47 R:0.15427 P:0.17511 F:0.16403
47 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.47 R:0.11545 P:0.11197 F:0.11368
47 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.47 R:0.10958 P:0.10728 F:0.10842
47 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.47 R:0.11159 P:0.10996 F:0.11077
47 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.47 R:0.11430 P:0.11304 F:0.11367
47 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.47 R:0.11942 P:0.12865 F:0.12386
47 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.47 R:0.11308 P:0.12121 F:0.11700
47 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.47 R:0.11849 P:0.12802 F:0.12307
47 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.47 R:0.10804 P:0.12066 F:0.11400
47 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.47 R:0.13283 P:0.13799 F:0.13536
47 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.47 R:0.12680 P:0.13797 F:0.13215
47 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.47 R:0.11921 P:0.12668 F:0.12283
47 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.47 R:0.12980 P:0.13869 F:0.13410
47 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.47 R:0.12739 P:0.12606 F:0.12672
47 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.47 R:0.11545 P:0.12379 F:0.11947
47 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.47 R:0.11340 P:0.11376 F:0.11358
47 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.47 R:0.12581 P:0.12559 F:0.12570
47 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.47 R:0.12883 P:0.12816 F:0.12849
47 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.47 R:0.12255 P:0.12120 F:0.12187
47 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.47 R:0.11406 P:0.11462 F:0.11434
47 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.47 R:0.13560 P:0.13017 F:0.13283
47 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.47 R:0.10952 P:0.10610 F:0.10778
47 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.47 R:0.11457 P:0.10824 F:0.11132
47 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.47 R:0.11355 P:0.11179 F:0.11266
47 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.47 R:0.10457 P:0.11185 F:0.10809
47 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.47 R:0.10731 P:0.10643 F:0.10687
47 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.47 R:0.11127 P:0.10188 F:0.10637
47 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.47 R:0.12215 P:0.11027 F:0.11591
47 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.47 R:0.11499 P:0.12433 F:0.11948
47 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.47 R:0.12500 P:0.09749 F:0.10954
47 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.47 R:0.10976 P:0.06950 F:0.08511
47 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.47 R:0.14695 P:0.09082 F:0.11226
47 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.47 R:0.12127 P:0.10387 F:0.11190
47 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.47 R:0.11346 P:0.12045 F:0.11685
47 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.47 R:0.11035 P:0.11603 F:0.11312
47 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.47 R:0.11279 P:0.12239 F:0.11739
47 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.47 R:0.11390 P:0.12355 F:0.11853
47 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.47 R:0.09591 P:0.11307 F:0.10379
47 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.47 R:0.09517 P:0.10656 F:0.10054
47 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.47 R:0.09220 P:0.11009 F:0.10035
47 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.47 R:0.09709 P:0.11173 F:0.10390
47 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.47 R:0.12821 P:0.15740 F:0.14131
47 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.47 R:0.12552 P:0.14807 F:0.13587
47 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.47 R:0.13008 P:0.16183 F:0.14423
47 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.47 R:0.12990 P:0.15886 F:0.14293
47 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.47 R:0.07861 P:0.07949 F:0.07905
47 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.47 R:0.06774 P:0.06982 F:0.06876
47 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.47 R:0.08222 P:0.08598 F:0.08406
47 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.47 R:0.07098 P:0.07375 F:0.07234
47 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.47 R:0.08044 P:0.08051 F:0.08047
47 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.47 R:0.08623 P:0.08684 F:0.08653
47 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.47 R:0.09237 P:0.09423 F:0.09329
47 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.47 R:0.08913 P:0.09011 F:0.08962
47 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.47 R:0.10892 P:0.13258 F:0.11959
47 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.47 R:0.10095 P:0.11685 F:0.10832
47 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.47 R:0.10703 P:0.13179 F:0.11813
47 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.47 R:0.10122 P:0.11960 F:0.10965
---------------------------------------------
47 ROUGE-SU4 Average_R: 0.13140 (95%-conf.int. 0.12418 - 0.13810)
47 ROUGE-SU4 Average_P: 0.07797 (95%-conf.int. 0.07372 - 0.08233)
47 ROUGE-SU4 Average_F: 0.09763 (95%-conf.int. 0.09238 - 0.10281)
.............................................
47 ROUGE-SU4 Eval D0703-A.M.100.A-A.47 R:0.15336 P:0.09069 F:0.11398
47 ROUGE-SU4 Eval D0703-A.M.100.A-C.47 R:0.12874 P:0.07666 F:0.09610
47 ROUGE-SU4 Eval D0703-A.M.100.A-D.47 R:0.14664 P:0.08522 F:0.10779
47 ROUGE-SU4 Eval D0703-A.M.100.A-J.47 R:0.15385 P:0.09035 F:0.11384
47 ROUGE-SU4 Eval D0703-B.M.100.A-A.47 R:0.12416 P:0.08204 F:0.09880
47 ROUGE-SU4 Eval D0703-B.M.100.A-C.47 R:0.13506 P:0.08684 F:0.10571
47 ROUGE-SU4 Eval D0703-B.M.100.A-D.47 R:0.13621 P:0.08758 F:0.10661
47 ROUGE-SU4 Eval D0703-B.M.100.A-J.47 R:0.13936 P:0.09054 F:0.10977
47 ROUGE-SU4 Eval D0703-C.M.100.A-A.47 R:0.13699 P:0.08065 F:0.10153
47 ROUGE-SU4 Eval D0703-C.M.100.A-C.47 R:0.14389 P:0.08703 F:0.10846
47 ROUGE-SU4 Eval D0703-C.M.100.A-D.47 R:0.13946 P:0.08266 F:0.10380
47 ROUGE-SU4 Eval D0703-C.M.100.A-J.47 R:0.15079 P:0.08938 F:0.11223
47 ROUGE-SU4 Eval D0706-A.M.100.B-B.47 R:0.14167 P:0.07856 F:0.10107
47 ROUGE-SU4 Eval D0706-A.M.100.B-D.47 R:0.13870 P:0.07640 F:0.09853
47 ROUGE-SU4 Eval D0706-A.M.100.B-E.47 R:0.08500 P:0.04713 F:0.06064
47 ROUGE-SU4 Eval D0706-A.M.100.B-I.47 R:0.13222 P:0.07332 F:0.09433
47 ROUGE-SU4 Eval D0706-B.M.100.B-B.47 R:0.12752 P:0.08051 F:0.09870
47 ROUGE-SU4 Eval D0706-B.M.100.B-D.47 R:0.10089 P:0.06391 F:0.07825
47 ROUGE-SU4 Eval D0706-B.M.100.B-E.47 R:0.08833 P:0.05614 F:0.06865
47 ROUGE-SU4 Eval D0706-B.M.100.B-I.47 R:0.12901 P:0.08227 F:0.10047
47 ROUGE-SU4 Eval D0706-C.M.100.B-B.47 R:0.16998 P:0.10541 F:0.13013
47 ROUGE-SU4 Eval D0706-C.M.100.B-D.47 R:0.17494 P:0.10849 F:0.13393
47 ROUGE-SU4 Eval D0706-C.M.100.B-E.47 R:0.14364 P:0.08966 F:0.11041
47 ROUGE-SU4 Eval D0706-C.M.100.B-I.47 R:0.17923 P:0.11225 F:0.13804
47 ROUGE-SU4 Eval D0711-A.M.100.C-A.47 R:0.10360 P:0.05864 F:0.07489
47 ROUGE-SU4 Eval D0711-A.M.100.C-B.47 R:0.11530 P:0.06437 F:0.08262
47 ROUGE-SU4 Eval D0711-A.M.100.C-C.47 R:0.10046 P:0.05609 F:0.07199
47 ROUGE-SU4 Eval D0711-A.M.100.C-F.47 R:0.11508 P:0.06469 F:0.08282
47 ROUGE-SU4 Eval D0711-B.M.100.C-A.47 R:0.09207 P:0.05579 F:0.06948
47 ROUGE-SU4 Eval D0711-B.M.100.C-B.47 R:0.09038 P:0.05438 F:0.06790
47 ROUGE-SU4 Eval D0711-B.M.100.C-C.47 R:0.08161 P:0.05014 F:0.06212
47 ROUGE-SU4 Eval D0711-B.M.100.C-F.47 R:0.09350 P:0.05685 F:0.07071
47 ROUGE-SU4 Eval D0711-C.M.100.C-A.47 R:0.14689 P:0.09123 F:0.11255
47 ROUGE-SU4 Eval D0711-C.M.100.C-B.47 R:0.14561 P:0.08737 F:0.10921
47 ROUGE-SU4 Eval D0711-C.M.100.C-C.47 R:0.16088 P:0.09754 F:0.12145
47 ROUGE-SU4 Eval D0711-C.M.100.C-F.47 R:0.15567 P:0.09439 F:0.11752
47 ROUGE-SU4 Eval D0716-A.M.100.D-C.47 R:0.19697 P:0.11315 F:0.14373
47 ROUGE-SU4 Eval D0716-A.M.100.D-D.47 R:0.21404 P:0.12089 F:0.15451
47 ROUGE-SU4 Eval D0716-A.M.100.D-E.47 R:0.22298 P:0.12637 F:0.16132
47 ROUGE-SU4 Eval D0716-A.M.100.D-F.47 R:0.21582 P:0.12315 F:0.15682
47 ROUGE-SU4 Eval D0716-B.M.100.D-C.47 R:0.20833 P:0.13065 F:0.16059
47 ROUGE-SU4 Eval D0716-B.M.100.D-D.47 R:0.21782 P:0.13383 F:0.16579
47 ROUGE-SU4 Eval D0716-B.M.100.D-E.47 R:0.20819 P:0.12924 F:0.15948
47 ROUGE-SU4 Eval D0716-B.M.100.D-F.47 R:0.21290 P:0.13171 F:0.16274
47 ROUGE-SU4 Eval D0716-C.M.100.D-C.47 R:0.15329 P:0.09529 F:0.11752
47 ROUGE-SU4 Eval D0716-C.M.100.D-D.47 R:0.16781 P:0.10152 F:0.12651
47 ROUGE-SU4 Eval D0716-C.M.100.D-E.47 R:0.16271 P:0.09979 F:0.12371
47 ROUGE-SU4 Eval D0716-C.M.100.D-F.47 R:0.17066 P:0.10360 F:0.12893
47 ROUGE-SU4 Eval D0721-A.M.100.E-B.47 R:0.08961 P:0.05544 F:0.06850
47 ROUGE-SU4 Eval D0721-A.M.100.E-C.47 R:0.08222 P:0.05226 F:0.06390
47 ROUGE-SU4 Eval D0721-A.M.100.E-E.47 R:0.07722 P:0.04908 F:0.06002
47 ROUGE-SU4 Eval D0721-A.M.100.E-G.47 R:0.08170 P:0.05297 F:0.06427
47 ROUGE-SU4 Eval D0721-B.M.100.E-B.47 R:0.10758 P:0.07228 F:0.08647
47 ROUGE-SU4 Eval D0721-B.M.100.E-C.47 R:0.10240 P:0.07041 F:0.08344
47 ROUGE-SU4 Eval D0721-B.M.100.E-E.47 R:0.09147 P:0.06105 F:0.07323
47 ROUGE-SU4 Eval D0721-B.M.100.E-G.47 R:0.09382 P:0.06367 F:0.07586
47 ROUGE-SU4 Eval D0721-C.M.100.E-B.47 R:0.13580 P:0.09125 F:0.10915
47 ROUGE-SU4 Eval D0721-C.M.100.E-C.47 R:0.11525 P:0.07692 F:0.09226
47 ROUGE-SU4 Eval D0721-C.M.100.E-E.47 R:0.10559 P:0.06976 F:0.08401
47 ROUGE-SU4 Eval D0721-C.M.100.E-G.47 R:0.11315 P:0.07655 F:0.09132
47 ROUGE-SU4 Eval D0726-A.M.100.F-A.47 R:0.21957 P:0.13630 F:0.16819
47 ROUGE-SU4 Eval D0726-A.M.100.F-E.47 R:0.18721 P:0.11582 F:0.14311
47 ROUGE-SU4 Eval D0726-A.M.100.F-F.47 R:0.21843 P:0.13559 F:0.16732
47 ROUGE-SU4 Eval D0726-A.M.100.F-G.47 R:0.20307 P:0.12606 F:0.15556
47 ROUGE-SU4 Eval D0726-B.M.100.F-A.47 R:0.11353 P:0.06185 F:0.08008
47 ROUGE-SU4 Eval D0726-B.M.100.F-E.47 R:0.10922 P:0.05850 F:0.07619
47 ROUGE-SU4 Eval D0726-B.M.100.F-F.47 R:0.11490 P:0.06155 F:0.08016
47 ROUGE-SU4 Eval D0726-B.M.100.F-G.47 R:0.11655 P:0.06307 F:0.08185
47 ROUGE-SU4 Eval D0726-C.M.100.F-A.47 R:0.11701 P:0.07103 F:0.08840
47 ROUGE-SU4 Eval D0726-C.M.100.F-E.47 R:0.11419 P:0.06861 F:0.08572
47 ROUGE-SU4 Eval D0726-C.M.100.F-F.47 R:0.11905 P:0.07103 F:0.08897
47 ROUGE-SU4 Eval D0726-C.M.100.F-G.47 R:0.10662 P:0.06584 F:0.08141
47 ROUGE-SU4 Eval D0727-A.M.100.G-A.47 R:0.15074 P:0.08798 F:0.11111
47 ROUGE-SU4 Eval D0727-A.M.100.G-F.47 R:0.15597 P:0.09197 F:0.11571
47 ROUGE-SU4 Eval D0727-A.M.100.G-G.47 R:0.12528 P:0.07437 F:0.09333
47 ROUGE-SU4 Eval D0727-A.M.100.G-H.47 R:0.15484 P:0.09130 F:0.11487
47 ROUGE-SU4 Eval D0727-B.M.100.G-A.47 R:0.13781 P:0.07677 F:0.09861
47 ROUGE-SU4 Eval D0727-B.M.100.G-F.47 R:0.11833 P:0.06988 F:0.08787
47 ROUGE-SU4 Eval D0727-B.M.100.G-G.47 R:0.11922 P:0.06594 F:0.08491
47 ROUGE-SU4 Eval D0727-B.M.100.G-H.47 R:0.14134 P:0.07874 F:0.10114
47 ROUGE-SU4 Eval D0727-C.M.100.G-A.47 R:0.15050 P:0.08227 F:0.10639
47 ROUGE-SU4 Eval D0727-C.M.100.G-F.47 R:0.14764 P:0.07800 F:0.10207
47 ROUGE-SU4 Eval D0727-C.M.100.G-G.47 R:0.12260 P:0.06612 F:0.08591
47 ROUGE-SU4 Eval D0727-C.M.100.G-H.47 R:0.15336 P:0.08074 F:0.10579
47 ROUGE-SU4 Eval D0736-A.M.100.H-G.47 R:0.11624 P:0.06275 F:0.08150
47 ROUGE-SU4 Eval D0736-A.M.100.H-H.47 R:0.12782 P:0.06773 F:0.08854
47 ROUGE-SU4 Eval D0736-A.M.100.H-I.47 R:0.12698 P:0.06906 F:0.08946
47 ROUGE-SU4 Eval D0736-A.M.100.H-J.47 R:0.11018 P:0.06541 F:0.08209
47 ROUGE-SU4 Eval D0736-B.M.100.H-G.47 R:0.10761 P:0.05683 F:0.07438
47 ROUGE-SU4 Eval D0736-B.M.100.H-H.47 R:0.11040 P:0.05371 F:0.07226
47 ROUGE-SU4 Eval D0736-B.M.100.H-I.47 R:0.12698 P:0.06098 F:0.08239
47 ROUGE-SU4 Eval D0736-B.M.100.H-J.47 R:0.12050 P:0.06965 F:0.08828
47 ROUGE-SU4 Eval D0736-C.M.100.H-G.47 R:0.14483 P:0.06097 F:0.08581
47 ROUGE-SU4 Eval D0736-C.M.100.H-H.47 R:0.11639 P:0.03830 F:0.05763
47 ROUGE-SU4 Eval D0736-C.M.100.H-I.47 R:0.17784 P:0.05852 F:0.08806
47 ROUGE-SU4 Eval D0736-C.M.100.H-J.47 R:0.12905 P:0.06097 F:0.08281
47 ROUGE-SU4 Eval D0740-A.M.100.I-D.47 R:0.12203 P:0.06963 F:0.08867
47 ROUGE-SU4 Eval D0740-A.M.100.I-H.47 R:0.11633 P:0.06705 F:0.08507
47 ROUGE-SU4 Eval D0740-A.M.100.I-I.47 R:0.12556 P:0.07286 F:0.09221
47 ROUGE-SU4 Eval D0740-A.M.100.I-J.47 R:0.12307 P:0.07189 F:0.09076
47 ROUGE-SU4 Eval D0740-B.M.100.I-D.47 R:0.09444 P:0.06003 F:0.07340
47 ROUGE-SU4 Eval D0740-B.M.100.I-H.47 R:0.08673 P:0.05403 F:0.06658
47 ROUGE-SU4 Eval D0740-B.M.100.I-I.47 R:0.09596 P:0.06038 F:0.07412
47 ROUGE-SU4 Eval D0740-B.M.100.I-J.47 R:0.09358 P:0.05968 F:0.07288
47 ROUGE-SU4 Eval D0740-C.M.100.I-D.47 R:0.17213 P:0.10847 F:0.13308
47 ROUGE-SU4 Eval D0740-C.M.100.I-H.47 R:0.15512 P:0.09711 F:0.11944
47 ROUGE-SU4 Eval D0740-C.M.100.I-I.47 R:0.18033 P:0.11364 F:0.13942
47 ROUGE-SU4 Eval D0740-C.M.100.I-J.47 R:0.18464 P:0.11674 F:0.14304
47 ROUGE-SU4 Eval D0743-A.M.100.J-B.47 R:0.06189 P:0.03551 F:0.04513
47 ROUGE-SU4 Eval D0743-A.M.100.J-H.47 R:0.04905 P:0.02897 F:0.03643
47 ROUGE-SU4 Eval D0743-A.M.100.J-I.47 R:0.06677 P:0.03894 F:0.04919
47 ROUGE-SU4 Eval D0743-A.M.100.J-J.47 R:0.05258 P:0.03115 F:0.03912
47 ROUGE-SU4 Eval D0743-B.M.100.J-B.47 R:0.07182 P:0.04248 F:0.05338
47 ROUGE-SU4 Eval D0743-B.M.100.J-H.47 R:0.07767 P:0.04669 F:0.05832
47 ROUGE-SU4 Eval D0743-B.M.100.J-I.47 R:0.08604 P:0.05156 F:0.06448
47 ROUGE-SU4 Eval D0743-B.M.100.J-J.47 R:0.07561 P:0.04604 F:0.05723
47 ROUGE-SU4 Eval D0743-C.M.100.J-B.47 R:0.12921 P:0.08914 F:0.10550
47 ROUGE-SU4 Eval D0743-C.M.100.J-H.47 R:0.10512 P:0.07228 F:0.08566
47 ROUGE-SU4 Eval D0743-C.M.100.J-I.47 R:0.13716 P:0.09401 F:0.11156
47 ROUGE-SU4 Eval D0743-C.M.100.J-J.47 R:0.11237 P:0.07828 F:0.09228
---------------------------------------------
48 ROUGE-1 Average_R: 0.34636 (95%-conf.int. 0.33520 - 0.35729)
48 ROUGE-1 Average_P: 0.23587 (95%-conf.int. 0.22871 - 0.24319)
48 ROUGE-1 Average_F: 0.27974 (95%-conf.int. 0.27129 - 0.28776)
.............................................
48 ROUGE-1 Eval D0703-A.M.100.A-A.48 R:0.40203 P:0.26802 F:0.32162
48 ROUGE-1 Eval D0703-A.M.100.A-C.48 R:0.36913 P:0.24775 F:0.29650
48 ROUGE-1 Eval D0703-A.M.100.A-D.48 R:0.38144 P:0.25000 F:0.30204
48 ROUGE-1 Eval D0703-A.M.100.A-J.48 R:0.40476 P:0.26802 F:0.32249
48 ROUGE-1 Eval D0703-B.M.100.A-A.48 R:0.33007 P:0.23877 F:0.27709
48 ROUGE-1 Eval D0703-B.M.100.A-C.48 R:0.32550 P:0.22931 F:0.26907
48 ROUGE-1 Eval D0703-B.M.100.A-D.48 R:0.31544 P:0.22222 F:0.26075
48 ROUGE-1 Eval D0703-B.M.100.A-J.48 R:0.34551 P:0.24586 F:0.28729
48 ROUGE-1 Eval D0703-C.M.100.A-A.48 R:0.36000 P:0.28346 F:0.31718
48 ROUGE-1 Eval D0703-C.M.100.A-C.48 R:0.36039 P:0.29134 F:0.32221
48 ROUGE-1 Eval D0703-C.M.100.A-D.48 R:0.35430 P:0.28084 F:0.31332
48 ROUGE-1 Eval D0703-C.M.100.A-J.48 R:0.36093 P:0.28609 F:0.31918
48 ROUGE-1 Eval D0706-A.M.100.B-B.48 R:0.34740 P:0.25296 F:0.29275
48 ROUGE-1 Eval D0706-A.M.100.B-D.48 R:0.34641 P:0.25059 F:0.29081
48 ROUGE-1 Eval D0706-A.M.100.B-E.48 R:0.29545 P:0.21513 F:0.24897
48 ROUGE-1 Eval D0706-A.M.100.B-I.48 R:0.32792 P:0.23877 F:0.27633
48 ROUGE-1 Eval D0706-B.M.100.B-B.48 R:0.26471 P:0.16981 F:0.20690
48 ROUGE-1 Eval D0706-B.M.100.B-D.48 R:0.23779 P:0.15304 F:0.18623
48 ROUGE-1 Eval D0706-B.M.100.B-E.48 R:0.23052 P:0.14885 F:0.18089
48 ROUGE-1 Eval D0706-B.M.100.B-I.48 R:0.27184 P:0.17610 F:0.21374
48 ROUGE-1 Eval D0706-C.M.100.B-B.48 R:0.33226 P:0.23043 F:0.27213
48 ROUGE-1 Eval D0706-C.M.100.B-D.48 R:0.37419 P:0.25951 F:0.30647
48 ROUGE-1 Eval D0706-C.M.100.B-E.48 R:0.35897 P:0.25056 F:0.29512
48 ROUGE-1 Eval D0706-C.M.100.B-I.48 R:0.38019 P:0.26622 F:0.31316
48 ROUGE-1 Eval D0711-A.M.100.C-A.48 R:0.42105 P:0.28444 F:0.33952
48 ROUGE-1 Eval D0711-A.M.100.C-B.48 R:0.43333 P:0.28889 F:0.34667
48 ROUGE-1 Eval D0711-A.M.100.C-C.48 R:0.40000 P:0.26667 F:0.32000
48 ROUGE-1 Eval D0711-A.M.100.C-F.48 R:0.41722 P:0.28000 F:0.33511
48 ROUGE-1 Eval D0711-B.M.100.C-A.48 R:0.34694 P:0.21384 F:0.26459
48 ROUGE-1 Eval D0711-B.M.100.C-B.48 R:0.36986 P:0.22642 F:0.28089
48 ROUGE-1 Eval D0711-B.M.100.C-C.48 R:0.35570 P:0.22222 F:0.27355
48 ROUGE-1 Eval D0711-B.M.100.C-F.48 R:0.32203 P:0.19916 F:0.24611
48 ROUGE-1 Eval D0711-C.M.100.C-A.48 R:0.32343 P:0.22072 F:0.26238
48 ROUGE-1 Eval D0711-C.M.100.C-B.48 R:0.34130 P:0.22523 F:0.27137
48 ROUGE-1 Eval D0711-C.M.100.C-C.48 R:0.32095 P:0.21396 F:0.25676
48 ROUGE-1 Eval D0711-C.M.100.C-F.48 R:0.29730 P:0.19820 F:0.23784
48 ROUGE-1 Eval D0716-A.M.100.D-C.48 R:0.44918 P:0.30856 F:0.36582
48 ROUGE-1 Eval D0716-A.M.100.D-D.48 R:0.46667 P:0.31532 F:0.37635
48 ROUGE-1 Eval D0716-A.M.100.D-E.48 R:0.48173 P:0.32658 F:0.38926
48 ROUGE-1 Eval D0716-A.M.100.D-F.48 R:0.43894 P:0.29955 F:0.35609
48 ROUGE-1 Eval D0716-B.M.100.D-C.48 R:0.36184 P:0.27160 F:0.31029
48 ROUGE-1 Eval D0716-B.M.100.D-D.48 R:0.37584 P:0.27654 F:0.31863
48 ROUGE-1 Eval D0716-B.M.100.D-E.48 R:0.36213 P:0.26914 F:0.30879
48 ROUGE-1 Eval D0716-B.M.100.D-F.48 R:0.36667 P:0.27160 F:0.31205
48 ROUGE-1 Eval D0716-C.M.100.D-C.48 R:0.39739 P:0.27111 F:0.32232
48 ROUGE-1 Eval D0716-C.M.100.D-D.48 R:0.38462 P:0.25556 F:0.30708
48 ROUGE-1 Eval D0716-C.M.100.D-E.48 R:0.44224 P:0.29778 F:0.35591
48 ROUGE-1 Eval D0716-C.M.100.D-F.48 R:0.39333 P:0.26222 F:0.31466
48 ROUGE-1 Eval D0721-A.M.100.E-B.48 R:0.34333 P:0.24879 F:0.28851
48 ROUGE-1 Eval D0721-A.M.100.E-C.48 R:0.34416 P:0.25604 F:0.29363
48 ROUGE-1 Eval D0721-A.M.100.E-E.48 R:0.30519 P:0.22705 F:0.26038
48 ROUGE-1 Eval D0721-A.M.100.E-G.48 R:0.32484 P:0.24638 F:0.28022
48 ROUGE-1 Eval D0721-B.M.100.E-B.48 R:0.29967 P:0.21296 F:0.24898
48 ROUGE-1 Eval D0721-B.M.100.E-C.48 R:0.27070 P:0.19676 F:0.22788
48 ROUGE-1 Eval D0721-B.M.100.E-E.48 R:0.25574 P:0.18056 F:0.21167
48 ROUGE-1 Eval D0721-B.M.100.E-G.48 R:0.25161 P:0.18056 F:0.21024
48 ROUGE-1 Eval D0721-C.M.100.E-B.48 R:0.29180 P:0.22997 F:0.25722
48 ROUGE-1 Eval D0721-C.M.100.E-C.48 R:0.23762 P:0.18605 F:0.20870
48 ROUGE-1 Eval D0721-C.M.100.E-E.48 R:0.26667 P:0.20672 F:0.23290
48 ROUGE-1 Eval D0721-C.M.100.E-G.48 R:0.25081 P:0.19897 F:0.22190
48 ROUGE-1 Eval D0726-A.M.100.F-A.48 R:0.44186 P:0.32598 F:0.37518
48 ROUGE-1 Eval D0726-A.M.100.F-E.48 R:0.40333 P:0.29657 F:0.34181
48 ROUGE-1 Eval D0726-A.M.100.F-F.48 R:0.44518 P:0.32843 F:0.37800
48 ROUGE-1 Eval D0726-A.M.100.F-G.48 R:0.40532 P:0.29902 F:0.34415
48 ROUGE-1 Eval D0726-B.M.100.F-A.48 R:0.30392 P:0.19255 F:0.23574
48 ROUGE-1 Eval D0726-B.M.100.F-E.48 R:0.32890 P:0.20497 F:0.25255
48 ROUGE-1 Eval D0726-B.M.100.F-F.48 R:0.34884 P:0.21739 F:0.26786
48 ROUGE-1 Eval D0726-B.M.100.F-G.48 R:0.32566 P:0.20497 F:0.25159
48 ROUGE-1 Eval D0726-C.M.100.F-A.48 R:0.23000 P:0.18110 F:0.20264
48 ROUGE-1 Eval D0726-C.M.100.F-E.48 R:0.22896 P:0.17848 F:0.20059
48 ROUGE-1 Eval D0726-C.M.100.F-F.48 R:0.23729 P:0.18373 F:0.20710
48 ROUGE-1 Eval D0726-C.M.100.F-G.48 R:0.22623 P:0.18110 F:0.20116
48 ROUGE-1 Eval D0727-A.M.100.G-A.48 R:0.45515 P:0.32388 F:0.37846
48 ROUGE-1 Eval D0727-A.M.100.G-F.48 R:0.42434 P:0.30496 F:0.35488
48 ROUGE-1 Eval D0727-A.M.100.G-G.48 R:0.39542 P:0.28605 F:0.33196
48 ROUGE-1 Eval D0727-A.M.100.G-H.48 R:0.45395 P:0.32624 F:0.37964
48 ROUGE-1 Eval D0727-B.M.100.G-A.48 R:0.34708 P:0.21308 F:0.26405
48 ROUGE-1 Eval D0727-B.M.100.G-F.48 R:0.33442 P:0.21730 F:0.26343
48 ROUGE-1 Eval D0727-B.M.100.G-G.48 R:0.30450 P:0.18565 F:0.23067
48 ROUGE-1 Eval D0727-B.M.100.G-H.48 R:0.32646 P:0.20042 F:0.24836
48 ROUGE-1 Eval D0727-C.M.100.G-A.48 R:0.35505 P:0.22996 F:0.27913
48 ROUGE-1 Eval D0727-C.M.100.G-F.48 R:0.36364 P:0.22785 F:0.28016
48 ROUGE-1 Eval D0727-C.M.100.G-G.48 R:0.33333 P:0.21308 F:0.25997
48 ROUGE-1 Eval D0727-C.M.100.G-H.48 R:0.38514 P:0.24051 F:0.29611
48 ROUGE-1 Eval D0736-A.M.100.H-G.48 R:0.33333 P:0.19497 F:0.24603
48 ROUGE-1 Eval D0736-A.M.100.H-H.48 R:0.34307 P:0.19706 F:0.25033
48 ROUGE-1 Eval D0736-A.M.100.H-I.48 R:0.34164 P:0.20126 F:0.25330
48 ROUGE-1 Eval D0736-A.M.100.H-J.48 R:0.32026 P:0.20545 F:0.25032
48 ROUGE-1 Eval D0736-B.M.100.H-G.48 R:0.41985 P:0.24775 F:0.31162
48 ROUGE-1 Eval D0736-B.M.100.H-H.48 R:0.42562 P:0.23198 F:0.30029
48 ROUGE-1 Eval D0736-B.M.100.H-I.48 R:0.46025 P:0.24775 F:0.32211
48 ROUGE-1 Eval D0736-B.M.100.H-J.48 R:0.43357 P:0.27928 F:0.33973
48 ROUGE-1 Eval D0736-C.M.100.H-G.48 R:0.41772 P:0.20497 F:0.27500
48 ROUGE-1 Eval D0736-C.M.100.H-H.48 R:0.35294 P:0.13665 F:0.19702
48 ROUGE-1 Eval D0736-C.M.100.H-I.48 R:0.51337 P:0.19876 F:0.28657
48 ROUGE-1 Eval D0736-C.M.100.H-J.48 R:0.40755 P:0.22360 F:0.28877
48 ROUGE-1 Eval D0740-A.M.100.I-D.48 R:0.35644 P:0.23841 F:0.28572
48 ROUGE-1 Eval D0740-A.M.100.I-H.48 R:0.36928 P:0.24945 F:0.29776
48 ROUGE-1 Eval D0740-A.M.100.I-I.48 R:0.38312 P:0.26049 F:0.31012
48 ROUGE-1 Eval D0740-A.M.100.I-J.48 R:0.37742 P:0.25828 F:0.30669
48 ROUGE-1 Eval D0740-B.M.100.I-D.48 R:0.37013 P:0.25503 F:0.30198
48 ROUGE-1 Eval D0740-B.M.100.I-H.48 R:0.34437 P:0.23266 F:0.27770
48 ROUGE-1 Eval D0740-B.M.100.I-I.48 R:0.35082 P:0.23937 F:0.28457
48 ROUGE-1 Eval D0740-B.M.100.I-J.48 R:0.35599 P:0.24609 F:0.29101
48 ROUGE-1 Eval D0740-C.M.100.I-D.48 R:0.33866 P:0.25420 F:0.29041
48 ROUGE-1 Eval D0740-C.M.100.I-H.48 R:0.30225 P:0.22542 F:0.25824
48 ROUGE-1 Eval D0740-C.M.100.I-I.48 R:0.33546 P:0.25180 F:0.28767
48 ROUGE-1 Eval D0740-C.M.100.I-J.48 R:0.33758 P:0.25420 F:0.29002
48 ROUGE-1 Eval D0743-A.M.100.J-B.48 R:0.28889 P:0.21212 F:0.24462
48 ROUGE-1 Eval D0743-A.M.100.J-H.48 R:0.27469 P:0.20746 F:0.23639
48 ROUGE-1 Eval D0743-A.M.100.J-I.48 R:0.26875 P:0.20047 F:0.22964
48 ROUGE-1 Eval D0743-A.M.100.J-J.48 R:0.24308 P:0.18415 F:0.20955
48 ROUGE-1 Eval D0743-B.M.100.J-B.48 R:0.26603 P:0.16179 F:0.20121
48 ROUGE-1 Eval D0743-B.M.100.J-H.48 R:0.23344 P:0.14425 F:0.17831
48 ROUGE-1 Eval D0743-B.M.100.J-I.48 R:0.24051 P:0.14815 F:0.18336
48 ROUGE-1 Eval D0743-B.M.100.J-J.48 R:0.23676 P:0.14815 F:0.18226
48 ROUGE-1 Eval D0743-C.M.100.J-B.48 R:0.34286 P:0.26471 F:0.29876
48 ROUGE-1 Eval D0743-C.M.100.J-H.48 R:0.30892 P:0.23775 F:0.26870
48 ROUGE-1 Eval D0743-C.M.100.J-I.48 R:0.34824 P:0.26716 F:0.30236
48 ROUGE-1 Eval D0743-C.M.100.J-J.48 R:0.30503 P:0.23775 F:0.26722
---------------------------------------------
48 ROUGE-2 Average_R: 0.08771 (95%-conf.int. 0.07984 - 0.09577)
48 ROUGE-2 Average_P: 0.05904 (95%-conf.int. 0.05404 - 0.06404)
48 ROUGE-2 Average_F: 0.07032 (95%-conf.int. 0.06434 - 0.07644)
.............................................
48 ROUGE-2 Eval D0703-A.M.100.A-A.48 R:0.12628 P:0.08390 F:0.10082
48 ROUGE-2 Eval D0703-A.M.100.A-C.48 R:0.09831 P:0.06576 F:0.07881
48 ROUGE-2 Eval D0703-A.M.100.A-D.48 R:0.12847 P:0.08390 F:0.10151
48 ROUGE-2 Eval D0703-A.M.100.A-J.48 R:0.14089 P:0.09297 F:0.11202
48 ROUGE-2 Eval D0703-B.M.100.A-A.48 R:0.13531 P:0.09762 F:0.11342
48 ROUGE-2 Eval D0703-B.M.100.A-C.48 R:0.12203 P:0.08571 F:0.10070
48 ROUGE-2 Eval D0703-B.M.100.A-D.48 R:0.11864 P:0.08333 F:0.09790
48 ROUGE-2 Eval D0703-B.M.100.A-J.48 R:0.14765 P:0.10476 F:0.12256
48 ROUGE-2 Eval D0703-C.M.100.A-A.48 R:0.08081 P:0.06349 F:0.07111
48 ROUGE-2 Eval D0703-C.M.100.A-C.48 R:0.07869 P:0.06349 F:0.07028
48 ROUGE-2 Eval D0703-C.M.100.A-D.48 R:0.06355 P:0.05026 F:0.05613
48 ROUGE-2 Eval D0703-C.M.100.A-J.48 R:0.07692 P:0.06085 F:0.06795
48 ROUGE-2 Eval D0706-A.M.100.B-B.48 R:0.10164 P:0.07381 F:0.08552
48 ROUGE-2 Eval D0706-A.M.100.B-D.48 R:0.12541 P:0.09048 F:0.10512
48 ROUGE-2 Eval D0706-A.M.100.B-E.48 R:0.07541 P:0.05476 F:0.06345
48 ROUGE-2 Eval D0706-A.M.100.B-I.48 R:0.10164 P:0.07381 F:0.08552
48 ROUGE-2 Eval D0706-B.M.100.B-B.48 R:0.08251 P:0.05274 F:0.06435
48 ROUGE-2 Eval D0706-B.M.100.B-D.48 R:0.06250 P:0.04008 F:0.04884
48 ROUGE-2 Eval D0706-B.M.100.B-E.48 R:0.03607 P:0.02321 F:0.02825
48 ROUGE-2 Eval D0706-B.M.100.B-I.48 R:0.07516 P:0.04852 F:0.05897
48 ROUGE-2 Eval D0706-C.M.100.B-B.48 R:0.07492 P:0.05180 F:0.06125
48 ROUGE-2 Eval D0706-C.M.100.B-D.48 R:0.12378 P:0.08559 F:0.10120
48 ROUGE-2 Eval D0706-C.M.100.B-E.48 R:0.09061 P:0.06306 F:0.07437
48 ROUGE-2 Eval D0706-C.M.100.B-I.48 R:0.11935 P:0.08333 F:0.09814
48 ROUGE-2 Eval D0711-A.M.100.C-A.48 R:0.11296 P:0.07606 F:0.09091
48 ROUGE-2 Eval D0711-A.M.100.C-B.48 R:0.11111 P:0.07383 F:0.08871
48 ROUGE-2 Eval D0711-A.M.100.C-C.48 R:0.10101 P:0.06711 F:0.08064
48 ROUGE-2 Eval D0711-A.M.100.C-F.48 R:0.08696 P:0.05817 F:0.06971
48 ROUGE-2 Eval D0711-B.M.100.C-A.48 R:0.06529 P:0.04008 F:0.04967
48 ROUGE-2 Eval D0711-B.M.100.C-B.48 R:0.08304 P:0.05063 F:0.06291
48 ROUGE-2 Eval D0711-B.M.100.C-C.48 R:0.07458 P:0.04641 F:0.05722
48 ROUGE-2 Eval D0711-B.M.100.C-F.48 R:0.05479 P:0.03376 F:0.04178
48 ROUGE-2 Eval D0711-C.M.100.C-A.48 R:0.07000 P:0.04762 F:0.05668
48 ROUGE-2 Eval D0711-C.M.100.C-B.48 R:0.07586 P:0.04989 F:0.06019
48 ROUGE-2 Eval D0711-C.M.100.C-C.48 R:0.05461 P:0.03628 F:0.04360
48 ROUGE-2 Eval D0711-C.M.100.C-F.48 R:0.05461 P:0.03628 F:0.04360
48 ROUGE-2 Eval D0716-A.M.100.D-C.48 R:0.17881 P:0.12245 F:0.14536
48 ROUGE-2 Eval D0716-A.M.100.D-D.48 R:0.19529 P:0.13152 F:0.15718
48 ROUGE-2 Eval D0716-A.M.100.D-E.48 R:0.18792 P:0.12698 F:0.15155
48 ROUGE-2 Eval D0716-A.M.100.D-F.48 R:0.18000 P:0.12245 F:0.14575
48 ROUGE-2 Eval D0716-B.M.100.D-C.48 R:0.08306 P:0.06219 F:0.07113
48 ROUGE-2 Eval D0716-B.M.100.D-D.48 R:0.08814 P:0.06468 F:0.07461
48 ROUGE-2 Eval D0716-B.M.100.D-E.48 R:0.07718 P:0.05721 F:0.06571
48 ROUGE-2 Eval D0716-B.M.100.D-F.48 R:0.10438 P:0.07711 F:0.08870
48 ROUGE-2 Eval D0716-C.M.100.D-C.48 R:0.12171 P:0.08277 F:0.09853
48 ROUGE-2 Eval D0716-C.M.100.D-D.48 R:0.07770 P:0.05145 F:0.06191
48 ROUGE-2 Eval D0716-C.M.100.D-E.48 R:0.14333 P:0.09620 F:0.11513
48 ROUGE-2 Eval D0716-C.M.100.D-F.48 R:0.10774 P:0.07159 F:0.08602
48 ROUGE-2 Eval D0721-A.M.100.E-B.48 R:0.04714 P:0.03406 F:0.03955
48 ROUGE-2 Eval D0721-A.M.100.E-C.48 R:0.05574 P:0.04136 F:0.04749
48 ROUGE-2 Eval D0721-A.M.100.E-E.48 R:0.05574 P:0.04136 F:0.04749
48 ROUGE-2 Eval D0721-A.M.100.E-G.48 R:0.05788 P:0.04380 F:0.04987
48 ROUGE-2 Eval D0721-B.M.100.E-B.48 R:0.04605 P:0.03263 F:0.03820
48 ROUGE-2 Eval D0721-B.M.100.E-C.48 R:0.04180 P:0.03030 F:0.03513
48 ROUGE-2 Eval D0721-B.M.100.E-E.48 R:0.04305 P:0.03030 F:0.03557
48 ROUGE-2 Eval D0721-B.M.100.E-G.48 R:0.02606 P:0.01865 F:0.02174
48 ROUGE-2 Eval D0721-C.M.100.E-B.48 R:0.05629 P:0.04427 F:0.04956
48 ROUGE-2 Eval D0721-C.M.100.E-C.48 R:0.03000 P:0.02344 F:0.02632
48 ROUGE-2 Eval D0721-C.M.100.E-E.48 R:0.04714 P:0.03646 F:0.04112
48 ROUGE-2 Eval D0721-C.M.100.E-G.48 R:0.03618 P:0.02865 F:0.03198
48 ROUGE-2 Eval D0726-A.M.100.F-A.48 R:0.19463 P:0.14321 F:0.16501
48 ROUGE-2 Eval D0726-A.M.100.F-E.48 R:0.14478 P:0.10617 F:0.12250
48 ROUGE-2 Eval D0726-A.M.100.F-F.48 R:0.18792 P:0.13827 F:0.15932
48 ROUGE-2 Eval D0726-A.M.100.F-G.48 R:0.12752 P:0.09383 F:0.10811
48 ROUGE-2 Eval D0726-B.M.100.F-A.48 R:0.06931 P:0.04375 F:0.05364
48 ROUGE-2 Eval D0726-B.M.100.F-E.48 R:0.06711 P:0.04167 F:0.05142
48 ROUGE-2 Eval D0726-B.M.100.F-F.48 R:0.08389 P:0.05208 F:0.06426
48 ROUGE-2 Eval D0726-B.M.100.F-G.48 R:0.04983 P:0.03125 F:0.03841
48 ROUGE-2 Eval D0726-C.M.100.F-A.48 R:0.01010 P:0.00794 F:0.00889
48 ROUGE-2 Eval D0726-C.M.100.F-E.48 R:0.00680 P:0.00529 F:0.00595
48 ROUGE-2 Eval D0726-C.M.100.F-F.48 R:0.01027 P:0.00794 F:0.00896
48 ROUGE-2 Eval D0726-C.M.100.F-G.48 R:0.01325 P:0.01058 F:0.01177
48 ROUGE-2 Eval D0727-A.M.100.G-A.48 R:0.16107 P:0.11429 F:0.13371
48 ROUGE-2 Eval D0727-A.M.100.G-F.48 R:0.14618 P:0.10476 F:0.12205
48 ROUGE-2 Eval D0727-A.M.100.G-G.48 R:0.09241 P:0.06667 F:0.07746
48 ROUGE-2 Eval D0727-A.M.100.G-H.48 R:0.15947 P:0.11429 F:0.13315
48 ROUGE-2 Eval D0727-B.M.100.G-A.48 R:0.04514 P:0.02760 F:0.03426
48 ROUGE-2 Eval D0727-B.M.100.G-F.48 R:0.05246 P:0.03397 F:0.04124
48 ROUGE-2 Eval D0727-B.M.100.G-G.48 R:0.02797 P:0.01699 F:0.02114
48 ROUGE-2 Eval D0727-B.M.100.G-H.48 R:0.04861 P:0.02972 F:0.03689
48 ROUGE-2 Eval D0727-C.M.100.G-A.48 R:0.05921 P:0.03822 F:0.04645
48 ROUGE-2 Eval D0727-C.M.100.G-F.48 R:0.07143 P:0.04459 F:0.05491
48 ROUGE-2 Eval D0727-C.M.100.G-G.48 R:0.06333 P:0.04034 F:0.04929
48 ROUGE-2 Eval D0727-C.M.100.G-H.48 R:0.06826 P:0.04246 F:0.05235
48 ROUGE-2 Eval D0736-A.M.100.H-G.48 R:0.08696 P:0.05063 F:0.06400
48 ROUGE-2 Eval D0736-A.M.100.H-H.48 R:0.06642 P:0.03797 F:0.04832
48 ROUGE-2 Eval D0736-A.M.100.H-I.48 R:0.07194 P:0.04219 F:0.05319
48 ROUGE-2 Eval D0736-A.M.100.H-J.48 R:0.07261 P:0.04641 F:0.05663
48 ROUGE-2 Eval D0736-B.M.100.H-G.48 R:0.10811 P:0.06349 F:0.08000
48 ROUGE-2 Eval D0736-B.M.100.H-H.48 R:0.15481 P:0.08390 F:0.10882
48 ROUGE-2 Eval D0736-B.M.100.H-I.48 R:0.17797 P:0.09524 F:0.12408
48 ROUGE-2 Eval D0736-B.M.100.H-J.48 R:0.16254 P:0.10431 F:0.12707
48 ROUGE-2 Eval D0736-C.M.100.H-G.48 R:0.17094 P:0.08333 F:0.11204
48 ROUGE-2 Eval D0736-C.M.100.H-H.48 R:0.08152 P:0.03125 F:0.04518
48 ROUGE-2 Eval D0736-C.M.100.H-I.48 R:0.22283 P:0.08542 F:0.12350
48 ROUGE-2 Eval D0736-C.M.100.H-J.48 R:0.14885 P:0.08125 F:0.10512
48 ROUGE-2 Eval D0740-A.M.100.I-D.48 R:0.08333 P:0.05556 F:0.06667
48 ROUGE-2 Eval D0740-A.M.100.I-H.48 R:0.09241 P:0.06222 F:0.07437
48 ROUGE-2 Eval D0740-A.M.100.I-I.48 R:0.08852 P:0.06000 F:0.07152
48 ROUGE-2 Eval D0740-A.M.100.I-J.48 R:0.08143 P:0.05556 F:0.06605
48 ROUGE-2 Eval D0740-B.M.100.I-D.48 R:0.09508 P:0.06532 F:0.07744
48 ROUGE-2 Eval D0740-B.M.100.I-H.48 R:0.08361 P:0.05631 F:0.06730
48 ROUGE-2 Eval D0740-B.M.100.I-I.48 R:0.06623 P:0.04505 F:0.05362
48 ROUGE-2 Eval D0740-B.M.100.I-J.48 R:0.08170 P:0.05631 F:0.06667
48 ROUGE-2 Eval D0740-C.M.100.I-D.48 R:0.08710 P:0.06522 F:0.07459
48 ROUGE-2 Eval D0740-C.M.100.I-H.48 R:0.04870 P:0.03623 F:0.04155
48 ROUGE-2 Eval D0740-C.M.100.I-I.48 R:0.08065 P:0.06039 F:0.06906
48 ROUGE-2 Eval D0740-C.M.100.I-J.48 R:0.09325 P:0.07005 F:0.08000
48 ROUGE-2 Eval D0743-A.M.100.J-B.48 R:0.05769 P:0.04225 F:0.04878
48 ROUGE-2 Eval D0743-A.M.100.J-H.48 R:0.05607 P:0.04225 F:0.04819
48 ROUGE-2 Eval D0743-A.M.100.J-I.48 R:0.04101 P:0.03052 F:0.03500
48 ROUGE-2 Eval D0743-A.M.100.J-J.48 R:0.04348 P:0.03286 F:0.03743
48 ROUGE-2 Eval D0743-B.M.100.J-B.48 R:0.03883 P:0.02353 F:0.02930
48 ROUGE-2 Eval D0743-B.M.100.J-H.48 R:0.02229 P:0.01373 F:0.01699
48 ROUGE-2 Eval D0743-B.M.100.J-I.48 R:0.02236 P:0.01373 F:0.01701
48 ROUGE-2 Eval D0743-B.M.100.J-J.48 R:0.03145 P:0.01961 F:0.02416
48 ROUGE-2 Eval D0743-C.M.100.J-B.48 R:0.07692 P:0.05926 F:0.06694
48 ROUGE-2 Eval D0743-C.M.100.J-H.48 R:0.07074 P:0.05432 F:0.06145
48 ROUGE-2 Eval D0743-C.M.100.J-I.48 R:0.08710 P:0.06667 F:0.07553
48 ROUGE-2 Eval D0743-C.M.100.J-J.48 R:0.06349 P:0.04938 F:0.05555
---------------------------------------------
48 ROUGE-3 Average_R: 0.03580 (95%-conf.int. 0.02986 - 0.04194)
48 ROUGE-3 Average_P: 0.02377 (95%-conf.int. 0.02001 - 0.02752)
48 ROUGE-3 Average_F: 0.02845 (95%-conf.int. 0.02388 - 0.03314)
.............................................
48 ROUGE-3 Eval D0703-A.M.100.A-A.48 R:0.04828 P:0.03196 F:0.03846
48 ROUGE-3 Eval D0703-A.M.100.A-C.48 R:0.02740 P:0.01826 F:0.02192
48 ROUGE-3 Eval D0703-A.M.100.A-D.48 R:0.05614 P:0.03653 F:0.04426
48 ROUGE-3 Eval D0703-A.M.100.A-J.48 R:0.05556 P:0.03653 F:0.04408
48 ROUGE-3 Eval D0703-B.M.100.A-A.48 R:0.09000 P:0.06475 F:0.07532
48 ROUGE-3 Eval D0703-B.M.100.A-C.48 R:0.06849 P:0.04796 F:0.05642
48 ROUGE-3 Eval D0703-B.M.100.A-D.48 R:0.06507 P:0.04556 F:0.05359
48 ROUGE-3 Eval D0703-B.M.100.A-J.48 R:0.09153 P:0.06475 F:0.07585
48 ROUGE-3 Eval D0703-C.M.100.A-A.48 R:0.01020 P:0.00800 F:0.00897
48 ROUGE-3 Eval D0703-C.M.100.A-C.48 R:0.00993 P:0.00800 F:0.00886
48 ROUGE-3 Eval D0703-C.M.100.A-D.48 R:0.00338 P:0.00267 F:0.00298
48 ROUGE-3 Eval D0703-C.M.100.A-J.48 R:0.00676 P:0.00533 F:0.00596
48 ROUGE-3 Eval D0706-A.M.100.B-B.48 R:0.04967 P:0.03597 F:0.04172
48 ROUGE-3 Eval D0706-A.M.100.B-D.48 R:0.06667 P:0.04796 F:0.05579
48 ROUGE-3 Eval D0706-A.M.100.B-E.48 R:0.02980 P:0.02158 F:0.02503
48 ROUGE-3 Eval D0706-A.M.100.B-I.48 R:0.05298 P:0.03837 F:0.04451
48 ROUGE-3 Eval D0706-B.M.100.B-B.48 R:0.04667 P:0.02972 F:0.03631
48 ROUGE-3 Eval D0706-B.M.100.B-D.48 R:0.03654 P:0.02335 F:0.02849
48 ROUGE-3 Eval D0706-B.M.100.B-E.48 R:0.00993 P:0.00637 F:0.00776
48 ROUGE-3 Eval D0706-B.M.100.B-I.48 R:0.04620 P:0.02972 F:0.03617
48 ROUGE-3 Eval D0706-C.M.100.B-B.48 R:0.02303 P:0.01587 F:0.01879
48 ROUGE-3 Eval D0706-C.M.100.B-D.48 R:0.05592 P:0.03855 F:0.04564
48 ROUGE-3 Eval D0706-C.M.100.B-E.48 R:0.03268 P:0.02268 F:0.02678
48 ROUGE-3 Eval D0706-C.M.100.B-I.48 R:0.05537 P:0.03855 F:0.04545
48 ROUGE-3 Eval D0711-A.M.100.C-A.48 R:0.05369 P:0.03604 F:0.04313
48 ROUGE-3 Eval D0711-A.M.100.C-B.48 R:0.04762 P:0.03153 F:0.03794
48 ROUGE-3 Eval D0711-A.M.100.C-C.48 R:0.04082 P:0.02703 F:0.03252
48 ROUGE-3 Eval D0711-A.M.100.C-F.48 R:0.03041 P:0.02027 F:0.02433
48 ROUGE-3 Eval D0711-B.M.100.C-A.48 R:0.01736 P:0.01062 F:0.01318
48 ROUGE-3 Eval D0711-B.M.100.C-B.48 R:0.02098 P:0.01274 F:0.01585
48 ROUGE-3 Eval D0711-B.M.100.C-C.48 R:0.01370 P:0.00849 F:0.01048
48 ROUGE-3 Eval D0711-B.M.100.C-F.48 R:0.01038 P:0.00637 F:0.00789
48 ROUGE-3 Eval D0711-C.M.100.C-A.48 R:0.03030 P:0.02055 F:0.02449
48 ROUGE-3 Eval D0711-C.M.100.C-B.48 R:0.03136 P:0.02055 F:0.02483
48 ROUGE-3 Eval D0711-C.M.100.C-C.48 R:0.02069 P:0.01370 F:0.01648
48 ROUGE-3 Eval D0711-C.M.100.C-F.48 R:0.01034 P:0.00685 F:0.00824
48 ROUGE-3 Eval D0716-A.M.100.D-C.48 R:0.09030 P:0.06164 F:0.07327
48 ROUGE-3 Eval D0716-A.M.100.D-D.48 R:0.10204 P:0.06849 F:0.08196
48 ROUGE-3 Eval D0716-A.M.100.D-E.48 R:0.08814 P:0.05936 F:0.07094
48 ROUGE-3 Eval D0716-A.M.100.D-F.48 R:0.08418 P:0.05708 F:0.06803
48 ROUGE-3 Eval D0716-B.M.100.D-C.48 R:0.04698 P:0.03509 F:0.04017
48 ROUGE-3 Eval D0716-B.M.100.D-D.48 R:0.04795 P:0.03509 F:0.04052
48 ROUGE-3 Eval D0716-B.M.100.D-E.48 R:0.04068 P:0.03008 F:0.03459
48 ROUGE-3 Eval D0716-B.M.100.D-F.48 R:0.06803 P:0.05013 F:0.05772
48 ROUGE-3 Eval D0716-C.M.100.D-C.48 R:0.05980 P:0.04054 F:0.04832
48 ROUGE-3 Eval D0716-C.M.100.D-D.48 R:0.03072 P:0.02027 F:0.02442
48 ROUGE-3 Eval D0716-C.M.100.D-E.48 R:0.07071 P:0.04730 F:0.05668
48 ROUGE-3 Eval D0716-C.M.100.D-F.48 R:0.06122 P:0.04054 F:0.04878
48 ROUGE-3 Eval D0721-A.M.100.E-B.48 R:0.00680 P:0.00490 F:0.00570
48 ROUGE-3 Eval D0721-A.M.100.E-C.48 R:0.00993 P:0.00735 F:0.00845
48 ROUGE-3 Eval D0721-A.M.100.E-E.48 R:0.00993 P:0.00735 F:0.00845
48 ROUGE-3 Eval D0721-A.M.100.E-G.48 R:0.01299 P:0.00980 F:0.01117
48 ROUGE-3 Eval D0721-B.M.100.E-B.48 R:0.00332 P:0.00235 F:0.00275
48 ROUGE-3 Eval D0721-B.M.100.E-C.48 R:0.00325 P:0.00235 F:0.00273
48 ROUGE-3 Eval D0721-B.M.100.E-E.48 R:0.00334 P:0.00235 F:0.00276
48 ROUGE-3 Eval D0721-B.M.100.E-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0721-C.M.100.E-B.48 R:0.01672 P:0.01312 F:0.01470
48 ROUGE-3 Eval D0721-C.M.100.E-C.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0721-C.M.100.E-E.48 R:0.01701 P:0.01312 F:0.01481
48 ROUGE-3 Eval D0721-C.M.100.E-G.48 R:0.01661 P:0.01312 F:0.01466
48 ROUGE-3 Eval D0726-A.M.100.F-A.48 R:0.13559 P:0.09950 F:0.11477
48 ROUGE-3 Eval D0726-A.M.100.F-E.48 R:0.09864 P:0.07214 F:0.08333
48 ROUGE-3 Eval D0726-A.M.100.F-F.48 R:0.12542 P:0.09204 F:0.10617
48 ROUGE-3 Eval D0726-A.M.100.F-G.48 R:0.07797 P:0.05721 F:0.06600
48 ROUGE-3 Eval D0726-B.M.100.F-A.48 R:0.02333 P:0.01468 F:0.01802
48 ROUGE-3 Eval D0726-B.M.100.F-E.48 R:0.02034 P:0.01258 F:0.01555
48 ROUGE-3 Eval D0726-B.M.100.F-F.48 R:0.02712 P:0.01677 F:0.02072
48 ROUGE-3 Eval D0726-B.M.100.F-G.48 R:0.01007 P:0.00629 F:0.00774
48 ROUGE-3 Eval D0726-C.M.100.F-A.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0726-C.M.100.F-E.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0726-C.M.100.F-F.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0726-C.M.100.F-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0727-A.M.100.G-A.48 R:0.07119 P:0.05036 F:0.05899
48 ROUGE-3 Eval D0727-A.M.100.G-F.48 R:0.07383 P:0.05276 F:0.06154
48 ROUGE-3 Eval D0727-A.M.100.G-G.48 R:0.02667 P:0.01918 F:0.02231
48 ROUGE-3 Eval D0727-A.M.100.G-H.48 R:0.08054 P:0.05755 F:0.06713
48 ROUGE-3 Eval D0727-B.M.100.G-A.48 R:0.01404 P:0.00855 F:0.01063
48 ROUGE-3 Eval D0727-B.M.100.G-F.48 R:0.01325 P:0.00855 F:0.01039
48 ROUGE-3 Eval D0727-B.M.100.G-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0727-B.M.100.G-H.48 R:0.01404 P:0.00855 F:0.01063
48 ROUGE-3 Eval D0727-C.M.100.G-A.48 R:0.01329 P:0.00855 F:0.01041
48 ROUGE-3 Eval D0727-C.M.100.G-F.48 R:0.01031 P:0.00641 F:0.00791
48 ROUGE-3 Eval D0727-C.M.100.G-G.48 R:0.01010 P:0.00641 F:0.00784
48 ROUGE-3 Eval D0727-C.M.100.G-H.48 R:0.00690 P:0.00427 F:0.00528
48 ROUGE-3 Eval D0736-A.M.100.H-G.48 R:0.02930 P:0.01699 F:0.02151
48 ROUGE-3 Eval D0736-A.M.100.H-H.48 R:0.01866 P:0.01062 F:0.01354
48 ROUGE-3 Eval D0736-A.M.100.H-I.48 R:0.01818 P:0.01062 F:0.01341
48 ROUGE-3 Eval D0736-A.M.100.H-J.48 R:0.02000 P:0.01274 F:0.01557
48 ROUGE-3 Eval D0736-B.M.100.H-G.48 R:0.04688 P:0.02740 F:0.03459
48 ROUGE-3 Eval D0736-B.M.100.H-H.48 R:0.10169 P:0.05479 F:0.07121
48 ROUGE-3 Eval D0736-B.M.100.H-I.48 R:0.12017 P:0.06393 F:0.08346
48 ROUGE-3 Eval D0736-B.M.100.H-J.48 R:0.10357 P:0.06621 F:0.08078
48 ROUGE-3 Eval D0736-C.M.100.H-G.48 R:0.10390 P:0.05031 F:0.06779
48 ROUGE-3 Eval D0736-C.M.100.H-H.48 R:0.02762 P:0.01048 F:0.01519
48 ROUGE-3 Eval D0736-C.M.100.H-I.48 R:0.12707 P:0.04822 F:0.06991
48 ROUGE-3 Eval D0736-C.M.100.H-J.48 R:0.07722 P:0.04193 F:0.05435
48 ROUGE-3 Eval D0740-A.M.100.I-D.48 R:0.01347 P:0.00895 F:0.01075
48 ROUGE-3 Eval D0740-A.M.100.I-H.48 R:0.01667 P:0.01119 F:0.01339
48 ROUGE-3 Eval D0740-A.M.100.I-I.48 R:0.00993 P:0.00671 F:0.00801
48 ROUGE-3 Eval D0740-A.M.100.I-J.48 R:0.00987 P:0.00671 F:0.00799
48 ROUGE-3 Eval D0740-B.M.100.I-D.48 R:0.03642 P:0.02494 F:0.02961
48 ROUGE-3 Eval D0740-B.M.100.I-H.48 R:0.03378 P:0.02268 F:0.02714
48 ROUGE-3 Eval D0740-B.M.100.I-I.48 R:0.02341 P:0.01587 F:0.01892
48 ROUGE-3 Eval D0740-B.M.100.I-J.48 R:0.03630 P:0.02494 F:0.02957
48 ROUGE-3 Eval D0740-C.M.100.I-D.48 R:0.02606 P:0.01946 F:0.02228
48 ROUGE-3 Eval D0740-C.M.100.I-H.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-3 Eval D0740-C.M.100.I-I.48 R:0.02606 P:0.01946 F:0.02228
48 ROUGE-3 Eval D0740-C.M.100.I-J.48 R:0.02597 P:0.01946 F:0.02225
48 ROUGE-3 Eval D0743-A.M.100.J-B.48 R:0.01618 P:0.01182 F:0.01366
48 ROUGE-3 Eval D0743-A.M.100.J-H.48 R:0.01572 P:0.01182 F:0.01349
48 ROUGE-3 Eval D0743-A.M.100.J-I.48 R:0.00318 P:0.00236 F:0.00271
48 ROUGE-3 Eval D0743-A.M.100.J-J.48 R:0.01254 P:0.00946 F:0.01078
48 ROUGE-3 Eval D0743-B.M.100.J-B.48 R:0.00654 P:0.00394 F:0.00492
48 ROUGE-3 Eval D0743-B.M.100.J-H.48 R:0.00322 P:0.00197 F:0.00244
48 ROUGE-3 Eval D0743-B.M.100.J-I.48 R:0.00323 P:0.00197 F:0.00245
48 ROUGE-3 Eval D0743-B.M.100.J-J.48 R:0.00635 P:0.00394 F:0.00486
48 ROUGE-3 Eval D0743-C.M.100.J-B.48 R:0.01294 P:0.00995 F:0.01125
48 ROUGE-3 Eval D0743-C.M.100.J-H.48 R:0.01948 P:0.01493 F:0.01690
48 ROUGE-3 Eval D0743-C.M.100.J-I.48 R:0.01954 P:0.01493 F:0.01693
48 ROUGE-3 Eval D0743-C.M.100.J-J.48 R:0.00641 P:0.00498 F:0.00561
---------------------------------------------
48 ROUGE-4 Average_R: 0.01964 (95%-conf.int. 0.01530 - 0.02401)
48 ROUGE-4 Average_P: 0.01295 (95%-conf.int. 0.01014 - 0.01573)
48 ROUGE-4 Average_F: 0.01553 (95%-conf.int. 0.01215 - 0.01888)
.............................................
48 ROUGE-4 Eval D0703-A.M.100.A-A.48 R:0.02091 P:0.01379 F:0.01662
48 ROUGE-4 Eval D0703-A.M.100.A-C.48 R:0.01038 P:0.00690 F:0.00829
48 ROUGE-4 Eval D0703-A.M.100.A-D.48 R:0.02837 P:0.01839 F:0.02231
48 ROUGE-4 Eval D0703-A.M.100.A-J.48 R:0.02456 P:0.01609 F:0.01944
48 ROUGE-4 Eval D0703-B.M.100.A-A.48 R:0.06734 P:0.04831 F:0.05626
48 ROUGE-4 Eval D0703-B.M.100.A-C.48 R:0.04152 P:0.02899 F:0.03414
48 ROUGE-4 Eval D0703-B.M.100.A-D.48 R:0.03460 P:0.02415 F:0.02845
48 ROUGE-4 Eval D0703-B.M.100.A-J.48 R:0.06164 P:0.04348 F:0.05099
48 ROUGE-4 Eval D0703-C.M.100.A-A.48 R:0.00344 P:0.00269 F:0.00302
48 ROUGE-4 Eval D0703-C.M.100.A-C.48 R:0.00334 P:0.00269 F:0.00298
48 ROUGE-4 Eval D0703-C.M.100.A-D.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0703-C.M.100.A-J.48 R:0.00341 P:0.00269 F:0.00301
48 ROUGE-4 Eval D0706-A.M.100.B-B.48 R:0.03344 P:0.02415 F:0.02805
48 ROUGE-4 Eval D0706-A.M.100.B-D.48 R:0.04377 P:0.03140 F:0.03657
48 ROUGE-4 Eval D0706-A.M.100.B-E.48 R:0.02007 P:0.01449 F:0.01683
48 ROUGE-4 Eval D0706-A.M.100.B-I.48 R:0.03344 P:0.02415 F:0.02805
48 ROUGE-4 Eval D0706-B.M.100.B-B.48 R:0.03030 P:0.01923 F:0.02353
48 ROUGE-4 Eval D0706-B.M.100.B-D.48 R:0.02685 P:0.01709 F:0.02089
48 ROUGE-4 Eval D0706-B.M.100.B-E.48 R:0.00334 P:0.00214 F:0.00261
48 ROUGE-4 Eval D0706-B.M.100.B-I.48 R:0.03000 P:0.01923 F:0.02344
48 ROUGE-4 Eval D0706-C.M.100.B-B.48 R:0.00997 P:0.00685 F:0.00812
48 ROUGE-4 Eval D0706-C.M.100.B-D.48 R:0.02990 P:0.02055 F:0.02436
48 ROUGE-4 Eval D0706-C.M.100.B-E.48 R:0.01980 P:0.01370 F:0.01619
48 ROUGE-4 Eval D0706-C.M.100.B-I.48 R:0.02961 P:0.02055 F:0.02426
48 ROUGE-4 Eval D0711-A.M.100.C-A.48 R:0.03051 P:0.02041 F:0.02446
48 ROUGE-4 Eval D0711-A.M.100.C-B.48 R:0.02405 P:0.01587 F:0.01912
48 ROUGE-4 Eval D0711-A.M.100.C-C.48 R:0.01718 P:0.01134 F:0.01366
48 ROUGE-4 Eval D0711-A.M.100.C-F.48 R:0.02048 P:0.01361 F:0.01635
48 ROUGE-4 Eval D0711-B.M.100.C-A.48 R:0.00351 P:0.00214 F:0.00266
48 ROUGE-4 Eval D0711-B.M.100.C-B.48 R:0.00353 P:0.00214 F:0.00266
48 ROUGE-4 Eval D0711-B.M.100.C-C.48 R:0.00346 P:0.00214 F:0.00264
48 ROUGE-4 Eval D0711-B.M.100.C-F.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0711-C.M.100.C-A.48 R:0.01361 P:0.00920 F:0.01098
48 ROUGE-4 Eval D0711-C.M.100.C-B.48 R:0.01408 P:0.00920 F:0.01113
48 ROUGE-4 Eval D0711-C.M.100.C-C.48 R:0.01394 P:0.00920 F:0.01108
48 ROUGE-4 Eval D0711-C.M.100.C-F.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0716-A.M.100.D-C.48 R:0.04392 P:0.02989 F:0.03557
48 ROUGE-4 Eval D0716-A.M.100.D-D.48 R:0.06529 P:0.04368 F:0.05234
48 ROUGE-4 Eval D0716-A.M.100.D-E.48 R:0.05479 P:0.03678 F:0.04401
48 ROUGE-4 Eval D0716-A.M.100.D-F.48 R:0.04082 P:0.02759 F:0.03293
48 ROUGE-4 Eval D0716-B.M.100.D-C.48 R:0.02373 P:0.01768 F:0.02026
48 ROUGE-4 Eval D0716-B.M.100.D-D.48 R:0.02422 P:0.01768 F:0.02044
48 ROUGE-4 Eval D0716-B.M.100.D-E.48 R:0.02055 P:0.01515 F:0.01744
48 ROUGE-4 Eval D0716-B.M.100.D-F.48 R:0.03436 P:0.02525 F:0.02911
48 ROUGE-4 Eval D0716-C.M.100.D-C.48 R:0.02685 P:0.01814 F:0.02165
48 ROUGE-4 Eval D0716-C.M.100.D-D.48 R:0.00690 P:0.00454 F:0.00548
48 ROUGE-4 Eval D0716-C.M.100.D-E.48 R:0.03061 P:0.02041 F:0.02449
48 ROUGE-4 Eval D0716-C.M.100.D-F.48 R:0.02749 P:0.01814 F:0.02186
48 ROUGE-4 Eval D0721-A.M.100.E-B.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-A.M.100.E-C.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-A.M.100.E-E.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-A.M.100.E-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-B.M.100.E-B.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-B.M.100.E-C.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-B.M.100.E-E.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-B.M.100.E-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-C.M.100.E-B.48 R:0.01014 P:0.00794 F:0.00891
48 ROUGE-4 Eval D0721-C.M.100.E-C.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0721-C.M.100.E-E.48 R:0.01031 P:0.00794 F:0.00897
48 ROUGE-4 Eval D0721-C.M.100.E-G.48 R:0.01007 P:0.00794 F:0.00888
48 ROUGE-4 Eval D0726-A.M.100.F-A.48 R:0.10959 P:0.08020 F:0.09262
48 ROUGE-4 Eval D0726-A.M.100.F-E.48 R:0.07560 P:0.05514 F:0.06377
48 ROUGE-4 Eval D0726-A.M.100.F-F.48 R:0.09932 P:0.07268 F:0.08394
48 ROUGE-4 Eval D0726-A.M.100.F-G.48 R:0.05479 P:0.04010 F:0.04631
48 ROUGE-4 Eval D0726-B.M.100.F-A.48 R:0.01010 P:0.00633 F:0.00778
48 ROUGE-4 Eval D0726-B.M.100.F-E.48 R:0.01027 P:0.00633 F:0.00783
48 ROUGE-4 Eval D0726-B.M.100.F-F.48 R:0.01027 P:0.00633 F:0.00783
48 ROUGE-4 Eval D0726-B.M.100.F-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0726-C.M.100.F-A.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0726-C.M.100.F-E.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0726-C.M.100.F-F.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0726-C.M.100.F-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0727-A.M.100.G-A.48 R:0.04795 P:0.03382 F:0.03966
48 ROUGE-4 Eval D0727-A.M.100.G-F.48 R:0.05424 P:0.03865 F:0.04514
48 ROUGE-4 Eval D0727-A.M.100.G-G.48 R:0.00673 P:0.00483 F:0.00562
48 ROUGE-4 Eval D0727-A.M.100.G-H.48 R:0.05424 P:0.03865 F:0.04514
48 ROUGE-4 Eval D0727-B.M.100.G-A.48 R:0.00709 P:0.00430 F:0.00535
48 ROUGE-4 Eval D0727-B.M.100.G-F.48 R:0.00669 P:0.00430 F:0.00524
48 ROUGE-4 Eval D0727-B.M.100.G-G.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0727-B.M.100.G-H.48 R:0.00709 P:0.00430 F:0.00535
48 ROUGE-4 Eval D0727-C.M.100.G-A.48 R:0.00336 P:0.00215 F:0.00262
48 ROUGE-4 Eval D0727-C.M.100.G-F.48 R:0.00347 P:0.00215 F:0.00265
48 ROUGE-4 Eval D0727-C.M.100.G-G.48 R:0.00340 P:0.00215 F:0.00263
48 ROUGE-4 Eval D0727-C.M.100.G-H.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0736-A.M.100.H-G.48 R:0.00741 P:0.00427 F:0.00542
48 ROUGE-4 Eval D0736-A.M.100.H-H.48 R:0.00755 P:0.00427 F:0.00545
48 ROUGE-4 Eval D0736-A.M.100.H-I.48 R:0.00368 P:0.00214 F:0.00271
48 ROUGE-4 Eval D0736-A.M.100.H-J.48 R:0.00337 P:0.00214 F:0.00262
48 ROUGE-4 Eval D0736-B.M.100.H-G.48 R:0.01581 P:0.00920 F:0.01163
48 ROUGE-4 Eval D0736-B.M.100.H-H.48 R:0.07296 P:0.03908 F:0.05090
48 ROUGE-4 Eval D0736-B.M.100.H-I.48 R:0.08261 P:0.04368 F:0.05714
48 ROUGE-4 Eval D0736-B.M.100.H-J.48 R:0.07220 P:0.04598 F:0.05618
48 ROUGE-4 Eval D0736-C.M.100.H-G.48 R:0.07018 P:0.03376 F:0.04559
48 ROUGE-4 Eval D0736-C.M.100.H-H.48 R:0.01685 P:0.00633 F:0.00920
48 ROUGE-4 Eval D0736-C.M.100.H-I.48 R:0.08989 P:0.03376 F:0.04909
48 ROUGE-4 Eval D0736-C.M.100.H-J.48 R:0.05078 P:0.02743 F:0.03562
48 ROUGE-4 Eval D0740-A.M.100.I-D.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0740-A.M.100.I-H.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0740-A.M.100.I-I.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0740-A.M.100.I-J.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0740-B.M.100.I-D.48 R:0.01003 P:0.00685 F:0.00814
48 ROUGE-4 Eval D0740-B.M.100.I-H.48 R:0.01365 P:0.00913 F:0.01094
48 ROUGE-4 Eval D0740-B.M.100.I-I.48 R:0.00338 P:0.00228 F:0.00272
48 ROUGE-4 Eval D0740-B.M.100.I-J.48 R:0.01333 P:0.00913 F:0.01084
48 ROUGE-4 Eval D0740-C.M.100.I-D.48 R:0.01645 P:0.01225 F:0.01404
48 ROUGE-4 Eval D0740-C.M.100.I-H.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0740-C.M.100.I-I.48 R:0.01645 P:0.01225 F:0.01404
48 ROUGE-4 Eval D0740-C.M.100.I-J.48 R:0.01639 P:0.01225 F:0.01402
48 ROUGE-4 Eval D0743-A.M.100.J-B.48 R:0.00327 P:0.00238 F:0.00275
48 ROUGE-4 Eval D0743-A.M.100.J-H.48 R:0.00317 P:0.00238 F:0.00272
48 ROUGE-4 Eval D0743-A.M.100.J-I.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-A.M.100.J-J.48 R:0.00316 P:0.00238 F:0.00272
48 ROUGE-4 Eval D0743-B.M.100.J-B.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-B.M.100.J-H.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-B.M.100.J-I.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-B.M.100.J-J.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-C.M.100.J-B.48 R:0.00000 P:0.00000 F:0.00000
48 ROUGE-4 Eval D0743-C.M.100.J-H.48 R:0.00328 P:0.00251 F:0.00284
48 ROUGE-4 Eval D0743-C.M.100.J-I.48 R:0.00329 P:0.00251 F:0.00285
48 ROUGE-4 Eval D0743-C.M.100.J-J.48 R:0.00324 P:0.00251 F:0.00283
---------------------------------------------
48 ROUGE-L Average_R: 0.30107 (95%-conf.int. 0.29142 - 0.31072)
48 ROUGE-L Average_P: 0.20483 (95%-conf.int. 0.19835 - 0.21116)
48 ROUGE-L Average_F: 0.24303 (95%-conf.int. 0.23566 - 0.25005)
.............................................
48 ROUGE-L Eval D0703-A.M.100.A-A.48 R:0.35473 P:0.23649 F:0.28379
48 ROUGE-L Eval D0703-A.M.100.A-C.48 R:0.31544 P:0.21171 F:0.25337
48 ROUGE-L Eval D0703-A.M.100.A-D.48 R:0.34021 P:0.22297 F:0.26939
48 ROUGE-L Eval D0703-A.M.100.A-J.48 R:0.37415 P:0.24775 F:0.29810
48 ROUGE-L Eval D0703-B.M.100.A-A.48 R:0.27451 P:0.19858 F:0.23045
48 ROUGE-L Eval D0703-B.M.100.A-C.48 R:0.27517 P:0.19385 F:0.22746
48 ROUGE-L Eval D0703-B.M.100.A-D.48 R:0.26846 P:0.18913 F:0.22192
48 ROUGE-L Eval D0703-B.M.100.A-J.48 R:0.29900 P:0.21277 F:0.24862
48 ROUGE-L Eval D0703-C.M.100.A-A.48 R:0.29667 P:0.23360 F:0.26138
48 ROUGE-L Eval D0703-C.M.100.A-C.48 R:0.27597 P:0.22310 F:0.24673
48 ROUGE-L Eval D0703-C.M.100.A-D.48 R:0.26490 P:0.20997 F:0.23426
48 ROUGE-L Eval D0703-C.M.100.A-J.48 R:0.30132 P:0.23885 F:0.26647
48 ROUGE-L Eval D0706-A.M.100.B-B.48 R:0.31818 P:0.23168 F:0.26813
48 ROUGE-L Eval D0706-A.M.100.B-D.48 R:0.31373 P:0.22695 F:0.26338
48 ROUGE-L Eval D0706-A.M.100.B-E.48 R:0.26948 P:0.19622 F:0.22709
48 ROUGE-L Eval D0706-A.M.100.B-I.48 R:0.29870 P:0.21749 F:0.25171
48 ROUGE-L Eval D0706-B.M.100.B-B.48 R:0.25490 P:0.16352 F:0.19923
48 ROUGE-L Eval D0706-B.M.100.B-D.48 R:0.22476 P:0.14465 F:0.17602
48 ROUGE-L Eval D0706-B.M.100.B-E.48 R:0.21753 P:0.14046 F:0.17070
48 ROUGE-L Eval D0706-B.M.100.B-I.48 R:0.25890 P:0.16771 F:0.20356
48 ROUGE-L Eval D0706-C.M.100.B-B.48 R:0.30000 P:0.20805 F:0.24570
48 ROUGE-L Eval D0706-C.M.100.B-D.48 R:0.33871 P:0.23490 F:0.27741
48 ROUGE-L Eval D0706-C.M.100.B-E.48 R:0.32372 P:0.22595 F:0.26614
48 ROUGE-L Eval D0706-C.M.100.B-I.48 R:0.33866 P:0.23714 F:0.27895
48 ROUGE-L Eval D0711-A.M.100.C-A.48 R:0.37500 P:0.25333 F:0.30238
48 ROUGE-L Eval D0711-A.M.100.C-B.48 R:0.38000 P:0.25333 F:0.30400
48 ROUGE-L Eval D0711-A.M.100.C-C.48 R:0.35667 P:0.23778 F:0.28534
48 ROUGE-L Eval D0711-A.M.100.C-F.48 R:0.36093 P:0.24222 F:0.28989
48 ROUGE-L Eval D0711-B.M.100.C-A.48 R:0.28912 P:0.17820 F:0.22050
48 ROUGE-L Eval D0711-B.M.100.C-B.48 R:0.30822 P:0.18868 F:0.23407
48 ROUGE-L Eval D0711-B.M.100.C-C.48 R:0.29530 P:0.18449 F:0.22710
48 ROUGE-L Eval D0711-B.M.100.C-F.48 R:0.26780 P:0.16562 F:0.20467
48 ROUGE-L Eval D0711-C.M.100.C-A.48 R:0.29373 P:0.20045 F:0.23829
48 ROUGE-L Eval D0711-C.M.100.C-B.48 R:0.31399 P:0.20721 F:0.24966
48 ROUGE-L Eval D0711-C.M.100.C-C.48 R:0.28378 P:0.18919 F:0.22703
48 ROUGE-L Eval D0711-C.M.100.C-F.48 R:0.26014 P:0.17342 F:0.20811
48 ROUGE-L Eval D0716-A.M.100.D-C.48 R:0.39344 P:0.27027 F:0.32043
48 ROUGE-L Eval D0716-A.M.100.D-D.48 R:0.41333 P:0.27928 F:0.33333
48 ROUGE-L Eval D0716-A.M.100.D-E.48 R:0.43189 P:0.29279 F:0.34899
48 ROUGE-L Eval D0716-A.M.100.D-F.48 R:0.38944 P:0.26577 F:0.31593
48 ROUGE-L Eval D0716-B.M.100.D-C.48 R:0.30592 P:0.22963 F:0.26234
48 ROUGE-L Eval D0716-B.M.100.D-D.48 R:0.32215 P:0.23704 F:0.27312
48 ROUGE-L Eval D0716-B.M.100.D-E.48 R:0.30897 P:0.22963 F:0.26346
48 ROUGE-L Eval D0716-B.M.100.D-F.48 R:0.31000 P:0.22963 F:0.26383
48 ROUGE-L Eval D0716-C.M.100.D-C.48 R:0.34202 P:0.23333 F:0.27741
48 ROUGE-L Eval D0716-C.M.100.D-D.48 R:0.31438 P:0.20889 F:0.25100
48 ROUGE-L Eval D0716-C.M.100.D-E.48 R:0.35644 P:0.24000 F:0.28685
48 ROUGE-L Eval D0716-C.M.100.D-F.48 R:0.31667 P:0.21111 F:0.25333
48 ROUGE-L Eval D0721-A.M.100.E-B.48 R:0.28333 P:0.20531 F:0.23809
48 ROUGE-L Eval D0721-A.M.100.E-C.48 R:0.28571 P:0.21256 F:0.24377
48 ROUGE-L Eval D0721-A.M.100.E-E.48 R:0.27273 P:0.20290 F:0.23269
48 ROUGE-L Eval D0721-A.M.100.E-G.48 R:0.28025 P:0.21256 F:0.24176
48 ROUGE-L Eval D0721-B.M.100.E-B.48 R:0.23779 P:0.16898 F:0.19756
48 ROUGE-L Eval D0721-B.M.100.E-C.48 R:0.22293 P:0.16204 F:0.18767
48 ROUGE-L Eval D0721-B.M.100.E-E.48 R:0.21311 P:0.15046 F:0.17639
48 ROUGE-L Eval D0721-B.M.100.E-G.48 R:0.20000 P:0.14352 F:0.16712
48 ROUGE-L Eval D0721-C.M.100.E-B.48 R:0.25902 P:0.20413 F:0.22832
48 ROUGE-L Eval D0721-C.M.100.E-C.48 R:0.20132 P:0.15762 F:0.17681
48 ROUGE-L Eval D0721-C.M.100.E-E.48 R:0.23000 P:0.17829 F:0.20087
48 ROUGE-L Eval D0721-C.M.100.E-G.48 R:0.21824 P:0.17313 F:0.19309
48 ROUGE-L Eval D0726-A.M.100.F-A.48 R:0.40532 P:0.29902 F:0.34415
48 ROUGE-L Eval D0726-A.M.100.F-E.48 R:0.36333 P:0.26716 F:0.30791
48 ROUGE-L Eval D0726-A.M.100.F-F.48 R:0.41528 P:0.30637 F:0.35261
48 ROUGE-L Eval D0726-A.M.100.F-G.48 R:0.36213 P:0.26716 F:0.30748
48 ROUGE-L Eval D0726-B.M.100.F-A.48 R:0.26144 P:0.16563 F:0.20279
48 ROUGE-L Eval D0726-B.M.100.F-E.48 R:0.26246 P:0.16356 F:0.20153
48 ROUGE-L Eval D0726-B.M.100.F-F.48 R:0.27575 P:0.17184 F:0.21173
48 ROUGE-L Eval D0726-B.M.100.F-G.48 R:0.25987 P:0.16356 F:0.20076
48 ROUGE-L Eval D0726-C.M.100.F-A.48 R:0.18667 P:0.14698 F:0.16446
48 ROUGE-L Eval D0726-C.M.100.F-E.48 R:0.19865 P:0.15486 F:0.17404
48 ROUGE-L Eval D0726-C.M.100.F-F.48 R:0.19322 P:0.14961 F:0.16864
48 ROUGE-L Eval D0726-C.M.100.F-G.48 R:0.19344 P:0.15486 F:0.17201
48 ROUGE-L Eval D0727-A.M.100.G-A.48 R:0.39535 P:0.28132 F:0.32873
48 ROUGE-L Eval D0727-A.M.100.G-F.48 R:0.35855 P:0.25768 F:0.29986
48 ROUGE-L Eval D0727-A.M.100.G-G.48 R:0.33987 P:0.24586 F:0.28532
48 ROUGE-L Eval D0727-A.M.100.G-H.48 R:0.40789 P:0.29314 F:0.34112
48 ROUGE-L Eval D0727-B.M.100.G-A.48 R:0.31271 P:0.19198 F:0.23790
48 ROUGE-L Eval D0727-B.M.100.G-F.48 R:0.30195 P:0.19620 F:0.23785
48 ROUGE-L Eval D0727-B.M.100.G-G.48 R:0.27336 P:0.16667 F:0.20708
48 ROUGE-L Eval D0727-B.M.100.G-H.48 R:0.29210 P:0.17932 F:0.22222
48 ROUGE-L Eval D0727-C.M.100.G-A.48 R:0.30293 P:0.19620 F:0.23815
48 ROUGE-L Eval D0727-C.M.100.G-F.48 R:0.29293 P:0.18354 F:0.22568
48 ROUGE-L Eval D0727-C.M.100.G-G.48 R:0.28053 P:0.17932 F:0.21879
48 ROUGE-L Eval D0727-C.M.100.G-H.48 R:0.33108 P:0.20675 F:0.25454
48 ROUGE-L Eval D0736-A.M.100.H-G.48 R:0.30824 P:0.18029 F:0.22751
48 ROUGE-L Eval D0736-A.M.100.H-H.48 R:0.31387 P:0.18029 F:0.22903
48 ROUGE-L Eval D0736-A.M.100.H-I.48 R:0.30961 P:0.18239 F:0.22955
48 ROUGE-L Eval D0736-A.M.100.H-J.48 R:0.30065 P:0.19287 F:0.23499
48 ROUGE-L Eval D0736-B.M.100.H-G.48 R:0.36641 P:0.21622 F:0.27196
48 ROUGE-L Eval D0736-B.M.100.H-H.48 R:0.39256 P:0.21396 F:0.27696
48 ROUGE-L Eval D0736-B.M.100.H-I.48 R:0.40586 P:0.21847 F:0.28404
48 ROUGE-L Eval D0736-B.M.100.H-J.48 R:0.38811 P:0.25000 F:0.30411
48 ROUGE-L Eval D0736-C.M.100.H-G.48 R:0.37553 P:0.18427 F:0.24723
48 ROUGE-L Eval D0736-C.M.100.H-H.48 R:0.29412 P:0.11387 F:0.16418
48 ROUGE-L Eval D0736-C.M.100.H-I.48 R:0.43850 P:0.16977 F:0.24477
48 ROUGE-L Eval D0736-C.M.100.H-J.48 R:0.35849 P:0.19669 F:0.25401
48 ROUGE-L Eval D0740-A.M.100.I-D.48 R:0.32673 P:0.21854 F:0.26190
48 ROUGE-L Eval D0740-A.M.100.I-H.48 R:0.32353 P:0.21854 F:0.26087
48 ROUGE-L Eval D0740-A.M.100.I-I.48 R:0.33442 P:0.22737 F:0.27070
48 ROUGE-L Eval D0740-A.M.100.I-J.48 R:0.33548 P:0.22958 F:0.27261
48 ROUGE-L Eval D0740-B.M.100.I-D.48 R:0.33766 P:0.23266 F:0.27549
48 ROUGE-L Eval D0740-B.M.100.I-H.48 R:0.30464 P:0.20582 F:0.24566
48 ROUGE-L Eval D0740-B.M.100.I-I.48 R:0.31148 P:0.21253 F:0.25266
48 ROUGE-L Eval D0740-B.M.100.I-J.48 R:0.32039 P:0.22148 F:0.26191
48 ROUGE-L Eval D0740-C.M.100.I-D.48 R:0.28115 P:0.21103 F:0.24110
48 ROUGE-L Eval D0740-C.M.100.I-H.48 R:0.24437 P:0.18225 F:0.20879
48 ROUGE-L Eval D0740-C.M.100.I-I.48 R:0.26198 P:0.19664 F:0.22466
48 ROUGE-L Eval D0740-C.M.100.I-J.48 R:0.28662 P:0.21583 F:0.24624
48 ROUGE-L Eval D0743-A.M.100.J-B.48 R:0.26349 P:0.19347 F:0.22312
48 ROUGE-L Eval D0743-A.M.100.J-H.48 R:0.25617 P:0.19347 F:0.22045
48 ROUGE-L Eval D0743-A.M.100.J-I.48 R:0.24375 P:0.18182 F:0.20828
48 ROUGE-L Eval D0743-A.M.100.J-J.48 R:0.22769 P:0.17249 F:0.19628
48 ROUGE-L Eval D0743-B.M.100.J-B.48 R:0.24359 P:0.14815 F:0.18424
48 ROUGE-L Eval D0743-B.M.100.J-H.48 R:0.19874 P:0.12281 F:0.15181
48 ROUGE-L Eval D0743-B.M.100.J-I.48 R:0.20570 P:0.12671 F:0.15682
48 ROUGE-L Eval D0743-B.M.100.J-J.48 R:0.20561 P:0.12865 F:0.15827
48 ROUGE-L Eval D0743-C.M.100.J-B.48 R:0.27619 P:0.21324 F:0.24067
48 ROUGE-L Eval D0743-C.M.100.J-H.48 R:0.27707 P:0.21324 F:0.24100
48 ROUGE-L Eval D0743-C.M.100.J-I.48 R:0.28435 P:0.21814 F:0.24688
48 ROUGE-L Eval D0743-C.M.100.J-J.48 R:0.25786 P:0.20098 F:0.22589
---------------------------------------------
48 ROUGE-W-1.2 Average_R: 0.10694 (95%-conf.int. 0.10318 - 0.11087)
48 ROUGE-W-1.2 Average_P: 0.13171 (95%-conf.int. 0.12725 - 0.13585)
48 ROUGE-W-1.2 Average_F: 0.11760 (95%-conf.int. 0.11376 - 0.12126)
.............................................
48 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.48 R:0.12307 P:0.14774 F:0.13428
48 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.48 R:0.10861 P:0.13249 F:0.11937
48 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.48 R:0.12027 P:0.14533 F:0.13162
48 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.48 R:0.13976 P:0.15830 F:0.14845
48 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.48 R:0.10320 P:0.13842 F:0.11824
48 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.48 R:0.09975 P:0.13298 F:0.11399
48 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.48 R:0.09661 P:0.12766 F:0.10999
48 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.48 R:0.10970 P:0.14478 F:0.12482
48 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.48 R:0.10027 P:0.14680 F:0.11915
48 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.48 R:0.09260 P:0.14134 F:0.11189
48 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.48 R:0.08739 P:0.13147 F:0.10499
48 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.48 R:0.10526 P:0.15027 F:0.12380
48 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.48 R:0.11558 P:0.15103 F:0.13095
48 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.48 R:0.11430 P:0.15173 F:0.13038
48 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.48 R:0.09803 P:0.12943 F:0.11156
48 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.48 R:0.10767 P:0.14528 F:0.12368
48 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.48 R:0.09809 P:0.10898 F:0.10325
48 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.48 R:0.08220 P:0.09329 F:0.08739
48 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.48 R:0.07819 P:0.08912 F:0.08330
48 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.48 R:0.09337 P:0.10938 F:0.10074
48 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.48 R:0.11263 P:0.13331 F:0.12210
48 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.48 R:0.12764 P:0.15239 F:0.13892
48 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.48 R:0.12298 P:0.14541 F:0.13326
48 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.48 R:0.12720 P:0.15468 F:0.13960
48 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.48 R:0.13252 P:0.16141 F:0.14555
48 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.48 R:0.13437 P:0.16226 F:0.14700
48 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.48 R:0.12495 P:0.14958 F:0.13616
48 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.48 R:0.12494 P:0.15211 F:0.13719
48 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.48 R:0.10405 P:0.11443 F:0.10899
48 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.48 R:0.10687 P:0.12260 F:0.11420
48 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.48 R:0.10185 P:0.11953 F:0.10998
48 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.48 R:0.09188 P:0.10553 F:0.09823
48 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.48 R:0.10048 P:0.12820 F:0.11266
48 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.48 R:0.10653 P:0.13147 F:0.11769
48 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.48 R:0.09705 P:0.12285 F:0.10844
48 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.48 R:0.08673 P:0.11143 F:0.09754
48 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.48 R:0.14717 P:0.18470 F:0.16381
48 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.48 R:0.14839 P:0.19102 F:0.16703
48 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.48 R:0.15284 P:0.19350 F:0.17078
48 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.48 R:0.13526 P:0.17554 F:0.15279
48 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.48 R:0.10560 P:0.13827 F:0.11975
48 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.48 R:0.10709 P:0.14102 F:0.12173
48 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.48 R:0.11083 P:0.14663 F:0.12624
48 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.48 R:0.10782 P:0.14137 F:0.12234
48 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.48 R:0.11452 P:0.14562 F:0.12821
48 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.48 R:0.10095 P:0.13007 F:0.11367
48 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.48 R:0.11464 P:0.14959 F:0.12980
48 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.48 R:0.10463 P:0.13569 F:0.11815
48 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.48 R:0.10133 P:0.12906 F:0.11353
48 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.48 R:0.10461 P:0.13808 F:0.11904
48 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.48 R:0.09629 P:0.12869 F:0.11016
48 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.48 R:0.10058 P:0.13368 F:0.11479
48 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.48 R:0.08125 P:0.11163 F:0.09405
48 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.48 R:0.07834 P:0.10702 F:0.09046
48 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.48 R:0.07261 P:0.10063 F:0.08435
48 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.48 R:0.06683 P:0.09571 F:0.07870
48 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.48 R:0.09184 P:0.13322 F:0.10873
48 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.48 R:0.07028 P:0.10353 F:0.08372
48 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.48 R:0.08216 P:0.11888 F:0.09717
48 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.48 R:0.07664 P:0.11370 F:0.09156
48 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.48 R:0.15342 P:0.20058 F:0.17386
48 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.48 R:0.13848 P:0.17839 F:0.15592
48 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.48 R:0.15553 P:0.20437 F:0.17664
48 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.48 R:0.13096 P:0.17489 F:0.14977
48 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.48 R:0.09417 P:0.10495 F:0.09927
48 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.48 R:0.09042 P:0.10172 F:0.09574
48 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.48 R:0.09530 P:0.10790 F:0.10121
48 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.48 R:0.08937 P:0.10156 F:0.09508
48 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.48 R:0.06745 P:0.09327 F:0.07829
48 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.48 R:0.07151 P:0.09839 F:0.08282
48 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.48 R:0.06809 P:0.09441 F:0.07912
48 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.48 R:0.06840 P:0.09804 F:0.08058
48 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.48 R:0.14606 P:0.18294 F:0.16243
48 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.48 R:0.13004 P:0.17059 F:0.14758
48 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.48 R:0.11933 P:0.15289 F:0.13404
48 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.48 R:0.14631 P:0.18849 F:0.16474
48 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.48 R:0.11079 P:0.11935 F:0.11491
48 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.48 R:0.10247 P:0.11961 F:0.11038
48 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.48 R:0.09314 P:0.10171 F:0.09724
48 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.48 R:0.10152 P:0.11032 F:0.10574
48 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.48 R:0.10289 P:0.11984 F:0.11072
48 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.48 R:0.10085 P:0.11678 F:0.10823
48 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.48 R:0.09587 P:0.11281 F:0.10365
48 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.48 R:0.11112 P:0.12489 F:0.11760
48 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.48 R:0.11368 P:0.11775 F:0.11568
48 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.48 R:0.11431 P:0.11547 F:0.11489
48 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.48 R:0.11194 P:0.11782 F:0.11480
48 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.48 R:0.10783 P:0.12332 F:0.11506
48 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.48 R:0.13346 P:0.14577 F:0.13934
48 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.48 R:0.15406 P:0.15535 F:0.15470
48 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.48 R:0.15684 P:0.15593 F:0.15638
48 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.48 R:0.14454 P:0.17211 F:0.15712
48 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.48 R:0.14174 P:0.12634 F:0.13360
48 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.48 R:0.10669 P:0.07720 F:0.08958
48 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.48 R:0.17115 P:0.12088 F:0.14169
48 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.48 R:0.13344 P:0.13062 F:0.13201
48 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.48 R:0.10946 P:0.13468 F:0.12077
48 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.48 R:0.11204 P:0.13654 F:0.12308
48 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.48 R:0.11133 P:0.14002 F:0.12404
48 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.48 R:0.11611 P:0.14597 F:0.12934
48 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.48 R:0.12026 P:0.15225 F:0.13438
48 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.48 R:0.11284 P:0.13567 F:0.12321
48 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.48 R:0.10589 P:0.13576 F:0.11898
48 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.48 R:0.11747 P:0.14517 F:0.12986
48 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.48 R:0.09484 P:0.13738 F:0.11221
48 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.48 R:0.08406 P:0.11700 F:0.09783
48 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.48 R:0.08708 P:0.12782 F:0.10359
48 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.48 R:0.09595 P:0.13845 F:0.11335
48 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.48 R:0.09318 P:0.11927 F:0.10462
48 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.48 R:0.09032 P:0.11784 F:0.10226
48 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.48 R:0.08362 P:0.11068 F:0.09527
48 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.48 R:0.08084 P:0.10631 F:0.09184
48 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.48 R:0.09038 P:0.09205 F:0.09121
48 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.48 R:0.07738 P:0.07929 F:0.07832
48 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.48 R:0.07640 P:0.07931 F:0.07783
48 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.48 R:0.07945 P:0.08174 F:0.08058
48 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.48 R:0.09684 P:0.13088 F:0.11132
48 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.48 R:0.09407 P:0.12090 F:0.10581
48 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.48 R:0.09373 P:0.12814 F:0.10827
48 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.48 R:0.08510 P:0.11164 F:0.09658
---------------------------------------------
48 ROUGE-SU4 Average_R: 0.12438 (95%-conf.int. 0.11717 - 0.13129)
48 ROUGE-SU4 Average_P: 0.08374 (95%-conf.int. 0.07910 - 0.08820)
48 ROUGE-SU4 Average_F: 0.09974 (95%-conf.int. 0.09427 - 0.10511)
.............................................
48 ROUGE-SU4 Eval D0703-A.M.100.A-A.48 R:0.14757 P:0.09748 F:0.11741
48 ROUGE-SU4 Eval D0703-A.M.100.A-C.48 R:0.13046 P:0.08677 F:0.10422
48 ROUGE-SU4 Eval D0703-A.M.100.A-D.48 R:0.15077 P:0.09786 F:0.11869
48 ROUGE-SU4 Eval D0703-A.M.100.A-J.48 R:0.15210 P:0.09977 F:0.12050
48 ROUGE-SU4 Eval D0703-B.M.100.A-A.48 R:0.15045 P:0.10803 F:0.12576
48 ROUGE-SU4 Eval D0703-B.M.100.A-C.48 R:0.13793 P:0.09639 F:0.11348
48 ROUGE-SU4 Eval D0703-B.M.100.A-D.48 R:0.13218 P:0.09237 F:0.10875
48 ROUGE-SU4 Eval D0703-B.M.100.A-J.48 R:0.16496 P:0.11647 F:0.13654
48 ROUGE-SU4 Eval D0703-C.M.100.A-A.48 R:0.12215 P:0.09562 F:0.10727
48 ROUGE-SU4 Eval D0703-C.M.100.A-C.48 R:0.12000 P:0.09651 F:0.10698
48 ROUGE-SU4 Eval D0703-C.M.100.A-D.48 R:0.11848 P:0.09339 F:0.10445
48 ROUGE-SU4 Eval D0703-C.M.100.A-J.48 R:0.12075 P:0.09517 F:0.10644
48 ROUGE-SU4 Eval D0706-A.M.100.B-B.48 R:0.13944 P:0.10080 F:0.11701
48 ROUGE-SU4 Eval D0706-A.M.100.B-D.48 R:0.14877 P:0.10683 F:0.12436
48 ROUGE-SU4 Eval D0706-A.M.100.B-E.48 R:0.10611 P:0.07671 F:0.08905
48 ROUGE-SU4 Eval D0706-A.M.100.B-I.48 R:0.12833 P:0.09277 F:0.10769
48 ROUGE-SU4 Eval D0706-B.M.100.B-B.48 R:0.10682 P:0.06787 F:0.08300
48 ROUGE-SU4 Eval D0706-B.M.100.B-D.48 R:0.08807 P:0.05615 F:0.06858
48 ROUGE-SU4 Eval D0706-B.M.100.B-E.48 R:0.07111 P:0.04549 F:0.05549
48 ROUGE-SU4 Eval D0706-B.M.100.B-I.48 R:0.10299 P:0.06610 F:0.08052
48 ROUGE-SU4 Eval D0706-C.M.100.B-B.48 R:0.11810 P:0.08125 F:0.09627
48 ROUGE-SU4 Eval D0706-C.M.100.B-D.48 R:0.14901 P:0.10251 F:0.12146
48 ROUGE-SU4 Eval D0706-C.M.100.B-E.48 R:0.13432 P:0.09301 F:0.10991
48 ROUGE-SU4 Eval D0706-C.M.100.B-I.48 R:0.15082 P:0.10478 F:0.12365
48 ROUGE-SU4 Eval D0711-A.M.100.C-A.48 R:0.16554 P:0.11086 F:0.13279
48 ROUGE-SU4 Eval D0711-A.M.100.C-B.48 R:0.16781 P:0.11086 F:0.13352
48 ROUGE-SU4 Eval D0711-A.M.100.C-C.48 R:0.15354 P:0.10143 F:0.12216
48 ROUGE-SU4 Eval D0711-A.M.100.C-F.48 R:0.14512 P:0.09653 F:0.11594
48 ROUGE-SU4 Eval D0711-B.M.100.C-A.48 R:0.11655 P:0.07107 F:0.08830
48 ROUGE-SU4 Eval D0711-B.M.100.C-B.48 R:0.13028 P:0.07889 F:0.09827
48 ROUGE-SU4 Eval D0711-B.M.100.C-C.48 R:0.12529 P:0.07747 F:0.09574
48 ROUGE-SU4 Eval D0711-B.M.100.C-F.48 R:0.10221 P:0.06254 F:0.07760
48 ROUGE-SU4 Eval D0711-C.M.100.C-A.48 R:0.11864 P:0.08028 F:0.09576
48 ROUGE-SU4 Eval D0711-C.M.100.C-B.48 R:0.12632 P:0.08257 F:0.09986
48 ROUGE-SU4 Eval D0711-C.M.100.C-C.48 R:0.11516 P:0.07607 F:0.09162
48 ROUGE-SU4 Eval D0711-C.M.100.C-F.48 R:0.09664 P:0.06384 F:0.07689
48 ROUGE-SU4 Eval D0716-A.M.100.D-C.48 R:0.21998 P:0.14985 F:0.17827
48 ROUGE-SU4 Eval D0716-A.M.100.D-D.48 R:0.24030 P:0.16093 F:0.19276
48 ROUGE-SU4 Eval D0716-A.M.100.D-E.48 R:0.23436 P:0.15749 F:0.18839
48 ROUGE-SU4 Eval D0716-A.M.100.D-F.48 R:0.21469 P:0.14526 F:0.17328
48 ROUGE-SU4 Eval D0716-B.M.100.D-C.48 R:0.13401 P:0.09992 F:0.11448
48 ROUGE-SU4 Eval D0716-B.M.100.D-D.48 R:0.14080 P:0.10285 F:0.11887
48 ROUGE-SU4 Eval D0716-B.M.100.D-E.48 R:0.13367 P:0.09866 F:0.11353
48 ROUGE-SU4 Eval D0716-B.M.100.D-F.48 R:0.13984 P:0.10285 F:0.11853
48 ROUGE-SU4 Eval D0716-C.M.100.D-C.48 R:0.15050 P:0.10181 F:0.12146
48 ROUGE-SU4 Eval D0716-C.M.100.D-D.48 R:0.13345 P:0.08786 F:0.10596
48 ROUGE-SU4 Eval D0716-C.M.100.D-E.48 R:0.16441 P:0.10973 F:0.13162
48 ROUGE-SU4 Eval D0716-C.M.100.D-F.48 R:0.14441 P:0.09540 F:0.11490
48 ROUGE-SU4 Eval D0721-A.M.100.E-B.48 R:0.09589 P:0.06897 F:0.08023
48 ROUGE-SU4 Eval D0721-A.M.100.E-C.48 R:0.09944 P:0.07348 F:0.08451
48 ROUGE-SU4 Eval D0721-A.M.100.E-E.48 R:0.08833 P:0.06527 F:0.07507
48 ROUGE-SU4 Eval D0721-A.M.100.E-G.48 R:0.09532 P:0.07184 F:0.08193
48 ROUGE-SU4 Eval D0721-B.M.100.E-B.48 R:0.08696 P:0.06132 F:0.07192
48 ROUGE-SU4 Eval D0721-B.M.100.E-C.48 R:0.07625 P:0.05503 F:0.06393
48 ROUGE-SU4 Eval D0721-B.M.100.E-E.48 R:0.07183 P:0.05031 F:0.05917
48 ROUGE-SU4 Eval D0721-B.M.100.E-G.48 R:0.06402 P:0.04560 F:0.05326
48 ROUGE-SU4 Eval D0721-C.M.100.E-B.48 R:0.08979 P:0.07036 F:0.07890
48 ROUGE-SU4 Eval D0721-C.M.100.E-C.48 R:0.06158 P:0.04793 F:0.05390
48 ROUGE-SU4 Eval D0721-C.M.100.E-E.48 R:0.08162 P:0.06288 F:0.07103
48 ROUGE-SU4 Eval D0721-C.M.100.E-G.48 R:0.07302 P:0.05761 F:0.06441
48 ROUGE-SU4 Eval D0726-A.M.100.F-A.48 R:0.21502 P:0.15750 F:0.18182
48 ROUGE-SU4 Eval D0726-A.M.100.F-E.48 R:0.16895 P:0.12333 F:0.14258
48 ROUGE-SU4 Eval D0726-A.M.100.F-F.48 R:0.20705 P:0.15167 F:0.17509
48 ROUGE-SU4 Eval D0726-A.M.100.F-G.48 R:0.17065 P:0.12500 F:0.14430
48 ROUGE-SU4 Eval D0726-B.M.100.F-A.48 R:0.09004 P:0.05649 F:0.06942
48 ROUGE-SU4 Eval D0726-B.M.100.F-E.48 R:0.09499 P:0.05860 F:0.07248
48 ROUGE-SU4 Eval D0726-B.M.100.F-F.48 R:0.10410 P:0.06421 F:0.07943
48 ROUGE-SU4 Eval D0726-B.M.100.F-G.48 R:0.08727 P:0.05439 F:0.06701
48 ROUGE-SU4 Eval D0726-C.M.100.F-A.48 R:0.05537 P:0.04334 F:0.04862
48 ROUGE-SU4 Eval D0726-C.M.100.F-E.48 R:0.05248 P:0.04066 F:0.04582
48 ROUGE-SU4 Eval D0726-C.M.100.F-F.48 R:0.05691 P:0.04379 F:0.04950
48 ROUGE-SU4 Eval D0726-C.M.100.F-G.48 R:0.05668 P:0.04513 F:0.05025
48 ROUGE-SU4 Eval D0727-A.M.100.G-A.48 R:0.19625 P:0.13855 F:0.16243
48 ROUGE-SU4 Eval D0727-A.M.100.G-F.48 R:0.17905 P:0.12771 F:0.14908
48 ROUGE-SU4 Eval D0727-A.M.100.G-G.48 R:0.13423 P:0.09639 F:0.11221
48 ROUGE-SU4 Eval D0727-A.M.100.G-H.48 R:0.20101 P:0.14337 F:0.16737
48 ROUGE-SU4 Eval D0727-B.M.100.G-A.48 R:0.09776 P:0.05937 F:0.07388
48 ROUGE-SU4 Eval D0727-B.M.100.G-F.48 R:0.09722 P:0.06259 F:0.07615
48 ROUGE-SU4 Eval D0727-B.M.100.G-G.48 R:0.08007 P:0.04828 F:0.06024
48 ROUGE-SU4 Eval D0727-B.M.100.G-H.48 R:0.09600 P:0.05830 F:0.07254
48 ROUGE-SU4 Eval D0727-C.M.100.G-A.48 R:0.11929 P:0.07654 F:0.09325
48 ROUGE-SU4 Eval D0727-C.M.100.G-F.48 R:0.11476 P:0.07117 F:0.08786
48 ROUGE-SU4 Eval D0727-C.M.100.G-G.48 R:0.10791 P:0.06831 F:0.08366
48 ROUGE-SU4 Eval D0727-C.M.100.G-H.48 R:0.12789 P:0.07904 F:0.09770
48 ROUGE-SU4 Eval D0736-A.M.100.H-G.48 R:0.10640 P:0.06148 F:0.07793
48 ROUGE-SU4 Eval D0736-A.M.100.H-H.48 R:0.10714 P:0.06077 F:0.07755
48 ROUGE-SU4 Eval D0736-A.M.100.H-I.48 R:0.10623 P:0.06183 F:0.07816
48 ROUGE-SU4 Eval D0736-A.M.100.H-J.48 R:0.09955 P:0.06326 F:0.07736
48 ROUGE-SU4 Eval D0736-B.M.100.H-G.48 R:0.14961 P:0.08716 F:0.11015
48 ROUGE-SU4 Eval D0736-B.M.100.H-H.48 R:0.18875 P:0.10130 F:0.13184
48 ROUGE-SU4 Eval D0736-B.M.100.H-I.48 R:0.20707 P:0.10971 F:0.14343
48 ROUGE-SU4 Eval D0736-B.M.100.H-J.48 R:0.18885 P:0.12041 F:0.14706
48 ROUGE-SU4 Eval D0736-C.M.100.H-G.48 R:0.18559 P:0.08947 F:0.12074
48 ROUGE-SU4 Eval D0736-C.M.100.H-H.48 R:0.11732 P:0.04421 F:0.06422
48 ROUGE-SU4 Eval D0736-C.M.100.H-I.48 R:0.23371 P:0.08807 F:0.12793
48 ROUGE-SU4 Eval D0736-C.M.100.H-J.48 R:0.16796 P:0.09088 F:0.11794
48 ROUGE-SU4 Eval D0740-A.M.100.I-D.48 R:0.11751 P:0.07790 F:0.09369
48 ROUGE-SU4 Eval D0740-A.M.100.I-H.48 R:0.12584 P:0.08427 F:0.10094
48 ROUGE-SU4 Eval D0740-A.M.100.I-I.48 R:0.12944 P:0.08727 F:0.10425
48 ROUGE-SU4 Eval D0740-A.M.100.I-J.48 R:0.12252 P:0.08315 F:0.09907
48 ROUGE-SU4 Eval D0740-B.M.100.I-D.48 R:0.12722 P:0.08694 F:0.10329
48 ROUGE-SU4 Eval D0740-B.M.100.I-H.48 R:0.11281 P:0.07555 F:0.09049
48 ROUGE-SU4 Eval D0740-B.M.100.I-I.48 R:0.11279 P:0.07631 F:0.09103
48 ROUGE-SU4 Eval D0740-B.M.100.I-J.48 R:0.12348 P:0.08466 F:0.10045
48 ROUGE-SU4 Eval D0740-C.M.100.I-D.48 R:0.13333 P:0.09943 F:0.11391
48 ROUGE-SU4 Eval D0740-C.M.100.I-H.48 R:0.10506 P:0.07783 F:0.08942
48 ROUGE-SU4 Eval D0740-C.M.100.I-I.48 R:0.12350 P:0.09209 F:0.10551
48 ROUGE-SU4 Eval D0740-C.M.100.I-J.48 R:0.13017 P:0.09739 F:0.11142
48 ROUGE-SU4 Eval D0743-A.M.100.J-B.48 R:0.09012 P:0.06572 F:0.07601
48 ROUGE-SU4 Eval D0743-A.M.100.J-H.48 R:0.08386 P:0.06295 F:0.07192
48 ROUGE-SU4 Eval D0743-A.M.100.J-I.48 R:0.07692 P:0.05701 F:0.06549
48 ROUGE-SU4 Eval D0743-A.M.100.J-J.48 R:0.07045 P:0.05305 F:0.06052
48 ROUGE-SU4 Eval D0743-B.M.100.J-B.48 R:0.07237 P:0.04356 F:0.05439
48 ROUGE-SU4 Eval D0743-B.M.100.J-H.48 R:0.05609 P:0.03432 F:0.04258
48 ROUGE-SU4 Eval D0743-B.M.100.J-I.48 R:0.06277 P:0.03828 F:0.04756
48 ROUGE-SU4 Eval D0743-B.M.100.J-J.48 R:0.06017 P:0.03729 F:0.04604
48 ROUGE-SU4 Eval D0743-C.M.100.J-B.48 R:0.10532 P:0.08083 F:0.09146
48 ROUGE-SU4 Eval D0743-C.M.100.J-H.48 R:0.09804 P:0.07500 F:0.08499
48 ROUGE-SU4 Eval D0743-C.M.100.J-I.48 R:0.11530 P:0.08792 F:0.09977
48 ROUGE-SU4 Eval D0743-C.M.100.J-J.48 R:0.09516 P:0.07375 F:0.08310
---------------------------------------------
49 ROUGE-1 Average_R: 0.33723 (95%-conf.int. 0.32618 - 0.34856)
49 ROUGE-1 Average_P: 0.21013 (95%-conf.int. 0.20217 - 0.21835)
49 ROUGE-1 Average_F: 0.25829 (95%-conf.int. 0.24908 - 0.26758)
.............................................
49 ROUGE-1 Eval D0703-A.M.100.A-A.49 R:0.34459 P:0.24286 F:0.28492
49 ROUGE-1 Eval D0703-A.M.100.A-C.49 R:0.34228 P:0.24286 F:0.28412
49 ROUGE-1 Eval D0703-A.M.100.A-D.49 R:0.33677 P:0.23333 F:0.27567
49 ROUGE-1 Eval D0703-A.M.100.A-J.49 R:0.34014 P:0.23810 F:0.28012
49 ROUGE-1 Eval D0703-B.M.100.A-A.49 R:0.30065 P:0.20175 F:0.24147
49 ROUGE-1 Eval D0703-B.M.100.A-C.49 R:0.35235 P:0.23026 F:0.27851
49 ROUGE-1 Eval D0703-B.M.100.A-D.49 R:0.34899 P:0.22807 F:0.27586
49 ROUGE-1 Eval D0703-B.M.100.A-J.49 R:0.33555 P:0.22149 F:0.26684
49 ROUGE-1 Eval D0703-C.M.100.A-A.49 R:0.41000 P:0.25949 F:0.31783
49 ROUGE-1 Eval D0703-C.M.100.A-C.49 R:0.37662 P:0.24473 F:0.29668
49 ROUGE-1 Eval D0703-C.M.100.A-D.49 R:0.41722 P:0.26582 F:0.32474
49 ROUGE-1 Eval D0703-C.M.100.A-J.49 R:0.44040 P:0.28059 F:0.34278
49 ROUGE-1 Eval D0706-A.M.100.B-B.49 R:0.36039 P:0.21637 F:0.27040
49 ROUGE-1 Eval D0706-A.M.100.B-D.49 R:0.34641 P:0.20663 F:0.25886
49 ROUGE-1 Eval D0706-A.M.100.B-E.49 R:0.31818 P:0.19103 F:0.23873
49 ROUGE-1 Eval D0706-A.M.100.B-I.49 R:0.33117 P:0.19883 F:0.24848
49 ROUGE-1 Eval D0706-B.M.100.B-B.49 R:0.26144 P:0.15595 F:0.19536
49 ROUGE-1 Eval D0706-B.M.100.B-D.49 R:0.25081 P:0.15010 F:0.18781
49 ROUGE-1 Eval D0706-B.M.100.B-E.49 R:0.23701 P:0.14230 F:0.17783
49 ROUGE-1 Eval D0706-B.M.100.B-I.49 R:0.27508 P:0.16569 F:0.20681
49 ROUGE-1 Eval D0706-C.M.100.B-B.49 R:0.34839 P:0.23841 F:0.28309
49 ROUGE-1 Eval D0706-C.M.100.B-D.49 R:0.37419 P:0.25607 F:0.30406
49 ROUGE-1 Eval D0706-C.M.100.B-E.49 R:0.35897 P:0.24724 F:0.29281
49 ROUGE-1 Eval D0706-C.M.100.B-I.49 R:0.34505 P:0.23841 F:0.28198
49 ROUGE-1 Eval D0711-A.M.100.C-A.49 R:0.40461 P:0.25153 F:0.31021
49 ROUGE-1 Eval D0711-A.M.100.C-B.49 R:0.46000 P:0.28221 F:0.34981
49 ROUGE-1 Eval D0711-A.M.100.C-C.49 R:0.44000 P:0.26994 F:0.33460
49 ROUGE-1 Eval D0711-A.M.100.C-F.49 R:0.43709 P:0.26994 F:0.33376
49 ROUGE-1 Eval D0711-B.M.100.C-A.49 R:0.36735 P:0.22086 F:0.27586
49 ROUGE-1 Eval D0711-B.M.100.C-B.49 R:0.36301 P:0.21677 F:0.27145
49 ROUGE-1 Eval D0711-B.M.100.C-C.49 R:0.33557 P:0.20450 F:0.25413
49 ROUGE-1 Eval D0711-B.M.100.C-F.49 R:0.33898 P:0.20450 F:0.25510
49 ROUGE-1 Eval D0711-C.M.100.C-A.49 R:0.44884 P:0.29825 F:0.35837
49 ROUGE-1 Eval D0711-C.M.100.C-B.49 R:0.41980 P:0.26974 F:0.32844
49 ROUGE-1 Eval D0711-C.M.100.C-C.49 R:0.39189 P:0.25439 F:0.30851
49 ROUGE-1 Eval D0711-C.M.100.C-F.49 R:0.43581 P:0.28289 F:0.34308
49 ROUGE-1 Eval D0716-A.M.100.D-C.49 R:0.41311 P:0.28378 F:0.33644
49 ROUGE-1 Eval D0716-A.M.100.D-D.49 R:0.38667 P:0.26126 F:0.31183
49 ROUGE-1 Eval D0716-A.M.100.D-E.49 R:0.44518 P:0.30180 F:0.35973
49 ROUGE-1 Eval D0716-A.M.100.D-F.49 R:0.41254 P:0.28153 F:0.33467
49 ROUGE-1 Eval D0716-B.M.100.D-C.49 R:0.31908 P:0.21556 F:0.25730
49 ROUGE-1 Eval D0716-B.M.100.D-D.49 R:0.35570 P:0.23556 F:0.28342
49 ROUGE-1 Eval D0716-B.M.100.D-E.49 R:0.32226 P:0.21556 F:0.25833
49 ROUGE-1 Eval D0716-B.M.100.D-F.49 R:0.33000 P:0.22000 F:0.26400
49 ROUGE-1 Eval D0716-C.M.100.D-C.49 R:0.42671 P:0.29705 F:0.35027
49 ROUGE-1 Eval D0716-C.M.100.D-D.49 R:0.49833 P:0.33787 F:0.40270
49 ROUGE-1 Eval D0716-C.M.100.D-E.49 R:0.45215 P:0.31066 F:0.36828
49 ROUGE-1 Eval D0716-C.M.100.D-F.49 R:0.47000 P:0.31973 F:0.38057
49 ROUGE-1 Eval D0721-A.M.100.E-B.49 R:0.36000 P:0.22222 F:0.27481
49 ROUGE-1 Eval D0721-A.M.100.E-C.49 R:0.34740 P:0.22016 F:0.26952
49 ROUGE-1 Eval D0721-A.M.100.E-E.49 R:0.36364 P:0.23045 F:0.28211
49 ROUGE-1 Eval D0721-A.M.100.E-G.49 R:0.35350 P:0.22840 F:0.27750
49 ROUGE-1 Eval D0721-B.M.100.E-B.49 R:0.25407 P:0.17219 F:0.20527
49 ROUGE-1 Eval D0721-B.M.100.E-C.49 R:0.21656 P:0.15011 F:0.17731
49 ROUGE-1 Eval D0721-B.M.100.E-E.49 R:0.22951 P:0.15453 F:0.18470
49 ROUGE-1 Eval D0721-B.M.100.E-G.49 R:0.21290 P:0.14570 F:0.17300
49 ROUGE-1 Eval D0721-C.M.100.E-B.49 R:0.32131 P:0.18882 F:0.23786
49 ROUGE-1 Eval D0721-C.M.100.E-C.49 R:0.27063 P:0.15800 F:0.19952
49 ROUGE-1 Eval D0721-C.M.100.E-E.49 R:0.28667 P:0.16570 F:0.21001
49 ROUGE-1 Eval D0721-C.M.100.E-G.49 R:0.26710 P:0.15800 F:0.19855
49 ROUGE-1 Eval D0726-A.M.100.F-A.49 R:0.35216 P:0.20907 F:0.26237
49 ROUGE-1 Eval D0726-A.M.100.F-E.49 R:0.33667 P:0.19921 F:0.25031
49 ROUGE-1 Eval D0726-A.M.100.F-F.49 R:0.32558 P:0.19329 F:0.24257
49 ROUGE-1 Eval D0726-A.M.100.F-G.49 R:0.34219 P:0.20316 F:0.25495
49 ROUGE-1 Eval D0726-B.M.100.F-A.49 R:0.20915 P:0.12476 F:0.15629
49 ROUGE-1 Eval D0726-B.M.100.F-E.49 R:0.23256 P:0.13645 F:0.17199
49 ROUGE-1 Eval D0726-B.M.100.F-F.49 R:0.23920 P:0.14035 F:0.17690
49 ROUGE-1 Eval D0726-B.M.100.F-G.49 R:0.23026 P:0.13645 F:0.17136
49 ROUGE-1 Eval D0726-C.M.100.F-A.49 R:0.28667 P:0.16570 F:0.21001
49 ROUGE-1 Eval D0726-C.M.100.F-E.49 R:0.28620 P:0.16378 F:0.20834
49 ROUGE-1 Eval D0726-C.M.100.F-F.49 R:0.29492 P:0.16763 F:0.21376
49 ROUGE-1 Eval D0726-C.M.100.F-G.49 R:0.28525 P:0.16763 F:0.21117
49 ROUGE-1 Eval D0727-A.M.100.G-A.49 R:0.40199 P:0.24744 F:0.30633
49 ROUGE-1 Eval D0727-A.M.100.G-F.49 R:0.41776 P:0.25971 F:0.32030
49 ROUGE-1 Eval D0727-A.M.100.G-G.49 R:0.39216 P:0.24540 F:0.30189
49 ROUGE-1 Eval D0727-A.M.100.G-H.49 R:0.39803 P:0.24744 F:0.30517
49 ROUGE-1 Eval D0727-B.M.100.G-A.49 R:0.40206 P:0.22543 F:0.28889
49 ROUGE-1 Eval D0727-B.M.100.G-F.49 R:0.37013 P:0.21965 F:0.27569
49 ROUGE-1 Eval D0727-B.M.100.G-G.49 R:0.35986 P:0.20039 F:0.25743
49 ROUGE-1 Eval D0727-B.M.100.G-H.49 R:0.37457 P:0.21002 F:0.26914
49 ROUGE-1 Eval D0727-C.M.100.G-A.49 R:0.37459 P:0.21905 F:0.27644
49 ROUGE-1 Eval D0727-C.M.100.G-F.49 R:0.37037 P:0.20952 F:0.26764
49 ROUGE-1 Eval D0727-C.M.100.G-G.49 R:0.37954 P:0.21905 F:0.27778
49 ROUGE-1 Eval D0727-C.M.100.G-H.49 R:0.35135 P:0.19810 F:0.25335
49 ROUGE-1 Eval D0736-A.M.100.H-G.49 R:0.35842 P:0.18215 F:0.24155
49 ROUGE-1 Eval D0736-A.M.100.H-H.49 R:0.39051 P:0.19490 F:0.26002
49 ROUGE-1 Eval D0736-A.M.100.H-I.49 R:0.37367 P:0.19126 F:0.25302
49 ROUGE-1 Eval D0736-A.M.100.H-J.49 R:0.35294 P:0.19672 F:0.25263
49 ROUGE-1 Eval D0736-B.M.100.H-G.49 R:0.20992 P:0.11247 F:0.14647
49 ROUGE-1 Eval D0736-B.M.100.H-H.49 R:0.23967 P:0.11861 F:0.15869
49 ROUGE-1 Eval D0736-B.M.100.H-I.49 R:0.24268 P:0.11861 F:0.15934
49 ROUGE-1 Eval D0736-B.M.100.H-J.49 R:0.24126 P:0.14110 F:0.17806
49 ROUGE-1 Eval D0736-C.M.100.H-G.49 R:0.39241 P:0.19375 F:0.25942
49 ROUGE-1 Eval D0736-C.M.100.H-H.49 R:0.33155 P:0.12917 F:0.18591
49 ROUGE-1 Eval D0736-C.M.100.H-I.49 R:0.46524 P:0.18125 F:0.26087
49 ROUGE-1 Eval D0736-C.M.100.H-J.49 R:0.36604 P:0.20208 F:0.26040
49 ROUGE-1 Eval D0740-A.M.100.I-D.49 R:0.32343 P:0.20165 F:0.24842
49 ROUGE-1 Eval D0740-A.M.100.I-H.49 R:0.32026 P:0.20165 F:0.24748
49 ROUGE-1 Eval D0740-A.M.100.I-I.49 R:0.31169 P:0.19753 F:0.24181
49 ROUGE-1 Eval D0740-A.M.100.I-J.49 R:0.32581 P:0.20782 F:0.25377
49 ROUGE-1 Eval D0740-B.M.100.I-D.49 R:0.27922 P:0.17805 F:0.21744
49 ROUGE-1 Eval D0740-B.M.100.I-H.49 R:0.25828 P:0.16149 F:0.19873
49 ROUGE-1 Eval D0740-B.M.100.I-I.49 R:0.26557 P:0.16770 F:0.20558
49 ROUGE-1 Eval D0740-B.M.100.I-J.49 R:0.25566 P:0.16356 F:0.19949
49 ROUGE-1 Eval D0740-C.M.100.I-D.49 R:0.33866 P:0.23556 F:0.27785
49 ROUGE-1 Eval D0740-C.M.100.I-H.49 R:0.32476 P:0.22444 F:0.26544
49 ROUGE-1 Eval D0740-C.M.100.I-I.49 R:0.32907 P:0.22889 F:0.26999
49 ROUGE-1 Eval D0740-C.M.100.I-J.49 R:0.33121 P:0.23111 F:0.27225
49 ROUGE-1 Eval D0743-A.M.100.J-B.49 R:0.29524 P:0.21528 F:0.24900
49 ROUGE-1 Eval D0743-A.M.100.J-H.49 R:0.28395 P:0.21296 F:0.24338
49 ROUGE-1 Eval D0743-A.M.100.J-I.49 R:0.30625 P:0.22685 F:0.26064
49 ROUGE-1 Eval D0743-A.M.100.J-J.49 R:0.26462 P:0.19907 F:0.22721
49 ROUGE-1 Eval D0743-B.M.100.J-B.49 R:0.27885 P:0.16763 F:0.20939
49 ROUGE-1 Eval D0743-B.M.100.J-H.49 R:0.28707 P:0.17534 F:0.21771
49 ROUGE-1 Eval D0743-B.M.100.J-I.49 R:0.28481 P:0.17341 F:0.21557
49 ROUGE-1 Eval D0743-B.M.100.J-J.49 R:0.29595 P:0.18304 F:0.22619
49 ROUGE-1 Eval D0743-C.M.100.J-B.49 R:0.33016 P:0.21010 F:0.25679
49 ROUGE-1 Eval D0743-C.M.100.J-H.49 R:0.26433 P:0.16768 F:0.20519
49 ROUGE-1 Eval D0743-C.M.100.J-I.49 R:0.30351 P:0.19192 F:0.23515
49 ROUGE-1 Eval D0743-C.M.100.J-J.49 R:0.28302 P:0.18182 F:0.22140
---------------------------------------------
49 ROUGE-2 Average_R: 0.07501 (95%-conf.int. 0.06831 - 0.08142)
49 ROUGE-2 Average_P: 0.04659 (95%-conf.int. 0.04234 - 0.05063)
49 ROUGE-2 Average_F: 0.05732 (95%-conf.int. 0.05218 - 0.06220)
.............................................
49 ROUGE-2 Eval D0703-A.M.100.A-A.49 R:0.10239 P:0.07194 F:0.08451
49 ROUGE-2 Eval D0703-A.M.100.A-C.49 R:0.11186 P:0.07914 F:0.09270
49 ROUGE-2 Eval D0703-A.M.100.A-D.49 R:0.09375 P:0.06475 F:0.07660
49 ROUGE-2 Eval D0703-A.M.100.A-J.49 R:0.10309 P:0.07194 F:0.08474
49 ROUGE-2 Eval D0703-B.M.100.A-A.49 R:0.03960 P:0.02649 F:0.03174
49 ROUGE-2 Eval D0703-B.M.100.A-C.49 R:0.06441 P:0.04194 F:0.05080
49 ROUGE-2 Eval D0703-B.M.100.A-D.49 R:0.06780 P:0.04415 F:0.05348
49 ROUGE-2 Eval D0703-B.M.100.A-J.49 R:0.07047 P:0.04636 F:0.05593
49 ROUGE-2 Eval D0703-C.M.100.A-A.49 R:0.13131 P:0.08280 F:0.10156
49 ROUGE-2 Eval D0703-C.M.100.A-C.49 R:0.09508 P:0.06157 F:0.07474
49 ROUGE-2 Eval D0703-C.M.100.A-D.49 R:0.13043 P:0.08280 F:0.10130
49 ROUGE-2 Eval D0703-C.M.100.A-J.49 R:0.14381 P:0.09130 F:0.11169
49 ROUGE-2 Eval D0706-A.M.100.B-B.49 R:0.09836 P:0.05882 F:0.07362
49 ROUGE-2 Eval D0706-A.M.100.B-D.49 R:0.09901 P:0.05882 F:0.07380
49 ROUGE-2 Eval D0706-A.M.100.B-E.49 R:0.08852 P:0.05294 F:0.06626
49 ROUGE-2 Eval D0706-A.M.100.B-I.49 R:0.09836 P:0.05882 F:0.07362
49 ROUGE-2 Eval D0706-B.M.100.B-B.49 R:0.07591 P:0.04510 F:0.05658
49 ROUGE-2 Eval D0706-B.M.100.B-D.49 R:0.05592 P:0.03333 F:0.04177
49 ROUGE-2 Eval D0706-B.M.100.B-E.49 R:0.03279 P:0.01961 F:0.02454
49 ROUGE-2 Eval D0706-B.M.100.B-I.49 R:0.07190 P:0.04314 F:0.05393
49 ROUGE-2 Eval D0706-C.M.100.B-B.49 R:0.07818 P:0.05333 F:0.06341
49 ROUGE-2 Eval D0706-C.M.100.B-D.49 R:0.08795 P:0.06000 F:0.07133
49 ROUGE-2 Eval D0706-C.M.100.B-E.49 R:0.09385 P:0.06444 F:0.07641
49 ROUGE-2 Eval D0706-C.M.100.B-I.49 R:0.07097 P:0.04889 F:0.05790
49 ROUGE-2 Eval D0711-A.M.100.C-A.49 R:0.06977 P:0.04321 F:0.05337
49 ROUGE-2 Eval D0711-A.M.100.C-B.49 R:0.14141 P:0.08642 F:0.10728
49 ROUGE-2 Eval D0711-A.M.100.C-C.49 R:0.11785 P:0.07202 F:0.08940
49 ROUGE-2 Eval D0711-A.M.100.C-F.49 R:0.10368 P:0.06379 F:0.07898
49 ROUGE-2 Eval D0711-B.M.100.C-A.49 R:0.07904 P:0.04733 F:0.05921
49 ROUGE-2 Eval D0711-B.M.100.C-B.49 R:0.08651 P:0.05144 F:0.06452
49 ROUGE-2 Eval D0711-B.M.100.C-C.49 R:0.05763 P:0.03498 F:0.04354
49 ROUGE-2 Eval D0711-B.M.100.C-F.49 R:0.05479 P:0.03292 F:0.04113
49 ROUGE-2 Eval D0711-C.M.100.C-A.49 R:0.12000 P:0.07947 F:0.09562
49 ROUGE-2 Eval D0711-C.M.100.C-B.49 R:0.12069 P:0.07726 F:0.09421
49 ROUGE-2 Eval D0711-C.M.100.C-C.49 R:0.06485 P:0.04194 F:0.05094
49 ROUGE-2 Eval D0711-C.M.100.C-F.49 R:0.13311 P:0.08609 F:0.10456
49 ROUGE-2 Eval D0716-A.M.100.D-C.49 R:0.13907 P:0.09524 F:0.11306
49 ROUGE-2 Eval D0716-A.M.100.D-D.49 R:0.11448 P:0.07710 F:0.09214
49 ROUGE-2 Eval D0716-A.M.100.D-E.49 R:0.15772 P:0.10658 F:0.12720
49 ROUGE-2 Eval D0716-A.M.100.D-F.49 R:0.13000 P:0.08844 F:0.10527
49 ROUGE-2 Eval D0716-B.M.100.D-C.49 R:0.05316 P:0.03579 F:0.04278
49 ROUGE-2 Eval D0716-B.M.100.D-D.49 R:0.05424 P:0.03579 F:0.04312
49 ROUGE-2 Eval D0716-B.M.100.D-E.49 R:0.05369 P:0.03579 F:0.04295
49 ROUGE-2 Eval D0716-B.M.100.D-F.49 R:0.06061 P:0.04027 F:0.04839
49 ROUGE-2 Eval D0716-C.M.100.D-C.49 R:0.14474 P:0.10046 F:0.11860
49 ROUGE-2 Eval D0716-C.M.100.D-D.49 R:0.17905 P:0.12100 F:0.14441
49 ROUGE-2 Eval D0716-C.M.100.D-E.49 R:0.15333 P:0.10502 F:0.12466
49 ROUGE-2 Eval D0716-C.M.100.D-F.49 R:0.15488 P:0.10502 F:0.12517
49 ROUGE-2 Eval D0721-A.M.100.E-B.49 R:0.09764 P:0.06004 F:0.07436
49 ROUGE-2 Eval D0721-A.M.100.E-C.49 R:0.09508 P:0.06004 F:0.07360
49 ROUGE-2 Eval D0721-A.M.100.E-E.49 R:0.10492 P:0.06625 F:0.08122
49 ROUGE-2 Eval D0721-A.M.100.E-G.49 R:0.10611 P:0.06832 F:0.08312
49 ROUGE-2 Eval D0721-B.M.100.E-B.49 R:0.02632 P:0.01778 F:0.02122
49 ROUGE-2 Eval D0721-B.M.100.E-C.49 R:0.02572 P:0.01778 F:0.02103
49 ROUGE-2 Eval D0721-B.M.100.E-E.49 R:0.02318 P:0.01556 F:0.01862
49 ROUGE-2 Eval D0721-B.M.100.E-G.49 R:0.01303 P:0.00889 F:0.01057
49 ROUGE-2 Eval D0721-C.M.100.E-B.49 R:0.05960 P:0.03488 F:0.04401
49 ROUGE-2 Eval D0721-C.M.100.E-C.49 R:0.04333 P:0.02519 F:0.03186
49 ROUGE-2 Eval D0721-C.M.100.E-E.49 R:0.04377 P:0.02519 F:0.03198
49 ROUGE-2 Eval D0721-C.M.100.E-G.49 R:0.04276 P:0.02519 F:0.03170
49 ROUGE-2 Eval D0726-A.M.100.F-A.49 R:0.06040 P:0.03571 F:0.04488
49 ROUGE-2 Eval D0726-A.M.100.F-E.49 R:0.06061 P:0.03571 F:0.04494
49 ROUGE-2 Eval D0726-A.M.100.F-F.49 R:0.03356 P:0.01984 F:0.02494
49 ROUGE-2 Eval D0726-A.M.100.F-G.49 R:0.05705 P:0.03373 F:0.04239
49 ROUGE-2 Eval D0726-B.M.100.F-A.49 R:0.01980 P:0.01176 F:0.01476
49 ROUGE-2 Eval D0726-B.M.100.F-E.49 R:0.02349 P:0.01373 F:0.01733
49 ROUGE-2 Eval D0726-B.M.100.F-F.49 R:0.02349 P:0.01373 F:0.01733
49 ROUGE-2 Eval D0726-B.M.100.F-G.49 R:0.02326 P:0.01373 F:0.01727
49 ROUGE-2 Eval D0726-C.M.100.F-A.49 R:0.04040 P:0.02326 F:0.02952
49 ROUGE-2 Eval D0726-C.M.100.F-E.49 R:0.04422 P:0.02519 F:0.03210
49 ROUGE-2 Eval D0726-C.M.100.F-F.49 R:0.03425 P:0.01938 F:0.02475
49 ROUGE-2 Eval D0726-C.M.100.F-G.49 R:0.04305 P:0.02519 F:0.03178
49 ROUGE-2 Eval D0727-A.M.100.G-A.49 R:0.05034 P:0.03086 F:0.03826
49 ROUGE-2 Eval D0727-A.M.100.G-F.49 R:0.06645 P:0.04115 F:0.05083
49 ROUGE-2 Eval D0727-A.M.100.G-G.49 R:0.05281 P:0.03292 F:0.04056
49 ROUGE-2 Eval D0727-A.M.100.G-H.49 R:0.06977 P:0.04321 F:0.05337
49 ROUGE-2 Eval D0727-B.M.100.G-A.49 R:0.06597 P:0.03682 F:0.04726
49 ROUGE-2 Eval D0727-B.M.100.G-F.49 R:0.03607 P:0.02132 F:0.02680
49 ROUGE-2 Eval D0727-B.M.100.G-G.49 R:0.05594 P:0.03101 F:0.03990
49 ROUGE-2 Eval D0727-B.M.100.G-H.49 R:0.04861 P:0.02713 F:0.03482
49 ROUGE-2 Eval D0727-C.M.100.G-A.49 R:0.08882 P:0.05172 F:0.06537
49 ROUGE-2 Eval D0727-C.M.100.G-F.49 R:0.10204 P:0.05747 F:0.07353
49 ROUGE-2 Eval D0727-C.M.100.G-G.49 R:0.10333 P:0.05939 F:0.07543
49 ROUGE-2 Eval D0727-C.M.100.G-H.49 R:0.06826 P:0.03831 F:0.04908
49 ROUGE-2 Eval D0736-A.M.100.H-G.49 R:0.10507 P:0.05311 F:0.07056
49 ROUGE-2 Eval D0736-A.M.100.H-H.49 R:0.10332 P:0.05128 F:0.06854
49 ROUGE-2 Eval D0736-A.M.100.H-I.49 R:0.10072 P:0.05128 F:0.06796
49 ROUGE-2 Eval D0736-A.M.100.H-J.49 R:0.08581 P:0.04762 F:0.06125
49 ROUGE-2 Eval D0736-B.M.100.H-G.49 R:0.02317 P:0.01235 F:0.01611
49 ROUGE-2 Eval D0736-B.M.100.H-H.49 R:0.05439 P:0.02675 F:0.03586
49 ROUGE-2 Eval D0736-B.M.100.H-I.49 R:0.05932 P:0.02881 F:0.03878
49 ROUGE-2 Eval D0736-B.M.100.H-J.49 R:0.05300 P:0.03086 F:0.03901
49 ROUGE-2 Eval D0736-C.M.100.H-G.49 R:0.13248 P:0.06499 F:0.08720
49 ROUGE-2 Eval D0736-C.M.100.H-H.49 R:0.05978 P:0.02306 F:0.03328
49 ROUGE-2 Eval D0736-C.M.100.H-I.49 R:0.16848 P:0.06499 F:0.09380
49 ROUGE-2 Eval D0736-C.M.100.H-J.49 R:0.12214 P:0.06709 F:0.08661
49 ROUGE-2 Eval D0740-A.M.100.I-D.49 R:0.09333 P:0.05797 F:0.07152
49 ROUGE-2 Eval D0740-A.M.100.I-H.49 R:0.07921 P:0.04969 F:0.06107
49 ROUGE-2 Eval D0740-A.M.100.I-I.49 R:0.07213 P:0.04555 F:0.05584
49 ROUGE-2 Eval D0740-A.M.100.I-J.49 R:0.07166 P:0.04555 F:0.05570
49 ROUGE-2 Eval D0740-B.M.100.I-D.49 R:0.06230 P:0.03958 F:0.04841
49 ROUGE-2 Eval D0740-B.M.100.I-H.49 R:0.05017 P:0.03125 F:0.03851
49 ROUGE-2 Eval D0740-B.M.100.I-I.49 R:0.05960 P:0.03750 F:0.04604
49 ROUGE-2 Eval D0740-B.M.100.I-J.49 R:0.05556 P:0.03542 F:0.04326
49 ROUGE-2 Eval D0740-C.M.100.I-D.49 R:0.09355 P:0.06488 F:0.07662
49 ROUGE-2 Eval D0740-C.M.100.I-H.49 R:0.06818 P:0.04698 F:0.05563
49 ROUGE-2 Eval D0740-C.M.100.I-I.49 R:0.09355 P:0.06488 F:0.07662
49 ROUGE-2 Eval D0740-C.M.100.I-J.49 R:0.08360 P:0.05817 F:0.06860
49 ROUGE-2 Eval D0743-A.M.100.J-B.49 R:0.03526 P:0.02564 F:0.02969
49 ROUGE-2 Eval D0743-A.M.100.J-H.49 R:0.02804 P:0.02098 F:0.02400
49 ROUGE-2 Eval D0743-A.M.100.J-I.49 R:0.02839 P:0.02098 F:0.02413
49 ROUGE-2 Eval D0743-A.M.100.J-J.49 R:0.02174 P:0.01632 F:0.01864
49 ROUGE-2 Eval D0743-B.M.100.J-B.49 R:0.02913 P:0.01744 F:0.02182
49 ROUGE-2 Eval D0743-B.M.100.J-H.49 R:0.02548 P:0.01550 F:0.01927
49 ROUGE-2 Eval D0743-B.M.100.J-I.49 R:0.00958 P:0.00581 F:0.00723
49 ROUGE-2 Eval D0743-B.M.100.J-J.49 R:0.02201 P:0.01357 F:0.01679
49 ROUGE-2 Eval D0743-C.M.100.J-B.49 R:0.07372 P:0.04675 F:0.05722
49 ROUGE-2 Eval D0743-C.M.100.J-H.49 R:0.02251 P:0.01423 F:0.01744
49 ROUGE-2 Eval D0743-C.M.100.J-I.49 R:0.06452 P:0.04065 F:0.04988
49 ROUGE-2 Eval D0743-C.M.100.J-J.49 R:0.06032 P:0.03862 F:0.04709
---------------------------------------------
49 ROUGE-3 Average_R: 0.02734 (95%-conf.int. 0.02368 - 0.03131)
49 ROUGE-3 Average_P: 0.01678 (95%-conf.int. 0.01441 - 0.01920)
49 ROUGE-3 Average_F: 0.02073 (95%-conf.int. 0.01788 - 0.02374)
.............................................
49 ROUGE-3 Eval D0703-A.M.100.A-A.49 R:0.04138 P:0.02899 F:0.03409
49 ROUGE-3 Eval D0703-A.M.100.A-C.49 R:0.04110 P:0.02899 F:0.03400
49 ROUGE-3 Eval D0703-A.M.100.A-D.49 R:0.03158 P:0.02174 F:0.02575
49 ROUGE-3 Eval D0703-A.M.100.A-J.49 R:0.03125 P:0.02174 F:0.02564
49 ROUGE-3 Eval D0703-B.M.100.A-A.49 R:0.01667 P:0.01111 F:0.01333
49 ROUGE-3 Eval D0703-B.M.100.A-C.49 R:0.02055 P:0.01333 F:0.01617
49 ROUGE-3 Eval D0703-B.M.100.A-D.49 R:0.02740 P:0.01778 F:0.02157
49 ROUGE-3 Eval D0703-B.M.100.A-J.49 R:0.02712 P:0.01778 F:0.02148
49 ROUGE-3 Eval D0703-C.M.100.A-A.49 R:0.05442 P:0.03419 F:0.04200
49 ROUGE-3 Eval D0703-C.M.100.A-C.49 R:0.02980 P:0.01923 F:0.02338
49 ROUGE-3 Eval D0703-C.M.100.A-D.49 R:0.06419 P:0.04060 F:0.04974
49 ROUGE-3 Eval D0703-C.M.100.A-J.49 R:0.06419 P:0.04060 F:0.04974
49 ROUGE-3 Eval D0706-A.M.100.B-B.49 R:0.03311 P:0.01972 F:0.02472
49 ROUGE-3 Eval D0706-A.M.100.B-D.49 R:0.04667 P:0.02761 F:0.03469
49 ROUGE-3 Eval D0706-A.M.100.B-E.49 R:0.02980 P:0.01775 F:0.02225
49 ROUGE-3 Eval D0706-A.M.100.B-I.49 R:0.04967 P:0.02959 F:0.03709
49 ROUGE-3 Eval D0706-B.M.100.B-B.49 R:0.04000 P:0.02367 F:0.02974
49 ROUGE-3 Eval D0706-B.M.100.B-D.49 R:0.03654 P:0.02170 F:0.02723
49 ROUGE-3 Eval D0706-B.M.100.B-E.49 R:0.00662 P:0.00394 F:0.00494
49 ROUGE-3 Eval D0706-B.M.100.B-I.49 R:0.03630 P:0.02170 F:0.02716
49 ROUGE-3 Eval D0706-C.M.100.B-B.49 R:0.03289 P:0.02237 F:0.02663
49 ROUGE-3 Eval D0706-C.M.100.B-D.49 R:0.03618 P:0.02461 F:0.02929
49 ROUGE-3 Eval D0706-C.M.100.B-E.49 R:0.04575 P:0.03132 F:0.03718
49 ROUGE-3 Eval D0706-C.M.100.B-I.49 R:0.02280 P:0.01566 F:0.01857
49 ROUGE-3 Eval D0711-A.M.100.C-A.49 R:0.03356 P:0.02070 F:0.02561
49 ROUGE-3 Eval D0711-A.M.100.C-B.49 R:0.08503 P:0.05176 F:0.06435
49 ROUGE-3 Eval D0711-A.M.100.C-C.49 R:0.07823 P:0.04762 F:0.05920
49 ROUGE-3 Eval D0711-A.M.100.C-F.49 R:0.05743 P:0.03520 F:0.04365
49 ROUGE-3 Eval D0711-B.M.100.C-A.49 R:0.02431 P:0.01449 F:0.01816
49 ROUGE-3 Eval D0711-B.M.100.C-B.49 R:0.02797 P:0.01656 F:0.02080
49 ROUGE-3 Eval D0711-B.M.100.C-C.49 R:0.01027 P:0.00621 F:0.00774
49 ROUGE-3 Eval D0711-B.M.100.C-F.49 R:0.02076 P:0.01242 F:0.01554
49 ROUGE-3 Eval D0711-C.M.100.C-A.49 R:0.06061 P:0.04000 F:0.04819
49 ROUGE-3 Eval D0711-C.M.100.C-B.49 R:0.06272 P:0.04000 F:0.04885
49 ROUGE-3 Eval D0711-C.M.100.C-C.49 R:0.01379 P:0.00889 F:0.01081
49 ROUGE-3 Eval D0711-C.M.100.C-F.49 R:0.06897 P:0.04444 F:0.05405
49 ROUGE-3 Eval D0716-A.M.100.D-C.49 R:0.06020 P:0.04110 F:0.04885
49 ROUGE-3 Eval D0716-A.M.100.D-D.49 R:0.03401 P:0.02283 F:0.02732
49 ROUGE-3 Eval D0716-A.M.100.D-E.49 R:0.05424 P:0.03653 F:0.04366
49 ROUGE-3 Eval D0716-A.M.100.D-F.49 R:0.04377 P:0.02968 F:0.03537
49 ROUGE-3 Eval D0716-B.M.100.D-C.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0716-B.M.100.D-D.49 R:0.00342 P:0.00225 F:0.00271
49 ROUGE-3 Eval D0716-B.M.100.D-E.49 R:0.00339 P:0.00225 F:0.00270
49 ROUGE-3 Eval D0716-B.M.100.D-F.49 R:0.00340 P:0.00225 F:0.00271
49 ROUGE-3 Eval D0716-C.M.100.D-C.49 R:0.06312 P:0.04368 F:0.05163
49 ROUGE-3 Eval D0716-C.M.100.D-D.49 R:0.09556 P:0.06437 F:0.07692
49 ROUGE-3 Eval D0716-C.M.100.D-E.49 R:0.07744 P:0.05287 F:0.06284
49 ROUGE-3 Eval D0716-C.M.100.D-F.49 R:0.07823 P:0.05287 F:0.06310
49 ROUGE-3 Eval D0721-A.M.100.E-B.49 R:0.01701 P:0.01042 F:0.01292
49 ROUGE-3 Eval D0721-A.M.100.E-C.49 R:0.02980 P:0.01875 F:0.02302
49 ROUGE-3 Eval D0721-A.M.100.E-E.49 R:0.02318 P:0.01458 F:0.01790
49 ROUGE-3 Eval D0721-A.M.100.E-G.49 R:0.02922 P:0.01875 F:0.02284
49 ROUGE-3 Eval D0721-B.M.100.E-B.49 R:0.00332 P:0.00224 F:0.00268
49 ROUGE-3 Eval D0721-B.M.100.E-C.49 R:0.00325 P:0.00224 F:0.00265
49 ROUGE-3 Eval D0721-B.M.100.E-E.49 R:0.00334 P:0.00224 F:0.00268
49 ROUGE-3 Eval D0721-B.M.100.E-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0721-C.M.100.E-B.49 R:0.01338 P:0.00780 F:0.00985
49 ROUGE-3 Eval D0721-C.M.100.E-C.49 R:0.01010 P:0.00585 F:0.00741
49 ROUGE-3 Eval D0721-C.M.100.E-E.49 R:0.01020 P:0.00585 F:0.00744
49 ROUGE-3 Eval D0721-C.M.100.E-G.49 R:0.00664 P:0.00390 F:0.00491
49 ROUGE-3 Eval D0726-A.M.100.F-A.49 R:0.03051 P:0.01796 F:0.02261
49 ROUGE-3 Eval D0726-A.M.100.F-E.49 R:0.03061 P:0.01796 F:0.02264
49 ROUGE-3 Eval D0726-A.M.100.F-F.49 R:0.00678 P:0.00399 F:0.00502
49 ROUGE-3 Eval D0726-A.M.100.F-G.49 R:0.02373 P:0.01397 F:0.01759
49 ROUGE-3 Eval D0726-B.M.100.F-A.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0726-B.M.100.F-E.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0726-B.M.100.F-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0726-B.M.100.F-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0726-C.M.100.F-A.49 R:0.01020 P:0.00585 F:0.00744
49 ROUGE-3 Eval D0726-C.M.100.F-E.49 R:0.01031 P:0.00585 F:0.00746
49 ROUGE-3 Eval D0726-C.M.100.F-F.49 R:0.00692 P:0.00390 F:0.00499
49 ROUGE-3 Eval D0726-C.M.100.F-G.49 R:0.01338 P:0.00780 F:0.00985
49 ROUGE-3 Eval D0727-A.M.100.G-A.49 R:0.00678 P:0.00414 F:0.00514
49 ROUGE-3 Eval D0727-A.M.100.G-F.49 R:0.02349 P:0.01449 F:0.01792
49 ROUGE-3 Eval D0727-A.M.100.G-G.49 R:0.01667 P:0.01035 F:0.01277
49 ROUGE-3 Eval D0727-A.M.100.G-H.49 R:0.02349 P:0.01449 F:0.01792
49 ROUGE-3 Eval D0727-B.M.100.G-A.49 R:0.02105 P:0.01170 F:0.01504
49 ROUGE-3 Eval D0727-B.M.100.G-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0727-B.M.100.G-G.49 R:0.02120 P:0.01170 F:0.01508
49 ROUGE-3 Eval D0727-B.M.100.G-H.49 R:0.02105 P:0.01170 F:0.01504
49 ROUGE-3 Eval D0727-C.M.100.G-A.49 R:0.03654 P:0.02119 F:0.02682
49 ROUGE-3 Eval D0727-C.M.100.G-F.49 R:0.03780 P:0.02119 F:0.02716
49 ROUGE-3 Eval D0727-C.M.100.G-G.49 R:0.03704 P:0.02119 F:0.02696
49 ROUGE-3 Eval D0727-C.M.100.G-H.49 R:0.01034 P:0.00578 F:0.00742
49 ROUGE-3 Eval D0736-A.M.100.H-G.49 R:0.05495 P:0.02762 F:0.03676
49 ROUGE-3 Eval D0736-A.M.100.H-H.49 R:0.05970 P:0.02947 F:0.03946
49 ROUGE-3 Eval D0736-A.M.100.H-I.49 R:0.05818 P:0.02947 F:0.03912
49 ROUGE-3 Eval D0736-A.M.100.H-J.49 R:0.03333 P:0.01842 F:0.02373
49 ROUGE-3 Eval D0736-B.M.100.H-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0736-B.M.100.H-H.49 R:0.02966 P:0.01449 F:0.01947
49 ROUGE-3 Eval D0736-B.M.100.H-I.49 R:0.03004 P:0.01449 F:0.01955
49 ROUGE-3 Eval D0736-B.M.100.H-J.49 R:0.02500 P:0.01449 F:0.01835
49 ROUGE-3 Eval D0736-C.M.100.H-G.49 R:0.06494 P:0.03165 F:0.04256
49 ROUGE-3 Eval D0736-C.M.100.H-H.49 R:0.00552 P:0.00211 F:0.00305
49 ROUGE-3 Eval D0736-C.M.100.H-I.49 R:0.07735 P:0.02954 F:0.04275
49 ROUGE-3 Eval D0736-C.M.100.H-J.49 R:0.05792 P:0.03165 F:0.04093
49 ROUGE-3 Eval D0740-A.M.100.I-D.49 R:0.03704 P:0.02292 F:0.02832
49 ROUGE-3 Eval D0740-A.M.100.I-H.49 R:0.03000 P:0.01875 F:0.02308
49 ROUGE-3 Eval D0740-A.M.100.I-I.49 R:0.02318 P:0.01458 F:0.01790
49 ROUGE-3 Eval D0740-A.M.100.I-J.49 R:0.01974 P:0.01250 F:0.01531
49 ROUGE-3 Eval D0740-B.M.100.I-D.49 R:0.01325 P:0.00839 F:0.01027
49 ROUGE-3 Eval D0740-B.M.100.I-H.49 R:0.01014 P:0.00629 F:0.00776
49 ROUGE-3 Eval D0740-B.M.100.I-I.49 R:0.01338 P:0.00839 F:0.01031
49 ROUGE-3 Eval D0740-B.M.100.I-J.49 R:0.01320 P:0.00839 F:0.01026
49 ROUGE-3 Eval D0740-C.M.100.I-D.49 R:0.02280 P:0.01577 F:0.01864
49 ROUGE-3 Eval D0740-C.M.100.I-H.49 R:0.00656 P:0.00450 F:0.00534
49 ROUGE-3 Eval D0740-C.M.100.I-I.49 R:0.02280 P:0.01577 F:0.01864
49 ROUGE-3 Eval D0740-C.M.100.I-J.49 R:0.01623 P:0.01126 F:0.01330
49 ROUGE-3 Eval D0743-A.M.100.J-B.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-A.M.100.J-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-A.M.100.J-I.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-A.M.100.J-J.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-B.M.100.J-B.49 R:0.00327 P:0.00195 F:0.00244
49 ROUGE-3 Eval D0743-B.M.100.J-H.49 R:0.00322 P:0.00195 F:0.00243
49 ROUGE-3 Eval D0743-B.M.100.J-I.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-B.M.100.J-J.49 R:0.00317 P:0.00195 F:0.00241
49 ROUGE-3 Eval D0743-C.M.100.J-B.49 R:0.02265 P:0.01431 F:0.01754
49 ROUGE-3 Eval D0743-C.M.100.J-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-3 Eval D0743-C.M.100.J-I.49 R:0.02280 P:0.01431 F:0.01758
49 ROUGE-3 Eval D0743-C.M.100.J-J.49 R:0.02244 P:0.01431 F:0.01748
---------------------------------------------
49 ROUGE-4 Average_R: 0.01361 (95%-conf.int. 0.01117 - 0.01653)
49 ROUGE-4 Average_P: 0.00822 (95%-conf.int. 0.00677 - 0.00996)
49 ROUGE-4 Average_F: 0.01021 (95%-conf.int. 0.00840 - 0.01228)
.............................................
49 ROUGE-4 Eval D0703-A.M.100.A-A.49 R:0.02091 P:0.01460 F:0.01719
49 ROUGE-4 Eval D0703-A.M.100.A-C.49 R:0.01730 P:0.01217 F:0.01429
49 ROUGE-4 Eval D0703-A.M.100.A-D.49 R:0.01773 P:0.01217 F:0.01443
49 ROUGE-4 Eval D0703-A.M.100.A-J.49 R:0.00702 P:0.00487 F:0.00575
49 ROUGE-4 Eval D0703-B.M.100.A-A.49 R:0.00337 P:0.00224 F:0.00269
49 ROUGE-4 Eval D0703-B.M.100.A-C.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0703-B.M.100.A-D.49 R:0.00346 P:0.00224 F:0.00272
49 ROUGE-4 Eval D0703-B.M.100.A-J.49 R:0.00342 P:0.00224 F:0.00271
49 ROUGE-4 Eval D0703-C.M.100.A-A.49 R:0.03436 P:0.02151 F:0.02646
49 ROUGE-4 Eval D0703-C.M.100.A-C.49 R:0.01003 P:0.00645 F:0.00785
49 ROUGE-4 Eval D0703-C.M.100.A-D.49 R:0.03754 P:0.02366 F:0.02903
49 ROUGE-4 Eval D0703-C.M.100.A-J.49 R:0.04096 P:0.02581 F:0.03167
49 ROUGE-4 Eval D0706-A.M.100.B-B.49 R:0.01338 P:0.00794 F:0.00997
49 ROUGE-4 Eval D0706-A.M.100.B-D.49 R:0.03030 P:0.01786 F:0.02247
49 ROUGE-4 Eval D0706-A.M.100.B-E.49 R:0.01672 P:0.00992 F:0.01245
49 ROUGE-4 Eval D0706-A.M.100.B-I.49 R:0.03010 P:0.01786 F:0.02242
49 ROUGE-4 Eval D0706-B.M.100.B-B.49 R:0.02694 P:0.01587 F:0.01997
49 ROUGE-4 Eval D0706-B.M.100.B-D.49 R:0.02685 P:0.01587 F:0.01995
49 ROUGE-4 Eval D0706-B.M.100.B-E.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0706-B.M.100.B-I.49 R:0.02667 P:0.01587 F:0.01990
49 ROUGE-4 Eval D0706-C.M.100.B-B.49 R:0.02326 P:0.01577 F:0.01880
49 ROUGE-4 Eval D0706-C.M.100.B-D.49 R:0.02326 P:0.01577 F:0.01880
49 ROUGE-4 Eval D0706-C.M.100.B-E.49 R:0.02970 P:0.02027 F:0.02410
49 ROUGE-4 Eval D0706-C.M.100.B-I.49 R:0.01316 P:0.00901 F:0.01070
49 ROUGE-4 Eval D0711-A.M.100.C-A.49 R:0.01695 P:0.01042 F:0.01291
49 ROUGE-4 Eval D0711-A.M.100.C-B.49 R:0.05498 P:0.03333 F:0.04150
49 ROUGE-4 Eval D0711-A.M.100.C-C.49 R:0.05498 P:0.03333 F:0.04150
49 ROUGE-4 Eval D0711-A.M.100.C-F.49 R:0.03754 P:0.02292 F:0.02846
49 ROUGE-4 Eval D0711-B.M.100.C-A.49 R:0.00702 P:0.00417 F:0.00523
49 ROUGE-4 Eval D0711-B.M.100.C-B.49 R:0.00707 P:0.00417 F:0.00525
49 ROUGE-4 Eval D0711-B.M.100.C-C.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0711-B.M.100.C-F.49 R:0.00699 P:0.00417 F:0.00522
49 ROUGE-4 Eval D0711-C.M.100.C-A.49 R:0.03741 P:0.02461 F:0.02969
49 ROUGE-4 Eval D0711-C.M.100.C-B.49 R:0.03873 P:0.02461 F:0.03010
49 ROUGE-4 Eval D0711-C.M.100.C-C.49 R:0.00697 P:0.00447 F:0.00545
49 ROUGE-4 Eval D0711-C.M.100.C-F.49 R:0.04181 P:0.02685 F:0.03270
49 ROUGE-4 Eval D0716-A.M.100.D-C.49 R:0.02027 P:0.01379 F:0.01641
49 ROUGE-4 Eval D0716-A.M.100.D-D.49 R:0.01375 P:0.00920 F:0.01102
49 ROUGE-4 Eval D0716-A.M.100.D-E.49 R:0.01712 P:0.01149 F:0.01375
49 ROUGE-4 Eval D0716-A.M.100.D-F.49 R:0.01020 P:0.00690 F:0.00823
49 ROUGE-4 Eval D0716-B.M.100.D-C.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0716-B.M.100.D-D.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0716-B.M.100.D-E.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0716-B.M.100.D-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0716-C.M.100.D-C.49 R:0.02685 P:0.01852 F:0.02192
49 ROUGE-4 Eval D0716-C.M.100.D-D.49 R:0.05172 P:0.03472 F:0.04155
49 ROUGE-4 Eval D0716-C.M.100.D-E.49 R:0.03741 P:0.02546 F:0.03030
49 ROUGE-4 Eval D0716-C.M.100.D-F.49 R:0.03780 P:0.02546 F:0.03043
49 ROUGE-4 Eval D0721-A.M.100.E-B.49 R:0.00344 P:0.00210 F:0.00261
49 ROUGE-4 Eval D0721-A.M.100.E-C.49 R:0.00669 P:0.00419 F:0.00515
49 ROUGE-4 Eval D0721-A.M.100.E-E.49 R:0.00334 P:0.00210 F:0.00258
49 ROUGE-4 Eval D0721-A.M.100.E-G.49 R:0.00656 P:0.00419 F:0.00511
49 ROUGE-4 Eval D0721-B.M.100.E-B.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0721-B.M.100.E-C.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0721-B.M.100.E-E.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0721-B.M.100.E-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0721-C.M.100.E-B.49 R:0.00338 P:0.00196 F:0.00248
49 ROUGE-4 Eval D0721-C.M.100.E-C.49 R:0.00340 P:0.00196 F:0.00249
49 ROUGE-4 Eval D0721-C.M.100.E-E.49 R:0.00344 P:0.00196 F:0.00250
49 ROUGE-4 Eval D0721-C.M.100.E-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-A.M.100.F-A.49 R:0.02055 P:0.01205 F:0.01519
49 ROUGE-4 Eval D0726-A.M.100.F-E.49 R:0.02062 P:0.01205 F:0.01521
49 ROUGE-4 Eval D0726-A.M.100.F-F.49 R:0.00342 P:0.00201 F:0.00253
49 ROUGE-4 Eval D0726-A.M.100.F-G.49 R:0.01712 P:0.01004 F:0.01266
49 ROUGE-4 Eval D0726-B.M.100.F-A.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-B.M.100.F-E.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-B.M.100.F-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-B.M.100.F-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-C.M.100.F-A.49 R:0.00344 P:0.00196 F:0.00250
49 ROUGE-4 Eval D0726-C.M.100.F-E.49 R:0.00347 P:0.00196 F:0.00251
49 ROUGE-4 Eval D0726-C.M.100.F-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0726-C.M.100.F-G.49 R:0.00338 P:0.00196 F:0.00248
49 ROUGE-4 Eval D0727-A.M.100.G-A.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0727-A.M.100.G-F.49 R:0.01356 P:0.00833 F:0.01032
49 ROUGE-4 Eval D0727-A.M.100.G-G.49 R:0.01347 P:0.00833 F:0.01029
49 ROUGE-4 Eval D0727-A.M.100.G-H.49 R:0.01356 P:0.00833 F:0.01032
49 ROUGE-4 Eval D0727-B.M.100.G-A.49 R:0.01064 P:0.00588 F:0.00757
49 ROUGE-4 Eval D0727-B.M.100.G-F.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0727-B.M.100.G-G.49 R:0.01071 P:0.00588 F:0.00759
49 ROUGE-4 Eval D0727-B.M.100.G-H.49 R:0.01064 P:0.00588 F:0.00757
49 ROUGE-4 Eval D0727-C.M.100.G-A.49 R:0.01678 P:0.00969 F:0.01229
49 ROUGE-4 Eval D0727-C.M.100.G-F.49 R:0.01736 P:0.00969 F:0.01244
49 ROUGE-4 Eval D0727-C.M.100.G-G.49 R:0.01701 P:0.00969 F:0.01235
49 ROUGE-4 Eval D0727-C.M.100.G-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0736-A.M.100.H-G.49 R:0.02963 P:0.01481 F:0.01975
49 ROUGE-4 Eval D0736-A.M.100.H-H.49 R:0.04151 P:0.02037 F:0.02733
49 ROUGE-4 Eval D0736-A.M.100.H-I.49 R:0.03676 P:0.01852 F:0.02463
49 ROUGE-4 Eval D0736-A.M.100.H-J.49 R:0.01347 P:0.00741 F:0.00956
49 ROUGE-4 Eval D0736-B.M.100.H-G.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0736-B.M.100.H-H.49 R:0.02575 P:0.01250 F:0.01683
49 ROUGE-4 Eval D0736-B.M.100.H-I.49 R:0.02609 P:0.01250 F:0.01690
49 ROUGE-4 Eval D0736-B.M.100.H-J.49 R:0.02166 P:0.01250 F:0.01585
49 ROUGE-4 Eval D0736-C.M.100.H-G.49 R:0.03947 P:0.01911 F:0.02575
49 ROUGE-4 Eval D0736-C.M.100.H-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0736-C.M.100.H-I.49 R:0.05056 P:0.01911 F:0.02774
49 ROUGE-4 Eval D0736-C.M.100.H-J.49 R:0.03516 P:0.01911 F:0.02476
49 ROUGE-4 Eval D0740-A.M.100.I-D.49 R:0.01020 P:0.00629 F:0.00778
49 ROUGE-4 Eval D0740-A.M.100.I-H.49 R:0.01010 P:0.00629 F:0.00775
49 ROUGE-4 Eval D0740-A.M.100.I-I.49 R:0.00669 P:0.00419 F:0.00515
49 ROUGE-4 Eval D0740-A.M.100.I-J.49 R:0.00332 P:0.00210 F:0.00257
49 ROUGE-4 Eval D0740-B.M.100.I-D.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0740-B.M.100.I-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0740-B.M.100.I-I.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0740-B.M.100.I-J.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0740-C.M.100.I-D.49 R:0.01316 P:0.00907 F:0.01074
49 ROUGE-4 Eval D0740-C.M.100.I-H.49 R:0.00331 P:0.00227 F:0.00269
49 ROUGE-4 Eval D0740-C.M.100.I-I.49 R:0.01316 P:0.00907 F:0.01074
49 ROUGE-4 Eval D0740-C.M.100.I-J.49 R:0.00984 P:0.00680 F:0.00804
49 ROUGE-4 Eval D0743-A.M.100.J-B.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-A.M.100.J-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-A.M.100.J-I.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-A.M.100.J-J.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-B.M.100.J-B.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-B.M.100.J-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-B.M.100.J-I.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-B.M.100.J-J.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-C.M.100.J-B.49 R:0.00980 P:0.00617 F:0.00757
49 ROUGE-4 Eval D0743-C.M.100.J-H.49 R:0.00000 P:0.00000 F:0.00000
49 ROUGE-4 Eval D0743-C.M.100.J-I.49 R:0.00987 P:0.00617 F:0.00759
49 ROUGE-4 Eval D0743-C.M.100.J-J.49 R:0.00971 P:0.00617 F:0.00755
---------------------------------------------
49 ROUGE-L Average_R: 0.29667 (95%-conf.int. 0.28680 - 0.30636)
49 ROUGE-L Average_P: 0.18460 (95%-conf.int. 0.17790 - 0.19192)
49 ROUGE-L Average_F: 0.22703 (95%-conf.int. 0.21889 - 0.23522)
.............................................
49 ROUGE-L Eval D0703-A.M.100.A-A.49 R:0.29730 P:0.20952 F:0.24581
49 ROUGE-L Eval D0703-A.M.100.A-C.49 R:0.28188 P:0.20000 F:0.23398
49 ROUGE-L Eval D0703-A.M.100.A-D.49 R:0.27835 P:0.19286 F:0.22785
49 ROUGE-L Eval D0703-A.M.100.A-J.49 R:0.29252 P:0.20476 F:0.24090
49 ROUGE-L Eval D0703-B.M.100.A-A.49 R:0.24837 P:0.16667 F:0.19948
49 ROUGE-L Eval D0703-B.M.100.A-C.49 R:0.30201 P:0.19737 F:0.23873
49 ROUGE-L Eval D0703-B.M.100.A-D.49 R:0.30537 P:0.19956 F:0.24138
49 ROUGE-L Eval D0703-B.M.100.A-J.49 R:0.30233 P:0.19956 F:0.24042
49 ROUGE-L Eval D0703-C.M.100.A-A.49 R:0.35667 P:0.22574 F:0.27649
49 ROUGE-L Eval D0703-C.M.100.A-C.49 R:0.32792 P:0.21308 F:0.25831
49 ROUGE-L Eval D0703-C.M.100.A-D.49 R:0.35099 P:0.22363 F:0.27320
49 ROUGE-L Eval D0703-C.M.100.A-J.49 R:0.39073 P:0.24895 F:0.30413
49 ROUGE-L Eval D0706-A.M.100.B-B.49 R:0.34091 P:0.20468 F:0.25579
49 ROUGE-L Eval D0706-A.M.100.B-D.49 R:0.32026 P:0.19103 F:0.23931
49 ROUGE-L Eval D0706-A.M.100.B-E.49 R:0.30195 P:0.18129 F:0.22656
49 ROUGE-L Eval D0706-A.M.100.B-I.49 R:0.31494 P:0.18908 F:0.23630
49 ROUGE-L Eval D0706-B.M.100.B-B.49 R:0.24837 P:0.14815 F:0.18559
49 ROUGE-L Eval D0706-B.M.100.B-D.49 R:0.23127 P:0.13840 F:0.17317
49 ROUGE-L Eval D0706-B.M.100.B-E.49 R:0.22403 P:0.13450 F:0.16809
49 ROUGE-L Eval D0706-B.M.100.B-I.49 R:0.25243 P:0.15205 F:0.18978
49 ROUGE-L Eval D0706-C.M.100.B-B.49 R:0.31290 P:0.21413 F:0.25426
49 ROUGE-L Eval D0706-C.M.100.B-D.49 R:0.33226 P:0.22737 F:0.26999
49 ROUGE-L Eval D0706-C.M.100.B-E.49 R:0.32372 P:0.22296 F:0.26405
49 ROUGE-L Eval D0706-C.M.100.B-I.49 R:0.30351 P:0.20971 F:0.24804
49 ROUGE-L Eval D0711-A.M.100.C-A.49 R:0.36842 P:0.22904 F:0.28247
49 ROUGE-L Eval D0711-A.M.100.C-B.49 R:0.42000 P:0.25767 F:0.31939
49 ROUGE-L Eval D0711-A.M.100.C-C.49 R:0.40000 P:0.24540 F:0.30418
49 ROUGE-L Eval D0711-A.M.100.C-F.49 R:0.39404 P:0.24335 F:0.30088
49 ROUGE-L Eval D0711-B.M.100.C-A.49 R:0.31973 P:0.19223 F:0.24010
49 ROUGE-L Eval D0711-B.M.100.C-B.49 R:0.30822 P:0.18405 F:0.23047
49 ROUGE-L Eval D0711-B.M.100.C-C.49 R:0.27517 P:0.16769 F:0.20839
49 ROUGE-L Eval D0711-B.M.100.C-F.49 R:0.29831 P:0.17996 F:0.22449
49 ROUGE-L Eval D0711-C.M.100.C-A.49 R:0.38614 P:0.25658 F:0.30830
49 ROUGE-L Eval D0711-C.M.100.C-B.49 R:0.36860 P:0.23684 F:0.28838
49 ROUGE-L Eval D0711-C.M.100.C-C.49 R:0.31081 P:0.20175 F:0.24468
49 ROUGE-L Eval D0711-C.M.100.C-F.49 R:0.35811 P:0.23246 F:0.28192
49 ROUGE-L Eval D0716-A.M.100.D-C.49 R:0.36066 P:0.24775 F:0.29373
49 ROUGE-L Eval D0716-A.M.100.D-D.49 R:0.33333 P:0.22523 F:0.26882
49 ROUGE-L Eval D0716-A.M.100.D-E.49 R:0.37542 P:0.25450 F:0.30335
49 ROUGE-L Eval D0716-A.M.100.D-F.49 R:0.34983 P:0.23874 F:0.28380
49 ROUGE-L Eval D0716-B.M.100.D-C.49 R:0.26974 P:0.18222 F:0.21751
49 ROUGE-L Eval D0716-B.M.100.D-D.49 R:0.29195 P:0.19333 F:0.23262
49 ROUGE-L Eval D0716-B.M.100.D-E.49 R:0.27907 P:0.18667 F:0.22370
49 ROUGE-L Eval D0716-B.M.100.D-F.49 R:0.27667 P:0.18444 F:0.22133
49 ROUGE-L Eval D0716-C.M.100.D-C.49 R:0.38111 P:0.26531 F:0.31284
49 ROUGE-L Eval D0716-C.M.100.D-D.49 R:0.44482 P:0.30159 F:0.35946
49 ROUGE-L Eval D0716-C.M.100.D-E.49 R:0.38614 P:0.26531 F:0.31452
49 ROUGE-L Eval D0716-C.M.100.D-F.49 R:0.41667 P:0.28345 F:0.33739
49 ROUGE-L Eval D0721-A.M.100.E-B.49 R:0.32000 P:0.19753 F:0.24427
49 ROUGE-L Eval D0721-A.M.100.E-C.49 R:0.30519 P:0.19342 F:0.23678
49 ROUGE-L Eval D0721-A.M.100.E-E.49 R:0.30519 P:0.19342 F:0.23678
49 ROUGE-L Eval D0721-A.M.100.E-G.49 R:0.31847 P:0.20576 F:0.25000
49 ROUGE-L Eval D0721-B.M.100.E-B.49 R:0.21498 P:0.14570 F:0.17369
49 ROUGE-L Eval D0721-B.M.100.E-C.49 R:0.20064 P:0.13907 F:0.16428
49 ROUGE-L Eval D0721-B.M.100.E-E.49 R:0.19344 P:0.13024 F:0.15567
49 ROUGE-L Eval D0721-B.M.100.E-G.49 R:0.17742 P:0.12141 F:0.14417
49 ROUGE-L Eval D0721-C.M.100.E-B.49 R:0.29508 P:0.17341 F:0.21845
49 ROUGE-L Eval D0721-C.M.100.E-C.49 R:0.24422 P:0.14258 F:0.18005
49 ROUGE-L Eval D0721-C.M.100.E-E.49 R:0.25667 P:0.14836 F:0.18803
49 ROUGE-L Eval D0721-C.M.100.E-G.49 R:0.24104 P:0.14258 F:0.17917
49 ROUGE-L Eval D0726-A.M.100.F-A.49 R:0.29900 P:0.17751 F:0.22277
49 ROUGE-L Eval D0726-A.M.100.F-E.49 R:0.29667 P:0.17554 F:0.22057
49 ROUGE-L Eval D0726-A.M.100.F-F.49 R:0.28571 P:0.16963 F:0.21287
49 ROUGE-L Eval D0726-A.M.100.F-G.49 R:0.29568 P:0.17554 F:0.22029
49 ROUGE-L Eval D0726-B.M.100.F-A.49 R:0.19935 P:0.11891 F:0.14896
49 ROUGE-L Eval D0726-B.M.100.F-E.49 R:0.20930 P:0.12281 F:0.15479
49 ROUGE-L Eval D0726-B.M.100.F-F.49 R:0.21927 P:0.12865 F:0.16216
49 ROUGE-L Eval D0726-B.M.100.F-G.49 R:0.21382 P:0.12671 F:0.15912
49 ROUGE-L Eval D0726-C.M.100.F-A.49 R:0.23667 P:0.13680 F:0.17338
49 ROUGE-L Eval D0726-C.M.100.F-E.49 R:0.24579 P:0.14066 F:0.17893
49 ROUGE-L Eval D0726-C.M.100.F-F.49 R:0.24068 P:0.13680 F:0.17445
49 ROUGE-L Eval D0726-C.M.100.F-G.49 R:0.24918 P:0.14644 F:0.18447
49 ROUGE-L Eval D0727-A.M.100.G-A.49 R:0.37209 P:0.22904 F:0.28354
49 ROUGE-L Eval D0727-A.M.100.G-F.49 R:0.37500 P:0.23313 F:0.28752
49 ROUGE-L Eval D0727-A.M.100.G-G.49 R:0.34314 P:0.21472 F:0.26415
49 ROUGE-L Eval D0727-A.M.100.G-H.49 R:0.36184 P:0.22495 F:0.27743
49 ROUGE-L Eval D0727-B.M.100.G-A.49 R:0.33677 P:0.18882 F:0.24197
49 ROUGE-L Eval D0727-B.M.100.G-F.49 R:0.30844 P:0.18304 F:0.22974
49 ROUGE-L Eval D0727-B.M.100.G-G.49 R:0.31142 P:0.17341 F:0.22277
49 ROUGE-L Eval D0727-B.M.100.G-H.49 R:0.31615 P:0.17726 F:0.22716
49 ROUGE-L Eval D0727-C.M.100.G-A.49 R:0.34202 P:0.20000 F:0.25240
49 ROUGE-L Eval D0727-C.M.100.G-F.49 R:0.33333 P:0.18857 F:0.24087
49 ROUGE-L Eval D0727-C.M.100.G-G.49 R:0.34653 P:0.20000 F:0.25362
49 ROUGE-L Eval D0727-C.M.100.G-H.49 R:0.33446 P:0.18857 F:0.24117
49 ROUGE-L Eval D0736-A.M.100.H-G.49 R:0.34409 P:0.17486 F:0.23188
49 ROUGE-L Eval D0736-A.M.100.H-H.49 R:0.36496 P:0.18215 F:0.24301
49 ROUGE-L Eval D0736-A.M.100.H-I.49 R:0.34520 P:0.17668 F:0.23373
49 ROUGE-L Eval D0736-A.M.100.H-J.49 R:0.33660 P:0.18761 F:0.24093
49 ROUGE-L Eval D0736-B.M.100.H-G.49 R:0.20229 P:0.10838 F:0.14114
49 ROUGE-L Eval D0736-B.M.100.H-H.49 R:0.22727 P:0.11247 F:0.15047
49 ROUGE-L Eval D0736-B.M.100.H-I.49 R:0.22176 P:0.10838 F:0.14560
49 ROUGE-L Eval D0736-B.M.100.H-J.49 R:0.22378 P:0.13088 F:0.16516
49 ROUGE-L Eval D0736-C.M.100.H-G.49 R:0.34177 P:0.16875 F:0.22594
49 ROUGE-L Eval D0736-C.M.100.H-H.49 R:0.27273 P:0.10625 F:0.15292
49 ROUGE-L Eval D0736-C.M.100.H-I.49 R:0.40107 P:0.15625 F:0.22489
49 ROUGE-L Eval D0736-C.M.100.H-J.49 R:0.33962 P:0.18750 F:0.24161
49 ROUGE-L Eval D0740-A.M.100.I-D.49 R:0.29703 P:0.18519 F:0.22814
49 ROUGE-L Eval D0740-A.M.100.I-H.49 R:0.30065 P:0.18930 F:0.23232
49 ROUGE-L Eval D0740-A.M.100.I-I.49 R:0.28571 P:0.18107 F:0.22166
49 ROUGE-L Eval D0740-A.M.100.I-J.49 R:0.30000 P:0.19136 F:0.23367
49 ROUGE-L Eval D0740-B.M.100.I-D.49 R:0.23701 P:0.15114 F:0.18458
49 ROUGE-L Eval D0740-B.M.100.I-H.49 R:0.22848 P:0.14286 F:0.17580
49 ROUGE-L Eval D0740-B.M.100.I-I.49 R:0.22295 P:0.14079 F:0.17259
49 ROUGE-L Eval D0740-B.M.100.I-J.49 R:0.22330 P:0.14286 F:0.17424
49 ROUGE-L Eval D0740-C.M.100.I-D.49 R:0.29712 P:0.20667 F:0.24378
49 ROUGE-L Eval D0740-C.M.100.I-H.49 R:0.28939 P:0.20000 F:0.23653
49 ROUGE-L Eval D0740-C.M.100.I-I.49 R:0.28435 P:0.19778 F:0.23329
49 ROUGE-L Eval D0740-C.M.100.I-J.49 R:0.28981 P:0.20222 F:0.23822
49 ROUGE-L Eval D0743-A.M.100.J-B.49 R:0.25079 P:0.18287 F:0.21151
49 ROUGE-L Eval D0743-A.M.100.J-H.49 R:0.23148 P:0.17361 F:0.19841
49 ROUGE-L Eval D0743-A.M.100.J-I.49 R:0.24688 P:0.18287 F:0.21011
49 ROUGE-L Eval D0743-A.M.100.J-J.49 R:0.21538 P:0.16204 F:0.18494
49 ROUGE-L Eval D0743-B.M.100.J-B.49 R:0.23718 P:0.14258 F:0.17810
49 ROUGE-L Eval D0743-B.M.100.J-H.49 R:0.24606 P:0.15029 F:0.18660
49 ROUGE-L Eval D0743-B.M.100.J-I.49 R:0.24051 P:0.14644 F:0.18204
49 ROUGE-L Eval D0743-B.M.100.J-J.49 R:0.24299 P:0.15029 F:0.18571
49 ROUGE-L Eval D0743-C.M.100.J-B.49 R:0.27937 P:0.17778 F:0.21729
49 ROUGE-L Eval D0743-C.M.100.J-H.49 R:0.22611 P:0.14343 F:0.17552
49 ROUGE-L Eval D0743-C.M.100.J-I.49 R:0.25879 P:0.16364 F:0.20050
49 ROUGE-L Eval D0743-C.M.100.J-J.49 R:0.26415 P:0.16970 F:0.20664
---------------------------------------------
49 ROUGE-W-1.2 Average_R: 0.10429 (95%-conf.int. 0.10082 - 0.10772)
49 ROUGE-W-1.2 Average_P: 0.11752 (95%-conf.int. 0.11321 - 0.12219)
49 ROUGE-W-1.2 Average_F: 0.11015 (95%-conf.int. 0.10644 - 0.11394)
.............................................
49 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.49 R:0.10572 P:0.13416 F:0.11825
49 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.49 R:0.10061 P:0.12975 F:0.11334
49 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.49 R:0.10115 P:0.12921 F:0.11347
49 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.49 R:0.10893 P:0.13043 F:0.11871
49 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.49 R:0.08523 P:0.10605 F:0.09451
49 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.49 R:0.10438 P:0.12909 F:0.11543
49 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.49 R:0.10661 P:0.13068 F:0.11742
49 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.49 R:0.10646 P:0.13034 F:0.11720
49 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.49 R:0.12041 P:0.14169 F:0.13019
49 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.49 R:0.10784 P:0.13231 F:0.11883
49 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.49 R:0.11720 P:0.14173 F:0.12830
49 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.49 R:0.13546 P:0.15544 F:0.14476
49 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.49 R:0.12068 P:0.13003 F:0.12518
49 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.49 R:0.11290 P:0.12357 F:0.11799
49 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.49 R:0.10701 P:0.11650 F:0.11155
49 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.49 R:0.11207 P:0.12468 F:0.11804
49 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.49 R:0.09230 P:0.09536 F:0.09381
49 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.49 R:0.08243 P:0.08699 F:0.08465
49 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.49 R:0.07784 P:0.08249 F:0.08010
49 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.49 R:0.09167 P:0.09985 F:0.09559
49 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.49 R:0.10321 P:0.12055 F:0.11121
49 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.49 R:0.10908 P:0.12850 F:0.11800
49 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.49 R:0.10876 P:0.12689 F:0.11713
49 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.49 R:0.10807 P:0.12969 F:0.11790
49 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.49 R:0.11564 P:0.12961 F:0.12223
49 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.49 R:0.13794 P:0.15328 F:0.14521
49 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.49 R:0.13228 P:0.14573 F:0.13868
49 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.49 R:0.13768 P:0.15425 F:0.14549
49 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.49 R:0.11789 P:0.12646 F:0.12202
49 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.49 R:0.10758 P:0.12039 F:0.11363
49 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.49 R:0.09332 P:0.10683 F:0.09962
49 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.49 R:0.10660 P:0.11943 F:0.11265
49 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.49 R:0.13446 P:0.16704 F:0.14899
49 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.49 R:0.13069 P:0.15703 F:0.14265
49 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.49 R:0.10350 P:0.12757 F:0.11428
49 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.49 R:0.12567 P:0.15722 F:0.13969
49 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.49 R:0.12792 P:0.16054 F:0.14239
49 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.49 R:0.11222 P:0.14445 F:0.12631
49 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.49 R:0.13230 P:0.16750 F:0.14783
49 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.49 R:0.11884 P:0.15423 F:0.13424
49 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.49 R:0.09006 P:0.10613 F:0.09744
49 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.49 R:0.09465 P:0.11217 F:0.10267
49 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.49 R:0.09511 P:0.11326 F:0.10339
49 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.49 R:0.08786 P:0.10367 F:0.09511
49 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.49 R:0.13001 P:0.16870 F:0.14685
49 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.49 R:0.15051 P:0.19790 F:0.17098
49 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.49 R:0.13174 P:0.17542 F:0.15047
49 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.49 R:0.13939 P:0.18446 F:0.15879
49 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.49 R:0.11175 P:0.12125 F:0.11631
49 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.49 R:0.10703 P:0.12035 F:0.11330
49 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.49 R:0.10160 P:0.11567 F:0.10818
49 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.49 R:0.11386 P:0.12892 F:0.12092
49 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.49 R:0.06993 P:0.09162 F:0.07932
49 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.49 R:0.06781 P:0.08835 F:0.07673
49 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.49 R:0.06482 P:0.08566 F:0.07380
49 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.49 R:0.05567 P:0.07603 F:0.06428
49 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.49 R:0.09939 P:0.10750 F:0.10329
49 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.49 R:0.08171 P:0.08975 F:0.08554
49 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.49 R:0.08647 P:0.09329 F:0.08975
49 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.49 R:0.08299 P:0.09180 F:0.08717
49 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.49 R:0.10835 P:0.11399 F:0.11110
49 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.49 R:0.11036 P:0.11441 F:0.11235
49 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.49 R:0.10190 P:0.10776 F:0.10475
49 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.49 R:0.10600 P:0.11391 F:0.10981
49 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.49 R:0.07071 P:0.07419 F:0.07241
49 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.49 R:0.06991 P:0.07405 F:0.07192
49 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.49 R:0.07432 P:0.07923 F:0.07670
49 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.49 R:0.07130 P:0.07629 F:0.07371
49 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.49 R:0.08110 P:0.08232 F:0.08171
49 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.49 R:0.08452 P:0.08537 F:0.08494
49 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.49 R:0.08280 P:0.08428 F:0.08353
49 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.49 R:0.08769 P:0.09227 F:0.08992
49 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.49 R:0.13332 P:0.14445 F:0.13866
49 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.49 R:0.13676 P:0.15519 F:0.14539
49 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.49 R:0.12446 P:0.13793 F:0.13085
49 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.49 R:0.13427 P:0.14963 F:0.14153
49 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.49 R:0.12357 P:0.12157 F:0.12256
49 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.49 R:0.10515 P:0.11209 F:0.10851
49 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.49 R:0.11264 P:0.11234 F:0.11249
49 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.49 R:0.11537 P:0.11450 F:0.11493
49 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.49 R:0.12146 P:0.12773 F:0.12452
49 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.49 R:0.11622 P:0.12151 F:0.11881
49 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.49 R:0.11881 P:0.12622 F:0.12240
49 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.49 R:0.11426 P:0.11595 F:0.11510
49 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.49 R:0.12817 P:0.11535 F:0.12142
49 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.49 R:0.13646 P:0.11976 F:0.12757
49 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.49 R:0.12722 P:0.11635 F:0.12154
49 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.49 R:0.12089 P:0.12012 F:0.12050
49 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.49 R:0.07615 P:0.07552 F:0.07583
49 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.49 R:0.08856 P:0.08108 F:0.08466
49 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.49 R:0.08849 P:0.07988 F:0.08396
49 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.49 R:0.08525 P:0.09217 F:0.08858
49 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.49 R:0.13335 P:0.11960 F:0.12610
49 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.49 R:0.10311 P:0.07508 F:0.08689
49 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.49 R:0.15972 P:0.11351 F:0.13271
49 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.49 R:0.12917 P:0.12723 F:0.12819
49 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.49 R:0.10599 P:0.12155 F:0.11324
49 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.49 R:0.10697 P:0.12150 F:0.11377
49 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.49 R:0.09899 P:0.11603 F:0.10683
49 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.49 R:0.10667 P:0.12499 F:0.11511
49 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.49 R:0.08298 P:0.09722 F:0.08954
49 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.49 R:0.08112 P:0.09027 F:0.08545
49 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.49 R:0.07902 P:0.09376 F:0.08576
49 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.49 R:0.08223 P:0.09405 F:0.08774
49 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.49 R:0.09830 P:0.13195 F:0.11267
49 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.49 R:0.09467 P:0.12211 F:0.10665
49 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.49 R:0.09492 P:0.12912 F:0.10941
49 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.49 R:0.09591 P:0.12824 F:0.10974
49 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.49 R:0.08854 P:0.11255 F:0.09911
49 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.49 R:0.08391 P:0.10871 F:0.09471
49 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.49 R:0.08670 P:0.11396 F:0.09848
49 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.49 R:0.07748 P:0.10118 F:0.08776
49 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.49 R:0.08343 P:0.08399 F:0.08371
49 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.49 R:0.08729 P:0.08842 F:0.08785
49 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.49 R:0.08551 P:0.08773 F:0.08661
49 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.49 R:0.08509 P:0.08652 F:0.08580
49 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.49 R:0.10683 P:0.11900 F:0.11259
49 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.49 R:0.08514 P:0.09018 F:0.08759
49 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.49 R:0.09933 P:0.11193 F:0.10525
49 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.49 R:0.10571 P:0.11431 F:0.10984
---------------------------------------------
49 ROUGE-SU4 Average_R: 0.11590 (95%-conf.int. 0.10950 - 0.12236)
49 ROUGE-SU4 Average_P: 0.07160 (95%-conf.int. 0.06716 - 0.07609)
49 ROUGE-SU4 Average_F: 0.08828 (95%-conf.int. 0.08307 - 0.09346)
.............................................
49 ROUGE-SU4 Eval D0703-A.M.100.A-A.49 R:0.13079 P:0.09142 F:0.10762
49 ROUGE-SU4 Eval D0703-A.M.100.A-C.49 R:0.12931 P:0.09102 F:0.10684
49 ROUGE-SU4 Eval D0703-A.M.100.A-D.49 R:0.12426 P:0.08536 F:0.10120
49 ROUGE-SU4 Eval D0703-A.M.100.A-J.49 R:0.12296 P:0.08536 F:0.10077
49 ROUGE-SU4 Eval D0703-B.M.100.A-A.49 R:0.09787 P:0.06510 F:0.07819
49 ROUGE-SU4 Eval D0703-B.M.100.A-C.49 R:0.12701 P:0.08222 F:0.09982
49 ROUGE-SU4 Eval D0703-B.M.100.A-D.49 R:0.12759 P:0.08259 F:0.10027
49 ROUGE-SU4 Eval D0703-B.M.100.A-J.49 R:0.12457 P:0.08147 F:0.09851
49 ROUGE-SU4 Eval D0703-C.M.100.A-A.49 R:0.16438 P:0.10300 F:0.12664
49 ROUGE-SU4 Eval D0703-C.M.100.A-C.49 R:0.13000 P:0.08369 F:0.10183
49 ROUGE-SU4 Eval D0703-C.M.100.A-D.49 R:0.16780 P:0.10587 F:0.12983
49 ROUGE-SU4 Eval D0703-C.M.100.A-J.49 R:0.18084 P:0.11409 F:0.13991
49 ROUGE-SU4 Eval D0706-A.M.100.B-B.49 R:0.12056 P:0.07162 F:0.08986
49 ROUGE-SU4 Eval D0706-A.M.100.B-D.49 R:0.12752 P:0.07525 F:0.09465
49 ROUGE-SU4 Eval D0706-A.M.100.B-E.49 R:0.10944 P:0.06502 F:0.08158
49 ROUGE-SU4 Eval D0706-A.M.100.B-I.49 R:0.11667 P:0.06931 F:0.08696
49 ROUGE-SU4 Eval D0706-B.M.100.B-B.49 R:0.10067 P:0.05941 F:0.07472
49 ROUGE-SU4 Eval D0706-B.M.100.B-D.49 R:0.08863 P:0.05248 F:0.06592
49 ROUGE-SU4 Eval D0706-B.M.100.B-E.49 R:0.06611 P:0.03927 F:0.04927
49 ROUGE-SU4 Eval D0706-B.M.100.B-I.49 R:0.10188 P:0.06073 F:0.07610
49 ROUGE-SU4 Eval D0706-C.M.100.B-B.49 R:0.11976 P:0.08127 F:0.09683
49 ROUGE-SU4 Eval D0706-C.M.100.B-D.49 R:0.12638 P:0.08577 F:0.10219
49 ROUGE-SU4 Eval D0706-C.M.100.B-E.49 R:0.12226 P:0.08352 F:0.09924
49 ROUGE-SU4 Eval D0706-C.M.100.B-I.49 R:0.10656 P:0.07303 F:0.08666
49 ROUGE-SU4 Eval D0711-A.M.100.C-A.49 R:0.14302 P:0.08801 F:0.10897
49 ROUGE-SU4 Eval D0711-A.M.100.C-B.49 R:0.18607 P:0.11296 F:0.14058
49 ROUGE-SU4 Eval D0711-A.M.100.C-C.49 R:0.17922 P:0.10880 F:0.13540
49 ROUGE-SU4 Eval D0711-A.M.100.C-F.49 R:0.16497 P:0.10083 F:0.12516
49 ROUGE-SU4 Eval D0711-B.M.100.C-A.49 R:0.12529 P:0.07450 F:0.09344
49 ROUGE-SU4 Eval D0711-B.M.100.C-B.49 R:0.12500 P:0.07380 F:0.09281
49 ROUGE-SU4 Eval D0711-B.M.100.C-C.49 R:0.10402 P:0.06272 F:0.07826
49 ROUGE-SU4 Eval D0711-B.M.100.C-F.49 R:0.10976 P:0.06549 F:0.08203
49 ROUGE-SU4 Eval D0711-C.M.100.C-A.49 R:0.17910 P:0.11793 F:0.14222
49 ROUGE-SU4 Eval D0711-C.M.100.C-B.49 R:0.17076 P:0.10863 F:0.13279
49 ROUGE-SU4 Eval D0711-C.M.100.C-C.49 R:0.12384 P:0.07961 F:0.09692
49 ROUGE-SU4 Eval D0711-C.M.100.C-F.49 R:0.17998 P:0.11570 F:0.14085
49 ROUGE-SU4 Eval D0716-A.M.100.D-C.49 R:0.16330 P:0.11124 F:0.13233
49 ROUGE-SU4 Eval D0716-A.M.100.D-D.49 R:0.15297 P:0.10245 F:0.12271
49 ROUGE-SU4 Eval D0716-A.M.100.D-E.49 R:0.17804 P:0.11965 F:0.14312
49 ROUGE-SU4 Eval D0716-A.M.100.D-F.49 R:0.15989 P:0.10818 F:0.12905
49 ROUGE-SU4 Eval D0716-B.M.100.D-C.49 R:0.11768 P:0.07881 F:0.09440
49 ROUGE-SU4 Eval D0716-B.M.100.D-D.49 R:0.13161 P:0.08635 F:0.10428
49 ROUGE-SU4 Eval D0716-B.M.100.D-E.49 R:0.11775 P:0.07805 F:0.09388
49 ROUGE-SU4 Eval D0716-B.M.100.D-F.49 R:0.12500 P:0.08258 F:0.09946
49 ROUGE-SU4 Eval D0716-C.M.100.D-C.49 R:0.17559 P:0.12125 F:0.14345
49 ROUGE-SU4 Eval D0716-C.M.100.D-D.49 R:0.23253 P:0.15627 F:0.18692
49 ROUGE-SU4 Eval D0716-C.M.100.D-E.49 R:0.19435 P:0.13241 F:0.15751
49 ROUGE-SU4 Eval D0716-C.M.100.D-F.49 R:0.20890 P:0.14088 F:0.16828
49 ROUGE-SU4 Eval D0721-A.M.100.E-B.49 R:0.13470 P:0.08229 F:0.10217
49 ROUGE-SU4 Eval D0721-A.M.100.E-C.49 R:0.12778 P:0.08020 F:0.09855
49 ROUGE-SU4 Eval D0721-A.M.100.E-E.49 R:0.13389 P:0.08403 F:0.10326
49 ROUGE-SU4 Eval D0721-A.M.100.E-G.49 R:0.13290 P:0.08508 F:0.10374
49 ROUGE-SU4 Eval D0721-B.M.100.E-B.49 R:0.06522 P:0.04382 F:0.05242
49 ROUGE-SU4 Eval D0721-B.M.100.E-C.49 R:0.05556 P:0.03820 F:0.04527
49 ROUGE-SU4 Eval D0721-B.M.100.E-E.49 R:0.05780 P:0.03858 F:0.04627
49 ROUGE-SU4 Eval D0721-B.M.100.E-G.49 R:0.04912 P:0.03333 F:0.03971
49 ROUGE-SU4 Eval D0721-C.M.100.E-B.49 R:0.09428 P:0.05479 F:0.06930
49 ROUGE-SU4 Eval D0721-C.M.100.E-C.49 R:0.07345 P:0.04240 F:0.05376
49 ROUGE-SU4 Eval D0721-C.M.100.E-E.49 R:0.08048 P:0.04599 F:0.05853
49 ROUGE-SU4 Eval D0721-C.M.100.E-G.49 R:0.07302 P:0.04273 F:0.05391
49 ROUGE-SU4 Eval D0726-A.M.100.F-A.49 R:0.11945 P:0.07014 F:0.08838
49 ROUGE-SU4 Eval D0726-A.M.100.F-E.49 R:0.12100 P:0.07081 F:0.08934
49 ROUGE-SU4 Eval D0726-A.M.100.F-F.49 R:0.10125 P:0.05945 F:0.07491
49 ROUGE-SU4 Eval D0726-A.M.100.F-G.49 R:0.11945 P:0.07014 F:0.08838
49 ROUGE-SU4 Eval D0726-B.M.100.F-A.49 R:0.05201 P:0.03069 F:0.03860
49 ROUGE-SU4 Eval D0726-B.M.100.F-E.49 R:0.05688 P:0.03300 F:0.04177
49 ROUGE-SU4 Eval D0726-B.M.100.F-F.49 R:0.06143 P:0.03564 F:0.04511
49 ROUGE-SU4 Eval D0726-B.M.100.F-G.49 R:0.05687 P:0.03333 F:0.04203
49 ROUGE-SU4 Eval D0726-C.M.100.F-A.49 R:0.07591 P:0.04338 F:0.05521
49 ROUGE-SU4 Eval D0726-C.M.100.F-E.49 R:0.07209 P:0.04077 F:0.05208
49 ROUGE-SU4 Eval D0726-C.M.100.F-F.49 R:0.07433 P:0.04175 F:0.05347
49 ROUGE-SU4 Eval D0726-C.M.100.F-G.49 R:0.07800 P:0.04534 F:0.05735
49 ROUGE-SU4 Eval D0727-A.M.100.G-A.49 R:0.12571 P:0.07658 F:0.09518
49 ROUGE-SU4 Eval D0727-A.M.100.G-F.49 R:0.14189 P:0.08732 F:0.10811
49 ROUGE-SU4 Eval D0727-A.M.100.G-G.49 R:0.12192 P:0.07554 F:0.09328
49 ROUGE-SU4 Eval D0727-A.M.100.G-H.49 R:0.13457 P:0.08281 F:0.10253
49 ROUGE-SU4 Eval D0727-B.M.100.G-A.49 R:0.12956 P:0.07175 F:0.09235
49 ROUGE-SU4 Eval D0727-B.M.100.G-F.49 R:0.10722 P:0.06295 F:0.07933
49 ROUGE-SU4 Eval D0727-B.M.100.G-G.49 R:0.11744 P:0.06458 F:0.08333
49 ROUGE-SU4 Eval D0727-B.M.100.G-H.49 R:0.12603 P:0.06980 F:0.08984
49 ROUGE-SU4 Eval D0727-C.M.100.G-A.49 R:0.13211 P:0.07640 F:0.09681
49 ROUGE-SU4 Eval D0727-C.M.100.G-F.49 R:0.13091 P:0.07318 F:0.09388
49 ROUGE-SU4 Eval D0727-C.M.100.G-G.49 R:0.13164 P:0.07511 F:0.09565
49 ROUGE-SU4 Eval D0727-C.M.100.G-H.49 R:0.10880 P:0.06061 F:0.07785
49 ROUGE-SU4 Eval D0736-A.M.100.H-G.49 R:0.12362 P:0.06192 F:0.08251
49 ROUGE-SU4 Eval D0736-A.M.100.H-H.49 R:0.13910 P:0.06839 F:0.09170
49 ROUGE-SU4 Eval D0736-A.M.100.H-I.49 R:0.13065 P:0.06593 F:0.08764
49 ROUGE-SU4 Eval D0736-A.M.100.H-J.49 R:0.11521 P:0.06346 F:0.08184
49 ROUGE-SU4 Eval D0736-B.M.100.H-G.49 R:0.05512 P:0.02911 F:0.03810
49 ROUGE-SU4 Eval D0736-B.M.100.H-H.49 R:0.08476 P:0.04123 F:0.05548
49 ROUGE-SU4 Eval D0736-B.M.100.H-I.49 R:0.08947 P:0.04297 F:0.05806
49 ROUGE-SU4 Eval D0736-B.M.100.H-J.49 R:0.08273 P:0.04782 F:0.06061
49 ROUGE-SU4 Eval D0736-C.M.100.H-G.49 R:0.16084 P:0.07804 F:0.10509
49 ROUGE-SU4 Eval D0736-C.M.100.H-H.49 R:0.09777 P:0.03708 F:0.05377
49 ROUGE-SU4 Eval D0736-C.M.100.H-I.49 R:0.19460 P:0.07380 F:0.10702
49 ROUGE-SU4 Eval D0736-C.M.100.H-J.49 R:0.14527 P:0.07910 F:0.10243
49 ROUGE-SU4 Eval D0740-A.M.100.I-D.49 R:0.10734 P:0.06625 F:0.08193
49 ROUGE-SU4 Eval D0740-A.M.100.I-H.49 R:0.10347 P:0.06450 F:0.07946
49 ROUGE-SU4 Eval D0740-A.M.100.I-I.49 R:0.09833 P:0.06172 F:0.07584
49 ROUGE-SU4 Eval D0740-A.M.100.I-J.49 R:0.10099 P:0.06381 F:0.07821
49 ROUGE-SU4 Eval D0740-B.M.100.I-D.49 R:0.07833 P:0.04947 F:0.06064
49 ROUGE-SU4 Eval D0740-B.M.100.I-H.49 R:0.06916 P:0.04281 F:0.05288
49 ROUGE-SU4 Eval D0740-B.M.100.I-I.49 R:0.07576 P:0.04737 F:0.05829
49 ROUGE-SU4 Eval D0740-B.M.100.I-J.49 R:0.07198 P:0.04561 F:0.05584
49 ROUGE-SU4 Eval D0740-C.M.100.I-D.49 R:0.13060 P:0.09012 F:0.10665
49 ROUGE-SU4 Eval D0740-C.M.100.I-H.49 R:0.11661 P:0.07994 F:0.09485
49 ROUGE-SU4 Eval D0740-C.M.100.I-I.49 R:0.12077 P:0.08333 F:0.09862
49 ROUGE-SU4 Eval D0740-C.M.100.I-J.49 R:0.12092 P:0.08371 F:0.09893
49 ROUGE-SU4 Eval D0743-A.M.100.J-B.49 R:0.08415 P:0.06093 F:0.07068
49 ROUGE-SU4 Eval D0743-A.M.100.J-H.49 R:0.07595 P:0.05660 F:0.06486
49 ROUGE-SU4 Eval D0743-A.M.100.J-I.49 R:0.08280 P:0.06093 F:0.07020
49 ROUGE-SU4 Eval D0743-A.M.100.J-J.49 R:0.07045 P:0.05267 F:0.06028
49 ROUGE-SU4 Eval D0743-B.M.100.J-B.49 R:0.07346 P:0.04371 F:0.05481
49 ROUGE-SU4 Eval D0743-B.M.100.J-H.49 R:0.07282 P:0.04403 F:0.05488
49 ROUGE-SU4 Eval D0743-B.M.100.J-I.49 R:0.06981 P:0.04207 F:0.05250
49 ROUGE-SU4 Eval D0743-B.M.100.J-J.49 R:0.07242 P:0.04436 F:0.05502
49 ROUGE-SU4 Eval D0743-C.M.100.J-B.49 R:0.12161 P:0.07666 F:0.09404
49 ROUGE-SU4 Eval D0743-C.M.100.J-H.49 R:0.07571 P:0.04757 F:0.05843
49 ROUGE-SU4 Eval D0743-C.M.100.J-I.49 R:0.10820 P:0.06776 F:0.08333
49 ROUGE-SU4 Eval D0743-C.M.100.J-J.49 R:0.10161 P:0.06468 F:0.07904
---------------------------------------------
50 ROUGE-1 Average_R: 0.29739 (95%-conf.int. 0.28889 - 0.30572)
50 ROUGE-1 Average_P: 0.20099 (95%-conf.int. 0.19423 - 0.20792)
50 ROUGE-1 Average_F: 0.23927 (95%-conf.int. 0.23188 - 0.24666)
.............................................
50 ROUGE-1 Eval D0703-A.M.100.A-A.50 R:0.36149 P:0.27865 F:0.31471
50 ROUGE-1 Eval D0703-A.M.100.A-C.50 R:0.32550 P:0.25260 F:0.28445
50 ROUGE-1 Eval D0703-A.M.100.A-D.50 R:0.34021 P:0.25781 F:0.29333
50 ROUGE-1 Eval D0703-A.M.100.A-J.50 R:0.32653 P:0.25000 F:0.28319
50 ROUGE-1 Eval D0703-B.M.100.A-A.50 R:0.35294 P:0.22930 F:0.27799
50 ROUGE-1 Eval D0703-B.M.100.A-C.50 R:0.40604 P:0.25690 F:0.31469
50 ROUGE-1 Eval D0703-B.M.100.A-D.50 R:0.36913 P:0.23355 F:0.28609
50 ROUGE-1 Eval D0703-B.M.100.A-J.50 R:0.36877 P:0.23567 F:0.28757
50 ROUGE-1 Eval D0703-C.M.100.A-A.50 R:0.34000 P:0.23611 F:0.27869
50 ROUGE-1 Eval D0703-C.M.100.A-C.50 R:0.34091 P:0.24306 F:0.28379
50 ROUGE-1 Eval D0703-C.M.100.A-D.50 R:0.33775 P:0.23611 F:0.27793
50 ROUGE-1 Eval D0703-C.M.100.A-J.50 R:0.34768 P:0.24306 F:0.28611
50 ROUGE-1 Eval D0706-A.M.100.B-B.50 R:0.31818 P:0.23671 F:0.27146
50 ROUGE-1 Eval D0706-A.M.100.B-D.50 R:0.29739 P:0.21981 F:0.25278
50 ROUGE-1 Eval D0706-A.M.100.B-E.50 R:0.31494 P:0.23430 F:0.26870
50 ROUGE-1 Eval D0706-A.M.100.B-I.50 R:0.29870 P:0.22222 F:0.25485
50 ROUGE-1 Eval D0706-B.M.100.B-B.50 R:0.24837 P:0.15833 F:0.19338
50 ROUGE-1 Eval D0706-B.M.100.B-D.50 R:0.23779 P:0.15208 F:0.18551
50 ROUGE-1 Eval D0706-B.M.100.B-E.50 R:0.22727 P:0.14583 F:0.17766
50 ROUGE-1 Eval D0706-B.M.100.B-I.50 R:0.26214 P:0.16875 F:0.20532
50 ROUGE-1 Eval D0706-C.M.100.B-B.50 R:0.39677 P:0.29078 F:0.33561
50 ROUGE-1 Eval D0706-C.M.100.B-D.50 R:0.40000 P:0.29314 F:0.33833
50 ROUGE-1 Eval D0706-C.M.100.B-E.50 R:0.39744 P:0.29314 F:0.33741
50 ROUGE-1 Eval D0706-C.M.100.B-I.50 R:0.38658 P:0.28605 F:0.32880
50 ROUGE-1 Eval D0711-A.M.100.C-A.50 R:0.28618 P:0.20280 F:0.23738
50 ROUGE-1 Eval D0711-A.M.100.C-B.50 R:0.33667 P:0.23543 F:0.27709
50 ROUGE-1 Eval D0711-A.M.100.C-C.50 R:0.30667 P:0.21445 F:0.25240
50 ROUGE-1 Eval D0711-A.M.100.C-F.50 R:0.33444 P:0.23543 F:0.27633
50 ROUGE-1 Eval D0711-B.M.100.C-A.50 R:0.38776 P:0.27143 F:0.31933
50 ROUGE-1 Eval D0711-B.M.100.C-B.50 R:0.34932 P:0.24286 F:0.28652
50 ROUGE-1 Eval D0711-B.M.100.C-C.50 R:0.35570 P:0.25238 F:0.29526
50 ROUGE-1 Eval D0711-B.M.100.C-F.50 R:0.34237 P:0.24048 F:0.28252
50 ROUGE-1 Eval D0711-C.M.100.C-A.50 R:0.34323 P:0.24242 F:0.28415
50 ROUGE-1 Eval D0711-C.M.100.C-B.50 R:0.32423 P:0.22145 F:0.26316
50 ROUGE-1 Eval D0711-C.M.100.C-C.50 R:0.34797 P:0.24009 F:0.28413
50 ROUGE-1 Eval D0711-C.M.100.C-F.50 R:0.35811 P:0.24709 F:0.29242
50 ROUGE-1 Eval D0716-A.M.100.D-C.50 R:0.22295 P:0.13821 F:0.17064
50 ROUGE-1 Eval D0716-A.M.100.D-D.50 R:0.23667 P:0.14431 F:0.17929
50 ROUGE-1 Eval D0716-A.M.100.D-E.50 R:0.22924 P:0.14024 F:0.17402
50 ROUGE-1 Eval D0716-A.M.100.D-F.50 R:0.22442 P:0.13821 F:0.17107
50 ROUGE-1 Eval D0716-B.M.100.D-C.50 R:0.20395 P:0.13248 F:0.16062
50 ROUGE-1 Eval D0716-B.M.100.D-D.50 R:0.22819 P:0.14530 F:0.17755
50 ROUGE-1 Eval D0716-B.M.100.D-E.50 R:0.20930 P:0.13462 F:0.16385
50 ROUGE-1 Eval D0716-B.M.100.D-F.50 R:0.21667 P:0.13889 F:0.16927
50 ROUGE-1 Eval D0716-C.M.100.D-C.50 R:0.26059 P:0.17429 F:0.20888
50 ROUGE-1 Eval D0716-C.M.100.D-D.50 R:0.30435 P:0.19826 F:0.24011
50 ROUGE-1 Eval D0716-C.M.100.D-E.50 R:0.31683 P:0.20915 F:0.25197
50 ROUGE-1 Eval D0716-C.M.100.D-F.50 R:0.31000 P:0.20261 F:0.24506
50 ROUGE-1 Eval D0721-A.M.100.E-B.50 R:0.28667 P:0.17695 F:0.21883
50 ROUGE-1 Eval D0721-A.M.100.E-C.50 R:0.27597 P:0.17490 F:0.21411
50 ROUGE-1 Eval D0721-A.M.100.E-E.50 R:0.28896 P:0.18313 F:0.22418
50 ROUGE-1 Eval D0721-A.M.100.E-G.50 R:0.27070 P:0.17490 F:0.21250
50 ROUGE-1 Eval D0721-B.M.100.E-B.50 R:0.29967 P:0.20862 F:0.24599
50 ROUGE-1 Eval D0721-B.M.100.E-C.50 R:0.32484 P:0.23129 F:0.27020
50 ROUGE-1 Eval D0721-B.M.100.E-E.50 R:0.27541 P:0.19048 F:0.22520
50 ROUGE-1 Eval D0721-B.M.100.E-G.50 R:0.30323 P:0.21315 F:0.25033
50 ROUGE-1 Eval D0721-C.M.100.E-B.50 R:0.29180 P:0.21343 F:0.24654
50 ROUGE-1 Eval D0721-C.M.100.E-C.50 R:0.23762 P:0.17266 F:0.20000
50 ROUGE-1 Eval D0721-C.M.100.E-E.50 R:0.26667 P:0.19185 F:0.22316
50 ROUGE-1 Eval D0721-C.M.100.E-G.50 R:0.25081 P:0.18465 F:0.21270
50 ROUGE-1 Eval D0726-A.M.100.F-A.50 R:0.26578 P:0.16667 F:0.20487
50 ROUGE-1 Eval D0726-A.M.100.F-E.50 R:0.25667 P:0.16042 F:0.19744
50 ROUGE-1 Eval D0726-A.M.100.F-F.50 R:0.26910 P:0.16875 F:0.20743
50 ROUGE-1 Eval D0726-A.M.100.F-G.50 R:0.26578 P:0.16667 F:0.20487
50 ROUGE-1 Eval D0726-B.M.100.F-A.50 R:0.22222 P:0.16425 F:0.18889
50 ROUGE-1 Eval D0726-B.M.100.F-E.50 R:0.23588 P:0.17150 F:0.19860
50 ROUGE-1 Eval D0726-B.M.100.F-F.50 R:0.22924 P:0.16667 F:0.19301
50 ROUGE-1 Eval D0726-B.M.100.F-G.50 R:0.25329 P:0.18599 F:0.21448
50 ROUGE-1 Eval D0726-C.M.100.F-A.50 R:0.26000 P:0.18182 F:0.21399
50 ROUGE-1 Eval D0726-C.M.100.F-E.50 R:0.26936 P:0.18648 F:0.22039
50 ROUGE-1 Eval D0726-C.M.100.F-F.50 R:0.25763 P:0.17716 F:0.20995
50 ROUGE-1 Eval D0726-C.M.100.F-G.50 R:0.23607 P:0.16783 F:0.19619
50 ROUGE-1 Eval D0727-A.M.100.G-A.50 R:0.31229 P:0.21759 F:0.25648
50 ROUGE-1 Eval D0727-A.M.100.G-F.50 R:0.29605 P:0.20833 F:0.24456
50 ROUGE-1 Eval D0727-A.M.100.G-G.50 R:0.30065 P:0.21296 F:0.24932
50 ROUGE-1 Eval D0727-A.M.100.G-H.50 R:0.29605 P:0.20833 F:0.24456
50 ROUGE-1 Eval D0727-B.M.100.G-A.50 R:0.37113 P:0.24658 F:0.29630
50 ROUGE-1 Eval D0727-B.M.100.G-F.50 R:0.35714 P:0.25114 F:0.29490
50 ROUGE-1 Eval D0727-B.M.100.G-G.50 R:0.36678 P:0.24201 F:0.29161
50 ROUGE-1 Eval D0727-B.M.100.G-H.50 R:0.32990 P:0.21918 F:0.26338
50 ROUGE-1 Eval D0727-C.M.100.G-A.50 R:0.33225 P:0.24286 F:0.28061
50 ROUGE-1 Eval D0727-C.M.100.G-F.50 R:0.35354 P:0.25000 F:0.29289
50 ROUGE-1 Eval D0727-C.M.100.G-G.50 R:0.31023 P:0.22381 F:0.26003
50 ROUGE-1 Eval D0727-C.M.100.G-H.50 R:0.34122 P:0.24048 F:0.28213
50 ROUGE-1 Eval D0736-A.M.100.H-G.50 R:0.30466 P:0.17068 F:0.21879
50 ROUGE-1 Eval D0736-A.M.100.H-H.50 R:0.26642 P:0.14659 F:0.18912
50 ROUGE-1 Eval D0736-A.M.100.H-I.50 R:0.29181 P:0.16466 F:0.21053
50 ROUGE-1 Eval D0736-A.M.100.H-J.50 R:0.27451 P:0.16867 F:0.20895
50 ROUGE-1 Eval D0736-B.M.100.H-G.50 R:0.20992 P:0.12141 F:0.15384
50 ROUGE-1 Eval D0736-B.M.100.H-H.50 R:0.20661 P:0.11038 F:0.14389
50 ROUGE-1 Eval D0736-B.M.100.H-I.50 R:0.22594 P:0.11921 F:0.15607
50 ROUGE-1 Eval D0736-B.M.100.H-J.50 R:0.20979 P:0.13245 F:0.16238
50 ROUGE-1 Eval D0736-C.M.100.H-G.50 R:0.32911 P:0.16774 F:0.22222
50 ROUGE-1 Eval D0736-C.M.100.H-H.50 R:0.36364 P:0.14624 F:0.20859
50 ROUGE-1 Eval D0736-C.M.100.H-I.50 R:0.36898 P:0.14839 F:0.21166
50 ROUGE-1 Eval D0736-C.M.100.H-J.50 R:0.29811 P:0.16989 F:0.21644
50 ROUGE-1 Eval D0740-A.M.100.I-D.50 R:0.33333 P:0.22296 F:0.26720
50 ROUGE-1 Eval D0740-A.M.100.I-H.50 R:0.31373 P:0.21192 F:0.25297
50 ROUGE-1 Eval D0740-A.M.100.I-I.50 R:0.29870 P:0.20309 F:0.24179
50 ROUGE-1 Eval D0740-A.M.100.I-J.50 R:0.30645 P:0.20971 F:0.24901
50 ROUGE-1 Eval D0740-B.M.100.I-D.50 R:0.34091 P:0.23179 F:0.27595
50 ROUGE-1 Eval D0740-B.M.100.I-H.50 R:0.31457 P:0.20971 F:0.25165
50 ROUGE-1 Eval D0740-B.M.100.I-I.50 R:0.32459 P:0.21854 F:0.26121
50 ROUGE-1 Eval D0740-B.M.100.I-J.50 R:0.30421 P:0.20751 F:0.24672
50 ROUGE-1 Eval D0740-C.M.100.I-D.50 R:0.25240 P:0.20102 F:0.22380
50 ROUGE-1 Eval D0740-C.M.100.I-H.50 R:0.24116 P:0.19084 F:0.21307
50 ROUGE-1 Eval D0740-C.M.100.I-I.50 R:0.23962 P:0.19084 F:0.21247
50 ROUGE-1 Eval D0740-C.M.100.I-J.50 R:0.25478 P:0.20356 F:0.22631
50 ROUGE-1 Eval D0743-A.M.100.J-B.50 R:0.26667 P:0.18301 F:0.21706
50 ROUGE-1 Eval D0743-A.M.100.J-H.50 R:0.24383 P:0.17211 F:0.20179
50 ROUGE-1 Eval D0743-A.M.100.J-I.50 R:0.24375 P:0.16993 F:0.20025
50 ROUGE-1 Eval D0743-A.M.100.J-J.50 R:0.22769 P:0.16122 F:0.18877
50 ROUGE-1 Eval D0743-B.M.100.J-B.50 R:0.30769 P:0.19277 F:0.23704
50 ROUGE-1 Eval D0743-B.M.100.J-H.50 R:0.27445 P:0.17470 F:0.21350
50 ROUGE-1 Eval D0743-B.M.100.J-I.50 R:0.29747 P:0.18876 F:0.23096
50 ROUGE-1 Eval D0743-B.M.100.J-J.50 R:0.29595 P:0.19076 F:0.23199
50 ROUGE-1 Eval D0743-C.M.100.J-B.50 R:0.30794 P:0.21272 F:0.25162
50 ROUGE-1 Eval D0743-C.M.100.J-H.50 R:0.28344 P:0.19518 F:0.23117
50 ROUGE-1 Eval D0743-C.M.100.J-I.50 R:0.32268 P:0.22149 F:0.26268
50 ROUGE-1 Eval D0743-C.M.100.J-J.50 R:0.27673 P:0.19298 F:0.22739
---------------------------------------------
50 ROUGE-2 Average_R: 0.05202 (95%-conf.int. 0.04695 - 0.05741)
50 ROUGE-2 Average_P: 0.03502 (95%-conf.int. 0.03152 - 0.03880)
50 ROUGE-2 Average_F: 0.04173 (95%-conf.int. 0.03759 - 0.04603)
.............................................
50 ROUGE-2 Eval D0703-A.M.100.A-A.50 R:0.12287 P:0.09449 F:0.10683
50 ROUGE-2 Eval D0703-A.M.100.A-C.50 R:0.09492 P:0.07349 F:0.08284
50 ROUGE-2 Eval D0703-A.M.100.A-D.50 R:0.11111 P:0.08399 F:0.09567
50 ROUGE-2 Eval D0703-A.M.100.A-J.50 R:0.10309 P:0.07874 F:0.08928
50 ROUGE-2 Eval D0703-B.M.100.A-A.50 R:0.08911 P:0.05769 F:0.07004
50 ROUGE-2 Eval D0703-B.M.100.A-C.50 R:0.12542 P:0.07906 F:0.09698
50 ROUGE-2 Eval D0703-B.M.100.A-D.50 R:0.10508 P:0.06624 F:0.08126
50 ROUGE-2 Eval D0703-B.M.100.A-J.50 R:0.11409 P:0.07265 F:0.08877
50 ROUGE-2 Eval D0703-C.M.100.A-A.50 R:0.07407 P:0.05128 F:0.06060
50 ROUGE-2 Eval D0703-C.M.100.A-C.50 R:0.08525 P:0.06061 F:0.07085
50 ROUGE-2 Eval D0703-C.M.100.A-D.50 R:0.07023 P:0.04895 F:0.05769
50 ROUGE-2 Eval D0703-C.M.100.A-J.50 R:0.09030 P:0.06294 F:0.07418
50 ROUGE-2 Eval D0706-A.M.100.B-B.50 R:0.07213 P:0.05353 F:0.06145
50 ROUGE-2 Eval D0706-A.M.100.B-D.50 R:0.04950 P:0.03650 F:0.04202
50 ROUGE-2 Eval D0706-A.M.100.B-E.50 R:0.07213 P:0.05353 F:0.06145
50 ROUGE-2 Eval D0706-A.M.100.B-I.50 R:0.06230 P:0.04623 F:0.05308
50 ROUGE-2 Eval D0706-B.M.100.B-B.50 R:0.05281 P:0.03354 F:0.04102
50 ROUGE-2 Eval D0706-B.M.100.B-D.50 R:0.04605 P:0.02935 F:0.03585
50 ROUGE-2 Eval D0706-B.M.100.B-E.50 R:0.02295 P:0.01468 F:0.01791
50 ROUGE-2 Eval D0706-B.M.100.B-I.50 R:0.05556 P:0.03564 F:0.04342
50 ROUGE-2 Eval D0706-C.M.100.B-B.50 R:0.07492 P:0.05476 F:0.06327
50 ROUGE-2 Eval D0706-C.M.100.B-D.50 R:0.08143 P:0.05952 F:0.06877
50 ROUGE-2 Eval D0706-C.M.100.B-E.50 R:0.08091 P:0.05952 F:0.06859
50 ROUGE-2 Eval D0706-C.M.100.B-I.50 R:0.06452 P:0.04762 F:0.05480
50 ROUGE-2 Eval D0711-A.M.100.C-A.50 R:0.03987 P:0.02817 F:0.03301
50 ROUGE-2 Eval D0711-A.M.100.C-B.50 R:0.05724 P:0.03991 F:0.04703
50 ROUGE-2 Eval D0711-A.M.100.C-C.50 R:0.04714 P:0.03286 F:0.03873
50 ROUGE-2 Eval D0711-A.M.100.C-F.50 R:0.04682 P:0.03286 F:0.03862
50 ROUGE-2 Eval D0711-B.M.100.C-A.50 R:0.06873 P:0.04796 F:0.05650
50 ROUGE-2 Eval D0711-B.M.100.C-B.50 R:0.06920 P:0.04796 F:0.05665
50 ROUGE-2 Eval D0711-B.M.100.C-C.50 R:0.04407 P:0.03118 F:0.03652
50 ROUGE-2 Eval D0711-B.M.100.C-F.50 R:0.04452 P:0.03118 F:0.03667
50 ROUGE-2 Eval D0711-C.M.100.C-A.50 R:0.04667 P:0.03286 F:0.03857
50 ROUGE-2 Eval D0711-C.M.100.C-B.50 R:0.03448 P:0.02347 F:0.02793
50 ROUGE-2 Eval D0711-C.M.100.C-C.50 R:0.03754 P:0.02582 F:0.03060
50 ROUGE-2 Eval D0711-C.M.100.C-F.50 R:0.05461 P:0.03756 F:0.04451
50 ROUGE-2 Eval D0716-A.M.100.D-C.50 R:0.00993 P:0.00613 F:0.00758
50 ROUGE-2 Eval D0716-A.M.100.D-D.50 R:0.01684 P:0.01022 F:0.01272
50 ROUGE-2 Eval D0716-A.M.100.D-E.50 R:0.01678 P:0.01022 F:0.01270
50 ROUGE-2 Eval D0716-A.M.100.D-F.50 R:0.01667 P:0.01022 F:0.01267
50 ROUGE-2 Eval D0716-B.M.100.D-C.50 R:0.00664 P:0.00430 F:0.00522
50 ROUGE-2 Eval D0716-B.M.100.D-D.50 R:0.00678 P:0.00430 F:0.00526
50 ROUGE-2 Eval D0716-B.M.100.D-E.50 R:0.01007 P:0.00645 F:0.00786
50 ROUGE-2 Eval D0716-B.M.100.D-F.50 R:0.00673 P:0.00430 F:0.00525
50 ROUGE-2 Eval D0716-C.M.100.D-C.50 R:0.03289 P:0.02193 F:0.02631
50 ROUGE-2 Eval D0716-C.M.100.D-D.50 R:0.07770 P:0.05044 F:0.06117
50 ROUGE-2 Eval D0716-C.M.100.D-E.50 R:0.07667 P:0.05044 F:0.06085
50 ROUGE-2 Eval D0716-C.M.100.D-F.50 R:0.07407 P:0.04825 F:0.05843
50 ROUGE-2 Eval D0721-A.M.100.E-B.50 R:0.03704 P:0.02277 F:0.02820
50 ROUGE-2 Eval D0721-A.M.100.E-C.50 R:0.03607 P:0.02277 F:0.02792
50 ROUGE-2 Eval D0721-A.M.100.E-E.50 R:0.04918 P:0.03106 F:0.03807
50 ROUGE-2 Eval D0721-A.M.100.E-G.50 R:0.03537 P:0.02277 F:0.02770
50 ROUGE-2 Eval D0721-B.M.100.E-B.50 R:0.05592 P:0.03881 F:0.04582
50 ROUGE-2 Eval D0721-B.M.100.E-C.50 R:0.08682 P:0.06164 F:0.07209
50 ROUGE-2 Eval D0721-B.M.100.E-E.50 R:0.04967 P:0.03425 F:0.04054
50 ROUGE-2 Eval D0721-B.M.100.E-G.50 R:0.08143 P:0.05708 F:0.06711
50 ROUGE-2 Eval D0721-C.M.100.E-B.50 R:0.05629 P:0.04106 F:0.04748
50 ROUGE-2 Eval D0721-C.M.100.E-C.50 R:0.03000 P:0.02174 F:0.02521
50 ROUGE-2 Eval D0721-C.M.100.E-E.50 R:0.04714 P:0.03382 F:0.03938
50 ROUGE-2 Eval D0721-C.M.100.E-G.50 R:0.03618 P:0.02657 F:0.03064
50 ROUGE-2 Eval D0726-A.M.100.F-A.50 R:0.01678 P:0.01048 F:0.01290
50 ROUGE-2 Eval D0726-A.M.100.F-E.50 R:0.00673 P:0.00419 F:0.00516
50 ROUGE-2 Eval D0726-A.M.100.F-F.50 R:0.01342 P:0.00839 F:0.01032
50 ROUGE-2 Eval D0726-A.M.100.F-G.50 R:0.01342 P:0.00839 F:0.01032
50 ROUGE-2 Eval D0726-B.M.100.F-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-2 Eval D0726-B.M.100.F-E.50 R:0.00671 P:0.00487 F:0.00564
50 ROUGE-2 Eval D0726-B.M.100.F-F.50 R:0.00671 P:0.00487 F:0.00564
50 ROUGE-2 Eval D0726-B.M.100.F-G.50 R:0.00664 P:0.00487 F:0.00562
50 ROUGE-2 Eval D0726-C.M.100.F-A.50 R:0.06734 P:0.04695 F:0.05533
50 ROUGE-2 Eval D0726-C.M.100.F-E.50 R:0.06122 P:0.04225 F:0.05000
50 ROUGE-2 Eval D0726-C.M.100.F-F.50 R:0.05479 P:0.03756 F:0.04457
50 ROUGE-2 Eval D0726-C.M.100.F-G.50 R:0.03974 P:0.02817 F:0.03297
50 ROUGE-2 Eval D0727-A.M.100.G-A.50 R:0.02685 P:0.01865 F:0.02201
50 ROUGE-2 Eval D0727-A.M.100.G-F.50 R:0.01993 P:0.01399 F:0.01644
50 ROUGE-2 Eval D0727-A.M.100.G-G.50 R:0.02970 P:0.02098 F:0.02459
50 ROUGE-2 Eval D0727-A.M.100.G-H.50 R:0.02326 P:0.01632 F:0.01918
50 ROUGE-2 Eval D0727-B.M.100.G-A.50 R:0.06944 P:0.04598 F:0.05533
50 ROUGE-2 Eval D0727-B.M.100.G-F.50 R:0.06557 P:0.04598 F:0.05405
50 ROUGE-2 Eval D0727-B.M.100.G-G.50 R:0.05594 P:0.03678 F:0.04438
50 ROUGE-2 Eval D0727-B.M.100.G-H.50 R:0.05556 P:0.03678 F:0.04426
50 ROUGE-2 Eval D0727-C.M.100.G-A.50 R:0.07237 P:0.05276 F:0.06103
50 ROUGE-2 Eval D0727-C.M.100.G-F.50 R:0.07823 P:0.05516 F:0.06470
50 ROUGE-2 Eval D0727-C.M.100.G-G.50 R:0.03667 P:0.02638 F:0.03069
50 ROUGE-2 Eval D0727-C.M.100.G-H.50 R:0.08532 P:0.05995 F:0.07042
50 ROUGE-2 Eval D0736-A.M.100.H-G.50 R:0.05435 P:0.03030 F:0.03891
50 ROUGE-2 Eval D0736-A.M.100.H-H.50 R:0.04059 P:0.02222 F:0.02872
50 ROUGE-2 Eval D0736-A.M.100.H-I.50 R:0.04676 P:0.02626 F:0.03363
50 ROUGE-2 Eval D0736-A.M.100.H-J.50 R:0.03960 P:0.02424 F:0.03007
50 ROUGE-2 Eval D0736-B.M.100.H-G.50 R:0.01544 P:0.00889 F:0.01128
50 ROUGE-2 Eval D0736-B.M.100.H-H.50 R:0.02092 P:0.01111 F:0.01451
50 ROUGE-2 Eval D0736-B.M.100.H-I.50 R:0.02119 P:0.01111 F:0.01458
50 ROUGE-2 Eval D0736-B.M.100.H-J.50 R:0.01413 P:0.00889 F:0.01091
50 ROUGE-2 Eval D0736-C.M.100.H-G.50 R:0.11111 P:0.05628 F:0.07471
50 ROUGE-2 Eval D0736-C.M.100.H-H.50 R:0.10326 P:0.04113 F:0.05883
50 ROUGE-2 Eval D0736-C.M.100.H-I.50 R:0.09239 P:0.03680 F:0.05263
50 ROUGE-2 Eval D0736-C.M.100.H-J.50 R:0.08397 P:0.04762 F:0.06077
50 ROUGE-2 Eval D0740-A.M.100.I-D.50 R:0.05667 P:0.03778 F:0.04534
50 ROUGE-2 Eval D0740-A.M.100.I-H.50 R:0.06601 P:0.04444 F:0.05312
50 ROUGE-2 Eval D0740-A.M.100.I-I.50 R:0.04262 P:0.02889 F:0.03444
50 ROUGE-2 Eval D0740-A.M.100.I-J.50 R:0.04235 P:0.02889 F:0.03435
50 ROUGE-2 Eval D0740-B.M.100.I-D.50 R:0.10164 P:0.06889 F:0.08212
50 ROUGE-2 Eval D0740-B.M.100.I-H.50 R:0.08361 P:0.05556 F:0.06676
50 ROUGE-2 Eval D0740-B.M.100.I-I.50 R:0.07947 P:0.05333 F:0.06383
50 ROUGE-2 Eval D0740-B.M.100.I-J.50 R:0.08170 P:0.05556 F:0.06614
50 ROUGE-2 Eval D0740-C.M.100.I-D.50 R:0.02581 P:0.02051 F:0.02286
50 ROUGE-2 Eval D0740-C.M.100.I-H.50 R:0.02597 P:0.02051 F:0.02292
50 ROUGE-2 Eval D0740-C.M.100.I-I.50 R:0.02903 P:0.02308 F:0.02572
50 ROUGE-2 Eval D0740-C.M.100.I-J.50 R:0.03537 P:0.02821 F:0.03139
50 ROUGE-2 Eval D0743-A.M.100.J-B.50 R:0.02244 P:0.01535 F:0.01823
50 ROUGE-2 Eval D0743-A.M.100.J-H.50 R:0.01558 P:0.01096 F:0.01287
50 ROUGE-2 Eval D0743-A.M.100.J-I.50 R:0.01893 P:0.01316 F:0.01553
50 ROUGE-2 Eval D0743-A.M.100.J-J.50 R:0.01863 P:0.01316 F:0.01542
50 ROUGE-2 Eval D0743-B.M.100.J-B.50 R:0.04531 P:0.02828 F:0.03482
50 ROUGE-2 Eval D0743-B.M.100.J-H.50 R:0.02866 P:0.01818 F:0.02225
50 ROUGE-2 Eval D0743-B.M.100.J-I.50 R:0.04153 P:0.02626 F:0.03218
50 ROUGE-2 Eval D0743-B.M.100.J-J.50 R:0.04717 P:0.03030 F:0.03690
50 ROUGE-2 Eval D0743-C.M.100.J-B.50 R:0.07051 P:0.04857 F:0.05752
50 ROUGE-2 Eval D0743-C.M.100.J-H.50 R:0.04823 P:0.03311 F:0.03926
50 ROUGE-2 Eval D0743-C.M.100.J-I.50 R:0.07742 P:0.05298 F:0.06291
50 ROUGE-2 Eval D0743-C.M.100.J-J.50 R:0.06349 P:0.04415 F:0.05208
---------------------------------------------
50 ROUGE-3 Average_R: 0.01600 (95%-conf.int. 0.01341 - 0.01865)
50 ROUGE-3 Average_P: 0.01078 (95%-conf.int. 0.00902 - 0.01257)
50 ROUGE-3 Average_F: 0.01285 (95%-conf.int. 0.01078 - 0.01497)
.............................................
50 ROUGE-3 Eval D0703-A.M.100.A-A.50 R:0.04828 P:0.03704 F:0.04192
50 ROUGE-3 Eval D0703-A.M.100.A-C.50 R:0.02397 P:0.01852 F:0.02090
50 ROUGE-3 Eval D0703-A.M.100.A-D.50 R:0.04561 P:0.03439 F:0.03921
50 ROUGE-3 Eval D0703-A.M.100.A-J.50 R:0.02778 P:0.02116 F:0.02402
50 ROUGE-3 Eval D0703-B.M.100.A-A.50 R:0.02667 P:0.01720 F:0.02091
50 ROUGE-3 Eval D0703-B.M.100.A-C.50 R:0.04110 P:0.02581 F:0.03171
50 ROUGE-3 Eval D0703-B.M.100.A-D.50 R:0.02397 P:0.01505 F:0.01849
50 ROUGE-3 Eval D0703-B.M.100.A-J.50 R:0.04068 P:0.02581 F:0.03158
50 ROUGE-3 Eval D0703-C.M.100.A-A.50 R:0.03061 P:0.02113 F:0.02500
50 ROUGE-3 Eval D0703-C.M.100.A-C.50 R:0.03311 P:0.02347 F:0.02747
50 ROUGE-3 Eval D0703-C.M.100.A-D.50 R:0.01689 P:0.01174 F:0.01385
50 ROUGE-3 Eval D0703-C.M.100.A-J.50 R:0.04054 P:0.02817 F:0.03324
50 ROUGE-3 Eval D0706-A.M.100.B-B.50 R:0.02649 P:0.01961 F:0.02254
50 ROUGE-3 Eval D0706-A.M.100.B-D.50 R:0.02000 P:0.01471 F:0.01695
50 ROUGE-3 Eval D0706-A.M.100.B-E.50 R:0.02649 P:0.01961 F:0.02254
50 ROUGE-3 Eval D0706-A.M.100.B-I.50 R:0.01656 P:0.01225 F:0.01408
50 ROUGE-3 Eval D0706-B.M.100.B-B.50 R:0.01333 P:0.00844 F:0.01034
50 ROUGE-3 Eval D0706-B.M.100.B-D.50 R:0.01329 P:0.00844 F:0.01032
50 ROUGE-3 Eval D0706-B.M.100.B-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0706-B.M.100.B-I.50 R:0.01320 P:0.00844 F:0.01030
50 ROUGE-3 Eval D0706-C.M.100.B-B.50 R:0.02303 P:0.01679 F:0.01942
50 ROUGE-3 Eval D0706-C.M.100.B-D.50 R:0.02632 P:0.01918 F:0.02219
50 ROUGE-3 Eval D0706-C.M.100.B-E.50 R:0.02614 P:0.01918 F:0.02213
50 ROUGE-3 Eval D0706-C.M.100.B-I.50 R:0.01303 P:0.00959 F:0.01105
50 ROUGE-3 Eval D0711-A.M.100.C-A.50 R:0.01007 P:0.00709 F:0.00832
50 ROUGE-3 Eval D0711-A.M.100.C-B.50 R:0.01361 P:0.00946 F:0.01116
50 ROUGE-3 Eval D0711-A.M.100.C-C.50 R:0.01020 P:0.00709 F:0.00837
50 ROUGE-3 Eval D0711-A.M.100.C-F.50 R:0.00676 P:0.00473 F:0.00557
50 ROUGE-3 Eval D0711-B.M.100.C-A.50 R:0.02083 P:0.01449 F:0.01709
50 ROUGE-3 Eval D0711-B.M.100.C-B.50 R:0.02098 P:0.01449 F:0.01714
50 ROUGE-3 Eval D0711-B.M.100.C-C.50 R:0.00342 P:0.00242 F:0.00283
50 ROUGE-3 Eval D0711-B.M.100.C-F.50 R:0.01730 P:0.01208 F:0.01423
50 ROUGE-3 Eval D0711-C.M.100.C-A.50 R:0.01010 P:0.00709 F:0.00833
50 ROUGE-3 Eval D0711-C.M.100.C-B.50 R:0.00348 P:0.00236 F:0.00281
50 ROUGE-3 Eval D0711-C.M.100.C-C.50 R:0.00690 P:0.00473 F:0.00561
50 ROUGE-3 Eval D0711-C.M.100.C-F.50 R:0.01034 P:0.00709 F:0.00841
50 ROUGE-3 Eval D0716-A.M.100.D-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-A.M.100.D-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-A.M.100.D-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-A.M.100.D-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-B.M.100.D-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-B.M.100.D-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-B.M.100.D-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-B.M.100.D-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0716-C.M.100.D-C.50 R:0.00332 P:0.00221 F:0.00265
50 ROUGE-3 Eval D0716-C.M.100.D-D.50 R:0.04096 P:0.02649 F:0.03217
50 ROUGE-3 Eval D0716-C.M.100.D-E.50 R:0.03704 P:0.02428 F:0.02933
50 ROUGE-3 Eval D0716-C.M.100.D-F.50 R:0.04082 P:0.02649 F:0.03213
50 ROUGE-3 Eval D0721-A.M.100.E-B.50 R:0.00680 P:0.00417 F:0.00517
50 ROUGE-3 Eval D0721-A.M.100.E-C.50 R:0.00662 P:0.00417 F:0.00512
50 ROUGE-3 Eval D0721-A.M.100.E-E.50 R:0.00993 P:0.00625 F:0.00767
50 ROUGE-3 Eval D0721-A.M.100.E-G.50 R:0.00649 P:0.00417 F:0.00508
50 ROUGE-3 Eval D0721-B.M.100.E-B.50 R:0.02326 P:0.01609 F:0.01902
50 ROUGE-3 Eval D0721-B.M.100.E-C.50 R:0.04221 P:0.02989 F:0.03500
50 ROUGE-3 Eval D0721-B.M.100.E-E.50 R:0.02007 P:0.01379 F:0.01635
50 ROUGE-3 Eval D0721-B.M.100.E-G.50 R:0.04276 P:0.02989 F:0.03519
50 ROUGE-3 Eval D0721-C.M.100.E-B.50 R:0.01672 P:0.01217 F:0.01409
50 ROUGE-3 Eval D0721-C.M.100.E-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0721-C.M.100.E-E.50 R:0.01701 P:0.01217 F:0.01419
50 ROUGE-3 Eval D0721-C.M.100.E-G.50 R:0.01661 P:0.01217 F:0.01405
50 ROUGE-3 Eval D0726-A.M.100.F-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-A.M.100.F-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-A.M.100.F-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-A.M.100.F-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-B.M.100.F-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-B.M.100.F-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-B.M.100.F-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-B.M.100.F-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0726-C.M.100.F-A.50 R:0.02041 P:0.01418 F:0.01673
50 ROUGE-3 Eval D0726-C.M.100.F-E.50 R:0.02062 P:0.01418 F:0.01680
50 ROUGE-3 Eval D0726-C.M.100.F-F.50 R:0.01730 P:0.01182 F:0.01404
50 ROUGE-3 Eval D0726-C.M.100.F-G.50 R:0.00334 P:0.00236 F:0.00277
50 ROUGE-3 Eval D0727-A.M.100.G-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0727-A.M.100.G-F.50 R:0.00336 P:0.00235 F:0.00277
50 ROUGE-3 Eval D0727-A.M.100.G-G.50 R:0.00333 P:0.00235 F:0.00276
50 ROUGE-3 Eval D0727-A.M.100.G-H.50 R:0.00336 P:0.00235 F:0.00277
50 ROUGE-3 Eval D0727-B.M.100.G-A.50 R:0.00702 P:0.00463 F:0.00558
50 ROUGE-3 Eval D0727-B.M.100.G-F.50 R:0.00662 P:0.00463 F:0.00545
50 ROUGE-3 Eval D0727-B.M.100.G-G.50 R:0.00353 P:0.00231 F:0.00279
50 ROUGE-3 Eval D0727-B.M.100.G-H.50 R:0.00351 P:0.00231 F:0.00279
50 ROUGE-3 Eval D0727-C.M.100.G-A.50 R:0.03322 P:0.02415 F:0.02797
50 ROUGE-3 Eval D0727-C.M.100.G-F.50 R:0.04124 P:0.02899 F:0.03405
50 ROUGE-3 Eval D0727-C.M.100.G-G.50 R:0.00673 P:0.00483 F:0.00562
50 ROUGE-3 Eval D0727-C.M.100.G-H.50 R:0.04138 P:0.02899 F:0.03409
50 ROUGE-3 Eval D0736-A.M.100.H-G.50 R:0.02198 P:0.01220 F:0.01569
50 ROUGE-3 Eval D0736-A.M.100.H-H.50 R:0.01493 P:0.00813 F:0.01053
50 ROUGE-3 Eval D0736-A.M.100.H-I.50 R:0.01455 P:0.00813 F:0.01043
50 ROUGE-3 Eval D0736-A.M.100.H-J.50 R:0.01333 P:0.00813 F:0.01010
50 ROUGE-3 Eval D0736-B.M.100.H-G.50 R:0.00391 P:0.00224 F:0.00285
50 ROUGE-3 Eval D0736-B.M.100.H-H.50 R:0.00424 P:0.00224 F:0.00293
50 ROUGE-3 Eval D0736-B.M.100.H-I.50 R:0.00429 P:0.00224 F:0.00294
50 ROUGE-3 Eval D0736-B.M.100.H-J.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0736-C.M.100.H-G.50 R:0.03463 P:0.01743 F:0.02319
50 ROUGE-3 Eval D0736-C.M.100.H-H.50 R:0.03315 P:0.01307 F:0.01875
50 ROUGE-3 Eval D0736-C.M.100.H-I.50 R:0.01657 P:0.00654 F:0.00938
50 ROUGE-3 Eval D0736-C.M.100.H-J.50 R:0.02703 P:0.01525 F:0.01950
50 ROUGE-3 Eval D0740-A.M.100.I-D.50 R:0.01347 P:0.00895 F:0.01075
50 ROUGE-3 Eval D0740-A.M.100.I-H.50 R:0.01667 P:0.01119 F:0.01339
50 ROUGE-3 Eval D0740-A.M.100.I-I.50 R:0.00993 P:0.00671 F:0.00801
50 ROUGE-3 Eval D0740-A.M.100.I-J.50 R:0.00987 P:0.00671 F:0.00799
50 ROUGE-3 Eval D0740-B.M.100.I-D.50 R:0.05629 P:0.03803 F:0.04539
50 ROUGE-3 Eval D0740-B.M.100.I-H.50 R:0.05068 P:0.03356 F:0.04038
50 ROUGE-3 Eval D0740-B.M.100.I-I.50 R:0.04013 P:0.02685 F:0.03217
50 ROUGE-3 Eval D0740-B.M.100.I-J.50 R:0.05281 P:0.03579 F:0.04267
50 ROUGE-3 Eval D0740-C.M.100.I-D.50 R:0.00326 P:0.00258 F:0.00288
50 ROUGE-3 Eval D0740-C.M.100.I-H.50 R:0.00328 P:0.00258 F:0.00289
50 ROUGE-3 Eval D0740-C.M.100.I-I.50 R:0.00651 P:0.00517 F:0.00576
50 ROUGE-3 Eval D0740-C.M.100.I-J.50 R:0.00649 P:0.00517 F:0.00576
50 ROUGE-3 Eval D0743-A.M.100.J-B.50 R:0.00324 P:0.00221 F:0.00263
50 ROUGE-3 Eval D0743-A.M.100.J-H.50 R:0.00314 P:0.00221 F:0.00259
50 ROUGE-3 Eval D0743-A.M.100.J-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-3 Eval D0743-A.M.100.J-J.50 R:0.00313 P:0.00221 F:0.00259
50 ROUGE-3 Eval D0743-B.M.100.J-B.50 R:0.01634 P:0.01016 F:0.01253
50 ROUGE-3 Eval D0743-B.M.100.J-H.50 R:0.00643 P:0.00407 F:0.00498
50 ROUGE-3 Eval D0743-B.M.100.J-I.50 R:0.01613 P:0.01016 F:0.01247
50 ROUGE-3 Eval D0743-B.M.100.J-J.50 R:0.01905 P:0.01220 F:0.01487
50 ROUGE-3 Eval D0743-C.M.100.J-B.50 R:0.02589 P:0.01778 F:0.02108
50 ROUGE-3 Eval D0743-C.M.100.J-H.50 R:0.00974 P:0.00667 F:0.00792
50 ROUGE-3 Eval D0743-C.M.100.J-I.50 R:0.02606 P:0.01778 F:0.02114
50 ROUGE-3 Eval D0743-C.M.100.J-J.50 R:0.01603 P:0.01111 F:0.01312
---------------------------------------------
50 ROUGE-4 Average_R: 0.00681 (95%-conf.int. 0.00528 - 0.00842)
50 ROUGE-4 Average_P: 0.00460 (95%-conf.int. 0.00353 - 0.00574)
50 ROUGE-4 Average_F: 0.00548 (95%-conf.int. 0.00425 - 0.00682)
.............................................
50 ROUGE-4 Eval D0703-A.M.100.A-A.50 R:0.02787 P:0.02133 F:0.02417
50 ROUGE-4 Eval D0703-A.M.100.A-C.50 R:0.01730 P:0.01333 F:0.01506
50 ROUGE-4 Eval D0703-A.M.100.A-D.50 R:0.02837 P:0.02133 F:0.02435
50 ROUGE-4 Eval D0703-A.M.100.A-J.50 R:0.01053 P:0.00800 F:0.00909
50 ROUGE-4 Eval D0703-B.M.100.A-A.50 R:0.01010 P:0.00649 F:0.00790
50 ROUGE-4 Eval D0703-B.M.100.A-C.50 R:0.01384 P:0.00866 F:0.01065
50 ROUGE-4 Eval D0703-B.M.100.A-D.50 R:0.00346 P:0.00216 F:0.00266
50 ROUGE-4 Eval D0703-B.M.100.A-J.50 R:0.01370 P:0.00866 F:0.01061
50 ROUGE-4 Eval D0703-C.M.100.A-A.50 R:0.01375 P:0.00946 F:0.01121
50 ROUGE-4 Eval D0703-C.M.100.A-C.50 R:0.01338 P:0.00946 F:0.01108
50 ROUGE-4 Eval D0703-C.M.100.A-D.50 R:0.00683 P:0.00473 F:0.00559
50 ROUGE-4 Eval D0703-C.M.100.A-J.50 R:0.01706 P:0.01182 F:0.01396
50 ROUGE-4 Eval D0706-A.M.100.B-B.50 R:0.01003 P:0.00741 F:0.00852
50 ROUGE-4 Eval D0706-A.M.100.B-D.50 R:0.00673 P:0.00494 F:0.00570
50 ROUGE-4 Eval D0706-A.M.100.B-E.50 R:0.01003 P:0.00741 F:0.00852
50 ROUGE-4 Eval D0706-A.M.100.B-I.50 R:0.00334 P:0.00247 F:0.00284
50 ROUGE-4 Eval D0706-B.M.100.B-B.50 R:0.01010 P:0.00637 F:0.00781
50 ROUGE-4 Eval D0706-B.M.100.B-D.50 R:0.01007 P:0.00637 F:0.00780
50 ROUGE-4 Eval D0706-B.M.100.B-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0706-B.M.100.B-I.50 R:0.01000 P:0.00637 F:0.00778
50 ROUGE-4 Eval D0706-C.M.100.B-B.50 R:0.00997 P:0.00725 F:0.00840
50 ROUGE-4 Eval D0706-C.M.100.B-D.50 R:0.00997 P:0.00725 F:0.00840
50 ROUGE-4 Eval D0706-C.M.100.B-E.50 R:0.00990 P:0.00725 F:0.00837
50 ROUGE-4 Eval D0706-C.M.100.B-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-A.M.100.C-A.50 R:0.00339 P:0.00238 F:0.00280
50 ROUGE-4 Eval D0711-A.M.100.C-B.50 R:0.00344 P:0.00238 F:0.00281
50 ROUGE-4 Eval D0711-A.M.100.C-C.50 R:0.00344 P:0.00238 F:0.00281
50 ROUGE-4 Eval D0711-A.M.100.C-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-B.M.100.C-A.50 R:0.00702 P:0.00487 F:0.00575
50 ROUGE-4 Eval D0711-B.M.100.C-B.50 R:0.00707 P:0.00487 F:0.00577
50 ROUGE-4 Eval D0711-B.M.100.C-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-B.M.100.C-F.50 R:0.00699 P:0.00487 F:0.00574
50 ROUGE-4 Eval D0711-C.M.100.C-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-C.M.100.C-B.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-C.M.100.C-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0711-C.M.100.C-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-A.M.100.D-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-A.M.100.D-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-A.M.100.D-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-A.M.100.D-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-B.M.100.D-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-B.M.100.D-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-B.M.100.D-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-B.M.100.D-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-C.M.100.D-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0716-C.M.100.D-D.50 R:0.03103 P:0.02000 F:0.02432
50 ROUGE-4 Eval D0716-C.M.100.D-E.50 R:0.03061 P:0.02000 F:0.02419
50 ROUGE-4 Eval D0716-C.M.100.D-F.50 R:0.03093 P:0.02000 F:0.02429
50 ROUGE-4 Eval D0721-A.M.100.E-B.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0721-A.M.100.E-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0721-A.M.100.E-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0721-A.M.100.E-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0721-B.M.100.E-B.50 R:0.01007 P:0.00694 F:0.00822
50 ROUGE-4 Eval D0721-B.M.100.E-C.50 R:0.02295 P:0.01620 F:0.01899
50 ROUGE-4 Eval D0721-B.M.100.E-E.50 R:0.01351 P:0.00926 F:0.01099
50 ROUGE-4 Eval D0721-B.M.100.E-G.50 R:0.02326 P:0.01620 F:0.01910
50 ROUGE-4 Eval D0721-C.M.100.E-B.50 R:0.01014 P:0.00735 F:0.00852
50 ROUGE-4 Eval D0721-C.M.100.E-C.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0721-C.M.100.E-E.50 R:0.01031 P:0.00735 F:0.00858
50 ROUGE-4 Eval D0721-C.M.100.E-G.50 R:0.01007 P:0.00735 F:0.00850
50 ROUGE-4 Eval D0726-A.M.100.F-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-A.M.100.F-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-A.M.100.F-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-A.M.100.F-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-B.M.100.F-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-B.M.100.F-E.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-B.M.100.F-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-B.M.100.F-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0726-C.M.100.F-A.50 R:0.00687 P:0.00476 F:0.00562
50 ROUGE-4 Eval D0726-C.M.100.F-E.50 R:0.00694 P:0.00476 F:0.00565
50 ROUGE-4 Eval D0726-C.M.100.F-F.50 R:0.00699 P:0.00476 F:0.00566
50 ROUGE-4 Eval D0726-C.M.100.F-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-A.M.100.G-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-A.M.100.G-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-A.M.100.G-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-A.M.100.G-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-B.M.100.G-A.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-B.M.100.G-F.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-B.M.100.G-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-B.M.100.G-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-C.M.100.G-A.50 R:0.02349 P:0.01703 F:0.01975
50 ROUGE-4 Eval D0727-C.M.100.G-F.50 R:0.02431 P:0.01703 F:0.02003
50 ROUGE-4 Eval D0727-C.M.100.G-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0727-C.M.100.G-H.50 R:0.02439 P:0.01703 F:0.02006
50 ROUGE-4 Eval D0736-A.M.100.H-G.50 R:0.00741 P:0.00409 F:0.00527
50 ROUGE-4 Eval D0736-A.M.100.H-H.50 R:0.00755 P:0.00409 F:0.00531
50 ROUGE-4 Eval D0736-A.M.100.H-I.50 R:0.00368 P:0.00204 F:0.00262
50 ROUGE-4 Eval D0736-A.M.100.H-J.50 R:0.00337 P:0.00204 F:0.00254
50 ROUGE-4 Eval D0736-B.M.100.H-G.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0736-B.M.100.H-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0736-B.M.100.H-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0736-B.M.100.H-J.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0736-C.M.100.H-G.50 R:0.01316 P:0.00658 F:0.00877
50 ROUGE-4 Eval D0736-C.M.100.H-H.50 R:0.01685 P:0.00658 F:0.00946
50 ROUGE-4 Eval D0736-C.M.100.H-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0736-C.M.100.H-J.50 R:0.01172 P:0.00658 F:0.00843
50 ROUGE-4 Eval D0740-A.M.100.I-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-A.M.100.I-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-A.M.100.I-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-A.M.100.I-J.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-B.M.100.I-D.50 R:0.03010 P:0.02027 F:0.02423
50 ROUGE-4 Eval D0740-B.M.100.I-H.50 R:0.03072 P:0.02027 F:0.02442
50 ROUGE-4 Eval D0740-B.M.100.I-I.50 R:0.01689 P:0.01126 F:0.01351
50 ROUGE-4 Eval D0740-B.M.100.I-J.50 R:0.03333 P:0.02252 F:0.02688
50 ROUGE-4 Eval D0740-C.M.100.I-D.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-C.M.100.I-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-C.M.100.I-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0740-C.M.100.I-J.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-A.M.100.J-B.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-A.M.100.J-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-A.M.100.J-I.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-A.M.100.J-J.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-B.M.100.J-B.50 R:0.00660 P:0.00409 F:0.00505
50 ROUGE-4 Eval D0743-B.M.100.J-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-B.M.100.J-I.50 R:0.00651 P:0.00409 F:0.00502
50 ROUGE-4 Eval D0743-B.M.100.J-J.50 R:0.00641 P:0.00409 F:0.00499
50 ROUGE-4 Eval D0743-C.M.100.J-B.50 R:0.00980 P:0.00671 F:0.00797
50 ROUGE-4 Eval D0743-C.M.100.J-H.50 R:0.00000 P:0.00000 F:0.00000
50 ROUGE-4 Eval D0743-C.M.100.J-I.50 R:0.00987 P:0.00671 F:0.00799
50 ROUGE-4 Eval D0743-C.M.100.J-J.50 R:0.00971 P:0.00671 F:0.00794
---------------------------------------------
50 ROUGE-L Average_R: 0.25714 (95%-conf.int. 0.24975 - 0.26440)
50 ROUGE-L Average_P: 0.17374 (95%-conf.int. 0.16778 - 0.17965)
50 ROUGE-L Average_F: 0.20685 (95%-conf.int. 0.20034 - 0.21333)
.............................................
50 ROUGE-L Eval D0703-A.M.100.A-A.50 R:0.31419 P:0.24219 F:0.27353
50 ROUGE-L Eval D0703-A.M.100.A-C.50 R:0.27517 P:0.21354 F:0.24047
50 ROUGE-L Eval D0703-A.M.100.A-D.50 R:0.29210 P:0.22135 F:0.25185
50 ROUGE-L Eval D0703-A.M.100.A-J.50 R:0.29932 P:0.22917 F:0.25959
50 ROUGE-L Eval D0703-B.M.100.A-A.50 R:0.30065 P:0.19533 F:0.23681
50 ROUGE-L Eval D0703-B.M.100.A-C.50 R:0.34899 P:0.22081 F:0.27048
50 ROUGE-L Eval D0703-B.M.100.A-D.50 R:0.33221 P:0.21019 F:0.25747
50 ROUGE-L Eval D0703-B.M.100.A-J.50 R:0.32558 P:0.20807 F:0.25389
50 ROUGE-L Eval D0703-C.M.100.A-A.50 R:0.28667 P:0.19907 F:0.23497
50 ROUGE-L Eval D0703-C.M.100.A-C.50 R:0.29545 P:0.21065 F:0.24595
50 ROUGE-L Eval D0703-C.M.100.A-D.50 R:0.28477 P:0.19907 F:0.23433
50 ROUGE-L Eval D0703-C.M.100.A-J.50 R:0.31126 P:0.21759 F:0.25613
50 ROUGE-L Eval D0706-A.M.100.B-B.50 R:0.27597 P:0.20531 F:0.23545
50 ROUGE-L Eval D0706-A.M.100.B-D.50 R:0.25163 P:0.18599 F:0.21389
50 ROUGE-L Eval D0706-A.M.100.B-E.50 R:0.27597 P:0.20531 F:0.23545
50 ROUGE-L Eval D0706-A.M.100.B-I.50 R:0.25974 P:0.19324 F:0.22161
50 ROUGE-L Eval D0706-B.M.100.B-B.50 R:0.21569 P:0.13750 F:0.16794
50 ROUGE-L Eval D0706-B.M.100.B-D.50 R:0.19218 P:0.12292 F:0.14994
50 ROUGE-L Eval D0706-B.M.100.B-E.50 R:0.18506 P:0.11875 F:0.14467
50 ROUGE-L Eval D0706-B.M.100.B-I.50 R:0.21683 P:0.13958 F:0.16983
50 ROUGE-L Eval D0706-C.M.100.B-B.50 R:0.34516 P:0.25296 F:0.29195
50 ROUGE-L Eval D0706-C.M.100.B-D.50 R:0.34839 P:0.25532 F:0.29468
50 ROUGE-L Eval D0706-C.M.100.B-E.50 R:0.33333 P:0.24586 F:0.28299
50 ROUGE-L Eval D0706-C.M.100.B-I.50 R:0.32268 P:0.23877 F:0.27445
50 ROUGE-L Eval D0711-A.M.100.C-A.50 R:0.25329 P:0.17949 F:0.21010
50 ROUGE-L Eval D0711-A.M.100.C-B.50 R:0.28333 P:0.19814 F:0.23320
50 ROUGE-L Eval D0711-A.M.100.C-C.50 R:0.25667 P:0.17949 F:0.21125
50 ROUGE-L Eval D0711-A.M.100.C-F.50 R:0.28146 P:0.19814 F:0.23256
50 ROUGE-L Eval D0711-B.M.100.C-A.50 R:0.32993 P:0.23095 F:0.27171
50 ROUGE-L Eval D0711-B.M.100.C-B.50 R:0.28767 P:0.20000 F:0.23595
50 ROUGE-L Eval D0711-B.M.100.C-C.50 R:0.29530 P:0.20952 F:0.24512
50 ROUGE-L Eval D0711-B.M.100.C-F.50 R:0.27797 P:0.19524 F:0.22937
50 ROUGE-L Eval D0711-C.M.100.C-A.50 R:0.31023 P:0.21911 F:0.25683
50 ROUGE-L Eval D0711-C.M.100.C-B.50 R:0.30034 P:0.20513 F:0.24377
50 ROUGE-L Eval D0711-C.M.100.C-C.50 R:0.30405 P:0.20979 F:0.24827
50 ROUGE-L Eval D0711-C.M.100.C-F.50 R:0.31757 P:0.21911 F:0.25931
50 ROUGE-L Eval D0716-A.M.100.D-C.50 R:0.20328 P:0.12602 F:0.15559
50 ROUGE-L Eval D0716-A.M.100.D-D.50 R:0.22000 P:0.13415 F:0.16667
50 ROUGE-L Eval D0716-A.M.100.D-E.50 R:0.20598 P:0.12602 F:0.15637
50 ROUGE-L Eval D0716-A.M.100.D-F.50 R:0.20462 P:0.12602 F:0.15598
50 ROUGE-L Eval D0716-B.M.100.D-C.50 R:0.17763 P:0.11538 F:0.13989
50 ROUGE-L Eval D0716-B.M.100.D-D.50 R:0.19128 P:0.12179 F:0.14882
50 ROUGE-L Eval D0716-B.M.100.D-E.50 R:0.18605 P:0.11966 F:0.14565
50 ROUGE-L Eval D0716-B.M.100.D-F.50 R:0.18333 P:0.11752 F:0.14323
50 ROUGE-L Eval D0716-C.M.100.D-C.50 R:0.21498 P:0.14379 F:0.17232
50 ROUGE-L Eval D0716-C.M.100.D-D.50 R:0.26087 P:0.16993 F:0.20580
50 ROUGE-L Eval D0716-C.M.100.D-E.50 R:0.27393 P:0.18083 F:0.21785
50 ROUGE-L Eval D0716-C.M.100.D-F.50 R:0.25333 P:0.16558 F:0.20026
50 ROUGE-L Eval D0721-A.M.100.E-B.50 R:0.25000 P:0.15432 F:0.19084
50 ROUGE-L Eval D0721-A.M.100.E-C.50 R:0.23701 P:0.15021 F:0.18388
50 ROUGE-L Eval D0721-A.M.100.E-E.50 R:0.26299 P:0.16667 F:0.20403
50 ROUGE-L Eval D0721-A.M.100.E-G.50 R:0.23567 P:0.15226 F:0.18500
50 ROUGE-L Eval D0721-B.M.100.E-B.50 R:0.25081 P:0.17460 F:0.20588
50 ROUGE-L Eval D0721-B.M.100.E-C.50 R:0.28025 P:0.19955 F:0.23311
50 ROUGE-L Eval D0721-B.M.100.E-E.50 R:0.22951 P:0.15873 F:0.18767
50 ROUGE-L Eval D0721-B.M.100.E-G.50 R:0.25806 P:0.18141 F:0.21305
50 ROUGE-L Eval D0721-C.M.100.E-B.50 R:0.27213 P:0.19904 F:0.22992
50 ROUGE-L Eval D0721-C.M.100.E-C.50 R:0.21782 P:0.15827 F:0.18333
50 ROUGE-L Eval D0721-C.M.100.E-E.50 R:0.23667 P:0.17026 F:0.19805
50 ROUGE-L Eval D0721-C.M.100.E-G.50 R:0.22150 P:0.16307 F:0.18785
50 ROUGE-L Eval D0726-A.M.100.F-A.50 R:0.22259 P:0.13958 F:0.17157
50 ROUGE-L Eval D0726-A.M.100.F-E.50 R:0.21333 P:0.13333 F:0.16410
50 ROUGE-L Eval D0726-A.M.100.F-F.50 R:0.22259 P:0.13958 F:0.17157
50 ROUGE-L Eval D0726-A.M.100.F-G.50 R:0.21927 P:0.13750 F:0.16901
50 ROUGE-L Eval D0726-B.M.100.F-A.50 R:0.18301 P:0.13527 F:0.15556
50 ROUGE-L Eval D0726-B.M.100.F-E.50 R:0.18937 P:0.13768 F:0.15944
50 ROUGE-L Eval D0726-B.M.100.F-F.50 R:0.17940 P:0.13043 F:0.15105
50 ROUGE-L Eval D0726-B.M.100.F-G.50 R:0.20066 P:0.14734 F:0.16992
50 ROUGE-L Eval D0726-C.M.100.F-A.50 R:0.22333 P:0.15618 F:0.18381
50 ROUGE-L Eval D0726-C.M.100.F-E.50 R:0.23569 P:0.16317 F:0.19284
50 ROUGE-L Eval D0726-C.M.100.F-F.50 R:0.22034 P:0.15152 F:0.17956
50 ROUGE-L Eval D0726-C.M.100.F-G.50 R:0.20328 P:0.14452 F:0.16894
50 ROUGE-L Eval D0727-A.M.100.G-A.50 R:0.26246 P:0.18287 F:0.21555
50 ROUGE-L Eval D0727-A.M.100.G-F.50 R:0.24671 P:0.17361 F:0.20380
50 ROUGE-L Eval D0727-A.M.100.G-G.50 R:0.25163 P:0.17824 F:0.20867
50 ROUGE-L Eval D0727-A.M.100.G-H.50 R:0.24671 P:0.17361 F:0.20380
50 ROUGE-L Eval D0727-B.M.100.G-A.50 R:0.29210 P:0.19406 F:0.23319
50 ROUGE-L Eval D0727-B.M.100.G-F.50 R:0.27597 P:0.19406 F:0.22788
50 ROUGE-L Eval D0727-B.M.100.G-G.50 R:0.28028 P:0.18493 F:0.22283
50 ROUGE-L Eval D0727-B.M.100.G-H.50 R:0.27148 P:0.18037 F:0.21674
50 ROUGE-L Eval D0727-C.M.100.G-A.50 R:0.28990 P:0.21190 F:0.24484
50 ROUGE-L Eval D0727-C.M.100.G-F.50 R:0.29966 P:0.21190 F:0.24825
50 ROUGE-L Eval D0727-C.M.100.G-G.50 R:0.26733 P:0.19286 F:0.22407
50 ROUGE-L Eval D0727-C.M.100.G-H.50 R:0.30068 P:0.21190 F:0.24860
50 ROUGE-L Eval D0736-A.M.100.H-G.50 R:0.29391 P:0.16466 F:0.21107
50 ROUGE-L Eval D0736-A.M.100.H-H.50 R:0.25182 P:0.13855 F:0.17875
50 ROUGE-L Eval D0736-A.M.100.H-I.50 R:0.27758 P:0.15663 F:0.20026
50 ROUGE-L Eval D0736-A.M.100.H-J.50 R:0.26144 P:0.16064 F:0.19900
50 ROUGE-L Eval D0736-B.M.100.H-G.50 R:0.18321 P:0.10596 F:0.13427
50 ROUGE-L Eval D0736-B.M.100.H-H.50 R:0.18182 P:0.09713 F:0.12662
50 ROUGE-L Eval D0736-B.M.100.H-I.50 R:0.18828 P:0.09934 F:0.13006
50 ROUGE-L Eval D0736-B.M.100.H-J.50 R:0.18182 P:0.11479 F:0.14073
50 ROUGE-L Eval D0736-C.M.100.H-G.50 R:0.27426 P:0.13978 F:0.18518
50 ROUGE-L Eval D0736-C.M.100.H-H.50 R:0.31016 P:0.12473 F:0.17791
50 ROUGE-L Eval D0736-C.M.100.H-I.50 R:0.29412 P:0.11828 F:0.16871
50 ROUGE-L Eval D0736-C.M.100.H-J.50 R:0.27925 P:0.15914 F:0.20274
50 ROUGE-L Eval D0740-A.M.100.I-D.50 R:0.30033 P:0.20088 F:0.24074
50 ROUGE-L Eval D0740-A.M.100.I-H.50 R:0.29739 P:0.20088 F:0.23979
50 ROUGE-L Eval D0740-A.M.100.I-I.50 R:0.26623 P:0.18102 F:0.21551
50 ROUGE-L Eval D0740-A.M.100.I-J.50 R:0.28065 P:0.19205 F:0.22805
50 ROUGE-L Eval D0740-B.M.100.I-D.50 R:0.31169 P:0.21192 F:0.25230
50 ROUGE-L Eval D0740-B.M.100.I-H.50 R:0.28477 P:0.18985 F:0.22782
50 ROUGE-L Eval D0740-B.M.100.I-I.50 R:0.28525 P:0.19205 F:0.22955
50 ROUGE-L Eval D0740-B.M.100.I-J.50 R:0.27508 P:0.18764 F:0.22310
50 ROUGE-L Eval D0740-C.M.100.I-D.50 R:0.23003 P:0.18321 F:0.20397
50 ROUGE-L Eval D0740-C.M.100.I-H.50 R:0.21865 P:0.17303 F:0.19318
50 ROUGE-L Eval D0740-C.M.100.I-I.50 R:0.21406 P:0.17048 F:0.18980
50 ROUGE-L Eval D0740-C.M.100.I-J.50 R:0.22930 P:0.18321 F:0.20368
50 ROUGE-L Eval D0743-A.M.100.J-B.50 R:0.20317 P:0.13943 F:0.16537
50 ROUGE-L Eval D0743-A.M.100.J-H.50 R:0.19136 P:0.13508 F:0.15837
50 ROUGE-L Eval D0743-A.M.100.J-I.50 R:0.19062 P:0.13290 F:0.15661
50 ROUGE-L Eval D0743-A.M.100.J-J.50 R:0.18154 P:0.12854 F:0.15051
50 ROUGE-L Eval D0743-B.M.100.J-B.50 R:0.28526 P:0.17871 F:0.21975
50 ROUGE-L Eval D0743-B.M.100.J-H.50 R:0.25237 P:0.16064 F:0.19632
50 ROUGE-L Eval D0743-B.M.100.J-I.50 R:0.27215 P:0.17269 F:0.21130
50 ROUGE-L Eval D0743-B.M.100.J-J.50 R:0.27103 P:0.17470 F:0.21246
50 ROUGE-L Eval D0743-C.M.100.J-B.50 R:0.26984 P:0.18640 F:0.22049
50 ROUGE-L Eval D0743-C.M.100.J-H.50 R:0.25478 P:0.17544 F:0.20779
50 ROUGE-L Eval D0743-C.M.100.J-I.50 R:0.29073 P:0.19956 F:0.23667
50 ROUGE-L Eval D0743-C.M.100.J-J.50 R:0.25157 P:0.17544 F:0.20672
---------------------------------------------
50 ROUGE-W-1.2 Average_R: 0.09047 (95%-conf.int. 0.08779 - 0.09313)
50 ROUGE-W-1.2 Average_P: 0.11062 (95%-conf.int. 0.10687 - 0.11424)
50 ROUGE-W-1.2 Average_F: 0.09922 (95%-conf.int. 0.09629 - 0.10219)
.............................................
50 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.50 R:0.11326 P:0.15721 F:0.13166
50 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.50 R:0.09565 P:0.13491 F:0.11194
50 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.50 R:0.10468 P:0.14625 F:0.12202
50 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.50 R:0.10982 P:0.14383 F:0.12454
50 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.50 R:0.10382 P:0.12506 F:0.11345
50 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.50 R:0.11675 P:0.13978 F:0.12723
50 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.50 R:0.11140 P:0.13221 F:0.12092
50 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.50 R:0.11326 P:0.13425 F:0.12286
50 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.50 R:0.09626 P:0.12429 F:0.10849
50 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.50 R:0.09887 P:0.13309 F:0.11346
50 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.50 R:0.09368 P:0.12430 F:0.10684
50 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.50 R:0.10728 P:0.13507 F:0.11958
50 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.50 R:0.09939 P:0.13269 F:0.11365
50 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.50 R:0.08668 P:0.11756 F:0.09979
50 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.50 R:0.09749 P:0.13153 F:0.11198
50 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.50 R:0.09119 P:0.12572 F:0.10571
50 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.50 R:0.08083 P:0.08924 F:0.08483
50 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.50 R:0.07112 P:0.08022 F:0.07540
50 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.50 R:0.06644 P:0.07525 F:0.07057
50 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.50 R:0.07704 P:0.08969 F:0.08289
50 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.50 R:0.11626 P:0.14543 F:0.12922
50 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.50 R:0.11795 P:0.14880 F:0.13159
50 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.50 R:0.11440 P:0.14294 F:0.12709
50 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.50 R:0.11604 P:0.14912 F:0.13052
50 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.50 R:0.09048 P:0.11559 F:0.10151
50 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.50 R:0.10013 P:0.12682 F:0.11191
50 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.50 R:0.09274 P:0.11646 F:0.10326
50 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.50 R:0.10062 P:0.12850 F:0.11286
50 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.50 R:0.11774 P:0.14705 F:0.13077
50 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.50 R:0.10092 P:0.13149 F:0.11419
50 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.50 R:0.10048 P:0.13392 F:0.11481
50 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.50 R:0.09629 P:0.12561 F:0.10901
50 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.50 R:0.09459 P:0.12491 F:0.10766
50 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.50 R:0.09133 P:0.11664 F:0.10244
50 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.50 R:0.09837 P:0.12887 F:0.11157
50 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.50 R:0.09826 P:0.13067 F:0.11217
50 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.50 R:0.06820 P:0.07725 F:0.07244
50 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.50 R:0.07065 P:0.08208 F:0.07594
50 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.50 R:0.06903 P:0.07887 F:0.07362
50 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.50 R:0.06724 P:0.07875 F:0.07254
50 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.50 R:0.06727 P:0.07623 F:0.07147
50 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.50 R:0.07002 P:0.07979 F:0.07459
50 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.50 R:0.06833 P:0.07824 F:0.07295
50 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.50 R:0.06707 P:0.07610 F:0.07130
50 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.50 R:0.06941 P:0.08653 F:0.07703
50 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.50 R:0.09104 P:0.11501 F:0.10163
50 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.50 R:0.09118 P:0.11664 F:0.10235
50 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.50 R:0.08502 P:0.10810 F:0.09518
50 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.50 R:0.08770 P:0.09516 F:0.09128
50 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.50 R:0.08260 P:0.09287 F:0.08743
50 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.50 R:0.08954 P:0.10194 F:0.09534
50 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.50 R:0.08378 P:0.09486 F:0.08898
50 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.50 R:0.08791 P:0.11831 F:0.10087
50 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.50 R:0.10155 P:0.13589 F:0.11624
50 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.50 R:0.07767 P:0.10543 F:0.08945
50 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.50 R:0.09035 P:0.12676 F:0.10550
50 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.50 R:0.09283 P:0.12496 F:0.10652
50 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.50 R:0.07440 P:0.10171 F:0.08594
50 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.50 R:0.08176 P:0.10978 F:0.09372
50 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.50 R:0.07652 P:0.10535 F:0.08865
50 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.50 R:0.07879 P:0.08755 F:0.08294
50 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.50 R:0.07538 P:0.08254 F:0.07880
50 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.50 R:0.07839 P:0.08755 F:0.08272
50 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.50 R:0.07650 P:0.08683 F:0.08134
50 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.50 R:0.06585 P:0.08562 F:0.07444
50 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.50 R:0.06644 P:0.08721 F:0.07542
50 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.50 R:0.06295 P:0.08315 F:0.07165
50 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.50 R:0.07026 P:0.09315 F:0.08010
50 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.50 R:0.07636 P:0.09377 F:0.08417
50 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.50 R:0.08078 P:0.09871 F:0.08885
50 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.50 R:0.07614 P:0.09377 F:0.08404
50 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.50 R:0.06723 P:0.08559 F:0.07531
50 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.50 R:0.09036 P:0.11082 F:0.09955
50 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.50 R:0.08267 P:0.10619 F:0.09297
50 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.50 R:0.08695 P:0.10908 F:0.09677
50 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.50 R:0.08379 P:0.10570 F:0.09348
50 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.50 R:0.10456 P:0.12189 F:0.11256
50 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.50 R:0.09463 P:0.11954 F:0.10564
50 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.50 R:0.09946 P:0.11754 F:0.10775
50 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.50 R:0.09634 P:0.11329 F:0.10413
50 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.50 R:0.10814 P:0.14215 F:0.12283
50 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.50 R:0.10815 P:0.14134 F:0.12254
50 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.50 R:0.09101 P:0.12086 F:0.10383
50 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.50 R:0.11160 P:0.14156 F:0.12481
50 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.50 R:0.10654 P:0.10570 F:0.10612
50 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.50 R:0.09543 P:0.09234 F:0.09386
50 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.50 R:0.10016 P:0.10098 F:0.10057
50 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.50 R:0.09355 P:0.10248 F:0.09781
50 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.50 R:0.06443 P:0.06898 F:0.06663
50 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.50 R:0.06615 P:0.06538 F:0.06576
50 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.50 R:0.06758 P:0.06585 F:0.06670
50 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.50 R:0.06346 P:0.07407 F:0.06836
50 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.50 R:0.10544 P:0.09763 F:0.10138
50 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.50 R:0.11981 P:0.09006 F:0.10283
50 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.50 R:0.11200 P:0.08217 F:0.09479
50 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.50 R:0.10283 P:0.10455 F:0.10368
50 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.50 R:0.10229 P:0.12585 F:0.11285
50 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.50 R:0.10556 P:0.12864 F:0.11596
50 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.50 R:0.09267 P:0.11655 F:0.10325
50 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.50 R:0.09649 P:0.12130 F:0.10748
50 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.50 R:0.11207 P:0.14000 F:0.12449
50 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.50 R:0.10738 P:0.12739 F:0.11653
50 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.50 R:0.10088 P:0.12763 F:0.11269
50 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.50 R:0.10229 P:0.12474 F:0.11241
50 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.50 R:0.07461 P:0.11467 F:0.09040
50 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.50 R:0.07502 P:0.11079 F:0.08946
50 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.50 R:0.07045 P:0.10973 F:0.08581
50 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.50 R:0.07606 P:0.11646 F:0.09202
50 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.50 R:0.07531 P:0.09010 F:0.08204
50 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.50 R:0.07035 P:0.08578 F:0.07730
50 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.50 R:0.06857 P:0.08482 F:0.07583
50 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.50 R:0.06763 P:0.08312 F:0.07458
50 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.50 R:0.10545 P:0.11064 F:0.10798
50 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.50 R:0.09435 P:0.09960 F:0.09690
50 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.50 R:0.10192 P:0.10899 F:0.10534
50 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.50 R:0.10462 P:0.11087 F:0.10765
50 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.50 R:0.10391 P:0.12565 F:0.11375
50 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.50 R:0.09757 P:0.11220 F:0.10437
50 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.50 R:0.11028 P:0.13489 F:0.12135
50 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.50 R:0.09876 P:0.11592 F:0.10665
---------------------------------------------
50 ROUGE-SU4 Average_R: 0.09205 (95%-conf.int. 0.08779 - 0.09658)
50 ROUGE-SU4 Average_P: 0.06169 (95%-conf.int. 0.05866 - 0.06496)
50 ROUGE-SU4 Average_F: 0.07366 (95%-conf.int. 0.07020 - 0.07741)
.............................................
50 ROUGE-SU4 Eval D0703-A.M.100.A-A.50 R:0.13889 P:0.10638 F:0.12048
50 ROUGE-SU4 Eval D0703-A.M.100.A-C.50 R:0.11207 P:0.08644 F:0.09760
50 ROUGE-SU4 Eval D0703-A.M.100.A-D.50 R:0.13251 P:0.09973 F:0.11381
50 ROUGE-SU4 Eval D0703-A.M.100.A-J.50 R:0.11189 P:0.08511 F:0.09668
50 ROUGE-SU4 Eval D0703-B.M.100.A-A.50 R:0.12360 P:0.07955 F:0.09680
50 ROUGE-SU4 Eval D0703-B.M.100.A-C.50 R:0.15460 P:0.09683 F:0.11908
50 ROUGE-SU4 Eval D0703-B.M.100.A-D.50 R:0.13851 P:0.08675 F:0.10668
50 ROUGE-SU4 Eval D0703-B.M.100.A-J.50 R:0.13879 P:0.08783 F:0.10758
50 ROUGE-SU4 Eval D0703-C.M.100.A-A.50 R:0.11416 P:0.07862 F:0.09311
50 ROUGE-SU4 Eval D0703-C.M.100.A-C.50 R:0.11500 P:0.08137 F:0.09531
50 ROUGE-SU4 Eval D0703-C.M.100.A-D.50 R:0.10488 P:0.07272 F:0.08589
50 ROUGE-SU4 Eval D0703-C.M.100.A-J.50 R:0.12018 P:0.08333 F:0.09842
50 ROUGE-SU4 Eval D0706-A.M.100.B-B.50 R:0.10556 P:0.07800 F:0.08971
50 ROUGE-SU4 Eval D0706-A.M.100.B-D.50 R:0.08949 P:0.06568 F:0.07576
50 ROUGE-SU4 Eval D0706-A.M.100.B-E.50 R:0.10667 P:0.07882 F:0.09065
50 ROUGE-SU4 Eval D0706-A.M.100.B-I.50 R:0.09056 P:0.06691 F:0.07696
50 ROUGE-SU4 Eval D0706-B.M.100.B-B.50 R:0.07215 P:0.04555 F:0.05584
50 ROUGE-SU4 Eval D0706-B.M.100.B-D.50 R:0.06800 P:0.04308 F:0.05274
50 ROUGE-SU4 Eval D0706-B.M.100.B-E.50 R:0.05556 P:0.03531 F:0.04318
50 ROUGE-SU4 Eval D0706-B.M.100.B-I.50 R:0.07807 P:0.04979 F:0.06080
50 ROUGE-SU4 Eval D0706-C.M.100.B-B.50 R:0.13411 P:0.09759 F:0.11297
50 ROUGE-SU4 Eval D0706-C.M.100.B-D.50 R:0.13135 P:0.09558 F:0.11065
50 ROUGE-SU4 Eval D0706-C.M.100.B-E.50 R:0.13213 P:0.09679 F:0.11173
50 ROUGE-SU4 Eval D0706-C.M.100.B-I.50 R:0.12022 P:0.08835 F:0.10185
50 ROUGE-SU4 Eval D0711-A.M.100.C-A.50 R:0.08164 P:0.05740 F:0.06741
50 ROUGE-SU4 Eval D0711-A.M.100.C-B.50 R:0.09418 P:0.06532 F:0.07714
50 ROUGE-SU4 Eval D0711-A.M.100.C-C.50 R:0.08961 P:0.06215 F:0.07340
50 ROUGE-SU4 Eval D0711-A.M.100.C-F.50 R:0.09580 P:0.06690 F:0.07878
50 ROUGE-SU4 Eval D0711-B.M.100.C-A.50 R:0.14044 P:0.09749 F:0.11509
50 ROUGE-SU4 Eval D0711-B.M.100.C-B.50 R:0.12676 P:0.08738 F:0.10345
50 ROUGE-SU4 Eval D0711-B.M.100.C-C.50 R:0.11667 P:0.08212 F:0.09639
50 ROUGE-SU4 Eval D0711-B.M.100.C-F.50 R:0.10801 P:0.07524 F:0.08869
50 ROUGE-SU4 Eval D0711-C.M.100.C-A.50 R:0.11073 P:0.07759 F:0.09124
50 ROUGE-SU4 Eval D0711-C.M.100.C-B.50 R:0.09766 P:0.06611 F:0.07885
50 ROUGE-SU4 Eval D0711-C.M.100.C-C.50 R:0.11111 P:0.07601 F:0.09027
50 ROUGE-SU4 Eval D0711-C.M.100.C-F.50 R:0.11806 P:0.08076 F:0.09591
50 ROUGE-SU4 Eval D0716-A.M.100.D-C.50 R:0.05499 P:0.03375 F:0.04183
50 ROUGE-SU4 Eval D0716-A.M.100.D-D.50 R:0.06050 P:0.03650 F:0.04553
50 ROUGE-SU4 Eval D0716-A.M.100.D-E.50 R:0.05688 P:0.03444 F:0.04290
50 ROUGE-SU4 Eval D0716-A.M.100.D-F.50 R:0.05537 P:0.03375 F:0.04194
50 ROUGE-SU4 Eval D0716-B.M.100.D-C.50 R:0.05180 P:0.03333 F:0.04056
50 ROUGE-SU4 Eval D0716-B.M.100.D-D.50 R:0.05747 P:0.03623 F:0.04444
50 ROUGE-SU4 Eval D0716-B.M.100.D-E.50 R:0.05404 P:0.03442 F:0.04205
50 ROUGE-SU4 Eval D0716-B.M.100.D-F.50 R:0.05708 P:0.03623 F:0.04433
50 ROUGE-SU4 Eval D0716-C.M.100.D-C.50 R:0.06800 P:0.04508 F:0.05422
50 ROUGE-SU4 Eval D0716-C.M.100.D-D.50 R:0.11627 P:0.07502 F:0.09120
50 ROUGE-SU4 Eval D0716-C.M.100.D-E.50 R:0.11525 P:0.07539 F:0.09115
50 ROUGE-SU4 Eval D0716-C.M.100.D-F.50 R:0.11758 P:0.07613 F:0.09242
50 ROUGE-SU4 Eval D0721-A.M.100.E-B.50 R:0.08505 P:0.05195 F:0.06450
50 ROUGE-SU4 Eval D0721-A.M.100.E-C.50 R:0.07889 P:0.04951 F:0.06084
50 ROUGE-SU4 Eval D0721-A.M.100.E-E.50 R:0.08667 P:0.05439 F:0.06684
50 ROUGE-SU4 Eval D0721-A.M.100.E-G.50 R:0.07680 P:0.04916 F:0.05995
50 ROUGE-SU4 Eval D0721-B.M.100.E-B.50 R:0.10201 P:0.07044 F:0.08334
50 ROUGE-SU4 Eval D0721-B.M.100.E-C.50 R:0.12364 P:0.08737 F:0.10239
50 ROUGE-SU4 Eval D0721-B.M.100.E-E.50 R:0.08418 P:0.05774 F:0.06850
50 ROUGE-SU4 Eval D0721-B.M.100.E-G.50 R:0.11645 P:0.08122 F:0.09570
50 ROUGE-SU4 Eval D0721-C.M.100.E-B.50 R:0.08979 P:0.06520 F:0.07554
50 ROUGE-SU4 Eval D0721-C.M.100.E-C.50 R:0.06158 P:0.04442 F:0.05161
50 ROUGE-SU4 Eval D0721-C.M.100.E-E.50 R:0.08162 P:0.05827 F:0.06800
50 ROUGE-SU4 Eval D0721-C.M.100.E-G.50 R:0.07302 P:0.05338 F:0.06167
50 ROUGE-SU4 Eval D0726-A.M.100.F-A.50 R:0.06428 P:0.03990 F:0.04924
50 ROUGE-SU4 Eval D0726-A.M.100.F-E.50 R:0.06107 P:0.03778 F:0.04668
50 ROUGE-SU4 Eval D0726-A.M.100.F-F.50 R:0.06542 P:0.04061 F:0.05011
50 ROUGE-SU4 Eval D0726-A.M.100.F-G.50 R:0.06712 P:0.04167 F:0.05142
50 ROUGE-SU4 Eval D0726-B.M.100.F-A.50 R:0.05369 P:0.03941 F:0.04545
50 ROUGE-SU4 Eval D0726-B.M.100.F-E.50 R:0.05745 P:0.04146 F:0.04816
50 ROUGE-SU4 Eval D0726-B.M.100.F-F.50 R:0.05461 P:0.03941 F:0.04578
50 ROUGE-SU4 Eval D0726-B.M.100.F-G.50 R:0.06306 P:0.04598 F:0.05318
50 ROUGE-SU4 Eval D0726-C.M.100.F-A.50 R:0.08105 P:0.05622 F:0.06639
50 ROUGE-SU4 Eval D0726-C.M.100.F-E.50 R:0.08651 P:0.05938 F:0.07042
50 ROUGE-SU4 Eval D0726-C.M.100.F-F.50 R:0.08072 P:0.05503 F:0.06544
50 ROUGE-SU4 Eval D0726-C.M.100.F-G.50 R:0.06622 P:0.04671 F:0.05478
50 ROUGE-SU4 Eval D0727-A.M.100.G-A.50 R:0.08476 P:0.05857 F:0.06927
50 ROUGE-SU4 Eval D0727-A.M.100.G-F.50 R:0.07770 P:0.05425 F:0.06389
50 ROUGE-SU4 Eval D0727-A.M.100.G-G.50 R:0.07662 P:0.05385 F:0.06325
50 ROUGE-SU4 Eval D0727-A.M.100.G-H.50 R:0.07714 P:0.05385 F:0.06342
50 ROUGE-SU4 Eval D0727-B.M.100.G-A.50 R:0.10777 P:0.07093 F:0.08555
50 ROUGE-SU4 Eval D0727-B.M.100.G-F.50 R:0.10556 P:0.07364 F:0.08676
50 ROUGE-SU4 Eval D0727-B.M.100.G-G.50 R:0.10320 P:0.06744 F:0.08157
50 ROUGE-SU4 Eval D0727-B.M.100.G-H.50 R:0.09658 P:0.06357 F:0.07667
50 ROUGE-SU4 Eval D0727-C.M.100.G-A.50 R:0.12096 P:0.08778 F:0.10173
50 ROUGE-SU4 Eval D0727-C.M.100.G-F.50 R:0.11938 P:0.08374 F:0.09843
50 ROUGE-SU4 Eval D0727-C.M.100.G-G.50 R:0.09266 P:0.06634 F:0.07732
50 ROUGE-SU4 Eval D0727-C.M.100.G-H.50 R:0.12326 P:0.08617 F:0.10143
50 ROUGE-SU4 Eval D0736-A.M.100.H-G.50 R:0.08979 P:0.04966 F:0.06395
50 ROUGE-SU4 Eval D0736-A.M.100.H-H.50 R:0.07957 P:0.04320 F:0.05600
50 ROUGE-SU4 Eval D0736-A.M.100.H-I.50 R:0.08730 P:0.04864 F:0.06247
50 ROUGE-SU4 Eval D0736-A.M.100.H-J.50 R:0.07942 P:0.04830 F:0.06007
50 ROUGE-SU4 Eval D0736-B.M.100.H-G.50 R:0.05249 P:0.02996 F:0.03815
50 ROUGE-SU4 Eval D0736-B.M.100.H-H.50 R:0.05413 P:0.02846 F:0.03731
50 ROUGE-SU4 Eval D0736-B.M.100.H-I.50 R:0.05628 P:0.02921 F:0.03846
50 ROUGE-SU4 Eval D0736-B.M.100.H-J.50 R:0.05396 P:0.03371 F:0.04150
50 ROUGE-SU4 Eval D0736-C.M.100.H-G.50 R:0.11936 P:0.05981 F:0.07969
50 ROUGE-SU4 Eval D0736-C.M.100.H-H.50 R:0.13501 P:0.05288 F:0.07599
50 ROUGE-SU4 Eval D0736-C.M.100.H-I.50 R:0.12942 P:0.05069 F:0.07285
50 ROUGE-SU4 Eval D0736-C.M.100.H-J.50 R:0.10246 P:0.05762 F:0.07376
50 ROUGE-SU4 Eval D0740-A.M.100.I-D.50 R:0.10339 P:0.06854 F:0.08243
50 ROUGE-SU4 Eval D0740-A.M.100.I-H.50 R:0.10011 P:0.06704 F:0.08030
50 ROUGE-SU4 Eval D0740-A.M.100.I-I.50 R:0.09000 P:0.06067 F:0.07248
50 ROUGE-SU4 Eval D0740-A.M.100.I-J.50 R:0.09658 P:0.06554 F:0.07809
50 ROUGE-SU4 Eval D0740-B.M.100.I-D.50 R:0.11556 P:0.07790 F:0.09306
50 ROUGE-SU4 Eval D0740-B.M.100.I-H.50 R:0.10658 P:0.07041 F:0.08480
50 ROUGE-SU4 Eval D0740-B.M.100.I-I.50 R:0.10269 P:0.06854 F:0.08221
50 ROUGE-SU4 Eval D0740-B.M.100.I-J.50 R:0.10797 P:0.07303 F:0.08713
50 ROUGE-SU4 Eval D0740-C.M.100.I-D.50 R:0.06940 P:0.05498 F:0.06135
50 ROUGE-SU4 Eval D0740-C.M.100.I-H.50 R:0.06601 P:0.05195 F:0.05814
50 ROUGE-SU4 Eval D0740-C.M.100.I-I.50 R:0.06721 P:0.05325 F:0.05942
50 ROUGE-SU4 Eval D0740-C.M.100.I-J.50 R:0.07298 P:0.05801 F:0.06464
50 ROUGE-SU4 Eval D0743-A.M.100.J-B.50 R:0.07058 P:0.04804 F:0.05717
50 ROUGE-SU4 Eval D0743-A.M.100.J-H.50 R:0.06118 P:0.04287 F:0.05041
50 ROUGE-SU4 Eval D0743-A.M.100.J-I.50 R:0.05929 P:0.04102 F:0.04849
50 ROUGE-SU4 Eval D0743-A.M.100.J-J.50 R:0.05836 P:0.04102 F:0.04818
50 ROUGE-SU4 Eval D0743-B.M.100.J-B.50 R:0.09156 P:0.05680 F:0.07011
50 ROUGE-SU4 Eval D0743-B.M.100.J-H.50 R:0.07443 P:0.04694 F:0.05757
50 ROUGE-SU4 Eval D0743-B.M.100.J-I.50 R:0.08712 P:0.05476 F:0.06725
50 ROUGE-SU4 Eval D0743-B.M.100.J-J.50 R:0.08573 P:0.05476 F:0.06683
50 ROUGE-SU4 Eval D0743-C.M.100.J-B.50 R:0.10641 P:0.07292 F:0.08654
50 ROUGE-SU4 Eval D0743-C.M.100.J-H.50 R:0.07843 P:0.05357 F:0.06366
50 ROUGE-SU4 Eval D0743-C.M.100.J-I.50 R:0.11148 P:0.07589 F:0.09030
50 ROUGE-SU4 Eval D0743-C.M.100.J-J.50 R:0.09301 P:0.06436 F:0.07608
---------------------------------------------
51 ROUGE-1 Average_R: 0.34432 (95%-conf.int. 0.33576 - 0.35346)
51 ROUGE-1 Average_P: 0.22042 (95%-conf.int. 0.21427 - 0.22657)
51 ROUGE-1 Average_F: 0.26818 (95%-conf.int. 0.26116 - 0.27524)
.............................................
51 ROUGE-1 Eval D0703-A.M.100.A-A.51 R:0.35135 P:0.21941 F:0.27013
51 ROUGE-1 Eval D0703-A.M.100.A-C.51 R:0.29195 P:0.18354 F:0.22539
51 ROUGE-1 Eval D0703-A.M.100.A-D.51 R:0.32302 P:0.19831 F:0.24575
51 ROUGE-1 Eval D0703-A.M.100.A-J.51 R:0.32653 P:0.20253 F:0.25000
51 ROUGE-1 Eval D0703-B.M.100.A-A.51 R:0.37255 P:0.26761 F:0.31148
51 ROUGE-1 Eval D0703-B.M.100.A-C.51 R:0.36577 P:0.25587 F:0.30111
51 ROUGE-1 Eval D0703-B.M.100.A-D.51 R:0.34564 P:0.24178 F:0.28453
51 ROUGE-1 Eval D0703-B.M.100.A-J.51 R:0.34219 P:0.24178 F:0.28335
51 ROUGE-1 Eval D0703-C.M.100.A-A.51 R:0.31000 P:0.21528 F:0.25410
51 ROUGE-1 Eval D0703-C.M.100.A-C.51 R:0.31169 P:0.22222 F:0.25946
51 ROUGE-1 Eval D0703-C.M.100.A-D.51 R:0.31788 P:0.22222 F:0.26158
51 ROUGE-1 Eval D0703-C.M.100.A-J.51 R:0.31788 P:0.22222 F:0.26158
51 ROUGE-1 Eval D0706-A.M.100.B-B.51 R:0.39935 P:0.25625 F:0.31218
51 ROUGE-1 Eval D0706-A.M.100.B-D.51 R:0.36928 P:0.23542 F:0.28753
51 ROUGE-1 Eval D0706-A.M.100.B-E.51 R:0.37987 P:0.24375 F:0.29695
51 ROUGE-1 Eval D0706-A.M.100.B-I.51 R:0.37338 P:0.23958 F:0.29188
51 ROUGE-1 Eval D0706-B.M.100.B-B.51 R:0.28431 P:0.18471 F:0.22393
51 ROUGE-1 Eval D0706-B.M.100.B-D.51 R:0.27687 P:0.18047 F:0.21851
51 ROUGE-1 Eval D0706-B.M.100.B-E.51 R:0.25325 P:0.16561 F:0.20026
51 ROUGE-1 Eval D0706-B.M.100.B-I.51 R:0.31715 P:0.20807 F:0.25128
51 ROUGE-1 Eval D0706-C.M.100.B-B.51 R:0.32903 P:0.20359 F:0.25154
51 ROUGE-1 Eval D0706-C.M.100.B-D.51 R:0.32903 P:0.20359 F:0.25154
51 ROUGE-1 Eval D0706-C.M.100.B-E.51 R:0.33654 P:0.20958 F:0.25830
51 ROUGE-1 Eval D0706-C.M.100.B-I.51 R:0.35463 P:0.22156 F:0.27273
51 ROUGE-1 Eval D0711-A.M.100.C-A.51 R:0.45395 P:0.30464 F:0.36460
51 ROUGE-1 Eval D0711-A.M.100.C-B.51 R:0.49000 P:0.32450 F:0.39044
51 ROUGE-1 Eval D0711-A.M.100.C-C.51 R:0.46667 P:0.30905 F:0.37185
51 ROUGE-1 Eval D0711-A.M.100.C-F.51 R:0.47020 P:0.31347 F:0.37616
51 ROUGE-1 Eval D0711-B.M.100.C-A.51 R:0.34354 P:0.22149 F:0.26933
51 ROUGE-1 Eval D0711-B.M.100.C-B.51 R:0.35274 P:0.22588 F:0.27540
51 ROUGE-1 Eval D0711-B.M.100.C-C.51 R:0.34564 P:0.22588 F:0.27321
51 ROUGE-1 Eval D0711-B.M.100.C-F.51 R:0.33220 P:0.21491 F:0.26098
51 ROUGE-1 Eval D0711-C.M.100.C-A.51 R:0.36304 P:0.24283 F:0.29101
51 ROUGE-1 Eval D0711-C.M.100.C-B.51 R:0.33106 P:0.21413 F:0.26006
51 ROUGE-1 Eval D0711-C.M.100.C-C.51 R:0.33108 P:0.21634 F:0.26169
51 ROUGE-1 Eval D0711-C.M.100.C-F.51 R:0.32770 P:0.21413 F:0.25901
51 ROUGE-1 Eval D0716-A.M.100.D-C.51 R:0.32459 P:0.22603 F:0.26649
51 ROUGE-1 Eval D0716-A.M.100.D-D.51 R:0.30333 P:0.20776 F:0.24661
51 ROUGE-1 Eval D0716-A.M.100.D-E.51 R:0.33887 P:0.23288 F:0.27605
51 ROUGE-1 Eval D0716-A.M.100.D-F.51 R:0.33333 P:0.23059 F:0.27260
51 ROUGE-1 Eval D0716-B.M.100.D-C.51 R:0.26974 P:0.19114 F:0.22374
51 ROUGE-1 Eval D0716-B.M.100.D-D.51 R:0.28188 P:0.19580 F:0.23108
51 ROUGE-1 Eval D0716-B.M.100.D-E.51 R:0.26578 P:0.18648 F:0.21918
51 ROUGE-1 Eval D0716-B.M.100.D-F.51 R:0.27000 P:0.18881 F:0.22222
51 ROUGE-1 Eval D0716-C.M.100.D-C.51 R:0.38436 P:0.25541 F:0.30689
51 ROUGE-1 Eval D0716-C.M.100.D-D.51 R:0.37458 P:0.24242 F:0.29435
51 ROUGE-1 Eval D0716-C.M.100.D-E.51 R:0.38944 P:0.25541 F:0.30850
51 ROUGE-1 Eval D0716-C.M.100.D-F.51 R:0.39000 P:0.25325 F:0.30709
51 ROUGE-1 Eval D0721-A.M.100.E-B.51 R:0.32667 P:0.20165 F:0.24937
51 ROUGE-1 Eval D0721-A.M.100.E-C.51 R:0.31818 P:0.20165 F:0.24685
51 ROUGE-1 Eval D0721-A.M.100.E-E.51 R:0.31818 P:0.20165 F:0.24685
51 ROUGE-1 Eval D0721-A.M.100.E-G.51 R:0.30573 P:0.19753 F:0.24000
51 ROUGE-1 Eval D0721-B.M.100.E-B.51 R:0.36808 P:0.25111 F:0.29855
51 ROUGE-1 Eval D0721-B.M.100.E-C.51 R:0.36306 P:0.25333 F:0.29843
51 ROUGE-1 Eval D0721-B.M.100.E-E.51 R:0.36393 P:0.24667 F:0.29404
51 ROUGE-1 Eval D0721-B.M.100.E-G.51 R:0.36129 P:0.24889 F:0.29474
51 ROUGE-1 Eval D0721-C.M.100.E-B.51 R:0.37377 P:0.27143 F:0.31448
51 ROUGE-1 Eval D0721-C.M.100.E-C.51 R:0.31353 P:0.22619 F:0.26279
51 ROUGE-1 Eval D0721-C.M.100.E-E.51 R:0.33000 P:0.23571 F:0.27500
51 ROUGE-1 Eval D0721-C.M.100.E-G.51 R:0.32573 P:0.23810 F:0.27511
51 ROUGE-1 Eval D0726-A.M.100.F-A.51 R:0.33555 P:0.23059 F:0.27334
51 ROUGE-1 Eval D0726-A.M.100.F-E.51 R:0.33667 P:0.23059 F:0.27371
51 ROUGE-1 Eval D0726-A.M.100.F-F.51 R:0.34884 P:0.23973 F:0.28417
51 ROUGE-1 Eval D0726-A.M.100.F-G.51 R:0.35548 P:0.24429 F:0.28958
51 ROUGE-1 Eval D0726-B.M.100.F-A.51 R:0.30719 P:0.22381 F:0.25895
51 ROUGE-1 Eval D0726-B.M.100.F-E.51 R:0.31229 P:0.22381 F:0.26075
51 ROUGE-1 Eval D0726-B.M.100.F-F.51 R:0.32558 P:0.23333 F:0.27184
51 ROUGE-1 Eval D0726-B.M.100.F-G.51 R:0.31250 P:0.22619 F:0.26243
51 ROUGE-1 Eval D0726-C.M.100.F-A.51 R:0.33000 P:0.20886 F:0.25581
51 ROUGE-1 Eval D0726-C.M.100.F-E.51 R:0.31313 P:0.19620 F:0.24124
51 ROUGE-1 Eval D0726-C.M.100.F-F.51 R:0.34237 P:0.21308 F:0.26268
51 ROUGE-1 Eval D0726-C.M.100.F-G.51 R:0.34754 P:0.22363 F:0.27214
51 ROUGE-1 Eval D0727-A.M.100.G-A.51 R:0.52159 P:0.30250 F:0.38292
51 ROUGE-1 Eval D0727-A.M.100.G-F.51 R:0.52303 P:0.30636 F:0.38639
51 ROUGE-1 Eval D0727-A.M.100.G-G.51 R:0.44118 P:0.26012 F:0.32728
51 ROUGE-1 Eval D0727-A.M.100.G-H.51 R:0.52961 P:0.31021 F:0.39125
51 ROUGE-1 Eval D0727-B.M.100.G-A.51 R:0.35052 P:0.19883 F:0.25373
51 ROUGE-1 Eval D0727-B.M.100.G-F.51 R:0.36688 P:0.22027 F:0.27527
51 ROUGE-1 Eval D0727-B.M.100.G-G.51 R:0.34602 P:0.19493 F:0.24937
51 ROUGE-1 Eval D0727-B.M.100.G-H.51 R:0.36082 P:0.20468 F:0.26119
51 ROUGE-1 Eval D0727-C.M.100.G-A.51 R:0.35179 P:0.22360 F:0.27342
51 ROUGE-1 Eval D0727-C.M.100.G-F.51 R:0.37037 P:0.22774 F:0.28205
51 ROUGE-1 Eval D0727-C.M.100.G-G.51 R:0.36634 P:0.22981 F:0.28244
51 ROUGE-1 Eval D0727-C.M.100.G-H.51 R:0.34797 P:0.21325 F:0.26444
51 ROUGE-1 Eval D0736-A.M.100.H-G.51 R:0.32616 P:0.19697 F:0.24561
51 ROUGE-1 Eval D0736-A.M.100.H-H.51 R:0.31387 P:0.18615 F:0.23370
51 ROUGE-1 Eval D0736-A.M.100.H-I.51 R:0.33808 P:0.20563 F:0.25572
51 ROUGE-1 Eval D0736-A.M.100.H-J.51 R:0.31699 P:0.20996 F:0.25261
51 ROUGE-1 Eval D0736-B.M.100.H-G.51 R:0.34351 P:0.19231 F:0.24658
51 ROUGE-1 Eval D0736-B.M.100.H-H.51 R:0.39669 P:0.20513 F:0.27042
51 ROUGE-1 Eval D0736-B.M.100.H-I.51 R:0.44351 P:0.22650 F:0.29986
51 ROUGE-1 Eval D0736-B.M.100.H-J.51 R:0.41608 P:0.25427 F:0.31565
51 ROUGE-1 Eval D0736-C.M.100.H-G.51 R:0.32911 P:0.15385 F:0.20968
51 ROUGE-1 Eval D0736-C.M.100.H-H.51 R:0.24599 P:0.09073 F:0.13257
51 ROUGE-1 Eval D0736-C.M.100.H-I.51 R:0.39572 P:0.14596 F:0.21326
51 ROUGE-1 Eval D0736-C.M.100.H-J.51 R:0.30566 P:0.15976 F:0.20984
51 ROUGE-1 Eval D0740-A.M.100.I-D.51 R:0.36304 P:0.24444 F:0.29216
51 ROUGE-1 Eval D0740-A.M.100.I-H.51 R:0.37908 P:0.25778 F:0.30688
51 ROUGE-1 Eval D0740-A.M.100.I-I.51 R:0.36039 P:0.24667 F:0.29288
51 ROUGE-1 Eval D0740-A.M.100.I-J.51 R:0.38387 P:0.26444 F:0.31315
51 ROUGE-1 Eval D0740-B.M.100.I-D.51 R:0.26948 P:0.17511 F:0.21228
51 ROUGE-1 Eval D0740-B.M.100.I-H.51 R:0.30464 P:0.19409 F:0.23711
51 ROUGE-1 Eval D0740-B.M.100.I-I.51 R:0.30492 P:0.19620 F:0.23877
51 ROUGE-1 Eval D0740-B.M.100.I-J.51 R:0.28803 P:0.18776 F:0.22733
51 ROUGE-1 Eval D0740-C.M.100.I-D.51 R:0.31949 P:0.21231 F:0.25510
51 ROUGE-1 Eval D0740-C.M.100.I-H.51 R:0.29582 P:0.19533 F:0.23529
51 ROUGE-1 Eval D0740-C.M.100.I-I.51 R:0.31629 P:0.21019 F:0.25255
51 ROUGE-1 Eval D0740-C.M.100.I-J.51 R:0.33439 P:0.22293 F:0.26751
51 ROUGE-1 Eval D0743-A.M.100.J-B.51 R:0.32381 P:0.18994 F:0.23943
51 ROUGE-1 Eval D0743-A.M.100.J-H.51 R:0.32099 P:0.19367 F:0.24158
51 ROUGE-1 Eval D0743-A.M.100.J-I.51 R:0.32188 P:0.19181 F:0.24038
51 ROUGE-1 Eval D0743-A.M.100.J-J.51 R:0.32308 P:0.19553 F:0.24362
51 ROUGE-1 Eval D0743-B.M.100.J-B.51 R:0.33654 P:0.19553 F:0.24735
51 ROUGE-1 Eval D0743-B.M.100.J-H.51 R:0.31861 P:0.18808 F:0.23653
51 ROUGE-1 Eval D0743-B.M.100.J-I.51 R:0.34494 P:0.20298 F:0.25557
51 ROUGE-1 Eval D0743-B.M.100.J-J.51 R:0.31776 P:0.18994 F:0.23776
51 ROUGE-1 Eval D0743-C.M.100.J-B.51 R:0.32063 P:0.20281 F:0.24846
51 ROUGE-1 Eval D0743-C.M.100.J-H.51 R:0.27070 P:0.17068 F:0.20936
51 ROUGE-1 Eval D0743-C.M.100.J-I.51 R:0.32907 P:0.20683 F:0.25401
51 ROUGE-1 Eval D0743-C.M.100.J-J.51 R:0.28931 P:0.18474 F:0.22549
---------------------------------------------
51 ROUGE-2 Average_R: 0.07958 (95%-conf.int. 0.07220 - 0.08746)
51 ROUGE-2 Average_P: 0.05060 (95%-conf.int. 0.04621 - 0.05524)
51 ROUGE-2 Average_F: 0.06171 (95%-conf.int. 0.05630 - 0.06756)
.............................................
51 ROUGE-2 Eval D0703-A.M.100.A-A.51 R:0.10239 P:0.06369 F:0.07853
51 ROUGE-2 Eval D0703-A.M.100.A-C.51 R:0.05424 P:0.03397 F:0.04178
51 ROUGE-2 Eval D0703-A.M.100.A-D.51 R:0.09722 P:0.05945 F:0.07378
51 ROUGE-2 Eval D0703-A.M.100.A-J.51 R:0.10653 P:0.06582 F:0.08137
51 ROUGE-2 Eval D0703-B.M.100.A-A.51 R:0.10231 P:0.07329 F:0.08540
51 ROUGE-2 Eval D0703-B.M.100.A-C.51 R:0.10169 P:0.07092 F:0.08356
51 ROUGE-2 Eval D0703-B.M.100.A-D.51 R:0.08136 P:0.05674 F:0.06686
51 ROUGE-2 Eval D0703-B.M.100.A-J.51 R:0.08725 P:0.06147 F:0.07213
51 ROUGE-2 Eval D0703-C.M.100.A-A.51 R:0.07407 P:0.05128 F:0.06060
51 ROUGE-2 Eval D0703-C.M.100.A-C.51 R:0.08197 P:0.05828 F:0.06812
51 ROUGE-2 Eval D0703-C.M.100.A-D.51 R:0.07358 P:0.05128 F:0.06044
51 ROUGE-2 Eval D0703-C.M.100.A-J.51 R:0.06020 P:0.04196 F:0.04945
51 ROUGE-2 Eval D0706-A.M.100.B-B.51 R:0.10164 P:0.06499 F:0.07928
51 ROUGE-2 Eval D0706-A.M.100.B-D.51 R:0.12871 P:0.08176 F:0.10000
51 ROUGE-2 Eval D0706-A.M.100.B-E.51 R:0.09508 P:0.06080 F:0.07417
51 ROUGE-2 Eval D0706-A.M.100.B-I.51 R:0.09836 P:0.06289 F:0.07672
51 ROUGE-2 Eval D0706-B.M.100.B-B.51 R:0.06601 P:0.04274 F:0.05189
51 ROUGE-2 Eval D0706-B.M.100.B-D.51 R:0.04276 P:0.02778 F:0.03368
51 ROUGE-2 Eval D0706-B.M.100.B-E.51 R:0.03279 P:0.02137 F:0.02588
51 ROUGE-2 Eval D0706-B.M.100.B-I.51 R:0.06536 P:0.04274 F:0.05168
51 ROUGE-2 Eval D0706-C.M.100.B-B.51 R:0.04560 P:0.02811 F:0.03478
51 ROUGE-2 Eval D0706-C.M.100.B-D.51 R:0.03909 P:0.02410 F:0.02982
51 ROUGE-2 Eval D0706-C.M.100.B-E.51 R:0.05825 P:0.03614 F:0.04461
51 ROUGE-2 Eval D0706-C.M.100.B-I.51 R:0.06129 P:0.03815 F:0.04703
51 ROUGE-2 Eval D0711-A.M.100.C-A.51 R:0.14286 P:0.09556 F:0.11452
51 ROUGE-2 Eval D0711-A.M.100.C-B.51 R:0.20539 P:0.13556 F:0.16332
51 ROUGE-2 Eval D0711-A.M.100.C-C.51 R:0.16835 P:0.11111 F:0.13387
51 ROUGE-2 Eval D0711-A.M.100.C-F.51 R:0.15719 P:0.10444 F:0.12550
51 ROUGE-2 Eval D0711-B.M.100.C-A.51 R:0.05842 P:0.03753 F:0.04570
51 ROUGE-2 Eval D0711-B.M.100.C-B.51 R:0.06228 P:0.03974 F:0.04852
51 ROUGE-2 Eval D0711-B.M.100.C-C.51 R:0.05763 P:0.03753 F:0.04546
51 ROUGE-2 Eval D0711-B.M.100.C-F.51 R:0.03767 P:0.02428 F:0.02953
51 ROUGE-2 Eval D0711-C.M.100.C-A.51 R:0.10000 P:0.06667 F:0.08000
51 ROUGE-2 Eval D0711-C.M.100.C-B.51 R:0.09655 P:0.06222 F:0.07567
51 ROUGE-2 Eval D0711-C.M.100.C-C.51 R:0.05802 P:0.03778 F:0.04576
51 ROUGE-2 Eval D0711-C.M.100.C-F.51 R:0.08191 P:0.05333 F:0.06460
51 ROUGE-2 Eval D0716-A.M.100.D-C.51 R:0.07947 P:0.05517 F:0.06513
51 ROUGE-2 Eval D0716-A.M.100.D-D.51 R:0.06734 P:0.04598 F:0.05465
51 ROUGE-2 Eval D0716-A.M.100.D-E.51 R:0.08389 P:0.05747 F:0.06821
51 ROUGE-2 Eval D0716-A.M.100.D-F.51 R:0.08000 P:0.05517 F:0.06530
51 ROUGE-2 Eval D0716-B.M.100.D-C.51 R:0.01661 P:0.01174 F:0.01376
51 ROUGE-2 Eval D0716-B.M.100.D-D.51 R:0.01017 P:0.00704 F:0.00832
51 ROUGE-2 Eval D0716-B.M.100.D-E.51 R:0.02013 P:0.01408 F:0.01657
51 ROUGE-2 Eval D0716-B.M.100.D-F.51 R:0.01347 P:0.00939 F:0.01107
51 ROUGE-2 Eval D0716-C.M.100.D-C.51 R:0.13487 P:0.08932 F:0.10747
51 ROUGE-2 Eval D0716-C.M.100.D-D.51 R:0.11486 P:0.07407 F:0.09006
51 ROUGE-2 Eval D0716-C.M.100.D-E.51 R:0.11000 P:0.07190 F:0.08696
51 ROUGE-2 Eval D0716-C.M.100.D-F.51 R:0.13131 P:0.08497 F:0.10318
51 ROUGE-2 Eval D0721-A.M.100.E-B.51 R:0.04377 P:0.02692 F:0.03334
51 ROUGE-2 Eval D0721-A.M.100.E-C.51 R:0.05902 P:0.03727 F:0.04569
51 ROUGE-2 Eval D0721-A.M.100.E-E.51 R:0.05902 P:0.03727 F:0.04569
51 ROUGE-2 Eval D0721-A.M.100.E-G.51 R:0.05466 P:0.03520 F:0.04282
51 ROUGE-2 Eval D0721-B.M.100.E-B.51 R:0.09539 P:0.06488 F:0.07723
51 ROUGE-2 Eval D0721-B.M.100.E-C.51 R:0.08360 P:0.05817 F:0.06860
51 ROUGE-2 Eval D0721-B.M.100.E-E.51 R:0.09603 P:0.06488 F:0.07744
51 ROUGE-2 Eval D0721-B.M.100.E-G.51 R:0.07818 P:0.05369 F:0.06366
51 ROUGE-2 Eval D0721-C.M.100.E-B.51 R:0.12914 P:0.09353 F:0.10849
51 ROUGE-2 Eval D0721-C.M.100.E-C.51 R:0.09333 P:0.06715 F:0.07810
51 ROUGE-2 Eval D0721-C.M.100.E-E.51 R:0.12121 P:0.08633 F:0.10084
51 ROUGE-2 Eval D0721-C.M.100.E-G.51 R:0.10526 P:0.07674 F:0.08877
51 ROUGE-2 Eval D0726-A.M.100.F-A.51 R:0.08725 P:0.05977 F:0.07094
51 ROUGE-2 Eval D0726-A.M.100.F-E.51 R:0.10438 P:0.07126 F:0.08470
51 ROUGE-2 Eval D0726-A.M.100.F-F.51 R:0.09732 P:0.06667 F:0.07913
51 ROUGE-2 Eval D0726-A.M.100.F-G.51 R:0.10403 P:0.07126 F:0.08458
51 ROUGE-2 Eval D0726-B.M.100.F-A.51 R:0.05281 P:0.03837 F:0.04445
51 ROUGE-2 Eval D0726-B.M.100.F-E.51 R:0.05369 P:0.03837 F:0.04476
51 ROUGE-2 Eval D0726-B.M.100.F-F.51 R:0.05705 P:0.04077 F:0.04756
51 ROUGE-2 Eval D0726-B.M.100.F-G.51 R:0.04651 P:0.03357 F:0.03899
51 ROUGE-2 Eval D0726-C.M.100.F-A.51 R:0.04714 P:0.02972 F:0.03646
51 ROUGE-2 Eval D0726-C.M.100.F-E.51 R:0.02381 P:0.01486 F:0.01830
51 ROUGE-2 Eval D0726-C.M.100.F-F.51 R:0.04110 P:0.02548 F:0.03146
51 ROUGE-2 Eval D0726-C.M.100.F-G.51 R:0.03974 P:0.02548 F:0.03105
51 ROUGE-2 Eval D0727-A.M.100.G-A.51 R:0.20470 P:0.11822 F:0.14988
51 ROUGE-2 Eval D0727-A.M.100.G-F.51 R:0.21262 P:0.12403 F:0.15667
51 ROUGE-2 Eval D0727-A.M.100.G-G.51 R:0.11551 P:0.06783 F:0.08547
51 ROUGE-2 Eval D0727-A.M.100.G-H.51 R:0.20598 P:0.12016 F:0.15178
51 ROUGE-2 Eval D0727-B.M.100.G-A.51 R:0.04167 P:0.02353 F:0.03008
51 ROUGE-2 Eval D0727-B.M.100.G-F.51 R:0.06885 P:0.04118 F:0.05154
51 ROUGE-2 Eval D0727-B.M.100.G-G.51 R:0.05245 P:0.02941 F:0.03769
51 ROUGE-2 Eval D0727-B.M.100.G-H.51 R:0.06250 P:0.03529 F:0.04511
51 ROUGE-2 Eval D0727-C.M.100.G-A.51 R:0.03289 P:0.02083 F:0.02551
51 ROUGE-2 Eval D0727-C.M.100.G-F.51 R:0.04422 P:0.02708 F:0.03359
51 ROUGE-2 Eval D0727-C.M.100.G-G.51 R:0.04000 P:0.02500 F:0.03077
51 ROUGE-2 Eval D0727-C.M.100.G-H.51 R:0.02389 P:0.01458 F:0.01811
51 ROUGE-2 Eval D0736-A.M.100.H-G.51 R:0.07971 P:0.04793 F:0.05986
51 ROUGE-2 Eval D0736-A.M.100.H-H.51 R:0.04059 P:0.02397 F:0.03014
51 ROUGE-2 Eval D0736-A.M.100.H-I.51 R:0.07554 P:0.04575 F:0.05699
51 ROUGE-2 Eval D0736-A.M.100.H-J.51 R:0.06931 P:0.04575 F:0.05512
51 ROUGE-2 Eval D0736-B.M.100.H-G.51 R:0.07722 P:0.04301 F:0.05525
51 ROUGE-2 Eval D0736-B.M.100.H-H.51 R:0.16318 P:0.08387 F:0.11079
51 ROUGE-2 Eval D0736-B.M.100.H-I.51 R:0.19068 P:0.09677 F:0.12838
51 ROUGE-2 Eval D0736-B.M.100.H-J.51 R:0.17314 P:0.10538 F:0.13102
51 ROUGE-2 Eval D0736-C.M.100.H-G.51 R:0.08974 P:0.04167 F:0.05691
51 ROUGE-2 Eval D0736-C.M.100.H-H.51 R:0.01630 P:0.00595 F:0.00872
51 ROUGE-2 Eval D0736-C.M.100.H-I.51 R:0.12500 P:0.04563 F:0.06686
51 ROUGE-2 Eval D0736-C.M.100.H-J.51 R:0.08397 P:0.04365 F:0.05744
51 ROUGE-2 Eval D0740-A.M.100.I-D.51 R:0.08667 P:0.05817 F:0.06962
51 ROUGE-2 Eval D0740-A.M.100.I-H.51 R:0.09901 P:0.06711 F:0.08000
51 ROUGE-2 Eval D0740-A.M.100.I-I.51 R:0.07213 P:0.04922 F:0.05851
51 ROUGE-2 Eval D0740-A.M.100.I-J.51 R:0.07818 P:0.05369 F:0.06366
51 ROUGE-2 Eval D0740-B.M.100.I-D.51 R:0.01967 P:0.01274 F:0.01546
51 ROUGE-2 Eval D0740-B.M.100.I-H.51 R:0.02676 P:0.01699 F:0.02078
51 ROUGE-2 Eval D0740-B.M.100.I-I.51 R:0.02980 P:0.01911 F:0.02329
51 ROUGE-2 Eval D0740-B.M.100.I-J.51 R:0.02288 P:0.01486 F:0.01802
51 ROUGE-2 Eval D0740-C.M.100.I-D.51 R:0.06452 P:0.04274 F:0.05142
51 ROUGE-2 Eval D0740-C.M.100.I-H.51 R:0.05195 P:0.03419 F:0.04124
51 ROUGE-2 Eval D0740-C.M.100.I-I.51 R:0.07419 P:0.04915 F:0.05913
51 ROUGE-2 Eval D0740-C.M.100.I-J.51 R:0.08039 P:0.05342 F:0.06419
51 ROUGE-2 Eval D0743-A.M.100.J-B.51 R:0.08974 P:0.05243 F:0.06619
51 ROUGE-2 Eval D0743-A.M.100.J-H.51 R:0.05919 P:0.03558 F:0.04444
51 ROUGE-2 Eval D0743-A.M.100.J-I.51 R:0.06625 P:0.03933 F:0.04936
51 ROUGE-2 Eval D0743-A.M.100.J-J.51 R:0.07764 P:0.04682 F:0.05841
51 ROUGE-2 Eval D0743-B.M.100.J-B.51 R:0.08738 P:0.05056 F:0.06406
51 ROUGE-2 Eval D0743-B.M.100.J-H.51 R:0.07325 P:0.04307 F:0.05424
51 ROUGE-2 Eval D0743-B.M.100.J-I.51 R:0.08626 P:0.05056 F:0.06375
51 ROUGE-2 Eval D0743-B.M.100.J-J.51 R:0.06918 P:0.04120 F:0.05164
51 ROUGE-2 Eval D0743-C.M.100.J-B.51 R:0.06410 P:0.04040 F:0.04956
51 ROUGE-2 Eval D0743-C.M.100.J-H.51 R:0.04180 P:0.02626 F:0.03226
51 ROUGE-2 Eval D0743-C.M.100.J-I.51 R:0.05806 P:0.03636 F:0.04472
51 ROUGE-2 Eval D0743-C.M.100.J-J.51 R:0.05714 P:0.03636 F:0.04444
---------------------------------------------
51 ROUGE-3 Average_R: 0.03213 (95%-conf.int. 0.02693 - 0.03739)
51 ROUGE-3 Average_P: 0.02008 (95%-conf.int. 0.01689 - 0.02320)
51 ROUGE-3 Average_F: 0.02465 (95%-conf.int. 0.02078 - 0.02859)
.............................................
51 ROUGE-3 Eval D0703-A.M.100.A-A.51 R:0.04483 P:0.02778 F:0.03430
51 ROUGE-3 Eval D0703-A.M.100.A-C.51 R:0.01027 P:0.00641 F:0.00789
51 ROUGE-3 Eval D0703-A.M.100.A-D.51 R:0.04912 P:0.02991 F:0.03718
51 ROUGE-3 Eval D0703-A.M.100.A-J.51 R:0.05208 P:0.03205 F:0.03968
51 ROUGE-3 Eval D0703-B.M.100.A-A.51 R:0.03000 P:0.02143 F:0.02500
51 ROUGE-3 Eval D0703-B.M.100.A-C.51 R:0.03082 P:0.02143 F:0.02528
51 ROUGE-3 Eval D0703-B.M.100.A-D.51 R:0.02055 P:0.01429 F:0.01686
51 ROUGE-3 Eval D0703-B.M.100.A-J.51 R:0.02034 P:0.01429 F:0.01679
51 ROUGE-3 Eval D0703-C.M.100.A-A.51 R:0.01020 P:0.00704 F:0.00833
51 ROUGE-3 Eval D0703-C.M.100.A-C.51 R:0.01325 P:0.00939 F:0.01099
51 ROUGE-3 Eval D0703-C.M.100.A-D.51 R:0.01351 P:0.00939 F:0.01108
51 ROUGE-3 Eval D0703-C.M.100.A-J.51 R:0.00338 P:0.00235 F:0.00277
51 ROUGE-3 Eval D0706-A.M.100.B-B.51 R:0.03642 P:0.02321 F:0.02835
51 ROUGE-3 Eval D0706-A.M.100.B-D.51 R:0.05333 P:0.03376 F:0.04135
51 ROUGE-3 Eval D0706-A.M.100.B-E.51 R:0.02649 P:0.01688 F:0.02062
51 ROUGE-3 Eval D0706-A.M.100.B-I.51 R:0.04305 P:0.02743 F:0.03351
51 ROUGE-3 Eval D0706-B.M.100.B-B.51 R:0.01667 P:0.01075 F:0.01307
51 ROUGE-3 Eval D0706-B.M.100.B-D.51 R:0.00664 P:0.00430 F:0.00522
51 ROUGE-3 Eval D0706-B.M.100.B-E.51 R:0.00993 P:0.00645 F:0.00782
51 ROUGE-3 Eval D0706-B.M.100.B-I.51 R:0.01650 P:0.01075 F:0.01302
51 ROUGE-3 Eval D0706-C.M.100.B-B.51 R:0.02632 P:0.01616 F:0.02003
51 ROUGE-3 Eval D0706-C.M.100.B-D.51 R:0.01974 P:0.01212 F:0.01502
51 ROUGE-3 Eval D0706-C.M.100.B-E.51 R:0.03922 P:0.02424 F:0.02996
51 ROUGE-3 Eval D0706-C.M.100.B-I.51 R:0.04235 P:0.02626 F:0.03242
51 ROUGE-3 Eval D0711-A.M.100.C-A.51 R:0.07383 P:0.04922 F:0.05906
51 ROUGE-3 Eval D0711-A.M.100.C-B.51 R:0.11224 P:0.07383 F:0.08907
51 ROUGE-3 Eval D0711-A.M.100.C-C.51 R:0.10544 P:0.06935 F:0.08367
51 ROUGE-3 Eval D0711-A.M.100.C-F.51 R:0.09459 P:0.06264 F:0.07537
51 ROUGE-3 Eval D0711-B.M.100.C-A.51 R:0.01389 P:0.00889 F:0.01084
51 ROUGE-3 Eval D0711-B.M.100.C-B.51 R:0.01399 P:0.00889 F:0.01087
51 ROUGE-3 Eval D0711-B.M.100.C-C.51 R:0.01027 P:0.00667 F:0.00809
51 ROUGE-3 Eval D0711-B.M.100.C-F.51 R:0.00346 P:0.00222 F:0.00270
51 ROUGE-3 Eval D0711-C.M.100.C-A.51 R:0.04714 P:0.03132 F:0.03764
51 ROUGE-3 Eval D0711-C.M.100.C-B.51 R:0.05575 P:0.03579 F:0.04359
51 ROUGE-3 Eval D0711-C.M.100.C-C.51 R:0.02069 P:0.01342 F:0.01628
51 ROUGE-3 Eval D0711-C.M.100.C-F.51 R:0.04138 P:0.02685 F:0.03257
51 ROUGE-3 Eval D0716-A.M.100.D-C.51 R:0.01672 P:0.01157 F:0.01368
51 ROUGE-3 Eval D0716-A.M.100.D-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0716-A.M.100.D-E.51 R:0.01695 P:0.01157 F:0.01375
51 ROUGE-3 Eval D0716-A.M.100.D-F.51 R:0.01684 P:0.01157 F:0.01372
51 ROUGE-3 Eval D0716-B.M.100.D-C.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0716-B.M.100.D-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0716-B.M.100.D-E.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0716-B.M.100.D-F.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0716-C.M.100.D-C.51 R:0.07641 P:0.05044 F:0.06077
51 ROUGE-3 Eval D0716-C.M.100.D-D.51 R:0.05802 P:0.03728 F:0.04539
51 ROUGE-3 Eval D0716-C.M.100.D-E.51 R:0.04040 P:0.02632 F:0.03187
51 ROUGE-3 Eval D0716-C.M.100.D-F.51 R:0.07823 P:0.05044 F:0.06133
51 ROUGE-3 Eval D0721-A.M.100.E-B.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0721-A.M.100.E-C.51 R:0.00993 P:0.00625 F:0.00767
51 ROUGE-3 Eval D0721-A.M.100.E-E.51 R:0.00993 P:0.00625 F:0.00767
51 ROUGE-3 Eval D0721-A.M.100.E-G.51 R:0.00974 P:0.00625 F:0.00761
51 ROUGE-3 Eval D0721-B.M.100.E-B.51 R:0.04319 P:0.02928 F:0.03490
51 ROUGE-3 Eval D0721-B.M.100.E-C.51 R:0.02922 P:0.02027 F:0.02394
51 ROUGE-3 Eval D0721-B.M.100.E-E.51 R:0.04682 P:0.03153 F:0.03768
51 ROUGE-3 Eval D0721-B.M.100.E-G.51 R:0.02961 P:0.02027 F:0.02407
51 ROUGE-3 Eval D0721-C.M.100.E-B.51 R:0.06355 P:0.04589 F:0.05330
51 ROUGE-3 Eval D0721-C.M.100.E-C.51 R:0.04040 P:0.02899 F:0.03376
51 ROUGE-3 Eval D0721-C.M.100.E-E.51 R:0.06463 P:0.04589 F:0.05367
51 ROUGE-3 Eval D0721-C.M.100.E-G.51 R:0.06312 P:0.04589 F:0.05314
51 ROUGE-3 Eval D0726-A.M.100.F-A.51 R:0.03051 P:0.02083 F:0.02476
51 ROUGE-3 Eval D0726-A.M.100.F-E.51 R:0.03401 P:0.02315 F:0.02755
51 ROUGE-3 Eval D0726-A.M.100.F-F.51 R:0.03390 P:0.02315 F:0.02751
51 ROUGE-3 Eval D0726-A.M.100.F-G.51 R:0.03390 P:0.02315 F:0.02751
51 ROUGE-3 Eval D0726-B.M.100.F-A.51 R:0.01000 P:0.00725 F:0.00841
51 ROUGE-3 Eval D0726-B.M.100.F-E.51 R:0.00678 P:0.00483 F:0.00564
51 ROUGE-3 Eval D0726-B.M.100.F-F.51 R:0.01017 P:0.00725 F:0.00847
51 ROUGE-3 Eval D0726-B.M.100.F-G.51 R:0.00336 P:0.00242 F:0.00281
51 ROUGE-3 Eval D0726-C.M.100.F-A.51 R:0.02721 P:0.01709 F:0.02099
51 ROUGE-3 Eval D0726-C.M.100.F-E.51 R:0.01031 P:0.00641 F:0.00791
51 ROUGE-3 Eval D0726-C.M.100.F-F.51 R:0.02422 P:0.01496 F:0.01850
51 ROUGE-3 Eval D0726-C.M.100.F-G.51 R:0.02007 P:0.01282 F:0.01565
51 ROUGE-3 Eval D0727-A.M.100.G-A.51 R:0.11525 P:0.06628 F:0.08416
51 ROUGE-3 Eval D0727-A.M.100.G-F.51 R:0.12081 P:0.07018 F:0.08878
51 ROUGE-3 Eval D0727-A.M.100.G-G.51 R:0.04000 P:0.02339 F:0.02952
51 ROUGE-3 Eval D0727-A.M.100.G-H.51 R:0.11745 P:0.06823 F:0.08632
51 ROUGE-3 Eval D0727-B.M.100.G-A.51 R:0.00351 P:0.00197 F:0.00252
51 ROUGE-3 Eval D0727-B.M.100.G-F.51 R:0.01325 P:0.00789 F:0.00989
51 ROUGE-3 Eval D0727-B.M.100.G-G.51 R:0.01060 P:0.00592 F:0.00760
51 ROUGE-3 Eval D0727-B.M.100.G-H.51 R:0.01404 P:0.00789 F:0.01010
51 ROUGE-3 Eval D0727-C.M.100.G-A.51 R:0.00664 P:0.00419 F:0.00514
51 ROUGE-3 Eval D0727-C.M.100.G-F.51 R:0.01375 P:0.00839 F:0.01042
51 ROUGE-3 Eval D0727-C.M.100.G-G.51 R:0.01347 P:0.00839 F:0.01034
51 ROUGE-3 Eval D0727-C.M.100.G-H.51 R:0.00690 P:0.00419 F:0.00521
51 ROUGE-3 Eval D0736-A.M.100.H-G.51 R:0.03297 P:0.01974 F:0.02469
51 ROUGE-3 Eval D0736-A.M.100.H-H.51 R:0.01493 P:0.00877 F:0.01105
51 ROUGE-3 Eval D0736-A.M.100.H-I.51 R:0.02545 P:0.01535 F:0.01915
51 ROUGE-3 Eval D0736-A.M.100.H-J.51 R:0.02333 P:0.01535 F:0.01852
51 ROUGE-3 Eval D0736-B.M.100.H-G.51 R:0.02734 P:0.01515 F:0.01950
51 ROUGE-3 Eval D0736-B.M.100.H-H.51 R:0.11864 P:0.06061 F:0.08023
51 ROUGE-3 Eval D0736-B.M.100.H-I.51 R:0.13305 P:0.06710 F:0.08921
51 ROUGE-3 Eval D0736-B.M.100.H-J.51 R:0.11786 P:0.07143 F:0.08895
51 ROUGE-3 Eval D0736-C.M.100.H-G.51 R:0.04329 P:0.01996 F:0.02732
51 ROUGE-3 Eval D0736-C.M.100.H-H.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-3 Eval D0736-C.M.100.H-I.51 R:0.05525 P:0.01996 F:0.02933
51 ROUGE-3 Eval D0736-C.M.100.H-J.51 R:0.03861 P:0.01996 F:0.02632
51 ROUGE-3 Eval D0740-A.M.100.I-D.51 R:0.02694 P:0.01802 F:0.02160
51 ROUGE-3 Eval D0740-A.M.100.I-H.51 R:0.02333 P:0.01577 F:0.01882
51 ROUGE-3 Eval D0740-A.M.100.I-I.51 R:0.01325 P:0.00901 F:0.01073
51 ROUGE-3 Eval D0740-A.M.100.I-J.51 R:0.01645 P:0.01126 F:0.01337
51 ROUGE-3 Eval D0740-B.M.100.I-D.51 R:0.00331 P:0.00214 F:0.00260
51 ROUGE-3 Eval D0740-B.M.100.I-H.51 R:0.00338 P:0.00214 F:0.00262
51 ROUGE-3 Eval D0740-B.M.100.I-I.51 R:0.00669 P:0.00427 F:0.00521
51 ROUGE-3 Eval D0740-B.M.100.I-J.51 R:0.00660 P:0.00427 F:0.00519
51 ROUGE-3 Eval D0740-C.M.100.I-D.51 R:0.02932 P:0.01935 F:0.02331
51 ROUGE-3 Eval D0740-C.M.100.I-H.51 R:0.02295 P:0.01505 F:0.01818
51 ROUGE-3 Eval D0740-C.M.100.I-I.51 R:0.03909 P:0.02581 F:0.03109
51 ROUGE-3 Eval D0740-C.M.100.I-J.51 R:0.04545 P:0.03011 F:0.03622
51 ROUGE-3 Eval D0743-A.M.100.J-B.51 R:0.03883 P:0.02260 F:0.02857
51 ROUGE-3 Eval D0743-A.M.100.J-H.51 R:0.01887 P:0.01130 F:0.01414
51 ROUGE-3 Eval D0743-A.M.100.J-I.51 R:0.02229 P:0.01318 F:0.01657
51 ROUGE-3 Eval D0743-A.M.100.J-J.51 R:0.03448 P:0.02072 F:0.02588
51 ROUGE-3 Eval D0743-B.M.100.J-B.51 R:0.03595 P:0.02072 F:0.02629
51 ROUGE-3 Eval D0743-B.M.100.J-H.51 R:0.02894 P:0.01695 F:0.02138
51 ROUGE-3 Eval D0743-B.M.100.J-I.51 R:0.03548 P:0.02072 F:0.02616
51 ROUGE-3 Eval D0743-B.M.100.J-J.51 R:0.02540 P:0.01507 F:0.01892
51 ROUGE-3 Eval D0743-C.M.100.J-B.51 R:0.02913 P:0.01829 F:0.02247
51 ROUGE-3 Eval D0743-C.M.100.J-H.51 R:0.01299 P:0.00813 F:0.01000
51 ROUGE-3 Eval D0743-C.M.100.J-I.51 R:0.02932 P:0.01829 F:0.02253
51 ROUGE-3 Eval D0743-C.M.100.J-J.51 R:0.02564 P:0.01626 F:0.01990
---------------------------------------------
51 ROUGE-4 Average_R: 0.01727 (95%-conf.int. 0.01358 - 0.02128)
51 ROUGE-4 Average_P: 0.01066 (95%-conf.int. 0.00842 - 0.01293)
51 ROUGE-4 Average_F: 0.01314 (95%-conf.int. 0.01039 - 0.01600)
.............................................
51 ROUGE-4 Eval D0703-A.M.100.A-A.51 R:0.02439 P:0.01505 F:0.01861
51 ROUGE-4 Eval D0703-A.M.100.A-C.51 R:0.00346 P:0.00215 F:0.00265
51 ROUGE-4 Eval D0703-A.M.100.A-D.51 R:0.02837 P:0.01720 F:0.02142
51 ROUGE-4 Eval D0703-A.M.100.A-J.51 R:0.02807 P:0.01720 F:0.02133
51 ROUGE-4 Eval D0703-B.M.100.A-A.51 R:0.00673 P:0.00480 F:0.00560
51 ROUGE-4 Eval D0703-B.M.100.A-C.51 R:0.00692 P:0.00480 F:0.00567
51 ROUGE-4 Eval D0703-B.M.100.A-D.51 R:0.00346 P:0.00240 F:0.00283
51 ROUGE-4 Eval D0703-B.M.100.A-J.51 R:0.00342 P:0.00240 F:0.00282
51 ROUGE-4 Eval D0703-C.M.100.A-A.51 R:0.00344 P:0.00236 F:0.00280
51 ROUGE-4 Eval D0703-C.M.100.A-C.51 R:0.00334 P:0.00236 F:0.00277
51 ROUGE-4 Eval D0703-C.M.100.A-D.51 R:0.00341 P:0.00236 F:0.00279
51 ROUGE-4 Eval D0703-C.M.100.A-J.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0706-A.M.100.B-B.51 R:0.02341 P:0.01486 F:0.01818
51 ROUGE-4 Eval D0706-A.M.100.B-D.51 R:0.03367 P:0.02123 F:0.02604
51 ROUGE-4 Eval D0706-A.M.100.B-E.51 R:0.01672 P:0.01062 F:0.01299
51 ROUGE-4 Eval D0706-A.M.100.B-I.51 R:0.02676 P:0.01699 F:0.02078
51 ROUGE-4 Eval D0706-B.M.100.B-B.51 R:0.00337 P:0.00216 F:0.00263
51 ROUGE-4 Eval D0706-B.M.100.B-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0706-B.M.100.B-E.51 R:0.00334 P:0.00216 F:0.00262
51 ROUGE-4 Eval D0706-B.M.100.B-I.51 R:0.00333 P:0.00216 F:0.00262
51 ROUGE-4 Eval D0706-C.M.100.B-B.51 R:0.01993 P:0.01220 F:0.01514
51 ROUGE-4 Eval D0706-C.M.100.B-D.51 R:0.01329 P:0.00813 F:0.01009
51 ROUGE-4 Eval D0706-C.M.100.B-E.51 R:0.03300 P:0.02033 F:0.02516
51 ROUGE-4 Eval D0706-C.M.100.B-I.51 R:0.03289 P:0.02033 F:0.02513
51 ROUGE-4 Eval D0711-A.M.100.C-A.51 R:0.04068 P:0.02703 F:0.03248
51 ROUGE-4 Eval D0711-A.M.100.C-B.51 R:0.06529 P:0.04279 F:0.05170
51 ROUGE-4 Eval D0711-A.M.100.C-C.51 R:0.07216 P:0.04730 F:0.05714
51 ROUGE-4 Eval D0711-A.M.100.C-F.51 R:0.05802 P:0.03829 F:0.04613
51 ROUGE-4 Eval D0711-B.M.100.C-A.51 R:0.00351 P:0.00224 F:0.00273
51 ROUGE-4 Eval D0711-B.M.100.C-B.51 R:0.00353 P:0.00224 F:0.00274
51 ROUGE-4 Eval D0711-B.M.100.C-C.51 R:0.00346 P:0.00224 F:0.00272
51 ROUGE-4 Eval D0711-B.M.100.C-F.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0711-C.M.100.C-A.51 R:0.02381 P:0.01577 F:0.01897
51 ROUGE-4 Eval D0711-C.M.100.C-B.51 R:0.02817 P:0.01802 F:0.02198
51 ROUGE-4 Eval D0711-C.M.100.C-C.51 R:0.00697 P:0.00450 F:0.00547
51 ROUGE-4 Eval D0711-C.M.100.C-F.51 R:0.02439 P:0.01577 F:0.01915
51 ROUGE-4 Eval D0716-A.M.100.D-C.51 R:0.00676 P:0.00466 F:0.00552
51 ROUGE-4 Eval D0716-A.M.100.D-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0716-A.M.100.D-E.51 R:0.00685 P:0.00466 F:0.00555
51 ROUGE-4 Eval D0716-A.M.100.D-F.51 R:0.00680 P:0.00466 F:0.00553
51 ROUGE-4 Eval D0716-B.M.100.D-C.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0716-B.M.100.D-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0716-B.M.100.D-E.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0716-B.M.100.D-F.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0716-C.M.100.D-C.51 R:0.04362 P:0.02870 F:0.03462
51 ROUGE-4 Eval D0716-C.M.100.D-D.51 R:0.03448 P:0.02208 F:0.02692
51 ROUGE-4 Eval D0716-C.M.100.D-E.51 R:0.01020 P:0.00662 F:0.00803
51 ROUGE-4 Eval D0716-C.M.100.D-F.51 R:0.04467 P:0.02870 F:0.03495
51 ROUGE-4 Eval D0721-A.M.100.E-B.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0721-A.M.100.E-C.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0721-A.M.100.E-E.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0721-A.M.100.E-G.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0721-B.M.100.E-B.51 R:0.02013 P:0.01361 F:0.01624
51 ROUGE-4 Eval D0721-B.M.100.E-C.51 R:0.00656 P:0.00454 F:0.00537
51 ROUGE-4 Eval D0721-B.M.100.E-E.51 R:0.02027 P:0.01361 F:0.01629
51 ROUGE-4 Eval D0721-B.M.100.E-G.51 R:0.01329 P:0.00907 F:0.01078
51 ROUGE-4 Eval D0721-C.M.100.E-B.51 R:0.04392 P:0.03163 F:0.03678
51 ROUGE-4 Eval D0721-C.M.100.E-C.51 R:0.02721 P:0.01946 F:0.02269
51 ROUGE-4 Eval D0721-C.M.100.E-E.51 R:0.04467 P:0.03163 F:0.03704
51 ROUGE-4 Eval D0721-C.M.100.E-G.51 R:0.04698 P:0.03406 F:0.03949
51 ROUGE-4 Eval D0726-A.M.100.F-A.51 R:0.01370 P:0.00932 F:0.01109
51 ROUGE-4 Eval D0726-A.M.100.F-E.51 R:0.01718 P:0.01166 F:0.01389
51 ROUGE-4 Eval D0726-A.M.100.F-F.51 R:0.01370 P:0.00932 F:0.01109
51 ROUGE-4 Eval D0726-A.M.100.F-G.51 R:0.01712 P:0.01166 F:0.01387
51 ROUGE-4 Eval D0726-B.M.100.F-A.51 R:0.00337 P:0.00243 F:0.00282
51 ROUGE-4 Eval D0726-B.M.100.F-E.51 R:0.00342 P:0.00243 F:0.00284
51 ROUGE-4 Eval D0726-B.M.100.F-F.51 R:0.00342 P:0.00243 F:0.00284
51 ROUGE-4 Eval D0726-B.M.100.F-G.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0726-C.M.100.F-A.51 R:0.01375 P:0.00860 F:0.01058
51 ROUGE-4 Eval D0726-C.M.100.F-E.51 R:0.00347 P:0.00215 F:0.00265
51 ROUGE-4 Eval D0726-C.M.100.F-F.51 R:0.01399 P:0.00860 F:0.01065
51 ROUGE-4 Eval D0726-C.M.100.F-G.51 R:0.01014 P:0.00645 F:0.00788
51 ROUGE-4 Eval D0727-A.M.100.G-A.51 R:0.06507 P:0.03725 F:0.04738
51 ROUGE-4 Eval D0727-A.M.100.G-F.51 R:0.07119 P:0.04118 F:0.05218
51 ROUGE-4 Eval D0727-A.M.100.G-G.51 R:0.00673 P:0.00392 F:0.00495
51 ROUGE-4 Eval D0727-A.M.100.G-H.51 R:0.07119 P:0.04118 F:0.05218
51 ROUGE-4 Eval D0727-B.M.100.G-A.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0727-B.M.100.G-F.51 R:0.00669 P:0.00397 F:0.00498
51 ROUGE-4 Eval D0727-B.M.100.G-G.51 R:0.00714 P:0.00397 F:0.00510
51 ROUGE-4 Eval D0727-B.M.100.G-H.51 R:0.00709 P:0.00397 F:0.00509
51 ROUGE-4 Eval D0727-C.M.100.G-A.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0727-C.M.100.G-F.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0727-C.M.100.G-G.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0727-C.M.100.G-H.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0736-A.M.100.H-G.51 R:0.01111 P:0.00662 F:0.00830
51 ROUGE-4 Eval D0736-A.M.100.H-H.51 R:0.00755 P:0.00442 F:0.00558
51 ROUGE-4 Eval D0736-A.M.100.H-I.51 R:0.00735 P:0.00442 F:0.00552
51 ROUGE-4 Eval D0736-A.M.100.H-J.51 R:0.00673 P:0.00442 F:0.00534
51 ROUGE-4 Eval D0736-B.M.100.H-G.51 R:0.01581 P:0.00871 F:0.01123
51 ROUGE-4 Eval D0736-B.M.100.H-H.51 R:0.09871 P:0.05011 F:0.06647
51 ROUGE-4 Eval D0736-B.M.100.H-I.51 R:0.10870 P:0.05447 F:0.07257
51 ROUGE-4 Eval D0736-B.M.100.H-J.51 R:0.09386 P:0.05664 F:0.07065
51 ROUGE-4 Eval D0736-C.M.100.H-G.51 R:0.02193 P:0.01004 F:0.01377
51 ROUGE-4 Eval D0736-C.M.100.H-H.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0736-C.M.100.H-I.51 R:0.02809 P:0.01004 F:0.01479
51 ROUGE-4 Eval D0736-C.M.100.H-J.51 R:0.01953 P:0.01004 F:0.01326
51 ROUGE-4 Eval D0740-A.M.100.I-D.51 R:0.00680 P:0.00454 F:0.00544
51 ROUGE-4 Eval D0740-A.M.100.I-H.51 R:0.00673 P:0.00454 F:0.00542
51 ROUGE-4 Eval D0740-A.M.100.I-I.51 R:0.00334 P:0.00227 F:0.00270
51 ROUGE-4 Eval D0740-A.M.100.I-J.51 R:0.00332 P:0.00227 F:0.00270
51 ROUGE-4 Eval D0740-B.M.100.I-D.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0740-B.M.100.I-H.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0740-B.M.100.I-I.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0740-B.M.100.I-J.51 R:0.00000 P:0.00000 F:0.00000
51 ROUGE-4 Eval D0740-C.M.100.I-D.51 R:0.01645 P:0.01082 F:0.01305
51 ROUGE-4 Eval D0740-C.M.100.I-H.51 R:0.01656 P:0.01082 F:0.01309
51 ROUGE-4 Eval D0740-C.M.100.I-I.51 R:0.02632 P:0.01732 F:0.02089
51 ROUGE-4 Eval D0740-C.M.100.I-J.51 R:0.02951 P:0.01948 F:0.02347
51 ROUGE-4 Eval D0743-A.M.100.J-B.51 R:0.02614 P:0.01515 F:0.01918
51 ROUGE-4 Eval D0743-A.M.100.J-H.51 R:0.00952 P:0.00568 F:0.00711
51 ROUGE-4 Eval D0743-A.M.100.J-I.51 R:0.01608 P:0.00947 F:0.01192
51 ROUGE-4 Eval D0743-A.M.100.J-J.51 R:0.02532 P:0.01515 F:0.01896
51 ROUGE-4 Eval D0743-B.M.100.J-B.51 R:0.01650 P:0.00947 F:0.01203
51 ROUGE-4 Eval D0743-B.M.100.J-H.51 R:0.00974 P:0.00568 F:0.00718
51 ROUGE-4 Eval D0743-B.M.100.J-I.51 R:0.01629 P:0.00947 F:0.01198
51 ROUGE-4 Eval D0743-B.M.100.J-J.51 R:0.00641 P:0.00379 F:0.00476
51 ROUGE-4 Eval D0743-C.M.100.J-B.51 R:0.01634 P:0.01022 F:0.01257
51 ROUGE-4 Eval D0743-C.M.100.J-H.51 R:0.00328 P:0.00204 F:0.00252
51 ROUGE-4 Eval D0743-C.M.100.J-I.51 R:0.01645 P:0.01022 F:0.01261
51 ROUGE-4 Eval D0743-C.M.100.J-J.51 R:0.01294 P:0.00818 F:0.01002
---------------------------------------------
51 ROUGE-L Average_R: 0.30333 (95%-conf.int. 0.29534 - 0.31193)
51 ROUGE-L Average_P: 0.19401 (95%-conf.int. 0.18839 - 0.19956)
51 ROUGE-L Average_F: 0.23613 (95%-conf.int. 0.22962 - 0.24239)
.............................................
51 ROUGE-L Eval D0703-A.M.100.A-A.51 R:0.30405 P:0.18987 F:0.23376
51 ROUGE-L Eval D0703-A.M.100.A-C.51 R:0.24832 P:0.15612 F:0.19171
51 ROUGE-L Eval D0703-A.M.100.A-D.51 R:0.27835 P:0.17089 F:0.21177
51 ROUGE-L Eval D0703-A.M.100.A-J.51 R:0.29932 P:0.18565 F:0.22916
51 ROUGE-L Eval D0703-B.M.100.A-A.51 R:0.32026 P:0.23005 F:0.26776
51 ROUGE-L Eval D0703-B.M.100.A-C.51 R:0.31879 P:0.22300 F:0.26243
51 ROUGE-L Eval D0703-B.M.100.A-D.51 R:0.29195 P:0.20423 F:0.24034
51 ROUGE-L Eval D0703-B.M.100.A-J.51 R:0.29568 P:0.20892 F:0.24484
51 ROUGE-L Eval D0703-C.M.100.A-A.51 R:0.26667 P:0.18519 F:0.21858
51 ROUGE-L Eval D0703-C.M.100.A-C.51 R:0.26623 P:0.18981 F:0.22162
51 ROUGE-L Eval D0703-C.M.100.A-D.51 R:0.27152 P:0.18981 F:0.22343
51 ROUGE-L Eval D0703-C.M.100.A-J.51 R:0.28477 P:0.19907 F:0.23433
51 ROUGE-L Eval D0706-A.M.100.B-B.51 R:0.34740 P:0.22292 F:0.27158
51 ROUGE-L Eval D0706-A.M.100.B-D.51 R:0.33007 P:0.21042 F:0.25700
51 ROUGE-L Eval D0706-A.M.100.B-E.51 R:0.33442 P:0.21458 F:0.26142
51 ROUGE-L Eval D0706-A.M.100.B-I.51 R:0.33442 P:0.21458 F:0.26142
51 ROUGE-L Eval D0706-B.M.100.B-B.51 R:0.27124 P:0.17622 F:0.21364
51 ROUGE-L Eval D0706-B.M.100.B-D.51 R:0.25733 P:0.16773 F:0.20309
51 ROUGE-L Eval D0706-B.M.100.B-E.51 R:0.23701 P:0.15499 F:0.18742
51 ROUGE-L Eval D0706-B.M.100.B-I.51 R:0.29773 P:0.19533 F:0.23590
51 ROUGE-L Eval D0706-C.M.100.B-B.51 R:0.29032 P:0.17964 F:0.22195
51 ROUGE-L Eval D0706-C.M.100.B-D.51 R:0.27742 P:0.17166 F:0.21209
51 ROUGE-L Eval D0706-C.M.100.B-E.51 R:0.29808 P:0.18563 F:0.22878
51 ROUGE-L Eval D0706-C.M.100.B-I.51 R:0.30990 P:0.19361 F:0.23833
51 ROUGE-L Eval D0711-A.M.100.C-A.51 R:0.41118 P:0.27594 F:0.33025
51 ROUGE-L Eval D0711-A.M.100.C-B.51 R:0.43667 P:0.28918 F:0.34794
51 ROUGE-L Eval D0711-A.M.100.C-C.51 R:0.41667 P:0.27594 F:0.33201
51 ROUGE-L Eval D0711-A.M.100.C-F.51 R:0.41722 P:0.27815 F:0.33378
51 ROUGE-L Eval D0711-B.M.100.C-A.51 R:0.30612 P:0.19737 F:0.24000
51 ROUGE-L Eval D0711-B.M.100.C-B.51 R:0.31164 P:0.19956 F:0.24331
51 ROUGE-L Eval D0711-B.M.100.C-C.51 R:0.30537 P:0.19956 F:0.24138
51 ROUGE-L Eval D0711-B.M.100.C-F.51 R:0.29831 P:0.19298 F:0.23435
51 ROUGE-L Eval D0711-C.M.100.C-A.51 R:0.32013 P:0.21413 F:0.25661
51 ROUGE-L Eval D0711-C.M.100.C-B.51 R:0.30717 P:0.19868 F:0.24129
51 ROUGE-L Eval D0711-C.M.100.C-C.51 R:0.28378 P:0.18543 F:0.22430
51 ROUGE-L Eval D0711-C.M.100.C-F.51 R:0.28041 P:0.18322 F:0.22163
51 ROUGE-L Eval D0716-A.M.100.D-C.51 R:0.28197 P:0.19635 F:0.23150
51 ROUGE-L Eval D0716-A.M.100.D-D.51 R:0.25333 P:0.17352 F:0.20596
51 ROUGE-L Eval D0716-A.M.100.D-E.51 R:0.28571 P:0.19635 F:0.23275
51 ROUGE-L Eval D0716-A.M.100.D-F.51 R:0.28053 P:0.19406 F:0.22942
51 ROUGE-L Eval D0716-B.M.100.D-C.51 R:0.23355 P:0.16550 F:0.19372
51 ROUGE-L Eval D0716-B.M.100.D-D.51 R:0.23490 P:0.16317 F:0.19257
51 ROUGE-L Eval D0716-B.M.100.D-E.51 R:0.23256 P:0.16317 F:0.19178
51 ROUGE-L Eval D0716-B.M.100.D-F.51 R:0.22667 P:0.15851 F:0.18656
51 ROUGE-L Eval D0716-C.M.100.D-C.51 R:0.35505 P:0.23593 F:0.28348
51 ROUGE-L Eval D0716-C.M.100.D-D.51 R:0.33779 P:0.21861 F:0.26544
51 ROUGE-L Eval D0716-C.M.100.D-E.51 R:0.33993 P:0.22294 F:0.26928
51 ROUGE-L Eval D0716-C.M.100.D-F.51 R:0.34667 P:0.22511 F:0.27297
51 ROUGE-L Eval D0721-A.M.100.E-B.51 R:0.28667 P:0.17695 F:0.21883
51 ROUGE-L Eval D0721-A.M.100.E-C.51 R:0.27922 P:0.17695 F:0.21662
51 ROUGE-L Eval D0721-A.M.100.E-E.51 R:0.27597 P:0.17490 F:0.21411
51 ROUGE-L Eval D0721-A.M.100.E-G.51 R:0.27070 P:0.17490 F:0.21250
51 ROUGE-L Eval D0721-B.M.100.E-B.51 R:0.32248 P:0.22000 F:0.26156
51 ROUGE-L Eval D0721-B.M.100.E-C.51 R:0.32166 P:0.22444 F:0.26440
51 ROUGE-L Eval D0721-B.M.100.E-E.51 R:0.31803 P:0.21556 F:0.25696
51 ROUGE-L Eval D0721-B.M.100.E-G.51 R:0.30968 P:0.21333 F:0.25263
51 ROUGE-L Eval D0721-C.M.100.E-B.51 R:0.33443 P:0.24286 F:0.28138
51 ROUGE-L Eval D0721-C.M.100.E-C.51 R:0.26733 P:0.19286 F:0.22407
51 ROUGE-L Eval D0721-C.M.100.E-E.51 R:0.29333 P:0.20952 F:0.24444
51 ROUGE-L Eval D0721-C.M.100.E-G.51 R:0.29967 P:0.21905 F:0.25309
51 ROUGE-L Eval D0726-A.M.100.F-A.51 R:0.30233 P:0.20776 F:0.24628
51 ROUGE-L Eval D0726-A.M.100.F-E.51 R:0.31000 P:0.21233 F:0.25203
51 ROUGE-L Eval D0726-A.M.100.F-F.51 R:0.31561 P:0.21689 F:0.25710
51 ROUGE-L Eval D0726-A.M.100.F-G.51 R:0.31894 P:0.21918 F:0.25981
51 ROUGE-L Eval D0726-B.M.100.F-A.51 R:0.26471 P:0.19286 F:0.22314
51 ROUGE-L Eval D0726-B.M.100.F-E.51 R:0.26910 P:0.19286 F:0.22469
51 ROUGE-L Eval D0726-B.M.100.F-F.51 R:0.27575 P:0.19762 F:0.23024
51 ROUGE-L Eval D0726-B.M.100.F-G.51 R:0.26974 P:0.19524 F:0.22652
51 ROUGE-L Eval D0726-C.M.100.F-A.51 R:0.29333 P:0.18565 F:0.22739
51 ROUGE-L Eval D0726-C.M.100.F-E.51 R:0.27946 P:0.17511 F:0.21531
51 ROUGE-L Eval D0726-C.M.100.F-F.51 R:0.31186 P:0.19409 F:0.23927
51 ROUGE-L Eval D0726-C.M.100.F-G.51 R:0.32787 P:0.21097 F:0.25674
51 ROUGE-L Eval D0727-A.M.100.G-A.51 R:0.46512 P:0.26975 F:0.34146
51 ROUGE-L Eval D0727-A.M.100.G-F.51 R:0.44737 P:0.26204 F:0.33050
51 ROUGE-L Eval D0727-A.M.100.G-G.51 R:0.38562 P:0.22736 F:0.28606
51 ROUGE-L Eval D0727-A.M.100.G-H.51 R:0.46053 P:0.26975 F:0.34022
51 ROUGE-L Eval D0727-B.M.100.G-A.51 R:0.31615 P:0.17934 F:0.22886
51 ROUGE-L Eval D0727-B.M.100.G-F.51 R:0.32143 P:0.19298 F:0.24117
51 ROUGE-L Eval D0727-B.M.100.G-G.51 R:0.30450 P:0.17154 F:0.21945
51 ROUGE-L Eval D0727-B.M.100.G-H.51 R:0.31959 P:0.18129 F:0.23135
51 ROUGE-L Eval D0727-C.M.100.G-A.51 R:0.31596 P:0.20083 F:0.24557
51 ROUGE-L Eval D0727-C.M.100.G-F.51 R:0.31987 P:0.19669 F:0.24359
51 ROUGE-L Eval D0727-C.M.100.G-G.51 R:0.32013 P:0.20083 F:0.24682
51 ROUGE-L Eval D0727-C.M.100.G-H.51 R:0.31081 P:0.19048 F:0.23620
51 ROUGE-L Eval D0736-A.M.100.H-G.51 R:0.28674 P:0.17316 F:0.21592
51 ROUGE-L Eval D0736-A.M.100.H-H.51 R:0.27007 P:0.16017 F:0.20108
51 ROUGE-L Eval D0736-A.M.100.H-I.51 R:0.30605 P:0.18615 F:0.23150
51 ROUGE-L Eval D0736-A.M.100.H-J.51 R:0.28431 P:0.18831 F:0.22656
51 ROUGE-L Eval D0736-B.M.100.H-G.51 R:0.30153 P:0.16880 F:0.21644
51 ROUGE-L Eval D0736-B.M.100.H-H.51 R:0.35124 P:0.18162 F:0.23943
51 ROUGE-L Eval D0736-B.M.100.H-I.51 R:0.39749 P:0.20299 F:0.26874
51 ROUGE-L Eval D0736-B.M.100.H-J.51 R:0.37413 P:0.22863 F:0.28382
51 ROUGE-L Eval D0736-C.M.100.H-G.51 R:0.30380 P:0.14201 F:0.19355
51 ROUGE-L Eval D0736-C.M.100.H-H.51 R:0.20856 P:0.07692 F:0.11239
51 ROUGE-L Eval D0736-C.M.100.H-I.51 R:0.35829 P:0.13215 F:0.19308
51 ROUGE-L Eval D0736-C.M.100.H-J.51 R:0.29057 P:0.15187 F:0.19948
51 ROUGE-L Eval D0740-A.M.100.I-D.51 R:0.31023 P:0.20889 F:0.24967
51 ROUGE-L Eval D0740-A.M.100.I-H.51 R:0.31373 P:0.21333 F:0.25397
51 ROUGE-L Eval D0740-A.M.100.I-I.51 R:0.28896 P:0.19778 F:0.23483
51 ROUGE-L Eval D0740-A.M.100.I-J.51 R:0.31935 P:0.22000 F:0.26052
51 ROUGE-L Eval D0740-B.M.100.I-D.51 R:0.21753 P:0.14135 F:0.17135
51 ROUGE-L Eval D0740-B.M.100.I-H.51 R:0.24503 P:0.15612 F:0.19072
51 ROUGE-L Eval D0740-B.M.100.I-I.51 R:0.23934 P:0.15401 F:0.18742
51 ROUGE-L Eval D0740-B.M.100.I-J.51 R:0.22977 P:0.14979 F:0.18135
51 ROUGE-L Eval D0740-C.M.100.I-D.51 R:0.28435 P:0.18896 F:0.22704
51 ROUGE-L Eval D0740-C.M.100.I-H.51 R:0.27653 P:0.18259 F:0.21995
51 ROUGE-L Eval D0740-C.M.100.I-I.51 R:0.27476 P:0.18259 F:0.21939
51 ROUGE-L Eval D0740-C.M.100.I-J.51 R:0.29618 P:0.19745 F:0.23694
51 ROUGE-L Eval D0743-A.M.100.J-B.51 R:0.30476 P:0.17877 F:0.22535
51 ROUGE-L Eval D0743-A.M.100.J-H.51 R:0.29012 P:0.17505 F:0.21835
51 ROUGE-L Eval D0743-A.M.100.J-I.51 R:0.29063 P:0.17318 F:0.21703
51 ROUGE-L Eval D0743-A.M.100.J-J.51 R:0.30154 P:0.18250 F:0.22738
51 ROUGE-L Eval D0743-B.M.100.J-B.51 R:0.31410 P:0.18250 F:0.23086
51 ROUGE-L Eval D0743-B.M.100.J-H.51 R:0.30284 P:0.17877 F:0.22482
51 ROUGE-L Eval D0743-B.M.100.J-I.51 R:0.32278 P:0.18994 F:0.23915
51 ROUGE-L Eval D0743-B.M.100.J-J.51 R:0.29283 P:0.17505 F:0.21912
51 ROUGE-L Eval D0743-C.M.100.J-B.51 R:0.26984 P:0.17068 F:0.20910
51 ROUGE-L Eval D0743-C.M.100.J-H.51 R:0.22930 P:0.14458 F:0.17734
51 ROUGE-L Eval D0743-C.M.100.J-I.51 R:0.27476 P:0.17269 F:0.21208
51 ROUGE-L Eval D0743-C.M.100.J-J.51 R:0.25472 P:0.16265 F:0.19853
---------------------------------------------
51 ROUGE-W-1.2 Average_R: 0.10715 (95%-conf.int. 0.10396 - 0.11057)
51 ROUGE-W-1.2 Average_P: 0.12399 (95%-conf.int. 0.12021 - 0.12768)
51 ROUGE-W-1.2 Average_F: 0.11457 (95%-conf.int. 0.11120 - 0.11795)
.............................................
51 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.51 R:0.10162 P:0.11427 F:0.10757
51 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.51 R:0.08635 P:0.09867 F:0.09210
51 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.51 R:0.09545 P:0.10804 F:0.10136
51 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.51 R:0.10664 P:0.11315 F:0.10980
51 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.51 R:0.10810 P:0.14397 F:0.12348
51 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.51 R:0.10609 P:0.14044 F:0.12087
51 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.51 R:0.09316 P:0.12223 F:0.10573
51 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.51 R:0.10501 P:0.13761 F:0.11912
51 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.51 R:0.09117 P:0.11772 F:0.10276
51 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.51 R:0.08892 P:0.11969 F:0.10204
51 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.51 R:0.08977 P:0.11910 F:0.10238
51 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.51 R:0.09953 P:0.12531 F:0.11094
51 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.51 R:0.12320 P:0.14187 F:0.13188
51 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.51 R:0.11536 P:0.13495 F:0.12439
51 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.51 R:0.11521 P:0.13406 F:0.12392
51 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.51 R:0.11727 P:0.13944 F:0.12740
51 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.51 R:0.10049 P:0.11306 F:0.10641
51 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.51 R:0.09261 P:0.10645 F:0.09905
51 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.51 R:0.08475 P:0.09782 F:0.09082
51 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.51 R:0.10247 P:0.12158 F:0.11121
51 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.51 R:0.10647 P:0.11244 F:0.10937
51 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.51 R:0.09978 P:0.10628 F:0.10293
51 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.51 R:0.11098 P:0.11708 F:0.11395
51 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.51 R:0.11469 P:0.12444 F:0.11937
51 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.51 R:0.14628 P:0.17698 F:0.16017
51 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.51 R:0.16092 P:0.19303 F:0.17552
51 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.51 R:0.15230 P:0.18112 F:0.16546
51 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.51 R:0.15145 P:0.18316 F:0.16580
51 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.51 R:0.10074 P:0.11589 F:0.10779
51 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.51 R:0.10128 P:0.12154 F:0.11049
51 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.51 R:0.09839 P:0.12079 F:0.10845
51 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.51 R:0.09980 P:0.11991 F:0.10893
51 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.51 R:0.10344 P:0.12935 F:0.11495
51 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.51 R:0.10053 P:0.12159 F:0.11006
51 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.51 R:0.08720 P:0.10819 F:0.09657
51 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.51 R:0.09502 P:0.11966 F:0.10593
51 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.51 R:0.08633 P:0.10983 F:0.09667
51 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.51 R:0.07935 P:0.10355 F:0.08985
51 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.51 R:0.08533 P:0.10951 F:0.09592
51 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.51 R:0.08099 P:0.10655 F:0.09203
51 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.51 R:0.08208 P:0.10147 F:0.09075
51 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.51 R:0.08162 P:0.10147 F:0.09047
51 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.51 R:0.08110 P:0.10130 F:0.09008
51 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.51 R:0.07854 P:0.09722 F:0.08689
51 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.51 R:0.12744 P:0.15784 F:0.14102
51 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.51 R:0.11683 P:0.14663 F:0.13004
51 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.51 R:0.11253 P:0.14302 F:0.12596
51 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.51 R:0.12045 P:0.15214 F:0.13445
51 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.51 R:0.10567 P:0.11466 F:0.10998
51 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.51 R:0.10252 P:0.11527 F:0.10852
51 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.51 R:0.10127 P:0.11529 F:0.10783
51 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.51 R:0.10063 P:0.11393 F:0.10687
51 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.51 R:0.10822 P:0.14273 F:0.12310
51 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.51 R:0.10612 P:0.13917 F:0.12042
51 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.51 R:0.10555 P:0.14042 F:0.12051
51 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.51 R:0.10090 P:0.13873 F:0.11683
51 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.51 R:0.12374 P:0.16538 F:0.14156
51 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.51 R:0.09791 P:0.13289 F:0.11275
51 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.51 R:0.11120 P:0.14824 F:0.12708
51 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.51 R:0.10931 P:0.14942 F:0.12626
51 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.51 R:0.10955 P:0.13341 F:0.12031
51 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.51 R:0.11611 P:0.13932 F:0.12666
51 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.51 R:0.11503 P:0.14080 F:0.12662
51 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.51 R:0.11589 P:0.14416 F:0.12849
51 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.51 R:0.09593 P:0.12294 F:0.10777
51 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.51 R:0.09381 P:0.12137 F:0.10583
51 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.51 R:0.09787 P:0.12744 F:0.11071
51 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.51 R:0.09438 P:0.12334 F:0.10693
51 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.51 R:0.10224 P:0.11363 F:0.10763
51 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.51 R:0.09556 P:0.10568 F:0.10037
51 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.51 R:0.10708 P:0.11934 F:0.11288
51 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.51 R:0.11087 P:0.12774 F:0.11871
51 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.51 R:0.16871 P:0.17222 F:0.17045
51 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.51 R:0.16144 P:0.17261 F:0.16684
51 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.51 R:0.13103 P:0.13683 F:0.13387
51 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.51 R:0.16294 P:0.17108 F:0.16691
51 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.51 R:0.11145 P:0.11093 F:0.11119
51 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.51 R:0.11235 P:0.12117 F:0.11659
51 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.51 R:0.11252 P:0.11353 F:0.11302
51 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.51 R:0.11684 P:0.11732 F:0.11708
51 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.51 R:0.11004 P:0.12578 F:0.11738
51 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.51 R:0.11038 P:0.12544 F:0.11743
51 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.51 R:0.11078 P:0.12793 F:0.11874
51 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.51 R:0.10856 P:0.11975 F:0.11388
51 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.51 R:0.10957 P:0.11717 F:0.11324
51 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.51 R:0.09952 P:0.10379 F:0.10161
51 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.51 R:0.11375 P:0.12362 F:0.11848
51 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.51 R:0.10586 P:0.12500 F:0.11464
51 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.51 R:0.10454 P:0.10833 F:0.10640
51 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.51 R:0.13626 P:0.13036 F:0.13324
51 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.51 R:0.15372 P:0.14499 F:0.14923
51 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.51 R:0.13830 P:0.15624 F:0.14672
51 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.51 R:0.12147 P:0.10315 F:0.11156
51 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.51 R:0.08001 P:0.05516 F:0.06530
51 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.51 R:0.14535 P:0.09780 F:0.11693
51 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.51 R:0.11471 P:0.10698 F:0.11071
51 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.51 R:0.10478 P:0.12977 F:0.11594
51 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.51 R:0.10689 P:0.13113 F:0.11778
51 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.51 R:0.09797 P:0.12404 F:0.10947
51 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.51 R:0.11153 P:0.14115 F:0.12460
51 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.51 R:0.07706 P:0.09200 F:0.08387
51 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.51 R:0.08989 P:0.10191 F:0.09552
51 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.51 R:0.08284 P:0.10016 F:0.09068
51 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.51 R:0.08359 P:0.09742 F:0.08998
51 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.51 R:0.09654 P:0.12381 F:0.10849
51 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.51 R:0.09665 P:0.11910 F:0.10671
51 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.51 R:0.09276 P:0.12055 F:0.10484
51 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.51 R:0.10018 P:0.12798 F:0.11239
51 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.51 R:0.10437 P:0.10672 F:0.10553
51 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.51 R:0.09736 P:0.10147 F:0.09937
51 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.51 R:0.10444 P:0.11044 F:0.10736
51 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.51 R:0.10393 P:0.10919 F:0.10650
51 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.51 R:0.11888 P:0.11567 F:0.11725
51 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.51 R:0.11638 P:0.11393 F:0.11514
51 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.51 R:0.12364 P:0.12261 F:0.12312
51 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.51 R:0.11400 P:0.11204 F:0.11301
51 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.51 R:0.10159 P:0.11249 F:0.10676
51 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.51 R:0.08930 P:0.09403 F:0.09160
51 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.51 R:0.10151 P:0.11369 F:0.10726
51 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.51 R:0.09915 P:0.10656 F:0.10272
---------------------------------------------
51 ROUGE-SU4 Average_R: 0.11912 (95%-conf.int. 0.11337 - 0.12517)
51 ROUGE-SU4 Average_P: 0.07536 (95%-conf.int. 0.07161 - 0.07900)
51 ROUGE-SU4 Average_F: 0.09210 (95%-conf.int. 0.08758 - 0.09652)
.............................................
51 ROUGE-SU4 Eval D0703-A.M.100.A-A.51 R:0.12847 P:0.07940 F:0.09814
51 ROUGE-SU4 Eval D0703-A.M.100.A-C.51 R:0.08736 P:0.05436 F:0.06702
51 ROUGE-SU4 Eval D0703-A.M.100.A-D.51 R:0.11720 P:0.07117 F:0.08856
51 ROUGE-SU4 Eval D0703-A.M.100.A-J.51 R:0.12063 P:0.07403 F:0.09175
51 ROUGE-SU4 Eval D0703-B.M.100.A-A.51 R:0.12472 P:0.08892 F:0.10382
51 ROUGE-SU4 Eval D0703-B.M.100.A-C.51 R:0.12586 P:0.08732 F:0.10311
51 ROUGE-SU4 Eval D0703-B.M.100.A-D.51 R:0.11149 P:0.07735 F:0.09133
51 ROUGE-SU4 Eval D0703-B.M.100.A-J.51 R:0.11433 P:0.08014 F:0.09423
51 ROUGE-SU4 Eval D0703-C.M.100.A-A.51 R:0.10845 P:0.07469 F:0.08846
51 ROUGE-SU4 Eval D0703-C.M.100.A-C.51 R:0.10722 P:0.07586 F:0.08885
51 ROUGE-SU4 Eval D0703-C.M.100.A-D.51 R:0.10601 P:0.07351 F:0.08682
51 ROUGE-SU4 Eval D0703-C.M.100.A-J.51 R:0.10884 P:0.07547 F:0.08913
51 ROUGE-SU4 Eval D0706-A.M.100.B-B.51 R:0.14389 P:0.09145 F:0.11183
51 ROUGE-SU4 Eval D0706-A.M.100.B-D.51 R:0.13870 P:0.08757 F:0.10736
51 ROUGE-SU4 Eval D0706-A.M.100.B-E.51 R:0.13167 P:0.08369 F:0.10234
51 ROUGE-SU4 Eval D0706-A.M.100.B-I.51 R:0.14000 P:0.08898 F:0.10881
51 ROUGE-SU4 Eval D0706-B.M.100.B-B.51 R:0.09676 P:0.06228 F:0.07578
51 ROUGE-SU4 Eval D0706-B.M.100.B-D.51 R:0.08473 P:0.05472 F:0.06650
51 ROUGE-SU4 Eval D0706-B.M.100.B-E.51 R:0.08111 P:0.05256 F:0.06379
51 ROUGE-SU4 Eval D0706-B.M.100.B-I.51 R:0.10631 P:0.06911 F:0.08377
51 ROUGE-SU4 Eval D0706-C.M.100.B-B.51 R:0.10706 P:0.06558 F:0.08134
51 ROUGE-SU4 Eval D0706-C.M.100.B-D.51 R:0.10375 P:0.06356 F:0.07883
51 ROUGE-SU4 Eval D0706-C.M.100.B-E.51 R:0.11732 P:0.07235 F:0.08950
51 ROUGE-SU4 Eval D0706-C.M.100.B-I.51 R:0.12350 P:0.07640 F:0.09440
51 ROUGE-SU4 Eval D0711-A.M.100.C-A.51 R:0.18074 P:0.12022 F:0.14440
51 ROUGE-SU4 Eval D0711-A.M.100.C-B.51 R:0.20491 P:0.13446 F:0.16237
51 ROUGE-SU4 Eval D0711-A.M.100.C-C.51 R:0.19977 P:0.13109 F:0.15830
51 ROUGE-SU4 Eval D0711-A.M.100.C-F.51 R:0.19161 P:0.12659 F:0.15246
51 ROUGE-SU4 Eval D0711-B.M.100.C-A.51 R:0.10256 P:0.06548 F:0.07993
51 ROUGE-SU4 Eval D0711-B.M.100.C-B.51 R:0.11150 P:0.07068 F:0.08652
51 ROUGE-SU4 Eval D0711-B.M.100.C-C.51 R:0.10517 P:0.06808 F:0.08265
51 ROUGE-SU4 Eval D0711-B.M.100.C-F.51 R:0.09408 P:0.06027 F:0.07347
51 ROUGE-SU4 Eval D0711-C.M.100.C-A.51 R:0.14011 P:0.09288 F:0.11171
51 ROUGE-SU4 Eval D0711-C.M.100.C-B.51 R:0.13158 P:0.08427 F:0.10274
51 ROUGE-SU4 Eval D0711-C.M.100.C-C.51 R:0.10532 P:0.06816 F:0.08276
51 ROUGE-SU4 Eval D0711-C.M.100.C-F.51 R:0.11748 P:0.07603 F:0.09232
51 ROUGE-SU4 Eval D0716-A.M.100.D-C.51 R:0.10774 P:0.07442 F:0.08803
51 ROUGE-SU4 Eval D0716-A.M.100.D-D.51 R:0.09247 P:0.06279 F:0.07479
51 ROUGE-SU4 Eval D0716-A.M.100.D-E.51 R:0.10751 P:0.07326 F:0.08714
51 ROUGE-SU4 Eval D0716-A.M.100.D-F.51 R:0.10847 P:0.07442 F:0.08828
51 ROUGE-SU4 Eval D0716-B.M.100.D-C.51 R:0.07264 P:0.05107 F:0.05997
51 ROUGE-SU4 Eval D0716-B.M.100.D-D.51 R:0.07299 P:0.05028 F:0.05954
51 ROUGE-SU4 Eval D0716-B.M.100.D-E.51 R:0.07167 P:0.04988 F:0.05882
51 ROUGE-SU4 Eval D0716-B.M.100.D-F.51 R:0.07306 P:0.05067 F:0.05984
51 ROUGE-SU4 Eval D0716-C.M.100.D-C.51 R:0.16722 P:0.11013 F:0.13280
51 ROUGE-SU4 Eval D0716-C.M.100.D-D.51 R:0.15922 P:0.10206 F:0.12439
51 ROUGE-SU4 Eval D0716-C.M.100.D-E.51 R:0.15367 P:0.09985 F:0.12105
51 ROUGE-SU4 Eval D0716-C.M.100.D-F.51 R:0.16895 P:0.10866 F:0.13226
51 ROUGE-SU4 Eval D0721-A.M.100.E-B.51 R:0.10217 P:0.06241 F:0.07749
51 ROUGE-SU4 Eval D0721-A.M.100.E-C.51 R:0.10333 P:0.06485 F:0.07969
51 ROUGE-SU4 Eval D0721-A.M.100.E-E.51 R:0.10056 P:0.06311 F:0.07755
51 ROUGE-SU4 Eval D0721-A.M.100.E-G.51 R:0.09641 P:0.06172 F:0.07526
51 ROUGE-SU4 Eval D0721-B.M.100.E-B.51 R:0.13768 P:0.09314 F:0.11111
51 ROUGE-SU4 Eval D0721-B.M.100.E-C.51 R:0.12037 P:0.08333 F:0.09848
51 ROUGE-SU4 Eval D0721-B.M.100.E-E.51 R:0.13412 P:0.09012 F:0.10780
51 ROUGE-SU4 Eval D0721-B.M.100.E-G.51 R:0.12638 P:0.08635 F:0.10260
51 ROUGE-SU4 Eval D0721-C.M.100.E-B.51 R:0.14703 P:0.10599 F:0.12318
51 ROUGE-SU4 Eval D0721-C.M.100.E-C.51 R:0.11017 P:0.07888 F:0.09194
51 ROUGE-SU4 Eval D0721-C.M.100.E-E.51 R:0.13128 P:0.09304 F:0.10890
51 ROUGE-SU4 Eval D0721-C.M.100.E-G.51 R:0.12709 P:0.09223 F:0.10689
51 ROUGE-SU4 Eval D0726-A.M.100.F-A.51 R:0.11490 P:0.07829 F:0.09313
51 ROUGE-SU4 Eval D0726-A.M.100.F-E.51 R:0.12329 P:0.08372 F:0.09972
51 ROUGE-SU4 Eval D0726-A.M.100.F-F.51 R:0.12856 P:0.08760 F:0.10420
51 ROUGE-SU4 Eval D0726-A.M.100.F-G.51 R:0.12514 P:0.08527 F:0.10143
51 ROUGE-SU4 Eval D0726-B.M.100.F-A.51 R:0.10011 P:0.07241 F:0.08404
51 ROUGE-SU4 Eval D0726-B.M.100.F-E.51 R:0.09443 P:0.06715 F:0.07849
51 ROUGE-SU4 Eval D0726-B.M.100.F-F.51 R:0.10466 P:0.07443 F:0.08699
51 ROUGE-SU4 Eval D0726-B.M.100.F-G.51 R:0.10248 P:0.07362 F:0.08569
51 ROUGE-SU4 Eval D0726-C.M.100.F-A.51 R:0.10845 P:0.06795 F:0.08355
51 ROUGE-SU4 Eval D0726-C.M.100.F-E.51 R:0.09631 P:0.05973 F:0.07373
51 ROUGE-SU4 Eval D0726-C.M.100.F-F.51 R:0.11731 P:0.07225 F:0.08942
51 ROUGE-SU4 Eval D0726-C.M.100.F-G.51 R:0.11560 P:0.07368 F:0.09000
51 ROUGE-SU4 Eval D0727-A.M.100.G-A.51 R:0.22526 P:0.12916 F:0.16418
51 ROUGE-SU4 Eval D0727-A.M.100.G-F.51 R:0.22691 P:0.13144 F:0.16646
51 ROUGE-SU4 Eval D0727-A.M.100.G-G.51 R:0.15436 P:0.09002 F:0.11372
51 ROUGE-SU4 Eval D0727-A.M.100.G-H.51 R:0.22748 P:0.13177 F:0.16688
51 ROUGE-SU4 Eval D0727-B.M.100.G-A.51 R:0.09717 P:0.05446 F:0.06980
51 ROUGE-SU4 Eval D0727-B.M.100.G-F.51 R:0.11333 P:0.06733 F:0.08447
51 ROUGE-SU4 Eval D0727-B.M.100.G-G.51 R:0.10380 P:0.05776 F:0.07422
51 ROUGE-SU4 Eval D0727-B.M.100.G-H.51 R:0.11072 P:0.06205 F:0.07953
51 ROUGE-SU4 Eval D0727-C.M.100.G-A.51 R:0.12319 P:0.07754 F:0.09517
51 ROUGE-SU4 Eval D0727-C.M.100.G-F.51 R:0.13379 P:0.08140 F:0.10122
51 ROUGE-SU4 Eval D0727-C.M.100.G-G.51 R:0.12994 P:0.08070 F:0.09956
51 ROUGE-SU4 Eval D0727-C.M.100.G-H.51 R:0.11343 P:0.06877 F:0.08563
51 ROUGE-SU4 Eval D0736-A.M.100.H-G.51 R:0.10886 P:0.06498 F:0.08138
51 ROUGE-SU4 Eval D0736-A.M.100.H-H.51 R:0.09461 P:0.05543 F:0.06990
51 ROUGE-SU4 Eval D0736-A.M.100.H-I.51 R:0.10806 P:0.06498 F:0.08116
51 ROUGE-SU4 Eval D0736-A.M.100.H-J.51 R:0.10347 P:0.06791 F:0.08200
51 ROUGE-SU4 Eval D0736-B.M.100.H-G.51 R:0.12336 P:0.06812 F:0.08777
51 ROUGE-SU4 Eval D0736-B.M.100.H-H.51 R:0.19872 P:0.10109 F:0.13401
51 ROUGE-SU4 Eval D0736-B.M.100.H-I.51 R:0.22150 P:0.11123 F:0.14809
51 ROUGE-SU4 Eval D0736-B.M.100.H-J.51 R:0.19964 P:0.12065 F:0.15040
51 ROUGE-SU4 Eval D0736-C.M.100.H-G.51 R:0.12082 P:0.05544 F:0.07600
51 ROUGE-SU4 Eval D0736-C.M.100.H-H.51 R:0.06331 P:0.02271 F:0.03343
51 ROUGE-SU4 Eval D0736-C.M.100.H-I.51 R:0.14991 P:0.05377 F:0.07915
51 ROUGE-SU4 Eval D0736-C.M.100.H-J.51 R:0.10571 P:0.05444 F:0.07187
51 ROUGE-SU4 Eval D0740-A.M.100.I-D.51 R:0.12429 P:0.08296 F:0.09950
51 ROUGE-SU4 Eval D0740-A.M.100.I-H.51 R:0.12584 P:0.08484 F:0.10135
51 ROUGE-SU4 Eval D0740-A.M.100.I-I.51 R:0.11500 P:0.07805 F:0.09299
51 ROUGE-SU4 Eval D0740-A.M.100.I-J.51 R:0.12528 P:0.08560 F:0.10171
51 ROUGE-SU4 Eval D0740-B.M.100.I-D.51 R:0.05556 P:0.03577 F:0.04352
51 ROUGE-SU4 Eval D0740-B.M.100.I-H.51 R:0.06519 P:0.04113 F:0.05044
51 ROUGE-SU4 Eval D0740-B.M.100.I-I.51 R:0.06846 P:0.04363 F:0.05329
51 ROUGE-SU4 Eval D0740-B.M.100.I-J.51 R:0.06257 P:0.04041 F:0.04911
51 ROUGE-SU4 Eval D0740-C.M.100.I-D.51 R:0.10984 P:0.07235 F:0.08724
51 ROUGE-SU4 Eval D0740-C.M.100.I-H.51 R:0.10121 P:0.06623 F:0.08007
51 ROUGE-SU4 Eval D0740-C.M.100.I-I.51 R:0.10929 P:0.07199 F:0.08680
51 ROUGE-SU4 Eval D0740-C.M.100.I-J.51 R:0.12255 P:0.08099 F:0.09753
51 ROUGE-SU4 Eval D0743-A.M.100.J-B.51 R:0.11726 P:0.06805 F:0.08612
51 ROUGE-SU4 Eval D0743-A.M.100.J-H.51 R:0.09019 P:0.05388 F:0.06746
51 ROUGE-SU4 Eval D0743-A.M.100.J-I.51 R:0.10363 P:0.06112 F:0.07689
51 ROUGE-SU4 Eval D0743-A.M.100.J-J.51 R:0.11094 P:0.06648 F:0.08314
51 ROUGE-SU4 Eval D0743-B.M.100.J-B.51 R:0.10965 P:0.06301 F:0.08003
51 ROUGE-SU4 Eval D0743-B.M.100.J-H.51 R:0.09817 P:0.05734 F:0.07239
51 ROUGE-SU4 Eval D0743-B.M.100.J-I.51 R:0.11201 P:0.06522 F:0.08244
51 ROUGE-SU4 Eval D0743-B.M.100.J-J.51 R:0.09212 P:0.05451 F:0.06849
51 ROUGE-SU4 Eval D0743-C.M.100.J-B.51 R:0.10586 P:0.06633 F:0.08156
51 ROUGE-SU4 Eval D0743-C.M.100.J-H.51 R:0.08007 P:0.05000 F:0.06156
51 ROUGE-SU4 Eval D0743-C.M.100.J-I.51 R:0.10546 P:0.06565 F:0.08092
51 ROUGE-SU4 Eval D0743-C.M.100.J-J.51 R:0.08978 P:0.05680 F:0.06958
---------------------------------------------
52 ROUGE-1 Average_R: 0.32737 (95%-conf.int. 0.31218 - 0.34240)
52 ROUGE-1 Average_P: 0.24958 (95%-conf.int. 0.24096 - 0.25786)
52 ROUGE-1 Average_F: 0.28098 (95%-conf.int. 0.27102 - 0.29084)
.............................................
52 ROUGE-1 Eval D0703-A.M.100.A-A.52 R:0.36149 P:0.27865 F:0.31471
52 ROUGE-1 Eval D0703-A.M.100.A-C.52 R:0.32550 P:0.25260 F:0.28445
52 ROUGE-1 Eval D0703-A.M.100.A-D.52 R:0.34021 P:0.25781 F:0.29333
52 ROUGE-1 Eval D0703-A.M.100.A-J.52 R:0.32653 P:0.25000 F:0.28319
52 ROUGE-1 Eval D0703-B.M.100.A-A.52 R:0.34641 P:0.33974 F:0.34304
52 ROUGE-1 Eval D0703-B.M.100.A-C.52 R:0.29866 P:0.28526 F:0.29181
52 ROUGE-1 Eval D0703-B.M.100.A-D.52 R:0.29530 P:0.28205 F:0.28852
52 ROUGE-1 Eval D0703-B.M.100.A-J.52 R:0.30565 P:0.29487 F:0.30016
52 ROUGE-1 Eval D0703-C.M.100.A-A.52 R:0.29667 P:0.24119 F:0.26607
52 ROUGE-1 Eval D0703-C.M.100.A-C.52 R:0.32143 P:0.26829 F:0.29247
52 ROUGE-1 Eval D0703-C.M.100.A-D.52 R:0.32119 P:0.26287 F:0.28912
52 ROUGE-1 Eval D0703-C.M.100.A-J.52 R:0.31788 P:0.26016 F:0.28614
52 ROUGE-1 Eval D0706-A.M.100.B-B.52 R:0.35390 P:0.24886 F:0.29223
52 ROUGE-1 Eval D0706-A.M.100.B-D.52 R:0.34967 P:0.24429 F:0.28763
52 ROUGE-1 Eval D0706-A.M.100.B-E.52 R:0.32792 P:0.23059 F:0.27077
52 ROUGE-1 Eval D0706-A.M.100.B-I.52 R:0.34416 P:0.24201 F:0.28418
52 ROUGE-1 Eval D0706-B.M.100.B-B.52 R:0.17647 P:0.19149 F:0.18367
52 ROUGE-1 Eval D0706-B.M.100.B-D.52 R:0.19218 P:0.20922 F:0.20034
52 ROUGE-1 Eval D0706-B.M.100.B-E.52 R:0.18831 P:0.20567 F:0.19661
52 ROUGE-1 Eval D0706-B.M.100.B-I.52 R:0.17476 P:0.19149 F:0.18274
52 ROUGE-1 Eval D0706-C.M.100.B-B.52 R:0.36452 P:0.25280 F:0.29855
52 ROUGE-1 Eval D0706-C.M.100.B-D.52 R:0.39355 P:0.27293 F:0.32233
52 ROUGE-1 Eval D0706-C.M.100.B-E.52 R:0.34936 P:0.24385 F:0.28722
52 ROUGE-1 Eval D0706-C.M.100.B-I.52 R:0.40575 P:0.28412 F:0.33421
52 ROUGE-1 Eval D0711-A.M.100.C-A.52 R:0.34211 P:0.22658 F:0.27261
52 ROUGE-1 Eval D0711-A.M.100.C-B.52 R:0.35333 P:0.23094 F:0.27932
52 ROUGE-1 Eval D0711-A.M.100.C-C.52 R:0.34667 P:0.22658 F:0.27405
52 ROUGE-1 Eval D0711-A.M.100.C-F.52 R:0.36093 P:0.23747 F:0.28646
52 ROUGE-1 Eval D0711-B.M.100.C-A.52 R:0.35374 P:0.31231 F:0.33174
52 ROUGE-1 Eval D0711-B.M.100.C-B.52 R:0.35616 P:0.31231 F:0.33280
52 ROUGE-1 Eval D0711-B.M.100.C-C.52 R:0.33221 P:0.29730 F:0.31379
52 ROUGE-1 Eval D0711-B.M.100.C-F.52 R:0.34237 P:0.30330 F:0.32165
52 ROUGE-1 Eval D0711-C.M.100.C-A.52 R:0.36304 P:0.33951 F:0.35088
52 ROUGE-1 Eval D0711-C.M.100.C-B.52 R:0.37884 P:0.34259 F:0.35980
52 ROUGE-1 Eval D0711-C.M.100.C-C.52 R:0.36824 P:0.33642 F:0.35161
52 ROUGE-1 Eval D0711-C.M.100.C-F.52 R:0.35473 P:0.32407 F:0.33871
52 ROUGE-1 Eval D0716-A.M.100.D-C.52 R:0.45902 P:0.32407 F:0.37992
52 ROUGE-1 Eval D0716-A.M.100.D-D.52 R:0.44667 P:0.31019 F:0.36612
52 ROUGE-1 Eval D0716-A.M.100.D-E.52 R:0.47841 P:0.33333 F:0.39291
52 ROUGE-1 Eval D0716-A.M.100.D-F.52 R:0.45215 P:0.31713 F:0.37279
52 ROUGE-1 Eval D0716-B.M.100.D-C.52 R:0.37171 P:0.27901 F:0.31876
52 ROUGE-1 Eval D0716-B.M.100.D-D.52 R:0.39597 P:0.29136 F:0.33570
52 ROUGE-1 Eval D0716-B.M.100.D-E.52 R:0.35216 P:0.26173 F:0.30028
52 ROUGE-1 Eval D0716-B.M.100.D-F.52 R:0.36667 P:0.27160 F:0.31205
52 ROUGE-1 Eval D0716-C.M.100.D-C.52 R:0.32573 P:0.23474 F:0.27285
52 ROUGE-1 Eval D0716-C.M.100.D-D.52 R:0.33445 P:0.23474 F:0.27586
52 ROUGE-1 Eval D0716-C.M.100.D-E.52 R:0.36964 P:0.26291 F:0.30727
52 ROUGE-1 Eval D0716-C.M.100.D-F.52 R:0.37000 P:0.26056 F:0.30578
52 ROUGE-1 Eval D0721-A.M.100.E-B.52 R:0.37000 P:0.28244 F:0.32034
52 ROUGE-1 Eval D0721-A.M.100.E-C.52 R:0.34416 P:0.26972 F:0.30243
52 ROUGE-1 Eval D0721-A.M.100.E-E.52 R:0.33766 P:0.26463 F:0.29672
52 ROUGE-1 Eval D0721-A.M.100.E-G.52 R:0.34395 P:0.27481 F:0.30552
52 ROUGE-1 Eval D0721-B.M.100.E-B.52 R:0.33876 P:0.27733 F:0.30498
52 ROUGE-1 Eval D0721-B.M.100.E-C.52 R:0.35669 P:0.29867 F:0.32511
52 ROUGE-1 Eval D0721-B.M.100.E-E.52 R:0.32787 P:0.26667 F:0.29412
52 ROUGE-1 Eval D0721-B.M.100.E-G.52 R:0.35484 P:0.29333 F:0.32117
52 ROUGE-1 Eval D0721-C.M.100.E-B.52 R:0.29508 P:0.30928 F:0.30201
52 ROUGE-1 Eval D0721-C.M.100.E-C.52 R:0.28053 P:0.29210 F:0.28620
52 ROUGE-1 Eval D0721-C.M.100.E-E.52 R:0.25667 P:0.26460 F:0.26057
52 ROUGE-1 Eval D0721-C.M.100.E-G.52 R:0.29316 P:0.30928 F:0.30100
52 ROUGE-1 Eval D0726-A.M.100.F-A.52 R:0.28571 P:0.24713 F:0.26502
52 ROUGE-1 Eval D0726-A.M.100.F-E.52 R:0.26000 P:0.22414 F:0.24074
52 ROUGE-1 Eval D0726-A.M.100.F-F.52 R:0.28571 P:0.24713 F:0.26502
52 ROUGE-1 Eval D0726-A.M.100.F-G.52 R:0.29568 P:0.25575 F:0.27427
52 ROUGE-1 Eval D0726-B.M.100.F-A.52 R:0.24837 P:0.20765 F:0.22619
52 ROUGE-1 Eval D0726-B.M.100.F-E.52 R:0.25581 P:0.21038 F:0.23088
52 ROUGE-1 Eval D0726-B.M.100.F-F.52 R:0.25249 P:0.20765 F:0.22789
52 ROUGE-1 Eval D0726-B.M.100.F-G.52 R:0.26316 P:0.21858 F:0.23881
52 ROUGE-1 Eval D0726-C.M.100.F-A.52 R:0.26000 P:0.23009 F:0.24413
52 ROUGE-1 Eval D0726-C.M.100.F-E.52 R:0.25253 P:0.22124 F:0.23585
52 ROUGE-1 Eval D0726-C.M.100.F-F.52 R:0.27119 P:0.23599 F:0.25237
52 ROUGE-1 Eval D0726-C.M.100.F-G.52 R:0.25902 P:0.23304 F:0.24534
52 ROUGE-1 Eval D0727-A.M.100.G-A.52 R:0.43522 P:0.29306 F:0.35027
52 ROUGE-1 Eval D0727-A.M.100.G-F.52 R:0.40461 P:0.27517 F:0.32757
52 ROUGE-1 Eval D0727-A.M.100.G-G.52 R:0.37255 P:0.25503 F:0.30279
52 ROUGE-1 Eval D0727-A.M.100.G-H.52 R:0.42763 P:0.29083 F:0.34621
52 ROUGE-1 Eval D0727-B.M.100.G-A.52 R:0.28522 P:0.26861 F:0.27667
52 ROUGE-1 Eval D0727-B.M.100.G-F.52 R:0.27273 P:0.27184 F:0.27228
52 ROUGE-1 Eval D0727-B.M.100.G-G.52 R:0.26644 P:0.24919 F:0.25753
52 ROUGE-1 Eval D0727-B.M.100.G-H.52 R:0.25430 P:0.23948 F:0.24667
52 ROUGE-1 Eval D0727-C.M.100.G-A.52 R:0.39414 P:0.25527 F:0.30986
52 ROUGE-1 Eval D0727-C.M.100.G-F.52 R:0.40067 P:0.25105 F:0.30869
52 ROUGE-1 Eval D0727-C.M.100.G-G.52 R:0.36634 P:0.23418 F:0.28572
52 ROUGE-1 Eval D0727-C.M.100.G-H.52 R:0.41554 P:0.25949 F:0.31948
52 ROUGE-1 Eval D0736-A.M.100.H-G.52 R:0.28674 P:0.20997 F:0.24242
52 ROUGE-1 Eval D0736-A.M.100.H-H.52 R:0.31022 P:0.22310 F:0.25954
52 ROUGE-1 Eval D0736-A.M.100.H-I.52 R:0.28114 P:0.20735 F:0.23867
52 ROUGE-1 Eval D0736-A.M.100.H-J.52 R:0.27124 P:0.21785 F:0.24163
52 ROUGE-1 Eval D0736-B.M.100.H-G.52 R:0.56107 P:0.32886 F:0.41467
52 ROUGE-1 Eval D0736-B.M.100.H-H.52 R:0.63636 P:0.34452 F:0.44702
52 ROUGE-1 Eval D0736-B.M.100.H-I.52 R:0.68201 P:0.36465 F:0.47522
52 ROUGE-1 Eval D0736-B.M.100.H-J.52 R:0.62238 P:0.39821 F:0.48568
52 ROUGE-1 Eval D0736-C.M.100.H-G.52 R:0.38397 P:0.18841 F:0.25278
52 ROUGE-1 Eval D0736-C.M.100.H-H.52 R:0.41711 P:0.16149 F:0.23283
52 ROUGE-1 Eval D0736-C.M.100.H-I.52 R:0.43850 P:0.16977 F:0.24477
52 ROUGE-1 Eval D0736-C.M.100.H-J.52 R:0.37736 P:0.20704 F:0.26738
52 ROUGE-1 Eval D0740-A.M.100.I-D.52 R:0.27063 P:0.18102 F:0.21694
52 ROUGE-1 Eval D0740-A.M.100.I-H.52 R:0.26471 P:0.17881 F:0.21344
52 ROUGE-1 Eval D0740-A.M.100.I-I.52 R:0.27597 P:0.18764 F:0.22339
52 ROUGE-1 Eval D0740-A.M.100.I-J.52 R:0.25484 P:0.17439 F:0.20708
52 ROUGE-1 Eval D0740-B.M.100.I-D.52 R:0.32468 P:0.22831 F:0.26810
52 ROUGE-1 Eval D0740-B.M.100.I-H.52 R:0.26821 P:0.18493 F:0.21892
52 ROUGE-1 Eval D0740-B.M.100.I-I.52 R:0.29508 P:0.20548 F:0.24226
52 ROUGE-1 Eval D0740-B.M.100.I-J.52 R:0.30744 P:0.21689 F:0.25435
52 ROUGE-1 Eval D0740-C.M.100.I-D.52 R:0.28435 P:0.20892 F:0.24087
52 ROUGE-1 Eval D0740-C.M.100.I-H.52 R:0.25080 P:0.18310 F:0.21167
52 ROUGE-1 Eval D0740-C.M.100.I-I.52 R:0.27157 P:0.19953 F:0.23004
52 ROUGE-1 Eval D0740-C.M.100.I-J.52 R:0.25796 P:0.19014 F:0.21892
52 ROUGE-1 Eval D0743-A.M.100.J-B.52 R:0.30159 P:0.22300 F:0.25641
52 ROUGE-1 Eval D0743-A.M.100.J-H.52 R:0.27778 P:0.21127 F:0.24000
52 ROUGE-1 Eval D0743-A.M.100.J-I.52 R:0.30938 P:0.23239 F:0.26541
52 ROUGE-1 Eval D0743-A.M.100.J-J.52 R:0.27077 P:0.20657 F:0.23435
52 ROUGE-1 Eval D0743-B.M.100.J-B.52 R:0.19872 P:0.17816 F:0.18788
52 ROUGE-1 Eval D0743-B.M.100.J-H.52 R:0.19243 P:0.17529 F:0.18346
52 ROUGE-1 Eval D0743-B.M.100.J-I.52 R:0.19620 P:0.17816 F:0.18675
52 ROUGE-1 Eval D0743-B.M.100.J-J.52 R:0.18069 P:0.16667 F:0.17340
52 ROUGE-1 Eval D0743-C.M.100.J-B.52 R:0.25397 P:0.20513 F:0.22695
52 ROUGE-1 Eval D0743-C.M.100.J-H.52 R:0.21338 P:0.17179 F:0.19034
52 ROUGE-1 Eval D0743-C.M.100.J-I.52 R:0.24281 P:0.19487 F:0.21621
52 ROUGE-1 Eval D0743-C.M.100.J-J.52 R:0.21384 P:0.17436 F:0.19209
---------------------------------------------
52 ROUGE-2 Average_R: 0.08051 (95%-conf.int. 0.06844 - 0.09445)
52 ROUGE-2 Average_P: 0.05840 (95%-conf.int. 0.05106 - 0.06650)
52 ROUGE-2 Average_F: 0.06705 (95%-conf.int. 0.05815 - 0.07745)
.............................................
52 ROUGE-2 Eval D0703-A.M.100.A-A.52 R:0.12287 P:0.09449 F:0.10683
52 ROUGE-2 Eval D0703-A.M.100.A-C.52 R:0.09492 P:0.07349 F:0.08284
52 ROUGE-2 Eval D0703-A.M.100.A-D.52 R:0.11111 P:0.08399 F:0.09567
52 ROUGE-2 Eval D0703-A.M.100.A-J.52 R:0.10309 P:0.07874 F:0.08928
52 ROUGE-2 Eval D0703-B.M.100.A-A.52 R:0.14521 P:0.14239 F:0.14379
52 ROUGE-2 Eval D0703-B.M.100.A-C.52 R:0.10169 P:0.09709 F:0.09934
52 ROUGE-2 Eval D0703-B.M.100.A-D.52 R:0.10508 P:0.10032 F:0.10264
52 ROUGE-2 Eval D0703-B.M.100.A-J.52 R:0.12081 P:0.11650 F:0.11862
52 ROUGE-2 Eval D0703-C.M.100.A-A.52 R:0.06397 P:0.05191 F:0.05731
52 ROUGE-2 Eval D0703-C.M.100.A-C.52 R:0.08197 P:0.06831 F:0.07452
52 ROUGE-2 Eval D0703-C.M.100.A-D.52 R:0.07692 P:0.06284 F:0.06917
52 ROUGE-2 Eval D0703-C.M.100.A-J.52 R:0.07692 P:0.06284 F:0.06917
52 ROUGE-2 Eval D0706-A.M.100.B-B.52 R:0.07541 P:0.05287 F:0.06216
52 ROUGE-2 Eval D0706-A.M.100.B-D.52 R:0.08251 P:0.05747 F:0.06775
52 ROUGE-2 Eval D0706-A.M.100.B-E.52 R:0.08525 P:0.05977 F:0.07027
52 ROUGE-2 Eval D0706-A.M.100.B-I.52 R:0.08197 P:0.05747 F:0.06757
52 ROUGE-2 Eval D0706-B.M.100.B-B.52 R:0.01650 P:0.01792 F:0.01718
52 ROUGE-2 Eval D0706-B.M.100.B-D.52 R:0.01974 P:0.02151 F:0.02059
52 ROUGE-2 Eval D0706-B.M.100.B-E.52 R:0.00984 P:0.01075 F:0.01027
52 ROUGE-2 Eval D0706-B.M.100.B-I.52 R:0.01307 P:0.01434 F:0.01368
52 ROUGE-2 Eval D0706-C.M.100.B-B.52 R:0.09446 P:0.06532 F:0.07723
52 ROUGE-2 Eval D0706-C.M.100.B-D.52 R:0.12704 P:0.08784 F:0.10386
52 ROUGE-2 Eval D0706-C.M.100.B-E.52 R:0.07120 P:0.04955 F:0.05843
52 ROUGE-2 Eval D0706-C.M.100.B-I.52 R:0.11613 P:0.08108 F:0.09549
52 ROUGE-2 Eval D0711-A.M.100.C-A.52 R:0.05316 P:0.03509 F:0.04228
52 ROUGE-2 Eval D0711-A.M.100.C-B.52 R:0.05724 P:0.03728 F:0.04515
52 ROUGE-2 Eval D0711-A.M.100.C-C.52 R:0.06061 P:0.03947 F:0.04781
52 ROUGE-2 Eval D0711-A.M.100.C-F.52 R:0.04013 P:0.02632 F:0.03179
52 ROUGE-2 Eval D0711-B.M.100.C-A.52 R:0.06529 P:0.05758 F:0.06119
52 ROUGE-2 Eval D0711-B.M.100.C-B.52 R:0.07266 P:0.06364 F:0.06785
52 ROUGE-2 Eval D0711-B.M.100.C-C.52 R:0.05085 P:0.04545 F:0.04800
52 ROUGE-2 Eval D0711-B.M.100.C-F.52 R:0.04795 P:0.04242 F:0.04502
52 ROUGE-2 Eval D0711-C.M.100.C-A.52 R:0.09333 P:0.08723 F:0.09018
52 ROUGE-2 Eval D0711-C.M.100.C-B.52 R:0.11379 P:0.10280 F:0.10802
52 ROUGE-2 Eval D0711-C.M.100.C-C.52 R:0.08532 P:0.07788 F:0.08143
52 ROUGE-2 Eval D0711-C.M.100.C-F.52 R:0.08532 P:0.07788 F:0.08143
52 ROUGE-2 Eval D0716-A.M.100.D-C.52 R:0.17219 P:0.12121 F:0.14227
52 ROUGE-2 Eval D0716-A.M.100.D-D.52 R:0.18855 P:0.13054 F:0.15427
52 ROUGE-2 Eval D0716-A.M.100.D-E.52 R:0.19128 P:0.13287 F:0.15681
52 ROUGE-2 Eval D0716-A.M.100.D-F.52 R:0.18000 P:0.12587 F:0.14815
52 ROUGE-2 Eval D0716-B.M.100.D-C.52 R:0.11296 P:0.08458 F:0.09673
52 ROUGE-2 Eval D0716-B.M.100.D-D.52 R:0.11525 P:0.08458 F:0.09756
52 ROUGE-2 Eval D0716-B.M.100.D-E.52 R:0.08389 P:0.06219 F:0.07143
52 ROUGE-2 Eval D0716-B.M.100.D-F.52 R:0.12121 P:0.08955 F:0.10300
52 ROUGE-2 Eval D0716-C.M.100.D-C.52 R:0.08553 P:0.06147 F:0.07153
52 ROUGE-2 Eval D0716-C.M.100.D-D.52 R:0.06757 P:0.04728 F:0.05563
52 ROUGE-2 Eval D0716-C.M.100.D-E.52 R:0.10333 P:0.07329 F:0.08576
52 ROUGE-2 Eval D0716-C.M.100.D-F.52 R:0.09428 P:0.06619 F:0.07778
52 ROUGE-2 Eval D0721-A.M.100.E-B.52 R:0.05724 P:0.04359 F:0.04949
52 ROUGE-2 Eval D0721-A.M.100.E-C.52 R:0.03607 P:0.02821 F:0.03166
52 ROUGE-2 Eval D0721-A.M.100.E-E.52 R:0.04590 P:0.03590 F:0.04029
52 ROUGE-2 Eval D0721-A.M.100.E-G.52 R:0.04823 P:0.03846 F:0.04279
52 ROUGE-2 Eval D0721-B.M.100.E-B.52 R:0.06250 P:0.05108 F:0.05622
52 ROUGE-2 Eval D0721-B.M.100.E-C.52 R:0.06752 P:0.05645 F:0.06149
52 ROUGE-2 Eval D0721-B.M.100.E-E.52 R:0.04967 P:0.04032 F:0.04451
52 ROUGE-2 Eval D0721-B.M.100.E-G.52 R:0.05537 P:0.04570 F:0.05007
52 ROUGE-2 Eval D0721-C.M.100.E-B.52 R:0.07616 P:0.07986 F:0.07797
52 ROUGE-2 Eval D0721-C.M.100.E-C.52 R:0.08000 P:0.08333 F:0.08163
52 ROUGE-2 Eval D0721-C.M.100.E-E.52 R:0.06061 P:0.06250 F:0.06154
52 ROUGE-2 Eval D0721-C.M.100.E-G.52 R:0.08224 P:0.08681 F:0.08446
52 ROUGE-2 Eval D0726-A.M.100.F-A.52 R:0.03691 P:0.03188 F:0.03421
52 ROUGE-2 Eval D0726-A.M.100.F-E.52 R:0.01684 P:0.01449 F:0.01558
52 ROUGE-2 Eval D0726-A.M.100.F-F.52 R:0.03691 P:0.03188 F:0.03421
52 ROUGE-2 Eval D0726-A.M.100.F-G.52 R:0.03020 P:0.02609 F:0.02799
52 ROUGE-2 Eval D0726-B.M.100.F-A.52 R:0.01980 P:0.01653 F:0.01802
52 ROUGE-2 Eval D0726-B.M.100.F-E.52 R:0.02013 P:0.01653 F:0.01815
52 ROUGE-2 Eval D0726-B.M.100.F-F.52 R:0.01678 P:0.01377 F:0.01513
52 ROUGE-2 Eval D0726-B.M.100.F-G.52 R:0.02326 P:0.01928 F:0.02108
52 ROUGE-2 Eval D0726-C.M.100.F-A.52 R:0.03367 P:0.02976 F:0.03159
52 ROUGE-2 Eval D0726-C.M.100.F-E.52 R:0.04762 P:0.04167 F:0.04445
52 ROUGE-2 Eval D0726-C.M.100.F-F.52 R:0.04452 P:0.03869 F:0.04140
52 ROUGE-2 Eval D0726-C.M.100.F-G.52 R:0.03642 P:0.03274 F:0.03448
52 ROUGE-2 Eval D0727-A.M.100.G-A.52 R:0.15101 P:0.10135 F:0.12129
52 ROUGE-2 Eval D0727-A.M.100.G-F.52 R:0.14950 P:0.10135 F:0.12080
52 ROUGE-2 Eval D0727-A.M.100.G-G.52 R:0.08911 P:0.06081 F:0.07229
52 ROUGE-2 Eval D0727-A.M.100.G-H.52 R:0.14950 P:0.10135 F:0.12080
52 ROUGE-2 Eval D0727-B.M.100.G-A.52 R:0.01042 P:0.00980 F:0.01010
52 ROUGE-2 Eval D0727-B.M.100.G-F.52 R:0.01967 P:0.01961 F:0.01964
52 ROUGE-2 Eval D0727-B.M.100.G-G.52 R:0.01748 P:0.01634 F:0.01689
52 ROUGE-2 Eval D0727-B.M.100.G-H.52 R:0.01389 P:0.01307 F:0.01347
52 ROUGE-2 Eval D0727-C.M.100.G-A.52 R:0.10526 P:0.06794 F:0.08258
52 ROUGE-2 Eval D0727-C.M.100.G-F.52 R:0.10204 P:0.06369 F:0.07843
52 ROUGE-2 Eval D0727-C.M.100.G-G.52 R:0.06667 P:0.04246 F:0.05188
52 ROUGE-2 Eval D0727-C.M.100.G-H.52 R:0.10922 P:0.06794 F:0.08377
52 ROUGE-2 Eval D0736-A.M.100.H-G.52 R:0.05797 P:0.04233 F:0.04893
52 ROUGE-2 Eval D0736-A.M.100.H-H.52 R:0.07380 P:0.05291 F:0.06163
52 ROUGE-2 Eval D0736-A.M.100.H-I.52 R:0.04317 P:0.03175 F:0.03659
52 ROUGE-2 Eval D0736-A.M.100.H-J.52 R:0.04950 P:0.03968 F:0.04405
52 ROUGE-2 Eval D0736-B.M.100.H-G.52 R:0.32432 P:0.18919 F:0.23898
52 ROUGE-2 Eval D0736-B.M.100.H-H.52 R:0.43096 P:0.23198 F:0.30161
52 ROUGE-2 Eval D0736-B.M.100.H-I.52 R:0.45763 P:0.24324 F:0.31764
52 ROUGE-2 Eval D0736-B.M.100.H-J.52 R:0.39929 P:0.25450 F:0.31086
52 ROUGE-2 Eval D0736-C.M.100.H-G.52 R:0.11966 P:0.05833 F:0.07843
52 ROUGE-2 Eval D0736-C.M.100.H-H.52 R:0.13043 P:0.05000 F:0.07229
52 ROUGE-2 Eval D0736-C.M.100.H-I.52 R:0.14130 P:0.05417 F:0.07832
52 ROUGE-2 Eval D0736-C.M.100.H-J.52 R:0.11450 P:0.06250 F:0.08086
52 ROUGE-2 Eval D0740-A.M.100.I-D.52 R:0.05000 P:0.03333 F:0.04000
52 ROUGE-2 Eval D0740-A.M.100.I-H.52 R:0.04620 P:0.03111 F:0.03718
52 ROUGE-2 Eval D0740-A.M.100.I-I.52 R:0.04918 P:0.03333 F:0.03973
52 ROUGE-2 Eval D0740-A.M.100.I-J.52 R:0.04235 P:0.02889 F:0.03435
52 ROUGE-2 Eval D0740-B.M.100.I-D.52 R:0.07541 P:0.05287 F:0.06216
52 ROUGE-2 Eval D0740-B.M.100.I-H.52 R:0.05686 P:0.03908 F:0.04632
52 ROUGE-2 Eval D0740-B.M.100.I-I.52 R:0.04636 P:0.03218 F:0.03799
52 ROUGE-2 Eval D0740-B.M.100.I-J.52 R:0.06863 P:0.04828 F:0.05668
52 ROUGE-2 Eval D0740-C.M.100.I-D.52 R:0.02903 P:0.02128 F:0.02456
52 ROUGE-2 Eval D0740-C.M.100.I-H.52 R:0.02597 P:0.01891 F:0.02188
52 ROUGE-2 Eval D0740-C.M.100.I-I.52 R:0.02903 P:0.02128 F:0.02456
52 ROUGE-2 Eval D0740-C.M.100.I-J.52 R:0.03215 P:0.02364 F:0.02725
52 ROUGE-2 Eval D0743-A.M.100.J-B.52 R:0.03205 P:0.02364 F:0.02721
52 ROUGE-2 Eval D0743-A.M.100.J-H.52 R:0.03115 P:0.02364 F:0.02688
52 ROUGE-2 Eval D0743-A.M.100.J-I.52 R:0.03155 P:0.02364 F:0.02703
52 ROUGE-2 Eval D0743-A.M.100.J-J.52 R:0.01863 P:0.01418 F:0.01610
52 ROUGE-2 Eval D0743-B.M.100.J-B.52 R:0.00971 P:0.00870 F:0.00918
52 ROUGE-2 Eval D0743-B.M.100.J-H.52 R:0.01274 P:0.01159 F:0.01214
52 ROUGE-2 Eval D0743-B.M.100.J-I.52 R:0.01278 P:0.01159 F:0.01216
52 ROUGE-2 Eval D0743-B.M.100.J-J.52 R:0.01258 P:0.01159 F:0.01206
52 ROUGE-2 Eval D0743-C.M.100.J-B.52 R:0.04487 P:0.03618 F:0.04006
52 ROUGE-2 Eval D0743-C.M.100.J-H.52 R:0.04502 P:0.03618 F:0.04012
52 ROUGE-2 Eval D0743-C.M.100.J-I.52 R:0.04839 P:0.03876 F:0.04304
52 ROUGE-2 Eval D0743-C.M.100.J-J.52 R:0.03492 P:0.02842 F:0.03134
---------------------------------------------
52 ROUGE-3 Average_R: 0.03487 (95%-conf.int. 0.02493 - 0.04642)
52 ROUGE-3 Average_P: 0.02425 (95%-conf.int. 0.01837 - 0.03118)
52 ROUGE-3 Average_F: 0.02830 (95%-conf.int. 0.02100 - 0.03698)
.............................................
52 ROUGE-3 Eval D0703-A.M.100.A-A.52 R:0.04828 P:0.03704 F:0.04192
52 ROUGE-3 Eval D0703-A.M.100.A-C.52 R:0.02397 P:0.01852 F:0.02090
52 ROUGE-3 Eval D0703-A.M.100.A-D.52 R:0.04561 P:0.03439 F:0.03921
52 ROUGE-3 Eval D0703-A.M.100.A-J.52 R:0.02778 P:0.02116 F:0.02402
52 ROUGE-3 Eval D0703-B.M.100.A-A.52 R:0.07667 P:0.07516 F:0.07591
52 ROUGE-3 Eval D0703-B.M.100.A-C.52 R:0.04795 P:0.04575 F:0.04682
52 ROUGE-3 Eval D0703-B.M.100.A-D.52 R:0.05137 P:0.04902 F:0.05017
52 ROUGE-3 Eval D0703-B.M.100.A-J.52 R:0.06780 P:0.06536 F:0.06656
52 ROUGE-3 Eval D0703-C.M.100.A-A.52 R:0.02041 P:0.01653 F:0.01827
52 ROUGE-3 Eval D0703-C.M.100.A-C.52 R:0.02649 P:0.02204 F:0.02406
52 ROUGE-3 Eval D0703-C.M.100.A-D.52 R:0.02703 P:0.02204 F:0.02428
52 ROUGE-3 Eval D0703-C.M.100.A-J.52 R:0.02703 P:0.02204 F:0.02428
52 ROUGE-3 Eval D0706-A.M.100.B-B.52 R:0.01987 P:0.01389 F:0.01635
52 ROUGE-3 Eval D0706-A.M.100.B-D.52 R:0.03333 P:0.02315 F:0.02732
52 ROUGE-3 Eval D0706-A.M.100.B-E.52 R:0.02980 P:0.02083 F:0.02452
52 ROUGE-3 Eval D0706-A.M.100.B-I.52 R:0.03642 P:0.02546 F:0.02997
52 ROUGE-3 Eval D0706-B.M.100.B-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0706-B.M.100.B-D.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0706-B.M.100.B-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0706-B.M.100.B-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0706-C.M.100.B-B.52 R:0.04934 P:0.03401 F:0.04027
52 ROUGE-3 Eval D0706-C.M.100.B-D.52 R:0.06908 P:0.04762 F:0.05638
52 ROUGE-3 Eval D0706-C.M.100.B-E.52 R:0.02288 P:0.01587 F:0.01874
52 ROUGE-3 Eval D0706-C.M.100.B-I.52 R:0.06515 P:0.04535 F:0.05348
52 ROUGE-3 Eval D0711-A.M.100.C-A.52 R:0.00671 P:0.00442 F:0.00533
52 ROUGE-3 Eval D0711-A.M.100.C-B.52 R:0.01020 P:0.00662 F:0.00803
52 ROUGE-3 Eval D0711-A.M.100.C-C.52 R:0.01020 P:0.00662 F:0.00803
52 ROUGE-3 Eval D0711-A.M.100.C-F.52 R:0.00338 P:0.00221 F:0.00267
52 ROUGE-3 Eval D0711-B.M.100.C-A.52 R:0.02083 P:0.01835 F:0.01951
52 ROUGE-3 Eval D0711-B.M.100.C-B.52 R:0.02098 P:0.01835 F:0.01958
52 ROUGE-3 Eval D0711-B.M.100.C-C.52 R:0.00685 P:0.00612 F:0.00646
52 ROUGE-3 Eval D0711-B.M.100.C-F.52 R:0.01384 P:0.01223 F:0.01299
52 ROUGE-3 Eval D0711-C.M.100.C-A.52 R:0.04040 P:0.03774 F:0.03902
52 ROUGE-3 Eval D0711-C.M.100.C-B.52 R:0.05226 P:0.04717 F:0.04958
52 ROUGE-3 Eval D0711-C.M.100.C-C.52 R:0.03448 P:0.03145 F:0.03290
52 ROUGE-3 Eval D0711-C.M.100.C-F.52 R:0.02759 P:0.02516 F:0.02632
52 ROUGE-3 Eval D0716-A.M.100.D-C.52 R:0.08027 P:0.05634 F:0.06621
52 ROUGE-3 Eval D0716-A.M.100.D-D.52 R:0.09864 P:0.06808 F:0.08056
52 ROUGE-3 Eval D0716-A.M.100.D-E.52 R:0.08814 P:0.06103 F:0.07212
52 ROUGE-3 Eval D0716-A.M.100.D-F.52 R:0.08754 P:0.06103 F:0.07192
52 ROUGE-3 Eval D0716-B.M.100.D-C.52 R:0.05369 P:0.04010 F:0.04591
52 ROUGE-3 Eval D0716-B.M.100.D-D.52 R:0.05479 P:0.04010 F:0.04631
52 ROUGE-3 Eval D0716-B.M.100.D-E.52 R:0.03390 P:0.02506 F:0.02882
52 ROUGE-3 Eval D0716-B.M.100.D-F.52 R:0.06122 P:0.04511 F:0.05194
52 ROUGE-3 Eval D0716-C.M.100.D-C.52 R:0.03654 P:0.02619 F:0.03051
52 ROUGE-3 Eval D0716-C.M.100.D-D.52 R:0.01706 P:0.01190 F:0.01402
52 ROUGE-3 Eval D0716-C.M.100.D-E.52 R:0.04040 P:0.02857 F:0.03347
52 ROUGE-3 Eval D0716-C.M.100.D-F.52 R:0.03741 P:0.02619 F:0.03081
52 ROUGE-3 Eval D0721-A.M.100.E-B.52 R:0.01361 P:0.01034 F:0.01175
52 ROUGE-3 Eval D0721-A.M.100.E-C.52 R:0.01325 P:0.01034 F:0.01162
52 ROUGE-3 Eval D0721-A.M.100.E-E.52 R:0.00993 P:0.00775 F:0.00871
52 ROUGE-3 Eval D0721-A.M.100.E-G.52 R:0.01299 P:0.01034 F:0.01151
52 ROUGE-3 Eval D0721-B.M.100.E-B.52 R:0.01329 P:0.01084 F:0.01194
52 ROUGE-3 Eval D0721-B.M.100.E-C.52 R:0.01623 P:0.01355 F:0.01477
52 ROUGE-3 Eval D0721-B.M.100.E-E.52 R:0.01003 P:0.00813 F:0.00898
52 ROUGE-3 Eval D0721-B.M.100.E-G.52 R:0.00987 P:0.00813 F:0.00892
52 ROUGE-3 Eval D0721-C.M.100.E-B.52 R:0.03679 P:0.03860 F:0.03767
52 ROUGE-3 Eval D0721-C.M.100.E-C.52 R:0.04377 P:0.04561 F:0.04467
52 ROUGE-3 Eval D0721-C.M.100.E-E.52 R:0.03061 P:0.03158 F:0.03109
52 ROUGE-3 Eval D0721-C.M.100.E-G.52 R:0.04983 P:0.05263 F:0.05119
52 ROUGE-3 Eval D0726-A.M.100.F-A.52 R:0.00678 P:0.00585 F:0.00628
52 ROUGE-3 Eval D0726-A.M.100.F-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-A.M.100.F-F.52 R:0.00678 P:0.00585 F:0.00628
52 ROUGE-3 Eval D0726-A.M.100.F-G.52 R:0.00678 P:0.00585 F:0.00628
52 ROUGE-3 Eval D0726-B.M.100.F-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-B.M.100.F-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-B.M.100.F-F.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-B.M.100.F-G.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-C.M.100.F-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0726-C.M.100.F-E.52 R:0.00344 P:0.00300 F:0.00320
52 ROUGE-3 Eval D0726-C.M.100.F-F.52 R:0.00346 P:0.00300 F:0.00321
52 ROUGE-3 Eval D0726-C.M.100.F-G.52 R:0.00334 P:0.00300 F:0.00316
52 ROUGE-3 Eval D0727-A.M.100.G-A.52 R:0.06780 P:0.04535 F:0.05435
52 ROUGE-3 Eval D0727-A.M.100.G-F.52 R:0.07383 P:0.04989 F:0.05954
52 ROUGE-3 Eval D0727-A.M.100.G-G.52 R:0.02333 P:0.01587 F:0.01889
52 ROUGE-3 Eval D0727-A.M.100.G-H.52 R:0.07718 P:0.05215 F:0.06224
52 ROUGE-3 Eval D0727-B.M.100.G-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0727-B.M.100.G-F.52 R:0.00331 P:0.00330 F:0.00330
52 ROUGE-3 Eval D0727-B.M.100.G-G.52 R:0.00353 P:0.00330 F:0.00341
52 ROUGE-3 Eval D0727-B.M.100.G-H.52 R:0.00351 P:0.00330 F:0.00340
52 ROUGE-3 Eval D0727-C.M.100.G-A.52 R:0.04319 P:0.02778 F:0.03381
52 ROUGE-3 Eval D0727-C.M.100.G-F.52 R:0.04467 P:0.02778 F:0.03426
52 ROUGE-3 Eval D0727-C.M.100.G-G.52 R:0.01347 P:0.00855 F:0.01046
52 ROUGE-3 Eval D0727-C.M.100.G-H.52 R:0.04138 P:0.02564 F:0.03166
52 ROUGE-3 Eval D0736-A.M.100.H-G.52 R:0.01465 P:0.01067 F:0.01235
52 ROUGE-3 Eval D0736-A.M.100.H-H.52 R:0.01493 P:0.01067 F:0.01245
52 ROUGE-3 Eval D0736-A.M.100.H-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0736-A.M.100.H-J.52 R:0.01333 P:0.01067 F:0.01185
52 ROUGE-3 Eval D0736-B.M.100.H-G.52 R:0.25000 P:0.14512 F:0.18364
52 ROUGE-3 Eval D0736-B.M.100.H-H.52 R:0.35593 P:0.19048 F:0.24816
52 ROUGE-3 Eval D0736-B.M.100.H-I.52 R:0.38197 P:0.20181 F:0.26409
52 ROUGE-3 Eval D0736-B.M.100.H-J.52 R:0.33214 P:0.21088 F:0.25797
52 ROUGE-3 Eval D0736-C.M.100.H-G.52 R:0.05195 P:0.02516 F:0.03390
52 ROUGE-3 Eval D0736-C.M.100.H-H.52 R:0.04420 P:0.01677 F:0.02431
52 ROUGE-3 Eval D0736-C.M.100.H-I.52 R:0.04972 P:0.01887 F:0.02736
52 ROUGE-3 Eval D0736-C.M.100.H-J.52 R:0.03861 P:0.02096 F:0.02717
52 ROUGE-3 Eval D0740-A.M.100.I-D.52 R:0.01010 P:0.00671 F:0.00806
52 ROUGE-3 Eval D0740-A.M.100.I-H.52 R:0.00667 P:0.00447 F:0.00535
52 ROUGE-3 Eval D0740-A.M.100.I-I.52 R:0.00662 P:0.00447 F:0.00534
52 ROUGE-3 Eval D0740-A.M.100.I-J.52 R:0.00658 P:0.00447 F:0.00532
52 ROUGE-3 Eval D0740-B.M.100.I-D.52 R:0.02318 P:0.01620 F:0.01907
52 ROUGE-3 Eval D0740-B.M.100.I-H.52 R:0.02365 P:0.01620 F:0.01923
52 ROUGE-3 Eval D0740-B.M.100.I-I.52 R:0.01003 P:0.00694 F:0.00820
52 ROUGE-3 Eval D0740-B.M.100.I-J.52 R:0.02310 P:0.01620 F:0.01904
52 ROUGE-3 Eval D0740-C.M.100.I-D.52 R:0.01303 P:0.00952 F:0.01100
52 ROUGE-3 Eval D0740-C.M.100.I-H.52 R:0.00984 P:0.00714 F:0.00828
52 ROUGE-3 Eval D0740-C.M.100.I-I.52 R:0.01303 P:0.00952 F:0.01100
52 ROUGE-3 Eval D0740-C.M.100.I-J.52 R:0.01299 P:0.00952 F:0.01099
52 ROUGE-3 Eval D0743-A.M.100.J-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-A.M.100.J-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-A.M.100.J-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-A.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-B.M.100.J-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-B.M.100.J-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-B.M.100.J-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-B.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-3 Eval D0743-C.M.100.J-B.52 R:0.00971 P:0.00781 F:0.00866
52 ROUGE-3 Eval D0743-C.M.100.J-H.52 R:0.00974 P:0.00781 F:0.00867
52 ROUGE-3 Eval D0743-C.M.100.J-I.52 R:0.00977 P:0.00781 F:0.00868
52 ROUGE-3 Eval D0743-C.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
52 ROUGE-4 Average_R: 0.02078 (95%-conf.int. 0.01264 - 0.03083)
52 ROUGE-4 Average_P: 0.01383 (95%-conf.int. 0.00893 - 0.01947)
52 ROUGE-4 Average_F: 0.01643 (95%-conf.int. 0.01038 - 0.02362)
.............................................
52 ROUGE-4 Eval D0703-A.M.100.A-A.52 R:0.02787 P:0.02133 F:0.02417
52 ROUGE-4 Eval D0703-A.M.100.A-C.52 R:0.01730 P:0.01333 F:0.01506
52 ROUGE-4 Eval D0703-A.M.100.A-D.52 R:0.02837 P:0.02133 F:0.02435
52 ROUGE-4 Eval D0703-A.M.100.A-J.52 R:0.01053 P:0.00800 F:0.00909
52 ROUGE-4 Eval D0703-B.M.100.A-A.52 R:0.03704 P:0.03630 F:0.03667
52 ROUGE-4 Eval D0703-B.M.100.A-C.52 R:0.01730 P:0.01650 F:0.01689
52 ROUGE-4 Eval D0703-B.M.100.A-D.52 R:0.02076 P:0.01980 F:0.02027
52 ROUGE-4 Eval D0703-B.M.100.A-J.52 R:0.03767 P:0.03630 F:0.03697
52 ROUGE-4 Eval D0703-C.M.100.A-A.52 R:0.00687 P:0.00556 F:0.00615
52 ROUGE-4 Eval D0703-C.M.100.A-C.52 R:0.00669 P:0.00556 F:0.00607
52 ROUGE-4 Eval D0703-C.M.100.A-D.52 R:0.00683 P:0.00556 F:0.00613
52 ROUGE-4 Eval D0703-C.M.100.A-J.52 R:0.01024 P:0.00833 F:0.00919
52 ROUGE-4 Eval D0706-A.M.100.B-B.52 R:0.00334 P:0.00233 F:0.00275
52 ROUGE-4 Eval D0706-A.M.100.B-D.52 R:0.02020 P:0.01399 F:0.01653
52 ROUGE-4 Eval D0706-A.M.100.B-E.52 R:0.01672 P:0.01166 F:0.01374
52 ROUGE-4 Eval D0706-A.M.100.B-I.52 R:0.02007 P:0.01399 F:0.01649
52 ROUGE-4 Eval D0706-B.M.100.B-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0706-B.M.100.B-D.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0706-B.M.100.B-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0706-B.M.100.B-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0706-C.M.100.B-B.52 R:0.03322 P:0.02283 F:0.02706
52 ROUGE-4 Eval D0706-C.M.100.B-D.52 R:0.04651 P:0.03196 F:0.03789
52 ROUGE-4 Eval D0706-C.M.100.B-E.52 R:0.01320 P:0.00913 F:0.01079
52 ROUGE-4 Eval D0706-C.M.100.B-I.52 R:0.04605 P:0.03196 F:0.03773
52 ROUGE-4 Eval D0711-A.M.100.C-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0711-A.M.100.C-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0711-A.M.100.C-C.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0711-A.M.100.C-F.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0711-B.M.100.C-A.52 R:0.00702 P:0.00617 F:0.00657
52 ROUGE-4 Eval D0711-B.M.100.C-B.52 R:0.00707 P:0.00617 F:0.00659
52 ROUGE-4 Eval D0711-B.M.100.C-C.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0711-B.M.100.C-F.52 R:0.00699 P:0.00617 F:0.00655
52 ROUGE-4 Eval D0711-C.M.100.C-A.52 R:0.02381 P:0.02222 F:0.02299
52 ROUGE-4 Eval D0711-C.M.100.C-B.52 R:0.02817 P:0.02540 F:0.02671
52 ROUGE-4 Eval D0711-C.M.100.C-C.52 R:0.01742 P:0.01587 F:0.01661
52 ROUGE-4 Eval D0711-C.M.100.C-F.52 R:0.01394 P:0.01270 F:0.01329
52 ROUGE-4 Eval D0716-A.M.100.D-C.52 R:0.04392 P:0.03073 F:0.03616
52 ROUGE-4 Eval D0716-A.M.100.D-D.52 R:0.06529 P:0.04492 F:0.05322
52 ROUGE-4 Eval D0716-A.M.100.D-E.52 R:0.05822 P:0.04019 F:0.04755
52 ROUGE-4 Eval D0716-A.M.100.D-F.52 R:0.04762 P:0.03310 F:0.03905
52 ROUGE-4 Eval D0716-B.M.100.D-C.52 R:0.02373 P:0.01768 F:0.02026
52 ROUGE-4 Eval D0716-B.M.100.D-D.52 R:0.02422 P:0.01768 F:0.02044
52 ROUGE-4 Eval D0716-B.M.100.D-E.52 R:0.01027 P:0.00758 F:0.00872
52 ROUGE-4 Eval D0716-B.M.100.D-F.52 R:0.02405 P:0.01768 F:0.02038
52 ROUGE-4 Eval D0716-C.M.100.D-C.52 R:0.01007 P:0.00719 F:0.00839
52 ROUGE-4 Eval D0716-C.M.100.D-D.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0716-C.M.100.D-E.52 R:0.01020 P:0.00719 F:0.00843
52 ROUGE-4 Eval D0716-C.M.100.D-F.52 R:0.01031 P:0.00719 F:0.00847
52 ROUGE-4 Eval D0721-A.M.100.E-B.52 R:0.00344 P:0.00260 F:0.00296
52 ROUGE-4 Eval D0721-A.M.100.E-C.52 R:0.00334 P:0.00260 F:0.00292
52 ROUGE-4 Eval D0721-A.M.100.E-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0721-A.M.100.E-G.52 R:0.00328 P:0.00260 F:0.00290
52 ROUGE-4 Eval D0721-B.M.100.E-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0721-B.M.100.E-C.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0721-B.M.100.E-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0721-B.M.100.E-G.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0721-C.M.100.E-B.52 R:0.02027 P:0.02128 F:0.02076
52 ROUGE-4 Eval D0721-C.M.100.E-C.52 R:0.02721 P:0.02837 F:0.02778
52 ROUGE-4 Eval D0721-C.M.100.E-E.52 R:0.01375 P:0.01418 F:0.01396
52 ROUGE-4 Eval D0721-C.M.100.E-G.52 R:0.03020 P:0.03191 F:0.03103
52 ROUGE-4 Eval D0726-A.M.100.F-A.52 R:0.00342 P:0.00295 F:0.00317
52 ROUGE-4 Eval D0726-A.M.100.F-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-A.M.100.F-F.52 R:0.00342 P:0.00295 F:0.00317
52 ROUGE-4 Eval D0726-A.M.100.F-G.52 R:0.00342 P:0.00295 F:0.00317
52 ROUGE-4 Eval D0726-B.M.100.F-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-B.M.100.F-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-B.M.100.F-F.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-B.M.100.F-G.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-C.M.100.F-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-C.M.100.F-E.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-C.M.100.F-F.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0726-C.M.100.F-G.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0727-A.M.100.G-A.52 R:0.04795 P:0.03196 F:0.03836
52 ROUGE-4 Eval D0727-A.M.100.G-F.52 R:0.05424 P:0.03653 F:0.04366
52 ROUGE-4 Eval D0727-A.M.100.G-G.52 R:0.00673 P:0.00457 F:0.00544
52 ROUGE-4 Eval D0727-A.M.100.G-H.52 R:0.05424 P:0.03653 F:0.04366
52 ROUGE-4 Eval D0727-B.M.100.G-A.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0727-B.M.100.G-F.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0727-B.M.100.G-G.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0727-B.M.100.G-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0727-C.M.100.G-A.52 R:0.02685 P:0.01720 F:0.02097
52 ROUGE-4 Eval D0727-C.M.100.G-F.52 R:0.02778 P:0.01720 F:0.02125
52 ROUGE-4 Eval D0727-C.M.100.G-G.52 R:0.00340 P:0.00215 F:0.00263
52 ROUGE-4 Eval D0727-C.M.100.G-H.52 R:0.02439 P:0.01505 F:0.01861
52 ROUGE-4 Eval D0736-A.M.100.H-G.52 R:0.00741 P:0.00538 F:0.00623
52 ROUGE-4 Eval D0736-A.M.100.H-H.52 R:0.00755 P:0.00538 F:0.00628
52 ROUGE-4 Eval D0736-A.M.100.H-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0736-A.M.100.H-J.52 R:0.00673 P:0.00538 F:0.00598
52 ROUGE-4 Eval D0736-B.M.100.H-G.52 R:0.20553 P:0.11872 F:0.15050
52 ROUGE-4 Eval D0736-B.M.100.H-H.52 R:0.30901 P:0.16438 F:0.21460
52 ROUGE-4 Eval D0736-B.M.100.H-I.52 R:0.32609 P:0.17123 F:0.22455
52 ROUGE-4 Eval D0736-B.M.100.H-J.52 R:0.28881 P:0.18265 F:0.22378
52 ROUGE-4 Eval D0736-C.M.100.H-G.52 R:0.02632 P:0.01266 F:0.01710
52 ROUGE-4 Eval D0736-C.M.100.H-H.52 R:0.02247 P:0.00844 F:0.01227
52 ROUGE-4 Eval D0736-C.M.100.H-I.52 R:0.01685 P:0.00633 F:0.00920
52 ROUGE-4 Eval D0736-C.M.100.H-J.52 R:0.01953 P:0.01055 F:0.01370
52 ROUGE-4 Eval D0740-A.M.100.I-D.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-A.M.100.I-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-A.M.100.I-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-A.M.100.I-J.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-B.M.100.I-D.52 R:0.01003 P:0.00699 F:0.00824
52 ROUGE-4 Eval D0740-B.M.100.I-H.52 R:0.01024 P:0.00699 F:0.00831
52 ROUGE-4 Eval D0740-B.M.100.I-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-B.M.100.I-J.52 R:0.01000 P:0.00699 F:0.00823
52 ROUGE-4 Eval D0740-C.M.100.I-D.52 R:0.00329 P:0.00240 F:0.00278
52 ROUGE-4 Eval D0740-C.M.100.I-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0740-C.M.100.I-I.52 R:0.00329 P:0.00240 F:0.00278
52 ROUGE-4 Eval D0740-C.M.100.I-J.52 R:0.00328 P:0.00240 F:0.00277
52 ROUGE-4 Eval D0743-A.M.100.J-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-A.M.100.J-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-A.M.100.J-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-A.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-B.M.100.J-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-B.M.100.J-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-B.M.100.J-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-B.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-C.M.100.J-B.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-C.M.100.J-H.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-C.M.100.J-I.52 R:0.00000 P:0.00000 F:0.00000
52 ROUGE-4 Eval D0743-C.M.100.J-J.52 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
52 ROUGE-L Average_R: 0.28051 (95%-conf.int. 0.26590 - 0.29612)
52 ROUGE-L Average_P: 0.21298 (95%-conf.int. 0.20527 - 0.22070)
52 ROUGE-L Average_F: 0.24015 (95%-conf.int. 0.23041 - 0.24987)
.............................................
52 ROUGE-L Eval D0703-A.M.100.A-A.52 R:0.31419 P:0.24219 F:0.27353
52 ROUGE-L Eval D0703-A.M.100.A-C.52 R:0.27517 P:0.21354 F:0.24047
52 ROUGE-L Eval D0703-A.M.100.A-D.52 R:0.29210 P:0.22135 F:0.25185
52 ROUGE-L Eval D0703-A.M.100.A-J.52 R:0.29932 P:0.22917 F:0.25959
52 ROUGE-L Eval D0703-B.M.100.A-A.52 R:0.30065 P:0.29487 F:0.29773
52 ROUGE-L Eval D0703-B.M.100.A-C.52 R:0.24497 P:0.23397 F:0.23934
52 ROUGE-L Eval D0703-B.M.100.A-D.52 R:0.24832 P:0.23718 F:0.24262
52 ROUGE-L Eval D0703-B.M.100.A-J.52 R:0.28239 P:0.27244 F:0.27733
52 ROUGE-L Eval D0703-C.M.100.A-A.52 R:0.24667 P:0.20054 F:0.22123
52 ROUGE-L Eval D0703-C.M.100.A-C.52 R:0.26623 P:0.22222 F:0.24224
52 ROUGE-L Eval D0703-C.M.100.A-D.52 R:0.27152 P:0.22222 F:0.24441
52 ROUGE-L Eval D0703-C.M.100.A-J.52 R:0.28477 P:0.23306 F:0.25633
52 ROUGE-L Eval D0706-A.M.100.B-B.52 R:0.31169 P:0.21918 F:0.25737
52 ROUGE-L Eval D0706-A.M.100.B-D.52 R:0.29739 P:0.20776 F:0.24462
52 ROUGE-L Eval D0706-A.M.100.B-E.52 R:0.30195 P:0.21233 F:0.24933
52 ROUGE-L Eval D0706-A.M.100.B-I.52 R:0.30844 P:0.21689 F:0.25469
52 ROUGE-L Eval D0706-B.M.100.B-B.52 R:0.16993 P:0.18440 F:0.17687
52 ROUGE-L Eval D0706-B.M.100.B-D.52 R:0.18241 P:0.19858 F:0.19015
52 ROUGE-L Eval D0706-B.M.100.B-E.52 R:0.17208 P:0.18794 F:0.17966
52 ROUGE-L Eval D0706-B.M.100.B-I.52 R:0.15858 P:0.17376 F:0.16582
52 ROUGE-L Eval D0706-C.M.100.B-B.52 R:0.33548 P:0.23266 F:0.27477
52 ROUGE-L Eval D0706-C.M.100.B-D.52 R:0.35806 P:0.24832 F:0.29326
52 ROUGE-L Eval D0706-C.M.100.B-E.52 R:0.31731 P:0.22148 F:0.26087
52 ROUGE-L Eval D0706-C.M.100.B-I.52 R:0.36741 P:0.25727 F:0.30263
52 ROUGE-L Eval D0711-A.M.100.C-A.52 R:0.30263 P:0.20044 F:0.24116
52 ROUGE-L Eval D0711-A.M.100.C-B.52 R:0.31667 P:0.20697 F:0.25033
52 ROUGE-L Eval D0711-A.M.100.C-C.52 R:0.31000 P:0.20261 F:0.24506
52 ROUGE-L Eval D0711-A.M.100.C-F.52 R:0.30464 P:0.20044 F:0.24179
52 ROUGE-L Eval D0711-B.M.100.C-A.52 R:0.30272 P:0.26727 F:0.28389
52 ROUGE-L Eval D0711-B.M.100.C-B.52 R:0.29795 P:0.26126 F:0.27840
52 ROUGE-L Eval D0711-B.M.100.C-C.52 R:0.27181 P:0.24324 F:0.25673
52 ROUGE-L Eval D0711-B.M.100.C-F.52 R:0.28814 P:0.25526 F:0.27071
52 ROUGE-L Eval D0711-C.M.100.C-A.52 R:0.31023 P:0.29012 F:0.29984
52 ROUGE-L Eval D0711-C.M.100.C-B.52 R:0.32765 P:0.29630 F:0.31119
52 ROUGE-L Eval D0711-C.M.100.C-C.52 R:0.29392 P:0.26852 F:0.28065
52 ROUGE-L Eval D0711-C.M.100.C-F.52 R:0.28041 P:0.25617 F:0.26774
52 ROUGE-L Eval D0716-A.M.100.D-C.52 R:0.39672 P:0.28009 F:0.32836
52 ROUGE-L Eval D0716-A.M.100.D-D.52 R:0.38667 P:0.26852 F:0.31694
52 ROUGE-L Eval D0716-A.M.100.D-E.52 R:0.42525 P:0.29630 F:0.34925
52 ROUGE-L Eval D0716-A.M.100.D-F.52 R:0.38944 P:0.27315 F:0.32109
52 ROUGE-L Eval D0716-B.M.100.D-C.52 R:0.32566 P:0.24444 F:0.27926
52 ROUGE-L Eval D0716-B.M.100.D-D.52 R:0.34228 P:0.25185 F:0.29018
52 ROUGE-L Eval D0716-B.M.100.D-E.52 R:0.29900 P:0.22222 F:0.25495
52 ROUGE-L Eval D0716-B.M.100.D-F.52 R:0.32000 P:0.23704 F:0.27234
52 ROUGE-L Eval D0716-C.M.100.D-C.52 R:0.28013 P:0.20188 F:0.23465
52 ROUGE-L Eval D0716-C.M.100.D-D.52 R:0.26421 P:0.18545 F:0.21793
52 ROUGE-L Eval D0716-C.M.100.D-E.52 R:0.31353 P:0.22300 F:0.26063
52 ROUGE-L Eval D0716-C.M.100.D-F.52 R:0.31333 P:0.22066 F:0.25895
52 ROUGE-L Eval D0721-A.M.100.E-B.52 R:0.30333 P:0.23155 F:0.26262
52 ROUGE-L Eval D0721-A.M.100.E-C.52 R:0.28247 P:0.22137 F:0.24822
52 ROUGE-L Eval D0721-A.M.100.E-E.52 R:0.26299 P:0.20611 F:0.23110
52 ROUGE-L Eval D0721-A.M.100.E-G.52 R:0.28344 P:0.22646 F:0.25177
52 ROUGE-L Eval D0721-B.M.100.E-B.52 R:0.25407 P:0.20800 F:0.22874
52 ROUGE-L Eval D0721-B.M.100.E-C.52 R:0.26433 P:0.22133 F:0.24093
52 ROUGE-L Eval D0721-B.M.100.E-E.52 R:0.22623 P:0.18400 F:0.20294
52 ROUGE-L Eval D0721-B.M.100.E-G.52 R:0.24516 P:0.20267 F:0.22190
52 ROUGE-L Eval D0721-C.M.100.E-B.52 R:0.24590 P:0.25773 F:0.25168
52 ROUGE-L Eval D0721-C.M.100.E-C.52 R:0.23432 P:0.24399 F:0.23906
52 ROUGE-L Eval D0721-C.M.100.E-E.52 R:0.20667 P:0.21306 F:0.20982
52 ROUGE-L Eval D0721-C.M.100.E-G.52 R:0.25081 P:0.26460 F:0.25752
52 ROUGE-L Eval D0726-A.M.100.F-A.52 R:0.22259 P:0.19253 F:0.20647
52 ROUGE-L Eval D0726-A.M.100.F-E.52 R:0.20000 P:0.17241 F:0.18518
52 ROUGE-L Eval D0726-A.M.100.F-F.52 R:0.22591 P:0.19540 F:0.20955
52 ROUGE-L Eval D0726-A.M.100.F-G.52 R:0.21927 P:0.18966 F:0.20339
52 ROUGE-L Eval D0726-B.M.100.F-A.52 R:0.21895 P:0.18306 F:0.19940
52 ROUGE-L Eval D0726-B.M.100.F-E.52 R:0.21262 P:0.17486 F:0.19190
52 ROUGE-L Eval D0726-B.M.100.F-F.52 R:0.20930 P:0.17213 F:0.18890
52 ROUGE-L Eval D0726-B.M.100.F-G.52 R:0.22039 P:0.18306 F:0.20000
52 ROUGE-L Eval D0726-C.M.100.F-A.52 R:0.22333 P:0.19764 F:0.20970
52 ROUGE-L Eval D0726-C.M.100.F-E.52 R:0.22222 P:0.19469 F:0.20755
52 ROUGE-L Eval D0726-C.M.100.F-F.52 R:0.24068 P:0.20944 F:0.22398
52 ROUGE-L Eval D0726-C.M.100.F-G.52 R:0.21639 P:0.19469 F:0.20497
52 ROUGE-L Eval D0727-A.M.100.G-A.52 R:0.36877 P:0.24832 F:0.29679
52 ROUGE-L Eval D0727-A.M.100.G-F.52 R:0.33553 P:0.22819 F:0.27164
52 ROUGE-L Eval D0727-A.M.100.G-G.52 R:0.31046 P:0.21253 F:0.25233
52 ROUGE-L Eval D0727-A.M.100.G-H.52 R:0.37829 P:0.25727 F:0.30626
52 ROUGE-L Eval D0727-B.M.100.G-A.52 R:0.22680 P:0.21359 F:0.22000
52 ROUGE-L Eval D0727-B.M.100.G-F.52 R:0.21753 P:0.21683 F:0.21718
52 ROUGE-L Eval D0727-B.M.100.G-G.52 R:0.20761 P:0.19417 F:0.20067
52 ROUGE-L Eval D0727-B.M.100.G-H.52 R:0.21306 P:0.20065 F:0.20667
52 ROUGE-L Eval D0727-C.M.100.G-A.52 R:0.34202 P:0.22152 F:0.26889
52 ROUGE-L Eval D0727-C.M.100.G-F.52 R:0.32997 P:0.20675 F:0.25422
52 ROUGE-L Eval D0727-C.M.100.G-G.52 R:0.30363 P:0.19409 F:0.23681
52 ROUGE-L Eval D0727-C.M.100.G-H.52 R:0.36149 P:0.22574 F:0.27792
52 ROUGE-L Eval D0736-A.M.100.H-G.52 R:0.25806 P:0.18898 F:0.21818
52 ROUGE-L Eval D0736-A.M.100.H-H.52 R:0.27007 P:0.19423 F:0.22596
52 ROUGE-L Eval D0736-A.M.100.H-I.52 R:0.24555 P:0.18110 F:0.20846
52 ROUGE-L Eval D0736-A.M.100.H-J.52 R:0.23856 P:0.19160 F:0.21252
52 ROUGE-L Eval D0736-B.M.100.H-G.52 R:0.54198 P:0.31767 F:0.40056
52 ROUGE-L Eval D0736-B.M.100.H-H.52 R:0.62397 P:0.33781 F:0.43832
52 ROUGE-L Eval D0736-B.M.100.H-I.52 R:0.65690 P:0.35123 F:0.45772
52 ROUGE-L Eval D0736-B.M.100.H-J.52 R:0.59790 P:0.38255 F:0.46657
52 ROUGE-L Eval D0736-C.M.100.H-G.52 R:0.34599 P:0.16977 F:0.22778
52 ROUGE-L Eval D0736-C.M.100.H-H.52 R:0.37433 P:0.14493 F:0.20896
52 ROUGE-L Eval D0736-C.M.100.H-I.52 R:0.37433 P:0.14493 F:0.20896
52 ROUGE-L Eval D0736-C.M.100.H-J.52 R:0.35094 P:0.19255 F:0.24867
52 ROUGE-L Eval D0740-A.M.100.I-D.52 R:0.24092 P:0.16115 F:0.19312
52 ROUGE-L Eval D0740-A.M.100.I-H.52 R:0.23529 P:0.15894 F:0.18972
52 ROUGE-L Eval D0740-A.M.100.I-I.52 R:0.24026 P:0.16336 F:0.19448
52 ROUGE-L Eval D0740-A.M.100.I-J.52 R:0.23226 P:0.15894 F:0.18873
52 ROUGE-L Eval D0740-B.M.100.I-D.52 R:0.26948 P:0.18950 F:0.22252
52 ROUGE-L Eval D0740-B.M.100.I-H.52 R:0.23510 P:0.16210 F:0.19189
52 ROUGE-L Eval D0740-B.M.100.I-I.52 R:0.24262 P:0.16895 F:0.19919
52 ROUGE-L Eval D0740-B.M.100.I-J.52 R:0.26214 P:0.18493 F:0.21687
52 ROUGE-L Eval D0740-C.M.100.I-D.52 R:0.23323 P:0.17136 F:0.19756
52 ROUGE-L Eval D0740-C.M.100.I-H.52 R:0.21865 P:0.15962 F:0.18453
52 ROUGE-L Eval D0740-C.M.100.I-I.52 R:0.23323 P:0.17136 F:0.19756
52 ROUGE-L Eval D0740-C.M.100.I-J.52 R:0.21656 P:0.15962 F:0.18378
52 ROUGE-L Eval D0743-A.M.100.J-B.52 R:0.22857 P:0.16901 F:0.19433
52 ROUGE-L Eval D0743-A.M.100.J-H.52 R:0.22222 P:0.16901 F:0.19200
52 ROUGE-L Eval D0743-A.M.100.J-I.52 R:0.23438 P:0.17606 F:0.20108
52 ROUGE-L Eval D0743-A.M.100.J-J.52 R:0.20308 P:0.15493 F:0.17577
52 ROUGE-L Eval D0743-B.M.100.J-B.52 R:0.16987 P:0.15230 F:0.16061
52 ROUGE-L Eval D0743-B.M.100.J-H.52 R:0.17666 P:0.16092 F:0.16842
52 ROUGE-L Eval D0743-B.M.100.J-I.52 R:0.17089 P:0.15517 F:0.16265
52 ROUGE-L Eval D0743-B.M.100.J-J.52 R:0.16511 P:0.15230 F:0.15845
52 ROUGE-L Eval D0743-C.M.100.J-B.52 R:0.21270 P:0.17179 F:0.19007
52 ROUGE-L Eval D0743-C.M.100.J-H.52 R:0.18790 P:0.15128 F:0.16761
52 ROUGE-L Eval D0743-C.M.100.J-I.52 R:0.20767 P:0.16667 F:0.18492
52 ROUGE-L Eval D0743-C.M.100.J-J.52 R:0.18239 P:0.14872 F:0.16384
---------------------------------------------
52 ROUGE-W-1.2 Average_R: 0.10047 (95%-conf.int. 0.09470 - 0.10692)
52 ROUGE-W-1.2 Average_P: 0.13818 (95%-conf.int. 0.13235 - 0.14423)
52 ROUGE-W-1.2 Average_F: 0.11535 (95%-conf.int. 0.10973 - 0.12132)
.............................................
52 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.52 R:0.11326 P:0.15721 F:0.13166
52 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.52 R:0.09565 P:0.13491 F:0.11194
52 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.52 R:0.10468 P:0.14625 F:0.12202
52 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.52 R:0.10982 P:0.14383 F:0.12454
52 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.52 R:0.10963 P:0.19936 F:0.14147
52 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.52 R:0.08598 P:0.15540 F:0.11071
52 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.52 R:0.08906 P:0.15955 F:0.11431
52 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.52 R:0.10417 P:0.18640 F:0.13365
52 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.52 R:0.07889 P:0.11926 F:0.09496
52 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.52 R:0.08504 P:0.13401 F:0.10405
52 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.52 R:0.09019 P:0.14010 F:0.10974
52 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.52 R:0.09490 P:0.13989 F:0.11308
52 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.52 R:0.10924 P:0.13785 F:0.12189
52 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.52 R:0.10362 P:0.13283 F:0.11642
52 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.52 R:0.10679 P:0.13617 F:0.11970
52 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.52 R:0.10699 P:0.13941 F:0.12107
52 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.52 R:0.06208 P:0.11667 F:0.08104
52 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.52 R:0.06606 P:0.12683 F:0.08687
52 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.52 R:0.06213 P:0.11978 F:0.08182
52 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.52 R:0.05541 P:0.10979 F:0.07365
52 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.52 R:0.12396 P:0.14672 F:0.13438
52 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.52 R:0.13323 P:0.15906 F:0.14500
52 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.52 R:0.11438 P:0.13524 F:0.12394
52 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.52 R:0.13614 P:0.16556 F:0.14942
52 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.52 R:0.10453 P:0.12481 F:0.11377
52 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.52 R:0.10748 P:0.12724 F:0.11653
52 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.52 R:0.10727 P:0.12590 F:0.11584
52 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.52 R:0.10464 P:0.12490 F:0.11388
52 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.52 R:0.10877 P:0.17133 F:0.13306
52 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.52 R:0.10049 P:0.16515 F:0.12495
52 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.52 R:0.08973 P:0.15084 F:0.11252
52 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.52 R:0.09645 P:0.15870 F:0.11998
52 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.52 R:0.10295 P:0.17999 F:0.13098
52 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.52 R:0.10777 P:0.18224 F:0.13544
52 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.52 R:0.09489 P:0.16460 F:0.12038
52 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.52 R:0.09127 P:0.16071 F:0.11642
52 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.52 R:0.14729 P:0.18998 F:0.16593
52 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.52 R:0.13715 P:0.18146 F:0.15622
52 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.52 R:0.15198 P:0.19775 F:0.17187
52 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.52 R:0.13596 P:0.18134 F:0.15540
52 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.52 R:0.12258 P:0.16051 F:0.13900
52 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.52 R:0.12287 P:0.16179 F:0.13967
52 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.52 R:0.10851 P:0.14357 F:0.12360
52 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.52 R:0.12001 P:0.15735 F:0.13617
52 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.52 R:0.09813 P:0.13182 F:0.11251
52 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.52 R:0.08791 P:0.11966 F:0.10136
52 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.52 R:0.10517 P:0.14496 F:0.12190
52 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.52 R:0.10562 P:0.14469 F:0.12211
52 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.52 R:0.10627 P:0.14259 F:0.12178
52 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.52 R:0.10085 P:0.14022 F:0.11732
52 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.52 R:0.08914 P:0.12549 F:0.10424
52 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.52 R:0.10202 P:0.14284 F:0.11903
52 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.52 R:0.08513 P:0.13473 F:0.10434
52 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.52 R:0.08950 P:0.14085 F:0.10945
52 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.52 R:0.07555 P:0.12061 F:0.09290
52 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.52 R:0.07890 P:0.13017 F:0.09825
52 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.52 R:0.09247 P:0.17839 F:0.12180
52 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.52 R:0.08449 P:0.16551 F:0.11187
52 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.52 R:0.07517 P:0.14465 F:0.09893
52 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.52 R:0.09231 P:0.18211 F:0.12252
52 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.52 R:0.07945 P:0.12178 F:0.09616
52 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.52 R:0.07217 P:0.10900 F:0.08684
52 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.52 R:0.08118 P:0.12506 F:0.09845
52 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.52 R:0.07898 P:0.12365 F:0.09639
52 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.52 R:0.07826 P:0.11509 F:0.09317
52 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.52 R:0.07413 P:0.11005 F:0.08859
52 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.52 R:0.07273 P:0.10868 F:0.08714
52 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.52 R:0.07687 P:0.11528 F:0.09224
52 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.52 R:0.08133 P:0.12639 F:0.09897
52 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.52 R:0.08097 P:0.12520 F:0.09834
52 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.52 R:0.08379 P:0.13058 F:0.10208
52 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.52 R:0.07911 P:0.12743 F:0.09762
52 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.52 R:0.13380 P:0.15858 F:0.14514
52 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.52 R:0.12246 P:0.15202 F:0.13565
52 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.52 R:0.10787 P:0.13078 F:0.11823
52 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.52 R:0.13353 P:0.16278 F:0.14671
52 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.52 R:0.07999 P:0.13218 F:0.09967
52 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.52 R:0.07651 P:0.13699 F:0.09818
52 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.52 R:0.07422 P:0.12433 F:0.09295
52 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.52 R:0.07721 P:0.12871 F:0.09652
52 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.52 R:0.12661 P:0.14747 F:0.13625
52 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.52 R:0.12152 P:0.14072 F:0.13042
52 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.52 R:0.10832 P:0.12746 F:0.11711
52 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.52 R:0.13424 P:0.15088 F:0.14207
52 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.52 R:0.09649 P:0.12513 F:0.10896
52 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.52 R:0.10181 P:0.12875 F:0.11371
52 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.52 R:0.09044 P:0.11918 F:0.10284
52 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.52 R:0.08643 P:0.12376 F:0.10178
52 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.52 R:0.21141 P:0.22936 F:0.22002
52 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.52 R:0.25717 P:0.25758 F:0.25737
52 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.52 R:0.26737 P:0.26404 F:0.26569
52 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.52 R:0.24022 P:0.28413 F:0.26034
52 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.52 R:0.11940 P:0.10642 F:0.11254
52 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.52 R:0.14498 P:0.10491 F:0.12173
52 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.52 R:0.12971 P:0.09161 F:0.10738
52 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.52 R:0.11785 P:0.11536 F:0.11659
52 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.52 R:0.08544 P:0.10512 F:0.09426
52 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.52 R:0.08437 P:0.10282 F:0.09269
52 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.52 R:0.08266 P:0.10396 F:0.09209
52 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.52 R:0.08105 P:0.10190 F:0.09029
52 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.52 R:0.09737 P:0.12579 F:0.10977
52 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.52 R:0.08928 P:0.10955 F:0.09838
52 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.52 R:0.08339 P:0.10912 F:0.09454
52 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.52 R:0.09892 P:0.12477 F:0.11035
52 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.52 R:0.07907 P:0.11212 F:0.09274
52 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.52 R:0.07609 P:0.10367 F:0.08776
52 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.52 R:0.07776 P:0.11174 F:0.09170
52 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.52 R:0.07476 P:0.10559 F:0.08754
52 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.52 R:0.08527 P:0.10990 F:0.09603
52 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.52 R:0.08314 P:0.10923 F:0.09442
52 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.52 R:0.08524 P:0.11362 F:0.09740
52 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.52 R:0.07250 P:0.09602 F:0.08262
52 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.52 R:0.06534 P:0.09810 F:0.07844
52 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.52 R:0.06927 P:0.10464 F:0.08336
52 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.52 R:0.06606 P:0.10108 F:0.07990
52 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.52 R:0.06582 P:0.09983 F:0.07933
52 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.52 R:0.07657 P:0.10825 F:0.08969
52 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.52 R:0.06950 P:0.09344 F:0.07971
52 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.52 R:0.07215 P:0.10319 F:0.08492
52 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.52 R:0.06545 P:0.08983 F:0.07573
---------------------------------------------
52 ROUGE-SU4 Average_R: 0.11722 (95%-conf.int. 0.10605 - 0.12948)
52 ROUGE-SU4 Average_P: 0.08688 (95%-conf.int. 0.08034 - 0.09352)
52 ROUGE-SU4 Average_F: 0.09888 (95%-conf.int. 0.09087 - 0.10745)
.............................................
52 ROUGE-SU4 Eval D0703-A.M.100.A-A.52 R:0.13889 P:0.10638 F:0.12048
52 ROUGE-SU4 Eval D0703-A.M.100.A-C.52 R:0.11207 P:0.08644 F:0.09760
52 ROUGE-SU4 Eval D0703-A.M.100.A-D.52 R:0.13251 P:0.09973 F:0.11381
52 ROUGE-SU4 Eval D0703-A.M.100.A-J.52 R:0.11189 P:0.08511 F:0.09668
52 ROUGE-SU4 Eval D0703-B.M.100.A-A.52 R:0.14933 P:0.14638 F:0.14784
52 ROUGE-SU4 Eval D0703-B.M.100.A-C.52 R:0.11322 P:0.10800 F:0.11055
52 ROUGE-SU4 Eval D0703-B.M.100.A-D.52 R:0.11667 P:0.11129 F:0.11392
52 ROUGE-SU4 Eval D0703-B.M.100.A-J.52 R:0.13083 P:0.12610 F:0.12842
52 ROUGE-SU4 Eval D0703-C.M.100.A-A.52 R:0.09817 P:0.07941 F:0.08780
52 ROUGE-SU4 Eval D0703-C.M.100.A-C.52 R:0.11444 P:0.09511 F:0.10388
52 ROUGE-SU4 Eval D0703-C.M.100.A-D.52 R:0.11281 P:0.09187 F:0.10127
52 ROUGE-SU4 Eval D0703-C.M.100.A-J.52 R:0.11508 P:0.09372 F:0.10331
52 ROUGE-SU4 Eval D0706-A.M.100.B-B.52 R:0.10444 P:0.07287 F:0.08584
52 ROUGE-SU4 Eval D0706-A.M.100.B-D.52 R:0.11130 P:0.07713 F:0.09112
52 ROUGE-SU4 Eval D0706-A.M.100.B-E.52 R:0.10667 P:0.07442 F:0.08767
52 ROUGE-SU4 Eval D0706-A.M.100.B-I.52 R:0.11167 P:0.07791 F:0.09178
52 ROUGE-SU4 Eval D0706-B.M.100.B-B.52 R:0.05034 P:0.05474 F:0.05245
52 ROUGE-SU4 Eval D0706-B.M.100.B-D.52 R:0.05351 P:0.05839 F:0.05584
52 ROUGE-SU4 Eval D0706-B.M.100.B-E.52 R:0.05444 P:0.05961 F:0.05691
52 ROUGE-SU4 Eval D0706-B.M.100.B-I.52 R:0.04707 P:0.05170 F:0.04928
52 ROUGE-SU4 Eval D0706-C.M.100.B-B.52 R:0.13245 P:0.09112 F:0.10796
52 ROUGE-SU4 Eval D0706-C.M.100.B-D.52 R:0.15508 P:0.10668 F:0.12641
52 ROUGE-SU4 Eval D0706-C.M.100.B-E.52 R:0.11458 P:0.07935 F:0.09376
52 ROUGE-SU4 Eval D0706-C.M.100.B-I.52 R:0.15683 P:0.10896 F:0.12858
52 ROUGE-SU4 Eval D0711-A.M.100.C-A.52 R:0.10304 P:0.06763 F:0.08166
52 ROUGE-SU4 Eval D0711-A.M.100.C-B.52 R:0.10674 P:0.06911 F:0.08390
52 ROUGE-SU4 Eval D0711-A.M.100.C-C.52 R:0.10445 P:0.06763 F:0.08210
52 ROUGE-SU4 Eval D0711-A.M.100.C-F.52 R:0.10828 P:0.07058 F:0.08546
52 ROUGE-SU4 Eval D0711-B.M.100.C-A.52 R:0.11946 P:0.10513 F:0.11184
52 ROUGE-SU4 Eval D0711-B.M.100.C-B.52 R:0.12559 P:0.10974 F:0.11713
52 ROUGE-SU4 Eval D0711-B.M.100.C-C.52 R:0.10805 P:0.09641 F:0.10190
52 ROUGE-SU4 Eval D0711-B.M.100.C-F.52 R:0.11092 P:0.09795 F:0.10403
52 ROUGE-SU4 Eval D0711-C.M.100.C-A.52 R:0.13672 P:0.12764 F:0.13202
52 ROUGE-SU4 Eval D0711-C.M.100.C-B.52 R:0.14503 P:0.13080 F:0.13755
52 ROUGE-SU4 Eval D0711-C.M.100.C-C.52 R:0.13426 P:0.12236 F:0.12803
52 ROUGE-SU4 Eval D0711-C.M.100.C-F.52 R:0.12731 P:0.11603 F:0.12141
52 ROUGE-SU4 Eval D0716-A.M.100.D-C.52 R:0.21661 P:0.15173 F:0.17846
52 ROUGE-SU4 Eval D0716-A.M.100.D-D.52 R:0.22603 P:0.15566 F:0.18436
52 ROUGE-SU4 Eval D0716-A.M.100.D-E.52 R:0.22981 P:0.15881 F:0.18782
52 ROUGE-SU4 Eval D0716-A.M.100.D-F.52 R:0.21808 P:0.15173 F:0.17895
52 ROUGE-SU4 Eval D0716-B.M.100.D-C.52 R:0.14696 P:0.10957 F:0.12554
52 ROUGE-SU4 Eval D0716-B.M.100.D-D.52 R:0.15517 P:0.11335 F:0.13100
52 ROUGE-SU4 Eval D0716-B.M.100.D-E.52 R:0.12856 P:0.09488 F:0.10918
52 ROUGE-SU4 Eval D0716-B.M.100.D-F.52 R:0.14669 P:0.10789 F:0.12433
52 ROUGE-SU4 Eval D0716-C.M.100.D-C.52 R:0.10591 P:0.07576 F:0.08833
52 ROUGE-SU4 Eval D0716-C.M.100.D-D.52 R:0.10424 P:0.07257 F:0.08557
52 ROUGE-SU4 Eval D0716-C.M.100.D-E.52 R:0.12712 P:0.08971 F:0.10519
52 ROUGE-SU4 Eval D0716-C.M.100.D-F.52 R:0.12329 P:0.08612 F:0.10141
52 ROUGE-SU4 Eval D0721-A.M.100.E-B.52 R:0.12728 P:0.09654 F:0.10980
52 ROUGE-SU4 Eval D0721-A.M.100.E-C.52 R:0.11278 P:0.08788 F:0.09879
52 ROUGE-SU4 Eval D0721-A.M.100.E-E.52 R:0.11444 P:0.08918 F:0.10024
52 ROUGE-SU4 Eval D0721-A.M.100.E-G.52 R:0.11819 P:0.09394 F:0.10468
52 ROUGE-SU4 Eval D0721-B.M.100.E-B.52 R:0.10256 P:0.08356 F:0.09209
52 ROUGE-SU4 Eval D0721-B.M.100.E-C.52 R:0.10512 P:0.08765 F:0.09559
52 ROUGE-SU4 Eval D0721-B.M.100.E-E.52 R:0.08979 P:0.07266 F:0.08032
52 ROUGE-SU4 Eval D0721-B.M.100.E-G.52 R:0.10265 P:0.08447 F:0.09268
52 ROUGE-SU4 Eval D0721-C.M.100.E-B.52 R:0.10887 P:0.11425 F:0.11150
52 ROUGE-SU4 Eval D0721-C.M.100.E-C.52 R:0.10452 P:0.10895 F:0.10669
52 ROUGE-SU4 Eval D0721-C.M.100.E-E.52 R:0.08390 P:0.08657 F:0.08521
52 ROUGE-SU4 Eval D0721-C.M.100.E-G.52 R:0.11315 P:0.11955 F:0.11626
52 ROUGE-SU4 Eval D0726-A.M.100.F-A.52 R:0.08134 P:0.07010 F:0.07530
52 ROUGE-SU4 Eval D0726-A.M.100.F-E.52 R:0.06735 P:0.05784 F:0.06223
52 ROUGE-SU4 Eval D0726-A.M.100.F-F.52 R:0.08305 P:0.07157 F:0.07688
52 ROUGE-SU4 Eval D0726-A.M.100.F-G.52 R:0.08419 P:0.07255 F:0.07794
52 ROUGE-SU4 Eval D0726-B.M.100.F-A.52 R:0.06432 P:0.05354 F:0.05844
52 ROUGE-SU4 Eval D0726-B.M.100.F-E.52 R:0.06485 P:0.05307 F:0.05837
52 ROUGE-SU4 Eval D0726-B.M.100.F-F.52 R:0.06485 P:0.05307 F:0.05837
52 ROUGE-SU4 Eval D0726-B.M.100.F-G.52 R:0.07038 P:0.05819 F:0.06371
52 ROUGE-SU4 Eval D0726-C.M.100.F-A.52 R:0.07078 P:0.06244 F:0.06635
52 ROUGE-SU4 Eval D0726-C.M.100.F-E.52 R:0.06920 P:0.06042 F:0.06451
52 ROUGE-SU4 Eval D0726-C.M.100.F-F.52 R:0.07666 P:0.06647 F:0.07120
52 ROUGE-SU4 Eval D0726-C.M.100.F-G.52 R:0.06678 P:0.05992 F:0.06316
52 ROUGE-SU4 Eval D0727-A.M.100.G-A.52 R:0.18259 P:0.12187 F:0.14618
52 ROUGE-SU4 Eval D0727-A.M.100.G-F.52 R:0.17399 P:0.11731 F:0.14014
52 ROUGE-SU4 Eval D0727-A.M.100.G-G.52 R:0.12248 P:0.08314 F:0.09905
52 ROUGE-SU4 Eval D0727-A.M.100.G-H.52 R:0.18750 P:0.12642 F:0.15102
52 ROUGE-SU4 Eval D0727-B.M.100.G-A.52 R:0.06655 P:0.06257 F:0.06450
52 ROUGE-SU4 Eval D0727-B.M.100.G-F.52 R:0.06556 P:0.06534 F:0.06545
52 ROUGE-SU4 Eval D0727-B.M.100.G-G.52 R:0.06050 P:0.05648 F:0.05842
52 ROUGE-SU4 Eval D0727-B.M.100.G-H.52 R:0.06184 P:0.05814 F:0.05993
52 ROUGE-SU4 Eval D0727-C.M.100.G-A.52 R:0.16054 P:0.10300 F:0.12549
52 ROUGE-SU4 Eval D0727-C.M.100.G-F.52 R:0.15456 P:0.09585 F:0.11832
52 ROUGE-SU4 Eval D0727-C.M.100.G-G.52 R:0.12486 P:0.07904 F:0.09680
52 ROUGE-SU4 Eval D0727-C.M.100.G-H.52 R:0.16667 P:0.10300 F:0.12732
52 ROUGE-SU4 Eval D0736-A.M.100.H-G.52 R:0.09164 P:0.06658 F:0.07713
52 ROUGE-SU4 Eval D0736-A.M.100.H-H.52 R:0.11090 P:0.07909 F:0.09233
52 ROUGE-SU4 Eval D0736-A.M.100.H-I.52 R:0.08913 P:0.06524 F:0.07534
52 ROUGE-SU4 Eval D0736-A.M.100.H-J.52 R:0.08669 P:0.06926 F:0.07700
52 ROUGE-SU4 Eval D0736-B.M.100.H-G.52 R:0.32940 P:0.19058 F:0.24146
52 ROUGE-SU4 Eval D0736-B.M.100.H-H.52 R:0.42094 P:0.22437 F:0.29272
52 ROUGE-SU4 Eval D0736-B.M.100.H-I.52 R:0.44805 P:0.23576 F:0.30895
52 ROUGE-SU4 Eval D0736-B.M.100.H-J.52 R:0.40408 P:0.25588 F:0.31334
52 ROUGE-SU4 Eval D0736-C.M.100.H-G.52 R:0.15502 P:0.07474 F:0.10085
52 ROUGE-SU4 Eval D0736-C.M.100.H-H.52 R:0.16015 P:0.06035 F:0.08766
52 ROUGE-SU4 Eval D0736-C.M.100.H-I.52 R:0.17877 P:0.06737 F:0.09786
52 ROUGE-SU4 Eval D0736-C.M.100.H-J.52 R:0.14137 P:0.07649 F:0.09927
52 ROUGE-SU4 Eval D0740-A.M.100.I-D.52 R:0.08305 P:0.05506 F:0.06622
52 ROUGE-SU4 Eval D0740-A.M.100.I-H.52 R:0.07774 P:0.05206 F:0.06236
52 ROUGE-SU4 Eval D0740-A.M.100.I-I.52 R:0.08444 P:0.05693 F:0.06801
52 ROUGE-SU4 Eval D0740-A.M.100.I-J.52 R:0.07616 P:0.05169 F:0.06158
52 ROUGE-SU4 Eval D0740-B.M.100.I-D.52 R:0.11278 P:0.07868 F:0.09269
52 ROUGE-SU4 Eval D0740-B.M.100.I-H.52 R:0.08673 P:0.05930 F:0.07044
52 ROUGE-SU4 Eval D0740-B.M.100.I-I.52 R:0.09091 P:0.06279 F:0.07428
52 ROUGE-SU4 Eval D0740-B.M.100.I-J.52 R:0.10853 P:0.07597 F:0.08938
52 ROUGE-SU4 Eval D0740-C.M.100.I-D.52 R:0.08251 P:0.06021 F:0.06962
52 ROUGE-SU4 Eval D0740-C.M.100.I-H.52 R:0.07371 P:0.05343 F:0.06195
52 ROUGE-SU4 Eval D0740-C.M.100.I-I.52 R:0.07978 P:0.05821 F:0.06731
52 ROUGE-SU4 Eval D0740-C.M.100.I-J.52 R:0.07571 P:0.05542 F:0.06400
52 ROUGE-SU4 Eval D0743-A.M.100.J-B.52 R:0.07166 P:0.05263 F:0.06069
52 ROUGE-SU4 Eval D0743-A.M.100.J-H.52 R:0.06540 P:0.04944 F:0.05631
52 ROUGE-SU4 Eval D0743-A.M.100.J-I.52 R:0.07585 P:0.05662 F:0.06484
52 ROUGE-SU4 Eval D0743-A.M.100.J-J.52 R:0.06046 P:0.04585 F:0.05215
52 ROUGE-SU4 Eval D0743-B.M.100.J-B.52 R:0.05099 P:0.04559 F:0.04814
52 ROUGE-SU4 Eval D0743-B.M.100.J-H.52 R:0.05016 P:0.04559 F:0.04777
52 ROUGE-SU4 Eval D0743-B.M.100.J-I.52 R:0.05087 P:0.04608 F:0.04836
52 ROUGE-SU4 Eval D0743-B.M.100.J-J.52 R:0.04420 P:0.04069 F:0.04237
52 ROUGE-SU4 Eval D0743-C.M.100.J-B.52 R:0.07166 P:0.05759 F:0.06386
52 ROUGE-SU4 Eval D0743-C.M.100.J-H.52 R:0.06100 P:0.04887 F:0.05427
52 ROUGE-SU4 Eval D0743-C.M.100.J-I.52 R:0.07213 P:0.05759 F:0.06405
52 ROUGE-SU4 Eval D0743-C.M.100.J-J.52 R:0.05914 P:0.04799 F:0.05298
---------------------------------------------
53 ROUGE-1 Average_R: 0.33463 (95%-conf.int. 0.32333 - 0.34541)
53 ROUGE-1 Average_P: 0.21590 (95%-conf.int. 0.20724 - 0.22451)
53 ROUGE-1 Average_F: 0.26186 (95%-conf.int. 0.25216 - 0.27158)
.............................................
53 ROUGE-1 Eval D0703-A.M.100.A-A.53 R:0.40878 P:0.27816 F:0.33105
53 ROUGE-1 Eval D0703-A.M.100.A-C.53 R:0.40268 P:0.27586 F:0.32742
53 ROUGE-1 Eval D0703-A.M.100.A-D.53 R:0.39863 P:0.26667 F:0.31956
53 ROUGE-1 Eval D0703-A.M.100.A-J.53 R:0.40816 P:0.27586 F:0.32922
53 ROUGE-1 Eval D0703-B.M.100.A-A.53 R:0.37582 P:0.25901 F:0.30667
53 ROUGE-1 Eval D0703-B.M.100.A-C.53 R:0.35906 P:0.24099 F:0.28841
53 ROUGE-1 Eval D0703-B.M.100.A-D.53 R:0.34899 P:0.23423 F:0.28032
53 ROUGE-1 Eval D0703-B.M.100.A-J.53 R:0.34219 P:0.23198 F:0.27651
53 ROUGE-1 Eval D0703-C.M.100.A-A.53 R:0.33333 P:0.22222 F:0.26666
53 ROUGE-1 Eval D0703-C.M.100.A-C.53 R:0.32143 P:0.22000 F:0.26121
53 ROUGE-1 Eval D0703-C.M.100.A-D.53 R:0.32781 P:0.22000 F:0.26330
53 ROUGE-1 Eval D0703-C.M.100.A-J.53 R:0.31457 P:0.21111 F:0.25266
53 ROUGE-1 Eval D0706-A.M.100.B-B.53 R:0.37987 P:0.25000 F:0.30155
53 ROUGE-1 Eval D0706-A.M.100.B-D.53 R:0.35294 P:0.23077 F:0.27907
53 ROUGE-1 Eval D0706-A.M.100.B-E.53 R:0.30844 P:0.20299 F:0.24484
53 ROUGE-1 Eval D0706-A.M.100.B-I.53 R:0.35390 P:0.23291 F:0.28093
53 ROUGE-1 Eval D0706-B.M.100.B-B.53 R:0.25490 P:0.16352 F:0.19923
53 ROUGE-1 Eval D0706-B.M.100.B-D.53 R:0.28664 P:0.18449 F:0.22449
53 ROUGE-1 Eval D0706-B.M.100.B-E.53 R:0.28247 P:0.18239 F:0.22166
53 ROUGE-1 Eval D0706-B.M.100.B-I.53 R:0.27832 P:0.18029 F:0.21883
53 ROUGE-1 Eval D0706-C.M.100.B-B.53 R:0.27097 P:0.17610 F:0.21347
53 ROUGE-1 Eval D0706-C.M.100.B-D.53 R:0.28710 P:0.18658 F:0.22617
53 ROUGE-1 Eval D0706-C.M.100.B-E.53 R:0.27564 P:0.18029 F:0.21799
53 ROUGE-1 Eval D0706-C.M.100.B-I.53 R:0.28435 P:0.18658 F:0.22532
53 ROUGE-1 Eval D0711-A.M.100.C-A.53 R:0.32237 P:0.19679 F:0.24439
53 ROUGE-1 Eval D0711-A.M.100.C-B.53 R:0.35333 P:0.21285 F:0.26566
53 ROUGE-1 Eval D0711-A.M.100.C-C.53 R:0.33000 P:0.19880 F:0.24812
53 ROUGE-1 Eval D0711-A.M.100.C-F.53 R:0.35762 P:0.21687 F:0.27000
53 ROUGE-1 Eval D0711-B.M.100.C-A.53 R:0.34014 P:0.24691 F:0.28612
53 ROUGE-1 Eval D0711-B.M.100.C-B.53 R:0.36986 P:0.26667 F:0.30990
53 ROUGE-1 Eval D0711-B.M.100.C-C.53 R:0.35906 P:0.26420 F:0.30441
53 ROUGE-1 Eval D0711-B.M.100.C-F.53 R:0.35593 P:0.25926 F:0.30000
53 ROUGE-1 Eval D0711-C.M.100.C-A.53 R:0.38284 P:0.26667 F:0.31437
53 ROUGE-1 Eval D0711-C.M.100.C-B.53 R:0.39932 P:0.26897 F:0.32143
53 ROUGE-1 Eval D0711-C.M.100.C-C.53 R:0.37838 P:0.25747 F:0.30643
53 ROUGE-1 Eval D0711-C.M.100.C-F.53 R:0.36486 P:0.24828 F:0.29549
53 ROUGE-1 Eval D0716-A.M.100.D-C.53 R:0.46885 P:0.31778 F:0.37881
53 ROUGE-1 Eval D0716-A.M.100.D-D.53 R:0.49333 P:0.32889 F:0.39467
53 ROUGE-1 Eval D0716-A.M.100.D-E.53 R:0.50831 P:0.34000 F:0.40746
53 ROUGE-1 Eval D0716-A.M.100.D-F.53 R:0.46535 P:0.31333 F:0.37450
53 ROUGE-1 Eval D0716-B.M.100.D-C.53 R:0.39803 P:0.27438 F:0.32484
53 ROUGE-1 Eval D0716-B.M.100.D-D.53 R:0.41275 P:0.27891 F:0.33288
53 ROUGE-1 Eval D0716-B.M.100.D-E.53 R:0.37542 P:0.25624 F:0.30459
53 ROUGE-1 Eval D0716-B.M.100.D-F.53 R:0.38000 P:0.25850 F:0.30769
53 ROUGE-1 Eval D0716-C.M.100.D-C.53 R:0.36482 P:0.24724 F:0.29474
53 ROUGE-1 Eval D0716-C.M.100.D-D.53 R:0.39799 P:0.26269 F:0.31649
53 ROUGE-1 Eval D0716-C.M.100.D-E.53 R:0.40264 P:0.26932 F:0.32275
53 ROUGE-1 Eval D0716-C.M.100.D-F.53 R:0.40333 P:0.26711 F:0.32138
53 ROUGE-1 Eval D0721-A.M.100.E-B.53 R:0.29667 P:0.19017 F:0.23177
53 ROUGE-1 Eval D0721-A.M.100.E-C.53 R:0.27922 P:0.18376 F:0.22165
53 ROUGE-1 Eval D0721-A.M.100.E-E.53 R:0.26623 P:0.17521 F:0.21134
53 ROUGE-1 Eval D0721-A.M.100.E-G.53 R:0.28025 P:0.18803 F:0.22506
53 ROUGE-1 Eval D0721-B.M.100.E-B.53 R:0.35179 P:0.22642 F:0.27551
53 ROUGE-1 Eval D0721-B.M.100.E-C.53 R:0.34076 P:0.22432 F:0.27054
53 ROUGE-1 Eval D0721-B.M.100.E-E.53 R:0.32787 P:0.20964 F:0.25575
53 ROUGE-1 Eval D0721-B.M.100.E-G.53 R:0.32903 P:0.21384 F:0.25921
53 ROUGE-1 Eval D0721-C.M.100.E-B.53 R:0.40984 P:0.26042 F:0.31848
53 ROUGE-1 Eval D0721-C.M.100.E-C.53 R:0.39934 P:0.25208 F:0.30907
53 ROUGE-1 Eval D0721-C.M.100.E-E.53 R:0.37333 P:0.23333 F:0.28718
53 ROUGE-1 Eval D0721-C.M.100.E-G.53 R:0.39739 P:0.25417 F:0.31004
53 ROUGE-1 Eval D0726-A.M.100.F-A.53 R:0.38206 P:0.23810 F:0.29337
53 ROUGE-1 Eval D0726-A.M.100.F-E.53 R:0.38333 P:0.23810 F:0.29374
53 ROUGE-1 Eval D0726-A.M.100.F-F.53 R:0.40864 P:0.25466 F:0.31378
53 ROUGE-1 Eval D0726-A.M.100.F-G.53 R:0.41196 P:0.25673 F:0.31633
53 ROUGE-1 Eval D0726-B.M.100.F-A.53 R:0.25490 P:0.17687 F:0.20883
53 ROUGE-1 Eval D0726-B.M.100.F-E.53 R:0.28571 P:0.19501 F:0.23180
53 ROUGE-1 Eval D0726-B.M.100.F-F.53 R:0.28239 P:0.19274 F:0.22911
53 ROUGE-1 Eval D0726-B.M.100.F-G.53 R:0.29605 P:0.20408 F:0.24161
53 ROUGE-1 Eval D0726-C.M.100.F-A.53 R:0.35333 P:0.24036 F:0.28610
53 ROUGE-1 Eval D0726-C.M.100.F-E.53 R:0.35017 P:0.23583 F:0.28185
53 ROUGE-1 Eval D0726-C.M.100.F-F.53 R:0.39661 P:0.26531 F:0.31794
53 ROUGE-1 Eval D0726-C.M.100.F-G.53 R:0.38361 P:0.26531 F:0.31368
53 ROUGE-1 Eval D0727-A.M.100.G-A.53 R:0.37209 P:0.23779 F:0.29015
53 ROUGE-1 Eval D0727-A.M.100.G-F.53 R:0.36513 P:0.23567 F:0.28645
53 ROUGE-1 Eval D0727-A.M.100.G-G.53 R:0.36928 P:0.23992 F:0.29087
53 ROUGE-1 Eval D0727-A.M.100.G-H.53 R:0.38487 P:0.24841 F:0.30194
53 ROUGE-1 Eval D0727-B.M.100.G-A.53 R:0.32990 P:0.20645 F:0.25397
53 ROUGE-1 Eval D0727-B.M.100.G-F.53 R:0.33442 P:0.22151 F:0.26650
53 ROUGE-1 Eval D0727-B.M.100.G-G.53 R:0.30104 P:0.18710 F:0.23077
53 ROUGE-1 Eval D0727-B.M.100.G-H.53 R:0.30584 P:0.19140 F:0.23545
53 ROUGE-1 Eval D0727-C.M.100.G-A.53 R:0.35179 P:0.22500 F:0.27446
53 ROUGE-1 Eval D0727-C.M.100.G-F.53 R:0.36027 P:0.22292 F:0.27542
53 ROUGE-1 Eval D0727-C.M.100.G-G.53 R:0.35644 P:0.22500 F:0.27586
53 ROUGE-1 Eval D0727-C.M.100.G-H.53 R:0.35811 P:0.22083 F:0.27319
53 ROUGE-1 Eval D0736-A.M.100.H-G.53 R:0.29749 P:0.15900 F:0.20724
53 ROUGE-1 Eval D0736-A.M.100.H-H.53 R:0.31752 P:0.16667 F:0.21860
53 ROUGE-1 Eval D0736-A.M.100.H-I.53 R:0.30605 P:0.16475 F:0.21420
53 ROUGE-1 Eval D0736-A.M.100.H-J.53 R:0.31046 P:0.18199 F:0.22947
53 ROUGE-1 Eval D0736-B.M.100.H-G.53 R:0.20229 P:0.11937 F:0.15014
53 ROUGE-1 Eval D0736-B.M.100.H-H.53 R:0.19835 P:0.10811 F:0.13994
53 ROUGE-1 Eval D0736-B.M.100.H-I.53 R:0.21339 P:0.11486 F:0.14934
53 ROUGE-1 Eval D0736-B.M.100.H-J.53 R:0.21329 P:0.13739 F:0.16713
53 ROUGE-1 Eval D0736-C.M.100.H-G.53 R:0.30802 P:0.13082 F:0.18364
53 ROUGE-1 Eval D0736-C.M.100.H-H.53 R:0.31551 P:0.10573 F:0.15838
53 ROUGE-1 Eval D0736-C.M.100.H-I.53 R:0.33690 P:0.11290 F:0.16912
53 ROUGE-1 Eval D0736-C.M.100.H-J.53 R:0.28302 P:0.13441 F:0.18226
53 ROUGE-1 Eval D0740-A.M.100.I-D.53 R:0.29703 P:0.18987 F:0.23166
53 ROUGE-1 Eval D0740-A.M.100.I-H.53 R:0.29412 P:0.18987 F:0.23077
53 ROUGE-1 Eval D0740-A.M.100.I-I.53 R:0.30519 P:0.19831 F:0.24041
53 ROUGE-1 Eval D0740-A.M.100.I-J.53 R:0.29677 P:0.19409 F:0.23469
53 ROUGE-1 Eval D0740-B.M.100.I-D.53 R:0.28571 P:0.18449 F:0.22421
53 ROUGE-1 Eval D0740-B.M.100.I-H.53 R:0.25828 P:0.16352 F:0.20026
53 ROUGE-1 Eval D0740-B.M.100.I-I.53 R:0.32131 P:0.20545 F:0.25064
53 ROUGE-1 Eval D0740-B.M.100.I-J.53 R:0.30097 P:0.19497 F:0.23664
53 ROUGE-1 Eval D0740-C.M.100.I-D.53 R:0.43131 P:0.30201 F:0.35526
53 ROUGE-1 Eval D0740-C.M.100.I-H.53 R:0.36013 P:0.25056 F:0.29552
53 ROUGE-1 Eval D0740-C.M.100.I-I.53 R:0.40256 P:0.28188 F:0.33158
53 ROUGE-1 Eval D0740-C.M.100.I-J.53 R:0.43631 P:0.30649 F:0.36006
53 ROUGE-1 Eval D0743-A.M.100.J-B.53 R:0.21270 P:0.13373 F:0.16421
53 ROUGE-1 Eval D0743-A.M.100.J-H.53 R:0.18519 P:0.11976 F:0.14546
53 ROUGE-1 Eval D0743-A.M.100.J-I.53 R:0.23438 P:0.14970 F:0.18271
53 ROUGE-1 Eval D0743-A.M.100.J-J.53 R:0.20000 P:0.12974 F:0.15738
53 ROUGE-1 Eval D0743-B.M.100.J-B.53 R:0.25321 P:0.16773 F:0.20179
53 ROUGE-1 Eval D0743-B.M.100.J-H.53 R:0.23975 P:0.16136 F:0.19290
53 ROUGE-1 Eval D0743-B.M.100.J-I.53 R:0.27848 P:0.18684 F:0.22364
53 ROUGE-1 Eval D0743-B.M.100.J-J.53 R:0.26168 P:0.17834 F:0.21212
53 ROUGE-1 Eval D0743-C.M.100.J-B.53 R:0.30794 P:0.18165 F:0.22851
53 ROUGE-1 Eval D0743-C.M.100.J-H.53 R:0.29618 P:0.17416 F:0.21934
53 ROUGE-1 Eval D0743-C.M.100.J-I.53 R:0.32588 P:0.19101 F:0.24085
53 ROUGE-1 Eval D0743-C.M.100.J-J.53 R:0.27987 P:0.16667 F:0.20892
---------------------------------------------
53 ROUGE-2 Average_R: 0.07378 (95%-conf.int. 0.06626 - 0.08165)
53 ROUGE-2 Average_P: 0.04784 (95%-conf.int. 0.04252 - 0.05327)
53 ROUGE-2 Average_F: 0.05792 (95%-conf.int. 0.05170 - 0.06440)
.............................................
53 ROUGE-2 Eval D0703-A.M.100.A-A.53 R:0.15017 P:0.10185 F:0.12138
53 ROUGE-2 Eval D0703-A.M.100.A-C.53 R:0.14576 P:0.09954 F:0.11830
53 ROUGE-2 Eval D0703-A.M.100.A-D.53 R:0.14931 P:0.09954 F:0.11945
53 ROUGE-2 Eval D0703-A.M.100.A-J.53 R:0.14089 P:0.09491 F:0.11342
53 ROUGE-2 Eval D0703-B.M.100.A-A.53 R:0.13861 P:0.09524 F:0.11290
53 ROUGE-2 Eval D0703-B.M.100.A-C.53 R:0.09831 P:0.06576 F:0.07881
53 ROUGE-2 Eval D0703-B.M.100.A-D.53 R:0.11186 P:0.07483 F:0.08967
53 ROUGE-2 Eval D0703-B.M.100.A-J.53 R:0.12416 P:0.08390 F:0.10013
53 ROUGE-2 Eval D0703-C.M.100.A-A.53 R:0.05051 P:0.03356 F:0.04033
53 ROUGE-2 Eval D0703-C.M.100.A-C.53 R:0.05574 P:0.03803 F:0.04521
53 ROUGE-2 Eval D0703-C.M.100.A-D.53 R:0.05017 P:0.03356 F:0.04022
53 ROUGE-2 Eval D0703-C.M.100.A-J.53 R:0.04348 P:0.02908 F:0.03485
53 ROUGE-2 Eval D0706-A.M.100.B-B.53 R:0.12787 P:0.08387 F:0.10130
53 ROUGE-2 Eval D0706-A.M.100.B-D.53 R:0.13201 P:0.08602 F:0.10416
53 ROUGE-2 Eval D0706-A.M.100.B-E.53 R:0.07869 P:0.05161 F:0.06234
53 ROUGE-2 Eval D0706-A.M.100.B-I.53 R:0.12459 P:0.08172 F:0.09870
53 ROUGE-2 Eval D0706-B.M.100.B-B.53 R:0.02640 P:0.01688 F:0.02059
53 ROUGE-2 Eval D0706-B.M.100.B-D.53 R:0.04605 P:0.02954 F:0.03599
53 ROUGE-2 Eval D0706-B.M.100.B-E.53 R:0.03279 P:0.02110 F:0.02568
53 ROUGE-2 Eval D0706-B.M.100.B-I.53 R:0.03268 P:0.02110 F:0.02564
53 ROUGE-2 Eval D0706-C.M.100.B-B.53 R:0.01629 P:0.01055 F:0.01281
53 ROUGE-2 Eval D0706-C.M.100.B-D.53 R:0.01954 P:0.01266 F:0.01536
53 ROUGE-2 Eval D0706-C.M.100.B-E.53 R:0.00647 P:0.00422 F:0.00511
53 ROUGE-2 Eval D0706-C.M.100.B-I.53 R:0.01613 P:0.01055 F:0.01276
53 ROUGE-2 Eval D0711-A.M.100.C-A.53 R:0.05648 P:0.03434 F:0.04271
53 ROUGE-2 Eval D0711-A.M.100.C-B.53 R:0.07407 P:0.04444 F:0.05555
53 ROUGE-2 Eval D0711-A.M.100.C-C.53 R:0.04714 P:0.02828 F:0.03535
53 ROUGE-2 Eval D0711-A.M.100.C-F.53 R:0.06355 P:0.03838 F:0.04786
53 ROUGE-2 Eval D0711-B.M.100.C-A.53 R:0.03093 P:0.02239 F:0.02598
53 ROUGE-2 Eval D0711-B.M.100.C-B.53 R:0.05882 P:0.04229 F:0.04920
53 ROUGE-2 Eval D0711-B.M.100.C-C.53 R:0.05085 P:0.03731 F:0.04304
53 ROUGE-2 Eval D0711-B.M.100.C-F.53 R:0.04452 P:0.03234 F:0.03746
53 ROUGE-2 Eval D0711-C.M.100.C-A.53 R:0.08667 P:0.06019 F:0.07104
53 ROUGE-2 Eval D0711-C.M.100.C-B.53 R:0.10345 P:0.06944 F:0.08310
53 ROUGE-2 Eval D0711-C.M.100.C-C.53 R:0.08191 P:0.05556 F:0.06621
53 ROUGE-2 Eval D0711-C.M.100.C-F.53 R:0.08532 P:0.05787 F:0.06896
53 ROUGE-2 Eval D0716-A.M.100.D-C.53 R:0.19205 P:0.12975 F:0.15487
53 ROUGE-2 Eval D0716-A.M.100.D-D.53 R:0.20539 P:0.13647 F:0.16398
53 ROUGE-2 Eval D0716-A.M.100.D-E.53 R:0.19799 P:0.13199 F:0.15839
53 ROUGE-2 Eval D0716-A.M.100.D-F.53 R:0.18667 P:0.12528 F:0.14993
53 ROUGE-2 Eval D0716-B.M.100.D-C.53 R:0.13621 P:0.09361 F:0.11096
53 ROUGE-2 Eval D0716-B.M.100.D-D.53 R:0.13898 P:0.09361 F:0.11187
53 ROUGE-2 Eval D0716-B.M.100.D-E.53 R:0.10738 P:0.07306 F:0.08696
53 ROUGE-2 Eval D0716-B.M.100.D-F.53 R:0.13131 P:0.08904 F:0.10612
53 ROUGE-2 Eval D0716-C.M.100.D-C.53 R:0.08553 P:0.05778 F:0.06897
53 ROUGE-2 Eval D0716-C.M.100.D-D.53 R:0.08108 P:0.05333 F:0.06434
53 ROUGE-2 Eval D0716-C.M.100.D-E.53 R:0.10333 P:0.06889 F:0.08267
53 ROUGE-2 Eval D0716-C.M.100.D-F.53 R:0.09091 P:0.06000 F:0.07229
53 ROUGE-2 Eval D0721-A.M.100.E-B.53 R:0.06061 P:0.03871 F:0.04725
53 ROUGE-2 Eval D0721-A.M.100.E-C.53 R:0.05574 P:0.03656 F:0.04416
53 ROUGE-2 Eval D0721-A.M.100.E-E.53 R:0.06230 P:0.04086 F:0.04935
53 ROUGE-2 Eval D0721-A.M.100.E-G.53 R:0.05788 P:0.03871 F:0.04639
53 ROUGE-2 Eval D0721-B.M.100.E-B.53 R:0.07895 P:0.05063 F:0.06170
53 ROUGE-2 Eval D0721-B.M.100.E-C.53 R:0.06109 P:0.04008 F:0.04840
53 ROUGE-2 Eval D0721-B.M.100.E-E.53 R:0.06954 P:0.04430 F:0.05412
53 ROUGE-2 Eval D0721-B.M.100.E-G.53 R:0.06515 P:0.04219 F:0.05121
53 ROUGE-2 Eval D0721-C.M.100.E-B.53 R:0.09272 P:0.05870 F:0.07189
53 ROUGE-2 Eval D0721-C.M.100.E-C.53 R:0.09333 P:0.05870 F:0.07207
53 ROUGE-2 Eval D0721-C.M.100.E-E.53 R:0.06734 P:0.04193 F:0.05168
53 ROUGE-2 Eval D0721-C.M.100.E-G.53 R:0.07566 P:0.04822 F:0.05890
53 ROUGE-2 Eval D0726-A.M.100.F-A.53 R:0.08054 P:0.05000 F:0.06170
53 ROUGE-2 Eval D0726-A.M.100.F-E.53 R:0.11111 P:0.06875 F:0.08494
53 ROUGE-2 Eval D0726-A.M.100.F-F.53 R:0.09396 P:0.05833 F:0.07198
53 ROUGE-2 Eval D0726-A.M.100.F-G.53 R:0.10738 P:0.06667 F:0.08226
53 ROUGE-2 Eval D0726-B.M.100.F-A.53 R:0.02640 P:0.01826 F:0.02159
53 ROUGE-2 Eval D0726-B.M.100.F-E.53 R:0.03691 P:0.02511 F:0.02989
53 ROUGE-2 Eval D0726-B.M.100.F-F.53 R:0.03356 P:0.02283 F:0.02717
53 ROUGE-2 Eval D0726-B.M.100.F-G.53 R:0.03322 P:0.02283 F:0.02706
53 ROUGE-2 Eval D0726-C.M.100.F-A.53 R:0.07071 P:0.04795 F:0.05715
53 ROUGE-2 Eval D0726-C.M.100.F-E.53 R:0.04762 P:0.03196 F:0.03825
53 ROUGE-2 Eval D0726-C.M.100.F-F.53 R:0.07534 P:0.05023 F:0.06027
53 ROUGE-2 Eval D0726-C.M.100.F-G.53 R:0.06954 P:0.04795 F:0.05676
53 ROUGE-2 Eval D0727-A.M.100.G-A.53 R:0.05369 P:0.03419 F:0.04178
53 ROUGE-2 Eval D0727-A.M.100.G-F.53 R:0.05316 P:0.03419 F:0.04162
53 ROUGE-2 Eval D0727-A.M.100.G-G.53 R:0.05941 P:0.03846 F:0.04669
53 ROUGE-2 Eval D0727-A.M.100.G-H.53 R:0.07309 P:0.04701 F:0.05722
53 ROUGE-2 Eval D0727-B.M.100.G-A.53 R:0.04861 P:0.03030 F:0.03733
53 ROUGE-2 Eval D0727-B.M.100.G-F.53 R:0.05902 P:0.03896 F:0.04694
53 ROUGE-2 Eval D0727-B.M.100.G-G.53 R:0.04545 P:0.02814 F:0.03476
53 ROUGE-2 Eval D0727-B.M.100.G-H.53 R:0.05208 P:0.03247 F:0.04000
53 ROUGE-2 Eval D0727-C.M.100.G-A.53 R:0.06908 P:0.04403 F:0.05378
53 ROUGE-2 Eval D0727-C.M.100.G-F.53 R:0.06803 P:0.04193 F:0.05188
53 ROUGE-2 Eval D0727-C.M.100.G-G.53 R:0.06667 P:0.04193 F:0.05148
53 ROUGE-2 Eval D0727-C.M.100.G-H.53 R:0.04778 P:0.02935 F:0.03636
53 ROUGE-2 Eval D0736-A.M.100.H-G.53 R:0.06884 P:0.03661 F:0.04780
53 ROUGE-2 Eval D0736-A.M.100.H-H.53 R:0.04797 P:0.02505 F:0.03291
53 ROUGE-2 Eval D0736-A.M.100.H-I.53 R:0.05755 P:0.03083 F:0.04015
53 ROUGE-2 Eval D0736-A.M.100.H-J.53 R:0.05941 P:0.03468 F:0.04380
53 ROUGE-2 Eval D0736-B.M.100.H-G.53 R:0.00386 P:0.00227 F:0.00286
53 ROUGE-2 Eval D0736-B.M.100.H-H.53 R:0.01255 P:0.00680 F:0.00882
53 ROUGE-2 Eval D0736-B.M.100.H-I.53 R:0.00847 P:0.00454 F:0.00591
53 ROUGE-2 Eval D0736-B.M.100.H-J.53 R:0.01060 P:0.00680 F:0.00829
53 ROUGE-2 Eval D0736-C.M.100.H-G.53 R:0.06838 P:0.02883 F:0.04056
53 ROUGE-2 Eval D0736-C.M.100.H-H.53 R:0.07065 P:0.02342 F:0.03518
53 ROUGE-2 Eval D0736-C.M.100.H-I.53 R:0.05978 P:0.01982 F:0.02977
53 ROUGE-2 Eval D0736-C.M.100.H-J.53 R:0.05344 P:0.02523 F:0.03428
53 ROUGE-2 Eval D0740-A.M.100.I-D.53 R:0.07000 P:0.04459 F:0.05448
53 ROUGE-2 Eval D0740-A.M.100.I-H.53 R:0.06601 P:0.04246 F:0.05168
53 ROUGE-2 Eval D0740-A.M.100.I-I.53 R:0.06885 P:0.04459 F:0.05413
53 ROUGE-2 Eval D0740-A.M.100.I-J.53 R:0.06189 P:0.04034 F:0.04884
53 ROUGE-2 Eval D0740-B.M.100.I-D.53 R:0.05574 P:0.03586 F:0.04364
53 ROUGE-2 Eval D0740-B.M.100.I-H.53 R:0.05351 P:0.03376 F:0.04140
53 ROUGE-2 Eval D0740-B.M.100.I-I.53 R:0.07616 P:0.04852 F:0.05928
53 ROUGE-2 Eval D0740-B.M.100.I-J.53 R:0.06209 P:0.04008 F:0.04871
53 ROUGE-2 Eval D0740-C.M.100.I-D.53 R:0.18065 P:0.12613 F:0.14855
53 ROUGE-2 Eval D0740-C.M.100.I-H.53 R:0.10065 P:0.06982 F:0.08245
53 ROUGE-2 Eval D0740-C.M.100.I-I.53 R:0.15161 P:0.10586 F:0.12467
53 ROUGE-2 Eval D0740-C.M.100.I-J.53 R:0.16720 P:0.11712 F:0.13775
53 ROUGE-2 Eval D0743-A.M.100.J-B.53 R:0.03846 P:0.02410 F:0.02963
53 ROUGE-2 Eval D0743-A.M.100.J-H.53 R:0.01558 P:0.01004 F:0.01221
53 ROUGE-2 Eval D0743-A.M.100.J-I.53 R:0.03470 P:0.02209 F:0.02699
53 ROUGE-2 Eval D0743-A.M.100.J-J.53 R:0.02484 P:0.01606 F:0.01951
53 ROUGE-2 Eval D0743-B.M.100.J-B.53 R:0.04854 P:0.03205 F:0.03861
53 ROUGE-2 Eval D0743-B.M.100.J-H.53 R:0.03503 P:0.02350 F:0.02813
53 ROUGE-2 Eval D0743-B.M.100.J-I.53 R:0.05751 P:0.03846 F:0.04609
53 ROUGE-2 Eval D0743-B.M.100.J-J.53 R:0.05031 P:0.03419 F:0.04071
53 ROUGE-2 Eval D0743-C.M.100.J-B.53 R:0.05128 P:0.03013 F:0.03796
53 ROUGE-2 Eval D0743-C.M.100.J-H.53 R:0.05466 P:0.03202 F:0.04038
53 ROUGE-2 Eval D0743-C.M.100.J-I.53 R:0.05484 P:0.03202 F:0.04043
53 ROUGE-2 Eval D0743-C.M.100.J-J.53 R:0.04127 P:0.02448 F:0.03073
---------------------------------------------
53 ROUGE-3 Average_R: 0.02659 (95%-conf.int. 0.02230 - 0.03127)
53 ROUGE-3 Average_P: 0.01731 (95%-conf.int. 0.01436 - 0.02054)
53 ROUGE-3 Average_F: 0.02092 (95%-conf.int. 0.01743 - 0.02478)
.............................................
53 ROUGE-3 Eval D0703-A.M.100.A-A.53 R:0.07241 P:0.04895 F:0.05841
53 ROUGE-3 Eval D0703-A.M.100.A-C.53 R:0.06849 P:0.04662 F:0.05548
53 ROUGE-3 Eval D0703-A.M.100.A-D.53 R:0.07368 P:0.04895 F:0.05882
53 ROUGE-3 Eval D0703-A.M.100.A-J.53 R:0.05556 P:0.03730 F:0.04463
53 ROUGE-3 Eval D0703-B.M.100.A-A.53 R:0.07000 P:0.04795 F:0.05691
53 ROUGE-3 Eval D0703-B.M.100.A-C.53 R:0.04452 P:0.02968 F:0.03562
53 ROUGE-3 Eval D0703-B.M.100.A-D.53 R:0.04452 P:0.02968 F:0.03562
53 ROUGE-3 Eval D0703-B.M.100.A-J.53 R:0.06441 P:0.04338 F:0.05184
53 ROUGE-3 Eval D0703-C.M.100.A-A.53 R:0.00680 P:0.00450 F:0.00542
53 ROUGE-3 Eval D0703-C.M.100.A-C.53 R:0.00662 P:0.00450 F:0.00536
53 ROUGE-3 Eval D0703-C.M.100.A-D.53 R:0.00676 P:0.00450 F:0.00540
53 ROUGE-3 Eval D0703-C.M.100.A-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0706-A.M.100.B-B.53 R:0.04967 P:0.03247 F:0.03927
53 ROUGE-3 Eval D0706-A.M.100.B-D.53 R:0.05667 P:0.03680 F:0.04462
53 ROUGE-3 Eval D0706-A.M.100.B-E.53 R:0.01325 P:0.00866 F:0.01047
53 ROUGE-3 Eval D0706-A.M.100.B-I.53 R:0.05960 P:0.03896 F:0.04712
53 ROUGE-3 Eval D0706-B.M.100.B-B.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0706-B.M.100.B-D.53 R:0.00664 P:0.00425 F:0.00518
53 ROUGE-3 Eval D0706-B.M.100.B-E.53 R:0.00662 P:0.00425 F:0.00518
53 ROUGE-3 Eval D0706-B.M.100.B-I.53 R:0.00660 P:0.00425 F:0.00517
53 ROUGE-3 Eval D0706-C.M.100.B-B.53 R:0.00329 P:0.00212 F:0.00258
53 ROUGE-3 Eval D0706-C.M.100.B-D.53 R:0.00329 P:0.00212 F:0.00258
53 ROUGE-3 Eval D0706-C.M.100.B-E.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0706-C.M.100.B-I.53 R:0.00326 P:0.00212 F:0.00257
53 ROUGE-3 Eval D0711-A.M.100.C-A.53 R:0.02349 P:0.01423 F:0.01772
53 ROUGE-3 Eval D0711-A.M.100.C-B.53 R:0.03061 P:0.01829 F:0.02290
53 ROUGE-3 Eval D0711-A.M.100.C-C.53 R:0.01361 P:0.00813 F:0.01018
53 ROUGE-3 Eval D0711-A.M.100.C-F.53 R:0.02365 P:0.01423 F:0.01777
53 ROUGE-3 Eval D0711-B.M.100.C-A.53 R:0.00347 P:0.00251 F:0.00291
53 ROUGE-3 Eval D0711-B.M.100.C-B.53 R:0.01399 P:0.01003 F:0.01168
53 ROUGE-3 Eval D0711-B.M.100.C-C.53 R:0.01370 P:0.01003 F:0.01158
53 ROUGE-3 Eval D0711-B.M.100.C-F.53 R:0.01038 P:0.00752 F:0.00872
53 ROUGE-3 Eval D0711-C.M.100.C-A.53 R:0.03704 P:0.02564 F:0.03030
53 ROUGE-3 Eval D0711-C.M.100.C-B.53 R:0.04878 P:0.03263 F:0.03910
53 ROUGE-3 Eval D0711-C.M.100.C-C.53 R:0.03103 P:0.02098 F:0.02503
53 ROUGE-3 Eval D0711-C.M.100.C-F.53 R:0.02759 P:0.01865 F:0.02226
53 ROUGE-3 Eval D0716-A.M.100.D-C.53 R:0.09365 P:0.06306 F:0.07537
53 ROUGE-3 Eval D0716-A.M.100.D-D.53 R:0.10544 P:0.06982 F:0.08401
53 ROUGE-3 Eval D0716-A.M.100.D-E.53 R:0.09153 P:0.06081 F:0.07307
53 ROUGE-3 Eval D0716-A.M.100.D-F.53 R:0.08418 P:0.05631 F:0.06748
53 ROUGE-3 Eval D0716-B.M.100.D-C.53 R:0.07383 P:0.05057 F:0.06003
53 ROUGE-3 Eval D0716-B.M.100.D-D.53 R:0.07534 P:0.05057 F:0.06052
53 ROUGE-3 Eval D0716-B.M.100.D-E.53 R:0.04407 P:0.02989 F:0.03562
53 ROUGE-3 Eval D0716-B.M.100.D-F.53 R:0.07143 P:0.04828 F:0.05762
53 ROUGE-3 Eval D0716-C.M.100.D-C.53 R:0.02658 P:0.01790 F:0.02139
53 ROUGE-3 Eval D0716-C.M.100.D-D.53 R:0.02048 P:0.01342 F:0.01621
53 ROUGE-3 Eval D0716-C.M.100.D-E.53 R:0.03030 P:0.02013 F:0.02419
53 ROUGE-3 Eval D0716-C.M.100.D-F.53 R:0.02381 P:0.01566 F:0.01889
53 ROUGE-3 Eval D0721-A.M.100.E-B.53 R:0.01020 P:0.00649 F:0.00793
53 ROUGE-3 Eval D0721-A.M.100.E-C.53 R:0.00993 P:0.00649 F:0.00785
53 ROUGE-3 Eval D0721-A.M.100.E-E.53 R:0.00993 P:0.00649 F:0.00785
53 ROUGE-3 Eval D0721-A.M.100.E-G.53 R:0.00974 P:0.00649 F:0.00779
53 ROUGE-3 Eval D0721-B.M.100.E-B.53 R:0.01661 P:0.01062 F:0.01296
53 ROUGE-3 Eval D0721-B.M.100.E-C.53 R:0.00974 P:0.00637 F:0.00770
53 ROUGE-3 Eval D0721-B.M.100.E-E.53 R:0.01338 P:0.00849 F:0.01039
53 ROUGE-3 Eval D0721-B.M.100.E-G.53 R:0.01974 P:0.01274 F:0.01549
53 ROUGE-3 Eval D0721-C.M.100.E-B.53 R:0.04348 P:0.02743 F:0.03364
53 ROUGE-3 Eval D0721-C.M.100.E-C.53 R:0.04040 P:0.02532 F:0.03113
53 ROUGE-3 Eval D0721-C.M.100.E-E.53 R:0.02381 P:0.01477 F:0.01823
53 ROUGE-3 Eval D0721-C.M.100.E-G.53 R:0.03322 P:0.02110 F:0.02581
53 ROUGE-3 Eval D0726-A.M.100.F-A.53 R:0.01695 P:0.01048 F:0.01295
53 ROUGE-3 Eval D0726-A.M.100.F-E.53 R:0.03741 P:0.02306 F:0.02853
53 ROUGE-3 Eval D0726-A.M.100.F-F.53 R:0.02712 P:0.01677 F:0.02072
53 ROUGE-3 Eval D0726-A.M.100.F-G.53 R:0.03051 P:0.01887 F:0.02332
53 ROUGE-3 Eval D0726-B.M.100.F-A.53 R:0.00667 P:0.00460 F:0.00544
53 ROUGE-3 Eval D0726-B.M.100.F-E.53 R:0.00678 P:0.00460 F:0.00548
53 ROUGE-3 Eval D0726-B.M.100.F-F.53 R:0.00678 P:0.00460 F:0.00548
53 ROUGE-3 Eval D0726-B.M.100.F-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0726-C.M.100.F-A.53 R:0.03061 P:0.02069 F:0.02469
53 ROUGE-3 Eval D0726-C.M.100.F-E.53 R:0.01031 P:0.00690 F:0.00827
53 ROUGE-3 Eval D0726-C.M.100.F-F.53 R:0.02768 P:0.01839 F:0.02210
53 ROUGE-3 Eval D0726-C.M.100.F-G.53 R:0.02341 P:0.01609 F:0.01907
53 ROUGE-3 Eval D0727-A.M.100.G-A.53 R:0.00678 P:0.00430 F:0.00526
53 ROUGE-3 Eval D0727-A.M.100.G-F.53 R:0.02013 P:0.01290 F:0.01572
53 ROUGE-3 Eval D0727-A.M.100.G-G.53 R:0.02000 P:0.01290 F:0.01568
53 ROUGE-3 Eval D0727-A.M.100.G-H.53 R:0.02349 P:0.01505 F:0.01835
53 ROUGE-3 Eval D0727-B.M.100.G-A.53 R:0.01053 P:0.00654 F:0.00807
53 ROUGE-3 Eval D0727-B.M.100.G-F.53 R:0.01325 P:0.00871 F:0.01051
53 ROUGE-3 Eval D0727-B.M.100.G-G.53 R:0.00707 P:0.00436 F:0.00539
53 ROUGE-3 Eval D0727-B.M.100.G-H.53 R:0.01053 P:0.00654 F:0.00807
53 ROUGE-3 Eval D0727-C.M.100.G-A.53 R:0.02990 P:0.01899 F:0.02323
53 ROUGE-3 Eval D0727-C.M.100.G-F.53 R:0.02749 P:0.01688 F:0.02092
53 ROUGE-3 Eval D0727-C.M.100.G-G.53 R:0.02694 P:0.01688 F:0.02076
53 ROUGE-3 Eval D0727-C.M.100.G-H.53 R:0.00690 P:0.00422 F:0.00524
53 ROUGE-3 Eval D0736-A.M.100.H-G.53 R:0.02930 P:0.01550 F:0.02027
53 ROUGE-3 Eval D0736-A.M.100.H-H.53 R:0.01866 P:0.00969 F:0.01276
53 ROUGE-3 Eval D0736-A.M.100.H-I.53 R:0.01818 P:0.00969 F:0.01264
53 ROUGE-3 Eval D0736-A.M.100.H-J.53 R:0.02000 P:0.01163 F:0.01471
53 ROUGE-3 Eval D0736-B.M.100.H-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0736-B.M.100.H-H.53 R:0.00424 P:0.00228 F:0.00297
53 ROUGE-3 Eval D0736-B.M.100.H-I.53 R:0.00429 P:0.00228 F:0.00298
53 ROUGE-3 Eval D0736-B.M.100.H-J.53 R:0.00357 P:0.00228 F:0.00278
53 ROUGE-3 Eval D0736-C.M.100.H-G.53 R:0.02597 P:0.01087 F:0.01533
53 ROUGE-3 Eval D0736-C.M.100.H-H.53 R:0.02762 P:0.00906 F:0.01364
53 ROUGE-3 Eval D0736-C.M.100.H-I.53 R:0.01105 P:0.00362 F:0.00545
53 ROUGE-3 Eval D0736-C.M.100.H-J.53 R:0.01931 P:0.00906 F:0.01233
53 ROUGE-3 Eval D0740-A.M.100.I-D.53 R:0.01347 P:0.00855 F:0.01046
53 ROUGE-3 Eval D0740-A.M.100.I-H.53 R:0.01333 P:0.00855 F:0.01042
53 ROUGE-3 Eval D0740-A.M.100.I-I.53 R:0.01325 P:0.00855 F:0.01039
53 ROUGE-3 Eval D0740-A.M.100.I-J.53 R:0.00987 P:0.00641 F:0.00777
53 ROUGE-3 Eval D0740-B.M.100.I-D.53 R:0.00662 P:0.00425 F:0.00518
53 ROUGE-3 Eval D0740-B.M.100.I-H.53 R:0.01351 P:0.00849 F:0.01043
53 ROUGE-3 Eval D0740-B.M.100.I-I.53 R:0.01672 P:0.01062 F:0.01299
53 ROUGE-3 Eval D0740-B.M.100.I-J.53 R:0.01320 P:0.00849 F:0.01033
53 ROUGE-3 Eval D0740-C.M.100.I-D.53 R:0.11401 P:0.07937 F:0.09359
53 ROUGE-3 Eval D0740-C.M.100.I-H.53 R:0.04590 P:0.03175 F:0.03754
53 ROUGE-3 Eval D0740-C.M.100.I-I.53 R:0.09121 P:0.06349 F:0.07487
53 ROUGE-3 Eval D0740-C.M.100.I-J.53 R:0.10065 P:0.07029 F:0.08277
53 ROUGE-3 Eval D0743-A.M.100.J-B.53 R:0.00324 P:0.00202 F:0.00249
53 ROUGE-3 Eval D0743-A.M.100.J-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-3 Eval D0743-A.M.100.J-I.53 R:0.00318 P:0.00202 F:0.00247
53 ROUGE-3 Eval D0743-A.M.100.J-J.53 R:0.00313 P:0.00202 F:0.00246
53 ROUGE-3 Eval D0743-B.M.100.J-B.53 R:0.01961 P:0.01290 F:0.01556
53 ROUGE-3 Eval D0743-B.M.100.J-H.53 R:0.00643 P:0.00430 F:0.00515
53 ROUGE-3 Eval D0743-B.M.100.J-I.53 R:0.01935 P:0.01290 F:0.01548
53 ROUGE-3 Eval D0743-B.M.100.J-J.53 R:0.02222 P:0.01505 F:0.01795
53 ROUGE-3 Eval D0743-C.M.100.J-B.53 R:0.01618 P:0.00947 F:0.01195
53 ROUGE-3 Eval D0743-C.M.100.J-H.53 R:0.01948 P:0.01136 F:0.01435
53 ROUGE-3 Eval D0743-C.M.100.J-I.53 R:0.01629 P:0.00947 F:0.01198
53 ROUGE-3 Eval D0743-C.M.100.J-J.53 R:0.00641 P:0.00379 F:0.00476
---------------------------------------------
53 ROUGE-4 Average_R: 0.01230 (95%-conf.int. 0.00940 - 0.01536)
53 ROUGE-4 Average_P: 0.00805 (95%-conf.int. 0.00610 - 0.01017)
53 ROUGE-4 Average_F: 0.00971 (95%-conf.int. 0.00736 - 0.01223)
.............................................
53 ROUGE-4 Eval D0703-A.M.100.A-A.53 R:0.04181 P:0.02817 F:0.03366
53 ROUGE-4 Eval D0703-A.M.100.A-C.53 R:0.03806 P:0.02582 F:0.03077
53 ROUGE-4 Eval D0703-A.M.100.A-D.53 R:0.04610 P:0.03052 F:0.03673
53 ROUGE-4 Eval D0703-A.M.100.A-J.53 R:0.02105 P:0.01408 F:0.01687
53 ROUGE-4 Eval D0703-B.M.100.A-A.53 R:0.03704 P:0.02529 F:0.03006
53 ROUGE-4 Eval D0703-B.M.100.A-C.53 R:0.01730 P:0.01149 F:0.01381
53 ROUGE-4 Eval D0703-B.M.100.A-D.53 R:0.02076 P:0.01379 F:0.01657
53 ROUGE-4 Eval D0703-B.M.100.A-J.53 R:0.03767 P:0.02529 F:0.03026
53 ROUGE-4 Eval D0703-C.M.100.A-A.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0703-C.M.100.A-C.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0703-C.M.100.A-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0703-C.M.100.A-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-A.M.100.B-B.53 R:0.03010 P:0.01961 F:0.02375
53 ROUGE-4 Eval D0706-A.M.100.B-D.53 R:0.03367 P:0.02179 F:0.02646
53 ROUGE-4 Eval D0706-A.M.100.B-E.53 R:0.00334 P:0.00218 F:0.00264
53 ROUGE-4 Eval D0706-A.M.100.B-I.53 R:0.03344 P:0.02179 F:0.02639
53 ROUGE-4 Eval D0706-B.M.100.B-B.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-B.M.100.B-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-B.M.100.B-E.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-B.M.100.B-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-C.M.100.B-B.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-C.M.100.B-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-C.M.100.B-E.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0706-C.M.100.B-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0711-A.M.100.C-A.53 R:0.01017 P:0.00613 F:0.00765
53 ROUGE-4 Eval D0711-A.M.100.C-B.53 R:0.01031 P:0.00613 F:0.00769
53 ROUGE-4 Eval D0711-A.M.100.C-C.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0711-A.M.100.C-F.53 R:0.01024 P:0.00613 F:0.00767
53 ROUGE-4 Eval D0711-B.M.100.C-A.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0711-B.M.100.C-B.53 R:0.00353 P:0.00253 F:0.00295
53 ROUGE-4 Eval D0711-B.M.100.C-C.53 R:0.00346 P:0.00253 F:0.00292
53 ROUGE-4 Eval D0711-B.M.100.C-F.53 R:0.00350 P:0.00253 F:0.00294
53 ROUGE-4 Eval D0711-C.M.100.C-A.53 R:0.02381 P:0.01643 F:0.01944
53 ROUGE-4 Eval D0711-C.M.100.C-B.53 R:0.02817 P:0.01878 F:0.02254
53 ROUGE-4 Eval D0711-C.M.100.C-C.53 R:0.01742 P:0.01174 F:0.01403
53 ROUGE-4 Eval D0711-C.M.100.C-F.53 R:0.01394 P:0.00939 F:0.01122
53 ROUGE-4 Eval D0716-A.M.100.D-C.53 R:0.04730 P:0.03175 F:0.03800
53 ROUGE-4 Eval D0716-A.M.100.D-D.53 R:0.06873 P:0.04535 F:0.05464
53 ROUGE-4 Eval D0716-A.M.100.D-E.53 R:0.05479 P:0.03628 F:0.04365
53 ROUGE-4 Eval D0716-A.M.100.D-F.53 R:0.04422 P:0.02948 F:0.03538
53 ROUGE-4 Eval D0716-B.M.100.D-C.53 R:0.03729 P:0.02546 F:0.03026
53 ROUGE-4 Eval D0716-B.M.100.D-D.53 R:0.03806 P:0.02546 F:0.03051
53 ROUGE-4 Eval D0716-B.M.100.D-E.53 R:0.02055 P:0.01389 F:0.01658
53 ROUGE-4 Eval D0716-B.M.100.D-F.53 R:0.03780 P:0.02546 F:0.03043
53 ROUGE-4 Eval D0716-C.M.100.D-C.53 R:0.00336 P:0.00225 F:0.00270
53 ROUGE-4 Eval D0716-C.M.100.D-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0716-C.M.100.D-E.53 R:0.00340 P:0.00225 F:0.00271
53 ROUGE-4 Eval D0716-C.M.100.D-F.53 R:0.00344 P:0.00225 F:0.00272
53 ROUGE-4 Eval D0721-A.M.100.E-B.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0721-A.M.100.E-C.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0721-A.M.100.E-E.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0721-A.M.100.E-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0721-B.M.100.E-B.53 R:0.00336 P:0.00214 F:0.00261
53 ROUGE-4 Eval D0721-B.M.100.E-C.53 R:0.00328 P:0.00214 F:0.00259
53 ROUGE-4 Eval D0721-B.M.100.E-E.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0721-B.M.100.E-G.53 R:0.00332 P:0.00214 F:0.00260
53 ROUGE-4 Eval D0721-C.M.100.E-B.53 R:0.02365 P:0.01486 F:0.01825
53 ROUGE-4 Eval D0721-C.M.100.E-C.53 R:0.02041 P:0.01274 F:0.01569
53 ROUGE-4 Eval D0721-C.M.100.E-E.53 R:0.00687 P:0.00425 F:0.00525
53 ROUGE-4 Eval D0721-C.M.100.E-G.53 R:0.02013 P:0.01274 F:0.01560
53 ROUGE-4 Eval D0726-A.M.100.F-A.53 R:0.01027 P:0.00633 F:0.00783
53 ROUGE-4 Eval D0726-A.M.100.F-E.53 R:0.01718 P:0.01055 F:0.01307
53 ROUGE-4 Eval D0726-A.M.100.F-F.53 R:0.01027 P:0.00633 F:0.00783
53 ROUGE-4 Eval D0726-A.M.100.F-G.53 R:0.01370 P:0.00844 F:0.01045
53 ROUGE-4 Eval D0726-B.M.100.F-A.53 R:0.00337 P:0.00231 F:0.00274
53 ROUGE-4 Eval D0726-B.M.100.F-E.53 R:0.00342 P:0.00231 F:0.00276
53 ROUGE-4 Eval D0726-B.M.100.F-F.53 R:0.00342 P:0.00231 F:0.00276
53 ROUGE-4 Eval D0726-B.M.100.F-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0726-C.M.100.F-A.53 R:0.01375 P:0.00926 F:0.01107
53 ROUGE-4 Eval D0726-C.M.100.F-E.53 R:0.00347 P:0.00231 F:0.00277
53 ROUGE-4 Eval D0726-C.M.100.F-F.53 R:0.01399 P:0.00926 F:0.01114
53 ROUGE-4 Eval D0726-C.M.100.F-G.53 R:0.01014 P:0.00694 F:0.00824
53 ROUGE-4 Eval D0727-A.M.100.G-A.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0727-A.M.100.G-F.53 R:0.01356 P:0.00866 F:0.01057
53 ROUGE-4 Eval D0727-A.M.100.G-G.53 R:0.01347 P:0.00866 F:0.01054
53 ROUGE-4 Eval D0727-A.M.100.G-H.53 R:0.01356 P:0.00866 F:0.01057
53 ROUGE-4 Eval D0727-B.M.100.G-A.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0727-B.M.100.G-F.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0727-B.M.100.G-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0727-B.M.100.G-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0727-C.M.100.G-A.53 R:0.01678 P:0.01062 F:0.01301
53 ROUGE-4 Eval D0727-C.M.100.G-F.53 R:0.01736 P:0.01062 F:0.01318
53 ROUGE-4 Eval D0727-C.M.100.G-G.53 R:0.01701 P:0.01062 F:0.01308
53 ROUGE-4 Eval D0727-C.M.100.G-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-A.M.100.H-G.53 R:0.01111 P:0.00585 F:0.00766
53 ROUGE-4 Eval D0736-A.M.100.H-H.53 R:0.00755 P:0.00390 F:0.00514
53 ROUGE-4 Eval D0736-A.M.100.H-I.53 R:0.00735 P:0.00390 F:0.00510
53 ROUGE-4 Eval D0736-A.M.100.H-J.53 R:0.00673 P:0.00390 F:0.00494
53 ROUGE-4 Eval D0736-B.M.100.H-G.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-B.M.100.H-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-B.M.100.H-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-B.M.100.H-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-C.M.100.H-G.53 R:0.01316 P:0.00546 F:0.00772
53 ROUGE-4 Eval D0736-C.M.100.H-H.53 R:0.01685 P:0.00546 F:0.00825
53 ROUGE-4 Eval D0736-C.M.100.H-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0736-C.M.100.H-J.53 R:0.01172 P:0.00546 F:0.00745
53 ROUGE-4 Eval D0740-A.M.100.I-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-A.M.100.I-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-A.M.100.I-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-A.M.100.I-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-B.M.100.I-D.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-B.M.100.I-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-B.M.100.I-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-B.M.100.I-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0740-C.M.100.I-D.53 R:0.08224 P:0.05708 F:0.06739
53 ROUGE-4 Eval D0740-C.M.100.I-H.53 R:0.02980 P:0.02055 F:0.02433
53 ROUGE-4 Eval D0740-C.M.100.I-I.53 R:0.06250 P:0.04338 F:0.05121
53 ROUGE-4 Eval D0740-C.M.100.I-J.53 R:0.07213 P:0.05023 F:0.05922
53 ROUGE-4 Eval D0743-A.M.100.J-B.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0743-A.M.100.J-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0743-A.M.100.J-I.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0743-A.M.100.J-J.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0743-B.M.100.J-B.53 R:0.00660 P:0.00433 F:0.00523
53 ROUGE-4 Eval D0743-B.M.100.J-H.53 R:0.00000 P:0.00000 F:0.00000
53 ROUGE-4 Eval D0743-B.M.100.J-I.53 R:0.00651 P:0.00433 F:0.00520
53 ROUGE-4 Eval D0743-B.M.100.J-J.53 R:0.00641 P:0.00433 F:0.00517
53 ROUGE-4 Eval D0743-C.M.100.J-B.53 R:0.00327 P:0.00190 F:0.00240
53 ROUGE-4 Eval D0743-C.M.100.J-H.53 R:0.00328 P:0.00190 F:0.00241
53 ROUGE-4 Eval D0743-C.M.100.J-I.53 R:0.00329 P:0.00190 F:0.00241
53 ROUGE-4 Eval D0743-C.M.100.J-J.53 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
53 ROUGE-L Average_R: 0.29301 (95%-conf.int. 0.28317 - 0.30270)
53 ROUGE-L Average_P: 0.18897 (95%-conf.int. 0.18135 - 0.19677)
53 ROUGE-L Average_F: 0.22923 (95%-conf.int. 0.22076 - 0.23820)
.............................................
53 ROUGE-L Eval D0703-A.M.100.A-A.53 R:0.35811 P:0.24368 F:0.29002
53 ROUGE-L Eval D0703-A.M.100.A-C.53 R:0.34228 P:0.23448 F:0.27831
53 ROUGE-L Eval D0703-A.M.100.A-D.53 R:0.35395 P:0.23678 F:0.28374
53 ROUGE-L Eval D0703-A.M.100.A-J.53 R:0.35034 P:0.23678 F:0.28258
53 ROUGE-L Eval D0703-B.M.100.A-A.53 R:0.33333 P:0.22973 F:0.27200
53 ROUGE-L Eval D0703-B.M.100.A-C.53 R:0.30201 P:0.20270 F:0.24258
53 ROUGE-L Eval D0703-B.M.100.A-D.53 R:0.29866 P:0.20045 F:0.23989
53 ROUGE-L Eval D0703-B.M.100.A-J.53 R:0.31229 P:0.21171 F:0.25235
53 ROUGE-L Eval D0703-C.M.100.A-A.53 R:0.26667 P:0.17778 F:0.21334
53 ROUGE-L Eval D0703-C.M.100.A-C.53 R:0.26299 P:0.18000 F:0.21372
53 ROUGE-L Eval D0703-C.M.100.A-D.53 R:0.26159 P:0.17556 F:0.21011
53 ROUGE-L Eval D0703-C.M.100.A-J.53 R:0.26821 P:0.18000 F:0.21542
53 ROUGE-L Eval D0706-A.M.100.B-B.53 R:0.35390 P:0.23291 F:0.28093
53 ROUGE-L Eval D0706-A.M.100.B-D.53 R:0.32680 P:0.21368 F:0.25840
53 ROUGE-L Eval D0706-A.M.100.B-E.53 R:0.28247 P:0.18590 F:0.22423
53 ROUGE-L Eval D0706-A.M.100.B-I.53 R:0.34416 P:0.22650 F:0.27320
53 ROUGE-L Eval D0706-B.M.100.B-B.53 R:0.24183 P:0.15514 F:0.18902
53 ROUGE-L Eval D0706-B.M.100.B-D.53 R:0.27036 P:0.17400 F:0.21173
53 ROUGE-L Eval D0706-B.M.100.B-E.53 R:0.26623 P:0.17191 F:0.20892
53 ROUGE-L Eval D0706-B.M.100.B-I.53 R:0.25566 P:0.16562 F:0.20102
53 ROUGE-L Eval D0706-C.M.100.B-B.53 R:0.25806 P:0.16771 F:0.20330
53 ROUGE-L Eval D0706-C.M.100.B-D.53 R:0.27097 P:0.17610 F:0.21347
53 ROUGE-L Eval D0706-C.M.100.B-E.53 R:0.25962 P:0.16981 F:0.20532
53 ROUGE-L Eval D0706-C.M.100.B-I.53 R:0.26198 P:0.17191 F:0.20760
53 ROUGE-L Eval D0711-A.M.100.C-A.53 R:0.27632 P:0.16867 F:0.20947
53 ROUGE-L Eval D0711-A.M.100.C-B.53 R:0.30333 P:0.18273 F:0.22807
53 ROUGE-L Eval D0711-A.M.100.C-C.53 R:0.27000 P:0.16265 F:0.20301
53 ROUGE-L Eval D0711-A.M.100.C-F.53 R:0.29470 P:0.17871 F:0.22250
53 ROUGE-L Eval D0711-B.M.100.C-A.53 R:0.29592 P:0.21481 F:0.24892
53 ROUGE-L Eval D0711-B.M.100.C-B.53 R:0.31164 P:0.22469 F:0.26112
53 ROUGE-L Eval D0711-B.M.100.C-C.53 R:0.29530 P:0.21728 F:0.25035
53 ROUGE-L Eval D0711-B.M.100.C-F.53 R:0.29831 P:0.21728 F:0.25143
53 ROUGE-L Eval D0711-C.M.100.C-A.53 R:0.34653 P:0.24138 F:0.28455
53 ROUGE-L Eval D0711-C.M.100.C-B.53 R:0.36860 P:0.24828 F:0.29671
53 ROUGE-L Eval D0711-C.M.100.C-C.53 R:0.32432 P:0.22069 F:0.26265
53 ROUGE-L Eval D0711-C.M.100.C-F.53 R:0.31419 P:0.21379 F:0.25444
53 ROUGE-L Eval D0716-A.M.100.D-C.53 R:0.42295 P:0.28667 F:0.34172
53 ROUGE-L Eval D0716-A.M.100.D-D.53 R:0.44667 P:0.29778 F:0.35734
53 ROUGE-L Eval D0716-A.M.100.D-E.53 R:0.45183 P:0.30222 F:0.36218
53 ROUGE-L Eval D0716-A.M.100.D-F.53 R:0.41584 P:0.28000 F:0.33466
53 ROUGE-L Eval D0716-B.M.100.D-C.53 R:0.34868 P:0.24036 F:0.28456
53 ROUGE-L Eval D0716-B.M.100.D-D.53 R:0.36242 P:0.24490 F:0.29229
53 ROUGE-L Eval D0716-B.M.100.D-E.53 R:0.31894 P:0.21769 F:0.25876
53 ROUGE-L Eval D0716-B.M.100.D-F.53 R:0.31667 P:0.21542 F:0.25641
53 ROUGE-L Eval D0716-C.M.100.D-C.53 R:0.30945 P:0.20971 F:0.25000
53 ROUGE-L Eval D0716-C.M.100.D-D.53 R:0.31104 P:0.20530 F:0.24734
53 ROUGE-L Eval D0716-C.M.100.D-E.53 R:0.31353 P:0.20971 F:0.25132
53 ROUGE-L Eval D0716-C.M.100.D-F.53 R:0.30667 P:0.20309 F:0.24436
53 ROUGE-L Eval D0721-A.M.100.E-B.53 R:0.26000 P:0.16667 F:0.20313
53 ROUGE-L Eval D0721-A.M.100.E-C.53 R:0.23701 P:0.15598 F:0.18814
53 ROUGE-L Eval D0721-A.M.100.E-E.53 R:0.22727 P:0.14957 F:0.18041
53 ROUGE-L Eval D0721-A.M.100.E-G.53 R:0.23248 P:0.15598 F:0.18670
53 ROUGE-L Eval D0721-B.M.100.E-B.53 R:0.28990 P:0.18658 F:0.22704
53 ROUGE-L Eval D0721-B.M.100.E-C.53 R:0.28344 P:0.18658 F:0.22503
53 ROUGE-L Eval D0721-B.M.100.E-E.53 R:0.27541 P:0.17610 F:0.21483
53 ROUGE-L Eval D0721-B.M.100.E-G.53 R:0.27742 P:0.18029 F:0.21855
53 ROUGE-L Eval D0721-C.M.100.E-B.53 R:0.33770 P:0.21458 F:0.26242
53 ROUGE-L Eval D0721-C.M.100.E-C.53 R:0.33333 P:0.21042 F:0.25798
53 ROUGE-L Eval D0721-C.M.100.E-E.53 R:0.30000 P:0.18750 F:0.23077
53 ROUGE-L Eval D0721-C.M.100.E-G.53 R:0.32248 P:0.20625 F:0.25159
53 ROUGE-L Eval D0726-A.M.100.F-A.53 R:0.32890 P:0.20497 F:0.25255
53 ROUGE-L Eval D0726-A.M.100.F-E.53 R:0.36000 P:0.22360 F:0.27586
53 ROUGE-L Eval D0726-A.M.100.F-F.53 R:0.35548 P:0.22153 F:0.27296
53 ROUGE-L Eval D0726-A.M.100.F-G.53 R:0.36213 P:0.22567 F:0.27806
53 ROUGE-L Eval D0726-B.M.100.F-A.53 R:0.22549 P:0.15646 F:0.18474
53 ROUGE-L Eval D0726-B.M.100.F-E.53 R:0.24252 P:0.16553 F:0.19676
53 ROUGE-L Eval D0726-B.M.100.F-F.53 R:0.25249 P:0.17234 F:0.20485
53 ROUGE-L Eval D0726-B.M.100.F-G.53 R:0.25987 P:0.17914 F:0.21208
53 ROUGE-L Eval D0726-C.M.100.F-A.53 R:0.31000 P:0.21088 F:0.25101
53 ROUGE-L Eval D0726-C.M.100.F-E.53 R:0.30640 P:0.20635 F:0.24661
53 ROUGE-L Eval D0726-C.M.100.F-F.53 R:0.35932 P:0.24036 F:0.28804
53 ROUGE-L Eval D0726-C.M.100.F-G.53 R:0.34754 P:0.24036 F:0.28418
53 ROUGE-L Eval D0727-A.M.100.G-A.53 R:0.32890 P:0.21019 F:0.25647
53 ROUGE-L Eval D0727-A.M.100.G-F.53 R:0.31908 P:0.20594 F:0.25032
53 ROUGE-L Eval D0727-A.M.100.G-G.53 R:0.33333 P:0.21656 F:0.26255
53 ROUGE-L Eval D0727-A.M.100.G-H.53 R:0.34211 P:0.22081 F:0.26839
53 ROUGE-L Eval D0727-B.M.100.G-A.53 R:0.29553 P:0.18495 F:0.22752
53 ROUGE-L Eval D0727-B.M.100.G-F.53 R:0.30195 P:0.20000 F:0.24062
53 ROUGE-L Eval D0727-B.M.100.G-G.53 R:0.26298 P:0.16344 F:0.20159
53 ROUGE-L Eval D0727-B.M.100.G-H.53 R:0.27835 P:0.17419 F:0.21428
53 ROUGE-L Eval D0727-C.M.100.G-A.53 R:0.31922 P:0.20417 F:0.24905
53 ROUGE-L Eval D0727-C.M.100.G-F.53 R:0.32323 P:0.20000 F:0.24710
53 ROUGE-L Eval D0727-C.M.100.G-G.53 R:0.32673 P:0.20625 F:0.25287
53 ROUGE-L Eval D0727-C.M.100.G-H.53 R:0.33784 P:0.20833 F:0.25773
53 ROUGE-L Eval D0736-A.M.100.H-G.53 R:0.27599 P:0.14751 F:0.19226
53 ROUGE-L Eval D0736-A.M.100.H-H.53 R:0.28102 P:0.14751 F:0.19347
53 ROUGE-L Eval D0736-A.M.100.H-I.53 R:0.28470 P:0.15326 F:0.19926
53 ROUGE-L Eval D0736-A.M.100.H-J.53 R:0.28431 P:0.16667 F:0.21015
53 ROUGE-L Eval D0736-B.M.100.H-G.53 R:0.17557 P:0.10360 F:0.13031
53 ROUGE-L Eval D0736-B.M.100.H-H.53 R:0.16942 P:0.09234 F:0.11953
53 ROUGE-L Eval D0736-B.M.100.H-I.53 R:0.17155 P:0.09234 F:0.12006
53 ROUGE-L Eval D0736-B.M.100.H-J.53 R:0.18182 P:0.11712 F:0.14247
53 ROUGE-L Eval D0736-C.M.100.H-G.53 R:0.27426 P:0.11649 F:0.16352
53 ROUGE-L Eval D0736-C.M.100.H-H.53 R:0.28877 P:0.09677 F:0.14496
53 ROUGE-L Eval D0736-C.M.100.H-I.53 R:0.29412 P:0.09857 F:0.14766
53 ROUGE-L Eval D0736-C.M.100.H-J.53 R:0.27170 P:0.12903 F:0.17497
53 ROUGE-L Eval D0740-A.M.100.I-D.53 R:0.27393 P:0.17511 F:0.21365
53 ROUGE-L Eval D0740-A.M.100.I-H.53 R:0.27451 P:0.17722 F:0.21539
53 ROUGE-L Eval D0740-A.M.100.I-I.53 R:0.28247 P:0.18354 F:0.22250
53 ROUGE-L Eval D0740-A.M.100.I-J.53 R:0.27419 P:0.17932 F:0.21683
53 ROUGE-L Eval D0740-B.M.100.I-D.53 R:0.25000 P:0.16143 F:0.19618
53 ROUGE-L Eval D0740-B.M.100.I-H.53 R:0.21854 P:0.13836 F:0.16944
53 ROUGE-L Eval D0740-B.M.100.I-I.53 R:0.26885 P:0.17191 F:0.20972
53 ROUGE-L Eval D0740-B.M.100.I-J.53 R:0.26214 P:0.16981 F:0.20611
53 ROUGE-L Eval D0740-C.M.100.I-D.53 R:0.40256 P:0.28188 F:0.33158
53 ROUGE-L Eval D0740-C.M.100.I-H.53 R:0.32797 P:0.22819 F:0.26913
53 ROUGE-L Eval D0740-C.M.100.I-I.53 R:0.36102 P:0.25280 F:0.29737
53 ROUGE-L Eval D0740-C.M.100.I-J.53 R:0.39490 P:0.27740 F:0.32588
53 ROUGE-L Eval D0743-A.M.100.J-B.53 R:0.19048 P:0.11976 F:0.14706
53 ROUGE-L Eval D0743-A.M.100.J-H.53 R:0.15741 P:0.10180 F:0.12364
53 ROUGE-L Eval D0743-A.M.100.J-I.53 R:0.20625 P:0.13174 F:0.16078
53 ROUGE-L Eval D0743-A.M.100.J-J.53 R:0.16615 P:0.10778 F:0.13075
53 ROUGE-L Eval D0743-B.M.100.J-B.53 R:0.22436 P:0.14862 F:0.17880
53 ROUGE-L Eval D0743-B.M.100.J-H.53 R:0.20505 P:0.13800 F:0.16497
53 ROUGE-L Eval D0743-B.M.100.J-I.53 R:0.24684 P:0.16561 F:0.19823
53 ROUGE-L Eval D0743-B.M.100.J-J.53 R:0.22430 P:0.15287 F:0.18182
53 ROUGE-L Eval D0743-C.M.100.J-B.53 R:0.24444 P:0.14419 F:0.18138
53 ROUGE-L Eval D0743-C.M.100.J-H.53 R:0.26433 P:0.15543 F:0.19575
53 ROUGE-L Eval D0743-C.M.100.J-I.53 R:0.26198 P:0.15356 F:0.19363
53 ROUGE-L Eval D0743-C.M.100.J-J.53 R:0.23899 P:0.14232 F:0.17840
---------------------------------------------
53 ROUGE-W-1.2 Average_R: 0.10286 (95%-conf.int. 0.09942 - 0.10627)
53 ROUGE-W-1.2 Average_P: 0.12043 (95%-conf.int. 0.11571 - 0.12568)
53 ROUGE-W-1.2 Average_F: 0.11060 (95%-conf.int. 0.10677 - 0.11473)
.............................................
53 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.53 R:0.13112 P:0.16066 F:0.14439
53 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.53 R:0.12487 P:0.15548 F:0.13850
53 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.53 R:0.12964 P:0.15989 F:0.14318
53 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.53 R:0.13239 P:0.15306 F:0.14198
53 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.53 R:0.11838 P:0.15127 F:0.13282
53 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.53 R:0.10608 P:0.13473 F:0.11870
53 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.53 R:0.10448 P:0.13153 F:0.11645
53 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.53 R:0.11271 P:0.14172 F:0.12556
53 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.53 R:0.08731 P:0.10822 F:0.09665
53 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.53 R:0.08493 P:0.10975 F:0.09576
53 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.53 R:0.08558 P:0.10901 F:0.09588
53 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.53 R:0.08846 P:0.10692 F:0.09682
53 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.53 R:0.12741 P:0.15048 F:0.13799
53 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.53 R:0.11607 P:0.13925 F:0.12661
53 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.53 R:0.09843 P:0.11747 F:0.10711
53 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.53 R:0.12082 P:0.14735 F:0.13277
53 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.53 R:0.08825 P:0.09804 F:0.09289
53 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.53 R:0.09764 P:0.11082 F:0.10381
53 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.53 R:0.09611 P:0.10954 F:0.10239
53 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.53 R:0.08776 P:0.10280 F:0.09469
53 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.53 R:0.09176 P:0.10179 F:0.09652
53 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.53 R:0.09507 P:0.10636 F:0.10040
53 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.53 R:0.09242 P:0.10240 F:0.09715
53 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.53 R:0.09337 P:0.10640 F:0.09946
53 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.53 R:0.10082 P:0.11095 F:0.10564
53 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.53 R:0.10987 P:0.11989 F:0.11466
53 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.53 R:0.09529 P:0.10309 F:0.09904
53 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.53 R:0.10632 P:0.11696 F:0.11139
53 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.53 R:0.10293 P:0.13331 F:0.11617
53 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.53 R:0.10193 P:0.13773 F:0.11716
53 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.53 R:0.09797 P:0.13541 F:0.11369
53 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.53 R:0.09875 P:0.13359 F:0.11356
53 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.53 R:0.11283 P:0.14693 F:0.12764
53 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.53 R:0.12041 P:0.15167 F:0.13424
53 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.53 R:0.10813 P:0.13971 F:0.12191
53 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.53 R:0.09686 P:0.12703 F:0.10991
53 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.53 R:0.15535 P:0.19236 F:0.17189
53 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.53 R:0.15879 P:0.20169 F:0.17769
53 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.53 R:0.16286 P:0.20344 F:0.18090
53 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.53 R:0.14468 P:0.18526 F:0.16247
53 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.53 R:0.12751 P:0.15333 F:0.13923
53 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.53 R:0.12902 P:0.15602 F:0.14124
53 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.53 R:0.11696 P:0.14211 F:0.12831
53 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.53 R:0.11431 P:0.13764 F:0.12489
53 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.53 R:0.10391 P:0.13126 F:0.11599
53 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.53 R:0.10052 P:0.12866 F:0.11286
53 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.53 R:0.10379 P:0.13454 F:0.11718
53 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.53 R:0.10084 P:0.12991 F:0.11354
53 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.53 R:0.09266 P:0.10440 F:0.09818
53 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.53 R:0.08402 P:0.09811 F:0.09052
53 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.53 R:0.08263 P:0.09769 F:0.08953
53 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.53 R:0.08392 P:0.09867 F:0.09070
53 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.53 R:0.09587 P:0.11928 F:0.10630
53 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.53 R:0.09400 P:0.11630 F:0.10397
53 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.53 R:0.08826 P:0.11077 F:0.09824
53 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.53 R:0.08959 P:0.11620 F:0.10117
53 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.53 R:0.11957 P:0.13984 F:0.12891
53 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.53 R:0.11576 P:0.13749 F:0.12569
53 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.53 R:0.10338 P:0.12059 F:0.11132
53 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.53 R:0.11233 P:0.13436 F:0.12236
53 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.53 R:0.11706 P:0.12928 F:0.12287
53 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.53 R:0.13250 P:0.14418 F:0.13809
53 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.53 R:0.12536 P:0.13914 F:0.13189
53 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.53 R:0.12580 P:0.14191 F:0.13337
53 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.53 R:0.08335 P:0.10173 F:0.09163
53 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.53 R:0.08690 P:0.10707 F:0.09594
53 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.53 R:0.09010 P:0.11173 F:0.09976
53 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.53 R:0.09229 P:0.11487 F:0.10235
53 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.53 R:0.10967 P:0.13101 F:0.11939
53 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.53 R:0.10853 P:0.12900 F:0.11788
53 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.53 R:0.12510 P:0.14986 F:0.13637
53 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.53 R:0.12067 P:0.14943 F:0.13352
53 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.53 R:0.11221 P:0.12621 F:0.11880
53 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.53 R:0.10886 P:0.12825 F:0.11776
53 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.53 R:0.11448 P:0.13172 F:0.12250
53 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.53 R:0.11748 P:0.13591 F:0.12602
53 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.53 R:0.10522 P:0.11553 F:0.11013
53 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.53 R:0.10216 P:0.12156 F:0.11102
53 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.53 R:0.09011 P:0.10030 F:0.09493
53 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.53 R:0.09602 P:0.10637 F:0.10093
53 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.53 R:0.10163 P:0.11690 F:0.10873
53 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.53 R:0.10248 P:0.11719 F:0.10934
53 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.53 R:0.10324 P:0.11996 F:0.11097
53 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.53 R:0.11548 P:0.12817 F:0.12149
53 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.53 R:0.09976 P:0.09442 F:0.09702
53 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.53 R:0.10122 P:0.09343 F:0.09717
53 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.53 R:0.10274 P:0.09882 F:0.10074
53 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.53 R:0.09914 P:0.10361 F:0.10133
53 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.53 R:0.06243 P:0.06819 F:0.06518
53 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.53 R:0.06206 P:0.06258 F:0.06232
53 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.53 R:0.06258 P:0.06222 F:0.06240
53 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.53 R:0.06387 P:0.07606 F:0.06943
53 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.53 R:0.10002 P:0.07717 F:0.08712
53 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.53 R:0.10881 P:0.06816 F:0.08382
53 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.53 R:0.10656 P:0.06515 F:0.08086
53 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.53 R:0.09876 P:0.08368 F:0.09060
53 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.53 R:0.09020 P:0.10606 F:0.09749
53 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.53 R:0.09631 P:0.11217 F:0.10364
53 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.53 R:0.09027 P:0.10850 F:0.09855
53 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.53 R:0.08991 P:0.10802 F:0.09814
53 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.53 R:0.08823 P:0.10467 F:0.09575
53 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.53 R:0.08295 P:0.09346 F:0.08789
53 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.53 R:0.09364 P:0.11250 F:0.10221
53 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.53 R:0.09577 P:0.11092 F:0.10279
53 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.53 R:0.14307 P:0.19334 F:0.16445
53 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.53 R:0.11805 P:0.15328 F:0.13338
53 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.53 R:0.12482 P:0.17093 F:0.14428
53 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.53 R:0.14069 P:0.18937 F:0.16144
53 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.53 R:0.07172 P:0.07861 F:0.07501
53 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.53 R:0.05902 P:0.06593 F:0.06228
53 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.53 R:0.07432 P:0.08424 F:0.07897
53 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.53 R:0.06261 P:0.07050 F:0.06632
53 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.53 R:0.08408 P:0.09327 F:0.08844
53 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.53 R:0.07863 P:0.08776 F:0.08294
53 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.53 R:0.09018 P:0.10196 F:0.09571
53 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.53 R:0.08584 P:0.09619 F:0.09072
53 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.53 R:0.09171 P:0.09470 F:0.09318
53 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.53 R:0.10321 P:0.10135 F:0.10227
53 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.53 R:0.09705 P:0.10137 F:0.09916
53 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.53 R:0.09093 P:0.09115 F:0.09104
---------------------------------------------
53 ROUGE-SU4 Average_R: 0.11407 (95%-conf.int. 0.10702 - 0.12128)
53 ROUGE-SU4 Average_P: 0.07326 (95%-conf.int. 0.06840 - 0.07850)
53 ROUGE-SU4 Average_F: 0.08903 (95%-conf.int. 0.08344 - 0.09504)
.............................................
53 ROUGE-SU4 Eval D0703-A.M.100.A-A.53 R:0.17303 P:0.11671 F:0.13940
53 ROUGE-SU4 Eval D0703-A.M.100.A-C.53 R:0.17299 P:0.11749 F:0.13994
53 ROUGE-SU4 Eval D0703-A.M.100.A-D.53 R:0.17020 P:0.11280 F:0.13568
53 ROUGE-SU4 Eval D0703-A.M.100.A-J.53 R:0.15851 P:0.10617 F:0.12716
53 ROUGE-SU4 Eval D0703-B.M.100.A-A.53 R:0.15380 P:0.10512 F:0.12488
53 ROUGE-SU4 Eval D0703-B.M.100.A-C.53 R:0.12816 P:0.08524 F:0.10238
53 ROUGE-SU4 Eval D0703-B.M.100.A-D.53 R:0.13448 P:0.08945 F:0.10744
53 ROUGE-SU4 Eval D0703-B.M.100.A-J.53 R:0.14334 P:0.09633 F:0.11522
53 ROUGE-SU4 Eval D0703-C.M.100.A-A.53 R:0.10502 P:0.06938 F:0.08356
53 ROUGE-SU4 Eval D0703-C.M.100.A-C.53 R:0.10278 P:0.06976 F:0.08311
53 ROUGE-SU4 Eval D0703-C.M.100.A-D.53 R:0.10091 P:0.06712 F:0.08062
53 ROUGE-SU4 Eval D0703-C.M.100.A-J.53 R:0.09467 P:0.06297 F:0.07563
53 ROUGE-SU4 Eval D0706-A.M.100.B-B.53 R:0.14222 P:0.09275 F:0.11228
53 ROUGE-SU4 Eval D0706-A.M.100.B-D.53 R:0.13311 P:0.08623 F:0.10466
53 ROUGE-SU4 Eval D0706-A.M.100.B-E.53 R:0.09444 P:0.06159 F:0.07456
53 ROUGE-SU4 Eval D0706-A.M.100.B-I.53 R:0.13278 P:0.08659 F:0.10482
53 ROUGE-SU4 Eval D0706-B.M.100.B-B.53 R:0.07438 P:0.04726 F:0.05780
53 ROUGE-SU4 Eval D0706-B.M.100.B-D.53 R:0.08473 P:0.05402 F:0.06598
53 ROUGE-SU4 Eval D0706-B.M.100.B-E.53 R:0.08444 P:0.05402 F:0.06589
53 ROUGE-SU4 Eval D0706-B.M.100.B-I.53 R:0.07863 P:0.05046 F:0.06147
53 ROUGE-SU4 Eval D0706-C.M.100.B-B.53 R:0.07781 P:0.05011 F:0.06096
53 ROUGE-SU4 Eval D0706-C.M.100.B-D.53 R:0.07781 P:0.05011 F:0.06096
53 ROUGE-SU4 Eval D0706-C.M.100.B-E.53 R:0.07566 P:0.04904 F:0.05951
53 ROUGE-SU4 Eval D0706-C.M.100.B-I.53 R:0.07869 P:0.05117 F:0.06201
53 ROUGE-SU4 Eval D0711-A.M.100.C-A.53 R:0.10811 P:0.06531 F:0.08143
53 ROUGE-SU4 Eval D0711-A.M.100.C-B.53 R:0.12043 P:0.07177 F:0.08994
53 ROUGE-SU4 Eval D0711-A.M.100.C-C.53 R:0.10160 P:0.06054 F:0.07587
53 ROUGE-SU4 Eval D0711-A.M.100.C-F.53 R:0.12132 P:0.07279 F:0.09099
53 ROUGE-SU4 Eval D0711-B.M.100.C-A.53 R:0.10023 P:0.07221 F:0.08394
53 ROUGE-SU4 Eval D0711-B.M.100.C-B.53 R:0.11854 P:0.08480 F:0.09887
53 ROUGE-SU4 Eval D0711-B.M.100.C-C.53 R:0.11264 P:0.08228 F:0.09510
53 ROUGE-SU4 Eval D0711-B.M.100.C-F.53 R:0.10976 P:0.07935 F:0.09211
53 ROUGE-SU4 Eval D0711-C.M.100.C-A.53 R:0.13898 P:0.09602 F:0.11357
53 ROUGE-SU4 Eval D0711-C.M.100.C-B.53 R:0.14971 P:0.09992 F:0.11985
53 ROUGE-SU4 Eval D0711-C.M.100.C-C.53 R:0.13542 P:0.09133 F:0.10909
53 ROUGE-SU4 Eval D0711-C.M.100.C-F.53 R:0.12963 P:0.08743 F:0.10443
53 ROUGE-SU4 Eval D0716-A.M.100.D-C.53 R:0.23064 P:0.15498 F:0.18539
53 ROUGE-SU4 Eval D0716-A.M.100.D-D.53 R:0.25514 P:0.16855 F:0.20300
53 ROUGE-SU4 Eval D0716-A.M.100.D-E.53 R:0.24460 P:0.16214 F:0.19501
53 ROUGE-SU4 Eval D0716-A.M.100.D-F.53 R:0.22147 P:0.14781 F:0.17729
53 ROUGE-SU4 Eval D0716-B.M.100.D-C.53 R:0.15822 P:0.10816 F:0.12849
53 ROUGE-SU4 Eval D0716-B.M.100.D-D.53 R:0.16839 P:0.11278 F:0.13509
53 ROUGE-SU4 Eval D0716-B.M.100.D-E.53 R:0.13197 P:0.08930 F:0.10652
53 ROUGE-SU4 Eval D0716-B.M.100.D-F.53 R:0.14612 P:0.09854 F:0.11770
53 ROUGE-SU4 Eval D0716-C.M.100.D-C.53 R:0.12207 P:0.08202 F:0.09812
53 ROUGE-SU4 Eval D0716-C.M.100.D-D.53 R:0.13116 P:0.08577 F:0.10372
53 ROUGE-SU4 Eval D0716-C.M.100.D-E.53 R:0.12994 P:0.08614 F:0.10360
53 ROUGE-SU4 Eval D0716-C.M.100.D-F.53 R:0.13185 P:0.08652 F:0.10448
53 ROUGE-SU4 Eval D0721-A.M.100.E-B.53 R:0.08619 P:0.05471 F:0.06693
53 ROUGE-SU4 Eval D0721-A.M.100.E-C.53 R:0.07889 P:0.05145 F:0.06228
53 ROUGE-SU4 Eval D0721-A.M.100.E-E.53 R:0.07556 P:0.04928 F:0.05965
53 ROUGE-SU4 Eval D0721-A.M.100.E-G.53 R:0.07843 P:0.05217 F:0.06266
53 ROUGE-SU4 Eval D0721-B.M.100.E-B.53 R:0.11148 P:0.07107 F:0.08680
53 ROUGE-SU4 Eval D0721-B.M.100.E-C.53 R:0.10512 P:0.06859 F:0.08301
53 ROUGE-SU4 Eval D0721-B.M.100.E-E.53 R:0.10494 P:0.06645 F:0.08137
53 ROUGE-SU4 Eval D0721-B.M.100.E-G.53 R:0.09713 P:0.06254 F:0.07609
53 ROUGE-SU4 Eval D0721-C.M.100.E-B.53 R:0.15600 P:0.09816 F:0.12050
53 ROUGE-SU4 Eval D0721-C.M.100.E-C.53 R:0.14802 P:0.09251 F:0.11386
53 ROUGE-SU4 Eval D0721-C.M.100.E-E.53 R:0.12329 P:0.07627 F:0.09424
53 ROUGE-SU4 Eval D0721-C.M.100.E-G.53 R:0.14548 P:0.09216 F:0.11284
53 ROUGE-SU4 Eval D0726-A.M.100.F-A.53 R:0.11661 P:0.07193 F:0.08898
53 ROUGE-SU4 Eval D0726-A.M.100.F-E.53 R:0.13299 P:0.08175 F:0.10126
53 ROUGE-SU4 Eval D0726-A.M.100.F-F.53 R:0.13823 P:0.08526 F:0.10547
53 ROUGE-SU4 Eval D0726-A.M.100.F-G.53 R:0.14164 P:0.08737 F:0.10807
53 ROUGE-SU4 Eval D0726-B.M.100.F-A.53 R:0.07327 P:0.05042 F:0.05973
53 ROUGE-SU4 Eval D0726-B.M.100.F-E.53 R:0.08248 P:0.05581 F:0.06657
53 ROUGE-SU4 Eval D0726-B.M.100.F-F.53 R:0.08305 P:0.05620 F:0.06704
53 ROUGE-SU4 Eval D0726-B.M.100.F-G.53 R:0.08671 P:0.05928 F:0.07042
53 ROUGE-SU4 Eval D0726-C.M.100.F-A.53 R:0.12443 P:0.08391 F:0.10023
53 ROUGE-SU4 Eval D0726-C.M.100.F-E.53 R:0.11476 P:0.07660 F:0.09188
53 ROUGE-SU4 Eval D0726-C.M.100.F-F.53 R:0.14925 P:0.09892 F:0.11898
53 ROUGE-SU4 Eval D0726-C.M.100.F-G.53 R:0.14198 P:0.09738 F:0.11552
53 ROUGE-SU4 Eval D0727-A.M.100.G-A.53 R:0.11377 P:0.07199 F:0.08818
53 ROUGE-SU4 Eval D0727-A.M.100.G-F.53 R:0.11824 P:0.07559 F:0.09222
53 ROUGE-SU4 Eval D0727-A.M.100.G-G.53 R:0.11913 P:0.07667 F:0.09330
53 ROUGE-SU4 Eval D0727-A.M.100.G-H.53 R:0.12725 P:0.08135 F:0.09925
53 ROUGE-SU4 Eval D0727-B.M.100.G-A.53 R:0.10188 P:0.06309 F:0.07792
53 ROUGE-SU4 Eval D0727-B.M.100.G-F.53 R:0.10667 P:0.07002 F:0.08454
53 ROUGE-SU4 Eval D0727-B.M.100.G-G.53 R:0.09193 P:0.05653 F:0.07001
53 ROUGE-SU4 Eval D0727-B.M.100.G-H.53 R:0.09482 P:0.05872 F:0.07253
53 ROUGE-SU4 Eval D0727-C.M.100.G-A.53 R:0.12430 P:0.07874 F:0.09641
53 ROUGE-SU4 Eval D0727-C.M.100.G-F.53 R:0.12226 P:0.07486 F:0.09286
53 ROUGE-SU4 Eval D0727-C.M.100.G-G.53 R:0.11921 P:0.07451 F:0.09170
53 ROUGE-SU4 Eval D0727-C.M.100.G-H.53 R:0.11748 P:0.07168 F:0.08904
53 ROUGE-SU4 Eval D0736-A.M.100.H-G.53 R:0.09102 P:0.04799 F:0.06285
53 ROUGE-SU4 Eval D0736-A.M.100.H-H.53 R:0.09649 P:0.04994 F:0.06582
53 ROUGE-SU4 Eval D0736-A.M.100.H-I.53 R:0.09463 P:0.05026 F:0.06565
53 ROUGE-SU4 Eval D0736-A.M.100.H-J.53 R:0.09340 P:0.05415 F:0.06855
53 ROUGE-SU4 Eval D0736-B.M.100.H-G.53 R:0.05052 P:0.02943 F:0.03719
53 ROUGE-SU4 Eval D0736-B.M.100.H-H.53 R:0.04915 P:0.02638 F:0.03433
53 ROUGE-SU4 Eval D0736-B.M.100.H-I.53 R:0.05411 P:0.02867 F:0.03748
53 ROUGE-SU4 Eval D0736-B.M.100.H-J.53 R:0.05456 P:0.03479 F:0.04249
53 ROUGE-SU4 Eval D0736-C.M.100.H-G.53 R:0.09389 P:0.03909 F:0.05520
53 ROUGE-SU4 Eval D0736-C.M.100.H-H.53 R:0.10615 P:0.03455 F:0.05213
53 ROUGE-SU4 Eval D0736-C.M.100.H-I.53 R:0.09870 P:0.03212 F:0.04847
53 ROUGE-SU4 Eval D0736-C.M.100.H-J.53 R:0.08301 P:0.03879 F:0.05287
53 ROUGE-SU4 Eval D0740-A.M.100.I-D.53 R:0.09887 P:0.06259 F:0.07665
53 ROUGE-SU4 Eval D0740-A.M.100.I-H.53 R:0.09620 P:0.06152 F:0.07505
53 ROUGE-SU4 Eval D0740-A.M.100.I-I.53 R:0.10444 P:0.06724 F:0.08181
53 ROUGE-SU4 Eval D0740-A.M.100.I-J.53 R:0.09382 P:0.06080 F:0.07378
53 ROUGE-SU4 Eval D0740-B.M.100.I-D.53 R:0.09333 P:0.05970 F:0.07282
53 ROUGE-SU4 Eval D0740-B.M.100.I-H.53 R:0.07993 P:0.05011 F:0.06160
53 ROUGE-SU4 Eval D0740-B.M.100.I-I.53 R:0.11055 P:0.07001 F:0.08573
53 ROUGE-SU4 Eval D0740-B.M.100.I-J.53 R:0.10188 P:0.06539 F:0.07965
53 ROUGE-SU4 Eval D0740-C.M.100.I-D.53 R:0.20492 P:0.14237 F:0.16801
53 ROUGE-SU4 Eval D0740-C.M.100.I-H.53 R:0.14631 P:0.10099 F:0.11950
53 ROUGE-SU4 Eval D0740-C.M.100.I-I.53 R:0.17486 P:0.12149 F:0.14337
53 ROUGE-SU4 Eval D0740-C.M.100.I-J.53 R:0.20044 P:0.13971 F:0.16465
53 ROUGE-SU4 Eval D0743-A.M.100.J-B.53 R:0.05483 P:0.03414 F:0.04208
53 ROUGE-SU4 Eval D0743-A.M.100.J-H.53 R:0.04219 P:0.02705 F:0.03296
53 ROUGE-SU4 Eval D0743-A.M.100.J-I.53 R:0.05983 P:0.03786 F:0.04637
53 ROUGE-SU4 Eval D0743-A.M.100.J-J.53 R:0.04784 P:0.03076 F:0.03744
53 ROUGE-SU4 Eval D0743-B.M.100.J-B.53 R:0.07456 P:0.04896 F:0.05911
53 ROUGE-SU4 Eval D0743-B.M.100.J-H.53 R:0.06958 P:0.04644 F:0.05570
53 ROUGE-SU4 Eval D0743-B.M.100.J-I.53 R:0.08929 P:0.05940 F:0.07134
53 ROUGE-SU4 Eval D0743-B.M.100.J-J.53 R:0.07934 P:0.05364 F:0.06401
53 ROUGE-SU4 Eval D0743-C.M.100.J-B.53 R:0.08686 P:0.05070 F:0.06403
53 ROUGE-SU4 Eval D0743-C.M.100.J-H.53 R:0.08497 P:0.04943 F:0.06250
53 ROUGE-SU4 Eval D0743-C.M.100.J-I.53 R:0.09290 P:0.05387 F:0.06820
53 ROUGE-SU4 Eval D0743-C.M.100.J-J.53 R:0.07581 P:0.04468 F:0.05622
---------------------------------------------
54 ROUGE-1 Average_R: 0.32247 (95%-conf.int. 0.31125 - 0.33447)
54 ROUGE-1 Average_P: 0.19701 (95%-conf.int. 0.19019 - 0.20364)
54 ROUGE-1 Average_F: 0.24406 (95%-conf.int. 0.23599 - 0.25237)
.............................................
54 ROUGE-1 Eval D0703-A.M.100.A-A.54 R:0.32770 P:0.21700 F:0.26110
54 ROUGE-1 Eval D0703-A.M.100.A-C.54 R:0.28523 P:0.19016 F:0.22819
54 ROUGE-1 Eval D0703-A.M.100.A-D.54 R:0.29897 P:0.19463 F:0.23577
54 ROUGE-1 Eval D0703-A.M.100.A-J.54 R:0.29932 P:0.19687 F:0.23752
54 ROUGE-1 Eval D0703-B.M.100.A-A.54 R:0.37255 P:0.23030 F:0.28464
54 ROUGE-1 Eval D0703-B.M.100.A-C.54 R:0.40940 P:0.24646 F:0.30769
54 ROUGE-1 Eval D0703-B.M.100.A-D.54 R:0.37919 P:0.22828 F:0.28499
54 ROUGE-1 Eval D0703-B.M.100.A-J.54 R:0.39535 P:0.24040 F:0.29899
54 ROUGE-1 Eval D0703-C.M.100.A-A.54 R:0.41667 P:0.23946 F:0.30413
54 ROUGE-1 Eval D0703-C.M.100.A-C.54 R:0.42857 P:0.25287 F:0.31807
54 ROUGE-1 Eval D0703-C.M.100.A-D.54 R:0.42053 P:0.24330 F:0.30826
54 ROUGE-1 Eval D0703-C.M.100.A-J.54 R:0.41722 P:0.24138 F:0.30583
54 ROUGE-1 Eval D0706-A.M.100.B-B.54 R:0.32143 P:0.20755 F:0.25223
54 ROUGE-1 Eval D0706-A.M.100.B-D.54 R:0.29085 P:0.18658 F:0.22733
54 ROUGE-1 Eval D0706-A.M.100.B-E.54 R:0.30195 P:0.19497 F:0.23694
54 ROUGE-1 Eval D0706-A.M.100.B-I.54 R:0.27597 P:0.17820 F:0.21656
54 ROUGE-1 Eval D0706-B.M.100.B-B.54 R:0.34967 P:0.22153 F:0.27123
54 ROUGE-1 Eval D0706-B.M.100.B-D.54 R:0.33550 P:0.21325 F:0.26076
54 ROUGE-1 Eval D0706-B.M.100.B-E.54 R:0.32792 P:0.20911 F:0.25537
54 ROUGE-1 Eval D0706-B.M.100.B-I.54 R:0.37217 P:0.23810 F:0.29041
54 ROUGE-1 Eval D0706-C.M.100.B-B.54 R:0.31290 P:0.18690 F:0.23402
54 ROUGE-1 Eval D0706-C.M.100.B-D.54 R:0.30968 P:0.18497 F:0.23160
54 ROUGE-1 Eval D0706-C.M.100.B-E.54 R:0.30769 P:0.18497 F:0.23105
54 ROUGE-1 Eval D0706-C.M.100.B-I.54 R:0.34185 P:0.20617 F:0.25721
54 ROUGE-1 Eval D0711-A.M.100.C-A.54 R:0.30921 P:0.22542 F:0.26075
54 ROUGE-1 Eval D0711-A.M.100.C-B.54 R:0.29000 P:0.20863 F:0.24268
54 ROUGE-1 Eval D0711-A.M.100.C-C.54 R:0.29000 P:0.20863 F:0.24268
54 ROUGE-1 Eval D0711-A.M.100.C-F.54 R:0.31457 P:0.22782 F:0.26426
54 ROUGE-1 Eval D0711-B.M.100.C-A.54 R:0.38435 P:0.23251 F:0.28974
54 ROUGE-1 Eval D0711-B.M.100.C-B.54 R:0.40068 P:0.24074 F:0.30077
54 ROUGE-1 Eval D0711-B.M.100.C-C.54 R:0.39597 P:0.24280 F:0.30102
54 ROUGE-1 Eval D0711-B.M.100.C-F.54 R:0.40678 P:0.24691 F:0.30730
54 ROUGE-1 Eval D0711-C.M.100.C-A.54 R:0.45545 P:0.24865 F:0.32168
54 ROUGE-1 Eval D0711-C.M.100.C-B.54 R:0.45392 P:0.23964 F:0.31368
54 ROUGE-1 Eval D0711-C.M.100.C-C.54 R:0.41892 P:0.22342 F:0.29142
54 ROUGE-1 Eval D0711-C.M.100.C-F.54 R:0.40878 P:0.21802 F:0.28437
54 ROUGE-1 Eval D0716-A.M.100.D-C.54 R:0.38361 P:0.25658 F:0.30749
54 ROUGE-1 Eval D0716-A.M.100.D-D.54 R:0.38000 P:0.25000 F:0.30159
54 ROUGE-1 Eval D0716-A.M.100.D-E.54 R:0.39203 P:0.25877 F:0.31176
54 ROUGE-1 Eval D0716-A.M.100.D-F.54 R:0.35314 P:0.23465 F:0.28195
54 ROUGE-1 Eval D0716-B.M.100.D-C.54 R:0.25658 P:0.15758 F:0.19525
54 ROUGE-1 Eval D0716-B.M.100.D-D.54 R:0.27181 P:0.16364 F:0.20429
54 ROUGE-1 Eval D0716-B.M.100.D-E.54 R:0.26578 P:0.16162 F:0.20101
54 ROUGE-1 Eval D0716-B.M.100.D-F.54 R:0.26333 P:0.15960 F:0.19874
54 ROUGE-1 Eval D0716-C.M.100.D-C.54 R:0.41042 P:0.24277 F:0.30508
54 ROUGE-1 Eval D0716-C.M.100.D-D.54 R:0.42475 P:0.24470 F:0.31051
54 ROUGE-1 Eval D0716-C.M.100.D-E.54 R:0.43894 P:0.25626 F:0.32360
54 ROUGE-1 Eval D0716-C.M.100.D-F.54 R:0.45333 P:0.26204 F:0.33211
54 ROUGE-1 Eval D0721-A.M.100.E-B.54 R:0.30667 P:0.20862 F:0.24832
54 ROUGE-1 Eval D0721-A.M.100.E-C.54 R:0.30195 P:0.21088 F:0.24833
54 ROUGE-1 Eval D0721-A.M.100.E-E.54 R:0.30844 P:0.21542 F:0.25367
54 ROUGE-1 Eval D0721-A.M.100.E-G.54 R:0.30255 P:0.21542 F:0.25166
54 ROUGE-1 Eval D0721-B.M.100.E-B.54 R:0.34853 P:0.17314 F:0.23135
54 ROUGE-1 Eval D0721-B.M.100.E-C.54 R:0.36306 P:0.18447 F:0.24464
54 ROUGE-1 Eval D0721-B.M.100.E-E.54 R:0.34426 P:0.16990 F:0.22752
54 ROUGE-1 Eval D0721-B.M.100.E-G.54 R:0.34194 P:0.17152 F:0.22845
54 ROUGE-1 Eval D0721-C.M.100.E-B.54 R:0.38033 P:0.24319 F:0.29668
54 ROUGE-1 Eval D0721-C.M.100.E-C.54 R:0.34653 P:0.22013 F:0.26923
54 ROUGE-1 Eval D0721-C.M.100.E-E.54 R:0.36333 P:0.22851 F:0.28056
54 ROUGE-1 Eval D0721-C.M.100.E-G.54 R:0.33225 P:0.21384 F:0.26021
54 ROUGE-1 Eval D0726-A.M.100.F-A.54 R:0.37542 P:0.25111 F:0.30093
54 ROUGE-1 Eval D0726-A.M.100.F-E.54 R:0.38667 P:0.25778 F:0.30934
54 ROUGE-1 Eval D0726-A.M.100.F-F.54 R:0.36213 P:0.24222 F:0.29028
54 ROUGE-1 Eval D0726-A.M.100.F-G.54 R:0.35216 P:0.23556 F:0.28229
54 ROUGE-1 Eval D0726-B.M.100.F-A.54 R:0.37255 P:0.22353 F:0.27941
54 ROUGE-1 Eval D0726-B.M.100.F-E.54 R:0.36213 P:0.21373 F:0.26881
54 ROUGE-1 Eval D0726-B.M.100.F-F.54 R:0.35880 P:0.21176 F:0.26633
54 ROUGE-1 Eval D0726-B.M.100.F-G.54 R:0.36184 P:0.21569 F:0.27027
54 ROUGE-1 Eval D0726-C.M.100.F-A.54 R:0.35000 P:0.20468 F:0.25830
54 ROUGE-1 Eval D0726-C.M.100.F-E.54 R:0.35017 P:0.20273 F:0.25679
54 ROUGE-1 Eval D0726-C.M.100.F-F.54 R:0.32881 P:0.18908 F:0.24009
54 ROUGE-1 Eval D0726-C.M.100.F-G.54 R:0.36393 P:0.21637 F:0.27139
54 ROUGE-1 Eval D0727-A.M.100.G-A.54 R:0.25249 P:0.16667 F:0.20079
54 ROUGE-1 Eval D0727-A.M.100.G-F.54 R:0.25000 P:0.16667 F:0.20000
54 ROUGE-1 Eval D0727-A.M.100.G-G.54 R:0.23203 P:0.15570 F:0.18635
54 ROUGE-1 Eval D0727-A.M.100.G-H.54 R:0.22368 P:0.14912 F:0.17894
54 ROUGE-1 Eval D0727-B.M.100.G-A.54 R:0.39175 P:0.20765 F:0.27143
54 ROUGE-1 Eval D0727-B.M.100.G-F.54 R:0.41558 P:0.23315 F:0.29871
54 ROUGE-1 Eval D0727-B.M.100.G-G.54 R:0.37370 P:0.19672 F:0.25775
54 ROUGE-1 Eval D0727-B.M.100.G-H.54 R:0.38488 P:0.20401 F:0.26667
54 ROUGE-1 Eval D0727-C.M.100.G-A.54 R:0.26384 P:0.15882 F:0.19828
54 ROUGE-1 Eval D0727-C.M.100.G-F.54 R:0.30640 P:0.17843 F:0.22553
54 ROUGE-1 Eval D0727-C.M.100.G-G.54 R:0.27723 P:0.16471 F:0.20665
54 ROUGE-1 Eval D0727-C.M.100.G-H.54 R:0.28041 P:0.16275 F:0.20596
54 ROUGE-1 Eval D0736-A.M.100.H-G.54 R:0.28315 P:0.17211 F:0.21409
54 ROUGE-1 Eval D0736-A.M.100.H-H.54 R:0.29927 P:0.17865 F:0.22374
54 ROUGE-1 Eval D0736-A.M.100.H-I.54 R:0.28470 P:0.17429 F:0.21622
54 ROUGE-1 Eval D0736-A.M.100.H-J.54 R:0.28105 P:0.18736 F:0.22484
54 ROUGE-1 Eval D0736-B.M.100.H-G.54 R:0.25191 P:0.12717 F:0.16902
54 ROUGE-1 Eval D0736-B.M.100.H-H.54 R:0.26033 P:0.12139 F:0.16557
54 ROUGE-1 Eval D0736-B.M.100.H-I.54 R:0.28452 P:0.13102 F:0.17942
54 ROUGE-1 Eval D0736-B.M.100.H-J.54 R:0.26573 P:0.14644 F:0.18882
54 ROUGE-1 Eval D0736-C.M.100.H-G.54 R:0.15612 P:0.08114 F:0.10678
54 ROUGE-1 Eval D0736-C.M.100.H-H.54 R:0.13369 P:0.05482 F:0.07776
54 ROUGE-1 Eval D0736-C.M.100.H-I.54 R:0.17647 P:0.07237 F:0.10265
54 ROUGE-1 Eval D0736-C.M.100.H-J.54 R:0.15094 P:0.08772 F:0.11096
54 ROUGE-1 Eval D0740-A.M.100.I-D.54 R:0.30033 P:0.19956 F:0.23979
54 ROUGE-1 Eval D0740-A.M.100.I-H.54 R:0.25817 P:0.17325 F:0.20735
54 ROUGE-1 Eval D0740-A.M.100.I-I.54 R:0.26299 P:0.17763 F:0.21204
54 ROUGE-1 Eval D0740-A.M.100.I-J.54 R:0.26452 P:0.17982 F:0.21410
54 ROUGE-1 Eval D0740-B.M.100.I-D.54 R:0.32143 P:0.19186 F:0.24029
54 ROUGE-1 Eval D0740-B.M.100.I-H.54 R:0.32781 P:0.19186 F:0.24205
54 ROUGE-1 Eval D0740-B.M.100.I-I.54 R:0.34098 P:0.20155 F:0.25335
54 ROUGE-1 Eval D0740-B.M.100.I-J.54 R:0.33333 P:0.19961 F:0.24969
54 ROUGE-1 Eval D0740-C.M.100.I-D.54 R:0.37061 P:0.22745 F:0.28190
54 ROUGE-1 Eval D0740-C.M.100.I-H.54 R:0.35048 P:0.21373 F:0.26553
54 ROUGE-1 Eval D0740-C.M.100.I-I.54 R:0.34505 P:0.21176 F:0.26245
54 ROUGE-1 Eval D0740-C.M.100.I-J.54 R:0.35350 P:0.21765 F:0.26942
54 ROUGE-1 Eval D0743-A.M.100.J-B.54 R:0.23492 P:0.15321 F:0.18546
54 ROUGE-1 Eval D0743-A.M.100.J-H.54 R:0.21914 P:0.14700 F:0.17596
54 ROUGE-1 Eval D0743-A.M.100.J-I.54 R:0.24375 P:0.16149 F:0.19427
54 ROUGE-1 Eval D0743-A.M.100.J-J.54 R:0.20923 P:0.14079 F:0.16832
54 ROUGE-1 Eval D0743-B.M.100.J-B.54 R:0.24679 P:0.17111 F:0.20210
54 ROUGE-1 Eval D0743-B.M.100.J-H.54 R:0.23028 P:0.16222 F:0.19035
54 ROUGE-1 Eval D0743-B.M.100.J-I.54 R:0.25000 P:0.17556 F:0.20627
54 ROUGE-1 Eval D0743-B.M.100.J-J.54 R:0.22118 P:0.15778 F:0.18418
54 ROUGE-1 Eval D0743-C.M.100.J-B.54 R:0.25397 P:0.15595 F:0.19324
54 ROUGE-1 Eval D0743-C.M.100.J-H.54 R:0.23885 P:0.14620 F:0.18138
54 ROUGE-1 Eval D0743-C.M.100.J-I.54 R:0.27157 P:0.16569 F:0.20581
54 ROUGE-1 Eval D0743-C.M.100.J-J.54 R:0.23585 P:0.14620 F:0.18051
---------------------------------------------
54 ROUGE-2 Average_R: 0.05478 (95%-conf.int. 0.04862 - 0.06113)
54 ROUGE-2 Average_P: 0.03300 (95%-conf.int. 0.02946 - 0.03670)
54 ROUGE-2 Average_F: 0.04111 (95%-conf.int. 0.03671 - 0.04577)
.............................................
54 ROUGE-2 Eval D0703-A.M.100.A-A.54 R:0.04096 P:0.02703 F:0.03257
54 ROUGE-2 Eval D0703-A.M.100.A-C.54 R:0.03051 P:0.02027 F:0.02436
54 ROUGE-2 Eval D0703-A.M.100.A-D.54 R:0.04514 P:0.02928 F:0.03552
54 ROUGE-2 Eval D0703-A.M.100.A-J.54 R:0.03780 P:0.02477 F:0.02993
54 ROUGE-2 Eval D0703-B.M.100.A-A.54 R:0.11551 P:0.07114 F:0.08805
54 ROUGE-2 Eval D0703-B.M.100.A-C.54 R:0.12542 P:0.07520 F:0.09402
54 ROUGE-2 Eval D0703-B.M.100.A-D.54 R:0.11864 P:0.07114 F:0.08895
54 ROUGE-2 Eval D0703-B.M.100.A-J.54 R:0.13423 P:0.08130 F:0.10127
54 ROUGE-2 Eval D0703-C.M.100.A-A.54 R:0.10101 P:0.05780 F:0.07353
54 ROUGE-2 Eval D0703-C.M.100.A-C.54 R:0.12459 P:0.07322 F:0.09223
54 ROUGE-2 Eval D0703-C.M.100.A-D.54 R:0.11371 P:0.06551 F:0.08313
54 ROUGE-2 Eval D0703-C.M.100.A-J.54 R:0.13043 P:0.07514 F:0.09535
54 ROUGE-2 Eval D0706-A.M.100.B-B.54 R:0.05574 P:0.03586 F:0.04364
54 ROUGE-2 Eval D0706-A.M.100.B-D.54 R:0.03960 P:0.02532 F:0.03089
54 ROUGE-2 Eval D0706-A.M.100.B-E.54 R:0.04262 P:0.02743 F:0.03338
54 ROUGE-2 Eval D0706-A.M.100.B-I.54 R:0.03934 P:0.02532 F:0.03081
54 ROUGE-2 Eval D0706-B.M.100.B-B.54 R:0.08581 P:0.05417 F:0.06641
54 ROUGE-2 Eval D0706-B.M.100.B-D.54 R:0.09868 P:0.06250 F:0.07653
54 ROUGE-2 Eval D0706-B.M.100.B-E.54 R:0.07213 P:0.04583 F:0.05605
54 ROUGE-2 Eval D0706-B.M.100.B-I.54 R:0.10784 P:0.06875 F:0.08397
54 ROUGE-2 Eval D0706-C.M.100.B-B.54 R:0.02932 P:0.01744 F:0.02187
54 ROUGE-2 Eval D0706-C.M.100.B-D.54 R:0.02932 P:0.01744 F:0.02187
54 ROUGE-2 Eval D0706-C.M.100.B-E.54 R:0.03883 P:0.02326 F:0.02909
54 ROUGE-2 Eval D0706-C.M.100.B-I.54 R:0.03871 P:0.02326 F:0.02906
54 ROUGE-2 Eval D0711-A.M.100.C-A.54 R:0.02990 P:0.02174 F:0.02518
54 ROUGE-2 Eval D0711-A.M.100.C-B.54 R:0.03367 P:0.02415 F:0.02813
54 ROUGE-2 Eval D0711-A.M.100.C-C.54 R:0.03030 P:0.02174 F:0.02532
54 ROUGE-2 Eval D0711-A.M.100.C-F.54 R:0.03679 P:0.02657 F:0.03086
54 ROUGE-2 Eval D0711-B.M.100.C-A.54 R:0.07560 P:0.04555 F:0.05685
54 ROUGE-2 Eval D0711-B.M.100.C-B.54 R:0.08304 P:0.04969 F:0.06218
54 ROUGE-2 Eval D0711-B.M.100.C-C.54 R:0.08475 P:0.05176 F:0.06427
54 ROUGE-2 Eval D0711-B.M.100.C-F.54 R:0.08562 P:0.05176 F:0.06452
54 ROUGE-2 Eval D0711-C.M.100.C-A.54 R:0.12667 P:0.06884 F:0.08920
54 ROUGE-2 Eval D0711-C.M.100.C-B.54 R:0.13793 P:0.07246 F:0.09501
54 ROUGE-2 Eval D0711-C.M.100.C-C.54 R:0.06826 P:0.03623 F:0.04734
54 ROUGE-2 Eval D0711-C.M.100.C-F.54 R:0.09556 P:0.05072 F:0.06627
54 ROUGE-2 Eval D0716-A.M.100.D-C.54 R:0.07285 P:0.04857 F:0.05828
54 ROUGE-2 Eval D0716-A.M.100.D-D.54 R:0.07744 P:0.05077 F:0.06133
54 ROUGE-2 Eval D0716-A.M.100.D-E.54 R:0.07047 P:0.04636 F:0.05593
54 ROUGE-2 Eval D0716-A.M.100.D-F.54 R:0.05000 P:0.03311 F:0.03984
54 ROUGE-2 Eval D0716-B.M.100.D-C.54 R:0.01993 P:0.01220 F:0.01514
54 ROUGE-2 Eval D0716-B.M.100.D-D.54 R:0.01695 P:0.01016 F:0.01270
54 ROUGE-2 Eval D0716-B.M.100.D-E.54 R:0.02013 P:0.01220 F:0.01519
54 ROUGE-2 Eval D0716-B.M.100.D-F.54 R:0.02357 P:0.01423 F:0.01775
54 ROUGE-2 Eval D0716-C.M.100.D-C.54 R:0.13158 P:0.07752 F:0.09756
54 ROUGE-2 Eval D0716-C.M.100.D-D.54 R:0.12838 P:0.07364 F:0.09359
54 ROUGE-2 Eval D0716-C.M.100.D-E.54 R:0.12333 P:0.07171 F:0.09069
54 ROUGE-2 Eval D0716-C.M.100.D-F.54 R:0.14815 P:0.08527 F:0.10824
54 ROUGE-2 Eval D0721-A.M.100.E-B.54 R:0.03704 P:0.02511 F:0.02993
54 ROUGE-2 Eval D0721-A.M.100.E-C.54 R:0.03279 P:0.02283 F:0.02692
54 ROUGE-2 Eval D0721-A.M.100.E-E.54 R:0.04262 P:0.02968 F:0.03499
54 ROUGE-2 Eval D0721-A.M.100.E-G.54 R:0.03537 P:0.02511 F:0.02937
54 ROUGE-2 Eval D0721-B.M.100.E-B.54 R:0.08553 P:0.04228 F:0.05659
54 ROUGE-2 Eval D0721-B.M.100.E-C.54 R:0.09003 P:0.04553 F:0.06048
54 ROUGE-2 Eval D0721-B.M.100.E-E.54 R:0.06954 P:0.03415 F:0.04581
54 ROUGE-2 Eval D0721-B.M.100.E-G.54 R:0.05863 P:0.02927 F:0.03905
54 ROUGE-2 Eval D0721-C.M.100.E-B.54 R:0.07947 P:0.05063 F:0.06185
54 ROUGE-2 Eval D0721-C.M.100.E-C.54 R:0.07333 P:0.04641 F:0.05684
54 ROUGE-2 Eval D0721-C.M.100.E-E.54 R:0.07744 P:0.04852 F:0.05966
54 ROUGE-2 Eval D0721-C.M.100.E-G.54 R:0.07895 P:0.05063 F:0.06170
54 ROUGE-2 Eval D0726-A.M.100.F-A.54 R:0.09732 P:0.06488 F:0.07786
54 ROUGE-2 Eval D0726-A.M.100.F-E.54 R:0.09764 P:0.06488 F:0.07796
54 ROUGE-2 Eval D0726-A.M.100.F-F.54 R:0.06711 P:0.04474 F:0.05369
54 ROUGE-2 Eval D0726-A.M.100.F-G.54 R:0.06040 P:0.04027 F:0.04832
54 ROUGE-2 Eval D0726-B.M.100.F-A.54 R:0.07921 P:0.04734 F:0.05926
54 ROUGE-2 Eval D0726-B.M.100.F-E.54 R:0.05705 P:0.03353 F:0.04224
54 ROUGE-2 Eval D0726-B.M.100.F-F.54 R:0.06711 P:0.03945 F:0.04969
54 ROUGE-2 Eval D0726-B.M.100.F-G.54 R:0.06645 P:0.03945 F:0.04951
54 ROUGE-2 Eval D0726-C.M.100.F-A.54 R:0.06061 P:0.03529 F:0.04461
54 ROUGE-2 Eval D0726-C.M.100.F-E.54 R:0.04762 P:0.02745 F:0.03483
54 ROUGE-2 Eval D0726-C.M.100.F-F.54 R:0.04110 P:0.02353 F:0.02993
54 ROUGE-2 Eval D0726-C.M.100.F-G.54 R:0.05298 P:0.03137 F:0.03941
54 ROUGE-2 Eval D0727-A.M.100.G-A.54 R:0.03020 P:0.01987 F:0.02397
54 ROUGE-2 Eval D0727-A.M.100.G-F.54 R:0.02990 P:0.01987 F:0.02387
54 ROUGE-2 Eval D0727-A.M.100.G-G.54 R:0.02310 P:0.01545 F:0.01852
54 ROUGE-2 Eval D0727-A.M.100.G-H.54 R:0.02658 P:0.01766 F:0.02122
54 ROUGE-2 Eval D0727-B.M.100.G-A.54 R:0.09028 P:0.04762 F:0.06235
54 ROUGE-2 Eval D0727-B.M.100.G-F.54 R:0.09836 P:0.05495 F:0.07051
54 ROUGE-2 Eval D0727-B.M.100.G-G.54 R:0.06643 P:0.03480 F:0.04567
54 ROUGE-2 Eval D0727-B.M.100.G-H.54 R:0.09375 P:0.04945 F:0.06475
54 ROUGE-2 Eval D0727-C.M.100.G-A.54 R:0.01316 P:0.00789 F:0.00987
54 ROUGE-2 Eval D0727-C.M.100.G-F.54 R:0.02381 P:0.01381 F:0.01748
54 ROUGE-2 Eval D0727-C.M.100.G-G.54 R:0.02333 P:0.01381 F:0.01735
54 ROUGE-2 Eval D0727-C.M.100.G-H.54 R:0.01024 P:0.00592 F:0.00750
54 ROUGE-2 Eval D0736-A.M.100.H-G.54 R:0.01449 P:0.00877 F:0.01093
54 ROUGE-2 Eval D0736-A.M.100.H-H.54 R:0.02214 P:0.01316 F:0.01651
54 ROUGE-2 Eval D0736-A.M.100.H-I.54 R:0.02158 P:0.01316 F:0.01635
54 ROUGE-2 Eval D0736-A.M.100.H-J.54 R:0.01650 P:0.01096 F:0.01317
54 ROUGE-2 Eval D0736-B.M.100.H-G.54 R:0.02703 P:0.01357 F:0.01807
54 ROUGE-2 Eval D0736-B.M.100.H-H.54 R:0.03347 P:0.01550 F:0.02119
54 ROUGE-2 Eval D0736-B.M.100.H-I.54 R:0.03390 P:0.01550 F:0.02127
54 ROUGE-2 Eval D0736-B.M.100.H-J.54 R:0.03534 P:0.01938 F:0.02503
54 ROUGE-2 Eval D0736-C.M.100.H-G.54 R:0.00427 P:0.00221 F:0.00291
54 ROUGE-2 Eval D0736-C.M.100.H-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-2 Eval D0736-C.M.100.H-I.54 R:0.00543 P:0.00221 F:0.00314
54 ROUGE-2 Eval D0736-C.M.100.H-J.54 R:0.00382 P:0.00221 F:0.00280
54 ROUGE-2 Eval D0740-A.M.100.I-D.54 R:0.04000 P:0.02649 F:0.03187
54 ROUGE-2 Eval D0740-A.M.100.I-H.54 R:0.03960 P:0.02649 F:0.03174
54 ROUGE-2 Eval D0740-A.M.100.I-I.54 R:0.03279 P:0.02208 F:0.02639
54 ROUGE-2 Eval D0740-A.M.100.I-J.54 R:0.01629 P:0.01104 F:0.01316
54 ROUGE-2 Eval D0740-B.M.100.I-D.54 R:0.04590 P:0.02729 F:0.03423
54 ROUGE-2 Eval D0740-B.M.100.I-H.54 R:0.03344 P:0.01949 F:0.02463
54 ROUGE-2 Eval D0740-B.M.100.I-I.54 R:0.04305 P:0.02534 F:0.03190
54 ROUGE-2 Eval D0740-B.M.100.I-J.54 R:0.04575 P:0.02729 F:0.03419
54 ROUGE-2 Eval D0740-C.M.100.I-D.54 R:0.03226 P:0.01972 F:0.02448
54 ROUGE-2 Eval D0740-C.M.100.I-H.54 R:0.02273 P:0.01381 F:0.01718
54 ROUGE-2 Eval D0740-C.M.100.I-I.54 R:0.02258 P:0.01381 F:0.01714
54 ROUGE-2 Eval D0740-C.M.100.I-J.54 R:0.02894 P:0.01775 F:0.02200
54 ROUGE-2 Eval D0743-A.M.100.J-B.54 R:0.01603 P:0.01042 F:0.01263
54 ROUGE-2 Eval D0743-A.M.100.J-H.54 R:0.00623 P:0.00417 F:0.00500
54 ROUGE-2 Eval D0743-A.M.100.J-I.54 R:0.01577 P:0.01042 F:0.01255
54 ROUGE-2 Eval D0743-A.M.100.J-J.54 R:0.01863 P:0.01250 F:0.01496
54 ROUGE-2 Eval D0743-B.M.100.J-B.54 R:0.01618 P:0.01119 F:0.01323
54 ROUGE-2 Eval D0743-B.M.100.J-H.54 R:0.02548 P:0.01790 F:0.02103
54 ROUGE-2 Eval D0743-B.M.100.J-I.54 R:0.02556 P:0.01790 F:0.02105
54 ROUGE-2 Eval D0743-B.M.100.J-J.54 R:0.01887 P:0.01342 F:0.01569
54 ROUGE-2 Eval D0743-C.M.100.J-B.54 R:0.03205 P:0.01961 F:0.02433
54 ROUGE-2 Eval D0743-C.M.100.J-H.54 R:0.02894 P:0.01765 F:0.02193
54 ROUGE-2 Eval D0743-C.M.100.J-I.54 R:0.03226 P:0.01961 F:0.02439
54 ROUGE-2 Eval D0743-C.M.100.J-J.54 R:0.02222 P:0.01373 F:0.01697
---------------------------------------------
54 ROUGE-3 Average_R: 0.01643 (95%-conf.int. 0.01337 - 0.01973)
54 ROUGE-3 Average_P: 0.00966 (95%-conf.int. 0.00793 - 0.01152)
54 ROUGE-3 Average_F: 0.01215 (95%-conf.int. 0.00994 - 0.01450)
.............................................
54 ROUGE-3 Eval D0703-A.M.100.A-A.54 R:0.01034 P:0.00680 F:0.00820
54 ROUGE-3 Eval D0703-A.M.100.A-C.54 R:0.00342 P:0.00227 F:0.00273
54 ROUGE-3 Eval D0703-A.M.100.A-D.54 R:0.01404 P:0.00907 F:0.01102
54 ROUGE-3 Eval D0703-A.M.100.A-J.54 R:0.01389 P:0.00907 F:0.01097
54 ROUGE-3 Eval D0703-B.M.100.A-A.54 R:0.03333 P:0.02045 F:0.02535
54 ROUGE-3 Eval D0703-B.M.100.A-C.54 R:0.03082 P:0.01840 F:0.02304
54 ROUGE-3 Eval D0703-B.M.100.A-D.54 R:0.03425 P:0.02045 F:0.02561
54 ROUGE-3 Eval D0703-B.M.100.A-J.54 R:0.04407 P:0.02658 F:0.03316
54 ROUGE-3 Eval D0703-C.M.100.A-A.54 R:0.03401 P:0.01938 F:0.02469
54 ROUGE-3 Eval D0703-C.M.100.A-C.54 R:0.04967 P:0.02907 F:0.03668
54 ROUGE-3 Eval D0703-C.M.100.A-D.54 R:0.04054 P:0.02326 F:0.02956
54 ROUGE-3 Eval D0703-C.M.100.A-J.54 R:0.05743 P:0.03295 F:0.04187
54 ROUGE-3 Eval D0706-A.M.100.B-B.54 R:0.01325 P:0.00849 F:0.01035
54 ROUGE-3 Eval D0706-A.M.100.B-D.54 R:0.01333 P:0.00849 F:0.01037
54 ROUGE-3 Eval D0706-A.M.100.B-E.54 R:0.00993 P:0.00637 F:0.00776
54 ROUGE-3 Eval D0706-A.M.100.B-I.54 R:0.00331 P:0.00212 F:0.00258
54 ROUGE-3 Eval D0706-B.M.100.B-B.54 R:0.02667 P:0.01677 F:0.02059
54 ROUGE-3 Eval D0706-B.M.100.B-D.54 R:0.03654 P:0.02306 F:0.02828
54 ROUGE-3 Eval D0706-B.M.100.B-E.54 R:0.02318 P:0.01468 F:0.01798
54 ROUGE-3 Eval D0706-B.M.100.B-I.54 R:0.04290 P:0.02725 F:0.03333
54 ROUGE-3 Eval D0706-C.M.100.B-B.54 R:0.00329 P:0.00195 F:0.00245
54 ROUGE-3 Eval D0706-C.M.100.B-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0706-C.M.100.B-E.54 R:0.00327 P:0.00195 F:0.00244
54 ROUGE-3 Eval D0706-C.M.100.B-I.54 R:0.00326 P:0.00195 F:0.00244
54 ROUGE-3 Eval D0711-A.M.100.C-A.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0711-A.M.100.C-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0711-A.M.100.C-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0711-A.M.100.C-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0711-B.M.100.C-A.54 R:0.01736 P:0.01042 F:0.01302
54 ROUGE-3 Eval D0711-B.M.100.C-B.54 R:0.01748 P:0.01042 F:0.01306
54 ROUGE-3 Eval D0711-B.M.100.C-C.54 R:0.02055 P:0.01250 F:0.01554
54 ROUGE-3 Eval D0711-B.M.100.C-F.54 R:0.02768 P:0.01667 F:0.02081
54 ROUGE-3 Eval D0711-C.M.100.C-A.54 R:0.06734 P:0.03643 F:0.04728
54 ROUGE-3 Eval D0711-C.M.100.C-B.54 R:0.07666 P:0.04007 F:0.05263
54 ROUGE-3 Eval D0711-C.M.100.C-C.54 R:0.02759 P:0.01457 F:0.01907
54 ROUGE-3 Eval D0711-C.M.100.C-F.54 R:0.05517 P:0.02914 F:0.03814
54 ROUGE-3 Eval D0716-A.M.100.D-C.54 R:0.01338 P:0.00889 F:0.01068
54 ROUGE-3 Eval D0716-A.M.100.D-D.54 R:0.01701 P:0.01111 F:0.01344
54 ROUGE-3 Eval D0716-A.M.100.D-E.54 R:0.01695 P:0.01111 F:0.01342
54 ROUGE-3 Eval D0716-A.M.100.D-F.54 R:0.00337 P:0.00222 F:0.00268
54 ROUGE-3 Eval D0716-B.M.100.D-C.54 R:0.00671 P:0.00409 F:0.00508
54 ROUGE-3 Eval D0716-B.M.100.D-D.54 R:0.00685 P:0.00409 F:0.00512
54 ROUGE-3 Eval D0716-B.M.100.D-E.54 R:0.00678 P:0.00409 F:0.00510
54 ROUGE-3 Eval D0716-B.M.100.D-F.54 R:0.01020 P:0.00613 F:0.00766
54 ROUGE-3 Eval D0716-C.M.100.D-C.54 R:0.06977 P:0.04094 F:0.05160
54 ROUGE-3 Eval D0716-C.M.100.D-D.54 R:0.05802 P:0.03314 F:0.04218
54 ROUGE-3 Eval D0716-C.M.100.D-E.54 R:0.05051 P:0.02924 F:0.03704
54 ROUGE-3 Eval D0716-C.M.100.D-F.54 R:0.07483 P:0.04288 F:0.05452
54 ROUGE-3 Eval D0721-A.M.100.E-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0721-A.M.100.E-C.54 R:0.00331 P:0.00230 F:0.00271
54 ROUGE-3 Eval D0721-A.M.100.E-E.54 R:0.00331 P:0.00230 F:0.00271
54 ROUGE-3 Eval D0721-A.M.100.E-G.54 R:0.00325 P:0.00230 F:0.00269
54 ROUGE-3 Eval D0721-B.M.100.E-B.54 R:0.02326 P:0.01144 F:0.01534
54 ROUGE-3 Eval D0721-B.M.100.E-C.54 R:0.02273 P:0.01144 F:0.01522
54 ROUGE-3 Eval D0721-B.M.100.E-E.54 R:0.02007 P:0.00980 F:0.01317
54 ROUGE-3 Eval D0721-B.M.100.E-G.54 R:0.00329 P:0.00163 F:0.00218
54 ROUGE-3 Eval D0721-C.M.100.E-B.54 R:0.02007 P:0.01274 F:0.01559
54 ROUGE-3 Eval D0721-C.M.100.E-C.54 R:0.01010 P:0.00637 F:0.00781
54 ROUGE-3 Eval D0721-C.M.100.E-E.54 R:0.02041 P:0.01274 F:0.01569
54 ROUGE-3 Eval D0721-C.M.100.E-G.54 R:0.01993 P:0.01274 F:0.01554
54 ROUGE-3 Eval D0726-A.M.100.F-A.54 R:0.04746 P:0.03153 F:0.03789
54 ROUGE-3 Eval D0726-A.M.100.F-E.54 R:0.04762 P:0.03153 F:0.03794
54 ROUGE-3 Eval D0726-A.M.100.F-F.54 R:0.02712 P:0.01802 F:0.02165
54 ROUGE-3 Eval D0726-A.M.100.F-G.54 R:0.02034 P:0.01351 F:0.01624
54 ROUGE-3 Eval D0726-B.M.100.F-A.54 R:0.04000 P:0.02381 F:0.02985
54 ROUGE-3 Eval D0726-B.M.100.F-E.54 R:0.03051 P:0.01786 F:0.02253
54 ROUGE-3 Eval D0726-B.M.100.F-F.54 R:0.02373 P:0.01389 F:0.01752
54 ROUGE-3 Eval D0726-B.M.100.F-G.54 R:0.02685 P:0.01587 F:0.01995
54 ROUGE-3 Eval D0726-C.M.100.F-A.54 R:0.01361 P:0.00789 F:0.00999
54 ROUGE-3 Eval D0726-C.M.100.F-E.54 R:0.01375 P:0.00789 F:0.01003
54 ROUGE-3 Eval D0726-C.M.100.F-F.54 R:0.00692 P:0.00394 F:0.00502
54 ROUGE-3 Eval D0726-C.M.100.F-G.54 R:0.01672 P:0.00986 F:0.01240
54 ROUGE-3 Eval D0727-A.M.100.G-A.54 R:0.00339 P:0.00222 F:0.00268
54 ROUGE-3 Eval D0727-A.M.100.G-F.54 R:0.00336 P:0.00222 F:0.00267
54 ROUGE-3 Eval D0727-A.M.100.G-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0727-A.M.100.G-H.54 R:0.00336 P:0.00222 F:0.00267
54 ROUGE-3 Eval D0727-B.M.100.G-A.54 R:0.03860 P:0.02026 F:0.02657
54 ROUGE-3 Eval D0727-B.M.100.G-F.54 R:0.03642 P:0.02026 F:0.02604
54 ROUGE-3 Eval D0727-B.M.100.G-G.54 R:0.02120 P:0.01105 F:0.01453
54 ROUGE-3 Eval D0727-B.M.100.G-H.54 R:0.03860 P:0.02026 F:0.02657
54 ROUGE-3 Eval D0727-C.M.100.G-A.54 R:0.00332 P:0.00198 F:0.00248
54 ROUGE-3 Eval D0727-C.M.100.G-F.54 R:0.00344 P:0.00198 F:0.00251
54 ROUGE-3 Eval D0727-C.M.100.G-G.54 R:0.00337 P:0.00198 F:0.00249
54 ROUGE-3 Eval D0727-C.M.100.G-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-A.M.100.H-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-A.M.100.H-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-A.M.100.H-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-A.M.100.H-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-B.M.100.H-G.54 R:0.00391 P:0.00195 F:0.00260
54 ROUGE-3 Eval D0736-B.M.100.H-H.54 R:0.01271 P:0.00585 F:0.00801
54 ROUGE-3 Eval D0736-B.M.100.H-I.54 R:0.01717 P:0.00780 F:0.01073
54 ROUGE-3 Eval D0736-B.M.100.H-J.54 R:0.01429 P:0.00780 F:0.01009
54 ROUGE-3 Eval D0736-C.M.100.H-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-C.M.100.H-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-C.M.100.H-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0736-C.M.100.H-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0740-A.M.100.I-D.54 R:0.00673 P:0.00444 F:0.00535
54 ROUGE-3 Eval D0740-A.M.100.I-H.54 R:0.00667 P:0.00444 F:0.00533
54 ROUGE-3 Eval D0740-A.M.100.I-I.54 R:0.00662 P:0.00444 F:0.00532
54 ROUGE-3 Eval D0740-A.M.100.I-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0740-B.M.100.I-D.54 R:0.00993 P:0.00588 F:0.00739
54 ROUGE-3 Eval D0740-B.M.100.I-H.54 R:0.00676 P:0.00392 F:0.00496
54 ROUGE-3 Eval D0740-B.M.100.I-I.54 R:0.01003 P:0.00588 F:0.00741
54 ROUGE-3 Eval D0740-B.M.100.I-J.54 R:0.01320 P:0.00784 F:0.00984
54 ROUGE-3 Eval D0740-C.M.100.I-D.54 R:0.00326 P:0.00198 F:0.00246
54 ROUGE-3 Eval D0740-C.M.100.I-H.54 R:0.00328 P:0.00198 F:0.00247
54 ROUGE-3 Eval D0740-C.M.100.I-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0740-C.M.100.I-J.54 R:0.00325 P:0.00198 F:0.00246
54 ROUGE-3 Eval D0743-A.M.100.J-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0743-A.M.100.J-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0743-A.M.100.J-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0743-A.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0743-B.M.100.J-B.54 R:0.00327 P:0.00225 F:0.00267
54 ROUGE-3 Eval D0743-B.M.100.J-H.54 R:0.00322 P:0.00225 F:0.00265
54 ROUGE-3 Eval D0743-B.M.100.J-I.54 R:0.00323 P:0.00225 F:0.00265
54 ROUGE-3 Eval D0743-B.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-3 Eval D0743-C.M.100.J-B.54 R:0.00647 P:0.00394 F:0.00490
54 ROUGE-3 Eval D0743-C.M.100.J-H.54 R:0.00649 P:0.00394 F:0.00490
54 ROUGE-3 Eval D0743-C.M.100.J-I.54 R:0.00651 P:0.00394 F:0.00491
54 ROUGE-3 Eval D0743-C.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
54 ROUGE-4 Average_R: 0.00686 (95%-conf.int. 0.00521 - 0.00876)
54 ROUGE-4 Average_P: 0.00397 (95%-conf.int. 0.00307 - 0.00502)
54 ROUGE-4 Average_F: 0.00502 (95%-conf.int. 0.00384 - 0.00639)
.............................................
54 ROUGE-4 Eval D0703-A.M.100.A-A.54 R:0.00697 P:0.00457 F:0.00552
54 ROUGE-4 Eval D0703-A.M.100.A-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0703-A.M.100.A-D.54 R:0.00709 P:0.00457 F:0.00556
54 ROUGE-4 Eval D0703-A.M.100.A-J.54 R:0.00702 P:0.00457 F:0.00554
54 ROUGE-4 Eval D0703-B.M.100.A-A.54 R:0.01684 P:0.01029 F:0.01277
54 ROUGE-4 Eval D0703-B.M.100.A-C.54 R:0.01038 P:0.00617 F:0.00774
54 ROUGE-4 Eval D0703-B.M.100.A-D.54 R:0.01384 P:0.00823 F:0.01032
54 ROUGE-4 Eval D0703-B.M.100.A-J.54 R:0.02055 P:0.01235 F:0.01543
54 ROUGE-4 Eval D0703-C.M.100.A-A.54 R:0.01031 P:0.00585 F:0.00746
54 ROUGE-4 Eval D0703-C.M.100.A-C.54 R:0.02341 P:0.01365 F:0.01724
54 ROUGE-4 Eval D0703-C.M.100.A-D.54 R:0.02048 P:0.01170 F:0.01489
54 ROUGE-4 Eval D0703-C.M.100.A-J.54 R:0.02730 P:0.01559 F:0.01985
54 ROUGE-4 Eval D0706-A.M.100.B-B.54 R:0.00669 P:0.00427 F:0.00521
54 ROUGE-4 Eval D0706-A.M.100.B-D.54 R:0.00673 P:0.00427 F:0.00522
54 ROUGE-4 Eval D0706-A.M.100.B-E.54 R:0.00669 P:0.00427 F:0.00521
54 ROUGE-4 Eval D0706-A.M.100.B-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0706-B.M.100.B-B.54 R:0.01347 P:0.00844 F:0.01038
54 ROUGE-4 Eval D0706-B.M.100.B-D.54 R:0.01678 P:0.01055 F:0.01295
54 ROUGE-4 Eval D0706-B.M.100.B-E.54 R:0.00334 P:0.00211 F:0.00259
54 ROUGE-4 Eval D0706-B.M.100.B-I.54 R:0.01667 P:0.01055 F:0.01292
54 ROUGE-4 Eval D0706-C.M.100.B-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0706-C.M.100.B-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0706-C.M.100.B-E.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0706-C.M.100.B-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-A.M.100.C-A.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-A.M.100.C-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-A.M.100.C-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-A.M.100.C-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-B.M.100.C-A.54 R:0.00702 P:0.00419 F:0.00525
54 ROUGE-4 Eval D0711-B.M.100.C-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0711-B.M.100.C-C.54 R:0.00692 P:0.00419 F:0.00522
54 ROUGE-4 Eval D0711-B.M.100.C-F.54 R:0.00699 P:0.00419 F:0.00524
54 ROUGE-4 Eval D0711-C.M.100.C-A.54 R:0.04422 P:0.02381 F:0.03095
54 ROUGE-4 Eval D0711-C.M.100.C-B.54 R:0.04930 P:0.02564 F:0.03374
54 ROUGE-4 Eval D0711-C.M.100.C-C.54 R:0.01045 P:0.00549 F:0.00720
54 ROUGE-4 Eval D0711-C.M.100.C-F.54 R:0.04181 P:0.02198 F:0.02881
54 ROUGE-4 Eval D0716-A.M.100.D-C.54 R:0.00676 P:0.00447 F:0.00538
54 ROUGE-4 Eval D0716-A.M.100.D-D.54 R:0.00687 P:0.00447 F:0.00542
54 ROUGE-4 Eval D0716-A.M.100.D-E.54 R:0.00685 P:0.00447 F:0.00541
54 ROUGE-4 Eval D0716-A.M.100.D-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0716-B.M.100.D-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0716-B.M.100.D-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0716-B.M.100.D-E.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0716-B.M.100.D-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0716-C.M.100.D-C.54 R:0.03020 P:0.01765 F:0.02228
54 ROUGE-4 Eval D0716-C.M.100.D-D.54 R:0.02414 P:0.01373 F:0.01750
54 ROUGE-4 Eval D0716-C.M.100.D-E.54 R:0.01361 P:0.00784 F:0.00995
54 ROUGE-4 Eval D0716-C.M.100.D-F.54 R:0.03436 P:0.01961 F:0.02497
54 ROUGE-4 Eval D0721-A.M.100.E-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-A.M.100.E-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-A.M.100.E-E.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-A.M.100.E-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-B.M.100.E-B.54 R:0.01342 P:0.00657 F:0.00882
54 ROUGE-4 Eval D0721-B.M.100.E-C.54 R:0.01311 P:0.00657 F:0.00875
54 ROUGE-4 Eval D0721-B.M.100.E-E.54 R:0.01351 P:0.00657 F:0.00884
54 ROUGE-4 Eval D0721-B.M.100.E-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-C.M.100.E-B.54 R:0.01014 P:0.00641 F:0.00785
54 ROUGE-4 Eval D0721-C.M.100.E-C.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0721-C.M.100.E-E.54 R:0.01031 P:0.00641 F:0.00791
54 ROUGE-4 Eval D0721-C.M.100.E-G.54 R:0.01007 P:0.00641 F:0.00783
54 ROUGE-4 Eval D0726-A.M.100.F-A.54 R:0.02397 P:0.01587 F:0.01910
54 ROUGE-4 Eval D0726-A.M.100.F-E.54 R:0.02405 P:0.01587 F:0.01912
54 ROUGE-4 Eval D0726-A.M.100.F-F.54 R:0.01370 P:0.00907 F:0.01091
54 ROUGE-4 Eval D0726-A.M.100.F-G.54 R:0.01027 P:0.00680 F:0.00818
54 ROUGE-4 Eval D0726-B.M.100.F-A.54 R:0.01347 P:0.00798 F:0.01002
54 ROUGE-4 Eval D0726-B.M.100.F-E.54 R:0.01370 P:0.00798 F:0.01009
54 ROUGE-4 Eval D0726-B.M.100.F-F.54 R:0.00342 P:0.00200 F:0.00252
54 ROUGE-4 Eval D0726-B.M.100.F-G.54 R:0.01017 P:0.00599 F:0.00754
54 ROUGE-4 Eval D0726-C.M.100.F-A.54 R:0.00687 P:0.00397 F:0.00503
54 ROUGE-4 Eval D0726-C.M.100.F-E.54 R:0.00694 P:0.00397 F:0.00505
54 ROUGE-4 Eval D0726-C.M.100.F-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0726-C.M.100.F-G.54 R:0.00676 P:0.00397 F:0.00500
54 ROUGE-4 Eval D0727-A.M.100.G-A.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-A.M.100.G-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-A.M.100.G-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-A.M.100.G-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-B.M.100.G-A.54 R:0.02128 P:0.01111 F:0.01460
54 ROUGE-4 Eval D0727-B.M.100.G-F.54 R:0.02007 P:0.01111 F:0.01430
54 ROUGE-4 Eval D0727-B.M.100.G-G.54 R:0.00357 P:0.00185 F:0.00244
54 ROUGE-4 Eval D0727-B.M.100.G-H.54 R:0.01773 P:0.00926 F:0.01217
54 ROUGE-4 Eval D0727-C.M.100.G-A.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-C.M.100.G-F.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-C.M.100.G-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0727-C.M.100.G-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-A.M.100.H-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-A.M.100.H-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-A.M.100.H-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-A.M.100.H-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-B.M.100.H-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-B.M.100.H-H.54 R:0.00858 P:0.00392 F:0.00538
54 ROUGE-4 Eval D0736-B.M.100.H-I.54 R:0.00870 P:0.00392 F:0.00540
54 ROUGE-4 Eval D0736-B.M.100.H-J.54 R:0.00722 P:0.00392 F:0.00508
54 ROUGE-4 Eval D0736-C.M.100.H-G.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-C.M.100.H-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-C.M.100.H-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0736-C.M.100.H-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-A.M.100.I-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-A.M.100.I-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-A.M.100.I-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-A.M.100.I-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-B.M.100.I-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-B.M.100.I-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-B.M.100.I-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-B.M.100.I-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-C.M.100.I-D.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-C.M.100.I-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-C.M.100.I-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0740-C.M.100.I-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-A.M.100.J-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-A.M.100.J-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-A.M.100.J-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-A.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-B.M.100.J-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-B.M.100.J-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-B.M.100.J-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-B.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-C.M.100.J-B.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-C.M.100.J-H.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-C.M.100.J-I.54 R:0.00000 P:0.00000 F:0.00000
54 ROUGE-4 Eval D0743-C.M.100.J-J.54 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
54 ROUGE-L Average_R: 0.28236 (95%-conf.int. 0.27291 - 0.29258)
54 ROUGE-L Average_P: 0.17234 (95%-conf.int. 0.16656 - 0.17800)
54 ROUGE-L Average_F: 0.21357 (95%-conf.int. 0.20660 - 0.22077)
.............................................
54 ROUGE-L Eval D0703-A.M.100.A-A.54 R:0.27027 P:0.17897 F:0.21534
54 ROUGE-L Eval D0703-A.M.100.A-C.54 R:0.23154 P:0.15436 F:0.18523
54 ROUGE-L Eval D0703-A.M.100.A-D.54 R:0.24399 P:0.15884 F:0.19242
54 ROUGE-L Eval D0703-A.M.100.A-J.54 R:0.26190 P:0.17226 F:0.20783
54 ROUGE-L Eval D0703-B.M.100.A-A.54 R:0.30065 P:0.18586 F:0.22971
54 ROUGE-L Eval D0703-B.M.100.A-C.54 R:0.32886 P:0.19798 F:0.24716
54 ROUGE-L Eval D0703-B.M.100.A-D.54 R:0.32550 P:0.19596 F:0.24464
54 ROUGE-L Eval D0703-B.M.100.A-J.54 R:0.34219 P:0.20808 F:0.25879
54 ROUGE-L Eval D0703-C.M.100.A-A.54 R:0.34333 P:0.19732 F:0.25061
54 ROUGE-L Eval D0703-C.M.100.A-C.54 R:0.35065 P:0.20690 F:0.26024
54 ROUGE-L Eval D0703-C.M.100.A-D.54 R:0.35430 P:0.20498 F:0.25971
54 ROUGE-L Eval D0703-C.M.100.A-J.54 R:0.36755 P:0.21264 F:0.26941
54 ROUGE-L Eval D0706-A.M.100.B-B.54 R:0.28571 P:0.18449 F:0.22421
54 ROUGE-L Eval D0706-A.M.100.B-D.54 R:0.25817 P:0.16562 F:0.20179
54 ROUGE-L Eval D0706-A.M.100.B-E.54 R:0.27597 P:0.17820 F:0.21656
54 ROUGE-L Eval D0706-A.M.100.B-I.54 R:0.24351 P:0.15723 F:0.19108
54 ROUGE-L Eval D0706-B.M.100.B-B.54 R:0.31373 P:0.19876 F:0.24335
54 ROUGE-L Eval D0706-B.M.100.B-D.54 R:0.31270 P:0.19876 F:0.24304
54 ROUGE-L Eval D0706-B.M.100.B-E.54 R:0.29870 P:0.19048 F:0.23262
54 ROUGE-L Eval D0706-B.M.100.B-I.54 R:0.34304 P:0.21946 F:0.26767
54 ROUGE-L Eval D0706-C.M.100.B-B.54 R:0.29032 P:0.17341 F:0.21713
54 ROUGE-L Eval D0706-C.M.100.B-D.54 R:0.28710 P:0.17148 F:0.21471
54 ROUGE-L Eval D0706-C.M.100.B-E.54 R:0.27885 P:0.16763 F:0.20939
54 ROUGE-L Eval D0706-C.M.100.B-I.54 R:0.30990 P:0.18690 F:0.23317
54 ROUGE-L Eval D0711-A.M.100.C-A.54 R:0.28618 P:0.20863 F:0.24133
54 ROUGE-L Eval D0711-A.M.100.C-B.54 R:0.26667 P:0.19185 F:0.22316
54 ROUGE-L Eval D0711-A.M.100.C-C.54 R:0.26667 P:0.19185 F:0.22316
54 ROUGE-L Eval D0711-A.M.100.C-F.54 R:0.28477 P:0.20624 F:0.23923
54 ROUGE-L Eval D0711-B.M.100.C-A.54 R:0.32993 P:0.19959 F:0.24872
54 ROUGE-L Eval D0711-B.M.100.C-B.54 R:0.32534 P:0.19547 F:0.24421
54 ROUGE-L Eval D0711-B.M.100.C-C.54 R:0.32550 P:0.19959 F:0.24745
54 ROUGE-L Eval D0711-B.M.100.C-F.54 R:0.34237 P:0.20782 F:0.25864
54 ROUGE-L Eval D0711-C.M.100.C-A.54 R:0.41254 P:0.22523 F:0.29138
54 ROUGE-L Eval D0711-C.M.100.C-B.54 R:0.42321 P:0.22342 F:0.29245
54 ROUGE-L Eval D0711-C.M.100.C-C.54 R:0.37162 P:0.19820 F:0.25852
54 ROUGE-L Eval D0711-C.M.100.C-F.54 R:0.35811 P:0.19099 F:0.24912
54 ROUGE-L Eval D0716-A.M.100.D-C.54 R:0.34098 P:0.22807 F:0.27332
54 ROUGE-L Eval D0716-A.M.100.D-D.54 R:0.33000 P:0.21711 F:0.26191
54 ROUGE-L Eval D0716-A.M.100.D-E.54 R:0.34551 P:0.22807 F:0.27477
54 ROUGE-L Eval D0716-A.M.100.D-F.54 R:0.30363 P:0.20175 F:0.24242
54 ROUGE-L Eval D0716-B.M.100.D-C.54 R:0.23026 P:0.14141 F:0.17521
54 ROUGE-L Eval D0716-B.M.100.D-D.54 R:0.24497 P:0.14747 F:0.18411
54 ROUGE-L Eval D0716-B.M.100.D-E.54 R:0.24252 P:0.14747 F:0.18341
54 ROUGE-L Eval D0716-B.M.100.D-F.54 R:0.24000 P:0.14545 F:0.18113
54 ROUGE-L Eval D0716-C.M.100.D-C.54 R:0.36808 P:0.21773 F:0.27361
54 ROUGE-L Eval D0716-C.M.100.D-D.54 R:0.37458 P:0.21580 F:0.27384
54 ROUGE-L Eval D0716-C.M.100.D-E.54 R:0.38614 P:0.22543 F:0.28467
54 ROUGE-L Eval D0716-C.M.100.D-F.54 R:0.41000 P:0.23699 F:0.30036
54 ROUGE-L Eval D0721-A.M.100.E-B.54 R:0.24667 P:0.16780 F:0.19973
54 ROUGE-L Eval D0721-A.M.100.E-C.54 R:0.24675 P:0.17234 F:0.20294
54 ROUGE-L Eval D0721-A.M.100.E-E.54 R:0.24351 P:0.17007 F:0.20027
54 ROUGE-L Eval D0721-A.M.100.E-G.54 R:0.22930 P:0.16327 F:0.19073
54 ROUGE-L Eval D0721-B.M.100.E-B.54 R:0.32248 P:0.16019 F:0.21405
54 ROUGE-L Eval D0721-B.M.100.E-C.54 R:0.33121 P:0.16828 F:0.22317
54 ROUGE-L Eval D0721-B.M.100.E-E.54 R:0.30820 P:0.15210 F:0.20368
54 ROUGE-L Eval D0721-B.M.100.E-G.54 R:0.30968 P:0.15534 F:0.20690
54 ROUGE-L Eval D0721-C.M.100.E-B.54 R:0.34426 P:0.22013 F:0.26854
54 ROUGE-L Eval D0721-C.M.100.E-C.54 R:0.31023 P:0.19706 F:0.24102
54 ROUGE-L Eval D0721-C.M.100.E-E.54 R:0.32667 P:0.20545 F:0.25225
54 ROUGE-L Eval D0721-C.M.100.E-G.54 R:0.30293 P:0.19497 F:0.23725
54 ROUGE-L Eval D0726-A.M.100.F-A.54 R:0.32226 P:0.21556 F:0.25833
54 ROUGE-L Eval D0726-A.M.100.F-E.54 R:0.31667 P:0.21111 F:0.25333
54 ROUGE-L Eval D0726-A.M.100.F-F.54 R:0.29900 P:0.20000 F:0.23968
54 ROUGE-L Eval D0726-A.M.100.F-G.54 R:0.27907 P:0.18667 F:0.22370
54 ROUGE-L Eval D0726-B.M.100.F-A.54 R:0.33333 P:0.20000 F:0.25000
54 ROUGE-L Eval D0726-B.M.100.F-E.54 R:0.31229 P:0.18431 F:0.23181
54 ROUGE-L Eval D0726-B.M.100.F-F.54 R:0.31229 P:0.18431 F:0.23181
54 ROUGE-L Eval D0726-B.M.100.F-G.54 R:0.32895 P:0.19608 F:0.24570
54 ROUGE-L Eval D0726-C.M.100.F-A.54 R:0.30333 P:0.17739 F:0.22386
54 ROUGE-L Eval D0726-C.M.100.F-E.54 R:0.29630 P:0.17154 F:0.21728
54 ROUGE-L Eval D0726-C.M.100.F-F.54 R:0.28136 P:0.16179 F:0.20544
54 ROUGE-L Eval D0726-C.M.100.F-G.54 R:0.31148 P:0.18519 F:0.23228
54 ROUGE-L Eval D0727-A.M.100.G-A.54 R:0.21927 P:0.14474 F:0.17438
54 ROUGE-L Eval D0727-A.M.100.G-F.54 R:0.20724 P:0.13816 F:0.16579
54 ROUGE-L Eval D0727-A.M.100.G-G.54 R:0.20261 P:0.13596 F:0.16272
54 ROUGE-L Eval D0727-A.M.100.G-H.54 R:0.20066 P:0.13377 F:0.16053
54 ROUGE-L Eval D0727-B.M.100.G-A.54 R:0.35395 P:0.18761 F:0.24523
54 ROUGE-L Eval D0727-B.M.100.G-F.54 R:0.36364 P:0.20401 F:0.26138
54 ROUGE-L Eval D0727-B.M.100.G-G.54 R:0.33218 P:0.17486 F:0.22911
54 ROUGE-L Eval D0727-B.M.100.G-H.54 R:0.35395 P:0.18761 F:0.24523
54 ROUGE-L Eval D0727-C.M.100.G-A.54 R:0.22801 P:0.13725 F:0.17135
54 ROUGE-L Eval D0727-C.M.100.G-F.54 R:0.26263 P:0.15294 F:0.19331
54 ROUGE-L Eval D0727-C.M.100.G-G.54 R:0.23762 P:0.14118 F:0.17712
54 ROUGE-L Eval D0727-C.M.100.G-H.54 R:0.25000 P:0.14510 F:0.18362
54 ROUGE-L Eval D0736-A.M.100.H-G.54 R:0.25806 P:0.15686 F:0.19512
54 ROUGE-L Eval D0736-A.M.100.H-H.54 R:0.26642 P:0.15904 F:0.19918
54 ROUGE-L Eval D0736-A.M.100.H-I.54 R:0.25623 P:0.15686 F:0.19459
54 ROUGE-L Eval D0736-A.M.100.H-J.54 R:0.25163 P:0.16776 F:0.20131
54 ROUGE-L Eval D0736-B.M.100.H-G.54 R:0.20992 P:0.10597 F:0.14084
54 ROUGE-L Eval D0736-B.M.100.H-H.54 R:0.21901 P:0.10212 F:0.13929
54 ROUGE-L Eval D0736-B.M.100.H-I.54 R:0.24686 P:0.11368 F:0.15567
54 ROUGE-L Eval D0736-B.M.100.H-J.54 R:0.23427 P:0.12909 F:0.16646
54 ROUGE-L Eval D0736-C.M.100.H-G.54 R:0.15190 P:0.07895 F:0.10390
54 ROUGE-L Eval D0736-C.M.100.H-H.54 R:0.13369 P:0.05482 F:0.07776
54 ROUGE-L Eval D0736-C.M.100.H-I.54 R:0.17112 P:0.07018 F:0.09954
54 ROUGE-L Eval D0736-C.M.100.H-J.54 R:0.14717 P:0.08553 F:0.10819
54 ROUGE-L Eval D0740-A.M.100.I-D.54 R:0.26733 P:0.17763 F:0.21344
54 ROUGE-L Eval D0740-A.M.100.I-H.54 R:0.24183 P:0.16228 F:0.19423
54 ROUGE-L Eval D0740-A.M.100.I-I.54 R:0.23701 P:0.16009 F:0.19110
54 ROUGE-L Eval D0740-A.M.100.I-J.54 R:0.24194 P:0.16447 F:0.19582
54 ROUGE-L Eval D0740-B.M.100.I-D.54 R:0.28571 P:0.17054 F:0.21359
54 ROUGE-L Eval D0740-B.M.100.I-H.54 R:0.29470 P:0.17248 F:0.21760
54 ROUGE-L Eval D0740-B.M.100.I-I.54 R:0.29836 P:0.17636 F:0.22168
54 ROUGE-L Eval D0740-B.M.100.I-J.54 R:0.29773 P:0.17829 F:0.22303
54 ROUGE-L Eval D0740-C.M.100.I-D.54 R:0.29393 P:0.18039 F:0.22357
54 ROUGE-L Eval D0740-C.M.100.I-H.54 R:0.28939 P:0.17647 F:0.21924
54 ROUGE-L Eval D0740-C.M.100.I-I.54 R:0.27796 P:0.17059 F:0.21142
54 ROUGE-L Eval D0740-C.M.100.I-J.54 R:0.28981 P:0.17843 F:0.22087
54 ROUGE-L Eval D0743-A.M.100.J-B.54 R:0.20000 P:0.13043 F:0.15789
54 ROUGE-L Eval D0743-A.M.100.J-H.54 R:0.17901 P:0.12008 F:0.14374
54 ROUGE-L Eval D0743-A.M.100.J-I.54 R:0.20625 P:0.13665 F:0.16439
54 ROUGE-L Eval D0743-A.M.100.J-J.54 R:0.19077 P:0.12836 F:0.15346
54 ROUGE-L Eval D0743-B.M.100.J-B.54 R:0.22115 P:0.15333 F:0.18110
54 ROUGE-L Eval D0743-B.M.100.J-H.54 R:0.21136 P:0.14889 F:0.17471
54 ROUGE-L Eval D0743-B.M.100.J-I.54 R:0.22152 P:0.15556 F:0.18277
54 ROUGE-L Eval D0743-B.M.100.J-J.54 R:0.19938 P:0.14222 F:0.16602
54 ROUGE-L Eval D0743-C.M.100.J-B.54 R:0.23175 P:0.14230 F:0.17633
54 ROUGE-L Eval D0743-C.M.100.J-H.54 R:0.22930 P:0.14035 F:0.17412
54 ROUGE-L Eval D0743-C.M.100.J-I.54 R:0.23962 P:0.14620 F:0.18160
54 ROUGE-L Eval D0743-C.M.100.J-J.54 R:0.20440 P:0.12671 F:0.15644
---------------------------------------------
54 ROUGE-W-1.2 Average_R: 0.09825 (95%-conf.int. 0.09513 - 0.10148)
54 ROUGE-W-1.2 Average_P: 0.10892 (95%-conf.int. 0.10529 - 0.11246)
54 ROUGE-W-1.2 Average_F: 0.10310 (95%-conf.int. 0.09982 - 0.10649)
.............................................
54 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.54 R:0.09284 P:0.11071 F:0.10099
54 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.54 R:0.07830 P:0.09488 F:0.08580
54 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.54 R:0.08630 P:0.10358 F:0.09415
54 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.54 R:0.09417 P:0.10595 F:0.09971
54 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.54 R:0.10785 P:0.12362 F:0.11520
54 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.54 R:0.11086 P:0.12629 F:0.11807
54 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.54 R:0.11138 P:0.12578 F:0.11814
54 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.54 R:0.11996 P:0.13530 F:0.12717
54 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.54 R:0.11656 P:0.12455 F:0.12042
54 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.54 R:0.12016 P:0.13386 F:0.12664
54 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.54 R:0.12009 P:0.13186 F:0.12570
54 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.54 R:0.13116 P:0.13667 F:0.13386
54 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.54 R:0.10060 P:0.11657 F:0.10800
54 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.54 R:0.08892 P:0.10467 F:0.09615
54 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.54 R:0.09512 P:0.11137 F:0.10261
54 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.54 R:0.08404 P:0.10055 F:0.09156
54 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.54 R:0.10945 P:0.12009 F:0.11452
54 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.54 R:0.10754 P:0.12053 F:0.11367
54 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.54 R:0.10629 P:0.11963 F:0.11257
54 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.54 R:0.11384 P:0.13171 F:0.12212
54 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.54 R:0.10077 P:0.10273 F:0.10174
54 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.54 R:0.09723 P:0.09997 F:0.09858
54 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.54 R:0.09514 P:0.09689 F:0.09601
54 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.54 R:0.11104 P:0.11630 F:0.11361
54 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.54 R:0.09726 P:0.12783 F:0.11047
54 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.54 R:0.09001 P:0.11730 F:0.10186
54 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.54 R:0.08797 P:0.11365 F:0.09917
54 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.54 R:0.09435 P:0.12396 F:0.10715
54 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.54 R:0.11911 P:0.12856 F:0.12365
54 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.54 R:0.11000 P:0.12386 F:0.11652
54 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.54 R:0.11211 P:0.12914 F:0.12002
54 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.54 R:0.11894 P:0.13409 F:0.12606
54 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.54 R:0.13918 P:0.14206 F:0.14061
54 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.54 R:0.14365 P:0.14181 F:0.14272
54 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.54 R:0.11981 P:0.12133 F:0.12057
54 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.54 R:0.11985 P:0.12320 F:0.12150
54 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.54 R:0.11521 P:0.14078 F:0.12672
54 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.54 R:0.10822 P:0.13565 F:0.12039
54 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.54 R:0.11372 P:0.14018 F:0.12557
54 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.54 R:0.09984 P:0.12616 F:0.11147
54 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.54 R:0.08268 P:0.08858 F:0.08553
54 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.54 R:0.08570 P:0.09233 F:0.08889
54 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.54 R:0.08612 P:0.09322 F:0.08953
54 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.54 R:0.08387 P:0.08996 F:0.08681
54 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.54 R:0.12537 P:0.13822 F:0.13148
54 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.54 R:0.12144 P:0.13568 F:0.12817
54 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.54 R:0.12621 P:0.14279 F:0.13399
54 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.54 R:0.13333 P:0.14992 F:0.14114
54 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.54 R:0.09065 P:0.10839 F:0.09873
54 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.54 R:0.09087 P:0.11259 F:0.10057
54 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.54 R:0.08702 P:0.10918 F:0.09685
54 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.54 R:0.08648 P:0.10790 F:0.09601
54 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.54 R:0.10783 P:0.10355 F:0.10565
54 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.54 R:0.11062 P:0.10564 F:0.10807
54 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.54 R:0.10004 P:0.09690 F:0.09844
54 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.54 R:0.09887 P:0.09897 F:0.09892
54 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.54 R:0.11551 P:0.13594 F:0.12490
54 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.54 R:0.10246 P:0.12245 F:0.11157
54 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.54 R:0.10967 P:0.12874 F:0.11844
54 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.54 R:0.10294 P:0.12389 F:0.11245
54 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.54 R:0.12119 P:0.14365 F:0.13147
54 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.54 R:0.12401 P:0.14483 F:0.13361
54 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.54 R:0.11059 P:0.13176 F:0.12025
54 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.54 R:0.10384 P:0.12572 F:0.11374
54 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.54 R:0.12377 P:0.13062 F:0.12710
54 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.54 R:0.10909 P:0.11623 F:0.11255
54 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.54 R:0.11219 P:0.12030 F:0.11610
54 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.54 R:0.11869 P:0.12774 F:0.12305
54 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.54 R:0.11045 P:0.11342 F:0.11192
54 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.54 R:0.10775 P:0.11010 F:0.10891
54 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.54 R:0.10130 P:0.10432 F:0.10279
54 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.54 R:0.11088 P:0.11804 F:0.11435
54 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.54 R:0.07520 P:0.08738 F:0.08083
54 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.54 R:0.07270 P:0.08846 F:0.07981
54 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.54 R:0.06824 P:0.08110 F:0.07412
54 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.54 R:0.06812 P:0.08141 F:0.07417
54 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.54 R:0.12970 P:0.12062 F:0.12500
54 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.54 R:0.12934 P:0.13034 F:0.12984
54 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.54 R:0.11657 P:0.10991 F:0.11314
54 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.54 R:0.12877 P:0.12082 F:0.12467
54 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.54 R:0.08023 P:0.08685 F:0.08341
54 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.54 R:0.09078 P:0.09771 F:0.09412
54 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.54 R:0.08369 P:0.09153 F:0.08743
54 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.54 R:0.08798 P:0.09190 F:0.08990
54 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.54 R:0.08994 P:0.09681 F:0.09325
54 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.54 R:0.09424 P:0.09893 F:0.09653
54 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.54 R:0.08922 P:0.09759 F:0.09322
54 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.54 R:0.08498 P:0.10099 F:0.09230
54 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.54 R:0.07619 P:0.07119 F:0.07361
54 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.54 R:0.08060 P:0.06953 F:0.07466
54 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.54 R:0.09023 P:0.07674 F:0.08294
54 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.54 R:0.08305 P:0.08461 F:0.08382
54 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.54 R:0.05602 P:0.05289 F:0.05441
54 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.54 R:0.05023 P:0.03850 F:0.04359
54 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.54 R:0.06420 P:0.04803 F:0.05495
54 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.54 R:0.05448 P:0.05648 F:0.05546
54 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.54 R:0.09400 P:0.11489 F:0.10340
54 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.54 R:0.08640 P:0.10460 F:0.09463
54 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.54 R:0.08456 P:0.10565 F:0.09394
54 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.54 R:0.08435 P:0.10534 F:0.09368
54 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.54 R:0.09741 P:0.10683 F:0.10190
54 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.54 R:0.10087 P:0.10506 F:0.10292
54 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.54 R:0.09788 P:0.10871 F:0.10301
54 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.54 R:0.10299 P:0.11026 F:0.10650
54 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.54 R:0.09774 P:0.11577 F:0.10599
54 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.54 R:0.09722 P:0.11065 F:0.10350
54 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.54 R:0.08614 P:0.10339 F:0.09398
54 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.54 R:0.09490 P:0.11196 F:0.10273
54 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.54 R:0.07151 P:0.08130 F:0.07609
54 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.54 R:0.06514 P:0.07548 F:0.06993
54 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.54 R:0.07177 P:0.08438 F:0.07757
54 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.54 R:0.06924 P:0.08088 F:0.07461
54 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.54 R:0.08194 P:0.09514 F:0.08805
54 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.54 R:0.08214 P:0.09596 F:0.08851
54 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.54 R:0.08343 P:0.09873 F:0.09044
54 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.54 R:0.07750 P:0.09090 F:0.08367
54 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.54 R:0.08275 P:0.08895 F:0.08574
54 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.54 R:0.08238 P:0.08421 F:0.08328
54 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.54 R:0.08146 P:0.08856 F:0.08486
54 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.54 R:0.07167 P:0.07478 F:0.07319
---------------------------------------------
54 ROUGE-SU4 Average_R: 0.10098 (95%-conf.int. 0.09529 - 0.10697)
54 ROUGE-SU4 Average_P: 0.06084 (95%-conf.int. 0.05759 - 0.06415)
54 ROUGE-SU4 Average_F: 0.07577 (95%-conf.int. 0.07166 - 0.07999)
.............................................
54 ROUGE-SU4 Eval D0703-A.M.100.A-A.54 R:0.10243 P:0.06720 F:0.08116
54 ROUGE-SU4 Eval D0703-A.M.100.A-C.54 R:0.08276 P:0.05467 F:0.06584
54 ROUGE-SU4 Eval D0703-A.M.100.A-D.54 R:0.09128 P:0.05885 F:0.07156
54 ROUGE-SU4 Eval D0703-A.M.100.A-J.54 R:0.09149 P:0.05961 F:0.07219
54 ROUGE-SU4 Eval D0703-B.M.100.A-A.54 R:0.13143 P:0.08042 F:0.09978
54 ROUGE-SU4 Eval D0703-B.M.100.A-C.54 R:0.13851 P:0.08248 F:0.10339
54 ROUGE-SU4 Eval D0703-B.M.100.A-D.54 R:0.13736 P:0.08179 F:0.10253
54 ROUGE-SU4 Eval D0703-B.M.100.A-J.54 R:0.14448 P:0.08693 F:0.10855
54 ROUGE-SU4 Eval D0703-C.M.100.A-A.54 R:0.15868 P:0.09014 F:0.11497
54 ROUGE-SU4 Eval D0703-C.M.100.A-C.54 R:0.17167 P:0.10019 F:0.12653
54 ROUGE-SU4 Eval D0703-C.M.100.A-D.54 R:0.15703 P:0.08982 F:0.11428
54 ROUGE-SU4 Eval D0703-C.M.100.A-J.54 R:0.16837 P:0.09630 F:0.12252
54 ROUGE-SU4 Eval D0706-A.M.100.B-B.54 R:0.10778 P:0.06894 F:0.08409
54 ROUGE-SU4 Eval D0706-A.M.100.B-D.54 R:0.09340 P:0.05935 F:0.07258
54 ROUGE-SU4 Eval D0706-A.M.100.B-E.54 R:0.09944 P:0.06361 F:0.07759
54 ROUGE-SU4 Eval D0706-A.M.100.B-I.54 R:0.08000 P:0.05117 F:0.06242
54 ROUGE-SU4 Eval D0706-B.M.100.B-B.54 R:0.11633 P:0.07298 F:0.08969
54 ROUGE-SU4 Eval D0706-B.M.100.B-D.54 R:0.11538 P:0.07263 F:0.08914
54 ROUGE-SU4 Eval D0706-B.M.100.B-E.54 R:0.10556 P:0.06667 F:0.08172
54 ROUGE-SU4 Eval D0706-B.M.100.B-I.54 R:0.13178 P:0.08351 F:0.10223
54 ROUGE-SU4 Eval D0706-C.M.100.B-B.54 R:0.08333 P:0.04925 F:0.06191
54 ROUGE-SU4 Eval D0706-C.M.100.B-D.54 R:0.08720 P:0.05153 F:0.06478
54 ROUGE-SU4 Eval D0706-C.M.100.B-E.54 R:0.08607 P:0.05121 F:0.06421
54 ROUGE-SU4 Eval D0706-C.M.100.B-I.54 R:0.09617 P:0.05740 F:0.07189
54 ROUGE-SU4 Eval D0711-A.M.100.C-A.54 R:0.08446 P:0.06112 F:0.07092
54 ROUGE-SU4 Eval D0711-A.M.100.C-B.54 R:0.08162 P:0.05827 F:0.06800
54 ROUGE-SU4 Eval D0711-A.M.100.C-C.54 R:0.08048 P:0.05746 F:0.06705
54 ROUGE-SU4 Eval D0711-A.M.100.C-F.54 R:0.09070 P:0.06520 F:0.07586
54 ROUGE-SU4 Eval D0711-B.M.100.C-A.54 R:0.12529 P:0.07497 F:0.09381
54 ROUGE-SU4 Eval D0711-B.M.100.C-B.54 R:0.13087 P:0.07775 F:0.09755
54 ROUGE-SU4 Eval D0711-B.M.100.C-C.54 R:0.13448 P:0.08159 F:0.10156
54 ROUGE-SU4 Eval D0711-B.M.100.C-F.54 R:0.13763 P:0.08264 F:0.10327
54 ROUGE-SU4 Eval D0711-C.M.100.C-A.54 R:0.18305 P:0.09872 F:0.12827
54 ROUGE-SU4 Eval D0711-C.M.100.C-B.54 R:0.18596 P:0.09689 F:0.12740
54 ROUGE-SU4 Eval D0711-C.M.100.C-C.54 R:0.13310 P:0.07008 F:0.09182
54 ROUGE-SU4 Eval D0711-C.M.100.C-F.54 R:0.16030 P:0.08440 F:0.11058
54 ROUGE-SU4 Eval D0716-A.M.100.D-C.54 R:0.12738 P:0.08445 F:0.10156
54 ROUGE-SU4 Eval D0716-A.M.100.D-D.54 R:0.13128 P:0.08557 F:0.10361
54 ROUGE-SU4 Eval D0716-A.M.100.D-E.54 R:0.13083 P:0.08557 F:0.10347
54 ROUGE-SU4 Eval D0716-A.M.100.D-F.54 R:0.10847 P:0.07143 F:0.08614
54 ROUGE-SU4 Eval D0716-B.M.100.D-C.54 R:0.06250 P:0.03799 F:0.04726
54 ROUGE-SU4 Eval D0716-B.M.100.D-D.54 R:0.06782 P:0.04038 F:0.05062
54 ROUGE-SU4 Eval D0716-B.M.100.D-E.54 R:0.06655 P:0.04004 F:0.05000
54 ROUGE-SU4 Eval D0716-B.M.100.D-F.54 R:0.06621 P:0.03970 F:0.04964
54 ROUGE-SU4 Eval D0716-C.M.100.D-C.54 R:0.14883 P:0.08708 F:0.10987
54 ROUGE-SU4 Eval D0716-C.M.100.D-D.54 R:0.15636 P:0.08904 F:0.11347
54 ROUGE-SU4 Eval D0716-C.M.100.D-E.54 R:0.15254 P:0.08806 F:0.11166
54 ROUGE-SU4 Eval D0716-C.M.100.D-F.54 R:0.17123 P:0.09785 F:0.12453
54 ROUGE-SU4 Eval D0721-A.M.100.E-B.54 R:0.08676 P:0.05851 F:0.06989
54 ROUGE-SU4 Eval D0721-A.M.100.E-C.54 R:0.08667 P:0.06005 F:0.07095
54 ROUGE-SU4 Eval D0721-A.M.100.E-E.54 R:0.08500 P:0.05889 F:0.06958
54 ROUGE-SU4 Eval D0721-A.M.100.E-G.54 R:0.08224 P:0.05812 F:0.06811
54 ROUGE-SU4 Eval D0721-B.M.100.E-B.54 R:0.11204 P:0.05492 F:0.07371
54 ROUGE-SU4 Eval D0721-B.M.100.E-C.54 R:0.11983 P:0.06011 F:0.08006
54 ROUGE-SU4 Eval D0721-B.M.100.E-E.54 R:0.10943 P:0.05328 F:0.07167
54 ROUGE-SU4 Eval D0721-B.M.100.E-G.54 R:0.10375 P:0.05137 F:0.06872
54 ROUGE-SU4 Eval D0721-C.M.100.E-B.54 R:0.13131 P:0.08316 F:0.10183
54 ROUGE-SU4 Eval D0721-C.M.100.E-C.54 R:0.11525 P:0.07249 F:0.08900
54 ROUGE-SU4 Eval D0721-C.M.100.E-E.54 R:0.12100 P:0.07534 F:0.09286
54 ROUGE-SU4 Eval D0721-C.M.100.E-G.54 R:0.10925 P:0.06965 F:0.08507
54 ROUGE-SU4 Eval D0726-A.M.100.F-A.54 R:0.12685 P:0.08409 F:0.10114
54 ROUGE-SU4 Eval D0726-A.M.100.F-E.54 R:0.13128 P:0.08673 F:0.10445
54 ROUGE-SU4 Eval D0726-A.M.100.F-F.54 R:0.10865 P:0.07202 F:0.08662
54 ROUGE-SU4 Eval D0726-A.M.100.F-G.54 R:0.10637 P:0.07051 F:0.08480
54 ROUGE-SU4 Eval D0726-B.M.100.F-A.54 R:0.12472 P:0.07404 F:0.09292
54 ROUGE-SU4 Eval D0726-B.M.100.F-E.54 R:0.10922 P:0.06375 F:0.08051
54 ROUGE-SU4 Eval D0726-B.M.100.F-F.54 R:0.11092 P:0.06474 F:0.08176
54 ROUGE-SU4 Eval D0726-B.M.100.F-G.54 R:0.11768 P:0.06939 F:0.08730
54 ROUGE-SU4 Eval D0726-C.M.100.F-A.54 R:0.10845 P:0.06271 F:0.07947
54 ROUGE-SU4 Eval D0726-C.M.100.F-E.54 R:0.10265 P:0.05875 F:0.07473
54 ROUGE-SU4 Eval D0726-C.M.100.F-F.54 R:0.09408 P:0.05347 F:0.06819
54 ROUGE-SU4 Eval D0726-C.M.100.F-G.54 R:0.10999 P:0.06469 F:0.08147
54 ROUGE-SU4 Eval D0727-A.M.100.G-A.54 R:0.06769 P:0.04427 F:0.05353
54 ROUGE-SU4 Eval D0727-A.M.100.G-F.54 R:0.06532 P:0.04315 F:0.05197
54 ROUGE-SU4 Eval D0727-A.M.100.G-G.54 R:0.05928 P:0.03943 F:0.04736
54 ROUGE-SU4 Eval D0727-A.M.100.G-H.54 R:0.05800 P:0.03832 F:0.04615
54 ROUGE-SU4 Eval D0727-B.M.100.G-A.54 R:0.14134 P:0.07394 F:0.09709
54 ROUGE-SU4 Eval D0727-B.M.100.G-F.54 R:0.14556 P:0.08071 F:0.10384
54 ROUGE-SU4 Eval D0727-B.M.100.G-G.54 R:0.11684 P:0.06069 F:0.07989
54 ROUGE-SU4 Eval D0727-B.M.100.G-H.54 R:0.13428 P:0.07024 F:0.09223
54 ROUGE-SU4 Eval D0727-C.M.100.G-A.54 R:0.08751 P:0.05212 F:0.06533
54 ROUGE-SU4 Eval D0727-C.M.100.G-F.54 R:0.10496 P:0.06042 F:0.07669
54 ROUGE-SU4 Eval D0727-C.M.100.G-G.54 R:0.09774 P:0.05744 F:0.07236
54 ROUGE-SU4 Eval D0727-C.M.100.G-H.54 R:0.09259 P:0.05312 F:0.06751
54 ROUGE-SU4 Eval D0736-A.M.100.H-G.54 R:0.06950 P:0.04176 F:0.05217
54 ROUGE-SU4 Eval D0736-A.M.100.H-H.54 R:0.07769 P:0.04582 F:0.05764
54 ROUGE-SU4 Eval D0736-A.M.100.H-I.54 R:0.07326 P:0.04435 F:0.05525
54 ROUGE-SU4 Eval D0736-A.M.100.H-J.54 R:0.07215 P:0.04767 F:0.05741
54 ROUGE-SU4 Eval D0736-B.M.100.H-G.54 R:0.06562 P:0.03262 F:0.04358
54 ROUGE-SU4 Eval D0736-B.M.100.H-H.54 R:0.07550 P:0.03457 F:0.04743
54 ROUGE-SU4 Eval D0736-B.M.100.H-I.54 R:0.08225 P:0.03718 F:0.05121
54 ROUGE-SU4 Eval D0736-B.M.100.H-J.54 R:0.07794 P:0.04240 F:0.05492
54 ROUGE-SU4 Eval D0736-C.M.100.H-G.54 R:0.03566 P:0.01823 F:0.02413
54 ROUGE-SU4 Eval D0736-C.M.100.H-H.54 R:0.03166 P:0.01265 F:0.01808
54 ROUGE-SU4 Eval D0736-C.M.100.H-I.54 R:0.04004 P:0.01600 F:0.02286
54 ROUGE-SU4 Eval D0736-C.M.100.H-J.54 R:0.03502 P:0.02009 F:0.02553
54 ROUGE-SU4 Eval D0740-A.M.100.I-D.54 R:0.08814 P:0.05804 F:0.06999
54 ROUGE-SU4 Eval D0740-A.M.100.I-H.54 R:0.07383 P:0.04911 F:0.05898
54 ROUGE-SU4 Eval D0740-A.M.100.I-I.54 R:0.07722 P:0.05171 F:0.06194
54 ROUGE-SU4 Eval D0740-A.M.100.I-J.54 R:0.07395 P:0.04985 F:0.05955
54 ROUGE-SU4 Eval D0740-B.M.100.I-D.54 R:0.09000 P:0.05315 F:0.06683
54 ROUGE-SU4 Eval D0740-B.M.100.I-H.54 R:0.08673 P:0.05020 F:0.06359
54 ROUGE-SU4 Eval D0740-B.M.100.I-I.54 R:0.09708 P:0.05676 F:0.07164
54 ROUGE-SU4 Eval D0740-B.M.100.I-J.54 R:0.09524 P:0.05643 F:0.07087
54 ROUGE-SU4 Eval D0740-C.M.100.I-D.54 R:0.11093 P:0.06740 F:0.08385
54 ROUGE-SU4 Eval D0740-C.M.100.I-H.54 R:0.10836 P:0.06541 F:0.08158
54 ROUGE-SU4 Eval D0740-C.M.100.I-I.54 R:0.10164 P:0.06175 F:0.07683
54 ROUGE-SU4 Eval D0740-C.M.100.I-J.54 R:0.10730 P:0.06541 F:0.08127
54 ROUGE-SU4 Eval D0743-A.M.100.J-B.54 R:0.06080 P:0.03930 F:0.04774
54 ROUGE-SU4 Eval D0743-A.M.100.J-H.54 R:0.05011 P:0.03333 F:0.04003
54 ROUGE-SU4 Eval D0743-A.M.100.J-I.54 R:0.06250 P:0.04105 F:0.04955
54 ROUGE-SU4 Eval D0743-A.M.100.J-J.54 R:0.05205 P:0.03474 F:0.04167
54 ROUGE-SU4 Eval D0743-B.M.100.J-B.54 R:0.06908 P:0.04751 F:0.05630
54 ROUGE-SU4 Eval D0743-B.M.100.J-H.54 R:0.06688 P:0.04676 F:0.05504
54 ROUGE-SU4 Eval D0743-B.M.100.J-I.54 R:0.07251 P:0.05053 F:0.05956
54 ROUGE-SU4 Eval D0743-B.M.100.J-J.54 R:0.05911 P:0.04186 F:0.04901
54 ROUGE-SU4 Eval D0743-C.M.100.J-B.54 R:0.06732 P:0.04092 F:0.05090
54 ROUGE-SU4 Eval D0743-C.M.100.J-H.54 R:0.06427 P:0.03894 F:0.04850
54 ROUGE-SU4 Eval D0743-C.M.100.J-I.54 R:0.07432 P:0.04488 F:0.05596
54 ROUGE-SU4 Eval D0743-C.M.100.J-J.54 R:0.05806 P:0.03564 F:0.04417
---------------------------------------------
55 ROUGE-1 Average_R: 0.37695 (95%-conf.int. 0.36746 - 0.38606)
55 ROUGE-1 Average_P: 0.23108 (95%-conf.int. 0.22530 - 0.23688)
55 ROUGE-1 Average_F: 0.28593 (95%-conf.int. 0.27927 - 0.29234)
.............................................
55 ROUGE-1 Eval D0703-A.M.100.A-A.55 R:0.42230 P:0.26042 F:0.32217
55 ROUGE-1 Eval D0703-A.M.100.A-C.55 R:0.39933 P:0.24792 F:0.30592
55 ROUGE-1 Eval D0703-A.M.100.A-D.55 R:0.38488 P:0.23333 F:0.29053
55 ROUGE-1 Eval D0703-A.M.100.A-J.55 R:0.40136 P:0.24583 F:0.30491
55 ROUGE-1 Eval D0703-B.M.100.A-A.55 R:0.35948 P:0.23965 F:0.28758
55 ROUGE-1 Eval D0703-B.M.100.A-C.55 R:0.37919 P:0.24619 F:0.29855
55 ROUGE-1 Eval D0703-B.M.100.A-D.55 R:0.36577 P:0.23747 F:0.28798
55 ROUGE-1 Eval D0703-B.M.100.A-J.55 R:0.36213 P:0.23747 F:0.28684
55 ROUGE-1 Eval D0703-C.M.100.A-A.55 R:0.40333 P:0.26889 F:0.32267
55 ROUGE-1 Eval D0703-C.M.100.A-C.55 R:0.40260 P:0.27556 F:0.32718
55 ROUGE-1 Eval D0703-C.M.100.A-D.55 R:0.38411 P:0.25778 F:0.30851
55 ROUGE-1 Eval D0703-C.M.100.A-J.55 R:0.40397 P:0.27111 F:0.32447
55 ROUGE-1 Eval D0706-A.M.100.B-B.55 R:0.41234 P:0.25813 F:0.31750
55 ROUGE-1 Eval D0706-A.M.100.B-D.55 R:0.42157 P:0.26220 F:0.32331
55 ROUGE-1 Eval D0706-A.M.100.B-E.55 R:0.36039 P:0.22561 F:0.27750
55 ROUGE-1 Eval D0706-A.M.100.B-I.55 R:0.39610 P:0.24797 F:0.30500
55 ROUGE-1 Eval D0706-B.M.100.B-B.55 R:0.36275 P:0.22561 F:0.27820
55 ROUGE-1 Eval D0706-B.M.100.B-D.55 R:0.35505 P:0.22154 F:0.27284
55 ROUGE-1 Eval D0706-B.M.100.B-E.55 R:0.32468 P:0.20325 F:0.25000
55 ROUGE-1 Eval D0706-B.M.100.B-I.55 R:0.37217 P:0.23374 F:0.28714
55 ROUGE-1 Eval D0706-C.M.100.B-B.55 R:0.37419 P:0.24017 F:0.29256
55 ROUGE-1 Eval D0706-C.M.100.B-D.55 R:0.38387 P:0.24638 F:0.30013
55 ROUGE-1 Eval D0706-C.M.100.B-E.55 R:0.38462 P:0.24845 F:0.30189
55 ROUGE-1 Eval D0706-C.M.100.B-I.55 R:0.38019 P:0.24638 F:0.29900
55 ROUGE-1 Eval D0711-A.M.100.C-A.55 R:0.38158 P:0.25272 F:0.30406
55 ROUGE-1 Eval D0711-A.M.100.C-B.55 R:0.41333 P:0.27015 F:0.32674
55 ROUGE-1 Eval D0711-A.M.100.C-C.55 R:0.38000 P:0.24837 F:0.30040
55 ROUGE-1 Eval D0711-A.M.100.C-F.55 R:0.41722 P:0.27451 F:0.33114
55 ROUGE-1 Eval D0711-B.M.100.C-A.55 R:0.32993 P:0.20464 F:0.25260
55 ROUGE-1 Eval D0711-B.M.100.C-B.55 R:0.34589 P:0.21308 F:0.26371
55 ROUGE-1 Eval D0711-B.M.100.C-C.55 R:0.31544 P:0.19831 F:0.24352
55 ROUGE-1 Eval D0711-B.M.100.C-F.55 R:0.35254 P:0.21941 F:0.27048
55 ROUGE-1 Eval D0711-C.M.100.C-A.55 R:0.41914 P:0.26132 F:0.32193
55 ROUGE-1 Eval D0711-C.M.100.C-B.55 R:0.39590 P:0.23868 F:0.29781
55 ROUGE-1 Eval D0711-C.M.100.C-C.55 R:0.40878 P:0.24897 F:0.30946
55 ROUGE-1 Eval D0711-C.M.100.C-F.55 R:0.43243 P:0.26337 F:0.32736
55 ROUGE-1 Eval D0716-A.M.100.D-C.55 R:0.41639 P:0.26625 F:0.32481
55 ROUGE-1 Eval D0716-A.M.100.D-D.55 R:0.38667 P:0.24319 F:0.29859
55 ROUGE-1 Eval D0716-A.M.100.D-E.55 R:0.45183 P:0.28512 F:0.34962
55 ROUGE-1 Eval D0716-A.M.100.D-F.55 R:0.43234 P:0.27463 F:0.33589
55 ROUGE-1 Eval D0716-B.M.100.D-C.55 R:0.47697 P:0.30021 F:0.36849
55 ROUGE-1 Eval D0716-B.M.100.D-D.55 R:0.51342 P:0.31677 F:0.39180
55 ROUGE-1 Eval D0716-B.M.100.D-E.55 R:0.47841 P:0.29814 F:0.36735
55 ROUGE-1 Eval D0716-B.M.100.D-F.55 R:0.48667 P:0.30228 F:0.37293
55 ROUGE-1 Eval D0716-C.M.100.D-C.55 R:0.44300 P:0.27984 F:0.34301
55 ROUGE-1 Eval D0716-C.M.100.D-D.55 R:0.47157 P:0.29012 F:0.35923
55 ROUGE-1 Eval D0716-C.M.100.D-E.55 R:0.44554 P:0.27778 F:0.34221
55 ROUGE-1 Eval D0716-C.M.100.D-F.55 R:0.44667 P:0.27572 F:0.34097
55 ROUGE-1 Eval D0721-A.M.100.E-B.55 R:0.39333 P:0.24583 F:0.30256
55 ROUGE-1 Eval D0721-A.M.100.E-C.55 R:0.40260 P:0.25833 F:0.31472
55 ROUGE-1 Eval D0721-A.M.100.E-E.55 R:0.39286 P:0.25208 F:0.30710
55 ROUGE-1 Eval D0721-A.M.100.E-G.55 R:0.40127 P:0.26250 F:0.31738
55 ROUGE-1 Eval D0721-B.M.100.E-B.55 R:0.34853 P:0.22016 F:0.26986
55 ROUGE-1 Eval D0721-B.M.100.E-C.55 R:0.36624 P:0.23663 F:0.28750
55 ROUGE-1 Eval D0721-B.M.100.E-E.55 R:0.31475 P:0.19753 F:0.24273
55 ROUGE-1 Eval D0721-B.M.100.E-G.55 R:0.35806 P:0.22840 F:0.27890
55 ROUGE-1 Eval D0721-C.M.100.E-B.55 R:0.39016 P:0.26622 F:0.31649
55 ROUGE-1 Eval D0721-C.M.100.E-C.55 R:0.37954 P:0.25727 F:0.30667
55 ROUGE-1 Eval D0721-C.M.100.E-E.55 R:0.36667 P:0.24609 F:0.29452
55 ROUGE-1 Eval D0721-C.M.100.E-G.55 R:0.34528 P:0.23714 F:0.28117
55 ROUGE-1 Eval D0726-A.M.100.F-A.55 R:0.44186 P:0.27708 F:0.34059
55 ROUGE-1 Eval D0726-A.M.100.F-E.55 R:0.40000 P:0.25000 F:0.30769
55 ROUGE-1 Eval D0726-A.M.100.F-F.55 R:0.44518 P:0.27917 F:0.34315
55 ROUGE-1 Eval D0726-A.M.100.F-G.55 R:0.41860 P:0.26250 F:0.32266
55 ROUGE-1 Eval D0726-B.M.100.F-A.55 R:0.32353 P:0.20000 F:0.24719
55 ROUGE-1 Eval D0726-B.M.100.F-E.55 R:0.30897 P:0.18788 F:0.23367
55 ROUGE-1 Eval D0726-B.M.100.F-F.55 R:0.34551 P:0.21010 F:0.26130
55 ROUGE-1 Eval D0726-B.M.100.F-G.55 R:0.33882 P:0.20808 F:0.25782
55 ROUGE-1 Eval D0726-C.M.100.F-A.55 R:0.37333 P:0.23188 F:0.28608
55 ROUGE-1 Eval D0726-C.M.100.F-E.55 R:0.37710 P:0.23188 F:0.28718
55 ROUGE-1 Eval D0726-C.M.100.F-F.55 R:0.38644 P:0.23602 F:0.29306
55 ROUGE-1 Eval D0726-C.M.100.F-G.55 R:0.37705 P:0.23810 F:0.29188
55 ROUGE-1 Eval D0727-A.M.100.G-A.55 R:0.43189 P:0.24482 F:0.31250
55 ROUGE-1 Eval D0727-A.M.100.G-F.55 R:0.44408 P:0.25424 F:0.32336
55 ROUGE-1 Eval D0727-A.M.100.G-G.55 R:0.42810 P:0.24670 F:0.31302
55 ROUGE-1 Eval D0727-A.M.100.G-H.55 R:0.44408 P:0.25424 F:0.32336
55 ROUGE-1 Eval D0727-B.M.100.G-A.55 R:0.39863 P:0.22222 F:0.28536
55 ROUGE-1 Eval D0727-B.M.100.G-F.55 R:0.42532 P:0.25096 F:0.31566
55 ROUGE-1 Eval D0727-B.M.100.G-G.55 R:0.38754 P:0.21456 F:0.27620
55 ROUGE-1 Eval D0727-B.M.100.G-H.55 R:0.39519 P:0.22031 F:0.28291
55 ROUGE-1 Eval D0727-C.M.100.G-A.55 R:0.33876 P:0.19476 F:0.24733
55 ROUGE-1 Eval D0727-C.M.100.G-F.55 R:0.37374 P:0.20787 F:0.26715
55 ROUGE-1 Eval D0727-C.M.100.G-G.55 R:0.36634 P:0.20787 F:0.26524
55 ROUGE-1 Eval D0727-C.M.100.G-H.55 R:0.33784 P:0.18727 F:0.24097
55 ROUGE-1 Eval D0736-A.M.100.H-G.55 R:0.32975 P:0.18930 F:0.24052
55 ROUGE-1 Eval D0736-A.M.100.H-H.55 R:0.33942 P:0.19136 F:0.24474
55 ROUGE-1 Eval D0736-A.M.100.H-I.55 R:0.33808 P:0.19547 F:0.24772
55 ROUGE-1 Eval D0736-A.M.100.H-J.55 R:0.32026 P:0.20165 F:0.24748
55 ROUGE-1 Eval D0736-B.M.100.H-G.55 R:0.33588 P:0.16858 F:0.22449
55 ROUGE-1 Eval D0736-B.M.100.H-H.55 R:0.39669 P:0.18391 F:0.25131
55 ROUGE-1 Eval D0736-B.M.100.H-I.55 R:0.43933 P:0.20115 F:0.27595
55 ROUGE-1 Eval D0736-B.M.100.H-J.55 R:0.39510 P:0.21648 F:0.27971
55 ROUGE-1 Eval D0736-C.M.100.H-G.55 R:0.41350 P:0.18882 F:0.25925
55 ROUGE-1 Eval D0736-C.M.100.H-H.55 R:0.43316 P:0.15607 F:0.22946
55 ROUGE-1 Eval D0736-C.M.100.H-I.55 R:0.43316 P:0.15607 F:0.22946
55 ROUGE-1 Eval D0736-C.M.100.H-J.55 R:0.40000 P:0.20424 F:0.27041
55 ROUGE-1 Eval D0740-A.M.100.I-D.55 R:0.35644 P:0.22086 F:0.27273
55 ROUGE-1 Eval D0740-A.M.100.I-H.55 R:0.31373 P:0.19632 F:0.24151
55 ROUGE-1 Eval D0740-A.M.100.I-I.55 R:0.34740 P:0.21881 F:0.26850
55 ROUGE-1 Eval D0740-A.M.100.I-J.55 R:0.33226 P:0.21063 F:0.25782
55 ROUGE-1 Eval D0740-B.M.100.I-D.55 R:0.36364 P:0.23188 F:0.28318
55 ROUGE-1 Eval D0740-B.M.100.I-H.55 R:0.33444 P:0.20911 F:0.25733
55 ROUGE-1 Eval D0740-B.M.100.I-I.55 R:0.40656 P:0.25673 F:0.31472
55 ROUGE-1 Eval D0740-B.M.100.I-J.55 R:0.35599 P:0.22774 F:0.27778
55 ROUGE-1 Eval D0740-C.M.100.I-D.55 R:0.34185 P:0.22016 F:0.26783
55 ROUGE-1 Eval D0740-C.M.100.I-H.55 R:0.31833 P:0.20370 F:0.24843
55 ROUGE-1 Eval D0740-C.M.100.I-I.55 R:0.33866 P:0.21811 F:0.26533
55 ROUGE-1 Eval D0740-C.M.100.I-J.55 R:0.37261 P:0.24074 F:0.29250
55 ROUGE-1 Eval D0743-A.M.100.J-B.55 R:0.32381 P:0.19540 F:0.24373
55 ROUGE-1 Eval D0743-A.M.100.J-H.55 R:0.30556 P:0.18966 F:0.23405
55 ROUGE-1 Eval D0743-A.M.100.J-I.55 R:0.35313 P:0.21648 F:0.26841
55 ROUGE-1 Eval D0743-A.M.100.J-J.55 R:0.28000 P:0.17433 F:0.21488
55 ROUGE-1 Eval D0743-B.M.100.J-B.55 R:0.27885 P:0.17901 F:0.21804
55 ROUGE-1 Eval D0743-B.M.100.J-H.55 R:0.26814 P:0.17490 F:0.21171
55 ROUGE-1 Eval D0743-B.M.100.J-I.55 R:0.30063 P:0.19547 F:0.23690
55 ROUGE-1 Eval D0743-B.M.100.J-J.55 R:0.27103 P:0.17901 F:0.21561
55 ROUGE-1 Eval D0743-C.M.100.J-B.55 R:0.27937 P:0.17671 F:0.21649
55 ROUGE-1 Eval D0743-C.M.100.J-H.55 R:0.25478 P:0.16064 F:0.19704
55 ROUGE-1 Eval D0743-C.M.100.J-I.55 R:0.30032 P:0.18876 F:0.23182
55 ROUGE-1 Eval D0743-C.M.100.J-J.55 R:0.24214 P:0.15462 F:0.18873
---------------------------------------------
55 ROUGE-2 Average_R: 0.09902 (95%-conf.int. 0.09245 - 0.10595)
55 ROUGE-2 Average_P: 0.06020 (95%-conf.int. 0.05645 - 0.06403)
55 ROUGE-2 Average_F: 0.07468 (95%-conf.int. 0.06999 - 0.07962)
.............................................
55 ROUGE-2 Eval D0703-A.M.100.A-A.55 R:0.15700 P:0.09644 F:0.11948
55 ROUGE-2 Eval D0703-A.M.100.A-C.55 R:0.14237 P:0.08805 F:0.10881
55 ROUGE-2 Eval D0703-A.M.100.A-D.55 R:0.13194 P:0.07966 F:0.09934
55 ROUGE-2 Eval D0703-A.M.100.A-J.55 R:0.14433 P:0.08805 F:0.10937
55 ROUGE-2 Eval D0703-B.M.100.A-A.55 R:0.08911 P:0.05921 F:0.07115
55 ROUGE-2 Eval D0703-B.M.100.A-C.55 R:0.08814 P:0.05702 F:0.06924
55 ROUGE-2 Eval D0703-B.M.100.A-D.55 R:0.08814 P:0.05702 F:0.06924
55 ROUGE-2 Eval D0703-B.M.100.A-J.55 R:0.10738 P:0.07018 F:0.08488
55 ROUGE-2 Eval D0703-C.M.100.A-A.55 R:0.13805 P:0.09172 F:0.11021
55 ROUGE-2 Eval D0703-C.M.100.A-C.55 R:0.12459 P:0.08501 F:0.10106
55 ROUGE-2 Eval D0703-C.M.100.A-D.55 R:0.11706 P:0.07830 F:0.09383
55 ROUGE-2 Eval D0703-C.M.100.A-J.55 R:0.14047 P:0.09396 F:0.11260
55 ROUGE-2 Eval D0706-A.M.100.B-B.55 R:0.14754 P:0.09202 F:0.11335
55 ROUGE-2 Eval D0706-A.M.100.B-D.55 R:0.16502 P:0.10225 F:0.12626
55 ROUGE-2 Eval D0706-A.M.100.B-E.55 R:0.12787 P:0.07975 F:0.09823
55 ROUGE-2 Eval D0706-A.M.100.B-I.55 R:0.15082 P:0.09407 F:0.11587
55 ROUGE-2 Eval D0706-B.M.100.B-B.55 R:0.11551 P:0.07157 F:0.08838
55 ROUGE-2 Eval D0706-B.M.100.B-D.55 R:0.09868 P:0.06135 F:0.07566
55 ROUGE-2 Eval D0706-B.M.100.B-E.55 R:0.05574 P:0.03476 F:0.04282
55 ROUGE-2 Eval D0706-B.M.100.B-I.55 R:0.10458 P:0.06544 F:0.08050
55 ROUGE-2 Eval D0706-C.M.100.B-B.55 R:0.08795 P:0.05625 F:0.06862
55 ROUGE-2 Eval D0706-C.M.100.B-D.55 R:0.09772 P:0.06250 F:0.07624
55 ROUGE-2 Eval D0706-C.M.100.B-E.55 R:0.10680 P:0.06875 F:0.08365
55 ROUGE-2 Eval D0706-C.M.100.B-I.55 R:0.09677 P:0.06250 F:0.07595
55 ROUGE-2 Eval D0711-A.M.100.C-A.55 R:0.10631 P:0.07018 F:0.08455
55 ROUGE-2 Eval D0711-A.M.100.C-B.55 R:0.13131 P:0.08553 F:0.10359
55 ROUGE-2 Eval D0711-A.M.100.C-C.55 R:0.08754 P:0.05702 F:0.06906
55 ROUGE-2 Eval D0711-A.M.100.C-F.55 R:0.10702 P:0.07018 F:0.08477
55 ROUGE-2 Eval D0711-B.M.100.C-A.55 R:0.05155 P:0.03185 F:0.03937
55 ROUGE-2 Eval D0711-B.M.100.C-B.55 R:0.07612 P:0.04671 F:0.05789
55 ROUGE-2 Eval D0711-B.M.100.C-C.55 R:0.06102 P:0.03822 F:0.04700
55 ROUGE-2 Eval D0711-B.M.100.C-F.55 R:0.06849 P:0.04246 F:0.05242
55 ROUGE-2 Eval D0711-C.M.100.C-A.55 R:0.09000 P:0.05590 F:0.06897
55 ROUGE-2 Eval D0711-C.M.100.C-B.55 R:0.07931 P:0.04762 F:0.05951
55 ROUGE-2 Eval D0711-C.M.100.C-C.55 R:0.06826 P:0.04141 F:0.05155
55 ROUGE-2 Eval D0711-C.M.100.C-F.55 R:0.10922 P:0.06625 F:0.08247
55 ROUGE-2 Eval D0716-A.M.100.D-C.55 R:0.12914 P:0.08228 F:0.10052
55 ROUGE-2 Eval D0716-A.M.100.D-D.55 R:0.11111 P:0.06962 F:0.08560
55 ROUGE-2 Eval D0716-A.M.100.D-E.55 R:0.15436 P:0.09705 F:0.11917
55 ROUGE-2 Eval D0716-A.M.100.D-F.55 R:0.12667 P:0.08017 F:0.09819
55 ROUGE-2 Eval D0716-B.M.100.D-C.55 R:0.13621 P:0.08542 F:0.10500
55 ROUGE-2 Eval D0716-B.M.100.D-D.55 R:0.16610 P:0.10208 F:0.12645
55 ROUGE-2 Eval D0716-B.M.100.D-E.55 R:0.14430 P:0.08958 F:0.11054
55 ROUGE-2 Eval D0716-B.M.100.D-F.55 R:0.14815 P:0.09167 F:0.11326
55 ROUGE-2 Eval D0716-C.M.100.D-C.55 R:0.15461 P:0.09731 F:0.11944
55 ROUGE-2 Eval D0716-C.M.100.D-D.55 R:0.15541 P:0.09524 F:0.11810
55 ROUGE-2 Eval D0716-C.M.100.D-E.55 R:0.13333 P:0.08282 F:0.10217
55 ROUGE-2 Eval D0716-C.M.100.D-F.55 R:0.13805 P:0.08489 F:0.10513
55 ROUGE-2 Eval D0721-A.M.100.E-B.55 R:0.10101 P:0.06289 F:0.07752
55 ROUGE-2 Eval D0721-A.M.100.E-C.55 R:0.09836 P:0.06289 F:0.07672
55 ROUGE-2 Eval D0721-A.M.100.E-E.55 R:0.09836 P:0.06289 F:0.07672
55 ROUGE-2 Eval D0721-A.M.100.E-G.55 R:0.10611 P:0.06918 F:0.08375
55 ROUGE-2 Eval D0721-B.M.100.E-B.55 R:0.05921 P:0.03727 F:0.04575
55 ROUGE-2 Eval D0721-B.M.100.E-C.55 R:0.05788 P:0.03727 F:0.04534
55 ROUGE-2 Eval D0721-B.M.100.E-E.55 R:0.04305 P:0.02692 F:0.03313
55 ROUGE-2 Eval D0721-B.M.100.E-G.55 R:0.05537 P:0.03520 F:0.04304
55 ROUGE-2 Eval D0721-C.M.100.E-B.55 R:0.11589 P:0.07883 F:0.09383
55 ROUGE-2 Eval D0721-C.M.100.E-C.55 R:0.13000 P:0.08784 F:0.10484
55 ROUGE-2 Eval D0721-C.M.100.E-E.55 R:0.10101 P:0.06757 F:0.08097
55 ROUGE-2 Eval D0721-C.M.100.E-G.55 R:0.08224 P:0.05631 F:0.06685
55 ROUGE-2 Eval D0726-A.M.100.F-A.55 R:0.18792 P:0.11740 F:0.14452
55 ROUGE-2 Eval D0726-A.M.100.F-E.55 R:0.14478 P:0.09015 F:0.11111
55 ROUGE-2 Eval D0726-A.M.100.F-F.55 R:0.18456 P:0.11530 F:0.14193
55 ROUGE-2 Eval D0726-A.M.100.F-G.55 R:0.13758 P:0.08595 F:0.10580
55 ROUGE-2 Eval D0726-B.M.100.F-A.55 R:0.08581 P:0.05285 F:0.06541
55 ROUGE-2 Eval D0726-B.M.100.F-E.55 R:0.05369 P:0.03252 F:0.04051
55 ROUGE-2 Eval D0726-B.M.100.F-F.55 R:0.08389 P:0.05081 F:0.06329
55 ROUGE-2 Eval D0726-B.M.100.F-G.55 R:0.07641 P:0.04675 F:0.05801
55 ROUGE-2 Eval D0726-C.M.100.F-A.55 R:0.07407 P:0.04583 F:0.05662
55 ROUGE-2 Eval D0726-C.M.100.F-E.55 R:0.06463 P:0.03958 F:0.04909
55 ROUGE-2 Eval D0726-C.M.100.F-F.55 R:0.08219 P:0.05000 F:0.06218
55 ROUGE-2 Eval D0726-C.M.100.F-G.55 R:0.07285 P:0.04583 F:0.05626
55 ROUGE-2 Eval D0727-A.M.100.G-A.55 R:0.10738 P:0.06061 F:0.07748
55 ROUGE-2 Eval D0727-A.M.100.G-F.55 R:0.13289 P:0.07576 F:0.09650
55 ROUGE-2 Eval D0727-A.M.100.G-G.55 R:0.12211 P:0.07008 F:0.08905
55 ROUGE-2 Eval D0727-A.M.100.G-H.55 R:0.12625 P:0.07197 F:0.09168
55 ROUGE-2 Eval D0727-B.M.100.G-A.55 R:0.11111 P:0.06166 F:0.07931
55 ROUGE-2 Eval D0727-B.M.100.G-F.55 R:0.13115 P:0.07707 F:0.09709
55 ROUGE-2 Eval D0727-B.M.100.G-G.55 R:0.09441 P:0.05202 F:0.06708
55 ROUGE-2 Eval D0727-B.M.100.G-H.55 R:0.10417 P:0.05780 F:0.07435
55 ROUGE-2 Eval D0727-C.M.100.G-A.55 R:0.03289 P:0.01883 F:0.02395
55 ROUGE-2 Eval D0727-C.M.100.G-F.55 R:0.05102 P:0.02825 F:0.03636
55 ROUGE-2 Eval D0727-C.M.100.G-G.55 R:0.04667 P:0.02637 F:0.03370
55 ROUGE-2 Eval D0727-C.M.100.G-H.55 R:0.03072 P:0.01695 F:0.02185
55 ROUGE-2 Eval D0736-A.M.100.H-G.55 R:0.07971 P:0.04555 F:0.05797
55 ROUGE-2 Eval D0736-A.M.100.H-H.55 R:0.05904 P:0.03313 F:0.04244
55 ROUGE-2 Eval D0736-A.M.100.H-I.55 R:0.08273 P:0.04762 F:0.06045
55 ROUGE-2 Eval D0736-A.M.100.H-J.55 R:0.07591 P:0.04762 F:0.05853
55 ROUGE-2 Eval D0736-B.M.100.H-G.55 R:0.06564 P:0.03276 F:0.04371
55 ROUGE-2 Eval D0736-B.M.100.H-H.55 R:0.15900 P:0.07322 F:0.10027
55 ROUGE-2 Eval D0736-B.M.100.H-I.55 R:0.17373 P:0.07900 F:0.10861
55 ROUGE-2 Eval D0736-B.M.100.H-J.55 R:0.15901 P:0.08671 F:0.11222
55 ROUGE-2 Eval D0736-C.M.100.H-G.55 R:0.14530 P:0.06589 F:0.09067
55 ROUGE-2 Eval D0736-C.M.100.H-H.55 R:0.14130 P:0.05039 F:0.07429
55 ROUGE-2 Eval D0736-C.M.100.H-I.55 R:0.15217 P:0.05426 F:0.08000
55 ROUGE-2 Eval D0736-C.M.100.H-J.55 R:0.13359 P:0.06783 F:0.08998
55 ROUGE-2 Eval D0740-A.M.100.I-D.55 R:0.07667 P:0.04733 F:0.05853
55 ROUGE-2 Eval D0740-A.M.100.I-H.55 R:0.05281 P:0.03292 F:0.04056
55 ROUGE-2 Eval D0740-A.M.100.I-I.55 R:0.05902 P:0.03704 F:0.04552
55 ROUGE-2 Eval D0740-A.M.100.I-J.55 R:0.05863 P:0.03704 F:0.04540
55 ROUGE-2 Eval D0740-B.M.100.I-D.55 R:0.06557 P:0.04167 F:0.05096
55 ROUGE-2 Eval D0740-B.M.100.I-H.55 R:0.06020 P:0.03750 F:0.04621
55 ROUGE-2 Eval D0740-B.M.100.I-I.55 R:0.08609 P:0.05417 F:0.06650
55 ROUGE-2 Eval D0740-B.M.100.I-J.55 R:0.06536 P:0.04167 F:0.05089
55 ROUGE-2 Eval D0740-C.M.100.I-D.55 R:0.07742 P:0.04969 F:0.06053
55 ROUGE-2 Eval D0740-C.M.100.I-H.55 R:0.06169 P:0.03934 F:0.04804
55 ROUGE-2 Eval D0740-C.M.100.I-I.55 R:0.07419 P:0.04762 F:0.05801
55 ROUGE-2 Eval D0740-C.M.100.I-J.55 R:0.08682 P:0.05590 F:0.06801
55 ROUGE-2 Eval D0743-A.M.100.J-B.55 R:0.08974 P:0.05395 F:0.06739
55 ROUGE-2 Eval D0743-A.M.100.J-H.55 R:0.06542 P:0.04046 F:0.05000
55 ROUGE-2 Eval D0743-A.M.100.J-I.55 R:0.09464 P:0.05780 F:0.07177
55 ROUGE-2 Eval D0743-A.M.100.J-J.55 R:0.03416 P:0.02119 F:0.02616
55 ROUGE-2 Eval D0743-B.M.100.J-B.55 R:0.04854 P:0.03106 F:0.03788
55 ROUGE-2 Eval D0743-B.M.100.J-H.55 R:0.03185 P:0.02070 F:0.02509
55 ROUGE-2 Eval D0743-B.M.100.J-I.55 R:0.05431 P:0.03520 F:0.04272
55 ROUGE-2 Eval D0743-B.M.100.J-J.55 R:0.04717 P:0.03106 F:0.03746
55 ROUGE-2 Eval D0743-C.M.100.J-B.55 R:0.05128 P:0.03232 F:0.03965
55 ROUGE-2 Eval D0743-C.M.100.J-H.55 R:0.05466 P:0.03434 F:0.04218
55 ROUGE-2 Eval D0743-C.M.100.J-I.55 R:0.04839 P:0.03030 F:0.03727
55 ROUGE-2 Eval D0743-C.M.100.J-J.55 R:0.03810 P:0.02424 F:0.02963
---------------------------------------------
55 ROUGE-3 Average_R: 0.03903 (95%-conf.int. 0.03408 - 0.04379)
55 ROUGE-3 Average_P: 0.02342 (95%-conf.int. 0.02060 - 0.02609)
55 ROUGE-3 Average_F: 0.02918 (95%-conf.int. 0.02558 - 0.03255)
.............................................
55 ROUGE-3 Eval D0703-A.M.100.A-A.55 R:0.05517 P:0.03376 F:0.04189
55 ROUGE-3 Eval D0703-A.M.100.A-C.55 R:0.04795 P:0.02954 F:0.03656
55 ROUGE-3 Eval D0703-A.M.100.A-D.55 R:0.04561 P:0.02743 F:0.03426
55 ROUGE-3 Eval D0703-A.M.100.A-J.55 R:0.03819 P:0.02321 F:0.02887
55 ROUGE-3 Eval D0703-B.M.100.A-A.55 R:0.03000 P:0.01987 F:0.02391
55 ROUGE-3 Eval D0703-B.M.100.A-C.55 R:0.02055 P:0.01325 F:0.01611
55 ROUGE-3 Eval D0703-B.M.100.A-D.55 R:0.03082 P:0.01987 F:0.02416
55 ROUGE-3 Eval D0703-B.M.100.A-J.55 R:0.04068 P:0.02649 F:0.03209
55 ROUGE-3 Eval D0703-C.M.100.A-A.55 R:0.04762 P:0.03153 F:0.03794
55 ROUGE-3 Eval D0703-C.M.100.A-C.55 R:0.04305 P:0.02928 F:0.03485
55 ROUGE-3 Eval D0703-C.M.100.A-D.55 R:0.04054 P:0.02703 F:0.03243
55 ROUGE-3 Eval D0703-C.M.100.A-J.55 R:0.05068 P:0.03378 F:0.04054
55 ROUGE-3 Eval D0706-A.M.100.B-B.55 R:0.06291 P:0.03909 F:0.04822
55 ROUGE-3 Eval D0706-A.M.100.B-D.55 R:0.08000 P:0.04938 F:0.06107
55 ROUGE-3 Eval D0706-A.M.100.B-E.55 R:0.04305 P:0.02675 F:0.03300
55 ROUGE-3 Eval D0706-A.M.100.B-I.55 R:0.07285 P:0.04527 F:0.05584
55 ROUGE-3 Eval D0706-B.M.100.B-B.55 R:0.04000 P:0.02469 F:0.03053
55 ROUGE-3 Eval D0706-B.M.100.B-D.55 R:0.03654 P:0.02263 F:0.02795
55 ROUGE-3 Eval D0706-B.M.100.B-E.55 R:0.00331 P:0.00206 F:0.00254
55 ROUGE-3 Eval D0706-B.M.100.B-I.55 R:0.03960 P:0.02469 F:0.03042
55 ROUGE-3 Eval D0706-C.M.100.B-B.55 R:0.02632 P:0.01677 F:0.02049
55 ROUGE-3 Eval D0706-C.M.100.B-D.55 R:0.02632 P:0.01677 F:0.02049
55 ROUGE-3 Eval D0706-C.M.100.B-E.55 R:0.03268 P:0.02096 F:0.02554
55 ROUGE-3 Eval D0706-C.M.100.B-I.55 R:0.02280 P:0.01468 F:0.01786
55 ROUGE-3 Eval D0711-A.M.100.C-A.55 R:0.04027 P:0.02649 F:0.03196
55 ROUGE-3 Eval D0711-A.M.100.C-B.55 R:0.04762 P:0.03091 F:0.03749
55 ROUGE-3 Eval D0711-A.M.100.C-C.55 R:0.02041 P:0.01325 F:0.01607
55 ROUGE-3 Eval D0711-A.M.100.C-F.55 R:0.03378 P:0.02208 F:0.02670
55 ROUGE-3 Eval D0711-B.M.100.C-A.55 R:0.00694 P:0.00427 F:0.00529
55 ROUGE-3 Eval D0711-B.M.100.C-B.55 R:0.01748 P:0.01068 F:0.01326
55 ROUGE-3 Eval D0711-B.M.100.C-C.55 R:0.01027 P:0.00641 F:0.00789
55 ROUGE-3 Eval D0711-B.M.100.C-F.55 R:0.01730 P:0.01068 F:0.01321
55 ROUGE-3 Eval D0711-C.M.100.C-A.55 R:0.04377 P:0.02708 F:0.03346
55 ROUGE-3 Eval D0711-C.M.100.C-B.55 R:0.03833 P:0.02292 F:0.02869
55 ROUGE-3 Eval D0711-C.M.100.C-C.55 R:0.03448 P:0.02083 F:0.02597
55 ROUGE-3 Eval D0711-C.M.100.C-F.55 R:0.05862 P:0.03542 F:0.04416
55 ROUGE-3 Eval D0716-A.M.100.D-C.55 R:0.05017 P:0.03185 F:0.03896
55 ROUGE-3 Eval D0716-A.M.100.D-D.55 R:0.03401 P:0.02123 F:0.02614
55 ROUGE-3 Eval D0716-A.M.100.D-E.55 R:0.05424 P:0.03397 F:0.04178
55 ROUGE-3 Eval D0716-A.M.100.D-F.55 R:0.04377 P:0.02760 F:0.03385
55 ROUGE-3 Eval D0716-B.M.100.D-C.55 R:0.04698 P:0.02935 F:0.03613
55 ROUGE-3 Eval D0716-B.M.100.D-D.55 R:0.07534 P:0.04612 F:0.05722
55 ROUGE-3 Eval D0716-B.M.100.D-E.55 R:0.06102 P:0.03774 F:0.04664
55 ROUGE-3 Eval D0716-B.M.100.D-F.55 R:0.06122 P:0.03774 F:0.04669
55 ROUGE-3 Eval D0716-C.M.100.D-C.55 R:0.08970 P:0.05625 F:0.06914
55 ROUGE-3 Eval D0716-C.M.100.D-D.55 R:0.08532 P:0.05208 F:0.06468
55 ROUGE-3 Eval D0716-C.M.100.D-E.55 R:0.05724 P:0.03542 F:0.04376
55 ROUGE-3 Eval D0716-C.M.100.D-F.55 R:0.08163 P:0.05000 F:0.06201
55 ROUGE-3 Eval D0721-A.M.100.E-B.55 R:0.01701 P:0.01055 F:0.01302
55 ROUGE-3 Eval D0721-A.M.100.E-C.55 R:0.02649 P:0.01688 F:0.02062
55 ROUGE-3 Eval D0721-A.M.100.E-E.55 R:0.01987 P:0.01266 F:0.01547
55 ROUGE-3 Eval D0721-A.M.100.E-G.55 R:0.02597 P:0.01688 F:0.02046
55 ROUGE-3 Eval D0721-B.M.100.E-B.55 R:0.00332 P:0.00208 F:0.00256
55 ROUGE-3 Eval D0721-B.M.100.E-C.55 R:0.00325 P:0.00208 F:0.00254
55 ROUGE-3 Eval D0721-B.M.100.E-E.55 R:0.00334 P:0.00208 F:0.00256
55 ROUGE-3 Eval D0721-B.M.100.E-G.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-3 Eval D0721-C.M.100.E-B.55 R:0.07692 P:0.05215 F:0.06216
55 ROUGE-3 Eval D0721-C.M.100.E-C.55 R:0.08754 P:0.05896 F:0.07046
55 ROUGE-3 Eval D0721-C.M.100.E-E.55 R:0.07143 P:0.04762 F:0.05714
55 ROUGE-3 Eval D0721-C.M.100.E-G.55 R:0.04651 P:0.03175 F:0.03774
55 ROUGE-3 Eval D0726-A.M.100.F-A.55 R:0.13220 P:0.08228 F:0.10143
55 ROUGE-3 Eval D0726-A.M.100.F-E.55 R:0.09524 P:0.05907 F:0.07292
55 ROUGE-3 Eval D0726-A.M.100.F-F.55 R:0.12203 P:0.07595 F:0.09363
55 ROUGE-3 Eval D0726-A.M.100.F-G.55 R:0.07797 P:0.04852 F:0.05982
55 ROUGE-3 Eval D0726-B.M.100.F-A.55 R:0.03333 P:0.02045 F:0.02535
55 ROUGE-3 Eval D0726-B.M.100.F-E.55 R:0.00678 P:0.00409 F:0.00510
55 ROUGE-3 Eval D0726-B.M.100.F-F.55 R:0.03390 P:0.02045 F:0.02551
55 ROUGE-3 Eval D0726-B.M.100.F-G.55 R:0.02685 P:0.01636 F:0.02033
55 ROUGE-3 Eval D0726-C.M.100.F-A.55 R:0.03741 P:0.02306 F:0.02853
55 ROUGE-3 Eval D0726-C.M.100.F-E.55 R:0.02405 P:0.01468 F:0.01823
55 ROUGE-3 Eval D0726-C.M.100.F-F.55 R:0.03806 P:0.02306 F:0.02872
55 ROUGE-3 Eval D0726-C.M.100.F-G.55 R:0.03344 P:0.02096 F:0.02577
55 ROUGE-3 Eval D0727-A.M.100.G-A.55 R:0.02373 P:0.01333 F:0.01707
55 ROUGE-3 Eval D0727-A.M.100.G-F.55 R:0.04698 P:0.02667 F:0.03402
55 ROUGE-3 Eval D0727-A.M.100.G-G.55 R:0.03667 P:0.02095 F:0.02667
55 ROUGE-3 Eval D0727-A.M.100.G-H.55 R:0.04362 P:0.02476 F:0.03159
55 ROUGE-3 Eval D0727-B.M.100.G-A.55 R:0.04912 P:0.02713 F:0.03495
55 ROUGE-3 Eval D0727-B.M.100.G-F.55 R:0.05298 P:0.03101 F:0.03912
55 ROUGE-3 Eval D0727-B.M.100.G-G.55 R:0.03534 P:0.01938 F:0.02503
55 ROUGE-3 Eval D0727-B.M.100.G-H.55 R:0.03860 P:0.02132 F:0.02747
55 ROUGE-3 Eval D0727-C.M.100.G-A.55 R:0.00332 P:0.00189 F:0.00241
55 ROUGE-3 Eval D0727-C.M.100.G-F.55 R:0.01031 P:0.00568 F:0.00732
55 ROUGE-3 Eval D0727-C.M.100.G-G.55 R:0.01010 P:0.00568 F:0.00727
55 ROUGE-3 Eval D0727-C.M.100.G-H.55 R:0.00690 P:0.00379 F:0.00489
55 ROUGE-3 Eval D0736-A.M.100.H-G.55 R:0.02198 P:0.01250 F:0.01594
55 ROUGE-3 Eval D0736-A.M.100.H-H.55 R:0.00373 P:0.00208 F:0.00267
55 ROUGE-3 Eval D0736-A.M.100.H-I.55 R:0.01818 P:0.01042 F:0.01325
55 ROUGE-3 Eval D0736-A.M.100.H-J.55 R:0.02000 P:0.01250 F:0.01538
55 ROUGE-3 Eval D0736-B.M.100.H-G.55 R:0.02734 P:0.01357 F:0.01814
55 ROUGE-3 Eval D0736-B.M.100.H-H.55 R:0.11864 P:0.05426 F:0.07446
55 ROUGE-3 Eval D0736-B.M.100.H-I.55 R:0.13305 P:0.06008 F:0.08278
55 ROUGE-3 Eval D0736-B.M.100.H-J.55 R:0.11786 P:0.06395 F:0.08291
55 ROUGE-3 Eval D0736-C.M.100.H-G.55 R:0.06926 P:0.03119 F:0.04301
55 ROUGE-3 Eval D0736-C.M.100.H-H.55 R:0.05525 P:0.01949 F:0.02882
55 ROUGE-3 Eval D0736-C.M.100.H-I.55 R:0.07735 P:0.02729 F:0.04035
55 ROUGE-3 Eval D0736-C.M.100.H-J.55 R:0.05405 P:0.02729 F:0.03627
55 ROUGE-3 Eval D0740-A.M.100.I-D.55 R:0.02020 P:0.01242 F:0.01538
55 ROUGE-3 Eval D0740-A.M.100.I-H.55 R:0.01667 P:0.01035 F:0.01277
55 ROUGE-3 Eval D0740-A.M.100.I-I.55 R:0.00993 P:0.00621 F:0.00764
55 ROUGE-3 Eval D0740-A.M.100.I-J.55 R:0.01316 P:0.00828 F:0.01016
55 ROUGE-3 Eval D0740-B.M.100.I-D.55 R:0.00993 P:0.00629 F:0.00770
55 ROUGE-3 Eval D0740-B.M.100.I-H.55 R:0.01351 P:0.00839 F:0.01035
55 ROUGE-3 Eval D0740-B.M.100.I-I.55 R:0.02007 P:0.01258 F:0.01547
55 ROUGE-3 Eval D0740-B.M.100.I-J.55 R:0.01650 P:0.01048 F:0.01282
55 ROUGE-3 Eval D0740-C.M.100.I-D.55 R:0.02606 P:0.01667 F:0.02033
55 ROUGE-3 Eval D0740-C.M.100.I-H.55 R:0.00984 P:0.00625 F:0.00764
55 ROUGE-3 Eval D0740-C.M.100.I-I.55 R:0.02280 P:0.01458 F:0.01779
55 ROUGE-3 Eval D0740-C.M.100.I-J.55 R:0.02922 P:0.01875 F:0.02284
55 ROUGE-3 Eval D0743-A.M.100.J-B.55 R:0.04854 P:0.02907 F:0.03636
55 ROUGE-3 Eval D0743-A.M.100.J-H.55 R:0.03774 P:0.02326 F:0.02878
55 ROUGE-3 Eval D0743-A.M.100.J-I.55 R:0.04777 P:0.02907 F:0.03614
55 ROUGE-3 Eval D0743-A.M.100.J-J.55 R:0.00940 P:0.00581 F:0.00718
55 ROUGE-3 Eval D0743-B.M.100.J-B.55 R:0.01961 P:0.01250 F:0.01527
55 ROUGE-3 Eval D0743-B.M.100.J-H.55 R:0.00643 P:0.00417 F:0.00506
55 ROUGE-3 Eval D0743-B.M.100.J-I.55 R:0.01935 P:0.01250 F:0.01519
55 ROUGE-3 Eval D0743-B.M.100.J-J.55 R:0.02222 P:0.01458 F:0.01761
55 ROUGE-3 Eval D0743-C.M.100.J-B.55 R:0.01618 P:0.01016 F:0.01248
55 ROUGE-3 Eval D0743-C.M.100.J-H.55 R:0.01948 P:0.01220 F:0.01500
55 ROUGE-3 Eval D0743-C.M.100.J-I.55 R:0.01629 P:0.01016 F:0.01251
55 ROUGE-3 Eval D0743-C.M.100.J-J.55 R:0.00641 P:0.00407 F:0.00498
---------------------------------------------
55 ROUGE-4 Average_R: 0.02071 (95%-conf.int. 0.01687 - 0.02485)
55 ROUGE-4 Average_P: 0.01221 (95%-conf.int. 0.01001 - 0.01448)
55 ROUGE-4 Average_F: 0.01530 (95%-conf.int. 0.01251 - 0.01819)
.............................................
55 ROUGE-4 Eval D0703-A.M.100.A-A.55 R:0.02439 P:0.01486 F:0.01847
55 ROUGE-4 Eval D0703-A.M.100.A-C.55 R:0.02076 P:0.01274 F:0.01579
55 ROUGE-4 Eval D0703-A.M.100.A-D.55 R:0.02128 P:0.01274 F:0.01594
55 ROUGE-4 Eval D0703-A.M.100.A-J.55 R:0.00702 P:0.00425 F:0.00529
55 ROUGE-4 Eval D0703-B.M.100.A-A.55 R:0.01684 P:0.01111 F:0.01339
55 ROUGE-4 Eval D0703-B.M.100.A-C.55 R:0.00692 P:0.00444 F:0.00541
55 ROUGE-4 Eval D0703-B.M.100.A-D.55 R:0.01730 P:0.01111 F:0.01353
55 ROUGE-4 Eval D0703-B.M.100.A-J.55 R:0.02055 P:0.01333 F:0.01617
55 ROUGE-4 Eval D0703-C.M.100.A-A.55 R:0.02062 P:0.01361 F:0.01640
55 ROUGE-4 Eval D0703-C.M.100.A-C.55 R:0.01672 P:0.01134 F:0.01351
55 ROUGE-4 Eval D0703-C.M.100.A-D.55 R:0.01706 P:0.01134 F:0.01362
55 ROUGE-4 Eval D0703-C.M.100.A-J.55 R:0.02730 P:0.01814 F:0.02180
55 ROUGE-4 Eval D0706-A.M.100.B-B.55 R:0.03679 P:0.02277 F:0.02813
55 ROUGE-4 Eval D0706-A.M.100.B-D.55 R:0.05051 P:0.03106 F:0.03847
55 ROUGE-4 Eval D0706-A.M.100.B-E.55 R:0.02341 P:0.01449 F:0.01790
55 ROUGE-4 Eval D0706-A.M.100.B-I.55 R:0.04013 P:0.02484 F:0.03069
55 ROUGE-4 Eval D0706-B.M.100.B-B.55 R:0.02694 P:0.01656 F:0.02051
55 ROUGE-4 Eval D0706-B.M.100.B-D.55 R:0.02685 P:0.01656 F:0.02049
55 ROUGE-4 Eval D0706-B.M.100.B-E.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0706-B.M.100.B-I.55 R:0.02667 P:0.01656 F:0.02043
55 ROUGE-4 Eval D0706-C.M.100.B-B.55 R:0.01329 P:0.00844 F:0.01032
55 ROUGE-4 Eval D0706-C.M.100.B-D.55 R:0.01329 P:0.00844 F:0.01032
55 ROUGE-4 Eval D0706-C.M.100.B-E.55 R:0.01980 P:0.01266 F:0.01544
55 ROUGE-4 Eval D0706-C.M.100.B-I.55 R:0.01316 P:0.00844 F:0.01028
55 ROUGE-4 Eval D0711-A.M.100.C-A.55 R:0.01356 P:0.00889 F:0.01074
55 ROUGE-4 Eval D0711-A.M.100.C-B.55 R:0.01375 P:0.00889 F:0.01080
55 ROUGE-4 Eval D0711-A.M.100.C-C.55 R:0.00344 P:0.00222 F:0.00270
55 ROUGE-4 Eval D0711-A.M.100.C-F.55 R:0.01024 P:0.00667 F:0.00808
55 ROUGE-4 Eval D0711-B.M.100.C-A.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0711-B.M.100.C-B.55 R:0.00353 P:0.00215 F:0.00267
55 ROUGE-4 Eval D0711-B.M.100.C-C.55 R:0.00346 P:0.00215 F:0.00265
55 ROUGE-4 Eval D0711-B.M.100.C-F.55 R:0.00350 P:0.00215 F:0.00266
55 ROUGE-4 Eval D0711-C.M.100.C-A.55 R:0.02721 P:0.01677 F:0.02075
55 ROUGE-4 Eval D0711-C.M.100.C-B.55 R:0.02465 P:0.01468 F:0.01840
55 ROUGE-4 Eval D0711-C.M.100.C-C.55 R:0.02439 P:0.01468 F:0.01833
55 ROUGE-4 Eval D0711-C.M.100.C-F.55 R:0.03833 P:0.02306 F:0.02880
55 ROUGE-4 Eval D0716-A.M.100.D-C.55 R:0.01689 P:0.01068 F:0.01309
55 ROUGE-4 Eval D0716-A.M.100.D-D.55 R:0.01031 P:0.00641 F:0.00791
55 ROUGE-4 Eval D0716-A.M.100.D-E.55 R:0.02055 P:0.01282 F:0.01579
55 ROUGE-4 Eval D0716-A.M.100.D-F.55 R:0.01361 P:0.00855 F:0.01050
55 ROUGE-4 Eval D0716-B.M.100.D-C.55 R:0.01695 P:0.01055 F:0.01301
55 ROUGE-4 Eval D0716-B.M.100.D-D.55 R:0.03460 P:0.02110 F:0.02621
55 ROUGE-4 Eval D0716-B.M.100.D-E.55 R:0.02740 P:0.01688 F:0.02089
55 ROUGE-4 Eval D0716-B.M.100.D-F.55 R:0.02405 P:0.01477 F:0.01830
55 ROUGE-4 Eval D0716-C.M.100.D-C.55 R:0.05034 P:0.03145 F:0.03871
55 ROUGE-4 Eval D0716-C.M.100.D-D.55 R:0.04483 P:0.02725 F:0.03390
55 ROUGE-4 Eval D0716-C.M.100.D-E.55 R:0.01361 P:0.00839 F:0.01038
55 ROUGE-4 Eval D0716-C.M.100.D-F.55 R:0.04467 P:0.02725 F:0.03385
55 ROUGE-4 Eval D0721-A.M.100.E-B.55 R:0.00344 P:0.00212 F:0.00262
55 ROUGE-4 Eval D0721-A.M.100.E-C.55 R:0.00669 P:0.00425 F:0.00520
55 ROUGE-4 Eval D0721-A.M.100.E-E.55 R:0.00334 P:0.00212 F:0.00259
55 ROUGE-4 Eval D0721-A.M.100.E-G.55 R:0.00656 P:0.00425 F:0.00516
55 ROUGE-4 Eval D0721-B.M.100.E-B.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0721-B.M.100.E-C.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0721-B.M.100.E-E.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0721-B.M.100.E-G.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0721-C.M.100.E-B.55 R:0.06081 P:0.04110 F:0.04905
55 ROUGE-4 Eval D0721-C.M.100.E-C.55 R:0.06803 P:0.04566 F:0.05464
55 ROUGE-4 Eval D0721-C.M.100.E-E.55 R:0.05498 P:0.03653 F:0.04390
55 ROUGE-4 Eval D0721-C.M.100.E-G.55 R:0.03020 P:0.02055 F:0.02446
55 ROUGE-4 Eval D0726-A.M.100.F-A.55 R:0.10616 P:0.06582 F:0.08126
55 ROUGE-4 Eval D0726-A.M.100.F-E.55 R:0.07216 P:0.04459 F:0.05512
55 ROUGE-4 Eval D0726-A.M.100.F-F.55 R:0.09589 P:0.05945 F:0.07340
55 ROUGE-4 Eval D0726-A.M.100.F-G.55 R:0.05479 P:0.03397 F:0.04194
55 ROUGE-4 Eval D0726-B.M.100.F-A.55 R:0.01684 P:0.01029 F:0.01277
55 ROUGE-4 Eval D0726-B.M.100.F-E.55 R:0.00342 P:0.00206 F:0.00257
55 ROUGE-4 Eval D0726-B.M.100.F-F.55 R:0.01712 P:0.01029 F:0.01285
55 ROUGE-4 Eval D0726-B.M.100.F-G.55 R:0.01356 P:0.00823 F:0.01024
55 ROUGE-4 Eval D0726-C.M.100.F-A.55 R:0.01375 P:0.00844 F:0.01046
55 ROUGE-4 Eval D0726-C.M.100.F-E.55 R:0.00347 P:0.00211 F:0.00262
55 ROUGE-4 Eval D0726-C.M.100.F-F.55 R:0.01399 P:0.00844 F:0.01053
55 ROUGE-4 Eval D0726-C.M.100.F-G.55 R:0.01014 P:0.00633 F:0.00779
55 ROUGE-4 Eval D0727-A.M.100.G-A.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0727-A.M.100.G-F.55 R:0.01695 P:0.00958 F:0.01224
55 ROUGE-4 Eval D0727-A.M.100.G-G.55 R:0.01684 P:0.00958 F:0.01221
55 ROUGE-4 Eval D0727-A.M.100.G-H.55 R:0.01695 P:0.00958 F:0.01224
55 ROUGE-4 Eval D0727-B.M.100.G-A.55 R:0.02837 P:0.01559 F:0.02012
55 ROUGE-4 Eval D0727-B.M.100.G-F.55 R:0.03010 P:0.01754 F:0.02216
55 ROUGE-4 Eval D0727-B.M.100.G-G.55 R:0.01786 P:0.00975 F:0.01261
55 ROUGE-4 Eval D0727-B.M.100.G-H.55 R:0.01773 P:0.00975 F:0.01258
55 ROUGE-4 Eval D0727-C.M.100.G-A.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0727-C.M.100.G-F.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0727-C.M.100.G-G.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0727-C.M.100.G-H.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0736-A.M.100.H-G.55 R:0.00741 P:0.00419 F:0.00535
55 ROUGE-4 Eval D0736-A.M.100.H-H.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0736-A.M.100.H-I.55 R:0.00735 P:0.00419 F:0.00534
55 ROUGE-4 Eval D0736-A.M.100.H-J.55 R:0.00673 P:0.00419 F:0.00516
55 ROUGE-4 Eval D0736-B.M.100.H-G.55 R:0.01581 P:0.00780 F:0.01045
55 ROUGE-4 Eval D0736-B.M.100.H-H.55 R:0.09871 P:0.04483 F:0.06166
55 ROUGE-4 Eval D0736-B.M.100.H-I.55 R:0.10870 P:0.04873 F:0.06729
55 ROUGE-4 Eval D0736-B.M.100.H-J.55 R:0.09386 P:0.05068 F:0.06582
55 ROUGE-4 Eval D0736-C.M.100.H-G.55 R:0.04825 P:0.02157 F:0.02981
55 ROUGE-4 Eval D0736-C.M.100.H-H.55 R:0.03371 P:0.01176 F:0.01744
55 ROUGE-4 Eval D0736-C.M.100.H-I.55 R:0.05618 P:0.01961 F:0.02907
55 ROUGE-4 Eval D0736-C.M.100.H-J.55 R:0.03516 P:0.01765 F:0.02350
55 ROUGE-4 Eval D0740-A.M.100.I-D.55 R:0.00680 P:0.00417 F:0.00517
55 ROUGE-4 Eval D0740-A.M.100.I-H.55 R:0.00673 P:0.00417 F:0.00515
55 ROUGE-4 Eval D0740-A.M.100.I-I.55 R:0.00334 P:0.00208 F:0.00256
55 ROUGE-4 Eval D0740-A.M.100.I-J.55 R:0.00332 P:0.00208 F:0.00256
55 ROUGE-4 Eval D0740-B.M.100.I-D.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0740-B.M.100.I-H.55 R:0.00341 P:0.00211 F:0.00261
55 ROUGE-4 Eval D0740-B.M.100.I-I.55 R:0.00338 P:0.00211 F:0.00260
55 ROUGE-4 Eval D0740-B.M.100.I-J.55 R:0.00333 P:0.00211 F:0.00258
55 ROUGE-4 Eval D0740-C.M.100.I-D.55 R:0.01316 P:0.00839 F:0.01025
55 ROUGE-4 Eval D0740-C.M.100.I-H.55 R:0.00331 P:0.00210 F:0.00257
55 ROUGE-4 Eval D0740-C.M.100.I-I.55 R:0.00987 P:0.00629 F:0.00768
55 ROUGE-4 Eval D0740-C.M.100.I-J.55 R:0.01311 P:0.00839 F:0.01023
55 ROUGE-4 Eval D0743-A.M.100.J-B.55 R:0.02941 P:0.01754 F:0.02197
55 ROUGE-4 Eval D0743-A.M.100.J-H.55 R:0.02857 P:0.01754 F:0.02174
55 ROUGE-4 Eval D0743-A.M.100.J-I.55 R:0.02894 P:0.01754 F:0.02184
55 ROUGE-4 Eval D0743-A.M.100.J-J.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0743-B.M.100.J-B.55 R:0.00660 P:0.00419 F:0.00513
55 ROUGE-4 Eval D0743-B.M.100.J-H.55 R:0.00000 P:0.00000 F:0.00000
55 ROUGE-4 Eval D0743-B.M.100.J-I.55 R:0.00651 P:0.00419 F:0.00510
55 ROUGE-4 Eval D0743-B.M.100.J-J.55 R:0.00641 P:0.00419 F:0.00507
55 ROUGE-4 Eval D0743-C.M.100.J-B.55 R:0.00327 P:0.00204 F:0.00251
55 ROUGE-4 Eval D0743-C.M.100.J-H.55 R:0.00328 P:0.00204 F:0.00252
55 ROUGE-4 Eval D0743-C.M.100.J-I.55 R:0.00329 P:0.00204 F:0.00252
55 ROUGE-4 Eval D0743-C.M.100.J-J.55 R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
55 ROUGE-L Average_R: 0.33008 (95%-conf.int. 0.32172 - 0.33849)
55 ROUGE-L Average_P: 0.20213 (95%-conf.int. 0.19703 - 0.20721)
55 ROUGE-L Average_F: 0.25020 (95%-conf.int. 0.24408 - 0.25623)
.............................................
55 ROUGE-L Eval D0703-A.M.100.A-A.55 R:0.38851 P:0.23958 F:0.29639
55 ROUGE-L Eval D0703-A.M.100.A-C.55 R:0.35570 P:0.22083 F:0.27249
55 ROUGE-L Eval D0703-A.M.100.A-D.55 R:0.35395 P:0.21458 F:0.26718
55 ROUGE-L Eval D0703-A.M.100.A-J.55 R:0.36735 P:0.22500 F:0.27907
55 ROUGE-L Eval D0703-B.M.100.A-A.55 R:0.31699 P:0.21133 F:0.25359
55 ROUGE-L Eval D0703-B.M.100.A-C.55 R:0.33557 P:0.21786 F:0.26420
55 ROUGE-L Eval D0703-B.M.100.A-D.55 R:0.31879 P:0.20697 F:0.25099
55 ROUGE-L Eval D0703-B.M.100.A-J.55 R:0.33555 P:0.22004 F:0.26579
55 ROUGE-L Eval D0703-C.M.100.A-A.55 R:0.35333 P:0.23556 F:0.28267
55 ROUGE-L Eval D0703-C.M.100.A-C.55 R:0.33766 P:0.23111 F:0.27440
55 ROUGE-L Eval D0703-C.M.100.A-D.55 R:0.33113 P:0.22222 F:0.26596
55 ROUGE-L Eval D0703-C.M.100.A-J.55 R:0.36424 P:0.24444 F:0.29255
55 ROUGE-L Eval D0706-A.M.100.B-B.55 R:0.36688 P:0.22967 F:0.28250
55 ROUGE-L Eval D0706-A.M.100.B-D.55 R:0.37908 P:0.23577 F:0.29072
55 ROUGE-L Eval D0706-A.M.100.B-E.55 R:0.33117 P:0.20732 F:0.25500
55 ROUGE-L Eval D0706-A.M.100.B-I.55 R:0.35714 P:0.22358 F:0.27500
55 ROUGE-L Eval D0706-B.M.100.B-B.55 R:0.34314 P:0.21341 F:0.26316
55 ROUGE-L Eval D0706-B.M.100.B-D.55 R:0.33225 P:0.20732 F:0.25532
55 ROUGE-L Eval D0706-B.M.100.B-E.55 R:0.30844 P:0.19309 F:0.23750
55 ROUGE-L Eval D0706-B.M.100.B-I.55 R:0.34304 P:0.21545 F:0.26467
55 ROUGE-L Eval D0706-C.M.100.B-B.55 R:0.32903 P:0.21118 F:0.25725
55 ROUGE-L Eval D0706-C.M.100.B-D.55 R:0.33226 P:0.21325 F:0.25977
55 ROUGE-L Eval D0706-C.M.100.B-E.55 R:0.34295 P:0.22153 F:0.26918
55 ROUGE-L Eval D0706-C.M.100.B-I.55 R:0.33546 P:0.21739 F:0.26382
55 ROUGE-L Eval D0711-A.M.100.C-A.55 R:0.32237 P:0.21351 F:0.25688
55 ROUGE-L Eval D0711-A.M.100.C-B.55 R:0.35000 P:0.22876 F:0.27668
55 ROUGE-L Eval D0711-A.M.100.C-C.55 R:0.32333 P:0.21133 F:0.25560
55 ROUGE-L Eval D0711-A.M.100.C-F.55 R:0.34768 P:0.22876 F:0.27595
55 ROUGE-L Eval D0711-B.M.100.C-A.55 R:0.29592 P:0.18354 F:0.22656
55 ROUGE-L Eval D0711-B.M.100.C-B.55 R:0.30822 P:0.18987 F:0.23498
55 ROUGE-L Eval D0711-B.M.100.C-C.55 R:0.28188 P:0.17722 F:0.21762
55 ROUGE-L Eval D0711-B.M.100.C-F.55 R:0.32542 P:0.20253 F:0.24967
55 ROUGE-L Eval D0711-C.M.100.C-A.55 R:0.33663 P:0.20988 F:0.25856
55 ROUGE-L Eval D0711-C.M.100.C-B.55 R:0.33788 P:0.20370 F:0.25417
55 ROUGE-L Eval D0711-C.M.100.C-C.55 R:0.32432 P:0.19753 F:0.24552
55 ROUGE-L Eval D0711-C.M.100.C-F.55 R:0.35473 P:0.21605 F:0.26854
55 ROUGE-L Eval D0716-A.M.100.D-C.55 R:0.34754 P:0.22222 F:0.27110
55 ROUGE-L Eval D0716-A.M.100.D-D.55 R:0.30667 P:0.19287 F:0.23681
55 ROUGE-L Eval D0716-A.M.100.D-E.55 R:0.36545 P:0.23061 F:0.28278
55 ROUGE-L Eval D0716-A.M.100.D-F.55 R:0.34983 P:0.22222 F:0.27179
55 ROUGE-L Eval D0716-B.M.100.D-C.55 R:0.38816 P:0.24431 F:0.29988
55 ROUGE-L Eval D0716-B.M.100.D-D.55 R:0.41275 P:0.25466 F:0.31498
55 ROUGE-L Eval D0716-B.M.100.D-E.55 R:0.39867 P:0.24845 F:0.30612
55 ROUGE-L Eval D0716-B.M.100.D-F.55 R:0.40667 P:0.25259 F:0.31162
55 ROUGE-L Eval D0716-C.M.100.D-C.55 R:0.41042 P:0.25926 F:0.31778
55 ROUGE-L Eval D0716-C.M.100.D-D.55 R:0.42140 P:0.25926 F:0.32102
55 ROUGE-L Eval D0716-C.M.100.D-E.55 R:0.39274 P:0.24486 F:0.30165
55 ROUGE-L Eval D0716-C.M.100.D-F.55 R:0.40333 P:0.24897 F:0.30789
55 ROUGE-L Eval D0721-A.M.100.E-B.55 R:0.34333 P:0.21458 F:0.26410
55 ROUGE-L Eval D0721-A.M.100.E-C.55 R:0.33766 P:0.21667 F:0.26396
55 ROUGE-L Eval D0721-A.M.100.E-E.55 R:0.31494 P:0.20208 F:0.24619
55 ROUGE-L Eval D0721-A.M.100.E-G.55 R:0.34076 P:0.22292 F:0.26952
55 ROUGE-L Eval D0721-B.M.100.E-B.55 R:0.28664 P:0.18107 F:0.22194
55 ROUGE-L Eval D0721-B.M.100.E-C.55 R:0.30892 P:0.19959 F:0.24250
55 ROUGE-L Eval D0721-B.M.100.E-E.55 R:0.26230 P:0.16461 F:0.20228
55 ROUGE-L Eval D0721-B.M.100.E-G.55 R:0.29677 P:0.18930 F:0.23115
55 ROUGE-L Eval D0721-C.M.100.E-B.55 R:0.34754 P:0.23714 F:0.28192
55 ROUGE-L Eval D0721-C.M.100.E-C.55 R:0.33993 P:0.23043 F:0.27467
55 ROUGE-L Eval D0721-C.M.100.E-E.55 R:0.31333 P:0.21029 F:0.25167
55 ROUGE-L Eval D0721-C.M.100.E-G.55 R:0.29316 P:0.20134 F:0.23873
55 ROUGE-L Eval D0726-A.M.100.F-A.55 R:0.40864 P:0.25625 F:0.31498
55 ROUGE-L Eval D0726-A.M.100.F-E.55 R:0.37333 P:0.23333 F:0.28718
55 ROUGE-L Eval D0726-A.M.100.F-F.55 R:0.41196 P:0.25833 F:0.31754
55 ROUGE-L Eval D0726-A.M.100.F-G.55 R:0.38206 P:0.23958 F:0.29449
55 ROUGE-L Eval D0726-B.M.100.F-A.55 R:0.29412 P:0.18182 F:0.22472
55 ROUGE-L Eval D0726-B.M.100.F-E.55 R:0.28571 P:0.17374 F:0.21608
55 ROUGE-L Eval D0726-B.M.100.F-F.55 R:0.30897 P:0.18788 F:0.23367
55 ROUGE-L Eval D0726-B.M.100.F-G.55 R:0.30921 P:0.18990 F:0.23529
55 ROUGE-L Eval D0726-C.M.100.F-A.55 R:0.33333 P:0.20704 F:0.25543
55 ROUGE-L Eval D0726-C.M.100.F-E.55 R:0.33333 P:0.20497 F:0.25385
55 ROUGE-L Eval D0726-C.M.100.F-F.55 R:0.34576 P:0.21118 F:0.26221
55 ROUGE-L Eval D0726-C.M.100.F-G.55 R:0.34098 P:0.21532 F:0.26396
55 ROUGE-L Eval D0727-A.M.100.G-A.55 R:0.37874 P:0.21469 F:0.27404
55 ROUGE-L Eval D0727-A.M.100.G-F.55 R:0.37829 P:0.21657 F:0.27545
55 ROUGE-L Eval D0727-A.M.100.G-G.55 R:0.37255 P:0.21469 F:0.27240
55 ROUGE-L Eval D0727-A.M.100.G-H.55 R:0.39145 P:0.22411 F:0.28503
55 ROUGE-L Eval D0727-B.M.100.G-A.55 R:0.37113 P:0.20690 F:0.26568
55 ROUGE-L Eval D0727-B.M.100.G-F.55 R:0.38961 P:0.22989 F:0.28916
55 ROUGE-L Eval D0727-B.M.100.G-G.55 R:0.34948 P:0.19349 F:0.24908
55 ROUGE-L Eval D0727-B.M.100.G-H.55 R:0.36426 P:0.20307 F:0.26077
55 ROUGE-L Eval D0727-C.M.100.G-A.55 R:0.31270 P:0.17978 F:0.22830
55 ROUGE-L Eval D0727-C.M.100.G-F.55 R:0.34680 P:0.19288 F:0.24789
55 ROUGE-L Eval D0727-C.M.100.G-G.55 R:0.33993 P:0.19288 F:0.24611
55 ROUGE-L Eval D0727-C.M.100.G-H.55 R:0.32770 P:0.18165 F:0.23374
55 ROUGE-L Eval D0736-A.M.100.H-G.55 R:0.29391 P:0.16872 F:0.21438
55 ROUGE-L Eval D0736-A.M.100.H-H.55 R:0.29562 P:0.16667 F:0.21316
55 ROUGE-L Eval D0736-A.M.100.H-I.55 R:0.30249 P:0.17490 F:0.22164
55 ROUGE-L Eval D0736-A.M.100.H-J.55 R:0.28758 P:0.18107 F:0.22222
55 ROUGE-L Eval D0736-B.M.100.H-G.55 R:0.29771 P:0.14943 F:0.19898
55 ROUGE-L Eval D0736-B.M.100.H-H.55 R:0.35950 P:0.16667 F:0.22775
55 ROUGE-L Eval D0736-B.M.100.H-I.55 R:0.40586 P:0.18582 F:0.25492
55 ROUGE-L Eval D0736-B.M.100.H-J.55 R:0.37413 P:0.20498 F:0.26485
55 ROUGE-L Eval D0736-C.M.100.H-G.55 R:0.37553 P:0.17148 F:0.23545
55 ROUGE-L Eval D0736-C.M.100.H-H.55 R:0.37968 P:0.13680 F:0.20113
55 ROUGE-L Eval D0736-C.M.100.H-I.55 R:0.37433 P:0.13487 F:0.19829
55 ROUGE-L Eval D0736-C.M.100.H-J.55 R:0.36604 P:0.18690 F:0.24745
55 ROUGE-L Eval D0740-A.M.100.I-D.55 R:0.31023 P:0.19223 F:0.23737
55 ROUGE-L Eval D0740-A.M.100.I-H.55 R:0.26471 P:0.16564 F:0.20377
55 ROUGE-L Eval D0740-A.M.100.I-I.55 R:0.28896 P:0.18200 F:0.22333
55 ROUGE-L Eval D0740-A.M.100.I-J.55 R:0.28065 P:0.17791 F:0.21777
55 ROUGE-L Eval D0740-B.M.100.I-D.55 R:0.31494 P:0.20083 F:0.24526
55 ROUGE-L Eval D0740-B.M.100.I-H.55 R:0.30464 P:0.19048 F:0.23440
55 ROUGE-L Eval D0740-B.M.100.I-I.55 R:0.34426 P:0.21739 F:0.26650
55 ROUGE-L Eval D0740-B.M.100.I-J.55 R:0.31068 P:0.19876 F:0.24243
55 ROUGE-L Eval D0740-C.M.100.I-D.55 R:0.28754 P:0.18519 F:0.22529
55 ROUGE-L Eval D0740-C.M.100.I-H.55 R:0.26688 P:0.17078 F:0.20828
55 ROUGE-L Eval D0740-C.M.100.I-I.55 R:0.28115 P:0.18107 F:0.22028
55 ROUGE-L Eval D0740-C.M.100.I-J.55 R:0.30573 P:0.19753 F:0.24000
55 ROUGE-L Eval D0743-A.M.100.J-B.55 R:0.27937 P:0.16858 F:0.21027
55 ROUGE-L Eval D0743-A.M.100.J-H.55 R:0.23765 P:0.14751 F:0.18203
55 ROUGE-L Eval D0743-A.M.100.J-I.55 R:0.29688 P:0.18199 F:0.22565
55 ROUGE-L Eval D0743-A.M.100.J-J.55 R:0.23385 P:0.14559 F:0.17946
55 ROUGE-L Eval D0743-B.M.100.J-B.55 R:0.24359 P:0.15638 F:0.19048
55 ROUGE-L Eval D0743-B.M.100.J-H.55 R:0.22397 P:0.14609 F:0.17683
55 ROUGE-L Eval D0743-B.M.100.J-I.55 R:0.25949 P:0.16872 F:0.20448
55 ROUGE-L Eval D0743-B.M.100.J-J.55 R:0.23053 P:0.15226 F:0.18339
55 ROUGE-L Eval D0743-C.M.100.J-B.55 R:0.22857 P:0.14458 F:0.17712
55 ROUGE-L Eval D0743-C.M.100.J-H.55 R:0.22293 P:0.14056 F:0.17241
55 ROUGE-L Eval D0743-C.M.100.J-I.55 R:0.24601 P:0.15462 F:0.18989
55 ROUGE-L Eval D0743-C.M.100.J-J.55 R:0.20755 P:0.13253 F:0.16177
---------------------------------------------
55 ROUGE-W-1.2 Average_R: 0.11654 (95%-conf.int. 0.11344 - 0.11968)
55 ROUGE-W-1.2 Average_P: 0.12930 (95%-conf.int. 0.12597 - 0.13262)
55 ROUGE-W-1.2 Average_F: 0.12225 (95%-conf.int. 0.11916 - 0.12528)
.............................................
55 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.55 R:0.13619 P:0.15123 F:0.14332
55 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.55 R:0.12248 P:0.13821 F:0.12987
55 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.55 R:0.12580 P:0.14060 F:0.13279
55 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.55 R:0.13423 P:0.14063 F:0.13736
55 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.55 R:0.10408 P:0.12866 F:0.11507
55 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.55 R:0.10944 P:0.13445 F:0.12066
55 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.55 R:0.10454 P:0.12731 F:0.11481
55 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.55 R:0.11296 P:0.13739 F:0.12398
55 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.55 R:0.12267 P:0.15206 F:0.13579
55 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.55 R:0.11441 P:0.14785 F:0.12900
55 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.55 R:0.11027 P:0.14045 F:0.12354
55 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.55 R:0.12787 P:0.15455 F:0.13995
55 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.55 R:0.13477 P:0.15141 F:0.14261
55 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.55 R:0.13785 P:0.15732 F:0.14694
55 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.55 R:0.11702 P:0.13285 F:0.12443
55 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.55 R:0.12766 P:0.14809 F:0.13712
55 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.55 R:0.12746 P:0.13729 F:0.13219
55 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.55 R:0.11837 P:0.13025 F:0.12403
55 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.55 R:0.10752 P:0.11881 F:0.11288
55 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.55 R:0.11970 P:0.13595 F:0.12731
55 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.55 R:0.11984 P:0.13128 F:0.12530
55 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.55 R:0.12043 P:0.13305 F:0.12643
55 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.55 R:0.12370 P:0.13536 F:0.12927
55 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.55 R:0.11919 P:0.13415 F:0.12623
55 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.55 R:0.11721 P:0.13995 F:0.12757
55 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.55 R:0.12678 P:0.15009 F:0.13745
55 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.55 R:0.11518 P:0.13518 F:0.12438
55 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.55 R:0.12423 P:0.14827 F:0.13519
55 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.55 R:0.10340 P:0.11443 F:0.10864
55 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.55 R:0.10673 P:0.12322 F:0.11438
55 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.55 R:0.09758 P:0.11525 F:0.10568
55 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.55 R:0.11293 P:0.13053 F:0.12109
55 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.55 R:0.11114 P:0.12955 F:0.11964
55 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.55 R:0.10986 P:0.12385 F:0.11644
55 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.55 R:0.10576 P:0.12231 F:0.11343
55 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.55 R:0.11226 P:0.13177 F:0.12124
55 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.55 R:0.12247 P:0.14307 F:0.13197
55 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.55 R:0.10304 P:0.12346 F:0.11233
55 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.55 R:0.12626 P:0.14879 F:0.13660
55 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.55 R:0.11855 P:0.14321 F:0.12972
55 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.55 R:0.13710 P:0.15053 F:0.14350
55 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.55 R:0.14737 P:0.16272 F:0.15467
55 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.55 R:0.14266 P:0.15827 F:0.15006
55 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.55 R:0.14405 P:0.15836 F:0.15087
55 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.55 R:0.14132 P:0.16639 F:0.15283
55 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.55 R:0.14057 P:0.16772 F:0.15295
55 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.55 R:0.12922 P:0.15613 F:0.14141
55 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.55 R:0.13424 P:0.16119 F:0.14649
55 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.55 R:0.12751 P:0.14007 F:0.13350
55 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.55 R:0.12521 P:0.14254 F:0.13331
55 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.55 R:0.11446 P:0.13194 F:0.12258
55 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.55 R:0.12659 P:0.14512 F:0.13522
55 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.55 R:0.09539 P:0.11649 F:0.10489
55 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.55 R:0.10404 P:0.12633 F:0.11411
55 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.55 R:0.08525 P:0.10501 F:0.09410
55 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.55 R:0.09542 P:0.12147 F:0.10688
55 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.55 R:0.12626 P:0.15856 F:0.14058
55 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.55 R:0.12289 P:0.15672 F:0.13776
55 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.55 R:0.11350 P:0.14217 F:0.12623
55 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.55 R:0.10209 P:0.13112 F:0.11480
55 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.55 R:0.15682 P:0.17426 F:0.16508
55 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.55 R:0.14408 P:0.15776 F:0.15061
55 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.55 R:0.15776 P:0.17620 F:0.16647
55 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.55 R:0.13778 P:0.15640 F:0.14650
55 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.55 R:0.11132 P:0.12104 F:0.11598
55 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.55 R:0.09916 P:0.10885 F:0.10378
55 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.55 R:0.11231 P:0.12407 F:0.11790
55 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.55 R:0.11167 P:0.12383 F:0.11744
55 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.55 R:0.11620 P:0.12674 F:0.12124
55 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.55 R:0.11590 P:0.12579 F:0.12064
55 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.55 R:0.11954 P:0.13075 F:0.12489
55 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.55 R:0.11708 P:0.13238 F:0.12426
55 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.55 R:0.13175 P:0.13145 F:0.13160
55 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.55 R:0.13115 P:0.13705 F:0.13404
55 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.55 R:0.12916 P:0.13182 F:0.13048
55 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.55 R:0.13755 P:0.14115 F:0.13933
55 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.55 R:0.12782 P:0.12503 F:0.12641
55 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.55 R:0.13226 P:0.14019 F:0.13611
55 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.55 R:0.12567 P:0.12462 F:0.12514
55 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.55 R:0.12692 P:0.12524 F:0.12607
55 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.55 R:0.10876 P:0.11245 F:0.11057
55 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.55 R:0.11686 P:0.12012 F:0.11847
55 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.55 R:0.11444 P:0.11954 F:0.11693
55 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.55 R:0.11244 P:0.11218 F:0.11231
55 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.55 R:0.10845 P:0.11025 F:0.10934
55 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.55 R:0.10969 P:0.10876 F:0.10922
55 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.55 R:0.11104 P:0.11472 F:0.11285
55 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.55 R:0.10344 P:0.11610 F:0.10940
55 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.55 R:0.10294 P:0.09564 F:0.09916
55 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.55 R:0.14067 P:0.12065 F:0.12989
55 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.55 R:0.15726 P:0.13299 F:0.14411
55 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.55 R:0.13889 P:0.14068 F:0.13978
55 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.55 R:0.13938 P:0.11562 F:0.12639
55 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.55 R:0.13787 P:0.09285 F:0.11097
55 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.55 R:0.14581 P:0.09584 F:0.11566
55 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.55 R:0.13523 P:0.12319 F:0.12893
55 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.55 R:0.10745 P:0.12247 F:0.11447
55 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.55 R:0.09384 P:0.10594 F:0.09952
55 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.55 R:0.09780 P:0.11395 F:0.10526
55 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.55 R:0.09629 P:0.11214 F:0.10361
55 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.55 R:0.10710 P:0.12547 F:0.11556
55 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.55 R:0.10616 P:0.11812 F:0.11182
55 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.55 R:0.11466 P:0.13605 F:0.12444
55 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.55 R:0.10938 P:0.12510 F:0.11671
55 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.55 R:0.10056 P:0.12498 F:0.11145
55 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.55 R:0.09546 P:0.11401 F:0.10391
55 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.55 R:0.09413 P:0.11856 F:0.10494
55 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.55 R:0.10422 P:0.12903 F:0.11531
55 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.55 R:0.10319 P:0.10855 F:0.10580
55 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.55 R:0.08911 P:0.09554 F:0.09221
55 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.55 R:0.10641 P:0.11575 F:0.11088
55 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.55 R:0.08588 P:0.09282 F:0.08922
55 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.55 R:0.09133 P:0.09819 F:0.09464
55 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.55 R:0.08607 P:0.09311 F:0.08945
55 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.55 R:0.09577 P:0.10494 F:0.10015
55 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.55 R:0.08828 P:0.09586 F:0.09191
55 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.55 R:0.07745 P:0.08575 F:0.08139
55 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.55 R:0.07834 P:0.08249 F:0.08036
55 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.55 R:0.08145 P:0.09122 F:0.08606
55 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.55 R:0.07965 P:0.08561 F:0.08252
---------------------------------------------
55 ROUGE-SU4 Average_R: 0.13670 (95%-conf.int. 0.13050 - 0.14249)
55 ROUGE-SU4 Average_P: 0.08269 (95%-conf.int. 0.07921 - 0.08597)
55 ROUGE-SU4 Average_F: 0.10280 (95%-conf.int. 0.09849 - 0.10670)
.............................................
55 ROUGE-SU4 Eval D0703-A.M.100.A-A.55 R:0.17072 P:0.10417 F:0.12939
55 ROUGE-SU4 Eval D0703-A.M.100.A-C.55 R:0.15805 P:0.09710 F:0.12030
55 ROUGE-SU4 Eval D0703-A.M.100.A-D.55 R:0.15312 P:0.09181 F:0.11479
55 ROUGE-SU4 Eval D0703-A.M.100.A-J.55 R:0.15268 P:0.09251 F:0.11521
55 ROUGE-SU4 Eval D0703-B.M.100.A-A.55 R:0.13031 P:0.08610 F:0.10369
55 ROUGE-SU4 Eval D0703-B.M.100.A-C.55 R:0.13506 P:0.08684 F:0.10571
55 ROUGE-SU4 Eval D0703-B.M.100.A-D.55 R:0.13793 P:0.08869 F:0.10796
55 ROUGE-SU4 Eval D0703-B.M.100.A-J.55 R:0.13993 P:0.09091 F:0.11022
55 ROUGE-SU4 Eval D0703-C.M.100.A-A.55 R:0.15525 P:0.10256 F:0.12352
55 ROUGE-SU4 Eval D0703-C.M.100.A-C.55 R:0.14722 P:0.09992 F:0.11904
55 ROUGE-SU4 Eval D0703-C.M.100.A-D.55 R:0.13832 P:0.09201 F:0.11051
55 ROUGE-SU4 Eval D0703-C.M.100.A-J.55 R:0.15420 P:0.10256 F:0.12319
55 ROUGE-SU4 Eval D0706-A.M.100.B-B.55 R:0.16444 P:0.10193 F:0.12585
55 ROUGE-SU4 Eval D0706-A.M.100.B-D.55 R:0.17562 P:0.10813 F:0.13385
55 ROUGE-SU4 Eval D0706-A.M.100.B-E.55 R:0.13111 P:0.08127 F:0.10034
55 ROUGE-SU4 Eval D0706-A.M.100.B-I.55 R:0.15667 P:0.09711 F:0.11990
55 ROUGE-SU4 Eval D0706-B.M.100.B-B.55 R:0.13814 P:0.08506 F:0.10529
55 ROUGE-SU4 Eval D0706-B.M.100.B-D.55 R:0.12542 P:0.07748 F:0.09579
55 ROUGE-SU4 Eval D0706-B.M.100.B-E.55 R:0.09556 P:0.05923 F:0.07313
55 ROUGE-SU4 Eval D0706-B.M.100.B-I.55 R:0.13344 P:0.08299 F:0.10234
55 ROUGE-SU4 Eval D0706-C.M.100.B-B.55 R:0.13245 P:0.08421 F:0.10296
55 ROUGE-SU4 Eval D0706-C.M.100.B-D.55 R:0.13079 P:0.08316 F:0.10167
55 ROUGE-SU4 Eval D0706-C.M.100.B-E.55 R:0.13268 P:0.08491 F:0.10355
55 ROUGE-SU4 Eval D0706-C.M.100.B-I.55 R:0.13005 P:0.08351 F:0.10171
55 ROUGE-SU4 Eval D0711-A.M.100.C-A.55 R:0.13345 P:0.08758 F:0.10576
55 ROUGE-SU4 Eval D0711-A.M.100.C-B.55 R:0.14498 P:0.09387 F:0.11396
55 ROUGE-SU4 Eval D0711-A.M.100.C-C.55 R:0.12272 P:0.07945 F:0.09645
55 ROUGE-SU4 Eval D0711-A.M.100.C-F.55 R:0.14229 P:0.09276 F:0.11231
55 ROUGE-SU4 Eval D0711-B.M.100.C-A.55 R:0.10082 P:0.06187 F:0.07668
55 ROUGE-SU4 Eval D0711-B.M.100.C-B.55 R:0.11385 P:0.06938 F:0.08622
55 ROUGE-SU4 Eval D0711-B.M.100.C-C.55 R:0.09943 P:0.06187 F:0.07628
55 ROUGE-SU4 Eval D0711-B.M.100.C-F.55 R:0.11150 P:0.06867 F:0.08499
55 ROUGE-SU4 Eval D0711-C.M.100.C-A.55 R:0.15141 P:0.09344 F:0.11556
55 ROUGE-SU4 Eval D0711-C.M.100.C-B.55 R:0.14211 P:0.08473 F:0.10616
55 ROUGE-SU4 Eval D0711-C.M.100.C-C.55 R:0.13600 P:0.08194 F:0.10227
55 ROUGE-SU4 Eval D0711-C.M.100.C-F.55 R:0.16204 P:0.09763 F:0.12185
55 ROUGE-SU4 Eval D0716-A.M.100.D-C.55 R:0.14703 P:0.09311 F:0.11402
55 ROUGE-SU4 Eval D0716-A.M.100.D-D.55 R:0.12728 P:0.07925 F:0.09768
55 ROUGE-SU4 Eval D0716-A.M.100.D-E.55 R:0.16553 P:0.10341 F:0.12730
55 ROUGE-SU4 Eval D0716-A.M.100.D-F.55 R:0.15311 P:0.09630 F:0.11823
55 ROUGE-SU4 Eval D0716-B.M.100.D-C.55 R:0.19595 P:0.12211 F:0.15046
55 ROUGE-SU4 Eval D0716-B.M.100.D-D.55 R:0.22759 P:0.13895 F:0.17255
55 ROUGE-SU4 Eval D0716-B.M.100.D-E.55 R:0.20023 P:0.12351 F:0.15278
55 ROUGE-SU4 Eval D0716-B.M.100.D-F.55 R:0.21518 P:0.13228 F:0.16384
55 ROUGE-SU4 Eval D0716-C.M.100.D-C.55 R:0.18618 P:0.11646 F:0.14329
55 ROUGE-SU4 Eval D0716-C.M.100.D-D.55 R:0.19874 P:0.12099 F:0.15041
55 ROUGE-SU4 Eval D0716-C.M.100.D-E.55 R:0.16667 P:0.10286 F:0.12721
55 ROUGE-SU4 Eval D0716-C.M.100.D-F.55 R:0.18265 P:0.11158 F:0.13853
55 ROUGE-SU4 Eval D0721-A.M.100.E-B.55 R:0.14726 P:0.09110 F:0.11256
55 ROUGE-SU4 Eval D0721-A.M.100.E-C.55 R:0.14500 P:0.09216 F:0.11269
55 ROUGE-SU4 Eval D0721-A.M.100.E-E.55 R:0.14278 P:0.09075 F:0.11097
55 ROUGE-SU4 Eval D0721-A.M.100.E-G.55 R:0.14924 P:0.09675 F:0.11739
55 ROUGE-SU4 Eval D0721-B.M.100.E-B.55 R:0.10702 P:0.06695 F:0.08237
55 ROUGE-SU4 Eval D0721-B.M.100.E-C.55 R:0.11166 P:0.07148 F:0.08716
55 ROUGE-SU4 Eval D0721-B.M.100.E-E.55 R:0.08754 P:0.05439 F:0.06709
55 ROUGE-SU4 Eval D0721-B.M.100.E-G.55 R:0.11038 P:0.06974 F:0.08548
55 ROUGE-SU4 Eval D0721-C.M.100.E-B.55 R:0.17059 P:0.11541 F:0.13768
55 ROUGE-SU4 Eval D0721-C.M.100.E-C.55 R:0.17119 P:0.11503 F:0.13760
55 ROUGE-SU4 Eval D0721-C.M.100.E-E.55 R:0.15297 P:0.10175 F:0.12221
55 ROUGE-SU4 Eval D0721-C.M.100.E-G.55 R:0.12598 P:0.08580 F:0.10208
55 ROUGE-SU4 Eval D0726-A.M.100.F-A.55 R:0.21559 P:0.13383 F:0.16514
55 ROUGE-SU4 Eval D0726-A.M.100.F-E.55 R:0.16724 P:0.10346 F:0.12784
55 ROUGE-SU4 Eval D0726-A.M.100.F-F.55 R:0.20819 P:0.12924 F:0.15948
55 ROUGE-SU4 Eval D0726-A.M.100.F-G.55 R:0.17406 P:0.10805 F:0.13333
55 ROUGE-SU4 Eval D0726-B.M.100.F-A.55 R:0.12025 P:0.07358 F:0.09130
55 ROUGE-SU4 Eval D0726-B.M.100.F-E.55 R:0.09954 P:0.05989 F:0.07478
55 ROUGE-SU4 Eval D0726-B.M.100.F-F.55 R:0.12514 P:0.07529 F:0.09402
55 ROUGE-SU4 Eval D0726-B.M.100.F-G.55 R:0.12444 P:0.07563 F:0.09408
55 ROUGE-SU4 Eval D0726-C.M.100.F-A.55 R:0.13470 P:0.08281 F:0.10257
55 ROUGE-SU4 Eval D0726-C.M.100.F-E.55 R:0.12860 P:0.07825 F:0.09730
55 ROUGE-SU4 Eval D0726-C.M.100.F-F.55 R:0.14402 P:0.08702 F:0.10849
55 ROUGE-SU4 Eval D0726-C.M.100.F-G.55 R:0.14198 P:0.08877 F:0.10924
55 ROUGE-SU4 Eval D0727-A.M.100.G-A.55 R:0.13595 P:0.07616 F:0.09763
55 ROUGE-SU4 Eval D0727-A.M.100.G-F.55 R:0.15090 P:0.08540 F:0.10907
55 ROUGE-SU4 Eval D0727-A.M.100.G-G.55 R:0.14262 P:0.08126 F:0.10353
55 ROUGE-SU4 Eval D0727-A.M.100.G-H.55 R:0.15372 P:0.08700 F:0.11111
55 ROUGE-SU4 Eval D0727-B.M.100.G-A.55 R:0.14900 P:0.08204 F:0.10582
55 ROUGE-SU4 Eval D0727-B.M.100.G-F.55 R:0.16444 P:0.09598 F:0.12121
55 ROUGE-SU4 Eval D0727-B.M.100.G-G.55 R:0.13998 P:0.07652 F:0.09895
55 ROUGE-SU4 Eval D0727-B.M.100.G-H.55 R:0.14547 P:0.08009 F:0.10330
55 ROUGE-SU4 Eval D0727-C.M.100.G-A.55 R:0.10591 P:0.06020 F:0.07677
55 ROUGE-SU4 Eval D0727-C.M.100.G-F.55 R:0.12053 P:0.06622 F:0.08548
55 ROUGE-SU4 Eval D0727-C.M.100.G-G.55 R:0.11977 P:0.06717 F:0.08607
55 ROUGE-SU4 Eval D0727-C.M.100.G-H.55 R:0.10475 P:0.05735 F:0.07412
55 ROUGE-SU4 Eval D0736-A.M.100.H-G.55 R:0.10025 P:0.05683 F:0.07254
55 ROUGE-SU4 Eval D0736-A.M.100.H-H.55 R:0.09962 P:0.05544 F:0.07124
55 ROUGE-SU4 Eval D0736-A.M.100.H-I.55 R:0.10684 P:0.06102 F:0.07768
55 ROUGE-SU4 Eval D0736-A.M.100.H-J.55 R:0.09787 P:0.06102 F:0.07517
55 ROUGE-SU4 Eval D0736-B.M.100.H-G.55 R:0.11680 P:0.05772 F:0.07726
55 ROUGE-SU4 Eval D0736-B.M.100.H-H.55 R:0.19444 P:0.08852 F:0.12166
55 ROUGE-SU4 Eval D0736-B.M.100.H-I.55 R:0.21356 P:0.09598 F:0.13244
55 ROUGE-SU4 Eval D0736-B.M.100.H-J.55 R:0.19065 P:0.10311 F:0.13384
55 ROUGE-SU4 Eval D0736-C.M.100.H-G.55 R:0.17831 P:0.07991 F:0.11036
55 ROUGE-SU4 Eval D0736-C.M.100.H-H.55 R:0.17412 P:0.06099 F:0.09034
55 ROUGE-SU4 Eval D0736-C.M.100.H-I.55 R:0.17132 P:0.06001 F:0.08889
55 ROUGE-SU4 Eval D0736-C.M.100.H-J.55 R:0.16083 P:0.08089 F:0.10764
55 ROUGE-SU4 Eval D0740-A.M.100.I-D.55 R:0.12147 P:0.07450 F:0.09236
55 ROUGE-SU4 Eval D0740-A.M.100.I-H.55 R:0.09843 P:0.06098 F:0.07531
55 ROUGE-SU4 Eval D0740-A.M.100.I-I.55 R:0.11111 P:0.06930 F:0.08536
55 ROUGE-SU4 Eval D0740-A.M.100.I-J.55 R:0.10762 P:0.06757 F:0.08302
55 ROUGE-SU4 Eval D0740-B.M.100.I-D.55 R:0.10889 P:0.06877 F:0.08430
55 ROUGE-SU4 Eval D0740-B.M.100.I-H.55 R:0.09580 P:0.05930 F:0.07326
55 ROUGE-SU4 Eval D0740-B.M.100.I-I.55 R:0.13075 P:0.08175 F:0.10060
55 ROUGE-SU4 Eval D0740-B.M.100.I-J.55 R:0.10908 P:0.06912 F:0.08462
55 ROUGE-SU4 Eval D0740-C.M.100.I-D.55 R:0.11257 P:0.07183 F:0.08770
55 ROUGE-SU4 Eval D0740-C.M.100.I-H.55 R:0.10561 P:0.06695 F:0.08195
55 ROUGE-SU4 Eval D0740-C.M.100.I-I.55 R:0.11257 P:0.07183 F:0.08770
55 ROUGE-SU4 Eval D0740-C.M.100.I-J.55 R:0.13017 P:0.08333 F:0.10161
55 ROUGE-SU4 Eval D0743-A.M.100.J-B.55 R:0.11564 P:0.06907 F:0.08648
55 ROUGE-SU4 Eval D0743-A.M.100.J-H.55 R:0.10074 P:0.06193 F:0.07671
55 ROUGE-SU4 Eval D0743-A.M.100.J-I.55 R:0.12340 P:0.07490 F:0.09322
55 ROUGE-SU4 Eval D0743-A.M.100.J-J.55 R:0.07939 P:0.04896 F:0.06057
55 ROUGE-SU4 Eval D0743-B.M.100.J-B.55 R:0.08498 P:0.05404 F:0.06607
55 ROUGE-SU4 Eval D0743-B.M.100.J-H.55 R:0.07767 P:0.05021 F:0.06099
55 ROUGE-SU4 Eval D0743-B.M.100.J-I.55 R:0.09416 P:0.06067 F:0.07379
55 ROUGE-SU4 Eval D0743-B.M.100.J-J.55 R:0.08040 P:0.05265 F:0.06363
55 ROUGE-SU4 Eval D0743-C.M.100.J-B.55 R:0.08035 P:0.05034 F:0.06190
55 ROUGE-SU4 Eval D0743-C.M.100.J-H.55 R:0.07244 P:0.04524 F:0.05570
55 ROUGE-SU4 Eval D0743-C.M.100.J-I.55 R:0.08579 P:0.05340 F:0.06583
55 ROUGE-SU4 Eval D0743-C.M.100.J-J.55 R:0.06290 P:0.03980 F:0.04875
---------------------------------------------
56 ROUGE-1 Average_R: 0.32235 (95%-conf.int. 0.31051 - 0.33379)
56 ROUGE-1 Average_P: 0.26592 (95%-conf.int. 0.25522 - 0.27565)
56 ROUGE-1 Average_F: 0.29118 (95%-conf.int. 0.27985 - 0.30179)
.............................................
56 ROUGE-1 Eval D0703-A.M.100.A-A.56 R:0.32432 P:0.26016 F:0.28872
56 ROUGE-1 Eval D0703-A.M.100.A-C.56 R:0.27517 P:0.22222 F:0.24588
56 ROUGE-1 Eval D0703-A.M.100.A-D.56 R:0.29210 P:0.23035 F:0.25758
56 ROUGE-1 Eval D0703-A.M.100.A-J.56 R:0.30952 P:0.24661 F:0.27451
56 ROUGE-1 Eval D0703-B.M.100.A-A.56 R:0.39216 P:0.33333 F:0.36036
56 ROUGE-1 Eval D0703-B.M.100.A-C.56 R:0.38255 P:0.31667 F:0.34651
56 ROUGE-1 Eval D0703-B.M.100.A-D.56 R:0.38255 P:0.31667 F:0.34651
56 ROUGE-1 Eval D0703-B.M.100.A-J.56 R:0.37874 P:0.31667 F:0.34493
56 ROUGE-1 Eval D0703-C.M.100.A-A.56 R:0.37667 P:0.30623 F:0.33782
56 ROUGE-1 Eval D0703-C.M.100.A-C.56 R:0.35390 P:0.29539 F:0.32201
56 ROUGE-1 Eval D0703-C.M.100.A-D.56 R:0.35099 P:0.28726 F:0.31594
56 ROUGE-1 Eval D0703-C.M.100.A-J.56 R:0.38411 P:0.31436 F:0.34575
56 ROUGE-1 Eval D0706-A.M.100.B-B.56 R:0.35065 P:0.30252 F:0.32481
56 ROUGE-1 Eval D0706-A.M.100.B-D.56 R:0.33333 P:0.28571 F:0.30769
56 ROUGE-1 Eval D0706-A.M.100.B-E.56 R:0.27273 P:0.23529 F:0.25263
56 ROUGE-1 Eval D0706-A.M.100.B-I.56 R:0.31169 P:0.26891 F:0.28872
56 ROUGE-1 Eval D0706-B.M.100.B-B.56 R:0.27451 P:0.22951 F:0.25000
56 ROUGE-1 Eval D0706-B.M.100.B-D.56 R:0.29967 P:0.25137 F:0.27340
56 ROUGE-1 Eval D0706-B.M.100.B-E.56 R:0.28571 P:0.24044 F:0.26113
56 ROUGE-1 Eval D0706-B.M.100.B-I.56 R:0.30097 P:0.25410 F:0.27556
56 ROUGE-1 Eval D0706-C.M.100.B-B.56 R:0.36452 P:0.30133 F:0.32993
56 ROUGE-1 Eval D0706-C.M.100.B-D.56 R:0.36129 P:0.29867 F:0.32701
56 ROUGE-1 Eval D0706-C.M.100.B-E.56 R:0.36859 P:0.30667 F:0.33479
56 ROUGE-1 Eval D0706-C.M.100.B-I.56 R:0.34185 P:0.28533 F:0.31104
56 ROUGE-1 Eval D0711-A.M.100.C-A.56 R:0.33882 P:0.27467 F:0.30339
56 ROUGE-1 Eval D0711-A.M.100.C-B.56 R:0.34333 P:0.27467 F:0.30519
56 ROUGE-1 Eval D0711-A.M.100.C-C.56 R:0.32000 P:0.25600 F:0.28444
56 ROUGE-1 Eval D0711-A.M.100.C-F.56 R:0.33113 P:0.26667 F:0.29542
56 ROUGE-1 Eval D0711-B.M.100.C-A.56 R:0.29932 P:0.24242 F:0.26788
56 ROUGE-1 Eval D0711-B.M.100.C-B.56 R:0.29110 P:0.23416 F:0.25954
56 ROUGE-1 Eval D0711-B.M.100.C-C.56 R:0.29530 P:0.24242 F:0.26626
56 ROUGE-1 Eval D0711-B.M.100.C-F.56 R:0.31525 P:0.25620 F:0.28267
56 ROUGE-1 Eval D0711-C.M.100.C-A.56 R:0.43564 P:0.35772 F:0.39285
56 ROUGE-1 Eval D0711-C.M.100.C-B.56 R:0.42321 P:0.33604 F:0.37462
56 ROUGE-1 Eval D0711-C.M.100.C-C.56 R:0.40203 P:0.32249 F:0.35789
56 ROUGE-1 Eval D0711-C.M.100.C-F.56 R:0.40541 P:0.32520 F:0.36090
56 ROUGE-1 Eval D0716-A.M.100.D-C.56 R:0.41639 P:0.34986 F:0.38024
56 ROUGE-1 Eval D0716-A.M.100.D-D.56 R:0.43333 P:0.35813 F:0.39216
56 ROUGE-1 Eval D0716-A.M.100.D-E.56 R:0.43522 P:0.36088 F:0.39458
56 ROUGE-1 Eval D0716-A.M.100.D-F.56 R:0.41254 P:0.34435 F:0.37537
56 ROUGE-1 Eval D0716-B.M.100.D-C.56 R:0.41447 P:0.33871 F:0.37278
56 ROUGE-1 Eval D0716-B.M.100.D-D.56 R:0.44295 P:0.35484 F:0.39403
56 ROUGE-1 Eval D0716-B.M.100.D-E.56 R:0.42857 P:0.34677 F:0.38335
56 ROUGE-1 Eval D0716-B.M.100.D-F.56 R:0.42000 P:0.33871 F:0.37500
56 ROUGE-1 Eval D0716-C.M.100.D-C.56 R:0.37134 P:0.30894 F:0.33728
56 ROUGE-1 Eval D0716-C.M.100.D-D.56 R:0.41137 P:0.33333 F:0.36826
56 ROUGE-1 Eval D0716-C.M.100.D-E.56 R:0.39274 P:0.32249 F:0.35417
56 ROUGE-1 Eval D0716-C.M.100.D-F.56 R:0.38333 P:0.31165 F:0.34379
56 ROUGE-1 Eval D0721-A.M.100.E-B.56 R:0.26000 P:0.21849 F:0.23744
56 ROUGE-1 Eval D0721-A.M.100.E-C.56 R:0.25325 P:0.21849 F:0.23459
56 ROUGE-1 Eval D0721-A.M.100.E-E.56 R:0.24026 P:0.20728 F:0.22255
56 ROUGE-1 Eval D0721-A.M.100.E-G.56 R:0.23248 P:0.20448 F:0.21758
56 ROUGE-1 Eval D0721-B.M.100.E-B.56 R:0.33876 P:0.28889 F:0.31184
56 ROUGE-1 Eval D0721-B.M.100.E-C.56 R:0.34395 P:0.30000 F:0.32048
56 ROUGE-1 Eval D0721-B.M.100.E-E.56 R:0.37377 P:0.31667 F:0.34286
56 ROUGE-1 Eval D0721-B.M.100.E-G.56 R:0.36129 P:0.31111 F:0.33433
56 ROUGE-1 Eval D0721-C.M.100.E-B.56 R:0.34098 P:0.29132 F:0.31420
56 ROUGE-1 Eval D0721-C.M.100.E-C.56 R:0.30363 P:0.25770 F:0.27879
56 ROUGE-1 Eval D0721-C.M.100.E-E.56 R:0.30333 P:0.25490 F:0.27701
56 ROUGE-1 Eval D0721-C.M.100.E-G.56 R:0.29642 P:0.25490 F:0.27410
56 ROUGE-1 Eval D0726-A.M.100.F-A.56 R:0.30565 P:0.25344 F:0.27711
56 ROUGE-1 Eval D0726-A.M.100.F-E.56 R:0.28000 P:0.23140 F:0.25339
56 ROUGE-1 Eval D0726-A.M.100.F-F.56 R:0.29900 P:0.24793 F:0.27108
56 ROUGE-1 Eval D0726-A.M.100.F-G.56 R:0.28239 P:0.23416 F:0.25602
56 ROUGE-1 Eval D0726-B.M.100.F-A.56 R:0.25490 P:0.21667 F:0.23424
56 ROUGE-1 Eval D0726-B.M.100.F-E.56 R:0.27575 P:0.23056 F:0.25114
56 ROUGE-1 Eval D0726-B.M.100.F-F.56 R:0.27907 P:0.23333 F:0.25416
56 ROUGE-1 Eval D0726-B.M.100.F-G.56 R:0.28947 P:0.24444 F:0.26506
56 ROUGE-1 Eval D0726-C.M.100.F-A.56 R:0.30000 P:0.24390 F:0.26906
56 ROUGE-1 Eval D0726-C.M.100.F-E.56 R:0.30303 P:0.24390 F:0.27027
56 ROUGE-1 Eval D0726-C.M.100.F-F.56 R:0.32542 P:0.26016 F:0.28915
56 ROUGE-1 Eval D0726-C.M.100.F-G.56 R:0.30492 P:0.25203 F:0.27596
56 ROUGE-1 Eval D0727-A.M.100.G-A.56 R:0.37874 P:0.31933 F:0.34651
56 ROUGE-1 Eval D0727-A.M.100.G-F.56 R:0.39474 P:0.33613 F:0.36308
56 ROUGE-1 Eval D0727-A.M.100.G-G.56 R:0.36275 P:0.31092 F:0.33484
56 ROUGE-1 Eval D0727-A.M.100.G-H.56 R:0.39474 P:0.33613 F:0.36308
56 ROUGE-1 Eval D0727-B.M.100.G-A.56 R:0.33333 P:0.27874 F:0.30360
56 ROUGE-1 Eval D0727-B.M.100.G-F.56 R:0.35065 P:0.31034 F:0.32927
56 ROUGE-1 Eval D0727-B.M.100.G-G.56 R:0.30104 P:0.25000 F:0.27316
56 ROUGE-1 Eval D0727-B.M.100.G-H.56 R:0.32646 P:0.27299 F:0.29734
56 ROUGE-1 Eval D0727-C.M.100.G-A.56 R:0.38436 P:0.33053 F:0.35542
56 ROUGE-1 Eval D0727-C.M.100.G-F.56 R:0.40741 P:0.33894 F:0.37003
56 ROUGE-1 Eval D0727-C.M.100.G-G.56 R:0.39604 P:0.33613 F:0.36363
56 ROUGE-1 Eval D0727-C.M.100.G-H.56 R:0.39865 P:0.33053 F:0.36141
56 ROUGE-1 Eval D0736-A.M.100.H-G.56 R:0.29749 P:0.22493 F:0.25617
56 ROUGE-1 Eval D0736-A.M.100.H-H.56 R:0.30657 P:0.22764 F:0.26127
56 ROUGE-1 Eval D0736-A.M.100.H-I.56 R:0.29181 P:0.22222 F:0.25230
56 ROUGE-1 Eval D0736-A.M.100.H-J.56 R:0.29412 P:0.24390 F:0.26667
56 ROUGE-1 Eval D0736-B.M.100.H-G.56 R:0.29771 P:0.21667 F:0.25081
56 ROUGE-1 Eval D0736-B.M.100.H-H.56 R:0.30165 P:0.20278 F:0.24253
56 ROUGE-1 Eval D0736-B.M.100.H-I.56 R:0.24686 P:0.16389 F:0.19700
56 ROUGE-1 Eval D0736-B.M.100.H-J.56 R:0.29371 P:0.23333 F:0.26006
56 ROUGE-1 Eval D0736-C.M.100.H-G.56 R:0.22785 P:0.16071 F:0.18848
56 ROUGE-1 Eval D0736-C.M.100.H-H.56 R:0.21925 P:0.12202 F:0.15678
56 ROUGE-1 Eval D0736-C.M.100.H-I.56 R:0.26738 P:0.14881 F:0.19121
56 ROUGE-1 Eval D0736-C.M.100.H-J.56 R:0.22264 P:0.17560 F:0.19634
56 ROUGE-1 Eval D0740-A.M.100.I-D.56 R:0.36964 P:0.29630 F:0.32893
56 ROUGE-1 Eval D0740-A.M.100.I-H.56 R:0.35294 P:0.28571 F:0.31579
56 ROUGE-1 Eval D0740-A.M.100.I-I.56 R:0.34091 P:0.27778 F:0.30612
56 ROUGE-1 Eval D0740-A.M.100.I-J.56 R:0.33548 P:0.27513 F:0.30232
56 ROUGE-1 Eval D0740-B.M.100.I-D.56 R:0.25649 P:0.22899 F:0.24196
56 ROUGE-1 Eval D0740-B.M.100.I-H.56 R:0.26159 P:0.22899 F:0.24421
56 ROUGE-1 Eval D0740-B.M.100.I-I.56 R:0.27541 P:0.24348 F:0.25846
56 ROUGE-1 Eval D0740-B.M.100.I-J.56 R:0.26537 P:0.23768 F:0.25076
56 ROUGE-1 Eval D0740-C.M.100.I-D.56 R:0.39297 P:0.33607 F:0.36230
56 ROUGE-1 Eval D0740-C.M.100.I-H.56 R:0.38585 P:0.32787 F:0.35450
56 ROUGE-1 Eval D0740-C.M.100.I-I.56 R:0.39297 P:0.33607 F:0.36230
56 ROUGE-1 Eval D0740-C.M.100.I-J.56 R:0.39172 P:0.33607 F:0.36177
56 ROUGE-1 Eval D0743-A.M.100.J-B.56 R:0.23175 P:0.19945 F:0.21439
56 ROUGE-1 Eval D0743-A.M.100.J-H.56 R:0.20370 P:0.18033 F:0.19130
56 ROUGE-1 Eval D0743-A.M.100.J-I.56 R:0.20625 P:0.18033 F:0.19242
56 ROUGE-1 Eval D0743-A.M.100.J-J.56 R:0.18154 P:0.16120 F:0.17077
56 ROUGE-1 Eval D0743-B.M.100.J-B.56 R:0.20513 P:0.17344 F:0.18796
56 ROUGE-1 Eval D0743-B.M.100.J-H.56 R:0.18297 P:0.15718 F:0.16910
56 ROUGE-1 Eval D0743-B.M.100.J-I.56 R:0.21835 P:0.18699 F:0.20146
56 ROUGE-1 Eval D0743-B.M.100.J-J.56 R:0.20872 P:0.18157 F:0.19420
56 ROUGE-1 Eval D0743-C.M.100.J-B.56 R:0.24444 P:0.20867 F:0.22514
56 ROUGE-1 Eval D0743-C.M.100.J-H.56 R:0.20701 P:0.17615 F:0.19034
56 ROUGE-1 Eval D0743-C.M.100.J-I.56 R:0.24601 P:0.20867 F:0.22581
56 ROUGE-1 Eval D0743-C.M.100.J-J.56 R:0.21698 P:0.18699 F:0.20087
---------------------------------------------
56 ROUGE-2 Average_R: 0.06240 (95%-conf.int. 0.05568 - 0.06934)
56 ROUGE-2 Average_P: 0.05156 (95%-conf.int. 0.04594 - 0.05733)
56 ROUGE-2 Average_F: 0.05643 (95%-conf.int. 0.05031 - 0.06274)
.............................................
56 ROUGE-2 Eval D0703-A.M.100.A-A.56 R:0.06485 P:0.05191 F:0.05766
56 ROUGE-2 Eval D0703-A.M.100.A-C.56 R:0.03729 P:0.03005 F:0.03328
56 ROUGE-2 Eval D0703-A.M.100.A-D.56 R:0.04514 P:0.03552 F:0.03976
56 ROUGE-2 Eval D0703-A.M.100.A-J.56 R:0.05842 P:0.04645 F:0.05175
56 ROUGE-2 Eval D0703-B.M.100.A-A.56 R:0.11881 P:0.10084 F:0.10909
56 ROUGE-2 Eval D0703-B.M.100.A-C.56 R:0.11186 P:0.09244 F:0.10123
56 ROUGE-2 Eval D0703-B.M.100.A-D.56 R:0.12542 P:0.10364 F:0.11349
56 ROUGE-2 Eval D0703-B.M.100.A-J.56 R:0.12752 P:0.10644 F:0.11603
56 ROUGE-2 Eval D0703-C.M.100.A-A.56 R:0.07407 P:0.06011 F:0.06636
56 ROUGE-2 Eval D0703-C.M.100.A-C.56 R:0.06885 P:0.05738 F:0.06259
56 ROUGE-2 Eval D0703-C.M.100.A-D.56 R:0.06355 P:0.05191 F:0.05714
56 ROUGE-2 Eval D0703-C.M.100.A-J.56 R:0.06355 P:0.05191 F:0.05714
56 ROUGE-2 Eval D0706-A.M.100.B-B.56 R:0.09836 P:0.08475 F:0.09105
56 ROUGE-2 Eval D0706-A.M.100.B-D.56 R:0.09901 P:0.08475 F:0.09133
56 ROUGE-2 Eval D0706-A.M.100.B-E.56 R:0.04590 P:0.03955 F:0.04249
56 ROUGE-2 Eval D0706-A.M.100.B-I.56 R:0.09180 P:0.07910 F:0.08498
56 ROUGE-2 Eval D0706-B.M.100.B-B.56 R:0.03630 P:0.03030 F:0.03303
56 ROUGE-2 Eval D0706-B.M.100.B-D.56 R:0.02961 P:0.02479 F:0.02699
56 ROUGE-2 Eval D0706-B.M.100.B-E.56 R:0.02623 P:0.02204 F:0.02395
56 ROUGE-2 Eval D0706-B.M.100.B-I.56 R:0.03595 P:0.03030 F:0.03288
56 ROUGE-2 Eval D0706-C.M.100.B-B.56 R:0.06189 P:0.05108 F:0.05597
56 ROUGE-2 Eval D0706-C.M.100.B-D.56 R:0.06189 P:0.05108 F:0.05597
56 ROUGE-2 Eval D0706-C.M.100.B-E.56 R:0.07120 P:0.05914 F:0.06461
56 ROUGE-2 Eval D0706-C.M.100.B-I.56 R:0.04839 P:0.04032 F:0.04399
56 ROUGE-2 Eval D0711-A.M.100.C-A.56 R:0.04651 P:0.03763 F:0.04160
56 ROUGE-2 Eval D0711-A.M.100.C-B.56 R:0.05724 P:0.04570 F:0.05082
56 ROUGE-2 Eval D0711-A.M.100.C-C.56 R:0.03367 P:0.02688 F:0.02989
56 ROUGE-2 Eval D0711-A.M.100.C-F.56 R:0.03344 P:0.02688 F:0.02980
56 ROUGE-2 Eval D0711-B.M.100.C-A.56 R:0.03436 P:0.02778 F:0.03072
56 ROUGE-2 Eval D0711-B.M.100.C-B.56 R:0.04498 P:0.03611 F:0.04006
56 ROUGE-2 Eval D0711-B.M.100.C-C.56 R:0.04068 P:0.03333 F:0.03664
56 ROUGE-2 Eval D0711-B.M.100.C-F.56 R:0.04452 P:0.03611 F:0.03988
56 ROUGE-2 Eval D0711-C.M.100.C-A.56 R:0.12333 P:0.10109 F:0.11111
56 ROUGE-2 Eval D0711-C.M.100.C-B.56 R:0.12069 P:0.09563 F:0.10671
56 ROUGE-2 Eval D0711-C.M.100.C-C.56 R:0.07850 P:0.06284 F:0.06980
56 ROUGE-2 Eval D0711-C.M.100.C-F.56 R:0.11604 P:0.09290 F:0.10319
56 ROUGE-2 Eval D0716-A.M.100.D-C.56 R:0.16556 P:0.13889 F:0.15106
56 ROUGE-2 Eval D0716-A.M.100.D-D.56 R:0.18519 P:0.15278 F:0.16743
56 ROUGE-2 Eval D0716-A.M.100.D-E.56 R:0.15772 P:0.13056 F:0.14286
56 ROUGE-2 Eval D0716-A.M.100.D-F.56 R:0.16333 P:0.13611 F:0.14848
56 ROUGE-2 Eval D0716-B.M.100.D-C.56 R:0.09967 P:0.08130 F:0.08955
56 ROUGE-2 Eval D0716-B.M.100.D-D.56 R:0.10847 P:0.08672 F:0.09638
56 ROUGE-2 Eval D0716-B.M.100.D-E.56 R:0.10403 P:0.08401 F:0.09295
56 ROUGE-2 Eval D0716-B.M.100.D-F.56 R:0.11111 P:0.08943 F:0.09910
56 ROUGE-2 Eval D0716-C.M.100.D-C.56 R:0.09211 P:0.07650 F:0.08358
56 ROUGE-2 Eval D0716-C.M.100.D-D.56 R:0.10135 P:0.08197 F:0.09064
56 ROUGE-2 Eval D0716-C.M.100.D-E.56 R:0.08333 P:0.06831 F:0.07508
56 ROUGE-2 Eval D0716-C.M.100.D-F.56 R:0.08418 P:0.06831 F:0.07542
56 ROUGE-2 Eval D0721-A.M.100.E-B.56 R:0.02694 P:0.02260 F:0.02458
56 ROUGE-2 Eval D0721-A.M.100.E-C.56 R:0.03279 P:0.02825 F:0.03035
56 ROUGE-2 Eval D0721-A.M.100.E-E.56 R:0.02951 P:0.02542 F:0.02731
56 ROUGE-2 Eval D0721-A.M.100.E-G.56 R:0.02894 P:0.02542 F:0.02707
56 ROUGE-2 Eval D0721-B.M.100.E-B.56 R:0.09211 P:0.07843 F:0.08472
56 ROUGE-2 Eval D0721-B.M.100.E-C.56 R:0.07717 P:0.06723 F:0.07186
56 ROUGE-2 Eval D0721-B.M.100.E-E.56 R:0.11258 P:0.09524 F:0.10319
56 ROUGE-2 Eval D0721-B.M.100.E-G.56 R:0.10098 P:0.08683 F:0.09337
56 ROUGE-2 Eval D0721-C.M.100.E-B.56 R:0.06954 P:0.05932 F:0.06402
56 ROUGE-2 Eval D0721-C.M.100.E-C.56 R:0.07667 P:0.06497 F:0.07034
56 ROUGE-2 Eval D0721-C.M.100.E-E.56 R:0.08081 P:0.06780 F:0.07374
56 ROUGE-2 Eval D0721-C.M.100.E-G.56 R:0.07237 P:0.06215 F:0.06687
56 ROUGE-2 Eval D0726-A.M.100.F-A.56 R:0.04027 P:0.03333 F:0.03647
56 ROUGE-2 Eval D0726-A.M.100.F-E.56 R:0.02694 P:0.02222 F:0.02435
56 ROUGE-2 Eval D0726-A.M.100.F-F.56 R:0.02685 P:0.02222 F:0.02432
56 ROUGE-2 Eval D0726-A.M.100.F-G.56 R:0.02685 P:0.02222 F:0.02432
56 ROUGE-2 Eval D0726-B.M.100.F-A.56 R:0.02970 P:0.02521 F:0.02727
56 ROUGE-2 Eval D0726-B.M.100.F-E.56 R:0.02349 P:0.01961 F:0.02138
56 ROUGE-2 Eval D0726-B.M.100.F-F.56 R:0.03020 P:0.02521 F:0.02748
56 ROUGE-2 Eval D0726-B.M.100.F-G.56 R:0.02658 P:0.02241 F:0.02432
56 ROUGE-2 Eval D0726-C.M.100.F-A.56 R:0.04714 P:0.03825 F:0.04223
56 ROUGE-2 Eval D0726-C.M.100.F-E.56 R:0.04082 P:0.03279 F:0.03637
56 ROUGE-2 Eval D0726-C.M.100.F-F.56 R:0.04795 P:0.03825 F:0.04255
56 ROUGE-2 Eval D0726-C.M.100.F-G.56 R:0.04636 P:0.03825 F:0.04192
56 ROUGE-2 Eval D0727-A.M.100.G-A.56 R:0.09060 P:0.07627 F:0.08282
56 ROUGE-2 Eval D0727-A.M.100.G-F.56 R:0.09967 P:0.08475 F:0.09161
56 ROUGE-2 Eval D0727-A.M.100.G-G.56 R:0.07261 P:0.06215 F:0.06697
56 ROUGE-2 Eval D0727-A.M.100.G-H.56 R:0.09635 P:0.08192 F:0.08855
56 ROUGE-2 Eval D0727-B.M.100.G-A.56 R:0.07986 P:0.06667 F:0.07267
56 ROUGE-2 Eval D0727-B.M.100.G-F.56 R:0.07869 P:0.06957 F:0.07385
56 ROUGE-2 Eval D0727-B.M.100.G-G.56 R:0.06294 P:0.05217 F:0.05705
56 ROUGE-2 Eval D0727-B.M.100.G-H.56 R:0.08681 P:0.07246 F:0.07899
56 ROUGE-2 Eval D0727-C.M.100.G-A.56 R:0.03618 P:0.03107 F:0.03343
56 ROUGE-2 Eval D0727-C.M.100.G-F.56 R:0.07823 P:0.06497 F:0.07099
56 ROUGE-2 Eval D0727-C.M.100.G-G.56 R:0.06333 P:0.05367 F:0.05810
56 ROUGE-2 Eval D0727-C.M.100.G-H.56 R:0.07509 P:0.06215 F:0.06801
56 ROUGE-2 Eval D0736-A.M.100.H-G.56 R:0.02174 P:0.01639 F:0.01869
56 ROUGE-2 Eval D0736-A.M.100.H-H.56 R:0.02583 P:0.01913 F:0.02198
56 ROUGE-2 Eval D0736-A.M.100.H-I.56 R:0.02158 P:0.01639 F:0.01863
56 ROUGE-2 Eval D0736-A.M.100.H-J.56 R:0.02640 P:0.02186 F:0.02392
56 ROUGE-2 Eval D0736-B.M.100.H-G.56 R:0.05405 P:0.03922 F:0.04546
56 ROUGE-2 Eval D0736-B.M.100.H-H.56 R:0.05439 P:0.03641 F:0.04362
56 ROUGE-2 Eval D0736-B.M.100.H-I.56 R:0.00847 P:0.00560 F:0.00674
56 ROUGE-2 Eval D0736-B.M.100.H-J.56 R:0.04594 P:0.03641 F:0.04062
56 ROUGE-2 Eval D0736-C.M.100.H-G.56 R:0.02564 P:0.01802 F:0.02117
56 ROUGE-2 Eval D0736-C.M.100.H-H.56 R:0.02717 P:0.01502 F:0.01935
56 ROUGE-2 Eval D0736-C.M.100.H-I.56 R:0.03804 P:0.02102 F:0.02708
56 ROUGE-2 Eval D0736-C.M.100.H-J.56 R:0.02290 P:0.01802 F:0.02017
56 ROUGE-2 Eval D0740-A.M.100.I-D.56 R:0.08333 P:0.06667 F:0.07407
56 ROUGE-2 Eval D0740-A.M.100.I-H.56 R:0.07921 P:0.06400 F:0.07080
56 ROUGE-2 Eval D0740-A.M.100.I-I.56 R:0.05574 P:0.04533 F:0.05000
56 ROUGE-2 Eval D0740-A.M.100.I-J.56 R:0.06840 P:0.05600 F:0.06158
56 ROUGE-2 Eval D0740-B.M.100.I-D.56 R:0.02295 P:0.02047 F:0.02164
56 ROUGE-2 Eval D0740-B.M.100.I-H.56 R:0.02007 P:0.01754 F:0.01872
56 ROUGE-2 Eval D0740-B.M.100.I-I.56 R:0.02980 P:0.02632 F:0.02795
56 ROUGE-2 Eval D0740-B.M.100.I-J.56 R:0.02614 P:0.02339 F:0.02469
56 ROUGE-2 Eval D0740-C.M.100.I-D.56 R:0.12581 P:0.10744 F:0.11590
56 ROUGE-2 Eval D0740-C.M.100.I-H.56 R:0.11039 P:0.09366 F:0.10134
56 ROUGE-2 Eval D0740-C.M.100.I-I.56 R:0.12258 P:0.10468 F:0.11293
56 ROUGE-2 Eval D0740-C.M.100.I-J.56 R:0.11576 P:0.09917 F:0.10682
56 ROUGE-2 Eval D0743-A.M.100.J-B.56 R:0.02564 P:0.02204 F:0.02370
56 ROUGE-2 Eval D0743-A.M.100.J-H.56 R:0.01869 P:0.01653 F:0.01754
56 ROUGE-2 Eval D0743-A.M.100.J-I.56 R:0.01577 P:0.01377 F:0.01470
56 ROUGE-2 Eval D0743-A.M.100.J-J.56 R:0.01553 P:0.01377 F:0.01460
56 ROUGE-2 Eval D0743-B.M.100.J-B.56 R:0.00647 P:0.00546 F:0.00592
56 ROUGE-2 Eval D0743-B.M.100.J-H.56 R:0.01274 P:0.01093 F:0.01177
56 ROUGE-2 Eval D0743-B.M.100.J-I.56 R:0.01278 P:0.01093 F:0.01178
56 ROUGE-2 Eval D0743-B.M.100.J-J.56 R:0.00629 P:0.00546 F:0.00585
56 ROUGE-2 Eval D0743-C.M.100.J-B.56 R:0.02885 P:0.02459 F:0.02655
56 ROUGE-2 Eval D0743-C.M.100.J-H.56 R:0.00965 P:0.00820 F:0.00887
56 ROUGE-2 Eval D0743-C.M.100.J-I.56 R:0.03226 P:0.02732 F:0.02959
56 ROUGE-2 Eval D0743-C.M.100.J-J.56 R:0.02540 P:0.02186 F:0.02350
---------------------------------------------
56 ROUGE-3 Average_R: 0.02059 (95%-conf.int. 0.01686 - 0.02453)
56 ROUGE-3 Average_P: 0.01703 (95%-conf.int. 0.01391 - 0.02034)
56 ROUGE-3 Average_F: 0.01864 (95%-conf.int. 0.01523 - 0.02222)
.............................................
56 ROUGE-3 Eval D0703-A.M.100.A-A.56 R:0.00690 P:0.00551 F:0.00613
56 ROUGE-3 Eval D0703-A.M.100.A-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0703-A.M.100.A-D.56 R:0.00702 P:0.00551 F:0.00617
56 ROUGE-3 Eval D0703-A.M.100.A-J.56 R:0.00694 P:0.00551 F:0.00614
56 ROUGE-3 Eval D0703-B.M.100.A-A.56 R:0.06000 P:0.05085 F:0.05505
56 ROUGE-3 Eval D0703-B.M.100.A-C.56 R:0.04795 P:0.03955 F:0.04335
56 ROUGE-3 Eval D0703-B.M.100.A-D.56 R:0.05822 P:0.04802 F:0.05263
56 ROUGE-3 Eval D0703-B.M.100.A-J.56 R:0.06780 P:0.05650 F:0.06164
56 ROUGE-3 Eval D0703-C.M.100.A-A.56 R:0.01701 P:0.01377 F:0.01522
56 ROUGE-3 Eval D0703-C.M.100.A-C.56 R:0.01987 P:0.01653 F:0.01805
56 ROUGE-3 Eval D0703-C.M.100.A-D.56 R:0.01689 P:0.01377 F:0.01517
56 ROUGE-3 Eval D0703-C.M.100.A-J.56 R:0.00676 P:0.00551 F:0.00607
56 ROUGE-3 Eval D0706-A.M.100.B-B.56 R:0.03642 P:0.03134 F:0.03369
56 ROUGE-3 Eval D0706-A.M.100.B-D.56 R:0.03667 P:0.03134 F:0.03380
56 ROUGE-3 Eval D0706-A.M.100.B-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0706-A.M.100.B-I.56 R:0.03642 P:0.03134 F:0.03369
56 ROUGE-3 Eval D0706-B.M.100.B-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0706-B.M.100.B-D.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0706-B.M.100.B-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0706-B.M.100.B-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0706-C.M.100.B-B.56 R:0.01974 P:0.01626 F:0.01783
56 ROUGE-3 Eval D0706-C.M.100.B-D.56 R:0.02303 P:0.01897 F:0.02080
56 ROUGE-3 Eval D0706-C.M.100.B-E.56 R:0.02614 P:0.02168 F:0.02370
56 ROUGE-3 Eval D0706-C.M.100.B-I.56 R:0.00977 P:0.00813 F:0.00887
56 ROUGE-3 Eval D0711-A.M.100.C-A.56 R:0.01678 P:0.01355 F:0.01499
56 ROUGE-3 Eval D0711-A.M.100.C-B.56 R:0.01701 P:0.01355 F:0.01508
56 ROUGE-3 Eval D0711-A.M.100.C-C.56 R:0.00680 P:0.00542 F:0.00603
56 ROUGE-3 Eval D0711-A.M.100.C-F.56 R:0.01014 P:0.00813 F:0.00902
56 ROUGE-3 Eval D0711-B.M.100.C-A.56 R:0.00347 P:0.00280 F:0.00310
56 ROUGE-3 Eval D0711-B.M.100.C-B.56 R:0.00350 P:0.00280 F:0.00311
56 ROUGE-3 Eval D0711-B.M.100.C-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0711-B.M.100.C-F.56 R:0.00346 P:0.00280 F:0.00310
56 ROUGE-3 Eval D0711-C.M.100.C-A.56 R:0.05387 P:0.04408 F:0.04849
56 ROUGE-3 Eval D0711-C.M.100.C-B.56 R:0.05923 P:0.04683 F:0.05231
56 ROUGE-3 Eval D0711-C.M.100.C-C.56 R:0.02414 P:0.01928 F:0.02144
56 ROUGE-3 Eval D0711-C.M.100.C-F.56 R:0.04828 P:0.03857 F:0.04288
56 ROUGE-3 Eval D0716-A.M.100.D-C.56 R:0.07358 P:0.06162 F:0.06707
56 ROUGE-3 Eval D0716-A.M.100.D-D.56 R:0.09184 P:0.07563 F:0.08295
56 ROUGE-3 Eval D0716-A.M.100.D-E.56 R:0.07458 P:0.06162 F:0.06748
56 ROUGE-3 Eval D0716-A.M.100.D-F.56 R:0.07407 P:0.06162 F:0.06727
56 ROUGE-3 Eval D0716-B.M.100.D-C.56 R:0.03691 P:0.03005 F:0.03313
56 ROUGE-3 Eval D0716-B.M.100.D-D.56 R:0.04110 P:0.03279 F:0.03648
56 ROUGE-3 Eval D0716-B.M.100.D-E.56 R:0.04068 P:0.03279 F:0.03631
56 ROUGE-3 Eval D0716-B.M.100.D-F.56 R:0.04422 P:0.03552 F:0.03940
56 ROUGE-3 Eval D0716-C.M.100.D-C.56 R:0.03987 P:0.03306 F:0.03615
56 ROUGE-3 Eval D0716-C.M.100.D-D.56 R:0.04437 P:0.03581 F:0.03963
56 ROUGE-3 Eval D0716-C.M.100.D-E.56 R:0.03367 P:0.02755 F:0.03030
56 ROUGE-3 Eval D0716-C.M.100.D-F.56 R:0.03401 P:0.02755 F:0.03044
56 ROUGE-3 Eval D0721-A.M.100.E-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0721-A.M.100.E-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0721-A.M.100.E-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0721-A.M.100.E-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0721-B.M.100.E-B.56 R:0.05648 P:0.04802 F:0.05191
56 ROUGE-3 Eval D0721-B.M.100.E-C.56 R:0.02597 P:0.02260 F:0.02417
56 ROUGE-3 Eval D0721-B.M.100.E-E.56 R:0.06020 P:0.05085 F:0.05513
56 ROUGE-3 Eval D0721-B.M.100.E-G.56 R:0.05592 P:0.04802 F:0.05167
56 ROUGE-3 Eval D0721-C.M.100.E-B.56 R:0.01672 P:0.01425 F:0.01539
56 ROUGE-3 Eval D0721-C.M.100.E-C.56 R:0.03030 P:0.02564 F:0.02778
56 ROUGE-3 Eval D0721-C.M.100.E-E.56 R:0.03061 P:0.02564 F:0.02791
56 ROUGE-3 Eval D0721-C.M.100.E-G.56 R:0.03322 P:0.02849 F:0.03067
56 ROUGE-3 Eval D0726-A.M.100.F-A.56 R:0.00339 P:0.00280 F:0.00307
56 ROUGE-3 Eval D0726-A.M.100.F-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0726-A.M.100.F-F.56 R:0.00339 P:0.00280 F:0.00307
56 ROUGE-3 Eval D0726-A.M.100.F-G.56 R:0.00339 P:0.00280 F:0.00307
56 ROUGE-3 Eval D0726-B.M.100.F-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0726-B.M.100.F-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0726-B.M.100.F-F.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0726-B.M.100.F-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0726-C.M.100.F-A.56 R:0.01020 P:0.00826 F:0.00913
56 ROUGE-3 Eval D0726-C.M.100.F-E.56 R:0.01031 P:0.00826 F:0.00917
56 ROUGE-3 Eval D0726-C.M.100.F-F.56 R:0.01384 P:0.01102 F:0.01227
56 ROUGE-3 Eval D0726-C.M.100.F-G.56 R:0.00669 P:0.00551 F:0.00604
56 ROUGE-3 Eval D0727-A.M.100.G-A.56 R:0.02712 P:0.02279 F:0.02477
56 ROUGE-3 Eval D0727-A.M.100.G-F.56 R:0.03691 P:0.03134 F:0.03390
56 ROUGE-3 Eval D0727-A.M.100.G-G.56 R:0.02333 P:0.01994 F:0.02150
56 ROUGE-3 Eval D0727-A.M.100.G-H.56 R:0.03356 P:0.02849 F:0.03082
56 ROUGE-3 Eval D0727-B.M.100.G-A.56 R:0.02807 P:0.02339 F:0.02552
56 ROUGE-3 Eval D0727-B.M.100.G-F.56 R:0.02318 P:0.02047 F:0.02174
56 ROUGE-3 Eval D0727-B.M.100.G-G.56 R:0.01767 P:0.01462 F:0.01600
56 ROUGE-3 Eval D0727-B.M.100.G-H.56 R:0.03509 P:0.02924 F:0.03190
56 ROUGE-3 Eval D0727-C.M.100.G-A.56 R:0.00664 P:0.00570 F:0.00613
56 ROUGE-3 Eval D0727-C.M.100.G-F.56 R:0.03780 P:0.03134 F:0.03427
56 ROUGE-3 Eval D0727-C.M.100.G-G.56 R:0.03367 P:0.02849 F:0.03086
56 ROUGE-3 Eval D0727-C.M.100.G-H.56 R:0.03448 P:0.02849 F:0.03120
56 ROUGE-3 Eval D0736-A.M.100.H-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-A.M.100.H-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-A.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-A.M.100.H-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-B.M.100.H-G.56 R:0.03125 P:0.02260 F:0.02623
56 ROUGE-3 Eval D0736-B.M.100.H-H.56 R:0.03390 P:0.02260 F:0.02712
56 ROUGE-3 Eval D0736-B.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-B.M.100.H-J.56 R:0.02857 P:0.02260 F:0.02524
56 ROUGE-3 Eval D0736-C.M.100.H-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-C.M.100.H-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-C.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0736-C.M.100.H-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0740-A.M.100.I-D.56 R:0.01684 P:0.01344 F:0.01495
56 ROUGE-3 Eval D0740-A.M.100.I-H.56 R:0.01333 P:0.01075 F:0.01190
56 ROUGE-3 Eval D0740-A.M.100.I-I.56 R:0.00662 P:0.00538 F:0.00594
56 ROUGE-3 Eval D0740-A.M.100.I-J.56 R:0.01316 P:0.01075 F:0.01183
56 ROUGE-3 Eval D0740-B.M.100.I-D.56 R:0.00331 P:0.00295 F:0.00312
56 ROUGE-3 Eval D0740-B.M.100.I-H.56 R:0.00338 P:0.00295 F:0.00315
56 ROUGE-3 Eval D0740-B.M.100.I-I.56 R:0.00669 P:0.00590 F:0.00627
56 ROUGE-3 Eval D0740-B.M.100.I-J.56 R:0.00660 P:0.00590 F:0.00623
56 ROUGE-3 Eval D0740-C.M.100.I-D.56 R:0.04886 P:0.04167 F:0.04498
56 ROUGE-3 Eval D0740-C.M.100.I-H.56 R:0.03607 P:0.03056 F:0.03309
56 ROUGE-3 Eval D0740-C.M.100.I-I.56 R:0.03909 P:0.03333 F:0.03598
56 ROUGE-3 Eval D0740-C.M.100.I-J.56 R:0.04221 P:0.03611 F:0.03892
56 ROUGE-3 Eval D0743-A.M.100.J-B.56 R:0.00324 P:0.00278 F:0.00299
56 ROUGE-3 Eval D0743-A.M.100.J-H.56 R:0.00314 P:0.00278 F:0.00295
56 ROUGE-3 Eval D0743-A.M.100.J-I.56 R:0.00318 P:0.00278 F:0.00297
56 ROUGE-3 Eval D0743-A.M.100.J-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0743-B.M.100.J-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0743-B.M.100.J-H.56 R:0.00322 P:0.00275 F:0.00297
56 ROUGE-3 Eval D0743-B.M.100.J-I.56 R:0.00323 P:0.00275 F:0.00297
56 ROUGE-3 Eval D0743-B.M.100.J-J.56 R:0.00317 P:0.00275 F:0.00295
56 ROUGE-3 Eval D0743-C.M.100.J-B.56 R:0.01294 P:0.01102 F:0.01190
56 ROUGE-3 Eval D0743-C.M.100.J-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-3 Eval D0743-C.M.100.J-I.56 R:0.01303 P:0.01102 F:0.01194
56 ROUGE-3 Eval D0743-C.M.100.J-J.56 R:0.01282 P:0.01102 F:0.01185
---------------------------------------------
56 ROUGE-4 Average_R: 0.00867 (95%-conf.int. 0.00639 - 0.01114)
56 ROUGE-4 Average_P: 0.00716 (95%-conf.int. 0.00528 - 0.00918)
56 ROUGE-4 Average_F: 0.00784 (95%-conf.int. 0.00577 - 0.01007)
.............................................
56 ROUGE-4 Eval D0703-A.M.100.A-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0703-A.M.100.A-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0703-A.M.100.A-D.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0703-A.M.100.A-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0703-B.M.100.A-A.56 R:0.03367 P:0.02849 F:0.03086
56 ROUGE-4 Eval D0703-B.M.100.A-C.56 R:0.01730 P:0.01425 F:0.01563
56 ROUGE-4 Eval D0703-B.M.100.A-D.56 R:0.02422 P:0.01994 F:0.02187
56 ROUGE-4 Eval D0703-B.M.100.A-J.56 R:0.03767 P:0.03134 F:0.03421
56 ROUGE-4 Eval D0703-C.M.100.A-A.56 R:0.00344 P:0.00278 F:0.00307
56 ROUGE-4 Eval D0703-C.M.100.A-C.56 R:0.00334 P:0.00278 F:0.00303
56 ROUGE-4 Eval D0703-C.M.100.A-D.56 R:0.00341 P:0.00278 F:0.00306
56 ROUGE-4 Eval D0703-C.M.100.A-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-A.M.100.B-B.56 R:0.02341 P:0.02011 F:0.02163
56 ROUGE-4 Eval D0706-A.M.100.B-D.56 R:0.02357 P:0.02011 F:0.02170
56 ROUGE-4 Eval D0706-A.M.100.B-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-A.M.100.B-I.56 R:0.02341 P:0.02011 F:0.02163
56 ROUGE-4 Eval D0706-B.M.100.B-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-B.M.100.B-D.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-B.M.100.B-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-B.M.100.B-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0706-C.M.100.B-B.56 R:0.00997 P:0.00820 F:0.00900
56 ROUGE-4 Eval D0706-C.M.100.B-D.56 R:0.00997 P:0.00820 F:0.00900
56 ROUGE-4 Eval D0706-C.M.100.B-E.56 R:0.00990 P:0.00820 F:0.00897
56 ROUGE-4 Eval D0706-C.M.100.B-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-A.M.100.C-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-A.M.100.C-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-A.M.100.C-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-A.M.100.C-F.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-B.M.100.C-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-B.M.100.C-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-B.M.100.C-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-B.M.100.C-F.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0711-C.M.100.C-A.56 R:0.02381 P:0.01944 F:0.02140
56 ROUGE-4 Eval D0711-C.M.100.C-B.56 R:0.02817 P:0.02222 F:0.02484
56 ROUGE-4 Eval D0711-C.M.100.C-C.56 R:0.00697 P:0.00556 F:0.00619
56 ROUGE-4 Eval D0711-C.M.100.C-F.56 R:0.02439 P:0.01944 F:0.02164
56 ROUGE-4 Eval D0716-A.M.100.D-C.56 R:0.04054 P:0.03390 F:0.03692
56 ROUGE-4 Eval D0716-A.M.100.D-D.56 R:0.06186 P:0.05085 F:0.05582
56 ROUGE-4 Eval D0716-A.M.100.D-E.56 R:0.05137 P:0.04237 F:0.04644
56 ROUGE-4 Eval D0716-A.M.100.D-F.56 R:0.04082 P:0.03390 F:0.03704
56 ROUGE-4 Eval D0716-B.M.100.D-C.56 R:0.00678 P:0.00551 F:0.00608
56 ROUGE-4 Eval D0716-B.M.100.D-D.56 R:0.00346 P:0.00275 F:0.00306
56 ROUGE-4 Eval D0716-B.M.100.D-E.56 R:0.00685 P:0.00551 F:0.00611
56 ROUGE-4 Eval D0716-B.M.100.D-F.56 R:0.00344 P:0.00275 F:0.00306
56 ROUGE-4 Eval D0716-C.M.100.D-C.56 R:0.01007 P:0.00833 F:0.00912
56 ROUGE-4 Eval D0716-C.M.100.D-D.56 R:0.01379 P:0.01111 F:0.01231
56 ROUGE-4 Eval D0716-C.M.100.D-E.56 R:0.01020 P:0.00833 F:0.00917
56 ROUGE-4 Eval D0716-C.M.100.D-F.56 R:0.00687 P:0.00556 F:0.00615
56 ROUGE-4 Eval D0721-A.M.100.E-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0721-A.M.100.E-C.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0721-A.M.100.E-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0721-A.M.100.E-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0721-B.M.100.E-B.56 R:0.04027 P:0.03419 F:0.03698
56 ROUGE-4 Eval D0721-B.M.100.E-C.56 R:0.00984 P:0.00855 F:0.00915
56 ROUGE-4 Eval D0721-B.M.100.E-E.56 R:0.04392 P:0.03704 F:0.04019
56 ROUGE-4 Eval D0721-B.M.100.E-G.56 R:0.03654 P:0.03134 F:0.03374
56 ROUGE-4 Eval D0721-C.M.100.E-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0721-C.M.100.E-C.56 R:0.01020 P:0.00862 F:0.00934
56 ROUGE-4 Eval D0721-C.M.100.E-E.56 R:0.01031 P:0.00862 F:0.00939
56 ROUGE-4 Eval D0721-C.M.100.E-G.56 R:0.01007 P:0.00862 F:0.00929
56 ROUGE-4 Eval D0726-A.M.100.F-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-A.M.100.F-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-A.M.100.F-F.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-A.M.100.F-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-B.M.100.F-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-B.M.100.F-E.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-B.M.100.F-F.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-B.M.100.F-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0726-C.M.100.F-A.56 R:0.00344 P:0.00278 F:0.00307
56 ROUGE-4 Eval D0726-C.M.100.F-E.56 R:0.00347 P:0.00278 F:0.00309
56 ROUGE-4 Eval D0726-C.M.100.F-F.56 R:0.00350 P:0.00278 F:0.00310
56 ROUGE-4 Eval D0726-C.M.100.F-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0727-A.M.100.G-A.56 R:0.00685 P:0.00575 F:0.00625
56 ROUGE-4 Eval D0727-A.M.100.G-F.56 R:0.01017 P:0.00862 F:0.00933
56 ROUGE-4 Eval D0727-A.M.100.G-G.56 R:0.00337 P:0.00287 F:0.00310
56 ROUGE-4 Eval D0727-A.M.100.G-H.56 R:0.01017 P:0.00862 F:0.00933
56 ROUGE-4 Eval D0727-B.M.100.G-A.56 R:0.01418 P:0.01180 F:0.01288
56 ROUGE-4 Eval D0727-B.M.100.G-F.56 R:0.01003 P:0.00885 F:0.00940
56 ROUGE-4 Eval D0727-B.M.100.G-G.56 R:0.00357 P:0.00295 F:0.00323
56 ROUGE-4 Eval D0727-B.M.100.G-H.56 R:0.01418 P:0.01180 F:0.01288
56 ROUGE-4 Eval D0727-C.M.100.G-A.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0727-C.M.100.G-F.56 R:0.02431 P:0.02011 F:0.02201
56 ROUGE-4 Eval D0727-C.M.100.G-G.56 R:0.02381 P:0.02011 F:0.02180
56 ROUGE-4 Eval D0727-C.M.100.G-H.56 R:0.02439 P:0.02011 F:0.02204
56 ROUGE-4 Eval D0736-A.M.100.H-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-A.M.100.H-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-A.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-A.M.100.H-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-B.M.100.H-G.56 R:0.02372 P:0.01709 F:0.01987
56 ROUGE-4 Eval D0736-B.M.100.H-H.56 R:0.02575 P:0.01709 F:0.02054
56 ROUGE-4 Eval D0736-B.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-B.M.100.H-J.56 R:0.02166 P:0.01709 F:0.01911
56 ROUGE-4 Eval D0736-C.M.100.H-G.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-C.M.100.H-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-C.M.100.H-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0736-C.M.100.H-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-A.M.100.I-D.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-A.M.100.I-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-A.M.100.I-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-A.M.100.I-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-B.M.100.I-D.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-B.M.100.I-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-B.M.100.I-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-B.M.100.I-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0740-C.M.100.I-D.56 R:0.02303 P:0.01961 F:0.02118
56 ROUGE-4 Eval D0740-C.M.100.I-H.56 R:0.01325 P:0.01120 F:0.01214
56 ROUGE-4 Eval D0740-C.M.100.I-I.56 R:0.01645 P:0.01401 F:0.01513
56 ROUGE-4 Eval D0740-C.M.100.I-J.56 R:0.01639 P:0.01401 F:0.01511
56 ROUGE-4 Eval D0743-A.M.100.J-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-A.M.100.J-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-A.M.100.J-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-A.M.100.J-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-B.M.100.J-B.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-B.M.100.J-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-B.M.100.J-I.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-B.M.100.J-J.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-C.M.100.J-B.56 R:0.00654 P:0.00556 F:0.00601
56 ROUGE-4 Eval D0743-C.M.100.J-H.56 R:0.00000 P:0.00000 F:0.00000
56 ROUGE-4 Eval D0743-C.M.100.J-I.56 R:0.00658 P:0.00556 F:0.00603
56 ROUGE-4 Eval D0743-C.M.100.J-J.56 R:0.00647 P:0.00556 F:0.00598
---------------------------------------------
56 ROUGE-L Average_R: 0.25448 (95%-conf.int. 0.24531 - 0.26378)
56 ROUGE-L Average_P: 0.20988 (95%-conf.int. 0.20175 - 0.21794)
56 ROUGE-L Average_F: 0.22984 (95%-conf.int. 0.22115 - 0.23847)
.............................................
56 ROUGE-L Eval D0703-A.M.100.A-A.56 R:0.27027 P:0.21680 F:0.24060
56 ROUGE-L Eval D0703-A.M.100.A-C.56 R:0.22483 P:0.18157 F:0.20090
56 ROUGE-L Eval D0703-A.M.100.A-D.56 R:0.25086 P:0.19783 F:0.22121
56 ROUGE-L Eval D0703-A.M.100.A-J.56 R:0.26190 P:0.20867 F:0.23227
56 ROUGE-L Eval D0703-B.M.100.A-A.56 R:0.31699 P:0.26944 F:0.29129
56 ROUGE-L Eval D0703-B.M.100.A-C.56 R:0.27852 P:0.23056 F:0.25228
56 ROUGE-L Eval D0703-B.M.100.A-D.56 R:0.30537 P:0.25278 F:0.27660
56 ROUGE-L Eval D0703-B.M.100.A-J.56 R:0.31561 P:0.26389 F:0.28744
56 ROUGE-L Eval D0703-C.M.100.A-A.56 R:0.29333 P:0.23848 F:0.26308
56 ROUGE-L Eval D0703-C.M.100.A-C.56 R:0.26948 P:0.22493 F:0.24520
56 ROUGE-L Eval D0703-C.M.100.A-D.56 R:0.26159 P:0.21409 F:0.23547
56 ROUGE-L Eval D0703-C.M.100.A-J.56 R:0.29470 P:0.24119 F:0.26527
56 ROUGE-L Eval D0706-A.M.100.B-B.56 R:0.29870 P:0.25770 F:0.27669
56 ROUGE-L Eval D0706-A.M.100.B-D.56 R:0.27778 P:0.23810 F:0.25641
56 ROUGE-L Eval D0706-A.M.100.B-E.56 R:0.22403 P:0.19328 F:0.20752
56 ROUGE-L Eval D0706-A.M.100.B-I.56 R:0.26299 P:0.22689 F:0.24361
56 ROUGE-L Eval D0706-B.M.100.B-B.56 R:0.23529 P:0.19672 F:0.21428
56 ROUGE-L Eval D0706-B.M.100.B-D.56 R:0.23127 P:0.19399 F:0.21100
56 ROUGE-L Eval D0706-B.M.100.B-E.56 R:0.22403 P:0.18852 F:0.20475
56 ROUGE-L Eval D0706-B.M.100.B-I.56 R:0.23625 P:0.19945 F:0.21630
56 ROUGE-L Eval D0706-C.M.100.B-B.56 R:0.29355 P:0.24267 F:0.26570
56 ROUGE-L Eval D0706-C.M.100.B-D.56 R:0.29032 P:0.24000 F:0.26277
56 ROUGE-L Eval D0706-C.M.100.B-E.56 R:0.30128 P:0.25067 F:0.27365
56 ROUGE-L Eval D0706-C.M.100.B-I.56 R:0.27157 P:0.22667 F:0.24710
56 ROUGE-L Eval D0711-A.M.100.C-A.56 R:0.26316 P:0.21333 F:0.23564
56 ROUGE-L Eval D0711-A.M.100.C-B.56 R:0.26667 P:0.21333 F:0.23704
56 ROUGE-L Eval D0711-A.M.100.C-C.56 R:0.24667 P:0.19733 F:0.21926
56 ROUGE-L Eval D0711-A.M.100.C-F.56 R:0.24834 P:0.20000 F:0.22156
56 ROUGE-L Eval D0711-B.M.100.C-A.56 R:0.23469 P:0.19008 F:0.21004
56 ROUGE-L Eval D0711-B.M.100.C-B.56 R:0.21575 P:0.17355 F:0.19236
56 ROUGE-L Eval D0711-B.M.100.C-C.56 R:0.22148 P:0.18182 F:0.19970
56 ROUGE-L Eval D0711-B.M.100.C-F.56 R:0.23390 P:0.19008 F:0.20973
56 ROUGE-L Eval D0711-C.M.100.C-A.56 R:0.33333 P:0.27371 F:0.30059
56 ROUGE-L Eval D0711-C.M.100.C-B.56 R:0.32423 P:0.25745 F:0.28701
56 ROUGE-L Eval D0711-C.M.100.C-C.56 R:0.29392 P:0.23577 F:0.26165
56 ROUGE-L Eval D0711-C.M.100.C-F.56 R:0.32095 P:0.25745 F:0.28571
56 ROUGE-L Eval D0716-A.M.100.D-C.56 R:0.35082 P:0.29477 F:0.32036
56 ROUGE-L Eval D0716-A.M.100.D-D.56 R:0.38333 P:0.31680 F:0.34690
56 ROUGE-L Eval D0716-A.M.100.D-E.56 R:0.37209 P:0.30854 F:0.33735
56 ROUGE-L Eval D0716-A.M.100.D-F.56 R:0.35314 P:0.29477 F:0.32133
56 ROUGE-L Eval D0716-B.M.100.D-C.56 R:0.35197 P:0.28763 F:0.31656
56 ROUGE-L Eval D0716-B.M.100.D-D.56 R:0.36913 P:0.29570 F:0.32836
56 ROUGE-L Eval D0716-B.M.100.D-E.56 R:0.34884 P:0.28226 F:0.31204
56 ROUGE-L Eval D0716-B.M.100.D-F.56 R:0.35667 P:0.28763 F:0.31845
56 ROUGE-L Eval D0716-C.M.100.D-C.56 R:0.28990 P:0.24119 F:0.26331
56 ROUGE-L Eval D0716-C.M.100.D-D.56 R:0.30769 P:0.24932 F:0.27545
56 ROUGE-L Eval D0716-C.M.100.D-E.56 R:0.28053 P:0.23035 F:0.25298
56 ROUGE-L Eval D0716-C.M.100.D-F.56 R:0.27333 P:0.22222 F:0.24514
56 ROUGE-L Eval D0721-A.M.100.E-B.56 R:0.21333 P:0.17927 F:0.19482
56 ROUGE-L Eval D0721-A.M.100.E-C.56 R:0.19805 P:0.17087 F:0.18346
56 ROUGE-L Eval D0721-A.M.100.E-E.56 R:0.19156 P:0.16527 F:0.17745
56 ROUGE-L Eval D0721-A.M.100.E-G.56 R:0.18790 P:0.16527 F:0.17586
56 ROUGE-L Eval D0721-B.M.100.E-B.56 R:0.24104 P:0.20556 F:0.22189
56 ROUGE-L Eval D0721-B.M.100.E-C.56 R:0.25478 P:0.22222 F:0.23739
56 ROUGE-L Eval D0721-B.M.100.E-E.56 R:0.25574 P:0.21667 F:0.23459
56 ROUGE-L Eval D0721-B.M.100.E-G.56 R:0.24839 P:0.21389 F:0.22985
56 ROUGE-L Eval D0721-C.M.100.E-B.56 R:0.27213 P:0.23249 F:0.25075
56 ROUGE-L Eval D0721-C.M.100.E-C.56 R:0.24092 P:0.20448 F:0.22121
56 ROUGE-L Eval D0721-C.M.100.E-E.56 R:0.24667 P:0.20728 F:0.22527
56 ROUGE-L Eval D0721-C.M.100.E-G.56 R:0.24756 P:0.21289 F:0.22892
56 ROUGE-L Eval D0726-A.M.100.F-A.56 R:0.22591 P:0.18733 F:0.20482
56 ROUGE-L Eval D0726-A.M.100.F-E.56 R:0.21000 P:0.17355 F:0.19004
56 ROUGE-L Eval D0726-A.M.100.F-F.56 R:0.22924 P:0.19008 F:0.20783
56 ROUGE-L Eval D0726-A.M.100.F-G.56 R:0.21262 P:0.17631 F:0.19277
56 ROUGE-L Eval D0726-B.M.100.F-A.56 R:0.21569 P:0.18333 F:0.19820
56 ROUGE-L Eval D0726-B.M.100.F-E.56 R:0.21595 P:0.18056 F:0.19668
56 ROUGE-L Eval D0726-B.M.100.F-F.56 R:0.21927 P:0.18333 F:0.19970
56 ROUGE-L Eval D0726-B.M.100.F-G.56 R:0.23026 P:0.19444 F:0.21084
56 ROUGE-L Eval D0726-C.M.100.F-A.56 R:0.23333 P:0.18970 F:0.20927
56 ROUGE-L Eval D0726-C.M.100.F-E.56 R:0.24242 P:0.19512 F:0.21621
56 ROUGE-L Eval D0726-C.M.100.F-F.56 R:0.25424 P:0.20325 F:0.22590
56 ROUGE-L Eval D0726-C.M.100.F-G.56 R:0.23279 P:0.19241 F:0.21068
56 ROUGE-L Eval D0727-A.M.100.G-A.56 R:0.30565 P:0.25770 F:0.27963
56 ROUGE-L Eval D0727-A.M.100.G-F.56 R:0.30592 P:0.26050 F:0.28139
56 ROUGE-L Eval D0727-A.M.100.G-G.56 R:0.27451 P:0.23529 F:0.25339
56 ROUGE-L Eval D0727-A.M.100.G-H.56 R:0.29934 P:0.25490 F:0.27534
56 ROUGE-L Eval D0727-B.M.100.G-A.56 R:0.26460 P:0.22126 F:0.24100
56 ROUGE-L Eval D0727-B.M.100.G-F.56 R:0.27273 P:0.24138 F:0.25610
56 ROUGE-L Eval D0727-B.M.100.G-G.56 R:0.23875 P:0.19828 F:0.21664
56 ROUGE-L Eval D0727-B.M.100.G-H.56 R:0.26117 P:0.21839 F:0.23787
56 ROUGE-L Eval D0727-C.M.100.G-A.56 R:0.28664 P:0.24650 F:0.26506
56 ROUGE-L Eval D0727-C.M.100.G-F.56 R:0.29966 P:0.24930 F:0.27217
56 ROUGE-L Eval D0727-C.M.100.G-G.56 R:0.28713 P:0.24370 F:0.26364
56 ROUGE-L Eval D0727-C.M.100.G-H.56 R:0.30405 P:0.25210 F:0.27565
56 ROUGE-L Eval D0736-A.M.100.H-G.56 R:0.23297 P:0.17615 F:0.20061
56 ROUGE-L Eval D0736-A.M.100.H-H.56 R:0.24453 P:0.18157 F:0.20840
56 ROUGE-L Eval D0736-A.M.100.H-I.56 R:0.22776 P:0.17344 F:0.19692
56 ROUGE-L Eval D0736-A.M.100.H-J.56 R:0.23203 P:0.19241 F:0.21037
56 ROUGE-L Eval D0736-B.M.100.H-G.56 R:0.22519 P:0.16389 F:0.18971
56 ROUGE-L Eval D0736-B.M.100.H-H.56 R:0.22727 P:0.15278 F:0.18272
56 ROUGE-L Eval D0736-B.M.100.H-I.56 R:0.18410 P:0.12222 F:0.14691
56 ROUGE-L Eval D0736-B.M.100.H-J.56 R:0.22378 P:0.17778 F:0.19815
56 ROUGE-L Eval D0736-C.M.100.H-G.56 R:0.19409 P:0.13690 F:0.16055
56 ROUGE-L Eval D0736-C.M.100.H-H.56 R:0.18182 P:0.10119 F:0.13002
56 ROUGE-L Eval D0736-C.M.100.H-I.56 R:0.21925 P:0.12202 F:0.15678
56 ROUGE-L Eval D0736-C.M.100.H-J.56 R:0.18868 P:0.14881 F:0.16639
56 ROUGE-L Eval D0740-A.M.100.I-D.56 R:0.30693 P:0.24603 F:0.27313
56 ROUGE-L Eval D0740-A.M.100.I-H.56 R:0.30065 P:0.24339 F:0.26901
56 ROUGE-L Eval D0740-A.M.100.I-I.56 R:0.29221 P:0.23810 F:0.26239
56 ROUGE-L Eval D0740-A.M.100.I-J.56 R:0.27419 P:0.22487 F:0.24709
56 ROUGE-L Eval D0740-B.M.100.I-D.56 R:0.19156 P:0.17101 F:0.18070
56 ROUGE-L Eval D0740-B.M.100.I-H.56 R:0.19536 P:0.17101 F:0.18238
56 ROUGE-L Eval D0740-B.M.100.I-I.56 R:0.19344 P:0.17101 F:0.18153
56 ROUGE-L Eval D0740-B.M.100.I-J.56 R:0.19417 P:0.17391 F:0.18348
56 ROUGE-L Eval D0740-C.M.100.I-D.56 R:0.30032 P:0.25683 F:0.27688
56 ROUGE-L Eval D0740-C.M.100.I-H.56 R:0.30868 P:0.26230 F:0.28361
56 ROUGE-L Eval D0740-C.M.100.I-I.56 R:0.29712 P:0.25410 F:0.27393
56 ROUGE-L Eval D0740-C.M.100.I-J.56 R:0.30255 P:0.25956 F:0.27941
56 ROUGE-L Eval D0743-A.M.100.J-B.56 R:0.18413 P:0.15847 F:0.17034
56 ROUGE-L Eval D0743-A.M.100.J-H.56 R:0.16049 P:0.14208 F:0.15072
56 ROUGE-L Eval D0743-A.M.100.J-I.56 R:0.17188 P:0.15027 F:0.16035
56 ROUGE-L Eval D0743-A.M.100.J-J.56 R:0.14769 P:0.13115 F:0.13893
56 ROUGE-L Eval D0743-B.M.100.J-B.56 R:0.17628 P:0.14905 F:0.16153
56 ROUGE-L Eval D0743-B.M.100.J-H.56 R:0.15142 P:0.13008 F:0.13994
56 ROUGE-L Eval D0743-B.M.100.J-I.56 R:0.18987 P:0.16260 F:0.17518
56 ROUGE-L Eval D0743-B.M.100.J-J.56 R:0.17445 P:0.15176 F:0.16232
56 ROUGE-L Eval D0743-C.M.100.J-B.56 R:0.20635 P:0.17615 F:0.19006
56 ROUGE-L Eval D0743-C.M.100.J-H.56 R:0.17516 P:0.14905 F:0.16105
56 ROUGE-L Eval D0743-C.M.100.J-I.56 R:0.19808 P:0.16802 F:0.18182
56 ROUGE-L Eval D0743-C.M.100.J-J.56 R:0.18239 P:0.15718 F:0.16885
---------------------------------------------
56 ROUGE-W-1.2 Average_R: 0.08915 (95%-conf.int. 0.08612 - 0.09218)
56 ROUGE-W-1.2 Average_P: 0.13362 (95%-conf.int. 0.12844 - 0.13888)
56 ROUGE-W-1.2 Average_F: 0.10682 (95%-conf.int. 0.10304 - 0.11068)
.............................................
56 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.56 R:0.09309 P:0.13447 F:0.11002
56 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.56 R:0.07765 P:0.11398 F:0.09237
56 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.56 R:0.08620 P:0.12532 F:0.10214
56 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.56 R:0.09555 P:0.13023 F:0.11023
56 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.56 R:0.10888 P:0.17160 F:0.13323
56 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.56 R:0.09517 P:0.14908 F:0.11618
56 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.56 R:0.10405 P:0.16156 F:0.12658
56 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.56 R:0.10938 P:0.16963 F:0.13300
56 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.56 R:0.09796 P:0.14808 F:0.11792
56 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.56 R:0.08876 P:0.13988 F:0.10861
56 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.56 R:0.08701 P:0.13515 F:0.10586
56 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.56 R:0.10136 P:0.14941 F:0.12078
56 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.56 R:0.10697 P:0.16563 F:0.12999
56 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.56 R:0.09831 P:0.15463 F:0.12020
56 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.56 R:0.07797 P:0.12198 F:0.09513
56 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.56 R:0.09370 P:0.14980 F:0.11529
56 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.56 R:0.08459 P:0.12248 F:0.10007
56 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.56 R:0.08143 P:0.12045 F:0.09717
56 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.56 R:0.07977 P:0.11849 F:0.09535
56 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.56 R:0.08186 P:0.12498 F:0.09893
56 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.56 R:0.09564 P:0.13494 F:0.11194
56 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.56 R:0.09302 P:0.13237 F:0.10926
56 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.56 R:0.09942 P:0.14013 F:0.11632
56 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.56 R:0.09630 P:0.13960 F:0.11398
56 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.56 R:0.08952 P:0.13083 F:0.10630
56 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.56 R:0.09155 P:0.13266 F:0.10834
56 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.56 R:0.08509 P:0.12224 F:0.10034
56 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.56 R:0.08375 P:0.12235 F:0.09944
56 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.56 R:0.08147 P:0.11772 F:0.09630
56 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.56 R:0.07297 P:0.11000 F:0.08774
56 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.56 R:0.07357 P:0.11346 F:0.08926
56 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.56 R:0.07853 P:0.11852 F:0.09447
56 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.56 R:0.11459 P:0.17592 F:0.13878
56 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.56 R:0.11219 P:0.16659 F:0.13408
56 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.56 R:0.09758 P:0.14863 F:0.11781
56 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.56 R:0.10709 P:0.16556 F:0.13006
56 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.56 R:0.12968 P:0.19907 F:0.15705
56 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.56 R:0.13477 P:0.21220 F:0.16485
56 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.56 R:0.13440 P:0.20813 F:0.16333
56 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.56 R:0.12259 P:0.19460 F:0.15042
56 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.56 R:0.12456 P:0.17757 F:0.14641
56 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.56 R:0.12589 P:0.18048 F:0.14832
56 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.56 R:0.12518 P:0.18031 F:0.14777
56 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.56 R:0.12539 P:0.17898 F:0.14747
56 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.56 R:0.09728 P:0.15085 F:0.11828
56 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.56 R:0.10046 P:0.15787 F:0.12279
56 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.56 R:0.08895 P:0.14155 F:0.10925
56 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.56 R:0.08808 P:0.13931 F:0.10792
56 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.56 R:0.07848 P:0.11593 F:0.09360
56 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.56 R:0.07211 P:0.11037 F:0.08723
56 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.56 R:0.07005 P:0.10856 F:0.08515
56 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.56 R:0.06885 P:0.10613 F:0.08352
56 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.56 R:0.08117 P:0.13381 F:0.10105
56 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.56 R:0.08613 P:0.14119 F:0.10699
56 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.56 R:0.08478 P:0.14099 F:0.10589
56 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.56 R:0.07986 P:0.13724 F:0.10097
56 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.56 R:0.09658 P:0.15186 F:0.11807
56 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.56 R:0.08629 P:0.13779 F:0.10612
56 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.56 R:0.08706 P:0.13655 F:0.10633
56 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.56 R:0.08973 P:0.14430 F:0.11065
56 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.56 R:0.08047 P:0.11824 F:0.09577
56 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.56 R:0.07421 P:0.10745 F:0.08779
56 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.56 R:0.07952 P:0.11744 F:0.09483
56 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.56 R:0.07476 P:0.11221 F:0.08973
56 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.56 R:0.07817 P:0.11687 F:0.09368
56 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.56 R:0.07730 P:0.11667 F:0.09299
56 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.56 R:0.07706 P:0.11706 F:0.09294
56 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.56 R:0.08050 P:0.12274 F:0.09723
56 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.56 R:0.08467 P:0.12087 F:0.09958
56 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.56 R:0.08708 P:0.12370 F:0.10221
56 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.56 R:0.08901 P:0.12743 F:0.10481
56 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.56 R:0.08216 P:0.12160 F:0.09806
56 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.56 R:0.10808 P:0.16039 F:0.12914
56 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.56 R:0.10774 P:0.16746 F:0.13112
56 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.56 R:0.09816 P:0.14901 F:0.11835
56 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.56 R:0.10703 P:0.16337 F:0.12933
56 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.56 R:0.09720 P:0.14262 F:0.11561
56 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.56 R:0.09518 P:0.15131 F:0.11685
56 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.56 R:0.08493 P:0.12633 F:0.10157
56 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.56 R:0.09515 P:0.14084 F:0.11357
56 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.56 R:0.09947 P:0.15383 F:0.12082
56 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.56 R:0.10607 P:0.16309 F:0.12854
56 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.56 R:0.09950 P:0.15545 F:0.12134
56 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.56 R:0.11007 P:0.16426 F:0.13181
56 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.56 R:0.08281 P:0.11088 F:0.09481
56 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.56 R:0.08801 P:0.11493 F:0.09968
56 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.56 R:0.08066 P:0.10975 F:0.09298
56 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.56 R:0.08093 P:0.11964 F:0.09655
56 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.56 R:0.08167 P:0.11001 F:0.09374
56 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.56 R:0.08399 P:0.10446 F:0.09311
56 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.56 R:0.06584 P:0.08073 F:0.07253
56 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.56 R:0.07999 P:0.11748 F:0.09518
56 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.56 R:0.06860 P:0.08790 F:0.07706
56 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.56 R:0.06865 P:0.07141 F:0.07000
56 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.56 R:0.07947 P:0.08068 F:0.08007
56 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.56 R:0.06723 P:0.09460 F:0.07860
56 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.56 R:0.10604 P:0.15636 F:0.12638
56 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.56 R:0.10243 P:0.14959 F:0.12160
56 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.56 R:0.09904 P:0.14927 F:0.11907
56 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.56 R:0.09181 P:0.13832 F:0.11037
56 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.56 R:0.06870 P:0.11268 F:0.08536
56 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.56 R:0.07181 P:0.11187 F:0.08747
56 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.56 R:0.06824 P:0.11336 F:0.08519
56 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.56 R:0.07164 P:0.11471 F:0.08820
56 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.56 R:0.10293 P:0.16987 F:0.12819
56 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.56 R:0.10743 P:0.17036 F:0.13177
56 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.56 R:0.09859 P:0.16490 F:0.12340
56 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.56 R:0.10267 P:0.16879 F:0.12768
56 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.56 R:0.06984 P:0.10477 F:0.08381
56 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.56 R:0.06284 P:0.09609 F:0.07599
56 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.56 R:0.06231 P:0.09668 F:0.07578
56 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.56 R:0.05735 P:0.08840 F:0.06957
56 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.56 R:0.06715 P:0.09509 F:0.07871
56 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.56 R:0.06003 P:0.08552 F:0.07054
56 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.56 R:0.07105 P:0.10254 F:0.08394
56 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.56 R:0.06758 P:0.09666 F:0.07955
56 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.56 R:0.07541 P:0.11268 F:0.09035
56 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.56 R:0.06300 P:0.08953 F:0.07396
56 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.56 R:0.07136 P:0.10786 F:0.08589
56 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.56 R:0.06847 P:0.09931 F:0.08106
---------------------------------------------
56 ROUGE-SU4 Average_R: 0.10435 (95%-conf.int. 0.09753 - 0.11149)
56 ROUGE-SU4 Average_P: 0.08575 (95%-conf.int. 0.07991 - 0.09165)
56 ROUGE-SU4 Average_F: 0.09407 (95%-conf.int. 0.08771 - 0.10047)
.............................................
56 ROUGE-SU4 Eval D0703-A.M.100.A-A.56 R:0.10475 P:0.08356 F:0.09296
56 ROUGE-SU4 Eval D0703-A.M.100.A-C.56 R:0.08103 P:0.06510 F:0.07220
56 ROUGE-SU4 Eval D0703-A.M.100.A-D.56 R:0.09187 P:0.07202 F:0.08074
56 ROUGE-SU4 Eval D0703-A.M.100.A-J.56 R:0.10256 P:0.08126 F:0.09068
56 ROUGE-SU4 Eval D0703-B.M.100.A-A.56 R:0.15436 P:0.13068 F:0.14154
56 ROUGE-SU4 Eval D0703-B.M.100.A-C.56 R:0.13966 P:0.11506 F:0.12617
56 ROUGE-SU4 Eval D0703-B.M.100.A-D.56 R:0.14828 P:0.12216 F:0.13396
56 ROUGE-SU4 Eval D0703-B.M.100.A-J.56 R:0.15358 P:0.12784 F:0.13953
56 ROUGE-SU4 Eval D0703-C.M.100.A-A.56 R:0.12557 P:0.10157 F:0.11230
56 ROUGE-SU4 Eval D0703-C.M.100.A-C.56 R:0.11611 P:0.09649 F:0.10539
56 ROUGE-SU4 Eval D0703-C.M.100.A-D.56 R:0.11338 P:0.09234 F:0.10178
56 ROUGE-SU4 Eval D0703-C.M.100.A-J.56 R:0.12642 P:0.10295 F:0.11348
56 ROUGE-SU4 Eval D0706-A.M.100.B-B.56 R:0.12389 P:0.10649 F:0.11453
56 ROUGE-SU4 Eval D0706-A.M.100.B-D.56 R:0.12025 P:0.10267 F:0.11077
56 ROUGE-SU4 Eval D0706-A.M.100.B-E.56 R:0.07833 P:0.06734 F:0.07242
56 ROUGE-SU4 Eval D0706-A.M.100.B-I.56 R:0.11333 P:0.09742 F:0.10477
56 ROUGE-SU4 Eval D0706-B.M.100.B-B.56 R:0.07830 P:0.06518 F:0.07114
56 ROUGE-SU4 Eval D0706-B.M.100.B-D.56 R:0.07860 P:0.06564 F:0.07154
56 ROUGE-SU4 Eval D0706-B.M.100.B-E.56 R:0.07722 P:0.06471 F:0.07041
56 ROUGE-SU4 Eval D0706-B.M.100.B-I.56 R:0.08472 P:0.07123 F:0.07739
56 ROUGE-SU4 Eval D0706-C.M.100.B-B.56 R:0.10817 P:0.08901 F:0.09766
56 ROUGE-SU4 Eval D0706-C.M.100.B-D.56 R:0.10927 P:0.08992 F:0.09866
56 ROUGE-SU4 Eval D0706-C.M.100.B-E.56 R:0.11075 P:0.09173 F:0.10035
56 ROUGE-SU4 Eval D0706-C.M.100.B-I.56 R:0.09399 P:0.07811 F:0.08532
56 ROUGE-SU4 Eval D0711-A.M.100.C-A.56 R:0.09403 P:0.07584 F:0.08396
56 ROUGE-SU4 Eval D0711-A.M.100.C-B.56 R:0.09646 P:0.07675 F:0.08548
56 ROUGE-SU4 Eval D0711-A.M.100.C-C.56 R:0.08562 P:0.06812 F:0.07587
56 ROUGE-SU4 Eval D0711-A.M.100.C-F.56 R:0.08333 P:0.06676 F:0.07413
56 ROUGE-SU4 Eval D0711-B.M.100.C-A.56 R:0.07692 P:0.06197 F:0.06864
56 ROUGE-SU4 Eval D0711-B.M.100.C-B.56 R:0.07923 P:0.06338 F:0.07042
56 ROUGE-SU4 Eval D0711-B.M.100.C-C.56 R:0.07586 P:0.06197 F:0.06822
56 ROUGE-SU4 Eval D0711-B.M.100.C-F.56 R:0.08014 P:0.06479 F:0.07165
56 ROUGE-SU4 Eval D0711-C.M.100.C-A.56 R:0.16441 P:0.13435 F:0.14787
56 ROUGE-SU4 Eval D0711-C.M.100.C-B.56 R:0.16316 P:0.12881 F:0.14396
56 ROUGE-SU4 Eval D0711-C.M.100.C-C.56 R:0.12963 P:0.10342 F:0.11505
56 ROUGE-SU4 Eval D0711-C.M.100.C-F.56 R:0.15336 P:0.12235 F:0.13611
56 ROUGE-SU4 Eval D0716-A.M.100.D-C.56 R:0.19753 P:0.16526 F:0.17996
56 ROUGE-SU4 Eval D0716-A.M.100.D-D.56 R:0.21804 P:0.17934 F:0.19681
56 ROUGE-SU4 Eval D0716-A.M.100.D-E.56 R:0.20250 P:0.16714 F:0.18313
56 ROUGE-SU4 Eval D0716-A.M.100.D-F.56 R:0.19605 P:0.16291 F:0.17795
56 ROUGE-SU4 Eval D0716-B.M.100.D-C.56 R:0.15878 P:0.12912 F:0.14242
56 ROUGE-SU4 Eval D0716-B.M.100.D-D.56 R:0.17184 P:0.13690 F:0.15239
56 ROUGE-SU4 Eval D0716-B.M.100.D-E.56 R:0.16553 P:0.13324 F:0.14764
56 ROUGE-SU4 Eval D0716-B.M.100.D-F.56 R:0.17352 P:0.13919 F:0.15447
56 ROUGE-SU4 Eval D0716-C.M.100.D-C.56 R:0.13322 P:0.11034 F:0.12071
56 ROUGE-SU4 Eval D0716-C.M.100.D-D.56 R:0.15235 P:0.12281 F:0.13599
56 ROUGE-SU4 Eval D0716-C.M.100.D-E.56 R:0.13107 P:0.10711 F:0.11788
56 ROUGE-SU4 Eval D0716-C.M.100.D-F.56 R:0.13413 P:0.10849 F:0.11996
56 ROUGE-SU4 Eval D0721-A.M.100.E-B.56 R:0.06507 P:0.05444 F:0.05928
56 ROUGE-SU4 Eval D0721-A.M.100.E-C.56 R:0.06111 P:0.05253 F:0.05650
56 ROUGE-SU4 Eval D0721-A.M.100.E-E.56 R:0.06056 P:0.05205 F:0.05598
56 ROUGE-SU4 Eval D0721-A.M.100.E-G.56 R:0.05719 P:0.05014 F:0.05343
56 ROUGE-SU4 Eval D0721-B.M.100.E-B.56 R:0.12319 P:0.10464 F:0.11316
56 ROUGE-SU4 Eval D0721-B.M.100.E-C.56 R:0.11383 P:0.09896 F:0.10588
56 ROUGE-SU4 Eval D0721-B.M.100.E-E.56 R:0.14310 P:0.12074 F:0.13097
56 ROUGE-SU4 Eval D0721-B.M.100.E-G.56 R:0.13521 P:0.11600 F:0.12487
56 ROUGE-SU4 Eval D0721-C.M.100.E-B.56 R:0.10494 P:0.08930 F:0.09649
56 ROUGE-SU4 Eval D0721-C.M.100.E-C.56 R:0.09605 P:0.08118 F:0.08799
56 ROUGE-SU4 Eval D0721-C.M.100.E-E.56 R:0.09589 P:0.08023 F:0.08736
56 ROUGE-SU4 Eval D0721-C.M.100.E-G.56 R:0.09365 P:0.08023 F:0.08642
56 ROUGE-SU4 Eval D0726-A.M.100.F-A.56 R:0.08191 P:0.06761 F:0.07408
56 ROUGE-SU4 Eval D0726-A.M.100.F-E.56 R:0.06735 P:0.05540 F:0.06079
56 ROUGE-SU4 Eval D0726-A.M.100.F-F.56 R:0.07850 P:0.06479 F:0.07099
56 ROUGE-SU4 Eval D0726-A.M.100.F-G.56 R:0.07281 P:0.06009 F:0.06584
56 ROUGE-SU4 Eval D0726-B.M.100.F-A.56 R:0.07215 P:0.06108 F:0.06616
56 ROUGE-SU4 Eval D0726-B.M.100.F-E.56 R:0.08020 P:0.06676 F:0.07287
56 ROUGE-SU4 Eval D0726-B.M.100.F-F.56 R:0.08134 P:0.06771 F:0.07390
56 ROUGE-SU4 Eval D0726-B.M.100.F-G.56 R:0.08671 P:0.07292 F:0.07922
56 ROUGE-SU4 Eval D0726-C.M.100.F-A.56 R:0.08847 P:0.07156 F:0.07912
56 ROUGE-SU4 Eval D0726-C.M.100.F-E.56 R:0.09343 P:0.07479 F:0.08308
56 ROUGE-SU4 Eval D0726-C.M.100.F-F.56 R:0.10279 P:0.08172 F:0.09105
56 ROUGE-SU4 Eval D0726-C.M.100.F-G.56 R:0.09484 P:0.07802 F:0.08561
56 ROUGE-SU4 Eval D0727-A.M.100.G-A.56 R:0.12514 P:0.10506 F:0.11422
56 ROUGE-SU4 Eval D0727-A.M.100.G-F.56 R:0.14077 P:0.11939 F:0.12920
56 ROUGE-SU4 Eval D0727-A.M.100.G-G.56 R:0.11074 P:0.09456 F:0.10201
56 ROUGE-SU4 Eval D0727-A.M.100.G-H.56 R:0.13570 P:0.11509 F:0.12455
56 ROUGE-SU4 Eval D0727-B.M.100.G-A.56 R:0.10542 P:0.08775 F:0.09578
56 ROUGE-SU4 Eval D0727-B.M.100.G-F.56 R:0.11111 P:0.09804 F:0.10417
56 ROUGE-SU4 Eval D0727-B.M.100.G-G.56 R:0.08837 P:0.07304 F:0.07998
56 ROUGE-SU4 Eval D0727-B.M.100.G-H.56 R:0.10424 P:0.08676 F:0.09470
56 ROUGE-SU4 Eval D0727-C.M.100.G-A.56 R:0.12486 P:0.10697 F:0.11522
56 ROUGE-SU4 Eval D0727-C.M.100.G-F.56 R:0.15340 P:0.12703 F:0.13898
56 ROUGE-SU4 Eval D0727-C.M.100.G-G.56 R:0.14124 P:0.11939 F:0.12940
56 ROUGE-SU4 Eval D0727-C.M.100.G-H.56 R:0.14641 P:0.12082 F:0.13239
56 ROUGE-SU4 Eval D0736-A.M.100.H-G.56 R:0.08180 P:0.06140 F:0.07015
56 ROUGE-SU4 Eval D0736-A.M.100.H-H.56 R:0.08584 P:0.06325 F:0.07283
56 ROUGE-SU4 Eval D0736-A.M.100.H-I.56 R:0.07692 P:0.05817 F:0.06624
56 ROUGE-SU4 Eval D0736-A.M.100.H-J.56 R:0.08054 P:0.06648 F:0.07284
56 ROUGE-SU4 Eval D0736-B.M.100.H-G.56 R:0.09646 P:0.06960 F:0.08086
56 ROUGE-SU4 Eval D0736-B.M.100.H-H.56 R:0.09972 P:0.06629 F:0.07964
56 ROUGE-SU4 Eval D0736-B.M.100.H-I.56 R:0.05628 P:0.03693 F:0.04460
56 ROUGE-SU4 Eval D0736-B.M.100.H-J.56 R:0.09053 P:0.07150 F:0.07990
56 ROUGE-SU4 Eval D0736-C.M.100.H-G.56 R:0.06041 P:0.04217 F:0.04967
56 ROUGE-SU4 Eval D0736-C.M.100.H-H.56 R:0.05680 P:0.03100 F:0.04011
56 ROUGE-SU4 Eval D0736-C.M.100.H-I.56 R:0.07169 P:0.03913 F:0.05063
56 ROUGE-SU4 Eval D0736-C.M.100.H-J.56 R:0.05512 P:0.04319 F:0.04843
56 ROUGE-SU4 Eval D0740-A.M.100.I-D.56 R:0.12316 P:0.09820 F:0.10927
56 ROUGE-SU4 Eval D0740-A.M.100.I-H.56 R:0.11298 P:0.09099 F:0.10080
56 ROUGE-SU4 Eval D0740-A.M.100.I-I.56 R:0.10389 P:0.08423 F:0.09303
56 ROUGE-SU4 Eval D0740-A.M.100.I-J.56 R:0.10706 P:0.08739 F:0.09623
56 ROUGE-SU4 Eval D0740-B.M.100.I-D.56 R:0.06444 P:0.05737 F:0.06070
56 ROUGE-SU4 Eval D0740-B.M.100.I-H.56 R:0.06236 P:0.05440 F:0.05811
56 ROUGE-SU4 Eval D0740-B.M.100.I-I.56 R:0.07407 P:0.06528 F:0.06940
56 ROUGE-SU4 Eval D0740-B.M.100.I-J.56 R:0.06589 P:0.05885 F:0.06217
56 ROUGE-SU4 Eval D0740-C.M.100.I-D.56 R:0.16011 P:0.13641 F:0.14731
56 ROUGE-SU4 Eval D0740-C.M.100.I-H.56 R:0.15127 P:0.12803 F:0.13868
56 ROUGE-SU4 Eval D0740-C.M.100.I-I.56 R:0.15956 P:0.13594 F:0.14681
56 ROUGE-SU4 Eval D0740-C.M.100.I-J.56 R:0.15414 P:0.13175 F:0.14207
56 ROUGE-SU4 Eval D0743-A.M.100.J-B.56 R:0.06026 P:0.05168 F:0.05564
56 ROUGE-SU4 Eval D0743-A.M.100.J-H.56 R:0.05011 P:0.04423 F:0.04699
56 ROUGE-SU4 Eval D0743-A.M.100.J-I.56 R:0.05128 P:0.04469 F:0.04776
56 ROUGE-SU4 Eval D0743-A.M.100.J-J.56 R:0.04469 P:0.03957 F:0.04197
56 ROUGE-SU4 Eval D0743-B.M.100.J-B.56 R:0.04989 P:0.04201 F:0.04561
56 ROUGE-SU4 Eval D0743-B.M.100.J-H.56 R:0.04639 P:0.03970 F:0.04279
56 ROUGE-SU4 Eval D0743-B.M.100.J-I.56 R:0.05574 P:0.04755 F:0.05132
56 ROUGE-SU4 Eval D0743-B.M.100.J-J.56 R:0.05218 P:0.04524 F:0.04846
56 ROUGE-SU4 Eval D0743-C.M.100.J-B.56 R:0.07058 P:0.06002 F:0.06487
56 ROUGE-SU4 Eval D0743-C.M.100.J-H.56 R:0.05011 P:0.04247 F:0.04597
56 ROUGE-SU4 Eval D0743-C.M.100.J-I.56 R:0.06940 P:0.05863 F:0.06356
56 ROUGE-SU4 Eval D0743-C.M.100.J-J.56 R:0.06237 P:0.05355 F:0.05762
---------------------------------------------
57 ROUGE-1 Average_R: 0.27542 (95%-conf.int. 0.26360 - 0.28633)
57 ROUGE-1 Average_P: 0.14218 (95%-conf.int. 0.13524 - 0.14879)
57 ROUGE-1 Average_F: 0.18700 (95%-conf.int. 0.17853 - 0.19521)
.............................................
57 ROUGE-1 Eval D0703-A.M.100.A-A.57 R:0.33784 P:0.18519 F:0.23924
57 ROUGE-1 Eval D0703-A.M.100.A-C.57 R:0.28188 P:0.15556 F:0.20048
57 ROUGE-1 Eval D0703-A.M.100.A-D.57 R:0.31615 P:0.17037 F:0.22142
57 ROUGE-1 Eval D0703-A.M.100.A-J.57 R:0.30612 P:0.16667 F:0.21583
57 ROUGE-1 Eval D0703-B.M.100.A-A.57 R:0.37582 P:0.22417 F:0.28083
57 ROUGE-1 Eval D0703-B.M.100.A-C.57 R:0.35906 P:0.20858 F:0.26387
57 ROUGE-1 Eval D0703-B.M.100.A-D.57 R:0.37919 P:0.22027 F:0.27866
57 ROUGE-1 Eval D0703-B.M.100.A-J.57 R:0.37209 P:0.21832 F:0.27518
57 ROUGE-1 Eval D0703-C.M.100.A-A.57 R:0.38333 P:0.19759 F:0.26077
57 ROUGE-1 Eval D0703-C.M.100.A-C.57 R:0.36039 P:0.19072 F:0.24944
57 ROUGE-1 Eval D0703-C.M.100.A-D.57 R:0.37748 P:0.19588 F:0.25792
57 ROUGE-1 Eval D0703-C.M.100.A-J.57 R:0.39404 P:0.20447 F:0.26923
57 ROUGE-1 Eval D0706-A.M.100.B-B.57 R:0.24026 P:0.11473 F:0.15530
57 ROUGE-1 Eval D0706-A.M.100.B-D.57 R:0.22222 P:0.10543 F:0.14301
57 ROUGE-1 Eval D0706-A.M.100.B-E.57 R:0.23052 P:0.11008 F:0.14901
57 ROUGE-1 Eval D0706-A.M.100.B-I.57 R:0.24351 P:0.11628 F:0.15740
57 ROUGE-1 Eval D0706-B.M.100.B-B.57 R:0.19608 P:0.09569 F:0.12861
57 ROUGE-1 Eval D0706-B.M.100.B-D.57 R:0.19218 P:0.09410 F:0.12634
57 ROUGE-1 Eval D0706-B.M.100.B-E.57 R:0.20779 P:0.10207 F:0.13689
57 ROUGE-1 Eval D0706-B.M.100.B-I.57 R:0.21359 P:0.10526 F:0.14102
57 ROUGE-1 Eval D0706-C.M.100.B-B.57 R:0.30645 P:0.16323 F:0.21300
57 ROUGE-1 Eval D0706-C.M.100.B-D.57 R:0.28710 P:0.15292 F:0.19955
57 ROUGE-1 Eval D0706-C.M.100.B-E.57 R:0.30128 P:0.16151 F:0.21029
57 ROUGE-1 Eval D0706-C.M.100.B-I.57 R:0.30990 P:0.16667 F:0.21676
57 ROUGE-1 Eval D0711-A.M.100.C-A.57 R:0.26645 P:0.13990 F:0.18347
57 ROUGE-1 Eval D0711-A.M.100.C-B.57 R:0.29333 P:0.15199 F:0.20023
57 ROUGE-1 Eval D0711-A.M.100.C-C.57 R:0.26333 P:0.13644 F:0.17975
57 ROUGE-1 Eval D0711-A.M.100.C-F.57 R:0.30132 P:0.15717 F:0.20658
57 ROUGE-1 Eval D0711-B.M.100.C-A.57 R:0.27211 P:0.14652 F:0.19048
57 ROUGE-1 Eval D0711-B.M.100.C-B.57 R:0.30137 P:0.16117 F:0.21002
57 ROUGE-1 Eval D0711-B.M.100.C-C.57 R:0.28188 P:0.15385 F:0.19906
57 ROUGE-1 Eval D0711-B.M.100.C-F.57 R:0.29492 P:0.15934 F:0.20690
57 ROUGE-1 Eval D0711-C.M.100.C-A.57 R:0.31353 P:0.17593 F:0.22539
57 ROUGE-1 Eval D0711-C.M.100.C-B.57 R:0.32082 P:0.17407 F:0.22569
57 ROUGE-1 Eval D0711-C.M.100.C-C.57 R:0.32095 P:0.17593 F:0.22728
57 ROUGE-1 Eval D0711-C.M.100.C-F.57 R:0.27703 P:0.15185 F:0.19617
57 ROUGE-1 Eval D0716-A.M.100.D-C.57 R:0.36721 P:0.18951 F:0.25000
57 ROUGE-1 Eval D0716-A.M.100.D-D.57 R:0.38333 P:0.19459 F:0.25814
57 ROUGE-1 Eval D0716-A.M.100.D-E.57 R:0.36545 P:0.18613 F:0.24664
57 ROUGE-1 Eval D0716-A.M.100.D-F.57 R:0.35314 P:0.18105 F:0.23938
57 ROUGE-1 Eval D0716-B.M.100.D-C.57 R:0.38487 P:0.19898 F:0.26233
57 ROUGE-1 Eval D0716-B.M.100.D-D.57 R:0.38591 P:0.19558 F:0.25960
57 ROUGE-1 Eval D0716-B.M.100.D-E.57 R:0.37874 P:0.19388 F:0.25647
57 ROUGE-1 Eval D0716-B.M.100.D-F.57 R:0.37667 P:0.19218 F:0.25451
57 ROUGE-1 Eval D0716-C.M.100.D-C.57 R:0.34528 P:0.16208 F:0.22060
57 ROUGE-1 Eval D0716-C.M.100.D-D.57 R:0.36455 P:0.16667 F:0.22875
57 ROUGE-1 Eval D0716-C.M.100.D-E.57 R:0.34323 P:0.15902 F:0.21734
57 ROUGE-1 Eval D0716-C.M.100.D-F.57 R:0.34667 P:0.15902 F:0.21803
57 ROUGE-1 Eval D0721-A.M.100.E-B.57 R:0.26667 P:0.14414 F:0.18713
57 ROUGE-1 Eval D0721-A.M.100.E-C.57 R:0.27273 P:0.15135 F:0.19467
57 ROUGE-1 Eval D0721-A.M.100.E-E.57 R:0.24675 P:0.13694 F:0.17613
57 ROUGE-1 Eval D0721-A.M.100.E-G.57 R:0.25796 P:0.14595 F:0.18642
57 ROUGE-1 Eval D0721-B.M.100.E-B.57 R:0.26710 P:0.11582 F:0.16158
57 ROUGE-1 Eval D0721-B.M.100.E-C.57 R:0.29618 P:0.13136 F:0.18200
57 ROUGE-1 Eval D0721-B.M.100.E-E.57 R:0.27869 P:0.12006 F:0.16782
57 ROUGE-1 Eval D0721-B.M.100.E-G.57 R:0.28387 P:0.12429 F:0.17288
57 ROUGE-1 Eval D0721-C.M.100.E-B.57 R:0.30164 P:0.13690 F:0.18833
57 ROUGE-1 Eval D0721-C.M.100.E-C.57 R:0.28713 P:0.12946 F:0.17846
57 ROUGE-1 Eval D0721-C.M.100.E-E.57 R:0.26000 P:0.11607 F:0.16049
57 ROUGE-1 Eval D0721-C.M.100.E-G.57 R:0.29642 P:0.13542 F:0.18591
57 ROUGE-1 Eval D0726-A.M.100.F-A.57 R:0.28904 P:0.15026 F:0.19773
57 ROUGE-1 Eval D0726-A.M.100.F-E.57 R:0.31000 P:0.16062 F:0.21160
57 ROUGE-1 Eval D0726-A.M.100.F-F.57 R:0.32558 P:0.16926 F:0.22273
57 ROUGE-1 Eval D0726-A.M.100.F-G.57 R:0.30233 P:0.15717 F:0.20682
57 ROUGE-1 Eval D0726-B.M.100.F-A.57 R:0.15686 P:0.08791 F:0.11267
57 ROUGE-1 Eval D0726-B.M.100.F-E.57 R:0.17276 P:0.09524 F:0.12279
57 ROUGE-1 Eval D0726-B.M.100.F-F.57 R:0.17276 P:0.09524 F:0.12279
57 ROUGE-1 Eval D0726-B.M.100.F-G.57 R:0.18092 P:0.10073 F:0.12941
57 ROUGE-1 Eval D0726-C.M.100.F-A.57 R:0.30333 P:0.15556 F:0.20565
57 ROUGE-1 Eval D0726-C.M.100.F-E.57 R:0.30976 P:0.15726 F:0.20861
57 ROUGE-1 Eval D0726-C.M.100.F-F.57 R:0.29492 P:0.14872 F:0.19773
57 ROUGE-1 Eval D0726-C.M.100.F-G.57 R:0.28525 P:0.14872 F:0.19551
57 ROUGE-1 Eval D0727-A.M.100.G-A.57 R:0.25581 P:0.14339 F:0.18377
57 ROUGE-1 Eval D0727-A.M.100.G-F.57 R:0.25000 P:0.14153 F:0.18074
57 ROUGE-1 Eval D0727-A.M.100.G-G.57 R:0.23856 P:0.13594 F:0.17319
57 ROUGE-1 Eval D0727-A.M.100.G-H.57 R:0.24342 P:0.13780 F:0.17598
57 ROUGE-1 Eval D0727-B.M.100.G-A.57 R:0.31959 P:0.16146 F:0.21453
57 ROUGE-1 Eval D0727-B.M.100.G-F.57 R:0.33117 P:0.17708 F:0.23077
57 ROUGE-1 Eval D0727-B.M.100.G-G.57 R:0.30450 P:0.15278 F:0.20347
57 ROUGE-1 Eval D0727-B.M.100.G-H.57 R:0.31615 P:0.15972 F:0.21222
57 ROUGE-1 Eval D0727-C.M.100.G-A.57 R:0.27362 P:0.13861 F:0.18401
57 ROUGE-1 Eval D0727-C.M.100.G-F.57 R:0.32997 P:0.16172 F:0.21706
57 ROUGE-1 Eval D0727-C.M.100.G-G.57 R:0.30033 P:0.15017 F:0.20022
57 ROUGE-1 Eval D0727-C.M.100.G-H.57 R:0.30405 P:0.14851 F:0.19955
57 ROUGE-1 Eval D0736-A.M.100.H-G.57 R:0.22581 P:0.09375 F:0.13249
57 ROUGE-1 Eval D0736-A.M.100.H-H.57 R:0.24453 P:0.09970 F:0.14165
57 ROUGE-1 Eval D0736-A.M.100.H-I.57 R:0.22064 P:0.09226 F:0.13011
57 ROUGE-1 Eval D0736-A.M.100.H-J.57 R:0.22549 P:0.10268 F:0.14111
57 ROUGE-1 Eval D0736-B.M.100.H-G.57 R:0.16031 P:0.06061 F:0.08796
57 ROUGE-1 Eval D0736-B.M.100.H-H.57 R:0.14050 P:0.04906 F:0.07273
57 ROUGE-1 Eval D0736-B.M.100.H-I.57 R:0.15481 P:0.05339 F:0.07940
57 ROUGE-1 Eval D0736-B.M.100.H-J.57 R:0.17133 P:0.07071 F:0.10011
57 ROUGE-1 Eval D0736-C.M.100.H-G.57 R:0.16034 P:0.05507 F:0.08198
57 ROUGE-1 Eval D0736-C.M.100.H-H.57 R:0.14973 P:0.04058 F:0.06385
57 ROUGE-1 Eval D0736-C.M.100.H-I.57 R:0.19251 P:0.05217 F:0.08209
57 ROUGE-1 Eval D0736-C.M.100.H-J.57 R:0.14717 P:0.05652 F:0.08167
57 ROUGE-1 Eval D0740-A.M.100.I-D.57 R:0.28713 P:0.16959 F:0.21324
57 ROUGE-1 Eval D0740-A.M.100.I-H.57 R:0.27451 P:0.16374 F:0.20513
57 ROUGE-1 Eval D0740-A.M.100.I-I.57 R:0.29870 P:0.17934 F:0.22412
57 ROUGE-1 Eval D0740-A.M.100.I-J.57 R:0.27419 P:0.16569 F:0.20656
57 ROUGE-1 Eval D0740-B.M.100.I-D.57 R:0.24026 P:0.12272 F:0.16246
57 ROUGE-1 Eval D0740-B.M.100.I-H.57 R:0.24503 P:0.12272 F:0.16354
57 ROUGE-1 Eval D0740-B.M.100.I-I.57 R:0.22951 P:0.11609 F:0.15419
57 ROUGE-1 Eval D0740-B.M.100.I-J.57 R:0.22654 P:0.11609 F:0.15351
57 ROUGE-1 Eval D0740-C.M.100.I-D.57 R:0.21725 P:0.13655 F:0.16770
57 ROUGE-1 Eval D0740-C.M.100.I-H.57 R:0.19614 P:0.12249 F:0.15080
57 ROUGE-1 Eval D0740-C.M.100.I-I.57 R:0.19808 P:0.12450 F:0.15290
57 ROUGE-1 Eval D0740-C.M.100.I-J.57 R:0.19427 P:0.12249 F:0.15025
57 ROUGE-1 Eval D0743-A.M.100.J-B.57 R:0.20952 P:0.11399 F:0.14765
57 ROUGE-1 Eval D0743-A.M.100.J-H.57 R:0.19753 P:0.11054 F:0.14175
57 ROUGE-1 Eval D0743-A.M.100.J-I.57 R:0.21563 P:0.11917 F:0.15350
57 ROUGE-1 Eval D0743-A.M.100.J-J.57 R:0.19077 P:0.10708 F:0.13717
57 ROUGE-1 Eval D0743-B.M.100.J-B.57 R:0.33013 P:0.18659 F:0.23842
57 ROUGE-1 Eval D0743-B.M.100.J-H.57 R:0.29338 P:0.16848 F:0.21404
57 ROUGE-1 Eval D0743-B.M.100.J-I.57 R:0.31329 P:0.17935 F:0.22811
57 ROUGE-1 Eval D0743-B.M.100.J-J.57 R:0.29595 P:0.17210 F:0.21764
57 ROUGE-1 Eval D0743-C.M.100.J-B.57 R:0.21905 P:0.11330 F:0.14935
57 ROUGE-1 Eval D0743-C.M.100.J-H.57 R:0.20382 P:0.10509 F:0.13868
57 ROUGE-1 Eval D0743-C.M.100.J-I.57 R:0.21725 P:0.11166 F:0.14751
57 ROUGE-1 Eval D0743-C.M.100.J-J.57 R:0.20755 P:0.10837 F:0.14239
---------------------------------------------
57 ROUGE-2 Average_R: 0.03722 (95%-conf.int. 0.03218 - 0.04208)
57 ROUGE-2 Average_P: 0.01934 (95%-conf.int. 0.01660 - 0.02203)
57 ROUGE-2 Average_F: 0.02540 (95%-conf.int. 0.02187 - 0.02882)
.............................................
57 ROUGE-2 Eval D0703-A.M.100.A-A.57 R:0.07509 P:0.04097 F:0.05301
57 ROUGE-2 Eval D0703-A.M.100.A-C.57 R:0.05763 P:0.03166 F:0.04087
57 ROUGE-2 Eval D0703-A.M.100.A-D.57 R:0.06597 P:0.03538 F:0.04606
57 ROUGE-2 Eval D0703-A.M.100.A-J.57 R:0.05842 P:0.03166 F:0.04107
57 ROUGE-2 Eval D0703-B.M.100.A-A.57 R:0.11881 P:0.07059 F:0.08856
57 ROUGE-2 Eval D0703-B.M.100.A-C.57 R:0.09153 P:0.05294 F:0.06708
57 ROUGE-2 Eval D0703-B.M.100.A-D.57 R:0.11525 P:0.06667 F:0.08447
57 ROUGE-2 Eval D0703-B.M.100.A-J.57 R:0.11745 P:0.06863 F:0.08664
57 ROUGE-2 Eval D0703-C.M.100.A-A.57 R:0.09428 P:0.04836 F:0.06393
57 ROUGE-2 Eval D0703-C.M.100.A-C.57 R:0.06885 P:0.03627 F:0.04751
57 ROUGE-2 Eval D0703-C.M.100.A-D.57 R:0.09365 P:0.04836 F:0.06378
57 ROUGE-2 Eval D0703-C.M.100.A-J.57 R:0.09365 P:0.04836 F:0.06378
57 ROUGE-2 Eval D0706-A.M.100.B-B.57 R:0.02623 P:0.01246 F:0.01689
57 ROUGE-2 Eval D0706-A.M.100.B-D.57 R:0.02310 P:0.01090 F:0.01481
57 ROUGE-2 Eval D0706-A.M.100.B-E.57 R:0.01967 P:0.00935 F:0.01268
57 ROUGE-2 Eval D0706-A.M.100.B-I.57 R:0.01967 P:0.00935 F:0.01268
57 ROUGE-2 Eval D0706-B.M.100.B-B.57 R:0.00990 P:0.00481 F:0.00647
57 ROUGE-2 Eval D0706-B.M.100.B-D.57 R:0.00987 P:0.00481 F:0.00647
57 ROUGE-2 Eval D0706-B.M.100.B-E.57 R:0.00984 P:0.00481 F:0.00646
57 ROUGE-2 Eval D0706-B.M.100.B-I.57 R:0.00980 P:0.00481 F:0.00645
57 ROUGE-2 Eval D0706-C.M.100.B-B.57 R:0.03909 P:0.02073 F:0.02709
57 ROUGE-2 Eval D0706-C.M.100.B-D.57 R:0.03257 P:0.01727 F:0.02257
57 ROUGE-2 Eval D0706-C.M.100.B-E.57 R:0.04207 P:0.02245 F:0.02928
57 ROUGE-2 Eval D0706-C.M.100.B-I.57 R:0.04194 P:0.02245 F:0.02925
57 ROUGE-2 Eval D0711-A.M.100.C-A.57 R:0.01993 P:0.01042 F:0.01369
57 ROUGE-2 Eval D0711-A.M.100.C-B.57 R:0.02357 P:0.01215 F:0.01603
57 ROUGE-2 Eval D0711-A.M.100.C-C.57 R:0.01010 P:0.00521 F:0.00687
57 ROUGE-2 Eval D0711-A.M.100.C-F.57 R:0.02676 P:0.01389 F:0.01829
57 ROUGE-2 Eval D0711-B.M.100.C-A.57 R:0.03093 P:0.01657 F:0.02158
57 ROUGE-2 Eval D0711-B.M.100.C-B.57 R:0.04152 P:0.02210 F:0.02885
57 ROUGE-2 Eval D0711-B.M.100.C-C.57 R:0.04068 P:0.02210 F:0.02864
57 ROUGE-2 Eval D0711-B.M.100.C-F.57 R:0.04110 P:0.02210 F:0.02874
57 ROUGE-2 Eval D0711-C.M.100.C-A.57 R:0.03667 P:0.02048 F:0.02628
57 ROUGE-2 Eval D0711-C.M.100.C-B.57 R:0.02759 P:0.01490 F:0.01935
57 ROUGE-2 Eval D0711-C.M.100.C-C.57 R:0.02730 P:0.01490 F:0.01928
57 ROUGE-2 Eval D0711-C.M.100.C-F.57 R:0.02048 P:0.01117 F:0.01446
57 ROUGE-2 Eval D0716-A.M.100.D-C.57 R:0.08609 P:0.04422 F:0.05843
57 ROUGE-2 Eval D0716-A.M.100.D-D.57 R:0.09428 P:0.04762 F:0.06328
57 ROUGE-2 Eval D0716-A.M.100.D-E.57 R:0.07718 P:0.03912 F:0.05192
57 ROUGE-2 Eval D0716-A.M.100.D-F.57 R:0.08333 P:0.04252 F:0.05631
57 ROUGE-2 Eval D0716-B.M.100.D-C.57 R:0.06645 P:0.03419 F:0.04515
57 ROUGE-2 Eval D0716-B.M.100.D-D.57 R:0.06441 P:0.03248 F:0.04318
57 ROUGE-2 Eval D0716-B.M.100.D-E.57 R:0.05369 P:0.02735 F:0.03624
57 ROUGE-2 Eval D0716-B.M.100.D-F.57 R:0.05724 P:0.02906 F:0.03855
57 ROUGE-2 Eval D0716-C.M.100.D-C.57 R:0.04934 P:0.02304 F:0.03141
57 ROUGE-2 Eval D0716-C.M.100.D-D.57 R:0.05743 P:0.02611 F:0.03590
57 ROUGE-2 Eval D0716-C.M.100.D-E.57 R:0.05667 P:0.02611 F:0.03575
57 ROUGE-2 Eval D0716-C.M.100.D-F.57 R:0.05724 P:0.02611 F:0.03586
57 ROUGE-2 Eval D0721-A.M.100.E-B.57 R:0.01684 P:0.00906 F:0.01178
57 ROUGE-2 Eval D0721-A.M.100.E-C.57 R:0.01639 P:0.00906 F:0.01167
57 ROUGE-2 Eval D0721-A.M.100.E-E.57 R:0.01967 P:0.01087 F:0.01400
57 ROUGE-2 Eval D0721-A.M.100.E-G.57 R:0.01608 P:0.00906 F:0.01159
57 ROUGE-2 Eval D0721-B.M.100.E-B.57 R:0.01974 P:0.00851 F:0.01189
57 ROUGE-2 Eval D0721-B.M.100.E-C.57 R:0.03537 P:0.01560 F:0.02165
57 ROUGE-2 Eval D0721-B.M.100.E-E.57 R:0.02980 P:0.01277 F:0.01788
57 ROUGE-2 Eval D0721-B.M.100.E-G.57 R:0.03257 P:0.01418 F:0.01976
57 ROUGE-2 Eval D0721-C.M.100.E-B.57 R:0.03974 P:0.01794 F:0.02472
57 ROUGE-2 Eval D0721-C.M.100.E-C.57 R:0.04000 P:0.01794 F:0.02477
57 ROUGE-2 Eval D0721-C.M.100.E-E.57 R:0.03367 P:0.01495 F:0.02071
57 ROUGE-2 Eval D0721-C.M.100.E-G.57 R:0.04605 P:0.02093 F:0.02878
57 ROUGE-2 Eval D0726-A.M.100.F-A.57 R:0.01678 P:0.00868 F:0.01144
57 ROUGE-2 Eval D0726-A.M.100.F-E.57 R:0.02694 P:0.01389 F:0.01833
57 ROUGE-2 Eval D0726-A.M.100.F-F.57 R:0.03356 P:0.01736 F:0.02288
57 ROUGE-2 Eval D0726-A.M.100.F-G.57 R:0.02349 P:0.01215 F:0.01602
57 ROUGE-2 Eval D0726-B.M.100.F-A.57 R:0.00660 P:0.00368 F:0.00473
57 ROUGE-2 Eval D0726-B.M.100.F-E.57 R:0.00671 P:0.00368 F:0.00475
57 ROUGE-2 Eval D0726-B.M.100.F-F.57 R:0.00671 P:0.00368 F:0.00475
57 ROUGE-2 Eval D0726-B.M.100.F-G.57 R:0.00997 P:0.00552 F:0.00711
57 ROUGE-2 Eval D0726-C.M.100.F-A.57 R:0.04714 P:0.02405 F:0.03185
57 ROUGE-2 Eval D0726-C.M.100.F-E.57 R:0.05102 P:0.02577 F:0.03424
57 ROUGE-2 Eval D0726-C.M.100.F-F.57 R:0.03767 P:0.01890 F:0.02517
57 ROUGE-2 Eval D0726-C.M.100.F-G.57 R:0.03642 P:0.01890 F:0.02489
57 ROUGE-2 Eval D0727-A.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-2 Eval D0727-A.M.100.G-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-2 Eval D0727-A.M.100.G-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-2 Eval D0727-A.M.100.G-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-2 Eval D0727-B.M.100.G-A.57 R:0.04514 P:0.02269 F:0.03020
57 ROUGE-2 Eval D0727-B.M.100.G-F.57 R:0.06885 P:0.03665 F:0.04784
57 ROUGE-2 Eval D0727-B.M.100.G-G.57 R:0.06294 P:0.03141 F:0.04191
57 ROUGE-2 Eval D0727-B.M.100.G-H.57 R:0.06944 P:0.03490 F:0.04645
57 ROUGE-2 Eval D0727-C.M.100.G-A.57 R:0.02632 P:0.01327 F:0.01764
57 ROUGE-2 Eval D0727-C.M.100.G-F.57 R:0.03401 P:0.01658 F:0.02229
57 ROUGE-2 Eval D0727-C.M.100.G-G.57 R:0.03333 P:0.01658 F:0.02214
57 ROUGE-2 Eval D0727-C.M.100.G-H.57 R:0.02730 P:0.01327 F:0.01786
57 ROUGE-2 Eval D0736-A.M.100.H-G.57 R:0.02536 P:0.01046 F:0.01481
57 ROUGE-2 Eval D0736-A.M.100.H-H.57 R:0.02952 P:0.01196 F:0.01702
57 ROUGE-2 Eval D0736-A.M.100.H-I.57 R:0.02878 P:0.01196 F:0.01690
57 ROUGE-2 Eval D0736-A.M.100.H-J.57 R:0.02310 P:0.01046 F:0.01440
57 ROUGE-2 Eval D0736-B.M.100.H-G.57 R:0.01158 P:0.00435 F:0.00632
57 ROUGE-2 Eval D0736-B.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-2 Eval D0736-B.M.100.H-I.57 R:0.01271 P:0.00435 F:0.00648
57 ROUGE-2 Eval D0736-B.M.100.H-J.57 R:0.01060 P:0.00435 F:0.00617
57 ROUGE-2 Eval D0736-C.M.100.H-G.57 R:0.01282 P:0.00437 F:0.00652
57 ROUGE-2 Eval D0736-C.M.100.H-H.57 R:0.00543 P:0.00146 F:0.00230
57 ROUGE-2 Eval D0736-C.M.100.H-I.57 R:0.01630 P:0.00437 F:0.00689
57 ROUGE-2 Eval D0736-C.M.100.H-J.57 R:0.00763 P:0.00291 F:0.00421
57 ROUGE-2 Eval D0740-A.M.100.I-D.57 R:0.05333 P:0.03137 F:0.03950
57 ROUGE-2 Eval D0740-A.M.100.I-H.57 R:0.04620 P:0.02745 F:0.03444
57 ROUGE-2 Eval D0740-A.M.100.I-I.57 R:0.06230 P:0.03725 F:0.04662
57 ROUGE-2 Eval D0740-A.M.100.I-J.57 R:0.04560 P:0.02745 F:0.03427
57 ROUGE-2 Eval D0740-B.M.100.I-D.57 R:0.02951 P:0.01500 F:0.01989
57 ROUGE-2 Eval D0740-B.M.100.I-H.57 R:0.04348 P:0.02167 F:0.02892
57 ROUGE-2 Eval D0740-B.M.100.I-I.57 R:0.02980 P:0.01500 F:0.01996
57 ROUGE-2 Eval D0740-B.M.100.I-J.57 R:0.03595 P:0.01833 F:0.02428
57 ROUGE-2 Eval D0740-C.M.100.I-D.57 R:0.00645 P:0.00404 F:0.00497
57 ROUGE-2 Eval D0740-C.M.100.I-H.57 R:0.00325 P:0.00202 F:0.00249
57 ROUGE-2 Eval D0740-C.M.100.I-I.57 R:0.00645 P:0.00404 F:0.00497
57 ROUGE-2 Eval D0740-C.M.100.I-J.57 R:0.00322 P:0.00202 F:0.00248
57 ROUGE-2 Eval D0743-A.M.100.J-B.57 R:0.01603 P:0.00868 F:0.01126
57 ROUGE-2 Eval D0743-A.M.100.J-H.57 R:0.00935 P:0.00521 F:0.00669
57 ROUGE-2 Eval D0743-A.M.100.J-I.57 R:0.01577 P:0.00868 F:0.01120
57 ROUGE-2 Eval D0743-A.M.100.J-J.57 R:0.00621 P:0.00347 F:0.00445
57 ROUGE-2 Eval D0743-B.M.100.J-B.57 R:0.08414 P:0.04736 F:0.06061
57 ROUGE-2 Eval D0743-B.M.100.J-H.57 R:0.04777 P:0.02732 F:0.03476
57 ROUGE-2 Eval D0743-B.M.100.J-I.57 R:0.05431 P:0.03097 F:0.03945
57 ROUGE-2 Eval D0743-B.M.100.J-J.57 R:0.06289 P:0.03643 F:0.04614
57 ROUGE-2 Eval D0743-C.M.100.J-B.57 R:0.01923 P:0.00990 F:0.01307
57 ROUGE-2 Eval D0743-C.M.100.J-H.57 R:0.01608 P:0.00825 F:0.01091
57 ROUGE-2 Eval D0743-C.M.100.J-I.57 R:0.00968 P:0.00495 F:0.00655
57 ROUGE-2 Eval D0743-C.M.100.J-J.57 R:0.01270 P:0.00660 F:0.00869
---------------------------------------------
57 ROUGE-3 Average_R: 0.00860 (95%-conf.int. 0.00630 - 0.01114)
57 ROUGE-3 Average_P: 0.00461 (95%-conf.int. 0.00334 - 0.00605)
57 ROUGE-3 Average_F: 0.00599 (95%-conf.int. 0.00436 - 0.00785)
.............................................
57 ROUGE-3 Eval D0703-A.M.100.A-A.57 R:0.01034 P:0.00562 F:0.00728
57 ROUGE-3 Eval D0703-A.M.100.A-C.57 R:0.00685 P:0.00375 F:0.00485
57 ROUGE-3 Eval D0703-A.M.100.A-D.57 R:0.01053 P:0.00562 F:0.00733
57 ROUGE-3 Eval D0703-A.M.100.A-J.57 R:0.00347 P:0.00187 F:0.00243
57 ROUGE-3 Eval D0703-B.M.100.A-A.57 R:0.06000 P:0.03550 F:0.04461
57 ROUGE-3 Eval D0703-B.M.100.A-C.57 R:0.04110 P:0.02367 F:0.03004
57 ROUGE-3 Eval D0703-B.M.100.A-D.57 R:0.05137 P:0.02959 F:0.03755
57 ROUGE-3 Eval D0703-B.M.100.A-J.57 R:0.06102 P:0.03550 F:0.04489
57 ROUGE-3 Eval D0703-C.M.100.A-A.57 R:0.02721 P:0.01389 F:0.01839
57 ROUGE-3 Eval D0703-C.M.100.A-C.57 R:0.00993 P:0.00521 F:0.00683
57 ROUGE-3 Eval D0703-C.M.100.A-D.57 R:0.02703 P:0.01389 F:0.01835
57 ROUGE-3 Eval D0703-C.M.100.A-J.57 R:0.02703 P:0.01389 F:0.01835
57 ROUGE-3 Eval D0706-A.M.100.B-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-A.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-A.M.100.B-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-A.M.100.B-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-B.M.100.B-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-B.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-B.M.100.B-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-B.M.100.B-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-C.M.100.B-B.57 R:0.00658 P:0.00347 F:0.00454
57 ROUGE-3 Eval D0706-C.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0706-C.M.100.B-E.57 R:0.00654 P:0.00347 F:0.00453
57 ROUGE-3 Eval D0706-C.M.100.B-I.57 R:0.00651 P:0.00347 F:0.00453
57 ROUGE-3 Eval D0711-A.M.100.C-A.57 R:0.00336 P:0.00175 F:0.00230
57 ROUGE-3 Eval D0711-A.M.100.C-B.57 R:0.00340 P:0.00175 F:0.00231
57 ROUGE-3 Eval D0711-A.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-A.M.100.C-F.57 R:0.00338 P:0.00175 F:0.00231
57 ROUGE-3 Eval D0711-B.M.100.C-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-B.M.100.C-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-B.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-B.M.100.C-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-C.M.100.C-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-C.M.100.C-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-C.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0711-C.M.100.C-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0716-A.M.100.D-C.57 R:0.01672 P:0.00855 F:0.01131
57 ROUGE-3 Eval D0716-A.M.100.D-D.57 R:0.02041 P:0.01026 F:0.01366
57 ROUGE-3 Eval D0716-A.M.100.D-E.57 R:0.01356 P:0.00684 F:0.00909
57 ROUGE-3 Eval D0716-A.M.100.D-F.57 R:0.02020 P:0.01026 F:0.01361
57 ROUGE-3 Eval D0716-B.M.100.D-C.57 R:0.02013 P:0.01031 F:0.01364
57 ROUGE-3 Eval D0716-B.M.100.D-D.57 R:0.01712 P:0.00859 F:0.01144
57 ROUGE-3 Eval D0716-B.M.100.D-E.57 R:0.01017 P:0.00515 F:0.00684
57 ROUGE-3 Eval D0716-B.M.100.D-F.57 R:0.01361 P:0.00687 F:0.00913
57 ROUGE-3 Eval D0716-C.M.100.D-C.57 R:0.00997 P:0.00463 F:0.00632
57 ROUGE-3 Eval D0716-C.M.100.D-D.57 R:0.01365 P:0.00617 F:0.00850
57 ROUGE-3 Eval D0716-C.M.100.D-E.57 R:0.01684 P:0.00772 F:0.01059
57 ROUGE-3 Eval D0716-C.M.100.D-F.57 R:0.01020 P:0.00463 F:0.00637
57 ROUGE-3 Eval D0721-A.M.100.E-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-A.M.100.E-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-A.M.100.E-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-A.M.100.E-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-B.M.100.E-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-B.M.100.E-C.57 R:0.00325 P:0.00142 F:0.00198
57 ROUGE-3 Eval D0721-B.M.100.E-E.57 R:0.00334 P:0.00142 F:0.00199
57 ROUGE-3 Eval D0721-B.M.100.E-G.57 R:0.00329 P:0.00142 F:0.00198
57 ROUGE-3 Eval D0721-C.M.100.E-B.57 R:0.00334 P:0.00150 F:0.00207
57 ROUGE-3 Eval D0721-C.M.100.E-C.57 R:0.00337 P:0.00150 F:0.00208
57 ROUGE-3 Eval D0721-C.M.100.E-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0721-C.M.100.E-G.57 R:0.00332 P:0.00150 F:0.00207
57 ROUGE-3 Eval D0726-A.M.100.F-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0726-A.M.100.F-E.57 R:0.01020 P:0.00524 F:0.00692
57 ROUGE-3 Eval D0726-A.M.100.F-F.57 R:0.01017 P:0.00524 F:0.00692
57 ROUGE-3 Eval D0726-A.M.100.F-G.57 R:0.01017 P:0.00524 F:0.00692
57 ROUGE-3 Eval D0726-B.M.100.F-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0726-B.M.100.F-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0726-B.M.100.F-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0726-B.M.100.F-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0726-C.M.100.F-A.57 R:0.01361 P:0.00691 F:0.00917
57 ROUGE-3 Eval D0726-C.M.100.F-E.57 R:0.01375 P:0.00691 F:0.00920
57 ROUGE-3 Eval D0726-C.M.100.F-F.57 R:0.01038 P:0.00518 F:0.00691
57 ROUGE-3 Eval D0726-C.M.100.F-G.57 R:0.00334 P:0.00173 F:0.00228
57 ROUGE-3 Eval D0727-A.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-A.M.100.G-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-A.M.100.G-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-A.M.100.G-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-B.M.100.G-A.57 R:0.00702 P:0.00351 F:0.00468
57 ROUGE-3 Eval D0727-B.M.100.G-F.57 R:0.02980 P:0.01579 F:0.02064
57 ROUGE-3 Eval D0727-B.M.100.G-G.57 R:0.03180 P:0.01579 F:0.02110
57 ROUGE-3 Eval D0727-B.M.100.G-H.57 R:0.03509 P:0.01754 F:0.02339
57 ROUGE-3 Eval D0727-C.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-C.M.100.G-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-C.M.100.G-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0727-C.M.100.G-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-A.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-A.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-A.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-A.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-B.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-B.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-B.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-B.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-C.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-C.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-C.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0736-C.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0740-A.M.100.I-D.57 R:0.01347 P:0.00789 F:0.00995
57 ROUGE-3 Eval D0740-A.M.100.I-H.57 R:0.00667 P:0.00394 F:0.00495
57 ROUGE-3 Eval D0740-A.M.100.I-I.57 R:0.01325 P:0.00789 F:0.00989
57 ROUGE-3 Eval D0740-A.M.100.I-J.57 R:0.00658 P:0.00394 F:0.00493
57 ROUGE-3 Eval D0740-B.M.100.I-D.57 R:0.00662 P:0.00335 F:0.00445
57 ROUGE-3 Eval D0740-B.M.100.I-H.57 R:0.01351 P:0.00670 F:0.00896
57 ROUGE-3 Eval D0740-B.M.100.I-I.57 R:0.00669 P:0.00335 F:0.00446
57 ROUGE-3 Eval D0740-B.M.100.I-J.57 R:0.01320 P:0.00670 F:0.00889
57 ROUGE-3 Eval D0740-C.M.100.I-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0740-C.M.100.I-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0740-C.M.100.I-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0740-C.M.100.I-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-A.M.100.J-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-A.M.100.J-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-A.M.100.J-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-A.M.100.J-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-B.M.100.J-B.57 R:0.05556 P:0.03114 F:0.03991
57 ROUGE-3 Eval D0743-B.M.100.J-H.57 R:0.02572 P:0.01465 F:0.01867
57 ROUGE-3 Eval D0743-B.M.100.J-I.57 R:0.03226 P:0.01832 F:0.02337
57 ROUGE-3 Eval D0743-B.M.100.J-J.57 R:0.05079 P:0.02930 F:0.03716
57 ROUGE-3 Eval D0743-C.M.100.J-B.57 R:0.00647 P:0.00332 F:0.00439
57 ROUGE-3 Eval D0743-C.M.100.J-H.57 R:0.00649 P:0.00332 F:0.00439
57 ROUGE-3 Eval D0743-C.M.100.J-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-3 Eval D0743-C.M.100.J-J.57 R:0.00641 P:0.00332 F:0.00437
---------------------------------------------
57 ROUGE-4 Average_R: 0.00371 (95%-conf.int. 0.00239 - 0.00533)
57 ROUGE-4 Average_P: 0.00201 (95%-conf.int. 0.00127 - 0.00291)
57 ROUGE-4 Average_F: 0.00260 (95%-conf.int. 0.00166 - 0.00377)
.............................................
57 ROUGE-4 Eval D0703-A.M.100.A-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0703-A.M.100.A-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0703-A.M.100.A-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0703-A.M.100.A-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0703-B.M.100.A-A.57 R:0.03367 P:0.01984 F:0.02497
57 ROUGE-4 Eval D0703-B.M.100.A-C.57 R:0.01384 P:0.00794 F:0.01009
57 ROUGE-4 Eval D0703-B.M.100.A-D.57 R:0.02076 P:0.01190 F:0.01513
57 ROUGE-4 Eval D0703-B.M.100.A-J.57 R:0.03425 P:0.01984 F:0.02513
57 ROUGE-4 Eval D0703-C.M.100.A-A.57 R:0.01031 P:0.00524 F:0.00695
57 ROUGE-4 Eval D0703-C.M.100.A-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0703-C.M.100.A-D.57 R:0.01024 P:0.00524 F:0.00693
57 ROUGE-4 Eval D0703-C.M.100.A-J.57 R:0.01024 P:0.00524 F:0.00693
57 ROUGE-4 Eval D0706-A.M.100.B-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-A.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-A.M.100.B-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-A.M.100.B-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-B.M.100.B-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-B.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-B.M.100.B-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-B.M.100.B-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-C.M.100.B-B.57 R:0.00332 P:0.00175 F:0.00229
57 ROUGE-4 Eval D0706-C.M.100.B-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0706-C.M.100.B-E.57 R:0.00330 P:0.00175 F:0.00229
57 ROUGE-4 Eval D0706-C.M.100.B-I.57 R:0.00329 P:0.00175 F:0.00228
57 ROUGE-4 Eval D0711-A.M.100.C-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-A.M.100.C-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-A.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-A.M.100.C-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-B.M.100.C-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-B.M.100.C-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-B.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-B.M.100.C-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-C.M.100.C-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-C.M.100.C-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-C.M.100.C-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0711-C.M.100.C-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0716-A.M.100.D-C.57 R:0.00338 P:0.00172 F:0.00228
57 ROUGE-4 Eval D0716-A.M.100.D-D.57 R:0.00344 P:0.00172 F:0.00229
57 ROUGE-4 Eval D0716-A.M.100.D-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0716-A.M.100.D-F.57 R:0.00340 P:0.00172 F:0.00228
57 ROUGE-4 Eval D0716-B.M.100.D-C.57 R:0.00678 P:0.00345 F:0.00457
57 ROUGE-4 Eval D0716-B.M.100.D-D.57 R:0.00692 P:0.00345 F:0.00460
57 ROUGE-4 Eval D0716-B.M.100.D-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0716-B.M.100.D-F.57 R:0.00687 P:0.00345 F:0.00459
57 ROUGE-4 Eval D0716-C.M.100.D-C.57 R:0.00336 P:0.00155 F:0.00212
57 ROUGE-4 Eval D0716-C.M.100.D-D.57 R:0.00690 P:0.00310 F:0.00428
57 ROUGE-4 Eval D0716-C.M.100.D-E.57 R:0.00680 P:0.00310 F:0.00426
57 ROUGE-4 Eval D0716-C.M.100.D-F.57 R:0.00344 P:0.00155 F:0.00214
57 ROUGE-4 Eval D0721-A.M.100.E-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-A.M.100.E-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-A.M.100.E-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-A.M.100.E-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-B.M.100.E-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-B.M.100.E-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-B.M.100.E-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-B.M.100.E-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-C.M.100.E-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-C.M.100.E-C.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-C.M.100.E-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0721-C.M.100.E-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-A.M.100.F-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-A.M.100.F-E.57 R:0.00344 P:0.00175 F:0.00232
57 ROUGE-4 Eval D0726-A.M.100.F-F.57 R:0.00342 P:0.00175 F:0.00232
57 ROUGE-4 Eval D0726-A.M.100.F-G.57 R:0.00342 P:0.00175 F:0.00232
57 ROUGE-4 Eval D0726-B.M.100.F-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-B.M.100.F-E.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-B.M.100.F-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-B.M.100.F-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0726-C.M.100.F-A.57 R:0.00344 P:0.00174 F:0.00231
57 ROUGE-4 Eval D0726-C.M.100.F-E.57 R:0.00347 P:0.00174 F:0.00232
57 ROUGE-4 Eval D0726-C.M.100.F-F.57 R:0.00350 P:0.00174 F:0.00232
57 ROUGE-4 Eval D0726-C.M.100.F-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-A.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-A.M.100.G-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-A.M.100.G-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-A.M.100.G-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-B.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-B.M.100.G-F.57 R:0.02341 P:0.01235 F:0.01617
57 ROUGE-4 Eval D0727-B.M.100.G-G.57 R:0.02500 P:0.01235 F:0.01653
57 ROUGE-4 Eval D0727-B.M.100.G-H.57 R:0.02482 P:0.01235 F:0.01649
57 ROUGE-4 Eval D0727-C.M.100.G-A.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-C.M.100.G-F.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-C.M.100.G-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0727-C.M.100.G-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-A.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-A.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-A.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-A.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-B.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-B.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-B.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-B.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-C.M.100.H-G.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-C.M.100.H-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-C.M.100.H-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0736-C.M.100.H-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-A.M.100.I-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-A.M.100.I-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-A.M.100.I-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-A.M.100.I-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-B.M.100.I-D.57 R:0.00334 P:0.00168 F:0.00224
57 ROUGE-4 Eval D0740-B.M.100.I-H.57 R:0.00341 P:0.00168 F:0.00225
57 ROUGE-4 Eval D0740-B.M.100.I-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-B.M.100.I-J.57 R:0.00333 P:0.00168 F:0.00223
57 ROUGE-4 Eval D0740-C.M.100.I-D.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-C.M.100.I-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-C.M.100.I-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0740-C.M.100.I-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-A.M.100.J-B.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-A.M.100.J-H.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-A.M.100.J-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-A.M.100.J-J.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-B.M.100.J-B.57 R:0.04290 P:0.02394 F:0.03073
57 ROUGE-4 Eval D0743-B.M.100.J-H.57 R:0.01948 P:0.01105 F:0.01410
57 ROUGE-4 Eval D0743-B.M.100.J-I.57 R:0.02280 P:0.01289 F:0.01647
57 ROUGE-4 Eval D0743-B.M.100.J-J.57 R:0.04167 P:0.02394 F:0.03041
57 ROUGE-4 Eval D0743-C.M.100.J-B.57 R:0.00327 P:0.00167 F:0.00221
57 ROUGE-4 Eval D0743-C.M.100.J-H.57 R:0.00328 P:0.00167 F:0.00221
57 ROUGE-4 Eval D0743-C.M.100.J-I.57 R:0.00000 P:0.00000 F:0.00000
57 ROUGE-4 Eval D0743-C.M.100.J-J.57 R:0.00324 P:0.00167 F:0.00220
---------------------------------------------
57 ROUGE-L Average_R: 0.24716 (95%-conf.int. 0.23695 - 0.25709)
57 ROUGE-L Average_P: 0.12741 (95%-conf.int. 0.12158 - 0.13311)
57 ROUGE-L Average_F: 0.16765 (95%-conf.int. 0.16026 - 0.17479)
.............................................
57 ROUGE-L Eval D0703-A.M.100.A-A.57 R:0.30068 P:0.16481 F:0.21292
57 ROUGE-L Eval D0703-A.M.100.A-C.57 R:0.24832 P:0.13704 F:0.17661
57 ROUGE-L Eval D0703-A.M.100.A-D.57 R:0.27491 P:0.14815 F:0.19254
57 ROUGE-L Eval D0703-A.M.100.A-J.57 R:0.28571 P:0.15556 F:0.20144
57 ROUGE-L Eval D0703-B.M.100.A-A.57 R:0.33007 P:0.19688 F:0.24664
57 ROUGE-L Eval D0703-B.M.100.A-C.57 R:0.31879 P:0.18519 F:0.23428
57 ROUGE-L Eval D0703-B.M.100.A-D.57 R:0.34228 P:0.19883 F:0.25154
57 ROUGE-L Eval D0703-B.M.100.A-J.57 R:0.33555 P:0.19688 F:0.24816
57 ROUGE-L Eval D0703-C.M.100.A-A.57 R:0.35333 P:0.18213 F:0.24036
57 ROUGE-L Eval D0703-C.M.100.A-C.57 R:0.32792 P:0.17354 F:0.22697
57 ROUGE-L Eval D0703-C.M.100.A-D.57 R:0.35099 P:0.18213 F:0.23982
57 ROUGE-L Eval D0703-C.M.100.A-J.57 R:0.36424 P:0.18900 F:0.24887
57 ROUGE-L Eval D0706-A.M.100.B-B.57 R:0.23701 P:0.11318 F:0.15320
57 ROUGE-L Eval D0706-A.M.100.B-D.57 R:0.21895 P:0.10388 F:0.14091
57 ROUGE-L Eval D0706-A.M.100.B-E.57 R:0.22403 P:0.10698 F:0.14481
57 ROUGE-L Eval D0706-A.M.100.B-I.57 R:0.23701 P:0.11318 F:0.15320
57 ROUGE-L Eval D0706-B.M.100.B-B.57 R:0.17320 P:0.08453 F:0.11361
57 ROUGE-L Eval D0706-B.M.100.B-D.57 R:0.16938 P:0.08293 F:0.11134
57 ROUGE-L Eval D0706-B.M.100.B-E.57 R:0.17857 P:0.08772 F:0.11765
57 ROUGE-L Eval D0706-B.M.100.B-I.57 R:0.18123 P:0.08931 F:0.11965
57 ROUGE-L Eval D0706-C.M.100.B-B.57 R:0.28065 P:0.14948 F:0.19506
57 ROUGE-L Eval D0706-C.M.100.B-D.57 R:0.26129 P:0.13918 F:0.18162
57 ROUGE-L Eval D0706-C.M.100.B-E.57 R:0.28205 P:0.15120 F:0.19687
57 ROUGE-L Eval D0706-C.M.100.B-I.57 R:0.29393 P:0.15808 F:0.20559
57 ROUGE-L Eval D0711-A.M.100.C-A.57 R:0.21382 P:0.11226 F:0.14722
57 ROUGE-L Eval D0711-A.M.100.C-B.57 R:0.24333 P:0.12608 F:0.16610
57 ROUGE-L Eval D0711-A.M.100.C-C.57 R:0.21667 P:0.11226 F:0.14789
57 ROUGE-L Eval D0711-A.M.100.C-F.57 R:0.26159 P:0.13644 F:0.17934
57 ROUGE-L Eval D0711-B.M.100.C-A.57 R:0.24490 P:0.13187 F:0.17143
57 ROUGE-L Eval D0711-B.M.100.C-B.57 R:0.26027 P:0.13919 F:0.18138
57 ROUGE-L Eval D0711-B.M.100.C-C.57 R:0.24497 P:0.13370 F:0.17299
57 ROUGE-L Eval D0711-B.M.100.C-F.57 R:0.25763 P:0.13919 F:0.18073
57 ROUGE-L Eval D0711-C.M.100.C-A.57 R:0.26733 P:0.15000 F:0.19217
57 ROUGE-L Eval D0711-C.M.100.C-B.57 R:0.28328 P:0.15370 F:0.19928
57 ROUGE-L Eval D0711-C.M.100.C-C.57 R:0.25676 P:0.14074 F:0.18182
57 ROUGE-L Eval D0711-C.M.100.C-F.57 R:0.23311 P:0.12778 F:0.16507
57 ROUGE-L Eval D0716-A.M.100.D-C.57 R:0.31803 P:0.16413 F:0.21652
57 ROUGE-L Eval D0716-A.M.100.D-D.57 R:0.32333 P:0.16413 F:0.21773
57 ROUGE-L Eval D0716-A.M.100.D-E.57 R:0.31229 P:0.15905 F:0.21076
57 ROUGE-L Eval D0716-A.M.100.D-F.57 R:0.29703 P:0.15228 F:0.20134
57 ROUGE-L Eval D0716-B.M.100.D-C.57 R:0.34211 P:0.17687 F:0.23318
57 ROUGE-L Eval D0716-B.M.100.D-D.57 R:0.33893 P:0.17177 F:0.22799
57 ROUGE-L Eval D0716-B.M.100.D-E.57 R:0.33223 P:0.17007 F:0.22497
57 ROUGE-L Eval D0716-B.M.100.D-F.57 R:0.34333 P:0.17517 F:0.23198
57 ROUGE-L Eval D0716-C.M.100.D-C.57 R:0.29642 P:0.13914 F:0.18938
57 ROUGE-L Eval D0716-C.M.100.D-D.57 R:0.28428 P:0.12997 F:0.17838
57 ROUGE-L Eval D0716-C.M.100.D-E.57 R:0.27393 P:0.12691 F:0.17346
57 ROUGE-L Eval D0716-C.M.100.D-F.57 R:0.27667 P:0.12691 F:0.17400
57 ROUGE-L Eval D0721-A.M.100.E-B.57 R:0.25000 P:0.13514 F:0.17544
57 ROUGE-L Eval D0721-A.M.100.E-C.57 R:0.25000 P:0.13874 F:0.17845
57 ROUGE-L Eval D0721-A.M.100.E-E.57 R:0.23052 P:0.12793 F:0.16454
57 ROUGE-L Eval D0721-A.M.100.E-G.57 R:0.23567 P:0.13333 F:0.17031
57 ROUGE-L Eval D0721-B.M.100.E-B.57 R:0.23779 P:0.10311 F:0.14385
57 ROUGE-L Eval D0721-B.M.100.E-C.57 R:0.26752 P:0.11864 F:0.16438
57 ROUGE-L Eval D0721-B.M.100.E-E.57 R:0.24590 P:0.10593 F:0.14807
57 ROUGE-L Eval D0721-B.M.100.E-G.57 R:0.25806 P:0.11299 F:0.15717
57 ROUGE-L Eval D0721-C.M.100.E-B.57 R:0.28852 P:0.13095 F:0.18014
57 ROUGE-L Eval D0721-C.M.100.E-C.57 R:0.26733 P:0.12054 F:0.16616
57 ROUGE-L Eval D0721-C.M.100.E-E.57 R:0.24333 P:0.10863 F:0.15020
57 ROUGE-L Eval D0721-C.M.100.E-G.57 R:0.27687 P:0.12649 F:0.17365
57 ROUGE-L Eval D0726-A.M.100.F-A.57 R:0.24917 P:0.12953 F:0.17045
57 ROUGE-L Eval D0726-A.M.100.F-E.57 R:0.27000 P:0.13990 F:0.18430
57 ROUGE-L Eval D0726-A.M.100.F-F.57 R:0.28904 P:0.15026 F:0.19773
57 ROUGE-L Eval D0726-A.M.100.F-G.57 R:0.26910 P:0.13990 F:0.18409
57 ROUGE-L Eval D0726-B.M.100.F-A.57 R:0.15033 P:0.08425 F:0.10798
57 ROUGE-L Eval D0726-B.M.100.F-E.57 R:0.15947 P:0.08791 F:0.11334
57 ROUGE-L Eval D0726-B.M.100.F-F.57 R:0.15615 P:0.08608 F:0.11098
57 ROUGE-L Eval D0726-B.M.100.F-G.57 R:0.16776 P:0.09341 F:0.12000
57 ROUGE-L Eval D0726-C.M.100.F-A.57 R:0.27667 P:0.14188 F:0.18757
57 ROUGE-L Eval D0726-C.M.100.F-E.57 R:0.28283 P:0.14359 F:0.19048
57 ROUGE-L Eval D0726-C.M.100.F-F.57 R:0.26441 P:0.13333 F:0.17727
57 ROUGE-L Eval D0726-C.M.100.F-G.57 R:0.25902 P:0.13504 F:0.17753
57 ROUGE-L Eval D0727-A.M.100.G-A.57 R:0.23256 P:0.13035 F:0.16706
57 ROUGE-L Eval D0727-A.M.100.G-F.57 R:0.22697 P:0.12849 F:0.16409
57 ROUGE-L Eval D0727-A.M.100.G-G.57 R:0.21569 P:0.12291 F:0.15659
57 ROUGE-L Eval D0727-A.M.100.G-H.57 R:0.22368 P:0.12663 F:0.16171
57 ROUGE-L Eval D0727-B.M.100.G-A.57 R:0.27491 P:0.13889 F:0.18454
57 ROUGE-L Eval D0727-B.M.100.G-F.57 R:0.29545 P:0.15799 F:0.20588
57 ROUGE-L Eval D0727-B.M.100.G-G.57 R:0.27682 P:0.13889 F:0.18497
57 ROUGE-L Eval D0727-B.M.100.G-H.57 R:0.27148 P:0.13715 F:0.18224
57 ROUGE-L Eval D0727-C.M.100.G-A.57 R:0.26059 P:0.13201 F:0.17524
57 ROUGE-L Eval D0727-C.M.100.G-F.57 R:0.30303 P:0.14851 F:0.19933
57 ROUGE-L Eval D0727-C.M.100.G-G.57 R:0.27063 P:0.13531 F:0.18042
57 ROUGE-L Eval D0727-C.M.100.G-H.57 R:0.28378 P:0.13861 F:0.18625
57 ROUGE-L Eval D0736-A.M.100.H-G.57 R:0.22222 P:0.09226 F:0.13039
57 ROUGE-L Eval D0736-A.M.100.H-H.57 R:0.24088 P:0.09821 F:0.13953
57 ROUGE-L Eval D0736-A.M.100.H-I.57 R:0.22064 P:0.09226 F:0.13011
57 ROUGE-L Eval D0736-A.M.100.H-J.57 R:0.22222 P:0.10119 F:0.13906
57 ROUGE-L Eval D0736-B.M.100.H-G.57 R:0.14122 P:0.05339 F:0.07749
57 ROUGE-L Eval D0736-B.M.100.H-H.57 R:0.12397 P:0.04329 F:0.06417
57 ROUGE-L Eval D0736-B.M.100.H-I.57 R:0.13808 P:0.04762 F:0.07082
57 ROUGE-L Eval D0736-B.M.100.H-J.57 R:0.15385 P:0.06349 F:0.08989
57 ROUGE-L Eval D0736-C.M.100.H-G.57 R:0.15190 P:0.05217 F:0.07767
57 ROUGE-L Eval D0736-C.M.100.H-H.57 R:0.13904 P:0.03768 F:0.05929
57 ROUGE-L Eval D0736-C.M.100.H-I.57 R:0.18182 P:0.04928 F:0.07754
57 ROUGE-L Eval D0736-C.M.100.H-J.57 R:0.14717 P:0.05652 F:0.08167
57 ROUGE-L Eval D0740-A.M.100.I-D.57 R:0.26403 P:0.15595 F:0.19608
57 ROUGE-L Eval D0740-A.M.100.I-H.57 R:0.24837 P:0.14815 F:0.18559
57 ROUGE-L Eval D0740-A.M.100.I-I.57 R:0.26299 P:0.15789 F:0.19732
57 ROUGE-L Eval D0740-A.M.100.I-J.57 R:0.25161 P:0.15205 F:0.18955
57 ROUGE-L Eval D0740-B.M.100.I-D.57 R:0.23052 P:0.11774 F:0.15587
57 ROUGE-L Eval D0740-B.M.100.I-H.57 R:0.23510 P:0.11774 F:0.15690
57 ROUGE-L Eval D0740-B.M.100.I-I.57 R:0.21639 P:0.10945 F:0.14537
57 ROUGE-L Eval D0740-B.M.100.I-J.57 R:0.22006 P:0.11277 F:0.14912
57 ROUGE-L Eval D0740-C.M.100.I-D.57 R:0.17891 P:0.11245 F:0.13810
57 ROUGE-L Eval D0740-C.M.100.I-H.57 R:0.15756 P:0.09839 F:0.12114
57 ROUGE-L Eval D0740-C.M.100.I-I.57 R:0.16294 P:0.10241 F:0.12577
57 ROUGE-L Eval D0740-C.M.100.I-J.57 R:0.16242 P:0.10241 F:0.12562
57 ROUGE-L Eval D0743-A.M.100.J-B.57 R:0.19683 P:0.10708 F:0.13870
57 ROUGE-L Eval D0743-A.M.100.J-H.57 R:0.17593 P:0.09845 F:0.12625
57 ROUGE-L Eval D0743-A.M.100.J-I.57 R:0.19062 P:0.10535 F:0.13570
57 ROUGE-L Eval D0743-A.M.100.J-J.57 R:0.17538 P:0.09845 F:0.12611
57 ROUGE-L Eval D0743-B.M.100.J-B.57 R:0.29808 P:0.16848 F:0.21528
57 ROUGE-L Eval D0743-B.M.100.J-H.57 R:0.25552 P:0.14674 F:0.18642
57 ROUGE-L Eval D0743-B.M.100.J-I.57 R:0.26899 P:0.15399 F:0.19586
57 ROUGE-L Eval D0743-B.M.100.J-J.57 R:0.25857 P:0.15036 F:0.19015
57 ROUGE-L Eval D0743-C.M.100.J-B.57 R:0.20635 P:0.10673 F:0.14069
57 ROUGE-L Eval D0743-C.M.100.J-H.57 R:0.19427 P:0.10016 F:0.13217
57 ROUGE-L Eval D0743-C.M.100.J-I.57 R:0.20447 P:0.10509 F:0.13883
57 ROUGE-L Eval D0743-C.M.100.J-J.57 R:0.19497 P:0.10181 F:0.13377
---------------------------------------------
57 ROUGE-W-1.2 Average_R: 0.08628 (95%-conf.int. 0.08301 - 0.08951)
57 ROUGE-W-1.2 Average_P: 0.08053 (95%-conf.int. 0.07694 - 0.08394)
57 ROUGE-W-1.2 Average_F: 0.08301 (95%-conf.int. 0.07952 - 0.08634)
.............................................
57 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.57 R:0.10478 P:0.10342 F:0.10410
57 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.57 R:0.08353 P:0.08378 F:0.08365
57 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.57 R:0.09845 P:0.09781 F:0.09813
57 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.57 R:0.10139 P:0.09443 F:0.09779
57 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.57 R:0.11238 P:0.12430 F:0.11804
57 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.57 R:0.10558 P:0.11605 F:0.11057
57 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.57 R:0.11391 P:0.12412 F:0.11880
57 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.57 R:0.11662 P:0.12691 F:0.12155
57 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.57 R:0.12059 P:0.11558 F:0.11803
57 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.57 R:0.10783 P:0.10774 F:0.10778
57 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.57 R:0.11745 P:0.11567 F:0.11655
57 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.57 R:0.12636 P:0.11810 F:0.12209
57 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.57 R:0.07990 P:0.06847 F:0.07374
57 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.57 R:0.07309 P:0.06363 F:0.06803
57 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.57 R:0.07339 P:0.06355 F:0.06812
57 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.57 R:0.07832 P:0.06930 F:0.07353
57 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.57 R:0.06524 P:0.05515 F:0.05977
57 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.57 R:0.06017 P:0.05196 F:0.05576
57 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.57 R:0.06266 P:0.05433 F:0.05820
57 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.57 R:0.06225 P:0.05548 F:0.05867
57 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.57 R:0.10037 P:0.09125 F:0.09559
57 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.57 R:0.09092 P:0.08336 F:0.08698
57 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.57 R:0.09769 P:0.08872 F:0.09299
57 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.57 R:0.10154 P:0.09484 F:0.09808
57 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.57 R:0.07338 P:0.06946 F:0.07137
57 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.57 R:0.08294 P:0.07784 F:0.08031
57 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.57 R:0.07398 P:0.06883 F:0.07131
57 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.57 R:0.08844 P:0.08368 F:0.08599
57 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.57 R:0.08549 P:0.08213 F:0.08378
57 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.57 R:0.08786 P:0.08806 F:0.08796
57 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.57 R:0.08343 P:0.08554 F:0.08447
57 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.57 R:0.08788 P:0.08818 F:0.08803
57 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.57 R:0.09178 P:0.09628 F:0.09398
57 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.57 R:0.09673 P:0.09815 F:0.09743
57 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.57 R:0.08575 P:0.08925 F:0.08747
57 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.57 R:0.07686 P:0.08120 F:0.07897
57 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.57 R:0.11096 P:0.10462 F:0.10770
57 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.57 R:0.10595 P:0.10247 F:0.10418
57 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.57 R:0.10676 P:0.10154 F:0.10408
57 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.57 R:0.09959 P:0.09709 F:0.09832
57 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.57 R:0.12379 P:0.11164 F:0.11740
57 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.57 R:0.12056 P:0.10934 F:0.11468
57 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.57 R:0.11635 P:0.10603 F:0.11095
57 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.57 R:0.11811 P:0.10666 F:0.11209
57 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.57 R:0.09819 P:0.08591 F:0.09164
57 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.57 R:0.09183 P:0.08142 F:0.08631
57 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.57 R:0.08952 P:0.08037 F:0.08470
57 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.57 R:0.08999 P:0.08030 F:0.08487
57 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.57 R:0.08930 P:0.08484 F:0.08701
57 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.57 R:0.08715 P:0.08580 F:0.08647
57 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.57 R:0.08136 P:0.08111 F:0.08123
57 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.57 R:0.08418 P:0.08346 F:0.08382
57 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.57 R:0.07940 P:0.06656 F:0.07242
57 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.57 R:0.08874 P:0.07397 F:0.08068
57 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.57 R:0.08040 P:0.06799 F:0.07368
57 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.57 R:0.08282 P:0.07237 F:0.07724
57 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.57 R:0.09944 P:0.08307 F:0.09052
57 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.57 R:0.08646 P:0.07335 F:0.07937
57 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.57 R:0.07866 P:0.06554 F:0.07150
57 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.57 R:0.09096 P:0.07771 F:0.08381
57 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.57 R:0.08887 P:0.08187 F:0.08523
57 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.57 R:0.09611 P:0.08724 F:0.09146
57 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.57 R:0.10139 P:0.09388 F:0.09749
57 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.57 R:0.09281 P:0.08734 F:0.08999
57 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.57 R:0.05313 P:0.05238 F:0.05275
57 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.57 R:0.05651 P:0.05624 F:0.05637
57 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.57 R:0.05297 P:0.05306 F:0.05301
57 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.57 R:0.05718 P:0.05748 F:0.05733
57 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.57 R:0.10032 P:0.09034 F:0.09507
57 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.57 R:0.10203 P:0.09143 F:0.09644
57 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.57 R:0.09314 P:0.08411 F:0.08839
57 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.57 R:0.09293 P:0.08675 F:0.08973
57 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.57 R:0.08119 P:0.08010 F:0.08064
57 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.57 R:0.07664 P:0.07919 F:0.07789
57 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.57 R:0.07439 P:0.07507 F:0.07473
57 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.57 R:0.07633 P:0.07746 F:0.07689
57 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.57 R:0.10116 P:0.08967 F:0.09507
57 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.57 R:0.10344 P:0.09936 F:0.10136
57 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.57 R:0.09838 P:0.08841 F:0.09313
57 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.57 R:0.09910 P:0.08862 F:0.09357
57 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.57 R:0.09097 P:0.08288 F:0.08674
57 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.57 R:0.10448 P:0.09464 F:0.09932
57 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.57 R:0.09394 P:0.08646 F:0.09004
57 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.57 R:0.09836 P:0.08647 F:0.09203
57 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.57 R:0.08168 P:0.06005 F:0.06921
57 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.57 R:0.08790 P:0.06303 F:0.07342
57 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.57 R:0.08053 P:0.06017 F:0.06888
57 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.57 R:0.07912 P:0.06423 F:0.07090
57 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.57 R:0.05220 P:0.03653 F:0.04298
57 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.57 R:0.04733 P:0.03058 F:0.03715
57 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.57 R:0.05256 P:0.03348 F:0.04090
57 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.57 R:0.05572 P:0.04251 F:0.04823
57 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.57 R:0.05682 P:0.03546 F:0.04367
57 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.57 R:0.05222 P:0.02645 F:0.03511
57 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.57 R:0.07011 P:0.03466 F:0.04639
57 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.57 R:0.05486 P:0.03759 F:0.04461
57 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.57 R:0.09340 P:0.10148 F:0.09727
57 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.57 R:0.08810 P:0.09481 F:0.09133
57 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.57 R:0.09177 P:0.10191 F:0.09657
57 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.57 R:0.08724 P:0.09685 F:0.09179
57 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.57 R:0.08112 P:0.07612 F:0.07854
57 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.57 R:0.08634 P:0.07695 F:0.08138
57 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.57 R:0.07454 P:0.07084 F:0.07264
57 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.57 R:0.08072 P:0.07395 F:0.07719
57 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.57 R:0.05893 P:0.07148 F:0.06460
57 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.57 R:0.05460 P:0.06364 F:0.05877
57 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.57 R:0.05372 P:0.06603 F:0.05924
57 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.57 R:0.05440 P:0.06572 F:0.05953
57 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.57 R:0.07330 P:0.06952 F:0.07136
57 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.57 R:0.06609 P:0.06388 F:0.06497
57 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.57 R:0.07062 P:0.06926 F:0.06993
57 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.57 R:0.06617 P:0.06448 F:0.06531
57 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.57 R:0.11458 P:0.10846 F:0.11144
57 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.57 R:0.09832 P:0.09364 F:0.09592
57 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.57 R:0.10202 P:0.09842 F:0.10019
57 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.57 R:0.10325 P:0.09872 F:0.10093
57 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.57 R:0.07395 P:0.06696 F:0.07028
57 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.57 R:0.07606 P:0.06549 F:0.07038
57 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.57 R:0.07363 P:0.06744 F:0.07040
57 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.57 R:0.07420 P:0.06522 F:0.06942
---------------------------------------------
57 ROUGE-SU4 Average_R: 0.07793 (95%-conf.int. 0.07258 - 0.08285)
57 ROUGE-SU4 Average_P: 0.03991 (95%-conf.int. 0.03707 - 0.04271)
57 ROUGE-SU4 Average_F: 0.05265 (95%-conf.int. 0.04897 - 0.05615)
.............................................
57 ROUGE-SU4 Eval D0703-A.M.100.A-A.57 R:0.09896 P:0.05357 F:0.06951
57 ROUGE-SU4 Eval D0703-A.M.100.A-C.57 R:0.08046 P:0.04386 F:0.05677
57 ROUGE-SU4 Eval D0703-A.M.100.A-D.57 R:0.09423 P:0.05013 F:0.06544
57 ROUGE-SU4 Eval D0703-A.M.100.A-J.57 R:0.08566 P:0.04605 F:0.05990
57 ROUGE-SU4 Eval D0703-B.M.100.A-A.57 R:0.14318 P:0.08449 F:0.10627
57 ROUGE-SU4 Eval D0703-B.M.100.A-C.57 R:0.12011 P:0.06898 F:0.08763
57 ROUGE-SU4 Eval D0703-B.M.100.A-D.57 R:0.13333 P:0.07657 F:0.09728
57 ROUGE-SU4 Eval D0703-B.M.100.A-J.57 R:0.14278 P:0.08284 F:0.10485
57 ROUGE-SU4 Eval D0703-C.M.100.A-A.57 R:0.15183 P:0.07724 F:0.10239
57 ROUGE-SU4 Eval D0703-C.M.100.A-C.57 R:0.12278 P:0.06417 F:0.08429
57 ROUGE-SU4 Eval D0703-C.M.100.A-D.57 R:0.13549 P:0.06940 F:0.09179
57 ROUGE-SU4 Eval D0703-C.M.100.A-J.57 R:0.14796 P:0.07578 F:0.10023
57 ROUGE-SU4 Eval D0706-A.M.100.B-B.57 R:0.05889 P:0.02773 F:0.03771
57 ROUGE-SU4 Eval D0706-A.M.100.B-D.57 R:0.05313 P:0.02486 F:0.03387
57 ROUGE-SU4 Eval D0706-A.M.100.B-E.57 R:0.05278 P:0.02486 F:0.03380
57 ROUGE-SU4 Eval D0706-A.M.100.B-I.57 R:0.05889 P:0.02773 F:0.03771
57 ROUGE-SU4 Eval D0706-B.M.100.B-B.57 R:0.04922 P:0.02369 F:0.03199
57 ROUGE-SU4 Eval D0706-B.M.100.B-D.57 R:0.04348 P:0.02100 F:0.02832
57 ROUGE-SU4 Eval D0706-B.M.100.B-E.57 R:0.05222 P:0.02531 F:0.03409
57 ROUGE-SU4 Eval D0706-B.M.100.B-I.57 R:0.05039 P:0.02450 F:0.03297
57 ROUGE-SU4 Eval D0706-C.M.100.B-B.57 R:0.07892 P:0.04152 F:0.05441
57 ROUGE-SU4 Eval D0706-C.M.100.B-D.57 R:0.07506 P:0.03949 F:0.05175
57 ROUGE-SU4 Eval D0706-C.M.100.B-E.57 R:0.07895 P:0.04181 F:0.05467
57 ROUGE-SU4 Eval D0706-C.M.100.B-I.57 R:0.08689 P:0.04617 F:0.06030
57 ROUGE-SU4 Eval D0711-A.M.100.C-A.57 R:0.06475 P:0.03357 F:0.04422
57 ROUGE-SU4 Eval D0711-A.M.100.C-B.57 R:0.07135 P:0.03649 F:0.04829
57 ROUGE-SU4 Eval D0711-A.M.100.C-C.57 R:0.06279 P:0.03211 F:0.04249
57 ROUGE-SU4 Eval D0711-A.M.100.C-F.57 R:0.07370 P:0.03795 F:0.05010
57 ROUGE-SU4 Eval D0711-B.M.100.C-A.57 R:0.07692 P:0.04089 F:0.05340
57 ROUGE-SU4 Eval D0711-B.M.100.C-B.57 R:0.08744 P:0.04616 F:0.06042
57 ROUGE-SU4 Eval D0711-B.M.100.C-C.57 R:0.07989 P:0.04306 F:0.05596
57 ROUGE-SU4 Eval D0711-B.M.100.C-F.57 R:0.08537 P:0.04554 F:0.05940
57 ROUGE-SU4 Eval D0711-C.M.100.C-A.57 R:0.08814 P:0.04887 F:0.06288
57 ROUGE-SU4 Eval D0711-C.M.100.C-B.57 R:0.09064 P:0.04856 F:0.06324
57 ROUGE-SU4 Eval D0711-C.M.100.C-C.57 R:0.08738 P:0.04731 F:0.06138
57 ROUGE-SU4 Eval D0711-C.M.100.C-F.57 R:0.07465 P:0.04041 F:0.05244
57 ROUGE-SU4 Eval D0716-A.M.100.D-C.57 R:0.10718 P:0.05460 F:0.07235
57 ROUGE-SU4 Eval D0716-A.M.100.D-D.57 R:0.11358 P:0.05689 F:0.07581
57 ROUGE-SU4 Eval D0716-A.M.100.D-E.57 R:0.10978 P:0.05517 F:0.07344
57 ROUGE-SU4 Eval D0716-A.M.100.D-F.57 R:0.10452 P:0.05289 F:0.07024
57 ROUGE-SU4 Eval D0716-B.M.100.D-C.57 R:0.11937 P:0.06092 F:0.08067
57 ROUGE-SU4 Eval D0716-B.M.100.D-D.57 R:0.12011 P:0.06006 F:0.08008
57 ROUGE-SU4 Eval D0716-B.M.100.D-E.57 R:0.10637 P:0.05374 F:0.07140
57 ROUGE-SU4 Eval D0716-B.M.100.D-F.57 R:0.11358 P:0.05718 F:0.07607
57 ROUGE-SU4 Eval D0716-C.M.100.D-C.57 R:0.09532 P:0.04412 F:0.06032
57 ROUGE-SU4 Eval D0716-C.M.100.D-D.57 R:0.10882 P:0.04902 F:0.06759
57 ROUGE-SU4 Eval D0716-C.M.100.D-E.57 R:0.09548 P:0.04360 F:0.05986
57 ROUGE-SU4 Eval D0716-C.M.100.D-F.57 R:0.09817 P:0.04438 F:0.06113
57 ROUGE-SU4 Eval D0721-A.M.100.E-B.57 R:0.05879 P:0.03138 F:0.04092
57 ROUGE-SU4 Eval D0721-A.M.100.E-C.57 R:0.06000 P:0.03291 F:0.04251
57 ROUGE-SU4 Eval D0721-A.M.100.E-E.57 R:0.05167 P:0.02834 F:0.03660
57 ROUGE-SU4 Eval D0721-A.M.100.E-G.57 R:0.05501 P:0.03077 F:0.03947
57 ROUGE-SU4 Eval D0721-B.M.100.E-B.57 R:0.06577 P:0.02810 F:0.03938
57 ROUGE-SU4 Eval D0721-B.M.100.E-C.57 R:0.07516 P:0.03286 F:0.04573
57 ROUGE-SU4 Eval D0721-B.M.100.E-E.57 R:0.07071 P:0.03000 F:0.04213
57 ROUGE-SU4 Eval D0721-B.M.100.E-G.57 R:0.07395 P:0.03190 F:0.04457
57 ROUGE-SU4 Eval D0721-C.M.100.E-B.57 R:0.09035 P:0.04041 F:0.05584
57 ROUGE-SU4 Eval D0721-C.M.100.E-C.57 R:0.08531 P:0.03790 F:0.05248
57 ROUGE-SU4 Eval D0721-C.M.100.E-E.57 R:0.07477 P:0.03288 F:0.04567
57 ROUGE-SU4 Eval D0721-C.M.100.E-G.57 R:0.08919 P:0.04016 F:0.05538
57 ROUGE-SU4 Eval D0726-A.M.100.F-A.57 R:0.07281 P:0.03736 F:0.04938
57 ROUGE-SU4 Eval D0726-A.M.100.F-E.57 R:0.08219 P:0.04203 F:0.05562
57 ROUGE-SU4 Eval D0726-A.M.100.F-F.57 R:0.09044 P:0.04641 F:0.06134
57 ROUGE-SU4 Eval D0726-A.M.100.F-G.57 R:0.07907 P:0.04057 F:0.05363
57 ROUGE-SU4 Eval D0726-B.M.100.F-A.57 R:0.03747 P:0.02076 F:0.02672
57 ROUGE-SU4 Eval D0726-B.M.100.F-E.57 R:0.04039 P:0.02200 F:0.02848
57 ROUGE-SU4 Eval D0726-B.M.100.F-F.57 R:0.04152 P:0.02261 F:0.02928
57 ROUGE-SU4 Eval D0726-B.M.100.F-G.57 R:0.04336 P:0.02385 F:0.03077
57 ROUGE-SU4 Eval D0726-C.M.100.F-A.57 R:0.09247 P:0.04679 F:0.06214
57 ROUGE-SU4 Eval D0726-C.M.100.F-E.57 R:0.09170 P:0.04593 F:0.06120
57 ROUGE-SU4 Eval D0726-C.M.100.F-F.57 R:0.08653 P:0.04304 F:0.05749
57 ROUGE-SU4 Eval D0726-C.M.100.F-G.57 R:0.08810 P:0.04535 F:0.05988
57 ROUGE-SU4 Eval D0727-A.M.100.G-A.57 R:0.05973 P:0.03308 F:0.04258
57 ROUGE-SU4 Eval D0727-A.M.100.G-F.57 R:0.05743 P:0.03214 F:0.04121
57 ROUGE-SU4 Eval D0727-A.M.100.G-G.57 R:0.05201 P:0.02930 F:0.03748
57 ROUGE-SU4 Eval D0727-A.M.100.G-H.57 R:0.05912 P:0.03308 F:0.04242
57 ROUGE-SU4 Eval D0727-B.M.100.G-A.57 R:0.09364 P:0.04665 F:0.06228
57 ROUGE-SU4 Eval D0727-B.M.100.G-F.57 R:0.11667 P:0.06162 F:0.08065
57 ROUGE-SU4 Eval D0727-B.M.100.G-G.57 R:0.10854 P:0.05370 F:0.07185
57 ROUGE-SU4 Eval D0727-B.M.100.G-H.57 R:0.10954 P:0.05458 F:0.07286
57 ROUGE-SU4 Eval D0727-C.M.100.G-A.57 R:0.07692 P:0.03846 F:0.05128
57 ROUGE-SU4 Eval D0727-C.M.100.G-F.57 R:0.10092 P:0.04877 F:0.06576
57 ROUGE-SU4 Eval D0727-C.M.100.G-G.57 R:0.08927 P:0.04404 F:0.05898
57 ROUGE-SU4 Eval D0727-C.M.100.G-H.57 R:0.09201 P:0.04431 F:0.05981
57 ROUGE-SU4 Eval D0736-A.M.100.H-G.57 R:0.05351 P:0.02184 F:0.03102
57 ROUGE-SU4 Eval D0736-A.M.100.H-H.57 R:0.06015 P:0.02410 F:0.03441
57 ROUGE-SU4 Eval D0736-A.M.100.H-I.57 R:0.05433 P:0.02234 F:0.03166
57 ROUGE-SU4 Eval D0736-A.M.100.H-J.57 R:0.05593 P:0.02510 F:0.03465
57 ROUGE-SU4 Eval D0736-B.M.100.H-G.57 R:0.03871 P:0.01436 F:0.02095
57 ROUGE-SU4 Eval D0736-B.M.100.H-H.57 R:0.03276 P:0.01119 F:0.01668
57 ROUGE-SU4 Eval D0736-B.M.100.H-I.57 R:0.03752 P:0.01265 F:0.01892
57 ROUGE-SU4 Eval D0736-B.M.100.H-J.57 R:0.04257 P:0.01727 F:0.02457
57 ROUGE-SU4 Eval D0736-C.M.100.H-G.57 R:0.03348 P:0.01124 F:0.01683
57 ROUGE-SU4 Eval D0736-C.M.100.H-H.57 R:0.02980 P:0.00782 F:0.01239
57 ROUGE-SU4 Eval D0736-C.M.100.H-I.57 R:0.04190 P:0.01100 F:0.01743
57 ROUGE-SU4 Eval D0736-C.M.100.H-J.57 R:0.03113 P:0.01173 F:0.01704
57 ROUGE-SU4 Eval D0740-A.M.100.I-D.57 R:0.09096 P:0.05314 F:0.06709
57 ROUGE-SU4 Eval D0740-A.M.100.I-H.57 R:0.08221 P:0.04851 F:0.06102
57 ROUGE-SU4 Eval D0740-A.M.100.I-I.57 R:0.09500 P:0.05644 F:0.07081
57 ROUGE-SU4 Eval D0740-A.M.100.I-J.57 R:0.08002 P:0.04785 F:0.05989
57 ROUGE-SU4 Eval D0740-B.M.100.I-D.57 R:0.06167 P:0.03109 F:0.04134
57 ROUGE-SU4 Eval D0740-B.M.100.I-H.57 R:0.06803 P:0.03361 F:0.04499
57 ROUGE-SU4 Eval D0740-B.M.100.I-I.57 R:0.06117 P:0.03053 F:0.04073
57 ROUGE-SU4 Eval D0740-B.M.100.I-J.57 R:0.06589 P:0.03333 F:0.04427
57 ROUGE-SU4 Eval D0740-C.M.100.I-D.57 R:0.05355 P:0.03333 F:0.04109
57 ROUGE-SU4 Eval D0740-C.M.100.I-H.57 R:0.04785 P:0.02959 F:0.03657
57 ROUGE-SU4 Eval D0740-C.M.100.I-I.57 R:0.04918 P:0.03061 F:0.03773
57 ROUGE-SU4 Eval D0740-C.M.100.I-J.57 R:0.04793 P:0.02993 F:0.03685
57 ROUGE-SU4 Eval D0743-A.M.100.J-B.57 R:0.05212 P:0.02802 F:0.03645
57 ROUGE-SU4 Eval D0743-A.M.100.J-H.57 R:0.04483 P:0.02481 F:0.03194
57 ROUGE-SU4 Eval D0743-A.M.100.J-I.57 R:0.05449 P:0.02977 F:0.03850
57 ROUGE-SU4 Eval D0743-A.M.100.J-J.57 R:0.04364 P:0.02423 F:0.03116
57 ROUGE-SU4 Eval D0743-B.M.100.J-B.57 R:0.12281 P:0.06863 F:0.08805
57 ROUGE-SU4 Eval D0743-B.M.100.J-H.57 R:0.09439 P:0.05362 F:0.06839
57 ROUGE-SU4 Eval D0743-B.M.100.J-I.57 R:0.10173 P:0.05760 F:0.07355
57 ROUGE-SU4 Eval D0743-B.M.100.J-J.57 R:0.10437 P:0.06005 F:0.07624
57 ROUGE-SU4 Eval D0743-C.M.100.J-B.57 R:0.05755 P:0.02940 F:0.03892
57 ROUGE-SU4 Eval D0743-C.M.100.J-H.57 R:0.05556 P:0.02829 F:0.03749
57 ROUGE-SU4 Eval D0743-C.M.100.J-I.57 R:0.05355 P:0.02718 F:0.03606
57 ROUGE-SU4 Eval D0743-C.M.100.J-J.57 R:0.05323 P:0.02745 F:0.03622
---------------------------------------------
58 ROUGE-1 Average_R: 0.35272 (95%-conf.int. 0.34236 - 0.36323)
58 ROUGE-1 Average_P: 0.21936 (95%-conf.int. 0.21269 - 0.22599)
58 ROUGE-1 Average_F: 0.26996 (95%-conf.int. 0.26209 - 0.27821)
.............................................
58 ROUGE-1 Eval D0703-A.M.100.A-A.58 R:0.33784 P:0.22523 F:0.27027
58 ROUGE-1 Eval D0703-A.M.100.A-C.58 R:0.31208 P:0.20946 F:0.25067
58 ROUGE-1 Eval D0703-A.M.100.A-D.58 R:0.32302 P:0.21171 F:0.25578
58 ROUGE-1 Eval D0703-A.M.100.A-J.58 R:0.35034 P:0.23198 F:0.27913
58 ROUGE-1 Eval D0703-B.M.100.A-A.58 R:0.47059 P:0.29448 F:0.36227
58 ROUGE-1 Eval D0703-B.M.100.A-C.58 R:0.47315 P:0.28834 F:0.35832
58 ROUGE-1 Eval D0703-B.M.100.A-D.58 R:0.44295 P:0.26994 F:0.33545
58 ROUGE-1 Eval D0703-B.M.100.A-J.58 R:0.49834 P:0.30675 F:0.37975
58 ROUGE-1 Eval D0703-C.M.100.A-A.58 R:0.39333 P:0.24131 F:0.29911
58 ROUGE-1 Eval D0703-C.M.100.A-C.58 R:0.40909 P:0.25767 F:0.31619
58 ROUGE-1 Eval D0703-C.M.100.A-D.58 R:0.40397 P:0.24949 F:0.30847
58 ROUGE-1 Eval D0703-C.M.100.A-J.58 R:0.42715 P:0.26380 F:0.32617
58 ROUGE-1 Eval D0706-A.M.100.B-B.58 R:0.44156 P:0.27812 F:0.34128
58 ROUGE-1 Eval D0706-A.M.100.B-D.58 R:0.42484 P:0.26585 F:0.32705
58 ROUGE-1 Eval D0706-A.M.100.B-E.58 R:0.39935 P:0.25153 F:0.30865
58 ROUGE-1 Eval D0706-A.M.100.B-I.58 R:0.43182 P:0.27198 F:0.33375
58 ROUGE-1 Eval D0706-B.M.100.B-B.58 R:0.26144 P:0.15504 F:0.19465
58 ROUGE-1 Eval D0706-B.M.100.B-D.58 R:0.25407 P:0.15116 F:0.18955
58 ROUGE-1 Eval D0706-B.M.100.B-E.58 R:0.23377 P:0.13953 F:0.17475
58 ROUGE-1 Eval D0706-B.M.100.B-I.58 R:0.25566 P:0.15310 F:0.19151
58 ROUGE-1 Eval D0706-C.M.100.B-B.58 R:0.33871 P:0.21212 F:0.26087
58 ROUGE-1 Eval D0706-C.M.100.B-D.58 R:0.35806 P:0.22424 F:0.27577
58 ROUGE-1 Eval D0706-C.M.100.B-E.58 R:0.36538 P:0.23030 F:0.28252
58 ROUGE-1 Eval D0706-C.M.100.B-I.58 R:0.37380 P:0.23636 F:0.28960
58 ROUGE-1 Eval D0711-A.M.100.C-A.58 R:0.33882 P:0.22889 F:0.27321
58 ROUGE-1 Eval D0711-A.M.100.C-B.58 R:0.38333 P:0.25556 F:0.30667
58 ROUGE-1 Eval D0711-A.M.100.C-C.58 R:0.38333 P:0.25556 F:0.30667
58 ROUGE-1 Eval D0711-A.M.100.C-F.58 R:0.39735 P:0.26667 F:0.31915
58 ROUGE-1 Eval D0711-B.M.100.C-A.58 R:0.32653 P:0.21333 F:0.25806
58 ROUGE-1 Eval D0711-B.M.100.C-B.58 R:0.34932 P:0.22667 F:0.27494
58 ROUGE-1 Eval D0711-B.M.100.C-C.58 R:0.32886 P:0.21778 F:0.26203
58 ROUGE-1 Eval D0711-B.M.100.C-F.58 R:0.34915 P:0.22889 F:0.27651
58 ROUGE-1 Eval D0711-C.M.100.C-A.58 R:0.32343 P:0.21491 F:0.25823
58 ROUGE-1 Eval D0711-C.M.100.C-B.58 R:0.33447 P:0.21491 F:0.26168
58 ROUGE-1 Eval D0711-C.M.100.C-C.58 R:0.31757 P:0.20614 F:0.25000
58 ROUGE-1 Eval D0711-C.M.100.C-F.58 R:0.29730 P:0.19298 F:0.23404
58 ROUGE-1 Eval D0716-A.M.100.D-C.58 R:0.43607 P:0.27536 F:0.33756
58 ROUGE-1 Eval D0716-A.M.100.D-D.58 R:0.42333 P:0.26294 F:0.32439
58 ROUGE-1 Eval D0716-A.M.100.D-E.58 R:0.46844 P:0.29193 F:0.35970
58 ROUGE-1 Eval D0716-A.M.100.D-F.58 R:0.43894 P:0.27536 F:0.33842
58 ROUGE-1 Eval D0716-B.M.100.D-C.58 R:0.42434 P:0.24022 F:0.30677
58 ROUGE-1 Eval D0716-B.M.100.D-D.58 R:0.49664 P:0.27561 F:0.35449
58 ROUGE-1 Eval D0716-B.M.100.D-E.58 R:0.46512 P:0.26071 F:0.33413
58 ROUGE-1 Eval D0716-B.M.100.D-F.58 R:0.46000 P:0.25698 F:0.32975
58 ROUGE-1 Eval D0716-C.M.100.D-C.58 R:0.41042 P:0.25926 F:0.31778
58 ROUGE-1 Eval D0716-C.M.100.D-D.58 R:0.42809 P:0.26337 F:0.32611
58 ROUGE-1 Eval D0716-C.M.100.D-E.58 R:0.44554 P:0.27778 F:0.34221
58 ROUGE-1 Eval D0716-C.M.100.D-F.58 R:0.43333 P:0.26749 F:0.33079
58 ROUGE-1 Eval D0721-A.M.100.E-B.58 R:0.33667 P:0.22149 F:0.26720
58 ROUGE-1 Eval D0721-A.M.100.E-C.58 R:0.33117 P:0.22368 F:0.26701
58 ROUGE-1 Eval D0721-A.M.100.E-E.58 R:0.32792 P:0.22149 F:0.26440
58 ROUGE-1 Eval D0721-A.M.100.E-G.58 R:0.33121 P:0.22807 F:0.27013
58 ROUGE-1 Eval D0721-B.M.100.E-B.58 R:0.34853 P:0.23465 F:0.28047
58 ROUGE-1 Eval D0721-B.M.100.E-C.58 R:0.34395 P:0.23684 F:0.28052
58 ROUGE-1 Eval D0721-B.M.100.E-E.58 R:0.32459 P:0.21711 F:0.26019
58 ROUGE-1 Eval D0721-B.M.100.E-G.58 R:0.33226 P:0.22588 F:0.26893
58 ROUGE-1 Eval D0721-C.M.100.E-B.58 R:0.34754 P:0.23094 F:0.27749
58 ROUGE-1 Eval D0721-C.M.100.E-C.58 R:0.32343 P:0.21351 F:0.25722
58 ROUGE-1 Eval D0721-C.M.100.E-E.58 R:0.29667 P:0.19390 F:0.23452
58 ROUGE-1 Eval D0721-C.M.100.E-G.58 R:0.31596 P:0.21133 F:0.25326
58 ROUGE-1 Eval D0726-A.M.100.F-A.58 R:0.33555 P:0.20911 F:0.25765
58 ROUGE-1 Eval D0726-A.M.100.F-E.58 R:0.33000 P:0.20497 F:0.25287
58 ROUGE-1 Eval D0726-A.M.100.F-F.58 R:0.35216 P:0.21946 F:0.27041
58 ROUGE-1 Eval D0726-A.M.100.F-G.58 R:0.32890 P:0.20497 F:0.25255
58 ROUGE-1 Eval D0726-B.M.100.F-A.58 R:0.32680 P:0.22371 F:0.26560
58 ROUGE-1 Eval D0726-B.M.100.F-E.58 R:0.32226 P:0.21700 F:0.25936
58 ROUGE-1 Eval D0726-B.M.100.F-F.58 R:0.30897 P:0.20805 F:0.24866
58 ROUGE-1 Eval D0726-B.M.100.F-G.58 R:0.32895 P:0.22371 F:0.26631
58 ROUGE-1 Eval D0726-C.M.100.F-A.58 R:0.37333 P:0.22904 F:0.28390
58 ROUGE-1 Eval D0726-C.M.100.F-E.58 R:0.37374 P:0.22699 F:0.28244
58 ROUGE-1 Eval D0726-C.M.100.F-F.58 R:0.38305 P:0.23108 F:0.28826
58 ROUGE-1 Eval D0726-C.M.100.F-G.58 R:0.36393 P:0.22699 F:0.27959
58 ROUGE-1 Eval D0727-A.M.100.G-A.58 R:0.30897 P:0.20261 F:0.24473
58 ROUGE-1 Eval D0727-A.M.100.G-F.58 R:0.30263 P:0.20044 F:0.24116
58 ROUGE-1 Eval D0727-A.M.100.G-G.58 R:0.30392 P:0.20261 F:0.24313
58 ROUGE-1 Eval D0727-A.M.100.G-H.58 R:0.31908 P:0.21133 F:0.25426
58 ROUGE-1 Eval D0727-B.M.100.G-A.58 R:0.37801 P:0.22917 F:0.28535
58 ROUGE-1 Eval D0727-B.M.100.G-F.58 R:0.34740 P:0.22292 F:0.27158
58 ROUGE-1 Eval D0727-B.M.100.G-G.58 R:0.35640 P:0.21458 F:0.26788
58 ROUGE-1 Eval D0727-B.M.100.G-H.58 R:0.36426 P:0.22083 F:0.27496
58 ROUGE-1 Eval D0727-C.M.100.G-A.58 R:0.35831 P:0.21956 F:0.27228
58 ROUGE-1 Eval D0727-C.M.100.G-F.58 R:0.37037 P:0.21956 F:0.27569
58 ROUGE-1 Eval D0727-C.M.100.G-G.58 R:0.36634 P:0.22156 F:0.27612
58 ROUGE-1 Eval D0727-C.M.100.G-H.58 R:0.36149 P:0.21357 F:0.26851
58 ROUGE-1 Eval D0736-A.M.100.H-G.58 R:0.29391 P:0.15709 F:0.20475
58 ROUGE-1 Eval D0736-A.M.100.H-H.58 R:0.31387 P:0.16475 F:0.21608
58 ROUGE-1 Eval D0736-A.M.100.H-I.58 R:0.28826 P:0.15517 F:0.20174
58 ROUGE-1 Eval D0736-A.M.100.H-J.58 R:0.28431 P:0.16667 F:0.21015
58 ROUGE-1 Eval D0736-B.M.100.H-G.58 R:0.37786 P:0.20122 F:0.26260
58 ROUGE-1 Eval D0736-B.M.100.H-H.58 R:0.38017 P:0.18699 F:0.25068
58 ROUGE-1 Eval D0736-B.M.100.H-I.58 R:0.34310 P:0.16667 F:0.22435
58 ROUGE-1 Eval D0736-B.M.100.H-J.58 R:0.36713 P:0.21341 F:0.26992
58 ROUGE-1 Eval D0736-C.M.100.H-G.58 R:0.32911 P:0.14773 F:0.20392
58 ROUGE-1 Eval D0736-C.M.100.H-H.58 R:0.33690 P:0.11932 F:0.17623
58 ROUGE-1 Eval D0736-C.M.100.H-I.58 R:0.31016 P:0.10985 F:0.16224
58 ROUGE-1 Eval D0736-C.M.100.H-J.58 R:0.31321 P:0.15720 F:0.20933
58 ROUGE-1 Eval D0740-A.M.100.I-D.58 R:0.29373 P:0.17980 F:0.22306
58 ROUGE-1 Eval D0740-A.M.100.I-H.58 R:0.28758 P:0.17778 F:0.21973
58 ROUGE-1 Eval D0740-A.M.100.I-I.58 R:0.28247 P:0.17576 F:0.21669
58 ROUGE-1 Eval D0740-A.M.100.I-J.58 R:0.29032 P:0.18182 F:0.22360
58 ROUGE-1 Eval D0740-B.M.100.I-D.58 R:0.36039 P:0.22561 F:0.27750
58 ROUGE-1 Eval D0740-B.M.100.I-H.58 R:0.34106 P:0.20935 F:0.25945
58 ROUGE-1 Eval D0740-B.M.100.I-I.58 R:0.39344 P:0.24390 F:0.30113
58 ROUGE-1 Eval D0740-B.M.100.I-J.58 R:0.35599 P:0.22358 F:0.27466
58 ROUGE-1 Eval D0740-C.M.100.I-D.58 R:0.40256 P:0.25767 F:0.31422
58 ROUGE-1 Eval D0740-C.M.100.I-H.58 R:0.39550 P:0.25153 F:0.30750
58 ROUGE-1 Eval D0740-C.M.100.I-I.58 R:0.39936 P:0.25562 F:0.31172
58 ROUGE-1 Eval D0740-C.M.100.I-J.58 R:0.40446 P:0.25971 F:0.31631
58 ROUGE-1 Eval D0743-A.M.100.J-B.58 R:0.31429 P:0.21290 F:0.25385
58 ROUGE-1 Eval D0743-A.M.100.J-H.58 R:0.29321 P:0.20430 F:0.24081
58 ROUGE-1 Eval D0743-A.M.100.J-I.58 R:0.29063 P:0.20000 F:0.23694
58 ROUGE-1 Eval D0743-A.M.100.J-J.58 R:0.25231 P:0.17634 F:0.20759
58 ROUGE-1 Eval D0743-B.M.100.J-B.58 R:0.29808 P:0.18788 F:0.23049
58 ROUGE-1 Eval D0743-B.M.100.J-H.58 R:0.27760 P:0.17778 F:0.21675
58 ROUGE-1 Eval D0743-B.M.100.J-I.58 R:0.25000 P:0.15960 F:0.19482
58 ROUGE-1 Eval D0743-B.M.100.J-J.58 R:0.29283 P:0.18990 F:0.23039
58 ROUGE-1 Eval D0743-C.M.100.J-B.58 R:0.29206 P:0.19048 F:0.23058
58 ROUGE-1 Eval D0743-C.M.100.J-H.58 R:0.27389 P:0.17805 F:0.21581
58 ROUGE-1 Eval D0743-C.M.100.J-I.58 R:0.32907 P:0.21325 F:0.25879
58 ROUGE-1 Eval D0743-C.M.100.J-J.58 R:0.28616 P:0.18841 F:0.22722
---------------------------------------------
58 ROUGE-2 Average_R: 0.08585 (95%-conf.int. 0.07764 - 0.09422)
58 ROUGE-2 Average_P: 0.05292 (95%-conf.int. 0.04793 - 0.05779)
58 ROUGE-2 Average_F: 0.06535 (95%-conf.int. 0.05912 - 0.07139)
.............................................
58 ROUGE-2 Eval D0703-A.M.100.A-A.58 R:0.12287 P:0.08163 F:0.09809
58 ROUGE-2 Eval D0703-A.M.100.A-C.58 R:0.09831 P:0.06576 F:0.07881
58 ROUGE-2 Eval D0703-A.M.100.A-D.58 R:0.11458 P:0.07483 F:0.09053
58 ROUGE-2 Eval D0703-A.M.100.A-J.58 R:0.12715 P:0.08390 F:0.10109
58 ROUGE-2 Eval D0703-B.M.100.A-A.58 R:0.21122 P:0.13169 F:0.16223
58 ROUGE-2 Eval D0703-B.M.100.A-C.58 R:0.17627 P:0.10700 F:0.13317
58 ROUGE-2 Eval D0703-B.M.100.A-D.58 R:0.17288 P:0.10494 F:0.13060
58 ROUGE-2 Eval D0703-B.M.100.A-J.58 R:0.23490 P:0.14403 F:0.17857
58 ROUGE-2 Eval D0703-C.M.100.A-A.58 R:0.14815 P:0.09053 F:0.11238
58 ROUGE-2 Eval D0703-C.M.100.A-C.58 R:0.17705 P:0.11111 F:0.13654
58 ROUGE-2 Eval D0703-C.M.100.A-D.58 R:0.16722 P:0.10288 F:0.12739
58 ROUGE-2 Eval D0703-C.M.100.A-J.58 R:0.18729 P:0.11523 F:0.14268
58 ROUGE-2 Eval D0706-A.M.100.B-B.58 R:0.15410 P:0.09671 F:0.11884
58 ROUGE-2 Eval D0706-A.M.100.B-D.58 R:0.15182 P:0.09465 F:0.11660
58 ROUGE-2 Eval D0706-A.M.100.B-E.58 R:0.13115 P:0.08230 F:0.10114
58 ROUGE-2 Eval D0706-A.M.100.B-I.58 R:0.15410 P:0.09671 F:0.11884
58 ROUGE-2 Eval D0706-B.M.100.B-B.58 R:0.03300 P:0.01949 F:0.02451
58 ROUGE-2 Eval D0706-B.M.100.B-D.58 R:0.03289 P:0.01949 F:0.02448
58 ROUGE-2 Eval D0706-B.M.100.B-E.58 R:0.02623 P:0.01559 F:0.01956
58 ROUGE-2 Eval D0706-B.M.100.B-I.58 R:0.02614 P:0.01559 F:0.01953
58 ROUGE-2 Eval D0706-C.M.100.B-B.58 R:0.08795 P:0.05488 F:0.06759
58 ROUGE-2 Eval D0706-C.M.100.B-D.58 R:0.08795 P:0.05488 F:0.06759
58 ROUGE-2 Eval D0706-C.M.100.B-E.58 R:0.10032 P:0.06301 F:0.07740
58 ROUGE-2 Eval D0706-C.M.100.B-I.58 R:0.10323 P:0.06504 F:0.07980
58 ROUGE-2 Eval D0711-A.M.100.C-A.58 R:0.05648 P:0.03803 F:0.04545
58 ROUGE-2 Eval D0711-A.M.100.C-B.58 R:0.09764 P:0.06488 F:0.07796
58 ROUGE-2 Eval D0711-A.M.100.C-C.58 R:0.09091 P:0.06040 F:0.07258
58 ROUGE-2 Eval D0711-A.M.100.C-F.58 R:0.08696 P:0.05817 F:0.06971
58 ROUGE-2 Eval D0711-B.M.100.C-A.58 R:0.03436 P:0.02237 F:0.02710
58 ROUGE-2 Eval D0711-B.M.100.C-B.58 R:0.04844 P:0.03132 F:0.03804
58 ROUGE-2 Eval D0711-B.M.100.C-C.58 R:0.03729 P:0.02461 F:0.02965
58 ROUGE-2 Eval D0711-B.M.100.C-F.58 R:0.03425 P:0.02237 F:0.02706
58 ROUGE-2 Eval D0711-C.M.100.C-A.58 R:0.02667 P:0.01766 F:0.02125
58 ROUGE-2 Eval D0711-C.M.100.C-B.58 R:0.02759 P:0.01766 F:0.02154
58 ROUGE-2 Eval D0711-C.M.100.C-C.58 R:0.02048 P:0.01325 F:0.01609
58 ROUGE-2 Eval D0711-C.M.100.C-F.58 R:0.02730 P:0.01766 F:0.02145
58 ROUGE-2 Eval D0716-A.M.100.D-C.58 R:0.15563 P:0.09792 F:0.12021
58 ROUGE-2 Eval D0716-A.M.100.D-D.58 R:0.12458 P:0.07708 F:0.09524
58 ROUGE-2 Eval D0716-A.M.100.D-E.58 R:0.16443 P:0.10208 F:0.12596
58 ROUGE-2 Eval D0716-A.M.100.D-F.58 R:0.14667 P:0.09167 F:0.11282
58 ROUGE-2 Eval D0716-B.M.100.D-C.58 R:0.13289 P:0.07491 F:0.09581
58 ROUGE-2 Eval D0716-B.M.100.D-D.58 R:0.20678 P:0.11423 F:0.14716
58 ROUGE-2 Eval D0716-B.M.100.D-E.58 R:0.17785 P:0.09925 F:0.12740
58 ROUGE-2 Eval D0716-B.M.100.D-F.58 R:0.19865 P:0.11049 F:0.14200
58 ROUGE-2 Eval D0716-C.M.100.D-C.58 R:0.14474 P:0.09110 F:0.11182
58 ROUGE-2 Eval D0716-C.M.100.D-D.58 R:0.12838 P:0.07867 F:0.09756
58 ROUGE-2 Eval D0716-C.M.100.D-E.58 R:0.14667 P:0.09110 F:0.11239
58 ROUGE-2 Eval D0716-C.M.100.D-F.58 R:0.12121 P:0.07453 F:0.09230
58 ROUGE-2 Eval D0721-A.M.100.E-B.58 R:0.09764 P:0.06402 F:0.07733
58 ROUGE-2 Eval D0721-A.M.100.E-C.58 R:0.08197 P:0.05519 F:0.06597
58 ROUGE-2 Eval D0721-A.M.100.E-E.58 R:0.06885 P:0.04636 F:0.05541
58 ROUGE-2 Eval D0721-A.M.100.E-G.58 R:0.08682 P:0.05960 F:0.07068
58 ROUGE-2 Eval D0721-B.M.100.E-B.58 R:0.07566 P:0.05077 F:0.06076
58 ROUGE-2 Eval D0721-B.M.100.E-C.58 R:0.07395 P:0.05077 F:0.06021
58 ROUGE-2 Eval D0721-B.M.100.E-E.58 R:0.05960 P:0.03974 F:0.04768
58 ROUGE-2 Eval D0721-B.M.100.E-G.58 R:0.05537 P:0.03753 F:0.04474
58 ROUGE-2 Eval D0721-C.M.100.E-B.58 R:0.07285 P:0.04825 F:0.05805
58 ROUGE-2 Eval D0721-C.M.100.E-C.58 R:0.06667 P:0.04386 F:0.05291
58 ROUGE-2 Eval D0721-C.M.100.E-E.58 R:0.03704 P:0.02412 F:0.02922
58 ROUGE-2 Eval D0721-C.M.100.E-G.58 R:0.06250 P:0.04167 F:0.05000
58 ROUGE-2 Eval D0726-A.M.100.F-A.58 R:0.05705 P:0.03542 F:0.04371
58 ROUGE-2 Eval D0726-A.M.100.F-E.58 R:0.05387 P:0.03333 F:0.04118
58 ROUGE-2 Eval D0726-A.M.100.F-F.58 R:0.06711 P:0.04167 F:0.05142
58 ROUGE-2 Eval D0726-A.M.100.F-G.58 R:0.04362 P:0.02708 F:0.03342
58 ROUGE-2 Eval D0726-B.M.100.F-A.58 R:0.08251 P:0.05631 F:0.06694
58 ROUGE-2 Eval D0726-B.M.100.F-E.58 R:0.06711 P:0.04505 F:0.05391
58 ROUGE-2 Eval D0726-B.M.100.F-F.58 R:0.06040 P:0.04054 F:0.04852
58 ROUGE-2 Eval D0726-B.M.100.F-G.58 R:0.05980 P:0.04054 F:0.04832
58 ROUGE-2 Eval D0726-C.M.100.F-A.58 R:0.09091 P:0.05556 F:0.06897
58 ROUGE-2 Eval D0726-C.M.100.F-E.58 R:0.06803 P:0.04115 F:0.05128
58 ROUGE-2 Eval D0726-C.M.100.F-F.58 R:0.07534 P:0.04527 F:0.05656
58 ROUGE-2 Eval D0726-C.M.100.F-G.58 R:0.06954 P:0.04321 F:0.05330
58 ROUGE-2 Eval D0727-A.M.100.G-A.58 R:0.03356 P:0.02193 F:0.02653
58 ROUGE-2 Eval D0727-A.M.100.G-F.58 R:0.04651 P:0.03070 F:0.03699
58 ROUGE-2 Eval D0727-A.M.100.G-G.58 R:0.04950 P:0.03289 F:0.03952
58 ROUGE-2 Eval D0727-A.M.100.G-H.58 R:0.04983 P:0.03289 F:0.03963
58 ROUGE-2 Eval D0727-B.M.100.G-A.58 R:0.10417 P:0.06289 F:0.07843
58 ROUGE-2 Eval D0727-B.M.100.G-F.58 R:0.08197 P:0.05241 F:0.06394
58 ROUGE-2 Eval D0727-B.M.100.G-G.58 R:0.09790 P:0.05870 F:0.07339
58 ROUGE-2 Eval D0727-B.M.100.G-H.58 R:0.10764 P:0.06499 F:0.08105
58 ROUGE-2 Eval D0727-C.M.100.G-A.58 R:0.04934 P:0.03012 F:0.03741
58 ROUGE-2 Eval D0727-C.M.100.G-F.58 R:0.06463 P:0.03815 F:0.04798
58 ROUGE-2 Eval D0727-C.M.100.G-G.58 R:0.06667 P:0.04016 F:0.05013
58 ROUGE-2 Eval D0727-C.M.100.G-H.58 R:0.06143 P:0.03614 F:0.04551
58 ROUGE-2 Eval D0736-A.M.100.H-G.58 R:0.03623 P:0.01927 F:0.02516
58 ROUGE-2 Eval D0736-A.M.100.H-H.58 R:0.03690 P:0.01927 F:0.02532
58 ROUGE-2 Eval D0736-A.M.100.H-I.58 R:0.03597 P:0.01927 F:0.02510
58 ROUGE-2 Eval D0736-A.M.100.H-J.58 R:0.02970 P:0.01734 F:0.02190
58 ROUGE-2 Eval D0736-B.M.100.H-G.58 R:0.10811 P:0.05726 F:0.07487
58 ROUGE-2 Eval D0736-B.M.100.H-H.58 R:0.11297 P:0.05521 F:0.07417
58 ROUGE-2 Eval D0736-B.M.100.H-I.58 R:0.05085 P:0.02454 F:0.03310
58 ROUGE-2 Eval D0736-B.M.100.H-J.58 R:0.09187 P:0.05317 F:0.06736
58 ROUGE-2 Eval D0736-C.M.100.H-G.58 R:0.08120 P:0.03619 F:0.05007
58 ROUGE-2 Eval D0736-C.M.100.H-H.58 R:0.10870 P:0.03810 F:0.05642
58 ROUGE-2 Eval D0736-C.M.100.H-I.58 R:0.04891 P:0.01714 F:0.02538
58 ROUGE-2 Eval D0736-C.M.100.H-J.58 R:0.08015 P:0.04000 F:0.05337
58 ROUGE-2 Eval D0740-A.M.100.I-D.58 R:0.07333 P:0.04472 F:0.05556
58 ROUGE-2 Eval D0740-A.M.100.I-H.58 R:0.07261 P:0.04472 F:0.05535
58 ROUGE-2 Eval D0740-A.M.100.I-I.58 R:0.05246 P:0.03252 F:0.04015
58 ROUGE-2 Eval D0740-A.M.100.I-J.58 R:0.05863 P:0.03659 F:0.04506
58 ROUGE-2 Eval D0740-B.M.100.I-D.58 R:0.07541 P:0.04703 F:0.05793
58 ROUGE-2 Eval D0740-B.M.100.I-H.58 R:0.07023 P:0.04294 F:0.05329
58 ROUGE-2 Eval D0740-B.M.100.I-I.58 R:0.08940 P:0.05521 F:0.06826
58 ROUGE-2 Eval D0740-B.M.100.I-J.58 R:0.08170 P:0.05112 F:0.06289
58 ROUGE-2 Eval D0740-C.M.100.I-D.58 R:0.07742 P:0.04938 F:0.06030
58 ROUGE-2 Eval D0740-C.M.100.I-H.58 R:0.07143 P:0.04527 F:0.05542
58 ROUGE-2 Eval D0740-C.M.100.I-I.58 R:0.09032 P:0.05761 F:0.07035
58 ROUGE-2 Eval D0740-C.M.100.I-J.58 R:0.09968 P:0.06379 F:0.07780
58 ROUGE-2 Eval D0743-A.M.100.J-B.58 R:0.05769 P:0.03896 F:0.04651
58 ROUGE-2 Eval D0743-A.M.100.J-H.58 R:0.05607 P:0.03896 F:0.04597
58 ROUGE-2 Eval D0743-A.M.100.J-I.58 R:0.03785 P:0.02597 F:0.03080
58 ROUGE-2 Eval D0743-A.M.100.J-J.58 R:0.03727 P:0.02597 F:0.03061
58 ROUGE-2 Eval D0743-B.M.100.J-B.58 R:0.04854 P:0.03049 F:0.03745
58 ROUGE-2 Eval D0743-B.M.100.J-H.58 R:0.04777 P:0.03049 F:0.03722
58 ROUGE-2 Eval D0743-B.M.100.J-I.58 R:0.02556 P:0.01626 F:0.01988
58 ROUGE-2 Eval D0743-B.M.100.J-J.58 R:0.05031 P:0.03252 F:0.03950
58 ROUGE-2 Eval D0743-C.M.100.J-B.58 R:0.05128 P:0.03333 F:0.04040
58 ROUGE-2 Eval D0743-C.M.100.J-H.58 R:0.04823 P:0.03125 F:0.03793
58 ROUGE-2 Eval D0743-C.M.100.J-I.58 R:0.05806 P:0.03750 F:0.04557
58 ROUGE-2 Eval D0743-C.M.100.J-J.58 R:0.04444 P:0.02917 F:0.03522
---------------------------------------------
58 ROUGE-3 Average_R: 0.03392 (95%-conf.int. 0.02902 - 0.03919)
58 ROUGE-3 Average_P: 0.02064 (95%-conf.int. 0.01768 - 0.02382)
58 ROUGE-3 Average_F: 0.02561 (95%-conf.int. 0.02197 - 0.02954)
.............................................
58 ROUGE-3 Eval D0703-A.M.100.A-A.58 R:0.04483 P:0.02968 F:0.03571
58 ROUGE-3 Eval D0703-A.M.100.A-C.58 R:0.03425 P:0.02283 F:0.02740
58 ROUGE-3 Eval D0703-A.M.100.A-D.58 R:0.03860 P:0.02511 F:0.03043
58 ROUGE-3 Eval D0703-A.M.100.A-J.58 R:0.04861 P:0.03196 F:0.03856
58 ROUGE-3 Eval D0703-B.M.100.A-A.58 R:0.12667 P:0.07867 F:0.09706
58 ROUGE-3 Eval D0703-B.M.100.A-C.58 R:0.08562 P:0.05176 F:0.06452
58 ROUGE-3 Eval D0703-B.M.100.A-D.58 R:0.08562 P:0.05176 F:0.06452
58 ROUGE-3 Eval D0703-B.M.100.A-J.58 R:0.13898 P:0.08489 F:0.10540
58 ROUGE-3 Eval D0703-C.M.100.A-A.58 R:0.06803 P:0.04141 F:0.05148
58 ROUGE-3 Eval D0703-C.M.100.A-C.58 R:0.08940 P:0.05590 F:0.06879
58 ROUGE-3 Eval D0703-C.M.100.A-D.58 R:0.08446 P:0.05176 F:0.06419
58 ROUGE-3 Eval D0703-C.M.100.A-J.58 R:0.10135 P:0.06211 F:0.07702
58 ROUGE-3 Eval D0706-A.M.100.B-B.58 R:0.07616 P:0.04762 F:0.05860
58 ROUGE-3 Eval D0706-A.M.100.B-D.58 R:0.08333 P:0.05176 F:0.06386
58 ROUGE-3 Eval D0706-A.M.100.B-E.58 R:0.05298 P:0.03313 F:0.04077
58 ROUGE-3 Eval D0706-A.M.100.B-I.58 R:0.08609 P:0.05383 F:0.06624
58 ROUGE-3 Eval D0706-B.M.100.B-B.58 R:0.00667 P:0.00392 F:0.00494
58 ROUGE-3 Eval D0706-B.M.100.B-D.58 R:0.00664 P:0.00392 F:0.00493
58 ROUGE-3 Eval D0706-B.M.100.B-E.58 R:0.00331 P:0.00196 F:0.00246
58 ROUGE-3 Eval D0706-B.M.100.B-I.58 R:0.00330 P:0.00196 F:0.00246
58 ROUGE-3 Eval D0706-C.M.100.B-B.58 R:0.05263 P:0.03272 F:0.04035
58 ROUGE-3 Eval D0706-C.M.100.B-D.58 R:0.05263 P:0.03272 F:0.04035
58 ROUGE-3 Eval D0706-C.M.100.B-E.58 R:0.05556 P:0.03476 F:0.04276
58 ROUGE-3 Eval D0706-C.M.100.B-I.58 R:0.05537 P:0.03476 F:0.04271
58 ROUGE-3 Eval D0711-A.M.100.C-A.58 R:0.01342 P:0.00901 F:0.01078
58 ROUGE-3 Eval D0711-A.M.100.C-B.58 R:0.04082 P:0.02703 F:0.03252
58 ROUGE-3 Eval D0711-A.M.100.C-C.58 R:0.03401 P:0.02252 F:0.02710
58 ROUGE-3 Eval D0711-A.M.100.C-F.58 R:0.03378 P:0.02252 F:0.02702
58 ROUGE-3 Eval D0711-B.M.100.C-A.58 R:0.00347 P:0.00225 F:0.00273
58 ROUGE-3 Eval D0711-B.M.100.C-B.58 R:0.00350 P:0.00225 F:0.00274
58 ROUGE-3 Eval D0711-B.M.100.C-C.58 R:0.00342 P:0.00225 F:0.00271
58 ROUGE-3 Eval D0711-B.M.100.C-F.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-3 Eval D0711-C.M.100.C-A.58 R:0.00337 P:0.00222 F:0.00268
58 ROUGE-3 Eval D0711-C.M.100.C-B.58 R:0.00348 P:0.00222 F:0.00271
58 ROUGE-3 Eval D0711-C.M.100.C-C.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-3 Eval D0711-C.M.100.C-F.58 R:0.00345 P:0.00222 F:0.00270
58 ROUGE-3 Eval D0716-A.M.100.D-C.58 R:0.05351 P:0.03354 F:0.04123
58 ROUGE-3 Eval D0716-A.M.100.D-D.58 R:0.02381 P:0.01468 F:0.01816
58 ROUGE-3 Eval D0716-A.M.100.D-E.58 R:0.05085 P:0.03145 F:0.03886
58 ROUGE-3 Eval D0716-A.M.100.D-F.58 R:0.04377 P:0.02725 F:0.03359
58 ROUGE-3 Eval D0716-B.M.100.D-C.58 R:0.06040 P:0.03390 F:0.04343
58 ROUGE-3 Eval D0716-B.M.100.D-D.58 R:0.11986 P:0.06591 F:0.08505
58 ROUGE-3 Eval D0716-B.M.100.D-E.58 R:0.10169 P:0.05650 F:0.07264
58 ROUGE-3 Eval D0716-B.M.100.D-F.58 R:0.11565 P:0.06403 F:0.08243
58 ROUGE-3 Eval D0716-C.M.100.D-C.58 R:0.06645 P:0.04167 F:0.05122
58 ROUGE-3 Eval D0716-C.M.100.D-D.58 R:0.06143 P:0.03750 F:0.04657
58 ROUGE-3 Eval D0716-C.M.100.D-E.58 R:0.06397 P:0.03958 F:0.04890
58 ROUGE-3 Eval D0716-C.M.100.D-F.58 R:0.05102 P:0.03125 F:0.03876
58 ROUGE-3 Eval D0721-A.M.100.E-B.58 R:0.03061 P:0.02000 F:0.02419
58 ROUGE-3 Eval D0721-A.M.100.E-C.58 R:0.02649 P:0.01778 F:0.02128
58 ROUGE-3 Eval D0721-A.M.100.E-E.58 R:0.00662 P:0.00444 F:0.00532
58 ROUGE-3 Eval D0721-A.M.100.E-G.58 R:0.02597 P:0.01778 F:0.02111
58 ROUGE-3 Eval D0721-B.M.100.E-B.58 R:0.01993 P:0.01333 F:0.01598
58 ROUGE-3 Eval D0721-B.M.100.E-C.58 R:0.01948 P:0.01333 F:0.01583
58 ROUGE-3 Eval D0721-B.M.100.E-E.58 R:0.01338 P:0.00889 F:0.01068
58 ROUGE-3 Eval D0721-B.M.100.E-G.58 R:0.01645 P:0.01111 F:0.01326
58 ROUGE-3 Eval D0721-C.M.100.E-B.58 R:0.03344 P:0.02208 F:0.02660
58 ROUGE-3 Eval D0721-C.M.100.E-C.58 R:0.03030 P:0.01987 F:0.02400
58 ROUGE-3 Eval D0721-C.M.100.E-E.58 R:0.01361 P:0.00883 F:0.01071
58 ROUGE-3 Eval D0721-C.M.100.E-G.58 R:0.03322 P:0.02208 F:0.02653
58 ROUGE-3 Eval D0726-A.M.100.F-A.58 R:0.02034 P:0.01258 F:0.01555
58 ROUGE-3 Eval D0726-A.M.100.F-E.58 R:0.02041 P:0.01258 F:0.01557
58 ROUGE-3 Eval D0726-A.M.100.F-F.58 R:0.02373 P:0.01468 F:0.01814
58 ROUGE-3 Eval D0726-A.M.100.F-G.58 R:0.00678 P:0.00419 F:0.00518
58 ROUGE-3 Eval D0726-B.M.100.F-A.58 R:0.04000 P:0.02721 F:0.03239
58 ROUGE-3 Eval D0726-B.M.100.F-E.58 R:0.03390 P:0.02268 F:0.02718
58 ROUGE-3 Eval D0726-B.M.100.F-F.58 R:0.02373 P:0.01587 F:0.01902
58 ROUGE-3 Eval D0726-B.M.100.F-G.58 R:0.02349 P:0.01587 F:0.01894
58 ROUGE-3 Eval D0726-C.M.100.F-A.58 R:0.04082 P:0.02484 F:0.03089
58 ROUGE-3 Eval D0726-C.M.100.F-E.58 R:0.02405 P:0.01449 F:0.01808
58 ROUGE-3 Eval D0726-C.M.100.F-F.58 R:0.03460 P:0.02070 F:0.02590
58 ROUGE-3 Eval D0726-C.M.100.F-G.58 R:0.02341 P:0.01449 F:0.01790
58 ROUGE-3 Eval D0727-A.M.100.G-A.58 R:0.00678 P:0.00442 F:0.00535
58 ROUGE-3 Eval D0727-A.M.100.G-F.58 R:0.02349 P:0.01545 F:0.01864
58 ROUGE-3 Eval D0727-A.M.100.G-G.58 R:0.02000 P:0.01325 F:0.01594
58 ROUGE-3 Eval D0727-A.M.100.G-H.58 R:0.02013 P:0.01325 F:0.01598
58 ROUGE-3 Eval D0727-B.M.100.G-A.58 R:0.03860 P:0.02321 F:0.02899
58 ROUGE-3 Eval D0727-B.M.100.G-F.58 R:0.01656 P:0.01055 F:0.01289
58 ROUGE-3 Eval D0727-B.M.100.G-G.58 R:0.03534 P:0.02110 F:0.02642
58 ROUGE-3 Eval D0727-B.M.100.G-H.58 R:0.03509 P:0.02110 F:0.02635
58 ROUGE-3 Eval D0727-C.M.100.G-A.58 R:0.00997 P:0.00606 F:0.00754
58 ROUGE-3 Eval D0727-C.M.100.G-F.58 R:0.00687 P:0.00404 F:0.00509
58 ROUGE-3 Eval D0727-C.M.100.G-G.58 R:0.01347 P:0.00808 F:0.01010
58 ROUGE-3 Eval D0727-C.M.100.G-H.58 R:0.01034 P:0.00606 F:0.00764
58 ROUGE-3 Eval D0736-A.M.100.H-G.58 R:0.01832 P:0.00969 F:0.01268
58 ROUGE-3 Eval D0736-A.M.100.H-H.58 R:0.01866 P:0.00969 F:0.01276
58 ROUGE-3 Eval D0736-A.M.100.H-I.58 R:0.01091 P:0.00581 F:0.00758
58 ROUGE-3 Eval D0736-A.M.100.H-J.58 R:0.00667 P:0.00388 F:0.00491
58 ROUGE-3 Eval D0736-B.M.100.H-G.58 R:0.06250 P:0.03292 F:0.04313
58 ROUGE-3 Eval D0736-B.M.100.H-H.58 R:0.05932 P:0.02881 F:0.03878
58 ROUGE-3 Eval D0736-B.M.100.H-I.58 R:0.02146 P:0.01029 F:0.01391
58 ROUGE-3 Eval D0736-B.M.100.H-J.58 R:0.04643 P:0.02675 F:0.03394
58 ROUGE-3 Eval D0736-C.M.100.H-G.58 R:0.04329 P:0.01916 F:0.02656
58 ROUGE-3 Eval D0736-C.M.100.H-H.58 R:0.05525 P:0.01916 F:0.02845
58 ROUGE-3 Eval D0736-C.M.100.H-I.58 R:0.00552 P:0.00192 F:0.00285
58 ROUGE-3 Eval D0736-C.M.100.H-J.58 R:0.03475 P:0.01724 F:0.02305
58 ROUGE-3 Eval D0740-A.M.100.I-D.58 R:0.02357 P:0.01431 F:0.01781
58 ROUGE-3 Eval D0740-A.M.100.I-H.58 R:0.02667 P:0.01636 F:0.02028
58 ROUGE-3 Eval D0740-A.M.100.I-I.58 R:0.01325 P:0.00818 F:0.01012
58 ROUGE-3 Eval D0740-A.M.100.I-J.58 R:0.01645 P:0.01022 F:0.01261
58 ROUGE-3 Eval D0740-B.M.100.I-D.58 R:0.00662 P:0.00412 F:0.00508
58 ROUGE-3 Eval D0740-B.M.100.I-H.58 R:0.01351 P:0.00823 F:0.01023
58 ROUGE-3 Eval D0740-B.M.100.I-I.58 R:0.01672 P:0.01029 F:0.01274
58 ROUGE-3 Eval D0740-B.M.100.I-J.58 R:0.01320 P:0.00823 F:0.01014
58 ROUGE-3 Eval D0740-C.M.100.I-D.58 R:0.02606 P:0.01656 F:0.02025
58 ROUGE-3 Eval D0740-C.M.100.I-H.58 R:0.02295 P:0.01449 F:0.01776
58 ROUGE-3 Eval D0740-C.M.100.I-I.58 R:0.03909 P:0.02484 F:0.03038
58 ROUGE-3 Eval D0740-C.M.100.I-J.58 R:0.03896 P:0.02484 F:0.03034
58 ROUGE-3 Eval D0743-A.M.100.J-B.58 R:0.01618 P:0.01089 F:0.01302
58 ROUGE-3 Eval D0743-A.M.100.J-H.58 R:0.01572 P:0.01089 F:0.01287
58 ROUGE-3 Eval D0743-A.M.100.J-I.58 R:0.00318 P:0.00218 F:0.00259
58 ROUGE-3 Eval D0743-A.M.100.J-J.58 R:0.01254 P:0.00871 F:0.01028
58 ROUGE-3 Eval D0743-B.M.100.J-B.58 R:0.00980 P:0.00613 F:0.00754
58 ROUGE-3 Eval D0743-B.M.100.J-H.58 R:0.00643 P:0.00409 F:0.00500
58 ROUGE-3 Eval D0743-B.M.100.J-I.58 R:0.00323 P:0.00204 F:0.00250
58 ROUGE-3 Eval D0743-B.M.100.J-J.58 R:0.00952 P:0.00613 F:0.00746
58 ROUGE-3 Eval D0743-C.M.100.J-B.58 R:0.00647 P:0.00419 F:0.00509
58 ROUGE-3 Eval D0743-C.M.100.J-H.58 R:0.01299 P:0.00839 F:0.01020
58 ROUGE-3 Eval D0743-C.M.100.J-I.58 R:0.01303 P:0.00839 F:0.01021
58 ROUGE-3 Eval D0743-C.M.100.J-J.58 R:0.00641 P:0.00419 F:0.00507
---------------------------------------------
58 ROUGE-4 Average_R: 0.01618 (95%-conf.int. 0.01298 - 0.01945)
58 ROUGE-4 Average_P: 0.00970 (95%-conf.int. 0.00783 - 0.01165)
58 ROUGE-4 Average_F: 0.01210 (95%-conf.int. 0.00971 - 0.01454)
.............................................
58 ROUGE-4 Eval D0703-A.M.100.A-A.58 R:0.01394 P:0.00920 F:0.01108
58 ROUGE-4 Eval D0703-A.M.100.A-C.58 R:0.01038 P:0.00690 F:0.00829
58 ROUGE-4 Eval D0703-A.M.100.A-D.58 R:0.02128 P:0.01379 F:0.01674
58 ROUGE-4 Eval D0703-A.M.100.A-J.58 R:0.01754 P:0.01149 F:0.01388
58 ROUGE-4 Eval D0703-B.M.100.A-A.58 R:0.08418 P:0.05208 F:0.06435
58 ROUGE-4 Eval D0703-B.M.100.A-C.58 R:0.04844 P:0.02917 F:0.03641
58 ROUGE-4 Eval D0703-B.M.100.A-D.58 R:0.04498 P:0.02708 F:0.03381
58 ROUGE-4 Eval D0703-B.M.100.A-J.58 R:0.08904 P:0.05417 F:0.06736
58 ROUGE-4 Eval D0703-C.M.100.A-A.58 R:0.03436 P:0.02083 F:0.02594
58 ROUGE-4 Eval D0703-C.M.100.A-C.58 R:0.04682 P:0.02917 F:0.03595
58 ROUGE-4 Eval D0703-C.M.100.A-D.58 R:0.04437 P:0.02708 F:0.03363
58 ROUGE-4 Eval D0703-C.M.100.A-J.58 R:0.05802 P:0.03542 F:0.04399
58 ROUGE-4 Eval D0706-A.M.100.B-B.58 R:0.04682 P:0.02917 F:0.03595
58 ROUGE-4 Eval D0706-A.M.100.B-D.58 R:0.05387 P:0.03333 F:0.04118
58 ROUGE-4 Eval D0706-A.M.100.B-E.58 R:0.03010 P:0.01875 F:0.02311
58 ROUGE-4 Eval D0706-A.M.100.B-I.58 R:0.05017 P:0.03125 F:0.03851
58 ROUGE-4 Eval D0706-B.M.100.B-B.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0706-B.M.100.B-D.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0706-B.M.100.B-E.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0706-B.M.100.B-I.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0706-C.M.100.B-B.58 R:0.03654 P:0.02263 F:0.02795
58 ROUGE-4 Eval D0706-C.M.100.B-D.58 R:0.03322 P:0.02058 F:0.02542
58 ROUGE-4 Eval D0706-C.M.100.B-E.58 R:0.03630 P:0.02263 F:0.02788
58 ROUGE-4 Eval D0706-C.M.100.B-I.58 R:0.03289 P:0.02058 F:0.02532
58 ROUGE-4 Eval D0711-A.M.100.C-A.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-A.M.100.C-B.58 R:0.00687 P:0.00454 F:0.00547
58 ROUGE-4 Eval D0711-A.M.100.C-C.58 R:0.00687 P:0.00454 F:0.00547
58 ROUGE-4 Eval D0711-A.M.100.C-F.58 R:0.00683 P:0.00454 F:0.00545
58 ROUGE-4 Eval D0711-B.M.100.C-A.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-B.M.100.C-B.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-B.M.100.C-C.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-B.M.100.C-F.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-C.M.100.C-A.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-C.M.100.C-B.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-C.M.100.C-C.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0711-C.M.100.C-F.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0716-A.M.100.D-C.58 R:0.01351 P:0.00844 F:0.01039
58 ROUGE-4 Eval D0716-A.M.100.D-D.58 R:0.00687 P:0.00422 F:0.00523
58 ROUGE-4 Eval D0716-A.M.100.D-E.58 R:0.01027 P:0.00633 F:0.00783
58 ROUGE-4 Eval D0716-A.M.100.D-F.58 R:0.01020 P:0.00633 F:0.00781
58 ROUGE-4 Eval D0716-B.M.100.D-C.58 R:0.02373 P:0.01326 F:0.01701
58 ROUGE-4 Eval D0716-B.M.100.D-D.58 R:0.06574 P:0.03598 F:0.04651
58 ROUGE-4 Eval D0716-B.M.100.D-E.58 R:0.05479 P:0.03030 F:0.03902
58 ROUGE-4 Eval D0716-B.M.100.D-F.58 R:0.06186 P:0.03409 F:0.04396
58 ROUGE-4 Eval D0716-C.M.100.D-C.58 R:0.03020 P:0.01887 F:0.02323
58 ROUGE-4 Eval D0716-C.M.100.D-D.58 R:0.02759 P:0.01677 F:0.02086
58 ROUGE-4 Eval D0716-C.M.100.D-E.58 R:0.02721 P:0.01677 F:0.02075
58 ROUGE-4 Eval D0716-C.M.100.D-F.58 R:0.01718 P:0.01048 F:0.01302
58 ROUGE-4 Eval D0721-A.M.100.E-B.58 R:0.01718 P:0.01119 F:0.01355
58 ROUGE-4 Eval D0721-A.M.100.E-C.58 R:0.01672 P:0.01119 F:0.01341
58 ROUGE-4 Eval D0721-A.M.100.E-E.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0721-A.M.100.E-G.58 R:0.01639 P:0.01119 F:0.01330
58 ROUGE-4 Eval D0721-B.M.100.E-B.58 R:0.00336 P:0.00224 F:0.00269
58 ROUGE-4 Eval D0721-B.M.100.E-C.58 R:0.00328 P:0.00224 F:0.00266
58 ROUGE-4 Eval D0721-B.M.100.E-E.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0721-B.M.100.E-G.58 R:0.00332 P:0.00224 F:0.00268
58 ROUGE-4 Eval D0721-C.M.100.E-B.58 R:0.02027 P:0.01333 F:0.01608
58 ROUGE-4 Eval D0721-C.M.100.E-C.58 R:0.01701 P:0.01111 F:0.01344
58 ROUGE-4 Eval D0721-C.M.100.E-E.58 R:0.00344 P:0.00222 F:0.00270
58 ROUGE-4 Eval D0721-C.M.100.E-G.58 R:0.02013 P:0.01333 F:0.01604
58 ROUGE-4 Eval D0726-A.M.100.F-A.58 R:0.01027 P:0.00633 F:0.00783
58 ROUGE-4 Eval D0726-A.M.100.F-E.58 R:0.01031 P:0.00633 F:0.00784
58 ROUGE-4 Eval D0726-A.M.100.F-F.58 R:0.01027 P:0.00633 F:0.00783
58 ROUGE-4 Eval D0726-A.M.100.F-G.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0726-B.M.100.F-A.58 R:0.02020 P:0.01370 F:0.01633
58 ROUGE-4 Eval D0726-B.M.100.F-E.58 R:0.02055 P:0.01370 F:0.01644
58 ROUGE-4 Eval D0726-B.M.100.F-F.58 R:0.01027 P:0.00685 F:0.00822
58 ROUGE-4 Eval D0726-B.M.100.F-G.58 R:0.01017 P:0.00685 F:0.00819
58 ROUGE-4 Eval D0726-C.M.100.F-A.58 R:0.01718 P:0.01042 F:0.01297
58 ROUGE-4 Eval D0726-C.M.100.F-E.58 R:0.00694 P:0.00417 F:0.00521
58 ROUGE-4 Eval D0726-C.M.100.F-F.58 R:0.01748 P:0.01042 F:0.01306
58 ROUGE-4 Eval D0726-C.M.100.F-G.58 R:0.01014 P:0.00625 F:0.00773
58 ROUGE-4 Eval D0727-A.M.100.G-A.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0727-A.M.100.G-F.58 R:0.01356 P:0.00889 F:0.01074
58 ROUGE-4 Eval D0727-A.M.100.G-G.58 R:0.01347 P:0.00889 F:0.01071
58 ROUGE-4 Eval D0727-A.M.100.G-H.58 R:0.01356 P:0.00889 F:0.01074
58 ROUGE-4 Eval D0727-B.M.100.G-A.58 R:0.01064 P:0.00637 F:0.00797
58 ROUGE-4 Eval D0727-B.M.100.G-F.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0727-B.M.100.G-G.58 R:0.01071 P:0.00637 F:0.00799
58 ROUGE-4 Eval D0727-B.M.100.G-H.58 R:0.01064 P:0.00637 F:0.00797
58 ROUGE-4 Eval D0727-C.M.100.G-A.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0727-C.M.100.G-F.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0727-C.M.100.G-G.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0727-C.M.100.G-H.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0736-A.M.100.H-G.58 R:0.01111 P:0.00585 F:0.00766
58 ROUGE-4 Eval D0736-A.M.100.H-H.58 R:0.01132 P:0.00585 F:0.00771
58 ROUGE-4 Eval D0736-A.M.100.H-I.58 R:0.00735 P:0.00390 F:0.00510
58 ROUGE-4 Eval D0736-A.M.100.H-J.58 R:0.00337 P:0.00195 F:0.00247
58 ROUGE-4 Eval D0736-B.M.100.H-G.58 R:0.04348 P:0.02277 F:0.02989
58 ROUGE-4 Eval D0736-B.M.100.H-H.58 R:0.04292 P:0.02070 F:0.02793
58 ROUGE-4 Eval D0736-B.M.100.H-I.58 R:0.01304 P:0.00621 F:0.00841
58 ROUGE-4 Eval D0736-B.M.100.H-J.58 R:0.03249 P:0.01863 F:0.02368
58 ROUGE-4 Eval D0736-C.M.100.H-G.58 R:0.02632 P:0.01156 F:0.01606
58 ROUGE-4 Eval D0736-C.M.100.H-H.58 R:0.03371 P:0.01156 F:0.01722
58 ROUGE-4 Eval D0736-C.M.100.H-I.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0736-C.M.100.H-J.58 R:0.02344 P:0.01156 F:0.01548
58 ROUGE-4 Eval D0740-A.M.100.I-D.58 R:0.00680 P:0.00412 F:0.00513
58 ROUGE-4 Eval D0740-A.M.100.I-H.58 R:0.00673 P:0.00412 F:0.00511
58 ROUGE-4 Eval D0740-A.M.100.I-I.58 R:0.00334 P:0.00206 F:0.00255
58 ROUGE-4 Eval D0740-A.M.100.I-J.58 R:0.00332 P:0.00206 F:0.00254
58 ROUGE-4 Eval D0740-B.M.100.I-D.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0740-B.M.100.I-H.58 R:0.00341 P:0.00207 F:0.00258
58 ROUGE-4 Eval D0740-B.M.100.I-I.58 R:0.00338 P:0.00207 F:0.00257
58 ROUGE-4 Eval D0740-B.M.100.I-J.58 R:0.00333 P:0.00207 F:0.00255
58 ROUGE-4 Eval D0740-C.M.100.I-D.58 R:0.01316 P:0.00833 F:0.01020
58 ROUGE-4 Eval D0740-C.M.100.I-H.58 R:0.00993 P:0.00625 F:0.00767
58 ROUGE-4 Eval D0740-C.M.100.I-I.58 R:0.02303 P:0.01458 F:0.01786
58 ROUGE-4 Eval D0740-C.M.100.I-J.58 R:0.02295 P:0.01458 F:0.01783
58 ROUGE-4 Eval D0743-A.M.100.J-B.58 R:0.00327 P:0.00219 F:0.00262
58 ROUGE-4 Eval D0743-A.M.100.J-H.58 R:0.00317 P:0.00219 F:0.00259
58 ROUGE-4 Eval D0743-A.M.100.J-I.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-A.M.100.J-J.58 R:0.00316 P:0.00219 F:0.00259
58 ROUGE-4 Eval D0743-B.M.100.J-B.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-B.M.100.J-H.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-B.M.100.J-I.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-B.M.100.J-J.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-C.M.100.J-B.58 R:0.00000 P:0.00000 F:0.00000
58 ROUGE-4 Eval D0743-C.M.100.J-H.58 R:0.00328 P:0.00211 F:0.00257
58 ROUGE-4 Eval D0743-C.M.100.J-I.58 R:0.00329 P:0.00211 F:0.00257
58 ROUGE-4 Eval D0743-C.M.100.J-J.58 R:0.00324 P:0.00211 F:0.00256
---------------------------------------------
58 ROUGE-L Average_R: 0.31162 (95%-conf.int. 0.30247 - 0.32110)
58 ROUGE-L Average_P: 0.19361 (95%-conf.int. 0.18762 - 0.19914)
58 ROUGE-L Average_F: 0.23834 (95%-conf.int. 0.23151 - 0.24527)
.............................................
58 ROUGE-L Eval D0703-A.M.100.A-A.58 R:0.31757 P:0.21171 F:0.25405
58 ROUGE-L Eval D0703-A.M.100.A-C.58 R:0.28859 P:0.19369 F:0.23180
58 ROUGE-L Eval D0703-A.M.100.A-D.58 R:0.30241 P:0.19820 F:0.23946
58 ROUGE-L Eval D0703-A.M.100.A-J.58 R:0.33333 P:0.22072 F:0.26558
58 ROUGE-L Eval D0703-B.M.100.A-A.58 R:0.41503 P:0.25971 F:0.31949
58 ROUGE-L Eval D0703-B.M.100.A-C.58 R:0.40940 P:0.24949 F:0.31004
58 ROUGE-L Eval D0703-B.M.100.A-D.58 R:0.40604 P:0.24744 F:0.30749
58 ROUGE-L Eval D0703-B.M.100.A-J.58 R:0.45515 P:0.28016 F:0.34683
58 ROUGE-L Eval D0703-C.M.100.A-A.58 R:0.34333 P:0.21063 F:0.26109
58 ROUGE-L Eval D0703-C.M.100.A-C.58 R:0.36039 P:0.22699 F:0.27854
58 ROUGE-L Eval D0703-C.M.100.A-D.58 R:0.35762 P:0.22086 F:0.27307
58 ROUGE-L Eval D0703-C.M.100.A-J.58 R:0.39404 P:0.24335 F:0.30088
58 ROUGE-L Eval D0706-A.M.100.B-B.58 R:0.39935 P:0.25153 F:0.30865
58 ROUGE-L Eval D0706-A.M.100.B-D.58 R:0.37255 P:0.23313 F:0.28679
58 ROUGE-L Eval D0706-A.M.100.B-E.58 R:0.36039 P:0.22699 F:0.27854
58 ROUGE-L Eval D0706-A.M.100.B-I.58 R:0.38961 P:0.24540 F:0.30113
58 ROUGE-L Eval D0706-B.M.100.B-B.58 R:0.23856 P:0.14147 F:0.17761
58 ROUGE-L Eval D0706-B.M.100.B-D.58 R:0.22476 P:0.13372 F:0.16768
58 ROUGE-L Eval D0706-B.M.100.B-E.58 R:0.20779 P:0.12403 F:0.15534
58 ROUGE-L Eval D0706-B.M.100.B-I.58 R:0.22654 P:0.13566 F:0.16970
58 ROUGE-L Eval D0706-C.M.100.B-B.58 R:0.31290 P:0.19596 F:0.24099
58 ROUGE-L Eval D0706-C.M.100.B-D.58 R:0.31935 P:0.20000 F:0.24596
58 ROUGE-L Eval D0706-C.M.100.B-E.58 R:0.31090 P:0.19596 F:0.24040
58 ROUGE-L Eval D0706-C.M.100.B-I.58 R:0.31949 P:0.20202 F:0.24752
58 ROUGE-L Eval D0711-A.M.100.C-A.58 R:0.29276 P:0.19778 F:0.23607
58 ROUGE-L Eval D0711-A.M.100.C-B.58 R:0.32333 P:0.21556 F:0.25867
58 ROUGE-L Eval D0711-A.M.100.C-C.58 R:0.31333 P:0.20889 F:0.25067
58 ROUGE-L Eval D0711-A.M.100.C-F.58 R:0.31457 P:0.21111 F:0.25266
58 ROUGE-L Eval D0711-B.M.100.C-A.58 R:0.27551 P:0.18000 F:0.21774
58 ROUGE-L Eval D0711-B.M.100.C-B.58 R:0.29452 P:0.19111 F:0.23180
58 ROUGE-L Eval D0711-B.M.100.C-C.58 R:0.26174 P:0.17333 F:0.20855
58 ROUGE-L Eval D0711-B.M.100.C-F.58 R:0.29831 P:0.19556 F:0.23625
58 ROUGE-L Eval D0711-C.M.100.C-A.58 R:0.28053 P:0.18640 F:0.22398
58 ROUGE-L Eval D0711-C.M.100.C-B.58 R:0.28669 P:0.18421 F:0.22430
58 ROUGE-L Eval D0711-C.M.100.C-C.58 R:0.26689 P:0.17325 F:0.21011
58 ROUGE-L Eval D0711-C.M.100.C-F.58 R:0.25676 P:0.16667 F:0.20213
58 ROUGE-L Eval D0716-A.M.100.D-C.58 R:0.38689 P:0.24431 F:0.29950
58 ROUGE-L Eval D0716-A.M.100.D-D.58 R:0.37000 P:0.22981 F:0.28352
58 ROUGE-L Eval D0716-A.M.100.D-E.58 R:0.40864 P:0.25466 F:0.31378
58 ROUGE-L Eval D0716-A.M.100.D-F.58 R:0.38284 P:0.24017 F:0.29517
58 ROUGE-L Eval D0716-B.M.100.D-C.58 R:0.36184 P:0.20484 F:0.26159
58 ROUGE-L Eval D0716-B.M.100.D-D.58 R:0.43960 P:0.24395 F:0.31377
58 ROUGE-L Eval D0716-B.M.100.D-E.58 R:0.40864 P:0.22905 F:0.29356
58 ROUGE-L Eval D0716-B.M.100.D-F.58 R:0.40667 P:0.22719 F:0.29152
58 ROUGE-L Eval D0716-C.M.100.D-C.58 R:0.37134 P:0.23457 F:0.28752
58 ROUGE-L Eval D0716-C.M.100.D-D.58 R:0.37124 P:0.22840 F:0.28281
58 ROUGE-L Eval D0716-C.M.100.D-E.58 R:0.38944 P:0.24280 F:0.29911
58 ROUGE-L Eval D0716-C.M.100.D-F.58 R:0.36667 P:0.22634 F:0.27990
58 ROUGE-L Eval D0721-A.M.100.E-B.58 R:0.31333 P:0.20614 F:0.24868
58 ROUGE-L Eval D0721-A.M.100.E-C.58 R:0.30519 P:0.20614 F:0.24607
58 ROUGE-L Eval D0721-A.M.100.E-E.58 R:0.28896 P:0.19518 F:0.23299
58 ROUGE-L Eval D0721-A.M.100.E-G.58 R:0.29299 P:0.20175 F:0.23896
58 ROUGE-L Eval D0721-B.M.100.E-B.58 R:0.30293 P:0.20395 F:0.24378
58 ROUGE-L Eval D0721-B.M.100.E-C.58 R:0.30255 P:0.20833 F:0.24675
58 ROUGE-L Eval D0721-B.M.100.E-E.58 R:0.27869 P:0.18640 F:0.22339
58 ROUGE-L Eval D0721-B.M.100.E-G.58 R:0.28065 P:0.19079 F:0.22716
58 ROUGE-L Eval D0721-C.M.100.E-B.58 R:0.31148 P:0.20697 F:0.24869
58 ROUGE-L Eval D0721-C.M.100.E-C.58 R:0.28383 P:0.18736 F:0.22572
58 ROUGE-L Eval D0721-C.M.100.E-E.58 R:0.26000 P:0.16993 F:0.20553
58 ROUGE-L Eval D0721-C.M.100.E-G.58 R:0.28013 P:0.18736 F:0.22454
58 ROUGE-L Eval D0726-A.M.100.F-A.58 R:0.28571 P:0.17805 F:0.21938
58 ROUGE-L Eval D0726-A.M.100.F-E.58 R:0.27667 P:0.17184 F:0.21200
58 ROUGE-L Eval D0726-A.M.100.F-F.58 R:0.29900 P:0.18634 F:0.22959
58 ROUGE-L Eval D0726-A.M.100.F-G.58 R:0.27575 P:0.17184 F:0.21173
58 ROUGE-L Eval D0726-B.M.100.F-A.58 R:0.28758 P:0.19687 F:0.23373
58 ROUGE-L Eval D0726-B.M.100.F-E.58 R:0.27575 P:0.18568 F:0.22192
58 ROUGE-L Eval D0726-B.M.100.F-F.58 R:0.26910 P:0.18121 F:0.21658
58 ROUGE-L Eval D0726-B.M.100.F-G.58 R:0.27632 P:0.18792 F:0.22370
58 ROUGE-L Eval D0726-C.M.100.F-A.58 R:0.33000 P:0.20245 F:0.25095
58 ROUGE-L Eval D0726-C.M.100.F-E.58 R:0.31987 P:0.19427 F:0.24173
58 ROUGE-L Eval D0726-C.M.100.F-F.58 R:0.34915 P:0.21063 F:0.26275
58 ROUGE-L Eval D0726-C.M.100.F-G.58 R:0.33443 P:0.20859 F:0.25693
58 ROUGE-L Eval D0727-A.M.100.G-A.58 R:0.27243 P:0.17865 F:0.21579
58 ROUGE-L Eval D0727-A.M.100.G-F.58 R:0.25658 P:0.16993 F:0.20445
58 ROUGE-L Eval D0727-A.M.100.G-G.58 R:0.27124 P:0.18083 F:0.21699
58 ROUGE-L Eval D0727-A.M.100.G-H.58 R:0.28618 P:0.18954 F:0.22804
58 ROUGE-L Eval D0727-B.M.100.G-A.58 R:0.35739 P:0.21667 F:0.26978
58 ROUGE-L Eval D0727-B.M.100.G-F.58 R:0.33117 P:0.21250 F:0.25888
58 ROUGE-L Eval D0727-B.M.100.G-G.58 R:0.32872 P:0.19792 F:0.24708
58 ROUGE-L Eval D0727-B.M.100.G-H.58 R:0.34708 P:0.21042 F:0.26200
58 ROUGE-L Eval D0727-C.M.100.G-A.58 R:0.31596 P:0.19361 F:0.24010
58 ROUGE-L Eval D0727-C.M.100.G-F.58 R:0.32323 P:0.19162 F:0.24060
58 ROUGE-L Eval D0727-C.M.100.G-G.58 R:0.31353 P:0.18962 F:0.23632
58 ROUGE-L Eval D0727-C.M.100.G-H.58 R:0.32432 P:0.19162 F:0.24090
58 ROUGE-L Eval D0736-A.M.100.H-G.58 R:0.27240 P:0.14559 F:0.18976
58 ROUGE-L Eval D0736-A.M.100.H-H.58 R:0.28832 P:0.15134 F:0.19849
58 ROUGE-L Eval D0736-A.M.100.H-I.58 R:0.27402 P:0.14751 F:0.19178
58 ROUGE-L Eval D0736-A.M.100.H-J.58 R:0.26144 P:0.15326 F:0.19324
58 ROUGE-L Eval D0736-B.M.100.H-G.58 R:0.32824 P:0.17480 F:0.22812
58 ROUGE-L Eval D0736-B.M.100.H-H.58 R:0.32231 P:0.15854 F:0.21254
58 ROUGE-L Eval D0736-B.M.100.H-I.58 R:0.28452 P:0.13821 F:0.18605
58 ROUGE-L Eval D0736-B.M.100.H-J.58 R:0.31119 P:0.18089 F:0.22879
58 ROUGE-L Eval D0736-C.M.100.H-G.58 R:0.31646 P:0.14205 F:0.19608
58 ROUGE-L Eval D0736-C.M.100.H-H.58 R:0.32086 P:0.11364 F:0.16784
58 ROUGE-L Eval D0736-C.M.100.H-I.58 R:0.29947 P:0.10606 F:0.15664
58 ROUGE-L Eval D0736-C.M.100.H-J.58 R:0.30943 P:0.15530 F:0.20681
58 ROUGE-L Eval D0740-A.M.100.I-D.58 R:0.27393 P:0.16768 F:0.20802
58 ROUGE-L Eval D0740-A.M.100.I-H.58 R:0.27451 P:0.16970 F:0.20974
58 ROUGE-L Eval D0740-A.M.100.I-I.58 R:0.26623 P:0.16566 F:0.20424
58 ROUGE-L Eval D0740-A.M.100.I-J.58 R:0.27097 P:0.16970 F:0.20870
58 ROUGE-L Eval D0740-B.M.100.I-D.58 R:0.29870 P:0.18699 F:0.23000
58 ROUGE-L Eval D0740-B.M.100.I-H.58 R:0.28808 P:0.17683 F:0.21914
58 ROUGE-L Eval D0740-B.M.100.I-I.58 R:0.31475 P:0.19512 F:0.24090
58 ROUGE-L Eval D0740-B.M.100.I-J.58 R:0.30421 P:0.19106 F:0.23471
58 ROUGE-L Eval D0740-C.M.100.I-D.58 R:0.32907 P:0.21063 F:0.25685
58 ROUGE-L Eval D0740-C.M.100.I-H.58 R:0.33441 P:0.21268 F:0.26000
58 ROUGE-L Eval D0740-C.M.100.I-I.58 R:0.34505 P:0.22086 F:0.26933
58 ROUGE-L Eval D0740-C.M.100.I-J.58 R:0.34395 P:0.22086 F:0.26899
58 ROUGE-L Eval D0743-A.M.100.J-B.58 R:0.29206 P:0.19785 F:0.23590
58 ROUGE-L Eval D0743-A.M.100.J-H.58 R:0.28086 P:0.19570 F:0.23067
58 ROUGE-L Eval D0743-A.M.100.J-I.58 R:0.26563 P:0.18280 F:0.21657
58 ROUGE-L Eval D0743-A.M.100.J-J.58 R:0.23692 P:0.16559 F:0.19493
58 ROUGE-L Eval D0743-B.M.100.J-B.58 R:0.26282 P:0.16566 F:0.20322
58 ROUGE-L Eval D0743-B.M.100.J-H.58 R:0.24921 P:0.15960 F:0.19458
58 ROUGE-L Eval D0743-B.M.100.J-I.58 R:0.21835 P:0.13939 F:0.17016
58 ROUGE-L Eval D0743-B.M.100.J-J.58 R:0.24611 P:0.15960 F:0.19363
58 ROUGE-L Eval D0743-C.M.100.J-B.58 R:0.24762 P:0.16149 F:0.19549
58 ROUGE-L Eval D0743-C.M.100.J-H.58 R:0.25796 P:0.16770 F:0.20326
58 ROUGE-L Eval D0743-C.M.100.J-I.58 R:0.28435 P:0.18427 F:0.22362
58 ROUGE-L Eval D0743-C.M.100.J-J.58 R:0.24843 P:0.16356 F:0.19725
---------------------------------------------
58 ROUGE-W-1.2 Average_R: 0.10941 (95%-conf.int. 0.10630 - 0.11283)
58 ROUGE-W-1.2 Average_P: 0.12316 (95%-conf.int. 0.11932 - 0.12697)
58 ROUGE-W-1.2 Average_F: 0.11557 (95%-conf.int. 0.11224 - 0.11895)
.............................................
58 ROUGE-W-1.2 Eval D0703-A.M.100.A-A.58 R:0.10858 P:0.13034 F:0.11847
58 ROUGE-W-1.2 Eval D0703-A.M.100.A-C.58 R:0.09712 P:0.11848 F:0.10674
58 ROUGE-W-1.2 Eval D0703-A.M.100.A-D.58 R:0.10674 P:0.12897 F:0.11681
58 ROUGE-W-1.2 Eval D0703-A.M.100.A-J.58 R:0.11740 P:0.13298 F:0.12471
58 ROUGE-W-1.2 Eval D0703-B.M.100.A-A.58 R:0.14838 P:0.17217 F:0.15939
58 ROUGE-W-1.2 Eval D0703-B.M.100.A-C.58 R:0.14260 P:0.16444 F:0.15274
58 ROUGE-W-1.2 Eval D0703-B.M.100.A-D.58 R:0.14055 P:0.16067 F:0.14994
58 ROUGE-W-1.2 Eval D0703-B.M.100.A-J.58 R:0.16274 P:0.18579 F:0.17350
58 ROUGE-W-1.2 Eval D0703-C.M.100.A-A.58 R:0.12062 P:0.13759 F:0.12855
58 ROUGE-W-1.2 Eval D0703-C.M.100.A-C.58 R:0.12551 P:0.14926 F:0.13636
58 ROUGE-W-1.2 Eval D0703-C.M.100.A-D.58 R:0.12398 P:0.14532 F:0.13380
58 ROUGE-W-1.2 Eval D0703-C.M.100.A-J.58 R:0.14337 P:0.15947 F:0.15099
58 ROUGE-W-1.2 Eval D0706-A.M.100.B-B.58 R:0.14639 P:0.16547 F:0.15535
58 ROUGE-W-1.2 Eval D0706-A.M.100.B-D.58 R:0.13525 P:0.15530 F:0.14458
58 ROUGE-W-1.2 Eval D0706-A.M.100.B-E.58 R:0.12981 P:0.14826 F:0.13842
58 ROUGE-W-1.2 Eval D0706-A.M.100.B-I.58 R:0.14005 P:0.16346 F:0.15085
58 ROUGE-W-1.2 Eval D0706-B.M.100.B-B.58 R:0.08781 P:0.09019 F:0.08898
58 ROUGE-W-1.2 Eval D0706-B.M.100.B-D.58 R:0.08159 P:0.08560 F:0.08355
58 ROUGE-W-1.2 Eval D0706-B.M.100.B-E.58 R:0.07595 P:0.08001 F:0.07793
58 ROUGE-W-1.2 Eval D0706-B.M.100.B-I.58 R:0.07801 P:0.08448 F:0.08112
58 ROUGE-W-1.2 Eval D0706-C.M.100.B-B.58 R:0.11601 P:0.12400 F:0.11987
58 ROUGE-W-1.2 Eval D0706-C.M.100.B-D.58 R:0.11368 P:0.12255 F:0.11795
58 ROUGE-W-1.2 Eval D0706-C.M.100.B-E.58 R:0.11403 P:0.12175 F:0.11776
58 ROUGE-W-1.2 Eval D0706-C.M.100.B-I.58 R:0.11438 P:0.12561 F:0.11973
58 ROUGE-W-1.2 Eval D0711-A.M.100.C-A.58 R:0.10071 P:0.12265 F:0.11060
58 ROUGE-W-1.2 Eval D0711-A.M.100.C-B.58 R:0.11190 P:0.13513 F:0.12242
58 ROUGE-W-1.2 Eval D0711-A.M.100.C-C.58 R:0.10977 P:0.13141 F:0.11962
58 ROUGE-W-1.2 Eval D0711-A.M.100.C-F.58 R:0.10820 P:0.13173 F:0.11881
58 ROUGE-W-1.2 Eval D0711-B.M.100.C-A.58 R:0.09767 P:0.11385 F:0.10514
58 ROUGE-W-1.2 Eval D0711-B.M.100.C-B.58 R:0.09527 P:0.11586 F:0.10456
58 ROUGE-W-1.2 Eval D0711-B.M.100.C-C.58 R:0.08640 P:0.10748 F:0.09579
58 ROUGE-W-1.2 Eval D0711-B.M.100.C-F.58 R:0.09843 P:0.11984 F:0.10808
58 ROUGE-W-1.2 Eval D0711-C.M.100.C-A.58 R:0.09019 P:0.11205 F:0.09994
58 ROUGE-W-1.2 Eval D0711-C.M.100.C-B.58 R:0.09063 P:0.10889 F:0.09892
58 ROUGE-W-1.2 Eval D0711-C.M.100.C-C.58 R:0.08470 P:0.10439 F:0.09352
58 ROUGE-W-1.2 Eval D0711-C.M.100.C-F.58 R:0.07956 P:0.09954 F:0.08844
58 ROUGE-W-1.2 Eval D0716-A.M.100.D-C.58 R:0.13717 P:0.15825 F:0.14696
58 ROUGE-W-1.2 Eval D0716-A.M.100.D-D.58 R:0.12252 P:0.14498 F:0.13281
58 ROUGE-W-1.2 Eval D0716-A.M.100.D-E.58 R:0.13969 P:0.16258 F:0.15027
58 ROUGE-W-1.2 Eval D0716-A.M.100.D-F.58 R:0.12658 P:0.15100 F:0.13772
58 ROUGE-W-1.2 Eval D0716-B.M.100.D-C.58 R:0.13290 P:0.13125 F:0.13207
58 ROUGE-W-1.2 Eval D0716-B.M.100.D-D.58 R:0.16274 P:0.16162 F:0.16218
58 ROUGE-W-1.2 Eval D0716-B.M.100.D-E.58 R:0.14896 P:0.14864 F:0.14880
58 ROUGE-W-1.2 Eval D0716-B.M.100.D-F.58 R:0.15105 P:0.14936 F:0.15020
58 ROUGE-W-1.2 Eval D0716-C.M.100.D-C.58 R:0.12479 P:0.14693 F:0.13496
58 ROUGE-W-1.2 Eval D0716-C.M.100.D-D.58 R:0.12025 P:0.14348 F:0.13084
58 ROUGE-W-1.2 Eval D0716-C.M.100.D-E.58 R:0.12577 P:0.15196 F:0.13763
58 ROUGE-W-1.2 Eval D0716-C.M.100.D-F.58 R:0.12055 P:0.14476 F:0.13155
58 ROUGE-W-1.2 Eval D0721-A.M.100.E-B.58 R:0.11730 P:0.13564 F:0.12581
58 ROUGE-W-1.2 Eval D0721-A.M.100.E-C.58 R:0.11085 P:0.13284 F:0.12085
58 ROUGE-W-1.2 Eval D0721-A.M.100.E-E.58 R:0.10118 P:0.12277 F:0.11093
58 ROUGE-W-1.2 Eval D0721-A.M.100.E-G.58 R:0.10804 P:0.13038 F:0.11816
58 ROUGE-W-1.2 Eval D0721-B.M.100.E-B.58 R:0.09432 P:0.12276 F:0.10668
58 ROUGE-W-1.2 Eval D0721-B.M.100.E-C.58 R:0.09596 P:0.12419 F:0.10827
58 ROUGE-W-1.2 Eval D0721-B.M.100.E-E.58 R:0.08856 P:0.11626 F:0.10054
58 ROUGE-W-1.2 Eval D0721-B.M.100.E-G.58 R:0.08404 P:0.11403 F:0.09676
58 ROUGE-W-1.2 Eval D0721-C.M.100.E-B.58 R:0.10745 P:0.13141 F:0.11823
58 ROUGE-W-1.2 Eval D0721-C.M.100.E-C.58 R:0.09621 P:0.11949 F:0.10659
58 ROUGE-W-1.2 Eval D0721-C.M.100.E-E.58 R:0.08710 P:0.10625 F:0.09573
58 ROUGE-W-1.2 Eval D0721-C.M.100.E-G.58 R:0.09514 P:0.11900 F:0.10574
58 ROUGE-W-1.2 Eval D0726-A.M.100.F-A.58 R:0.10111 P:0.11166 F:0.10612
58 ROUGE-W-1.2 Eval D0726-A.M.100.F-E.58 R:0.10222 P:0.11123 F:0.10653
58 ROUGE-W-1.2 Eval D0726-A.M.100.F-F.58 R:0.10446 P:0.11595 F:0.10991
58 ROUGE-W-1.2 Eval D0726-A.M.100.F-G.58 R:0.09641 P:0.10876 F:0.10221
58 ROUGE-W-1.2 Eval D0726-B.M.100.F-A.58 R:0.10610 P:0.12776 F:0.11593
58 ROUGE-W-1.2 Eval D0726-B.M.100.F-E.58 R:0.09849 P:0.11972 F:0.10807
58 ROUGE-W-1.2 Eval D0726-B.M.100.F-F.58 R:0.09579 P:0.11719 F:0.10541
58 ROUGE-W-1.2 Eval D0726-B.M.100.F-G.58 R:0.09896 P:0.12152 F:0.10909
58 ROUGE-W-1.2 Eval D0726-C.M.100.F-A.58 R:0.11238 P:0.12106 F:0.11656
58 ROUGE-W-1.2 Eval D0726-C.M.100.F-E.58 R:0.10759 P:0.11533 F:0.11133
58 ROUGE-W-1.2 Eval D0726-C.M.100.F-F.58 R:0.12096 P:0.13067 F:0.12563
58 ROUGE-W-1.2 Eval D0726-C.M.100.F-G.58 R:0.11278 P:0.12595 F:0.11900
58 ROUGE-W-1.2 Eval D0727-A.M.100.G-A.58 R:0.09783 P:0.11292 F:0.10483
58 ROUGE-W-1.2 Eval D0727-A.M.100.G-F.58 R:0.09066 P:0.10960 F:0.09923
58 ROUGE-W-1.2 Eval D0727-A.M.100.G-G.58 R:0.09757 P:0.11520 F:0.10565
58 ROUGE-W-1.2 Eval D0727-A.M.100.G-H.58 R:0.10158 P:0.12060 F:0.11028
58 ROUGE-W-1.2 Eval D0727-B.M.100.G-A.58 R:0.13018 P:0.13848 F:0.13420
58 ROUGE-W-1.2 Eval D0727-B.M.100.G-F.58 R:0.11531 P:0.13291 F:0.12349
58 ROUGE-W-1.2 Eval D0727-B.M.100.G-G.58 R:0.12093 P:0.13041 F:0.12549
58 ROUGE-W-1.2 Eval D0727-B.M.100.G-H.58 R:0.12750 P:0.13682 F:0.13200
58 ROUGE-W-1.2 Eval D0727-C.M.100.G-A.58 R:0.10623 P:0.11706 F:0.11138
58 ROUGE-W-1.2 Eval D0727-C.M.100.G-F.58 R:0.10879 P:0.11920 F:0.11376
58 ROUGE-W-1.2 Eval D0727-C.M.100.G-G.58 R:0.10739 P:0.11956 F:0.11315
58 ROUGE-W-1.2 Eval D0727-C.M.100.G-H.58 R:0.11052 P:0.11752 F:0.11391
58 ROUGE-W-1.2 Eval D0736-A.M.100.H-G.58 R:0.10019 P:0.09483 F:0.09744
58 ROUGE-W-1.2 Eval D0736-A.M.100.H-H.58 R:0.10511 P:0.09702 F:0.10090
58 ROUGE-W-1.2 Eval D0736-A.M.100.H-I.58 R:0.09931 P:0.09552 F:0.09738
58 ROUGE-W-1.2 Eval D0736-A.M.100.H-J.58 R:0.09321 P:0.09741 F:0.09526
58 ROUGE-W-1.2 Eval D0736-B.M.100.H-G.58 R:0.12064 P:0.11891 F:0.11977
58 ROUGE-W-1.2 Eval D0736-B.M.100.H-H.58 R:0.12181 P:0.11084 F:0.11607
58 ROUGE-W-1.2 Eval D0736-B.M.100.H-I.58 R:0.10326 P:0.09265 F:0.09767
58 ROUGE-W-1.2 Eval D0736-B.M.100.H-J.58 R:0.11267 P:0.12108 F:0.11672
58 ROUGE-W-1.2 Eval D0736-C.M.100.H-G.58 R:0.11940 P:0.09736 F:0.10726
58 ROUGE-W-1.2 Eval D0736-C.M.100.H-H.58 R:0.12552 P:0.08309 F:0.09999
58 ROUGE-W-1.2 Eval D0736-C.M.100.H-I.58 R:0.10905 P:0.07046 F:0.08561
58 ROUGE-W-1.2 Eval D0736-C.M.100.H-J.58 R:0.11573 P:0.10363 F:0.10935
58 ROUGE-W-1.2 Eval D0740-A.M.100.I-D.58 R:0.09518 P:0.10716 F:0.10082
58 ROUGE-W-1.2 Eval D0740-A.M.100.I-H.58 R:0.09892 P:0.11032 F:0.10431
58 ROUGE-W-1.2 Eval D0740-A.M.100.I-I.58 R:0.09045 P:0.10410 F:0.09680
58 ROUGE-W-1.2 Eval D0740-A.M.100.I-J.58 R:0.09303 P:0.10703 F:0.09954
58 ROUGE-W-1.2 Eval D0740-B.M.100.I-D.58 R:0.10301 P:0.11848 F:0.11020
58 ROUGE-W-1.2 Eval D0740-B.M.100.I-H.58 R:0.10222 P:0.11166 F:0.10673
58 ROUGE-W-1.2 Eval D0740-B.M.100.I-I.58 R:0.10678 P:0.12438 F:0.11491
58 ROUGE-W-1.2 Eval D0740-B.M.100.I-J.58 R:0.10895 P:0.12233 F:0.11525
58 ROUGE-W-1.2 Eval D0740-C.M.100.I-D.58 R:0.11515 P:0.14224 F:0.12727
58 ROUGE-W-1.2 Eval D0740-C.M.100.I-H.58 R:0.11468 P:0.13611 F:0.12448
58 ROUGE-W-1.2 Eval D0740-C.M.100.I-I.58 R:0.11571 P:0.14484 F:0.12865
58 ROUGE-W-1.2 Eval D0740-C.M.100.I-J.58 R:0.12010 P:0.14777 F:0.13251
58 ROUGE-W-1.2 Eval D0743-A.M.100.J-B.58 R:0.10165 P:0.12004 F:0.11008
58 ROUGE-W-1.2 Eval D0743-A.M.100.J-H.58 R:0.09852 P:0.11858 F:0.10762
58 ROUGE-W-1.2 Eval D0743-A.M.100.J-I.58 R:0.09240 P:0.11283 F:0.10160
58 ROUGE-W-1.2 Eval D0743-A.M.100.J-J.58 R:0.08342 P:0.10121 F:0.09146
58 ROUGE-W-1.2 Eval D0743-B.M.100.J-B.58 R:0.09712 P:0.10251 F:0.09974
58 ROUGE-W-1.2 Eval D0743-B.M.100.J-H.58 R:0.09532 P:0.10123 F:0.09819
58 ROUGE-W-1.2 Eval D0743-B.M.100.J-I.58 R:0.08328 P:0.08959 F:0.08632
58 ROUGE-W-1.2 Eval D0743-B.M.100.J-J.58 R:0.09534 P:0.10165 F:0.09839
58 ROUGE-W-1.2 Eval D0743-C.M.100.J-B.58 R:0.08893 P:0.10152 F:0.09481
58 ROUGE-W-1.2 Eval D0743-C.M.100.J-H.58 R:0.09571 P:0.10391 F:0.09964
58 ROUGE-W-1.2 Eval D0743-C.M.100.J-I.58 R:0.09800 P:0.11317 F:0.10504
58 ROUGE-W-1.2 Eval D0743-C.M.100.J-J.58 R:0.09011 P:0.09986 F:0.09473
---------------------------------------------
58 ROUGE-SU4 Average_R: 0.12380 (95%-conf.int. 0.11752 - 0.13040)
58 ROUGE-SU4 Average_P: 0.07597 (95%-conf.int. 0.07202 - 0.07986)
58 ROUGE-SU4 Average_F: 0.09396 (95%-conf.int. 0.08914 - 0.09899)
.............................................
58 ROUGE-SU4 Eval D0703-A.M.100.A-A.58 R:0.13310 P:0.08792 F:0.10589
58 ROUGE-SU4 Eval D0703-A.M.100.A-C.58 R:0.12126 P:0.08066 F:0.09688
58 ROUGE-SU4 Eval D0703-A.M.100.A-D.58 R:0.13015 P:0.08448 F:0.10246
58 ROUGE-SU4 Eval D0703-A.M.100.A-J.58 R:0.13869 P:0.09098 F:0.10988
58 ROUGE-SU4 Eval D0703-B.M.100.A-A.58 R:0.21532 P:0.13340 F:0.16474
58 ROUGE-SU4 Eval D0703-B.M.100.A-C.58 R:0.19253 P:0.11608 F:0.14484
58 ROUGE-SU4 Eval D0703-B.M.100.A-D.58 R:0.19655 P:0.11850 F:0.14786
58 ROUGE-SU4 Eval D0703-B.M.100.A-J.58 R:0.23549 P:0.14345 F:0.17829
58 ROUGE-SU4 Eval D0703-C.M.100.A-A.58 R:0.16495 P:0.10014 F:0.12462
58 ROUGE-SU4 Eval D0703-C.M.100.A-C.58 R:0.18222 P:0.11365 F:0.13999
58 ROUGE-SU4 Eval D0703-C.M.100.A-D.58 R:0.17177 P:0.10499 F:0.13032
58 ROUGE-SU4 Eval D0703-C.M.100.A-J.58 R:0.19615 P:0.11989 F:0.14882
58 ROUGE-SU4 Eval D0706-A.M.100.B-B.58 R:0.18333 P:0.11435 F:0.14085
58 ROUGE-SU4 Eval D0706-A.M.100.B-D.58 R:0.17506 P:0.10845 F:0.13393
58 ROUGE-SU4 Eval D0706-A.M.100.B-E.58 R:0.15000 P:0.09356 F:0.11524
58 ROUGE-SU4 Eval D0706-A.M.100.B-I.58 R:0.17778 P:0.11088 F:0.13658
58 ROUGE-SU4 Eval D0706-B.M.100.B-B.58 R:0.06823 P:0.04003 F:0.05046
58 ROUGE-SU4 Eval D0706-B.M.100.B-D.58 R:0.06355 P:0.03740 F:0.04709
58 ROUGE-SU4 Eval D0706-B.M.100.B-E.58 R:0.05833 P:0.03445 F:0.04332
58 ROUGE-SU4 Eval D0706-B.M.100.B-I.58 R:0.06368 P:0.03773 F:0.04738
58 ROUGE-SU4 Eval D0706-C.M.100.B-B.58 R:0.12693 P:0.07871 F:0.09717
58 ROUGE-SU4 Eval D0706-C.M.100.B-D.58 R:0.13742 P:0.08522 F:0.10520
58 ROUGE-SU4 Eval D0706-C.M.100.B-E.58 R:0.13706 P:0.08556 F:0.10535
58 ROUGE-SU4 Eval D0706-C.M.100.B-I.58 R:0.13934 P:0.08727 F:0.10732
58 ROUGE-SU4 Eval D0711-A.M.100.C-A.58 R:0.11374 P:0.07617 F:0.09124
58 ROUGE-SU4 Eval D0711-A.M.100.C-B.58 R:0.13014 P:0.08597 F:0.10354
58 ROUGE-SU4 Eval D0711-A.M.100.C-C.58 R:0.13470 P:0.08899 F:0.10717
58 ROUGE-SU4 Eval D0711-A.M.100.C-F.58 R:0.13776 P:0.09163 F:0.11006
58 ROUGE-SU4 Eval D0711-B.M.100.C-A.58 R:0.09207 P:0.05958 F:0.07234
58 ROUGE-SU4 Eval D0711-B.M.100.C-B.58 R:0.10915 P:0.07014 F:0.08540
58 ROUGE-SU4 Eval D0711-B.M.100.C-C.58 R:0.10115 P:0.06637 F:0.08015
58 ROUGE-SU4 Eval D0711-B.M.100.C-F.58 R:0.10569 P:0.06863 F:0.08322
58 ROUGE-SU4 Eval D0711-C.M.100.C-A.58 R:0.09492 P:0.06250 F:0.07537
58 ROUGE-SU4 Eval D0711-C.M.100.C-B.58 R:0.10000 P:0.06362 F:0.07777
58 ROUGE-SU4 Eval D0711-C.M.100.C-C.58 R:0.09549 P:0.06138 F:0.07473
58 ROUGE-SU4 Eval D0711-C.M.100.C-F.58 R:0.08681 P:0.05580 F:0.06793
58 ROUGE-SU4 Eval D0716-A.M.100.D-C.58 R:0.15488 P:0.09684 F:0.11917
58 ROUGE-SU4 Eval D0716-A.M.100.D-D.58 R:0.14726 P:0.09053 F:0.11213
58 ROUGE-SU4 Eval D0716-A.M.100.D-E.58 R:0.16837 P:0.10386 F:0.12847
58 ROUGE-SU4 Eval D0716-A.M.100.D-F.58 R:0.15311 P:0.09509 F:0.11732
58 ROUGE-SU4 Eval D0716-B.M.100.D-C.58 R:0.15653 P:0.08759 F:0.11233
58 ROUGE-SU4 Eval D0716-B.M.100.D-D.58 R:0.22701 P:0.12445 F:0.16077
58 ROUGE-SU4 Eval D0716-B.M.100.D-E.58 R:0.19909 P:0.11027 F:0.14193
58 ROUGE-SU4 Eval D0716-B.M.100.D-F.58 R:0.20548 P:0.11342 F:0.14616
58 ROUGE-SU4 Eval D0716-C.M.100.D-C.58 R:0.15385 P:0.09623 F:0.11840
58 ROUGE-SU4 Eval D0716-C.M.100.D-D.58 R:0.15636 P:0.09519 F:0.11834
58 ROUGE-SU4 Eval D0716-C.M.100.D-E.58 R:0.16045 P:0.09902 F:0.12246
58 ROUGE-SU4 Eval D0716-C.M.100.D-F.58 R:0.15126 P:0.09240 F:0.11472
58 ROUGE-SU4 Eval D0721-A.M.100.E-B.58 R:0.11758 P:0.07664 F:0.09280
58 ROUGE-SU4 Eval D0721-A.M.100.E-C.58 R:0.11222 P:0.07515 F:0.09002
58 ROUGE-SU4 Eval D0721-A.M.100.E-E.58 R:0.09722 P:0.06510 F:0.07798
58 ROUGE-SU4 Eval D0721-A.M.100.E-G.58 R:0.10730 P:0.07329 F:0.08709
58 ROUGE-SU4 Eval D0721-B.M.100.E-B.58 R:0.11706 P:0.07813 F:0.09371
58 ROUGE-SU4 Eval D0721-B.M.100.E-C.58 R:0.11220 P:0.07664 F:0.09107
58 ROUGE-SU4 Eval D0721-B.M.100.E-E.58 R:0.10382 P:0.06882 F:0.08277
58 ROUGE-SU4 Eval D0721-B.M.100.E-G.58 R:0.10044 P:0.06771 F:0.08089
58 ROUGE-SU4 Eval D0721-C.M.100.E-B.58 R:0.12514 P:0.08241 F:0.09938
58 ROUGE-SU4 Eval D0721-C.M.100.E-C.58 R:0.11299 P:0.07391 F:0.08936
58 ROUGE-SU4 Eval D0721-C.M.100.E-E.58 R:0.08961 P:0.05802 F:0.07044
58 ROUGE-SU4 Eval D0721-C.M.100.E-G.58 R:0.11148 P:0.07391 F:0.08889
58 ROUGE-SU4 Eval D0726-A.M.100.F-A.58 R:0.09443 P:0.05825 F:0.07205
58 ROUGE-SU4 Eval D0726-A.M.100.F-E.58 R:0.09475 P:0.05825 F:0.07215
58 ROUGE-SU4 Eval D0726-A.M.100.F-F.58 R:0.10296 P:0.06351 F:0.07856
58 ROUGE-SU4 Eval D0726-A.M.100.F-G.58 R:0.09215 P:0.05684 F:0.07031
58 ROUGE-SU4 Eval D0726-B.M.100.F-A.58 R:0.10682 P:0.07251 F:0.08638
58 ROUGE-SU4 Eval D0726-B.M.100.F-E.58 R:0.10125 P:0.06758 F:0.08106
58 ROUGE-SU4 Eval D0726-B.M.100.F-F.58 R:0.09613 P:0.06416 F:0.07696
58 ROUGE-SU4 Eval D0726-B.M.100.F-G.58 R:0.10417 P:0.07024 F:0.08390
58 ROUGE-SU4 Eval D0726-C.M.100.F-A.58 R:0.13128 P:0.07970 F:0.09918
58 ROUGE-SU4 Eval D0726-C.M.100.F-E.58 R:0.12457 P:0.07484 F:0.09350
58 ROUGE-SU4 Eval D0726-C.M.100.F-F.58 R:0.13705 P:0.08177 F:0.10243
58 ROUGE-SU4 Eval D0726-C.M.100.F-G.58 R:0.12738 P:0.07866 F:0.09726
58 ROUGE-SU4 Eval D0727-A.M.100.G-A.58 R:0.08532 P:0.05543 F:0.06720
58 ROUGE-SU4 Eval D0727-A.M.100.G-F.58 R:0.09122 P:0.05987 F:0.07229
58 ROUGE-SU4 Eval D0727-A.M.100.G-G.58 R:0.09172 P:0.06061 F:0.07299
58 ROUGE-SU4 Eval D0727-A.M.100.G-H.58 R:0.09516 P:0.06245 F:0.07541
58 ROUGE-SU4 Eval D0727-B.M.100.G-A.58 R:0.13663 P:0.08192 F:0.10243
58 ROUGE-SU4 Eval D0727-B.M.100.G-F.58 R:0.11500 P:0.07309 F:0.08938
58 ROUGE-SU4 Eval D0727-B.M.100.G-G.58 R:0.13286 P:0.07910 F:0.09916
58 ROUGE-SU4 Eval D0727-B.M.100.G-H.58 R:0.13604 P:0.08157 F:0.10199
58 ROUGE-SU4 Eval D0727-C.M.100.G-A.58 R:0.11873 P:0.07201 F:0.08965
58 ROUGE-SU4 Eval D0727-C.M.100.G-F.58 R:0.12918 P:0.07573 F:0.09548
58 ROUGE-SU4 Eval D0727-C.M.100.G-G.58 R:0.12938 P:0.07742 F:0.09687
58 ROUGE-SU4 Eval D0727-C.M.100.G-H.58 R:0.12326 P:0.07201 F:0.09091
58 ROUGE-SU4 Eval D0736-A.M.100.H-G.58 R:0.08303 P:0.04377 F:0.05732
58 ROUGE-SU4 Eval D0736-A.M.100.H-H.58 R:0.09148 P:0.04734 F:0.06239
58 ROUGE-SU4 Eval D0736-A.M.100.H-I.58 R:0.08242 P:0.04377 F:0.05718
58 ROUGE-SU4 Eval D0736-A.M.100.H-J.58 R:0.08110 P:0.04702 F:0.05953
58 ROUGE-SU4 Eval D0736-B.M.100.H-G.58 R:0.14829 P:0.07782 F:0.10207
58 ROUGE-SU4 Eval D0736-B.M.100.H-H.58 R:0.14957 P:0.07231 F:0.09749
58 ROUGE-SU4 Eval D0736-B.M.100.H-I.58 R:0.10967 P:0.05234 F:0.07086
58 ROUGE-SU4 Eval D0736-B.M.100.H-J.58 R:0.14029 P:0.08058 F:0.10236
58 ROUGE-SU4 Eval D0736-C.M.100.H-G.58 R:0.13537 P:0.05962 F:0.08278
58 ROUGE-SU4 Eval D0736-C.M.100.H-H.58 R:0.14525 P:0.05000 F:0.07439
58 ROUGE-SU4 Eval D0736-C.M.100.H-I.58 R:0.09777 P:0.03365 F:0.05007
58 ROUGE-SU4 Eval D0736-C.M.100.H-J.58 R:0.12257 P:0.06058 F:0.08108
58 ROUGE-SU4 Eval D0740-A.M.100.I-D.58 R:0.10395 P:0.06297 F:0.07843
58 ROUGE-SU4 Eval D0740-A.M.100.I-H.58 R:0.09899 P:0.06057 F:0.07515
58 ROUGE-SU4 Eval D0740-A.M.100.I-I.58 R:0.09667 P:0.05955 F:0.07370
58 ROUGE-SU4 Eval D0740-A.M.100.I-J.58 R:0.09713 P:0.06023 F:0.07435
58 ROUGE-SU4 Eval D0740-B.M.100.I-D.58 R:0.11167 P:0.06921 F:0.08546
58 ROUGE-SU4 Eval D0740-B.M.100.I-H.58 R:0.10091 P:0.06129 F:0.07626
58 ROUGE-SU4 Eval D0740-B.M.100.I-I.58 R:0.12851 P:0.07886 F:0.09774
58 ROUGE-SU4 Eval D0740-B.M.100.I-J.58 R:0.11019 P:0.06853 F:0.08450
58 ROUGE-SU4 Eval D0740-C.M.100.I-D.58 R:0.15191 P:0.09633 F:0.11790
58 ROUGE-SU4 Eval D0740-C.M.100.I-H.58 R:0.14411 P:0.09078 F:0.11139
58 ROUGE-SU4 Eval D0740-C.M.100.I-I.58 R:0.15683 P:0.09945 F:0.12172
58 ROUGE-SU4 Eval D0740-C.M.100.I-J.58 R:0.15741 P:0.10014 F:0.12241
58 ROUGE-SU4 Eval D0743-A.M.100.J-B.58 R:0.10586 P:0.07112 F:0.08508
58 ROUGE-SU4 Eval D0743-A.M.100.J-H.58 R:0.09705 P:0.06710 F:0.07934
58 ROUGE-SU4 Eval D0743-A.M.100.J-I.58 R:0.09081 P:0.06200 F:0.07369
58 ROUGE-SU4 Eval D0743-A.M.100.J-J.58 R:0.07729 P:0.05361 F:0.06331
58 ROUGE-SU4 Eval D0743-B.M.100.J-B.58 R:0.08224 P:0.05133 F:0.06321
58 ROUGE-SU4 Eval D0743-B.M.100.J-H.58 R:0.07497 P:0.04757 F:0.05821
58 ROUGE-SU4 Eval D0743-B.M.100.J-I.58 R:0.06656 P:0.04209 F:0.05157
58 ROUGE-SU4 Eval D0743-B.M.100.J-J.58 R:0.08094 P:0.05202 F:0.06333
58 ROUGE-SU4 Eval D0743-C.M.100.J-B.58 R:0.09066 P:0.05860 F:0.07119
58 ROUGE-SU4 Eval D0743-C.M.100.J-H.58 R:0.08660 P:0.05579 F:0.06786
58 ROUGE-SU4 Eval D0743-C.M.100.J-I.58 R:0.10765 P:0.06912 F:0.08419
58 ROUGE-SU4 Eval D0743-C.M.100.J-J.58 R:0.08978 P:0.05860 F:0.07091
---------------------------------------------
59BASIC ROUGE-1 Average_R: 0.32516 (95%-conf.int. 0.31561 - 0.33526)
59BASIC ROUGE-1 Average_P: 0.18762 (95%-conf.int. 0.18001 - 0.19547)
59BASIC ROUGE-1 Average_F: 0.23671 (95%-conf.int. 0.22841 - 0.24572)
.............................................
59BASIC ROUGE-1 Eval D0703-A.M.100.A-A.59BASIC R:0.30068 P:0.18427 F:0.22850
59BASIC ROUGE-1 Eval D0703-A.M.100.A-C.59BASIC R:0.25503 P:0.15735 F:0.19462
59BASIC ROUGE-1 Eval D0703-A.M.100.A-D.59BASIC R:0.27835 P:0.16770 F:0.20930
59BASIC ROUGE-1 Eval D0703-A.M.100.A-J.59BASIC R:0.29592 P:0.18012 F:0.22394
59BASIC ROUGE-1 Eval D0703-B.M.100.A-A.59BASIC R:0.34967 P:0.22016 F:0.27020
59BASIC ROUGE-1 Eval D0703-B.M.100.A-C.59BASIC R:0.34228 P:0.20988 F:0.26021
59BASIC ROUGE-1 Eval D0703-B.M.100.A-D.59BASIC R:0.34228 P:0.20988 F:0.26021
59BASIC ROUGE-1 Eval D0703-B.M.100.A-J.59BASIC R:0.34219 P:0.21193 F:0.26175
59BASIC ROUGE-1 Eval D0703-C.M.100.A-A.59BASIC R:0.28333 P:0.16284 F:0.20682
59BASIC ROUGE-1 Eval D0703-C.M.100.A-C.59BASIC R:0.26623 P:0.15709 F:0.19759
59BASIC ROUGE-1 Eval D0703-C.M.100.A-D.59BASIC R:0.25166 P:0.14559 F:0.18446
59BASIC ROUGE-1 Eval D0703-C.M.100.A-J.59BASIC R:0.29801 P:0.17241 F:0.21844
59BASIC ROUGE-1 Eval D0706-A.M.100.B-B.59BASIC R:0.28896 P:0.17349 F:0.21681
59BASIC ROUGE-1 Eval D0706-A.M.100.B-D.59BASIC R:0.29739 P:0.17739 F:0.22223
59BASIC ROUGE-1 Eval D0706-A.M.100.B-E.59BASIC R:0.27597 P:0.16569 F:0.20706
59BASIC ROUGE-1 Eval D0706-A.M.100.B-I.59BASIC R:0.28896 P:0.17349 F:0.21681
59BASIC ROUGE-1 Eval D0706-B.M.100.B-B.59BASIC R:0.35294 P:0.22222 F:0.27273
59BASIC ROUGE-1 Eval D0706-B.M.100.B-D.59BASIC R:0.36156 P:0.22840 F:0.27995
59BASIC ROUGE-1 Eval D0706-B.M.100.B-E.59BASIC R:0.31494 P:0.19959 F:0.24434
59BASIC ROUGE-1 Eval D0706-B.M.100.B-I.59BASIC R:0.38511 P:0.24486 F:0.29937
59BASIC ROUGE-1 Eval D0706-C.M.100.B-B.59BASIC R:0.26452 P:0.18345 F:0.21665
59BASIC ROUGE-1 Eval D0706-C.M.100.B-D.59BASIC R:0.30968 P:0.21477 F:0.25364
59BASIC ROUGE-1 Eval D0706-C.M.100.B-E.59BASIC R:0.28526 P:0.19911 F:0.23452
59BASIC ROUGE-1 Eval D0706-C.M.100.B-I.59BASIC R:0.29712 P:0.20805 F:0.24473
59BASIC ROUGE-1 Eval D0711-A.M.100.C-A.59BASIC R:0.33553 P:0.19429 F:0.24608
59BASIC ROUGE-1 Eval D0711-A.M.100.C-B.59BASIC R:0.36000 P:0.20571 F:0.26181
59BASIC ROUGE-1 Eval D0711-A.M.100.C-C.59BASIC R:0.31333 P:0.17905 F:0.22788
59BASIC ROUGE-1 Eval D0711-A.M.100.C-F.59BASIC R:0.35430 P:0.20381 F:0.25877
59BASIC ROUGE-1 Eval D0711-B.M.100.C-A.59BASIC R:0.33673 P:0.14798 F:0.20560
59BASIC ROUGE-1 Eval D0711-B.M.100.C-B.59BASIC R:0.34932 P:0.15247 F:0.21228
59BASIC ROUGE-1 Eval D0711-B.M.100.C-C.59BASIC R:0.31208 P:0.13901 F:0.19234
59BASIC ROUGE-1 Eval D0711-B.M.100.C-F.59BASIC R:0.30508 P:0.13453 F:0.18672
59BASIC ROUGE-1 Eval D0711-C.M.100.C-A.59BASIC R:0.35974 P:0.21373 F:0.26815
59BASIC ROUGE-1 Eval D0711-C.M.100.C-B.59BASIC R:0.37543 P:0.21569 F:0.27398
59BASIC ROUGE-1 Eval D0711-C.M.100.C-C.59BASIC R:0.37500 P:0.21765 F:0.27544
59BASIC ROUGE-1 Eval D0711-C.M.100.C-F.59BASIC R:0.35473 P:0.20588 F:0.26054
59BASIC ROUGE-1 Eval D0716-A.M.100.D-C.59BASIC R:0.35082 P:0.23778 F:0.28345
59BASIC ROUGE-1 Eval D0716-A.M.100.D-D.59BASIC R:0.36333 P:0.24222 F:0.29066
59BASIC ROUGE-1 Eval D0716-A.M.100.D-E.59BASIC R:0.37874 P:0.25333 F:0.30359
59BASIC ROUGE-1 Eval D0716-A.M.100.D-F.59BASIC R:0.34653 P:0.23333 F:0.27888
59BASIC ROUGE-1 Eval D0716-B.M.100.D-C.59BASIC R:0.39145 P:0.24486 F:0.30127
59BASIC ROUGE-1 Eval D0716-B.M.100.D-D.59BASIC R:0.38926 P:0.23868 F:0.29592
59BASIC ROUGE-1 Eval D0716-B.M.100.D-E.59BASIC R:0.35216 P:0.21811 F:0.26938
59BASIC ROUGE-1 Eval D0716-B.M.100.D-F.59BASIC R:0.37333 P:0.23045 F:0.28498
59BASIC ROUGE-1 Eval D0716-C.M.100.D-C.59BASIC R:0.43322 P:0.27536 F:0.33671
59BASIC ROUGE-1 Eval D0716-C.M.100.D-D.59BASIC R:0.46823 P:0.28986 F:0.35806
59BASIC ROUGE-1 Eval D0716-C.M.100.D-E.59BASIC R:0.45545 P:0.28571 F:0.35114
59BASIC ROUGE-1 Eval D0716-C.M.100.D-F.59BASIC R:0.47000 P:0.29193 F:0.36016
59BASIC ROUGE-1 Eval D0721-A.M.100.E-B.59BASIC R:0.30667 P:0.17934 F:0.22633
59BASIC ROUGE-1 Eval D0721-A.M.100.E-C.59BASIC R:0.28247 P:0.16959 F:0.21194
59BASIC ROUGE-1 Eval D0721-A.M.100.E-E.59BASIC R:0.27597 P:0.16569 F:0.20706
59BASIC ROUGE-1 Eval D0721-A.M.100.E-G.59BASIC R:0.26752 P:0.16374 F:0.20314
59BASIC ROUGE-1 Eval D0721-B.M.100.E-B.59BASIC R:0.34853 P:0.22153 F:0.27088
59BASIC ROUGE-1 Eval D0721-B.M.100.E-C.59BASIC R:0.30892 P:0.20083 F:0.24342
59BASIC ROUGE-1 Eval D0721-B.M.100.E-E.59BASIC R:0.34426 P:0.21739 F:0.26650
59BASIC ROUGE-1 Eval D0721-B.M.100.E-G.59BASIC R:0.30000 P:0.19255 F:0.23455
59BASIC ROUGE-1 Eval D0721-C.M.100.E-B.59BASIC R:0.43279 P:0.23529 F:0.30485
59BASIC ROUGE-1 Eval D0721-C.M.100.E-C.59BASIC R:0.35974 P:0.19430 F:0.25232
59BASIC ROUGE-1 Eval D0721-C.M.100.E-E.59BASIC R:0.40333 P:0.21569 F:0.28107
59BASIC ROUGE-1 Eval D0721-C.M.100.E-G.59BASIC R:0.41368 P:0.22638 F:0.29263
59BASIC ROUGE-1 Eval D0726-A.M.100.F-A.59BASIC R:0.29900 P:0.18750 F:0.23047
59BASIC ROUGE-1 Eval D0726-A.M.100.F-E.59BASIC R:0.28667 P:0.17917 F:0.22052
59BASIC ROUGE-1 Eval D0726-A.M.100.F-F.59BASIC R:0.29568 P:0.18542 F:0.22792
59BASIC ROUGE-1 Eval D0726-A.M.100.F-G.59BASIC R:0.26578 P:0.16667 F:0.20487
59BASIC ROUGE-1 Eval D0726-B.M.100.F-A.59BASIC R:0.31699 P:0.18908 F:0.23687
59BASIC ROUGE-1 Eval D0726-B.M.100.F-E.59BASIC R:0.31561 P:0.18519 F:0.23342
59BASIC ROUGE-1 Eval D0726-B.M.100.F-F.59BASIC R:0.30233 P:0.17739 F:0.22359
59BASIC ROUGE-1 Eval D0726-B.M.100.F-G.59BASIC R:0.32237 P:0.19103 F:0.23990
59BASIC ROUGE-1 Eval D0726-C.M.100.F-A.59BASIC R:0.29000 P:0.18954 F:0.22925
59BASIC ROUGE-1 Eval D0726-C.M.100.F-E.59BASIC R:0.29630 P:0.19172 F:0.23280
59BASIC ROUGE-1 Eval D0726-C.M.100.F-F.59BASIC R:0.27797 P:0.17865 F:0.21751
59BASIC ROUGE-1 Eval D0726-C.M.100.F-G.59BASIC R:0.25902 P:0.17211 F:0.20681
59BASIC ROUGE-1 Eval D0727-A.M.100.G-A.59BASIC R:0.48173 P:0.27778 F:0.35237
59BASIC ROUGE-1 Eval D0727-A.M.100.G-F.59BASIC R:0.46711 P:0.27203 F:0.34383
59BASIC ROUGE-1 Eval D0727-A.M.100.G-G.59BASIC R:0.43464 P:0.25479 F:0.32126
59BASIC ROUGE-1 Eval D0727-A.M.100.G-H.59BASIC R:0.49342 P:0.28736 F:0.36320
59BASIC ROUGE-1 Eval D0727-B.M.100.G-A.59BASIC R:0.32302 P:0.17216 F:0.22461
59BASIC ROUGE-1 Eval D0727-B.M.100.G-F.59BASIC R:0.33442 P:0.18864 F:0.24122
59BASIC ROUGE-1 Eval D0727-B.M.100.G-G.59BASIC R:0.30104 P:0.15934 F:0.20838
59BASIC ROUGE-1 Eval D0727-B.M.100.G-H.59BASIC R:0.31271 P:0.16667 F:0.21744
59BASIC ROUGE-1 Eval D0727-C.M.100.G-A.59BASIC R:0.28339 P:0.14646 F:0.19312
59BASIC ROUGE-1 Eval D0727-C.M.100.G-F.59BASIC R:0.31650 P:0.15825 F:0.21100
59BASIC ROUGE-1 Eval D0727-C.M.100.G-G.59BASIC R:0.30363 P:0.15488 F:0.20513
59BASIC ROUGE-1 Eval D0727-C.M.100.G-H.59BASIC R:0.31419 P:0.15657 F:0.20899
59BASIC ROUGE-1 Eval D0736-A.M.100.H-G.59BASIC R:0.34050 P:0.17495 F:0.23114
59BASIC ROUGE-1 Eval D0736-A.M.100.H-H.59BASIC R:0.33577 P:0.16943 F:0.22522
59BASIC ROUGE-1 Eval D0736-A.M.100.H-I.59BASIC R:0.35587 P:0.18416 F:0.24272
59BASIC ROUGE-1 Eval D0736-A.M.100.H-J.59BASIC R:0.34641 P:0.19521 F:0.24971
59BASIC ROUGE-1 Eval D0736-B.M.100.H-G.59BASIC R:0.23664 P:0.12086 F:0.16000
59BASIC ROUGE-1 Eval D0736-B.M.100.H-H.59BASIC R:0.21074 P:0.09942 F:0.13510
59BASIC ROUGE-1 Eval D0736-B.M.100.H-I.59BASIC R:0.25105 P:0.11696 F:0.15958
59BASIC ROUGE-1 Eval D0736-B.M.100.H-J.59BASIC R:0.23427 P:0.13060 F:0.16771
59BASIC ROUGE-1 Eval D0736-C.M.100.H-G.59BASIC R:0.27848 P:0.10526 F:0.15277
59BASIC ROUGE-1 Eval D0736-C.M.100.H-H.59BASIC R:0.25134 P:0.07496 F:0.11548
59BASIC ROUGE-1 Eval D0736-C.M.100.H-I.59BASIC R:0.29412 P:0.08772 F:0.13514
59BASIC ROUGE-1 Eval D0736-C.M.100.H-J.59BASIC R:0.27170 P:0.11483 F:0.16143
59BASIC ROUGE-1 Eval D0740-A.M.100.I-D.59BASIC R:0.35644 P:0.22360 F:0.27481
59BASIC ROUGE-1 Eval D0740-A.M.100.I-H.59BASIC R:0.32026 P:0.20290 F:0.24842
59BASIC ROUGE-1 Eval D0740-A.M.100.I-I.59BASIC R:0.33766 P:0.21532 F:0.26296
59BASIC ROUGE-1 Eval D0740-A.M.100.I-J.59BASIC R:0.33548 P:0.21532 F:0.26229
59BASIC ROUGE-1 Eval D0740-B.M.100.I-D.59BASIC R:0.33766 P:0.20273 F:0.25335
59BASIC ROUGE-1 Eval D0740-B.M.100.I-H.59BASIC R:0.34768 P:0.20468 F:0.25767
59BASIC ROUGE-1 Eval D0740-B.M.100.I-I.59BASIC R:0.36066 P:0.21442 F:0.26895
59BASIC ROUGE-1 Eval D0740-B.M.100.I-J.59BASIC R:0.32686 P:0.19688 F:0.24574
59BASIC ROUGE-1 Eval D0740-C.M.100.I-D.59BASIC R:0.21725 P:0.13178 F:0.16405
59BASIC ROUGE-1 Eval D0740-C.M.100.I-H.59BASIC R:0.19293 P:0.11628 F:0.14510
59BASIC ROUGE-1 Eval D0740-C.M.100.I-I.59BASIC R:0.20447 P:0.12403 F:0.15440
59BASIC ROUGE-1 Eval D0740-C.M.100.I-J.59BASIC R:0.20064 P:0.12209 F:0.15181
59BASIC ROUGE-1 Eval D0743-A.M.100.J-B.59BASIC R:0.26032 P:0.07946 F:0.12176
59BASIC ROUGE-1 Eval D0743-A.M.100.J-H.59BASIC R:0.34568 P:0.10853 F:0.16520
59BASIC ROUGE-1 Eval D0743-A.M.100.J-I.59BASIC R:0.34687 P:0.10756 F:0.16420
59BASIC ROUGE-1 Eval D0743-A.M.100.J-J.59BASIC R:0.32615 P:0.10271 F:0.15622
59BASIC ROUGE-1 Eval D0743-B.M.100.J-B.59BASIC R:0.31731 P:0.18750 F:0.23571
59BASIC ROUGE-1 Eval D0743-B.M.100.J-H.59BASIC R:0.29653 P:0.17803 F:0.22248
59BASIC ROUGE-1 Eval D0743-B.M.100.J-I.59BASIC R:0.34494 P:0.20644 F:0.25830
59BASIC ROUGE-1 Eval D0743-B.M.100.J-J.59BASIC R:0.34891 P:0.21212 F:0.26384
59BASIC ROUGE-1 Eval D0743-C.M.100.J-B.59BASIC R:0.34921 P:0.20833 F:0.26097
59BASIC ROUGE-1 Eval D0743-C.M.100.J-H.59BASIC R:0.31210 P:0.18561 F:0.23278
59BASIC ROUGE-1 Eval D0743-C.M.100.J-I.59BASIC R:0.34824 P:0.20644 F:0.25921
59BASIC ROUGE-1 Eval D0743-C.M.100.J-J.59BASIC R:0.33333 P:0.20076 F:0.25059
---------------------------------------------
59BASIC ROUGE-2 Average_R: 0.06774 (95%-conf.int. 0.06038 - 0.07513)
59BASIC ROUGE-2 Average_P: 0.03924 (95%-conf.int. 0.03493 - 0.04367)
59BASIC ROUGE-2 Average_F: 0.04949 (95%-conf.int. 0.04396 - 0.05503)
.............................................
59BASIC ROUGE-2 Eval D0703-A.M.100.A-A.59BASIC R:0.06826 P:0.04167 F:0.05175
59BASIC ROUGE-2 Eval D0703-A.M.100.A-C.59BASIC R:0.06102 P:0.03750 F:0.04645
59BASIC ROUGE-2 Eval D0703-A.M.100.A-D.59BASIC R:0.05903 P:0.03542 F:0.04427
59BASIC ROUGE-2 Eval D0703-A.M.100.A-J.59BASIC R:0.08935 P:0.05417 F:0.06745
59BASIC ROUGE-2 Eval D0703-B.M.100.A-A.59BASIC R:0.07591 P:0.04762 F:0.05853
59BASIC ROUGE-2 Eval D0703-B.M.100.A-C.59BASIC R:0.05085 P:0.03106 F:0.03856
59BASIC ROUGE-2 Eval D0703-B.M.100.A-D.59BASIC R:0.07797 P:0.04762 F:0.05913
59BASIC ROUGE-2 Eval D0703-B.M.100.A-J.59BASIC R:0.08725 P:0.05383 F:0.06658
59BASIC ROUGE-2 Eval D0703-C.M.100.A-A.59BASIC R:0.03367 P:0.01927 F:0.02451
59BASIC ROUGE-2 Eval D0703-C.M.100.A-C.59BASIC R:0.02951 P:0.01734 F:0.02184
59BASIC ROUGE-2 Eval D0703-C.M.100.A-D.59BASIC R:0.02676 P:0.01541 F:0.01956
59BASIC ROUGE-2 Eval D0703-C.M.100.A-J.59BASIC R:0.04013 P:0.02312 F:0.02934
59BASIC ROUGE-2 Eval D0706-A.M.100.B-B.59BASIC R:0.08197 P:0.04902 F:0.06135
59BASIC ROUGE-2 Eval D0706-A.M.100.B-D.59BASIC R:0.10561 P:0.06275 F:0.07872
59BASIC ROUGE-2 Eval D0706-A.M.100.B-E.59BASIC R:0.07213 P:0.04314 F:0.05399
59BASIC ROUGE-2 Eval D0706-A.M.100.B-I.59BASIC R:0.08525 P:0.05098 F:0.06380
59BASIC ROUGE-2 Eval D0706-B.M.100.B-B.59BASIC R:0.09901 P:0.06211 F:0.07633
59BASIC ROUGE-2 Eval D0706-B.M.100.B-D.59BASIC R:0.09539 P:0.06004 F:0.07370
59BASIC ROUGE-2 Eval D0706-B.M.100.B-E.59BASIC R:0.05246 P:0.03313 F:0.04061
59BASIC ROUGE-2 Eval D0706-B.M.100.B-I.59BASIC R:0.09804 P:0.06211 F:0.07604
59BASIC ROUGE-2 Eval D0706-C.M.100.B-B.59BASIC R:0.01629 P:0.01126 F:0.01332
59BASIC ROUGE-2 Eval D0706-C.M.100.B-D.59BASIC R:0.04560 P:0.03153 F:0.03728
59BASIC ROUGE-2 Eval D0706-C.M.100.B-E.59BASIC R:0.03883 P:0.02703 F:0.03187
59BASIC ROUGE-2 Eval D0706-C.M.100.B-I.59BASIC R:0.04516 P:0.03153 F:0.03713
59BASIC ROUGE-2 Eval D0711-A.M.100.C-A.59BASIC R:0.07641 P:0.04406 F:0.05589
59BASIC ROUGE-2 Eval D0711-A.M.100.C-B.59BASIC R:0.09091 P:0.05172 F:0.06593
59BASIC ROUGE-2 Eval D0711-A.M.100.C-C.59BASIC R:0.04377 P:0.02490 F:0.03174
59BASIC ROUGE-2 Eval D0711-A.M.100.C-F.59BASIC R:0.09030 P:0.05172 F:0.06577
59BASIC ROUGE-2 Eval D0711-B.M.100.C-A.59BASIC R:0.07216 P:0.03153 F:0.04388
59BASIC ROUGE-2 Eval D0711-B.M.100.C-B.59BASIC R:0.08997 P:0.03904 F:0.05445
59BASIC ROUGE-2 Eval D0711-B.M.100.C-C.59BASIC R:0.07797 P:0.03453 F:0.04786
59BASIC ROUGE-2 Eval D0711-B.M.100.C-F.59BASIC R:0.06849 P:0.03003 F:0.04175
59BASIC ROUGE-2 Eval D0711-C.M.100.C-A.59BASIC R:0.09333 P:0.05523 F:0.06939
59BASIC ROUGE-2 Eval D0711-C.M.100.C-B.59BASIC R:0.09310 P:0.05325 F:0.06775
59BASIC ROUGE-2 Eval D0711-C.M.100.C-C.59BASIC R:0.08874 P:0.05128 F:0.06500
59BASIC ROUGE-2 Eval D0711-C.M.100.C-F.59BASIC R:0.09215 P:0.05325 F:0.06750
59BASIC ROUGE-2 Eval D0716-A.M.100.D-C.59BASIC R:0.08278 P:0.05593 F:0.06676
59BASIC ROUGE-2 Eval D0716-A.M.100.D-D.59BASIC R:0.08418 P:0.05593 F:0.06721
59BASIC ROUGE-2 Eval D0716-A.M.100.D-E.59BASIC R:0.09396 P:0.06264 F:0.07517
59BASIC ROUGE-2 Eval D0716-A.M.100.D-F.59BASIC R:0.08000 P:0.05369 F:0.06426
59BASIC ROUGE-2 Eval D0716-B.M.100.D-C.59BASIC R:0.09967 P:0.06211 F:0.07653
59BASIC ROUGE-2 Eval D0716-B.M.100.D-D.59BASIC R:0.09492 P:0.05797 F:0.07198
59BASIC ROUGE-2 Eval D0716-B.M.100.D-E.59BASIC R:0.06040 P:0.03727 F:0.04610
59BASIC ROUGE-2 Eval D0716-B.M.100.D-F.59BASIC R:0.10774 P:0.06625 F:0.08205
59BASIC ROUGE-2 Eval D0716-C.M.100.D-C.59BASIC R:0.15132 P:0.09583 F:0.11735
59BASIC ROUGE-2 Eval D0716-C.M.100.D-D.59BASIC R:0.15541 P:0.09583 F:0.11856
59BASIC ROUGE-2 Eval D0716-C.M.100.D-E.59BASIC R:0.16667 P:0.10417 F:0.12821
59BASIC ROUGE-2 Eval D0716-C.M.100.D-F.59BASIC R:0.16835 P:0.10417 F:0.12870
59BASIC ROUGE-2 Eval D0721-A.M.100.E-B.59BASIC R:0.03704 P:0.02157 F:0.02726
59BASIC ROUGE-2 Eval D0721-A.M.100.E-C.59BASIC R:0.03607 P:0.02157 F:0.02700
59BASIC ROUGE-2 Eval D0721-A.M.100.E-E.59BASIC R:0.03607 P:0.02157 F:0.02700
59BASIC ROUGE-2 Eval D0721-A.M.100.E-G.59BASIC R:0.03859 P:0.02353 F:0.02923
59BASIC ROUGE-2 Eval D0721-B.M.100.E-B.59BASIC R:0.05592 P:0.03542 F:0.04337
59BASIC ROUGE-2 Eval D0721-B.M.100.E-C.59BASIC R:0.05466 P:0.03542 F:0.04299
59BASIC ROUGE-2 Eval D0721-B.M.100.E-E.59BASIC R:0.05298 P:0.03333 F:0.04092
59BASIC ROUGE-2 Eval D0721-B.M.100.E-G.59BASIC R:0.04235 P:0.02708 F:0.03304
59BASIC ROUGE-2 Eval D0721-C.M.100.E-B.59BASIC R:0.17550 P:0.09498 F:0.12325
59BASIC ROUGE-2 Eval D0721-C.M.100.E-C.59BASIC R:0.12333 P:0.06631 F:0.08625
59BASIC ROUGE-2 Eval D0721-C.M.100.E-E.59BASIC R:0.18182 P:0.09677 F:0.12631
59BASIC ROUGE-2 Eval D0721-C.M.100.E-G.59BASIC R:0.18750 P:0.10215 F:0.13225
59BASIC ROUGE-2 Eval D0726-A.M.100.F-A.59BASIC R:0.05369 P:0.03354 F:0.04129
59BASIC ROUGE-2 Eval D0726-A.M.100.F-E.59BASIC R:0.05387 P:0.03354 F:0.04134
59BASIC ROUGE-2 Eval D0726-A.M.100.F-F.59BASIC R:0.05369 P:0.03354 F:0.04129
59BASIC ROUGE-2 Eval D0726-A.M.100.F-G.59BASIC R:0.02013 P:0.01258 F:0.01548
59BASIC ROUGE-2 Eval D0726-B.M.100.F-A.59BASIC R:0.05611 P:0.03333 F:0.04182
59BASIC ROUGE-2 Eval D0726-B.M.100.F-E.59BASIC R:0.05034 P:0.02941 F:0.03713
59BASIC ROUGE-2 Eval D0726-B.M.100.F-F.59BASIC R:0.05705 P:0.03333 F:0.04208
59BASIC ROUGE-2 Eval D0726-B.M.100.F-G.59BASIC R:0.02658 P:0.01569 F:0.01973
59BASIC ROUGE-2 Eval D0726-C.M.100.F-A.59BASIC R:0.05387 P:0.03509 F:0.04250
59BASIC ROUGE-2 Eval D0726-C.M.100.F-E.59BASIC R:0.05102 P:0.03289 F:0.04000
59BASIC ROUGE-2 Eval D0726-C.M.100.F-F.59BASIC R:0.03425 P:0.02193 F:0.02674
59BASIC ROUGE-2 Eval D0726-C.M.100.F-G.59BASIC R:0.02318 P:0.01535 F:0.01847
59BASIC ROUGE-2 Eval D0727-A.M.100.G-A.59BASIC R:0.18121 P:0.10405 F:0.13219
59BASIC ROUGE-2 Eval D0727-A.M.100.G-F.59BASIC R:0.18937 P:0.10983 F:0.13903
59BASIC ROUGE-2 Eval D0727-A.M.100.G-G.59BASIC R:0.12871 P:0.07514 F:0.09489
59BASIC ROUGE-2 Eval D0727-A.M.100.G-H.59BASIC R:0.19934 P:0.11561 F:0.14635
59BASIC ROUGE-2 Eval D0727-B.M.100.G-A.59BASIC R:0.04167 P:0.02210 F:0.02888
59BASIC ROUGE-2 Eval D0727-B.M.100.G-F.59BASIC R:0.05902 P:0.03315 F:0.04245
59BASIC ROUGE-2 Eval D0727-B.M.100.G-G.59BASIC R:0.03846 P:0.02026 F:0.02654
59BASIC ROUGE-2 Eval D0727-B.M.100.G-H.59BASIC R:0.05556 P:0.02947 F:0.03851
59BASIC ROUGE-2 Eval D0727-C.M.100.G-A.59BASIC R:0.02303 P:0.01184 F:0.01564
59BASIC ROUGE-2 Eval D0727-C.M.100.G-F.59BASIC R:0.03741 P:0.01861 F:0.02486
59BASIC ROUGE-2 Eval D0727-C.M.100.G-G.59BASIC R:0.03000 P:0.01523 F:0.02020
59BASIC ROUGE-2 Eval D0727-C.M.100.G-H.59BASIC R:0.04096 P:0.02030 F:0.02715
59BASIC ROUGE-2 Eval D0736-A.M.100.H-G.59BASIC R:0.07971 P:0.04074 F:0.05392
59BASIC ROUGE-2 Eval D0736-A.M.100.H-H.59BASIC R:0.05166 P:0.02593 F:0.03453
59BASIC ROUGE-2 Eval D0736-A.M.100.H-I.59BASIC R:0.06475 P:0.03333 F:0.04401
59BASIC ROUGE-2 Eval D0736-A.M.100.H-J.59BASIC R:0.06931 P:0.03889 F:0.04982
59BASIC ROUGE-2 Eval D0736-B.M.100.H-G.59BASIC R:0.00772 P:0.00392 F:0.00520
59BASIC ROUGE-2 Eval D0736-B.M.100.H-H.59BASIC R:0.01255 P:0.00588 F:0.00801
59BASIC ROUGE-2 Eval D0736-B.M.100.H-I.59BASIC R:0.00847 P:0.00392 F:0.00536
59BASIC ROUGE-2 Eval D0736-B.M.100.H-J.59BASIC R:0.00707 P:0.00392 F:0.00504
59BASIC ROUGE-2 Eval D0736-C.M.100.H-G.59BASIC R:0.04274 P:0.01603 F:0.02332
59BASIC ROUGE-2 Eval D0736-C.M.100.H-H.59BASIC R:0.01630 P:0.00481 F:0.00743
59BASIC ROUGE-2 Eval D0736-C.M.100.H-I.59BASIC R:0.06522 P:0.01923 F:0.02970
59BASIC ROUGE-2 Eval D0736-C.M.100.H-J.59BASIC R:0.04198 P:0.01763 F:0.02483
59BASIC ROUGE-2 Eval D0740-A.M.100.I-D.59BASIC R:0.09000 P:0.05625 F:0.06923
59BASIC ROUGE-2 Eval D0740-A.M.100.I-H.59BASIC R:0.07591 P:0.04792 F:0.05875
59BASIC ROUGE-2 Eval D0740-A.M.100.I-I.59BASIC R:0.08197 P:0.05208 F:0.06369
59BASIC ROUGE-2 Eval D0740-A.M.100.I-J.59BASIC R:0.06840 P:0.04375 F:0.05337
59BASIC ROUGE-2 Eval D0740-B.M.100.I-D.59BASIC R:0.05246 P:0.03137 F:0.03926
59BASIC ROUGE-2 Eval D0740-B.M.100.I-H.59BASIC R:0.06020 P:0.03529 F:0.04450
59BASIC ROUGE-2 Eval D0740-B.M.100.I-I.59BASIC R:0.06623 P:0.03922 F:0.04927
59BASIC ROUGE-2 Eval D0740-B.M.100.I-J.59BASIC R:0.04902 P:0.02941 F:0.03676
59BASIC ROUGE-2 Eval D0740-C.M.100.I-D.59BASIC R:0.00323 P:0.00195 F:0.00243
59BASIC ROUGE-2 Eval D0740-C.M.100.I-H.59BASIC R:0.00649 P:0.00390 F:0.00487
59BASIC ROUGE-2 Eval D0740-C.M.100.I-I.59BASIC R:0.00323 P:0.00195 F:0.00243
59BASIC ROUGE-2 Eval D0740-C.M.100.I-J.59BASIC R:0.00643 P:0.00390 F:0.00486
59BASIC ROUGE-2 Eval D0743-A.M.100.J-B.59BASIC R:0.02885 P:0.00875 F:0.01343
59BASIC ROUGE-2 Eval D0743-A.M.100.J-H.59BASIC R:0.05607 P:0.01749 F:0.02666
59BASIC ROUGE-2 Eval D0743-A.M.100.J-I.59BASIC R:0.05678 P:0.01749 F:0.02674
59BASIC ROUGE-2 Eval D0743-A.M.100.J-J.59BASIC R:0.04658 P:0.01458 F:0.02221
59BASIC ROUGE-2 Eval D0743-B.M.100.J-B.59BASIC R:0.06796 P:0.04000 F:0.05036
59BASIC ROUGE-2 Eval D0743-B.M.100.J-H.59BASIC R:0.04459 P:0.02667 F:0.03338
59BASIC ROUGE-2 Eval D0743-B.M.100.J-I.59BASIC R:0.07668 P:0.04571 F:0.05728
59BASIC ROUGE-2 Eval D0743-B.M.100.J-J.59BASIC R:0.08805 P:0.05333 F:0.06643
59BASIC ROUGE-2 Eval D0743-C.M.100.J-B.59BASIC R:0.05769 P:0.03429 F:0.04301
59BASIC ROUGE-2 Eval D0743-C.M.100.J-H.59BASIC R:0.05466 P:0.03238 F:0.04067
59BASIC ROUGE-2 Eval D0743-C.M.100.J-I.59BASIC R:0.04839 P:0.02857 F:0.03593
59BASIC ROUGE-2 Eval D0743-C.M.100.J-J.59BASIC R:0.04127 P:0.02476 F:0.03095
---------------------------------------------
59BASIC ROUGE-3 Average_R: 0.02597 (95%-conf.int. 0.02165 - 0.03087)
59BASIC ROUGE-3 Average_P: 0.01499 (95%-conf.int. 0.01244 - 0.01779)
59BASIC ROUGE-3 Average_F: 0.01895 (95%-conf.int. 0.01574 - 0.02250)
.............................................
59BASIC ROUGE-3 Eval D0703-A.M.100.A-A.59BASIC R:0.02069 P:0.01258 F:0.01565
59BASIC ROUGE-3 Eval D0703-A.M.100.A-C.59BASIC R:0.02055 P:0.01258 F:0.01561
59BASIC ROUGE-3 Eval D0703-A.M.100.A-D.59BASIC R:0.01404 P:0.00839 F:0.01050
59BASIC ROUGE-3 Eval D0703-A.M.100.A-J.59BASIC R:0.02778 P:0.01677 F:0.02091
59BASIC ROUGE-3 Eval D0703-B.M.100.A-A.59BASIC R:0.03667 P:0.02292 F:0.02821
59BASIC ROUGE-3 Eval D0703-B.M.100.A-C.59BASIC R:0.00685 P:0.00417 F:0.00518
59BASIC ROUGE-3 Eval D0703-B.M.100.A-D.59BASIC R:0.03767 P:0.02292 F:0.02850
59BASIC ROUGE-3 Eval D0703-B.M.100.A-J.59BASIC R:0.04068 P:0.02500 F:0.03097
59BASIC ROUGE-3 Eval D0703-C.M.100.A-A.59BASIC R:0.00680 P:0.00388 F:0.00494
59BASIC ROUGE-3 Eval D0703-C.M.100.A-C.59BASIC R:0.00993 P:0.00581 F:0.00733
59BASIC ROUGE-3 Eval D0703-C.M.100.A-D.59BASIC R:0.00338 P:0.00194 F:0.00247
59BASIC ROUGE-3 Eval D0703-C.M.100.A-J.59BASIC R:0.01014 P:0.00581 F:0.00739
59BASIC ROUGE-3 Eval D0706-A.M.100.B-B.59BASIC R:0.03642 P:0.02170 F:0.02720
59BASIC ROUGE-3 Eval D0706-A.M.100.B-D.59BASIC R:0.05333 P:0.03156 F:0.03965
59BASIC ROUGE-3 Eval D0706-A.M.100.B-E.59BASIC R:0.02649 P:0.01578 F:0.01978
59BASIC ROUGE-3 Eval D0706-A.M.100.B-I.59BASIC R:0.04305 P:0.02564 F:0.03214
59BASIC ROUGE-3 Eval D0706-B.M.100.B-B.59BASIC R:0.02667 P:0.01667 F:0.02052
59BASIC ROUGE-3 Eval D0706-B.M.100.B-D.59BASIC R:0.02990 P:0.01875 F:0.02305
59BASIC ROUGE-3 Eval D0706-B.M.100.B-E.59BASIC R:0.00331 P:0.00208 F:0.00255
59BASIC ROUGE-3 Eval D0706-B.M.100.B-I.59BASIC R:0.02970 P:0.01875 F:0.02299
59BASIC ROUGE-3 Eval D0706-C.M.100.B-B.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0706-C.M.100.B-D.59BASIC R:0.01316 P:0.00907 F:0.01074
59BASIC ROUGE-3 Eval D0706-C.M.100.B-E.59BASIC R:0.01307 P:0.00907 F:0.01071
59BASIC ROUGE-3 Eval D0706-C.M.100.B-I.59BASIC R:0.01303 P:0.00907 F:0.01070
59BASIC ROUGE-3 Eval D0711-A.M.100.C-A.59BASIC R:0.04027 P:0.02312 F:0.02938
59BASIC ROUGE-3 Eval D0711-A.M.100.C-B.59BASIC R:0.04762 P:0.02697 F:0.03444
59BASIC ROUGE-3 Eval D0711-A.M.100.C-C.59BASIC R:0.00680 P:0.00385 F:0.00492
59BASIC ROUGE-3 Eval D0711-A.M.100.C-F.59BASIC R:0.04730 P:0.02697 F:0.03435
59BASIC ROUGE-3 Eval D0711-B.M.100.C-A.59BASIC R:0.01736 P:0.00754 F:0.01051
59BASIC ROUGE-3 Eval D0711-B.M.100.C-B.59BASIC R:0.02098 P:0.00905 F:0.01265
59BASIC ROUGE-3 Eval D0711-B.M.100.C-C.59BASIC R:0.01370 P:0.00603 F:0.00837
59BASIC ROUGE-3 Eval D0711-B.M.100.C-F.59BASIC R:0.01038 P:0.00452 F:0.00630
59BASIC ROUGE-3 Eval D0711-C.M.100.C-A.59BASIC R:0.06061 P:0.03571 F:0.04494
59BASIC ROUGE-3 Eval D0711-C.M.100.C-B.59BASIC R:0.05923 P:0.03373 F:0.04298
59BASIC ROUGE-3 Eval D0711-C.M.100.C-C.59BASIC R:0.06207 P:0.03571 F:0.04534
59BASIC ROUGE-3 Eval D0711-C.M.100.C-F.59BASIC R:0.06552 P:0.03770 F:0.04786
59BASIC ROUGE-3 Eval D0716-A.M.100.D-C.59BASIC R:0.01338 P:0.00901 F:0.01077
59BASIC ROUGE-3 Eval D0716-A.M.100.D-D.59BASIC R:0.01020 P:0.00676 F:0.00813
59BASIC ROUGE-3 Eval D0716-A.M.100.D-E.59BASIC R:0.02034 P:0.01351 F:0.01624
59BASIC ROUGE-3 Eval D0716-A.M.100.D-F.59BASIC R:0.01684 P:0.01126 F:0.01350
59BASIC ROUGE-3 Eval D0716-B.M.100.D-C.59BASIC R:0.04027 P:0.02500 F:0.03085
59BASIC ROUGE-3 Eval D0716-B.M.100.D-D.59BASIC R:0.04110 P:0.02500 F:0.03109
59BASIC ROUGE-3 Eval D0716-B.M.100.D-E.59BASIC R:0.02034 P:0.01250 F:0.01548
59BASIC ROUGE-3 Eval D0716-B.M.100.D-F.59BASIC R:0.05102 P:0.03125 F:0.03876
59BASIC ROUGE-3 Eval D0716-C.M.100.D-C.59BASIC R:0.08970 P:0.05660 F:0.06941
59BASIC ROUGE-3 Eval D0716-C.M.100.D-D.59BASIC R:0.08191 P:0.05031 F:0.06233
59BASIC ROUGE-3 Eval D0716-C.M.100.D-E.59BASIC R:0.09091 P:0.05660 F:0.06976
59BASIC ROUGE-3 Eval D0716-C.M.100.D-F.59BASIC R:0.10204 P:0.06289 F:0.07782
59BASIC ROUGE-3 Eval D0721-A.M.100.E-B.59BASIC R:0.01020 P:0.00592 F:0.00749
59BASIC ROUGE-3 Eval D0721-A.M.100.E-C.59BASIC R:0.00993 P:0.00592 F:0.00742
59BASIC ROUGE-3 Eval D0721-A.M.100.E-E.59BASIC R:0.00993 P:0.00592 F:0.00742
59BASIC ROUGE-3 Eval D0721-A.M.100.E-G.59BASIC R:0.00974 P:0.00592 F:0.00736
59BASIC ROUGE-3 Eval D0721-B.M.100.E-B.59BASIC R:0.00332 P:0.00210 F:0.00257
59BASIC ROUGE-3 Eval D0721-B.M.100.E-C.59BASIC R:0.00649 P:0.00419 F:0.00509
59BASIC ROUGE-3 Eval D0721-B.M.100.E-E.59BASIC R:0.00669 P:0.00419 F:0.00515
59BASIC ROUGE-3 Eval D0721-B.M.100.E-G.59BASIC R:0.00329 P:0.00210 F:0.00256
59BASIC ROUGE-3 Eval D0721-C.M.100.E-B.59BASIC R:0.09365 P:0.05045 F:0.06557
59BASIC ROUGE-3 Eval D0721-C.M.100.E-C.59BASIC R:0.04714 P:0.02523 F:0.03287
59BASIC ROUGE-3 Eval D0721-C.M.100.E-E.59BASIC R:0.11224 P:0.05946 F:0.07774
59BASIC ROUGE-3 Eval D0721-C.M.100.E-G.59BASIC R:0.11960 P:0.06486 F:0.08411
59BASIC ROUGE-3 Eval D0726-A.M.100.F-A.59BASIC R:0.02712 P:0.01688 F:0.02081
59BASIC ROUGE-3 Eval D0726-A.M.100.F-E.59BASIC R:0.02721 P:0.01688 F:0.02083
59BASIC ROUGE-3 Eval D0726-A.M.100.F-F.59BASIC R:0.02712 P:0.01688 F:0.02081
59BASIC ROUGE-3 Eval D0726-A.M.100.F-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0726-B.M.100.F-A.59BASIC R:0.03333 P:0.01972 F:0.02478
59BASIC ROUGE-3 Eval D0726-B.M.100.F-E.59BASIC R:0.02712 P:0.01578 F:0.01995
59BASIC ROUGE-3 Eval D0726-B.M.100.F-F.59BASIC R:0.03051 P:0.01775 F:0.02244
59BASIC ROUGE-3 Eval D0726-B.M.100.F-G.59BASIC R:0.01007 P:0.00592 F:0.00746
59BASIC ROUGE-3 Eval D0726-C.M.100.F-A.59BASIC R:0.02041 P:0.01325 F:0.01607
59BASIC ROUGE-3 Eval D0726-C.M.100.F-E.59BASIC R:0.02062 P:0.01325 F:0.01613
59BASIC ROUGE-3 Eval D0726-C.M.100.F-F.59BASIC R:0.01730 P:0.01104 F:0.01348
59BASIC ROUGE-3 Eval D0726-C.M.100.F-G.59BASIC R:0.00334 P:0.00221 F:0.00266
59BASIC ROUGE-3 Eval D0727-A.M.100.G-A.59BASIC R:0.09153 P:0.05233 F:0.06659
59BASIC ROUGE-3 Eval D0727-A.M.100.G-F.59BASIC R:0.09732 P:0.05620 F:0.07125
59BASIC ROUGE-3 Eval D0727-A.M.100.G-G.59BASIC R:0.03667 P:0.02132 F:0.02696
59BASIC ROUGE-3 Eval D0727-A.M.100.G-H.59BASIC R:0.09732 P:0.05620 F:0.07125
59BASIC ROUGE-3 Eval D0727-B.M.100.G-A.59BASIC R:0.00351 P:0.00185 F:0.00242
59BASIC ROUGE-3 Eval D0727-B.M.100.G-F.59BASIC R:0.00331 P:0.00185 F:0.00237
59BASIC ROUGE-3 Eval D0727-B.M.100.G-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0727-B.M.100.G-H.59BASIC R:0.00351 P:0.00185 F:0.00242
59BASIC ROUGE-3 Eval D0727-C.M.100.G-A.59BASIC R:0.00332 P:0.00170 F:0.00225
59BASIC ROUGE-3 Eval D0727-C.M.100.G-F.59BASIC R:0.01031 P:0.00510 F:0.00682
59BASIC ROUGE-3 Eval D0727-C.M.100.G-G.59BASIC R:0.00673 P:0.00340 F:0.00452
59BASIC ROUGE-3 Eval D0727-C.M.100.G-H.59BASIC R:0.01034 P:0.00510 F:0.00683
59BASIC ROUGE-3 Eval D0736-A.M.100.H-G.59BASIC R:0.03297 P:0.01676 F:0.02222
59BASIC ROUGE-3 Eval D0736-A.M.100.H-H.59BASIC R:0.01866 P:0.00931 F:0.01242
59BASIC ROUGE-3 Eval D0736-A.M.100.H-I.59BASIC R:0.02182 P:0.01117 F:0.01478
59BASIC ROUGE-3 Eval D0736-A.M.100.H-J.59BASIC R:0.02333 P:0.01304 F:0.01673
59BASIC ROUGE-3 Eval D0736-B.M.100.H-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0736-B.M.100.H-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0736-B.M.100.H-I.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0736-B.M.100.H-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0736-C.M.100.H-G.59BASIC R:0.02165 P:0.00805 F:0.01174
59BASIC ROUGE-3 Eval D0736-C.M.100.H-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0736-C.M.100.H-I.59BASIC R:0.02762 P:0.00805 F:0.01247
59BASIC ROUGE-3 Eval D0736-C.M.100.H-J.59BASIC R:0.01931 P:0.00805 F:0.01136
59BASIC ROUGE-3 Eval D0740-A.M.100.I-D.59BASIC R:0.02694 P:0.01677 F:0.02067
59BASIC ROUGE-3 Eval D0740-A.M.100.I-H.59BASIC R:0.01667 P:0.01048 F:0.01287
59BASIC ROUGE-3 Eval D0740-A.M.100.I-I.59BASIC R:0.02318 P:0.01468 F:0.01798
59BASIC ROUGE-3 Eval D0740-A.M.100.I-J.59BASIC R:0.01316 P:0.00839 F:0.01025
59BASIC ROUGE-3 Eval D0740-B.M.100.I-D.59BASIC R:0.00993 P:0.00592 F:0.00742
59BASIC ROUGE-3 Eval D0740-B.M.100.I-H.59BASIC R:0.01351 P:0.00789 F:0.00996
59BASIC ROUGE-3 Eval D0740-B.M.100.I-I.59BASIC R:0.01672 P:0.00986 F:0.01240
59BASIC ROUGE-3 Eval D0740-B.M.100.I-J.59BASIC R:0.00990 P:0.00592 F:0.00741
59BASIC ROUGE-3 Eval D0740-C.M.100.I-D.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0740-C.M.100.I-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0740-C.M.100.I-I.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0740-C.M.100.I-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-3 Eval D0743-A.M.100.J-B.59BASIC R:0.00647 P:0.00195 F:0.00300
59BASIC ROUGE-3 Eval D0743-A.M.100.J-H.59BASIC R:0.01887 P:0.00585 F:0.00893
59BASIC ROUGE-3 Eval D0743-A.M.100.J-I.59BASIC R:0.01911 P:0.00585 F:0.00896
59BASIC ROUGE-3 Eval D0743-A.M.100.J-J.59BASIC R:0.01254 P:0.00390 F:0.00595
59BASIC ROUGE-3 Eval D0743-B.M.100.J-B.59BASIC R:0.02614 P:0.01533 F:0.01933
59BASIC ROUGE-3 Eval D0743-B.M.100.J-H.59BASIC R:0.01608 P:0.00958 F:0.01201
59BASIC ROUGE-3 Eval D0743-B.M.100.J-I.59BASIC R:0.02903 P:0.01724 F:0.02163
59BASIC ROUGE-3 Eval D0743-B.M.100.J-J.59BASIC R:0.03492 P:0.02107 F:0.02628
59BASIC ROUGE-3 Eval D0743-C.M.100.J-B.59BASIC R:0.01942 P:0.01149 F:0.01444
59BASIC ROUGE-3 Eval D0743-C.M.100.J-H.59BASIC R:0.01948 P:0.01149 F:0.01445
59BASIC ROUGE-3 Eval D0743-C.M.100.J-I.59BASIC R:0.01954 P:0.01149 F:0.01447
59BASIC ROUGE-3 Eval D0743-C.M.100.J-J.59BASIC R:0.00962 P:0.00575 F:0.00720
---------------------------------------------
59BASIC ROUGE-4 Average_R: 0.01236 (95%-conf.int. 0.00926 - 0.01552)
59BASIC ROUGE-4 Average_P: 0.00710 (95%-conf.int. 0.00538 - 0.00889)
59BASIC ROUGE-4 Average_F: 0.00900 (95%-conf.int. 0.00679 - 0.01125)
.............................................
59BASIC ROUGE-4 Eval D0703-A.M.100.A-A.59BASIC R:0.00697 P:0.00422 F:0.00526
59BASIC ROUGE-4 Eval D0703-A.M.100.A-C.59BASIC R:0.01038 P:0.00633 F:0.00786
59BASIC ROUGE-4 Eval D0703-A.M.100.A-D.59BASIC R:0.00355 P:0.00211 F:0.00265
59BASIC ROUGE-4 Eval D0703-A.M.100.A-J.59BASIC R:0.01053 P:0.00633 F:0.00791
59BASIC ROUGE-4 Eval D0703-B.M.100.A-A.59BASIC R:0.03030 P:0.01887 F:0.02326
59BASIC ROUGE-4 Eval D0703-B.M.100.A-C.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0703-B.M.100.A-D.59BASIC R:0.03114 P:0.01887 F:0.02350
59BASIC ROUGE-4 Eval D0703-B.M.100.A-J.59BASIC R:0.03082 P:0.01887 F:0.02341
59BASIC ROUGE-4 Eval D0703-C.M.100.A-A.59BASIC R:0.00344 P:0.00195 F:0.00249
59BASIC ROUGE-4 Eval D0703-C.M.100.A-C.59BASIC R:0.00334 P:0.00195 F:0.00246
59BASIC ROUGE-4 Eval D0703-C.M.100.A-D.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0703-C.M.100.A-J.59BASIC R:0.00341 P:0.00195 F:0.00248
59BASIC ROUGE-4 Eval D0706-A.M.100.B-B.59BASIC R:0.02341 P:0.01389 F:0.01744
59BASIC ROUGE-4 Eval D0706-A.M.100.B-D.59BASIC R:0.03367 P:0.01984 F:0.02497
59BASIC ROUGE-4 Eval D0706-A.M.100.B-E.59BASIC R:0.01672 P:0.00992 F:0.01245
59BASIC ROUGE-4 Eval D0706-A.M.100.B-I.59BASIC R:0.02676 P:0.01587 F:0.01992
59BASIC ROUGE-4 Eval D0706-B.M.100.B-B.59BASIC R:0.01684 P:0.01048 F:0.01292
59BASIC ROUGE-4 Eval D0706-B.M.100.B-D.59BASIC R:0.01678 P:0.01048 F:0.01290
59BASIC ROUGE-4 Eval D0706-B.M.100.B-E.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0706-B.M.100.B-I.59BASIC R:0.01667 P:0.01048 F:0.01287
59BASIC ROUGE-4 Eval D0706-C.M.100.B-B.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0706-C.M.100.B-D.59BASIC R:0.00664 P:0.00457 F:0.00541
59BASIC ROUGE-4 Eval D0706-C.M.100.B-E.59BASIC R:0.00660 P:0.00457 F:0.00540
59BASIC ROUGE-4 Eval D0706-C.M.100.B-I.59BASIC R:0.00658 P:0.00457 F:0.00539
59BASIC ROUGE-4 Eval D0711-A.M.100.C-A.59BASIC R:0.03051 P:0.01744 F:0.02219
59BASIC ROUGE-4 Eval D0711-A.M.100.C-B.59BASIC R:0.03093 P:0.01744 F:0.02230
59BASIC ROUGE-4 Eval D0711-A.M.100.C-C.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0711-A.M.100.C-F.59BASIC R:0.03072 P:0.01744 F:0.02225
59BASIC ROUGE-4 Eval D0711-B.M.100.C-A.59BASIC R:0.00351 P:0.00152 F:0.00212
59BASIC ROUGE-4 Eval D0711-B.M.100.C-B.59BASIC R:0.00353 P:0.00152 F:0.00212
59BASIC ROUGE-4 Eval D0711-B.M.100.C-C.59BASIC R:0.00346 P:0.00152 F:0.00211
59BASIC ROUGE-4 Eval D0711-B.M.100.C-F.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0711-C.M.100.C-A.59BASIC R:0.04082 P:0.02395 F:0.03019
59BASIC ROUGE-4 Eval D0711-C.M.100.C-B.59BASIC R:0.03873 P:0.02196 F:0.02803
59BASIC ROUGE-4 Eval D0711-C.M.100.C-C.59BASIC R:0.04181 P:0.02395 F:0.03045
59BASIC ROUGE-4 Eval D0711-C.M.100.C-F.59BASIC R:0.04530 P:0.02595 F:0.03300
59BASIC ROUGE-4 Eval D0716-A.M.100.D-C.59BASIC R:0.00338 P:0.00227 F:0.00272
59BASIC ROUGE-4 Eval D0716-A.M.100.D-D.59BASIC R:0.00344 P:0.00227 F:0.00274
59BASIC ROUGE-4 Eval D0716-A.M.100.D-E.59BASIC R:0.00685 P:0.00454 F:0.00546
59BASIC ROUGE-4 Eval D0716-A.M.100.D-F.59BASIC R:0.00680 P:0.00454 F:0.00544
59BASIC ROUGE-4 Eval D0716-B.M.100.D-C.59BASIC R:0.01695 P:0.01048 F:0.01295
59BASIC ROUGE-4 Eval D0716-B.M.100.D-D.59BASIC R:0.01730 P:0.01048 F:0.01305
59BASIC ROUGE-4 Eval D0716-B.M.100.D-E.59BASIC R:0.00685 P:0.00419 F:0.00520
59BASIC ROUGE-4 Eval D0716-B.M.100.D-F.59BASIC R:0.02062 P:0.01258 F:0.01563
59BASIC ROUGE-4 Eval D0716-C.M.100.D-C.59BASIC R:0.04027 P:0.02532 F:0.03109
59BASIC ROUGE-4 Eval D0716-C.M.100.D-D.59BASIC R:0.03103 P:0.01899 F:0.02356
59BASIC ROUGE-4 Eval D0716-C.M.100.D-E.59BASIC R:0.03061 P:0.01899 F:0.02344
59BASIC ROUGE-4 Eval D0716-C.M.100.D-F.59BASIC R:0.04124 P:0.02532 F:0.03138
59BASIC ROUGE-4 Eval D0721-A.M.100.E-B.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-A.M.100.E-C.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-A.M.100.E-E.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-A.M.100.E-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-B.M.100.E-B.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-B.M.100.E-C.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-B.M.100.E-E.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-B.M.100.E-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0721-C.M.100.E-B.59BASIC R:0.07432 P:0.03986 F:0.05189
59BASIC ROUGE-4 Eval D0721-C.M.100.E-C.59BASIC R:0.02721 P:0.01449 F:0.01891
59BASIC ROUGE-4 Eval D0721-C.M.100.E-E.59BASIC R:0.08247 P:0.04348 F:0.05694
59BASIC ROUGE-4 Eval D0721-C.M.100.E-G.59BASIC R:0.09060 P:0.04891 F:0.06353
59BASIC ROUGE-4 Eval D0726-A.M.100.F-A.59BASIC R:0.01370 P:0.00849 F:0.01048
59BASIC ROUGE-4 Eval D0726-A.M.100.F-E.59BASIC R:0.01375 P:0.00849 F:0.01050
59BASIC ROUGE-4 Eval D0726-A.M.100.F-F.59BASIC R:0.01370 P:0.00849 F:0.01048
59BASIC ROUGE-4 Eval D0726-A.M.100.F-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0726-B.M.100.F-A.59BASIC R:0.01684 P:0.00992 F:0.01249
59BASIC ROUGE-4 Eval D0726-B.M.100.F-E.59BASIC R:0.01712 P:0.00992 F:0.01256
59BASIC ROUGE-4 Eval D0726-B.M.100.F-F.59BASIC R:0.01712 P:0.00992 F:0.01256
59BASIC ROUGE-4 Eval D0726-B.M.100.F-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0726-C.M.100.F-A.59BASIC R:0.00687 P:0.00444 F:0.00539
59BASIC ROUGE-4 Eval D0726-C.M.100.F-E.59BASIC R:0.00694 P:0.00444 F:0.00542
59BASIC ROUGE-4 Eval D0726-C.M.100.F-F.59BASIC R:0.00699 P:0.00444 F:0.00543
59BASIC ROUGE-4 Eval D0726-C.M.100.F-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-A.M.100.G-A.59BASIC R:0.04795 P:0.02729 F:0.03478
59BASIC ROUGE-4 Eval D0727-A.M.100.G-F.59BASIC R:0.05424 P:0.03119 F:0.03961
59BASIC ROUGE-4 Eval D0727-A.M.100.G-G.59BASIC R:0.00673 P:0.00390 F:0.00494
59BASIC ROUGE-4 Eval D0727-A.M.100.G-H.59BASIC R:0.05424 P:0.03119 F:0.03961
59BASIC ROUGE-4 Eval D0727-B.M.100.G-A.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-B.M.100.G-F.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-B.M.100.G-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-B.M.100.G-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-C.M.100.G-A.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-C.M.100.G-F.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-C.M.100.G-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0727-C.M.100.G-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-A.M.100.H-G.59BASIC R:0.00741 P:0.00375 F:0.00498
59BASIC ROUGE-4 Eval D0736-A.M.100.H-H.59BASIC R:0.00755 P:0.00375 F:0.00501
59BASIC ROUGE-4 Eval D0736-A.M.100.H-I.59BASIC R:0.00368 P:0.00187 F:0.00248
59BASIC ROUGE-4 Eval D0736-A.M.100.H-J.59BASIC R:0.00337 P:0.00187 F:0.00241
59BASIC ROUGE-4 Eval D0736-B.M.100.H-G.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-B.M.100.H-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-B.M.100.H-I.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-B.M.100.H-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-C.M.100.H-G.59BASIC R:0.01316 P:0.00485 F:0.00709
59BASIC ROUGE-4 Eval D0736-C.M.100.H-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0736-C.M.100.H-I.59BASIC R:0.01685 P:0.00485 F:0.00753
59BASIC ROUGE-4 Eval D0736-C.M.100.H-J.59BASIC R:0.01172 P:0.00485 F:0.00686
59BASIC ROUGE-4 Eval D0740-A.M.100.I-D.59BASIC R:0.00340 P:0.00211 F:0.00260
59BASIC ROUGE-4 Eval D0740-A.M.100.I-H.59BASIC R:0.00337 P:0.00211 F:0.00260
59BASIC ROUGE-4 Eval D0740-A.M.100.I-I.59BASIC R:0.00334 P:0.00211 F:0.00259
59BASIC ROUGE-4 Eval D0740-A.M.100.I-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0740-B.M.100.I-D.59BASIC R:0.00334 P:0.00198 F:0.00249
59BASIC ROUGE-4 Eval D0740-B.M.100.I-H.59BASIC R:0.00683 P:0.00397 F:0.00502
59BASIC ROUGE-4 Eval D0740-B.M.100.I-I.59BASIC R:0.00676 P:0.00397 F:0.00500
59BASIC ROUGE-4 Eval D0740-B.M.100.I-J.59BASIC R:0.00333 P:0.00198 F:0.00248
59BASIC ROUGE-4 Eval D0740-C.M.100.I-D.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0740-C.M.100.I-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0740-C.M.100.I-I.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0740-C.M.100.I-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0743-A.M.100.J-B.59BASIC R:0.00327 P:0.00098 F:0.00151
59BASIC ROUGE-4 Eval D0743-A.M.100.J-H.59BASIC R:0.00317 P:0.00098 F:0.00150
59BASIC ROUGE-4 Eval D0743-A.M.100.J-I.59BASIC R:0.00322 P:0.00098 F:0.00150
59BASIC ROUGE-4 Eval D0743-A.M.100.J-J.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0743-B.M.100.J-B.59BASIC R:0.00660 P:0.00385 F:0.00486
59BASIC ROUGE-4 Eval D0743-B.M.100.J-H.59BASIC R:0.00000 P:0.00000 F:0.00000
59BASIC ROUGE-4 Eval D0743-B.M.100.J-I.59BASIC R:0.00651 P:0.00385 F:0.00484
59BASIC ROUGE-4 Eval D0743-B.M.100.J-J.59BASIC R:0.00641 P:0.00385 F:0.00481
59BASIC ROUGE-4 Eval D0743-C.M.100.J-B.59BASIC R:0.00327 P:0.00193 F:0.00243
59BASIC ROUGE-4 Eval D0743-C.M.100.J-H.59BASIC R:0.00328 P:0.00193 F:0.00243
59BASIC ROUGE-4 Eval D0743-C.M.100.J-I.59BASIC R:0.00329 P:0.00193 F:0.00243
59BASIC ROUGE-4 Eval D0743-C.M.100.J-J.59BASIC R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
59BASIC ROUGE-L Average_R: 0.29018 (95%-conf.int. 0.28137 - 0.29915)
59BASIC ROUGE-L Average_P: 0.16710 (95%-conf.int. 0.16059 - 0.17414)
59BASIC ROUGE-L Average_F: 0.21094 (95%-conf.int. 0.20370 - 0.21876)
.............................................
59BASIC ROUGE-L Eval D0703-A.M.100.A-A.59BASIC R:0.27703 P:0.16977 F:0.21053
59BASIC ROUGE-L Eval D0703-A.M.100.A-C.59BASIC R:0.23826 P:0.14700 F:0.18182
59BASIC ROUGE-L Eval D0703-A.M.100.A-D.59BASIC R:0.26117 P:0.15735 F:0.19638
59BASIC ROUGE-L Eval D0703-A.M.100.A-J.59BASIC R:0.27211 P:0.16563 F:0.20592
59BASIC ROUGE-L Eval D0703-B.M.100.A-A.59BASIC R:0.29085 P:0.18313 F:0.22475
59BASIC ROUGE-L Eval D0703-B.M.100.A-C.59BASIC R:0.29195 P:0.17901 F:0.22194
59BASIC ROUGE-L Eval D0703-B.M.100.A-D.59BASIC R:0.29195 P:0.17901 F:0.22194
59BASIC ROUGE-L Eval D0703-B.M.100.A-J.59BASIC R:0.29236 P:0.18107 F:0.22363
59BASIC ROUGE-L Eval D0703-C.M.100.A-A.59BASIC R:0.25667 P:0.14751 F:0.18735
59BASIC ROUGE-L Eval D0703-C.M.100.A-C.59BASIC R:0.23377 P:0.13793 F:0.17349
59BASIC ROUGE-L Eval D0703-C.M.100.A-D.59BASIC R:0.22185 P:0.12835 F:0.16262
59BASIC ROUGE-L Eval D0703-C.M.100.A-J.59BASIC R:0.26821 P:0.15517 F:0.19660
59BASIC ROUGE-L Eval D0706-A.M.100.B-B.59BASIC R:0.25325 P:0.15205 F:0.19002
59BASIC ROUGE-L Eval D0706-A.M.100.B-D.59BASIC R:0.26471 P:0.15789 F:0.19780
59BASIC ROUGE-L Eval D0706-A.M.100.B-E.59BASIC R:0.25325 P:0.15205 F:0.19002
59BASIC ROUGE-L Eval D0706-A.M.100.B-I.59BASIC R:0.26299 P:0.15789 F:0.19732
59BASIC ROUGE-L Eval D0706-B.M.100.B-B.59BASIC R:0.30392 P:0.19136 F:0.23485
59BASIC ROUGE-L Eval D0706-B.M.100.B-D.59BASIC R:0.31596 P:0.19959 F:0.24464
59BASIC ROUGE-L Eval D0706-B.M.100.B-E.59BASIC R:0.27273 P:0.17284 F:0.21159
59BASIC ROUGE-L Eval D0706-B.M.100.B-I.59BASIC R:0.32686 P:0.20782 F:0.25409
59BASIC ROUGE-L Eval D0706-C.M.100.B-B.59BASIC R:0.23548 P:0.16331 F:0.19286
59BASIC ROUGE-L Eval D0706-C.M.100.B-D.59BASIC R:0.27419 P:0.19016 F:0.22457
59BASIC ROUGE-L Eval D0706-C.M.100.B-E.59BASIC R:0.25641 P:0.17897 F:0.21080
59BASIC ROUGE-L Eval D0706-C.M.100.B-I.59BASIC R:0.26518 P:0.18568 F:0.21842
59BASIC ROUGE-L Eval D0711-A.M.100.C-A.59BASIC R:0.31250 P:0.18095 F:0.22919
59BASIC ROUGE-L Eval D0711-A.M.100.C-B.59BASIC R:0.33667 P:0.19238 F:0.24485
59BASIC ROUGE-L Eval D0711-A.M.100.C-C.59BASIC R:0.30000 P:0.17143 F:0.21818
59BASIC ROUGE-L Eval D0711-A.M.100.C-F.59BASIC R:0.33444 P:0.19238 F:0.24426
59BASIC ROUGE-L Eval D0711-B.M.100.C-A.59BASIC R:0.30612 P:0.13453 F:0.18692
59BASIC ROUGE-L Eval D0711-B.M.100.C-B.59BASIC R:0.31164 P:0.13602 F:0.18938
59BASIC ROUGE-L Eval D0711-B.M.100.C-C.59BASIC R:0.28859 P:0.12855 F:0.17787
59BASIC ROUGE-L Eval D0711-B.M.100.C-F.59BASIC R:0.27458 P:0.12108 F:0.16805
59BASIC ROUGE-L Eval D0711-C.M.100.C-A.59BASIC R:0.32673 P:0.19412 F:0.24354
59BASIC ROUGE-L Eval D0711-C.M.100.C-B.59BASIC R:0.33106 P:0.19020 F:0.24160
59BASIC ROUGE-L Eval D0711-C.M.100.C-C.59BASIC R:0.33446 P:0.19412 F:0.24566
59BASIC ROUGE-L Eval D0711-C.M.100.C-F.59BASIC R:0.32095 P:0.18627 F:0.23573
59BASIC ROUGE-L Eval D0716-A.M.100.D-C.59BASIC R:0.28852 P:0.19556 F:0.23311
59BASIC ROUGE-L Eval D0716-A.M.100.D-D.59BASIC R:0.29333 P:0.19556 F:0.23467
59BASIC ROUGE-L Eval D0716-A.M.100.D-E.59BASIC R:0.30565 P:0.20444 F:0.24500
59BASIC ROUGE-L Eval D0716-A.M.100.D-F.59BASIC R:0.28383 P:0.19111 F:0.22842
59BASIC ROUGE-L Eval D0716-B.M.100.D-C.59BASIC R:0.34539 P:0.21605 F:0.26582
59BASIC ROUGE-L Eval D0716-B.M.100.D-D.59BASIC R:0.36913 P:0.22634 F:0.28061
59BASIC ROUGE-L Eval D0716-B.M.100.D-E.59BASIC R:0.31561 P:0.19547 F:0.24142
59BASIC ROUGE-L Eval D0716-B.M.100.D-F.59BASIC R:0.33667 P:0.20782 F:0.25700
59BASIC ROUGE-L Eval D0716-C.M.100.D-C.59BASIC R:0.39739 P:0.25259 F:0.30886
59BASIC ROUGE-L Eval D0716-C.M.100.D-D.59BASIC R:0.41472 P:0.25673 F:0.31714
59BASIC ROUGE-L Eval D0716-C.M.100.D-E.59BASIC R:0.40594 P:0.25466 F:0.31298
59BASIC ROUGE-L Eval D0716-C.M.100.D-F.59BASIC R:0.42000 P:0.26087 F:0.32184
59BASIC ROUGE-L Eval D0721-A.M.100.E-B.59BASIC R:0.27000 P:0.15789 F:0.19926
59BASIC ROUGE-L Eval D0721-A.M.100.E-C.59BASIC R:0.24675 P:0.14815 F:0.18514
59BASIC ROUGE-L Eval D0721-A.M.100.E-E.59BASIC R:0.25325 P:0.15205 F:0.19002
59BASIC ROUGE-L Eval D0721-A.M.100.E-G.59BASIC R:0.25478 P:0.15595 F:0.19347
59BASIC ROUGE-L Eval D0721-B.M.100.E-B.59BASIC R:0.28990 P:0.18427 F:0.22532
59BASIC ROUGE-L Eval D0721-B.M.100.E-C.59BASIC R:0.27707 P:0.18012 F:0.21832
59BASIC ROUGE-L Eval D0721-B.M.100.E-E.59BASIC R:0.29508 P:0.18634 F:0.22843
59BASIC ROUGE-L Eval D0721-B.M.100.E-G.59BASIC R:0.26452 P:0.16977 F:0.20681
59BASIC ROUGE-L Eval D0721-C.M.100.E-B.59BASIC R:0.38033 P:0.20677 F:0.26790
59BASIC ROUGE-L Eval D0721-C.M.100.E-C.59BASIC R:0.30363 P:0.16399 F:0.21296
59BASIC ROUGE-L Eval D0721-C.M.100.E-E.59BASIC R:0.35667 P:0.19073 F:0.24855
59BASIC ROUGE-L Eval D0721-C.M.100.E-G.59BASIC R:0.37134 P:0.20321 F:0.26268
59BASIC ROUGE-L Eval D0726-A.M.100.F-A.59BASIC R:0.27907 P:0.17500 F:0.21511
59BASIC ROUGE-L Eval D0726-A.M.100.F-E.59BASIC R:0.26000 P:0.16250 F:0.20000
59BASIC ROUGE-L Eval D0726-A.M.100.F-F.59BASIC R:0.26910 P:0.16875 F:0.20743
59BASIC ROUGE-L Eval D0726-A.M.100.F-G.59BASIC R:0.22924 P:0.14375 F:0.17670
59BASIC ROUGE-L Eval D0726-B.M.100.F-A.59BASIC R:0.29739 P:0.17739 F:0.22223
59BASIC ROUGE-L Eval D0726-B.M.100.F-E.59BASIC R:0.28239 P:0.16569 F:0.20884
59BASIC ROUGE-L Eval D0726-B.M.100.F-F.59BASIC R:0.26578 P:0.15595 F:0.19656
59BASIC ROUGE-L Eval D0726-B.M.100.F-G.59BASIC R:0.28289 P:0.16764 F:0.21052
59BASIC ROUGE-L Eval D0726-C.M.100.F-A.59BASIC R:0.26000 P:0.16993 F:0.20553
59BASIC ROUGE-L Eval D0726-C.M.100.F-E.59BASIC R:0.27273 P:0.17647 F:0.21429
59BASIC ROUGE-L Eval D0726-C.M.100.F-F.59BASIC R:0.25763 P:0.16558 F:0.20159
59BASIC ROUGE-L Eval D0726-C.M.100.F-G.59BASIC R:0.23279 P:0.15468 F:0.18586
59BASIC ROUGE-L Eval D0727-A.M.100.G-A.59BASIC R:0.41528 P:0.23946 F:0.30376
59BASIC ROUGE-L Eval D0727-A.M.100.G-F.59BASIC R:0.38816 P:0.22605 F:0.28571
59BASIC ROUGE-L Eval D0727-A.M.100.G-G.59BASIC R:0.36928 P:0.21648 F:0.27295
59BASIC ROUGE-L Eval D0727-A.M.100.G-H.59BASIC R:0.42763 P:0.24904 F:0.31477
59BASIC ROUGE-L Eval D0727-B.M.100.G-A.59BASIC R:0.29553 P:0.15751 F:0.20550
59BASIC ROUGE-L Eval D0727-B.M.100.G-F.59BASIC R:0.29545 P:0.16667 F:0.21312
59BASIC ROUGE-L Eval D0727-B.M.100.G-G.59BASIC R:0.26990 P:0.14286 F:0.18683
59BASIC ROUGE-L Eval D0727-B.M.100.G-H.59BASIC R:0.28866 P:0.15385 F:0.20072
59BASIC ROUGE-L Eval D0727-C.M.100.G-A.59BASIC R:0.26710 P:0.13805 F:0.18202
59BASIC ROUGE-L Eval D0727-C.M.100.G-F.59BASIC R:0.28956 P:0.14478 F:0.19304
59BASIC ROUGE-L Eval D0727-C.M.100.G-G.59BASIC R:0.28053 P:0.14310 F:0.18952
59BASIC ROUGE-L Eval D0727-C.M.100.G-H.59BASIC R:0.30068 P:0.14983 F:0.20000
59BASIC ROUGE-L Eval D0736-A.M.100.H-G.59BASIC R:0.32616 P:0.16759 F:0.22141
59BASIC ROUGE-L Eval D0736-A.M.100.H-H.59BASIC R:0.31022 P:0.15654 F:0.20808
59BASIC ROUGE-L Eval D0736-A.M.100.H-I.59BASIC R:0.33808 P:0.17495 F:0.23058
59BASIC ROUGE-L Eval D0736-A.M.100.H-J.59BASIC R:0.33007 P:0.18600 F:0.23793
59BASIC ROUGE-L Eval D0736-B.M.100.H-G.59BASIC R:0.18702 P:0.09552 F:0.12645
59BASIC ROUGE-L Eval D0736-B.M.100.H-H.59BASIC R:0.18182 P:0.08577 F:0.11656
59BASIC ROUGE-L Eval D0736-B.M.100.H-I.59BASIC R:0.18828 P:0.08772 F:0.11968
59BASIC ROUGE-L Eval D0736-B.M.100.H-J.59BASIC R:0.18881 P:0.10526 F:0.13517
59BASIC ROUGE-L Eval D0736-C.M.100.H-G.59BASIC R:0.26582 P:0.10048 F:0.14583
59BASIC ROUGE-L Eval D0736-C.M.100.H-H.59BASIC R:0.22995 P:0.06858 F:0.10565
59BASIC ROUGE-L Eval D0736-C.M.100.H-I.59BASIC R:0.28342 P:0.08453 F:0.13022
59BASIC ROUGE-L Eval D0736-C.M.100.H-J.59BASIC R:0.26038 P:0.11005 F:0.15471
59BASIC ROUGE-L Eval D0740-A.M.100.I-D.59BASIC R:0.33333 P:0.20911 F:0.25700
59BASIC ROUGE-L Eval D0740-A.M.100.I-H.59BASIC R:0.29412 P:0.18634 F:0.22814
59BASIC ROUGE-L Eval D0740-A.M.100.I-I.59BASIC R:0.30519 P:0.19462 F:0.23767
59BASIC ROUGE-L Eval D0740-A.M.100.I-J.59BASIC R:0.30000 P:0.19255 F:0.23455
59BASIC ROUGE-L Eval D0740-B.M.100.I-D.59BASIC R:0.28247 P:0.16959 F:0.21194
59BASIC ROUGE-L Eval D0740-B.M.100.I-H.59BASIC R:0.29139 P:0.17154 F:0.21595
59BASIC ROUGE-L Eval D0740-B.M.100.I-I.59BASIC R:0.30164 P:0.17934 F:0.22494
59BASIC ROUGE-L Eval D0740-B.M.100.I-J.59BASIC R:0.28155 P:0.16959 F:0.21168
59BASIC ROUGE-L Eval D0740-C.M.100.I-D.59BASIC R:0.18850 P:0.11434 F:0.14234
59BASIC ROUGE-L Eval D0740-C.M.100.I-H.59BASIC R:0.16720 P:0.10078 F:0.12576
59BASIC ROUGE-L Eval D0740-C.M.100.I-I.59BASIC R:0.17252 P:0.10465 F:0.13028
59BASIC ROUGE-L Eval D0740-C.M.100.I-J.59BASIC R:0.18153 P:0.11047 F:0.13735
59BASIC ROUGE-L Eval D0743-A.M.100.J-B.59BASIC R:0.23175 P:0.07074 F:0.10839
59BASIC ROUGE-L Eval D0743-A.M.100.J-H.59BASIC R:0.32407 P:0.10174 F:0.15486
59BASIC ROUGE-L Eval D0743-A.M.100.J-I.59BASIC R:0.32500 P:0.10078 F:0.15385
59BASIC ROUGE-L Eval D0743-A.M.100.J-J.59BASIC R:0.30462 P:0.09593 F:0.14591
59BASIC ROUGE-L Eval D0743-B.M.100.J-B.59BASIC R:0.28526 P:0.16856 F:0.21191
59BASIC ROUGE-L Eval D0743-B.M.100.J-H.59BASIC R:0.26814 P:0.16098 F:0.20118
59BASIC ROUGE-L Eval D0743-B.M.100.J-I.59BASIC R:0.31646 P:0.18939 F:0.23696
59BASIC ROUGE-L Eval D0743-B.M.100.J-J.59BASIC R:0.31464 P:0.19129 F:0.23793
59BASIC ROUGE-L Eval D0743-C.M.100.J-B.59BASIC R:0.30476 P:0.18182 F:0.22776
59BASIC ROUGE-L Eval D0743-C.M.100.J-H.59BASIC R:0.28981 P:0.17235 F:0.21615
59BASIC ROUGE-L Eval D0743-C.M.100.J-I.59BASIC R:0.30671 P:0.18182 F:0.22830
59BASIC ROUGE-L Eval D0743-C.M.100.J-J.59BASIC R:0.30818 P:0.18561 F:0.23168
---------------------------------------------
59BASIC ROUGE-W-1.2 Average_R: 0.10273 (95%-conf.int. 0.09942 - 0.10603)
59BASIC ROUGE-W-1.2 Average_P: 0.10686 (95%-conf.int. 0.10273 - 0.11134)
59BASIC ROUGE-W-1.2 Average_F: 0.10405 (95%-conf.int. 0.10046 - 0.10773)
.............................................
59BASIC ROUGE-W-1.2 Eval D0703-A.M.100.A-A.59BASIC R:0.09805 P:0.10820 F:0.10288
59BASIC ROUGE-W-1.2 Eval D0703-A.M.100.A-C.59BASIC R:0.08334 P:0.09345 F:0.08811
59BASIC ROUGE-W-1.2 Eval D0703-A.M.100.A-D.59BASIC R:0.09121 P:0.10131 F:0.09600
59BASIC ROUGE-W-1.2 Eval D0703-A.M.100.A-J.59BASIC R:0.10134 P:0.10552 F:0.10339
59BASIC ROUGE-W-1.2 Eval D0703-B.M.100.A-A.59BASIC R:0.10192 P:0.11898 F:0.10979
59BASIC ROUGE-W-1.2 Eval D0703-B.M.100.A-C.59BASIC R:0.09601 P:0.11140 F:0.10313
59BASIC ROUGE-W-1.2 Eval D0703-B.M.100.A-D.59BASIC R:0.10100 P:0.11616 F:0.10805
59BASIC ROUGE-W-1.2 Eval D0703-B.M.100.A-J.59BASIC R:0.10659 P:0.12244 F:0.11397
59BASIC ROUGE-W-1.2 Eval D0703-C.M.100.A-A.59BASIC R:0.08820 P:0.09425 F:0.09112
59BASIC ROUGE-W-1.2 Eval D0703-C.M.100.A-C.59BASIC R:0.07772 P:0.08659 F:0.08192
59BASIC ROUGE-W-1.2 Eval D0703-C.M.100.A-D.59BASIC R:0.07482 P:0.08216 F:0.07832
59BASIC ROUGE-W-1.2 Eval D0703-C.M.100.A-J.59BASIC R:0.09394 P:0.09789 F:0.09587
59BASIC ROUGE-W-1.2 Eval D0706-A.M.100.B-B.59BASIC R:0.09272 P:0.09990 F:0.09618
59BASIC ROUGE-W-1.2 Eval D0706-A.M.100.B-D.59BASIC R:0.09583 P:0.10489 F:0.10016
59BASIC ROUGE-W-1.2 Eval D0706-A.M.100.B-E.59BASIC R:0.08808 P:0.09590 F:0.09182
59BASIC ROUGE-W-1.2 Eval D0706-A.M.100.B-I.59BASIC R:0.09228 P:0.10267 F:0.09720
59BASIC ROUGE-W-1.2 Eval D0706-B.M.100.B-B.59BASIC R:0.10936 P:0.11925 F:0.11409
59BASIC ROUGE-W-1.2 Eval D0706-B.M.100.B-D.59BASIC R:0.11164 P:0.12436 F:0.11766
59BASIC ROUGE-W-1.2 Eval D0706-B.M.100.B-E.59BASIC R:0.09490 P:0.10616 F:0.10021
59BASIC ROUGE-W-1.2 Eval D0706-B.M.100.B-I.59BASIC R:0.11398 P:0.13105 F:0.12192
59BASIC ROUGE-W-1.2 Eval D0706-C.M.100.B-B.59BASIC R:0.08553 P:0.10124 F:0.09272
59BASIC ROUGE-W-1.2 Eval D0706-C.M.100.B-D.59BASIC R:0.08742 P:0.10437 F:0.09515
59BASIC ROUGE-W-1.2 Eval D0706-C.M.100.B-E.59BASIC R:0.08084 P:0.09558 F:0.08759
59BASIC ROUGE-W-1.2 Eval D0706-C.M.100.B-I.59BASIC R:0.08405 P:0.10221 F:0.09224
59BASIC ROUGE-W-1.2 Eval D0711-A.M.100.C-A.59BASIC R:0.10912 P:0.11392 F:0.11147
59BASIC ROUGE-W-1.2 Eval D0711-A.M.100.C-B.59BASIC R:0.11658 P:0.12066 F:0.11858
59BASIC ROUGE-W-1.2 Eval D0711-A.M.100.C-C.59BASIC R:0.09924 P:0.10183 F:0.10052
59BASIC ROUGE-W-1.2 Eval D0711-A.M.100.C-F.59BASIC R:0.11764 P:0.12276 F:0.12015
59BASIC ROUGE-W-1.2 Eval D0711-B.M.100.C-A.59BASIC R:0.11040 P:0.08656 F:0.09704
59BASIC ROUGE-W-1.2 Eval D0711-B.M.100.C-B.59BASIC R:0.10713 P:0.08763 F:0.09640
59BASIC ROUGE-W-1.2 Eval D0711-B.M.100.C-C.59BASIC R:0.09860 P:0.08251 F:0.08984
59BASIC ROUGE-W-1.2 Eval D0711-B.M.100.C-F.59BASIC R:0.09520 P:0.07797 F:0.08573
59BASIC ROUGE-W-1.2 Eval D0711-C.M.100.C-A.59BASIC R:0.11371 P:0.12630 F:0.11967
59BASIC ROUGE-W-1.2 Eval D0711-C.M.100.C-B.59BASIC R:0.11264 P:0.12101 F:0.11668
59BASIC ROUGE-W-1.2 Eval D0711-C.M.100.C-C.59BASIC R:0.11010 P:0.12133 F:0.11544
59BASIC ROUGE-W-1.2 Eval D0711-C.M.100.C-F.59BASIC R:0.10734 P:0.12007 F:0.11335
59BASIC ROUGE-W-1.2 Eval D0716-A.M.100.D-C.59BASIC R:0.09731 P:0.12049 F:0.10767
59BASIC ROUGE-W-1.2 Eval D0716-A.M.100.D-D.59BASIC R:0.09465 P:0.12022 F:0.10591
59BASIC ROUGE-W-1.2 Eval D0716-A.M.100.D-E.59BASIC R:0.10216 P:0.12761 F:0.11348
59BASIC ROUGE-W-1.2 Eval D0716-A.M.100.D-F.59BASIC R:0.09144 P:0.11708 F:0.10268
59BASIC ROUGE-W-1.2 Eval D0716-B.M.100.D-C.59BASIC R:0.12444 P:0.13578 F:0.12986
59BASIC ROUGE-W-1.2 Eval D0716-B.M.100.D-D.59BASIC R:0.12821 P:0.14068 F:0.13416
59BASIC ROUGE-W-1.2 Eval D0716-B.M.100.D-E.59BASIC R:0.10977 P:0.12103 F:0.11513
59BASIC ROUGE-W-1.2 Eval D0716-B.M.100.D-F.59BASIC R:0.12259 P:0.13394 F:0.12801
59BASIC ROUGE-W-1.2 Eval D0716-C.M.100.D-C.59BASIC R:0.13390 P:0.15864 F:0.14522
59BASIC ROUGE-W-1.2 Eval D0716-C.M.100.D-D.59BASIC R:0.13687 P:0.16431 F:0.14934
59BASIC ROUGE-W-1.2 Eval D0716-C.M.100.D-E.59BASIC R:0.14283 P:0.17365 F:0.15674
59BASIC ROUGE-W-1.2 Eval D0716-C.M.100.D-F.59BASIC R:0.14097 P:0.17033 F:0.15427
59BASIC ROUGE-W-1.2 Eval D0721-A.M.100.E-B.59BASIC R:0.09667 P:0.09937 F:0.09800
59BASIC ROUGE-W-1.2 Eval D0721-A.M.100.E-C.59BASIC R:0.08791 P:0.09364 F:0.09068
59BASIC ROUGE-W-1.2 Eval D0721-A.M.100.E-E.59BASIC R:0.08860 P:0.09555 F:0.09194
59BASIC ROUGE-W-1.2 Eval D0721-A.M.100.E-G.59BASIC R:0.09190 P:0.09858 F:0.09512
59BASIC ROUGE-W-1.2 Eval D0721-B.M.100.E-B.59BASIC R:0.09543 P:0.11726 F:0.10522
59BASIC ROUGE-W-1.2 Eval D0721-B.M.100.E-C.59BASIC R:0.09263 P:0.11318 F:0.10188
59BASIC ROUGE-W-1.2 Eval D0721-B.M.100.E-E.59BASIC R:0.09795 P:0.12140 F:0.10842
59BASIC ROUGE-W-1.2 Eval D0721-B.M.100.E-G.59BASIC R:0.08269 P:0.10592 F:0.09287
59BASIC ROUGE-W-1.2 Eval D0721-C.M.100.E-B.59BASIC R:0.14684 P:0.14694 F:0.14689
59BASIC ROUGE-W-1.2 Eval D0721-C.M.100.E-C.59BASIC R:0.11262 P:0.11444 F:0.11352
59BASIC ROUGE-W-1.2 Eval D0721-C.M.100.E-E.59BASIC R:0.14295 P:0.14267 F:0.14281
59BASIC ROUGE-W-1.2 Eval D0721-C.M.100.E-G.59BASIC R:0.14312 P:0.14646 F:0.14477
59BASIC ROUGE-W-1.2 Eval D0726-A.M.100.F-A.59BASIC R:0.10205 P:0.11340 F:0.10743
59BASIC ROUGE-W-1.2 Eval D0726-A.M.100.F-E.59BASIC R:0.09665 P:0.10583 F:0.10103
59BASIC ROUGE-W-1.2 Eval D0726-A.M.100.F-F.59BASIC R:0.09703 P:0.10838 F:0.10239
59BASIC ROUGE-W-1.2 Eval D0726-A.M.100.F-G.59BASIC R:0.07831 P:0.08889 F:0.08327
59BASIC ROUGE-W-1.2 Eval D0726-B.M.100.F-A.59BASIC R:0.11178 P:0.11728 F:0.11446
59BASIC ROUGE-W-1.2 Eval D0726-B.M.100.F-E.59BASIC R:0.10356 P:0.10969 F:0.10654
59BASIC ROUGE-W-1.2 Eval D0726-B.M.100.F-F.59BASIC R:0.09654 P:0.10292 F:0.09963
59BASIC ROUGE-W-1.2 Eval D0726-B.M.100.F-G.59BASIC R:0.09819 P:0.10506 F:0.10151
59BASIC ROUGE-W-1.2 Eval D0726-C.M.100.F-A.59BASIC R:0.09255 P:0.10622 F:0.09891
59BASIC ROUGE-W-1.2 Eval D0726-C.M.100.F-E.59BASIC R:0.09808 P:0.11201 F:0.10458
59BASIC ROUGE-W-1.2 Eval D0726-C.M.100.F-F.59BASIC R:0.09164 P:0.10548 F:0.09807
59BASIC ROUGE-W-1.2 Eval D0726-C.M.100.F-G.59BASIC R:0.08113 P:0.09652 F:0.08816
59BASIC ROUGE-W-1.2 Eval D0727-A.M.100.G-A.59BASIC R:0.15230 P:0.15458 F:0.15343
59BASIC ROUGE-W-1.2 Eval D0727-A.M.100.G-F.59BASIC R:0.13918 P:0.14795 F:0.14343
59BASIC ROUGE-W-1.2 Eval D0727-A.M.100.G-G.59BASIC R:0.13117 P:0.13618 F:0.13363
59BASIC ROUGE-W-1.2 Eval D0727-A.M.100.G-H.59BASIC R:0.15430 P:0.16108 F:0.15762
59BASIC ROUGE-W-1.2 Eval D0727-B.M.100.G-A.59BASIC R:0.10472 P:0.09793 F:0.10121
59BASIC ROUGE-W-1.2 Eval D0727-B.M.100.G-F.59BASIC R:0.10359 P:0.10497 F:0.10428
59BASIC ROUGE-W-1.2 Eval D0727-B.M.100.G-G.59BASIC R:0.09897 P:0.09383 F:0.09633
59BASIC ROUGE-W-1.2 Eval D0727-B.M.100.G-H.59BASIC R:0.10566 P:0.09967 F:0.10258
59BASIC ROUGE-W-1.2 Eval D0727-C.M.100.G-A.59BASIC R:0.09321 P:0.08664 F:0.08980
59BASIC ROUGE-W-1.2 Eval D0727-C.M.100.G-F.59BASIC R:0.09892 P:0.09141 F:0.09502
59BASIC ROUGE-W-1.2 Eval D0727-C.M.100.G-G.59BASIC R:0.09629 P:0.09041 F:0.09326
59BASIC ROUGE-W-1.2 Eval D0727-C.M.100.G-H.59BASIC R:0.10558 P:0.09469 F:0.09984
59BASIC ROUGE-W-1.2 Eval D0736-A.M.100.H-G.59BASIC R:0.11920 P:0.10846 F:0.11358
59BASIC ROUGE-W-1.2 Eval D0736-A.M.100.H-H.59BASIC R:0.11131 P:0.09877 F:0.10467
59BASIC ROUGE-W-1.2 Eval D0736-A.M.100.H-I.59BASIC R:0.12089 P:0.11178 F:0.11616
59BASIC ROUGE-W-1.2 Eval D0736-A.M.100.H-J.59BASIC R:0.11580 P:0.11634 F:0.11607
59BASIC ROUGE-W-1.2 Eval D0736-B.M.100.H-G.59BASIC R:0.06756 P:0.06387 F:0.06566
59BASIC ROUGE-W-1.2 Eval D0736-B.M.100.H-H.59BASIC R:0.06737 P:0.05879 F:0.06279
59BASIC ROUGE-W-1.2 Eval D0736-B.M.100.H-I.59BASIC R:0.06916 P:0.05951 F:0.06397
59BASIC ROUGE-W-1.2 Eval D0736-B.M.100.H-J.59BASIC R:0.06724 P:0.06930 F:0.06825
59BASIC ROUGE-W-1.2 Eval D0736-C.M.100.H-G.59BASIC R:0.09850 P:0.06763 F:0.08020
59BASIC ROUGE-W-1.2 Eval D0736-C.M.100.H-H.59BASIC R:0.08586 P:0.04786 F:0.06146
59BASIC ROUGE-W-1.2 Eval D0736-C.M.100.H-I.59BASIC R:0.10845 P:0.05901 F:0.07643
59BASIC ROUGE-W-1.2 Eval D0736-C.M.100.H-J.59BASIC R:0.09485 P:0.07152 F:0.08155
59BASIC ROUGE-W-1.2 Eval D0740-A.M.100.I-D.59BASIC R:0.11536 P:0.13312 F:0.12361
59BASIC ROUGE-W-1.2 Eval D0740-A.M.100.I-H.59BASIC R:0.10369 P:0.11851 F:0.11061
59BASIC ROUGE-W-1.2 Eval D0740-A.M.100.I-I.59BASIC R:0.10548 P:0.12441 F:0.11417
59BASIC ROUGE-W-1.2 Eval D0740-A.M.100.I-J.59BASIC R:0.10271 P:0.12110 F:0.11115
59BASIC ROUGE-W-1.2 Eval D0740-B.M.100.I-D.59BASIC R:0.09932 P:0.10956 F:0.10419
59BASIC ROUGE-W-1.2 Eval D0740-B.M.100.I-H.59BASIC R:0.10781 P:0.11294 F:0.11032
59BASIC ROUGE-W-1.2 Eval D0740-B.M.100.I-I.59BASIC R:0.10478 P:0.11706 F:0.11058
59BASIC ROUGE-W-1.2 Eval D0740-B.M.100.I-J.59BASIC R:0.10138 P:0.10917 F:0.10513
59BASIC ROUGE-W-1.2 Eval D0740-C.M.100.I-D.59BASIC R:0.06194 P:0.07251 F:0.06681
59BASIC ROUGE-W-1.2 Eval D0740-C.M.100.I-H.59BASIC R:0.05781 P:0.06502 F:0.06120
59BASIC ROUGE-W-1.2 Eval D0740-C.M.100.I-I.59BASIC R:0.05649 P:0.06701 F:0.06130
59BASIC ROUGE-W-1.2 Eval D0740-C.M.100.I-J.59BASIC R:0.05975 P:0.06968 F:0.06433
59BASIC ROUGE-W-1.2 Eval D0743-A.M.100.J-B.59BASIC R:0.09251 P:0.04922 F:0.06425
59BASIC ROUGE-W-1.2 Eval D0743-A.M.100.J-H.59BASIC R:0.12499 P:0.06779 F:0.08790
59BASIC ROUGE-W-1.2 Eval D0743-A.M.100.J-I.59BASIC R:0.12074 P:0.06643 F:0.08571
59BASIC ROUGE-W-1.2 Eval D0743-A.M.100.J-J.59BASIC R:0.11410 P:0.06238 F:0.08066
59BASIC ROUGE-W-1.2 Eval D0743-B.M.100.J-B.59BASIC R:0.11104 P:0.10988 F:0.11046
59BASIC ROUGE-W-1.2 Eval D0743-B.M.100.J-H.59BASIC R:0.10281 P:0.10237 F:0.10259
59BASIC ROUGE-W-1.2 Eval D0743-B.M.100.J-I.59BASIC R:0.12394 P:0.12501 F:0.12447
59BASIC ROUGE-W-1.2 Eval D0743-B.M.100.J-J.59BASIC R:0.12456 P:0.12450 F:0.12453
59BASIC ROUGE-W-1.2 Eval D0743-C.M.100.J-B.59BASIC R:0.10827 P:0.11307 F:0.11062
59BASIC ROUGE-W-1.2 Eval D0743-C.M.100.J-H.59BASIC R:0.10839 P:0.10764 F:0.10801
59BASIC ROUGE-W-1.2 Eval D0743-C.M.100.J-I.59BASIC R:0.10648 P:0.11248 F:0.10940
59BASIC ROUGE-W-1.2 Eval D0743-C.M.100.J-J.59BASIC R:0.11199 P:0.11353 F:0.11275
---------------------------------------------
59BASIC ROUGE-SU4 Average_R: 0.10681 (95%-conf.int. 0.10099 - 0.11307)
59BASIC ROUGE-SU4 Average_P: 0.06113 (95%-conf.int. 0.05737 - 0.06526)
59BASIC ROUGE-SU4 Average_F: 0.07738 (95%-conf.int. 0.07276 - 0.08240)
.............................................
59BASIC ROUGE-SU4 Eval D0703-A.M.100.A-A.59BASIC R:0.09433 P:0.05719 F:0.07121
59BASIC ROUGE-SU4 Eval D0703-A.M.100.A-C.59BASIC R:0.08103 P:0.04947 F:0.06143
59BASIC ROUGE-SU4 Eval D0703-A.M.100.A-D.59BASIC R:0.08009 P:0.04772 F:0.05981
59BASIC ROUGE-SU4 Eval D0703-A.M.100.A-J.59BASIC R:0.09674 P:0.05825 F:0.07272
59BASIC ROUGE-SU4 Eval D0703-B.M.100.A-A.59BASIC R:0.12025 P:0.07497 F:0.09236
59BASIC ROUGE-SU4 Eval D0703-B.M.100.A-C.59BASIC R:0.10287 P:0.06241 F:0.07769
59BASIC ROUGE-SU4 Eval D0703-B.M.100.A-D.59BASIC R:0.12241 P:0.07427 F:0.09245
59BASIC ROUGE-SU4 Eval D0703-B.M.100.A-J.59BASIC R:0.12400 P:0.07601 F:0.09425
59BASIC ROUGE-SU4 Eval D0703-C.M.100.A-A.59BASIC R:0.08619 P:0.04896 F:0.06245
59BASIC ROUGE-SU4 Eval D0703-C.M.100.A-C.59BASIC R:0.07611 P:0.04442 F:0.05610
59BASIC ROUGE-SU4 Eval D0703-C.M.100.A-D.59BASIC R:0.07143 P:0.04086 F:0.05198
59BASIC ROUGE-SU4 Eval D0703-C.M.100.A-J.59BASIC R:0.09354 P:0.05350 F:0.06807
59BASIC ROUGE-SU4 Eval D0706-A.M.100.B-B.59BASIC R:0.09667 P:0.05743 F:0.07205
59BASIC ROUGE-SU4 Eval D0706-A.M.100.B-D.59BASIC R:0.10403 P:0.06139 F:0.07721
59BASIC ROUGE-SU4 Eval D0706-A.M.100.B-E.59BASIC R:0.08889 P:0.05281 F:0.06626
59BASIC ROUGE-SU4 Eval D0706-A.M.100.B-I.59BASIC R:0.09778 P:0.05809 F:0.07288
59BASIC ROUGE-SU4 Eval D0706-B.M.100.B-B.59BASIC R:0.11633 P:0.07252 F:0.08934
59BASIC ROUGE-SU4 Eval D0706-B.M.100.B-D.59BASIC R:0.11929 P:0.07462 F:0.09181
59BASIC ROUGE-SU4 Eval D0706-B.M.100.B-E.59BASIC R:0.08833 P:0.05544 F:0.06812
59BASIC ROUGE-SU4 Eval D0706-B.M.100.B-I.59BASIC R:0.12348 P:0.07775 F:0.09542
59BASIC ROUGE-SU4 Eval D0706-C.M.100.B-B.59BASIC R:0.07009 P:0.04822 F:0.05713
59BASIC ROUGE-SU4 Eval D0706-C.M.100.B-D.59BASIC R:0.09768 P:0.06720 F:0.07962
59BASIC ROUGE-SU4 Eval D0706-C.M.100.B-E.59BASIC R:0.08882 P:0.06150 F:0.07268
59BASIC ROUGE-SU4 Eval D0706-C.M.100.B-I.59BASIC R:0.09290 P:0.06454 F:0.07617
59BASIC ROUGE-SU4 Eval D0711-A.M.100.C-A.59BASIC R:0.12725 P:0.07286 F:0.09266
59BASIC ROUGE-SU4 Eval D0711-A.M.100.C-B.59BASIC R:0.13470 P:0.07608 F:0.09724
59BASIC ROUGE-SU4 Eval D0711-A.M.100.C-C.59BASIC R:0.09989 P:0.05642 F:0.07211
59BASIC ROUGE-SU4 Eval D0711-A.M.100.C-F.59BASIC R:0.13379 P:0.07608 F:0.09700
59BASIC ROUGE-SU4 Eval D0711-B.M.100.C-A.59BASIC R:0.11946 P:0.05169 F:0.07216
59BASIC ROUGE-SU4 Eval D0711-B.M.100.C-B.59BASIC R:0.12676 P:0.05446 F:0.07619
59BASIC ROUGE-SU4 Eval D0711-B.M.100.C-C.59BASIC R:0.11322 P:0.04967 F:0.06905
59BASIC ROUGE-SU4 Eval D0711-B.M.100.C-F.59BASIC R:0.09756 P:0.04236 F:0.05907
59BASIC ROUGE-SU4 Eval D0711-C.M.100.C-A.59BASIC R:0.12655 P:0.07437 F:0.09368
59BASIC ROUGE-SU4 Eval D0711-C.M.100.C-B.59BASIC R:0.13216 P:0.07503 F:0.09572
59BASIC ROUGE-SU4 Eval D0711-C.M.100.C-C.59BASIC R:0.12731 P:0.07304 F:0.09282
59BASIC ROUGE-SU4 Eval D0711-C.M.100.C-F.59BASIC R:0.12789 P:0.07337 F:0.09325
59BASIC ROUGE-SU4 Eval D0716-A.M.100.D-C.59BASIC R:0.11841 P:0.07956 F:0.09517
59BASIC ROUGE-SU4 Eval D0716-A.M.100.D-D.59BASIC R:0.12215 P:0.08069 F:0.09718
59BASIC ROUGE-SU4 Eval D0716-A.M.100.D-E.59BASIC R:0.13026 P:0.08635 F:0.10385
59BASIC ROUGE-SU4 Eval D0716-A.M.100.D-F.59BASIC R:0.11356 P:0.07579 F:0.09091
59BASIC ROUGE-SU4 Eval D0716-B.M.100.D-C.59BASIC R:0.14865 P:0.09205 F:0.11370
59BASIC ROUGE-SU4 Eval D0716-B.M.100.D-D.59BASIC R:0.15230 P:0.09240 F:0.11502
59BASIC ROUGE-SU4 Eval D0716-B.M.100.D-E.59BASIC R:0.11889 P:0.07287 F:0.09036
59BASIC ROUGE-SU4 Eval D0716-B.M.100.D-F.59BASIC R:0.14726 P:0.08996 F:0.11169
59BASIC ROUGE-SU4 Eval D0716-C.M.100.D-C.59BASIC R:0.18896 P:0.11895 F:0.14600
59BASIC ROUGE-SU4 Eval D0716-C.M.100.D-D.59BASIC R:0.21249 P:0.13018 F:0.16145
59BASIC ROUGE-SU4 Eval D0716-C.M.100.D-E.59BASIC R:0.19605 P:0.12175 F:0.15021
59BASIC ROUGE-SU4 Eval D0716-C.M.100.D-F.59BASIC R:0.21518 P:0.13228 F:0.16384
59BASIC ROUGE-SU4 Eval D0721-A.M.100.E-B.59BASIC R:0.08447 P:0.04884 F:0.06189
59BASIC ROUGE-SU4 Eval D0721-A.M.100.E-C.59BASIC R:0.07556 P:0.04488 F:0.05631
59BASIC ROUGE-SU4 Eval D0721-A.M.100.E-E.59BASIC R:0.07500 P:0.04455 F:0.05590
59BASIC ROUGE-SU4 Eval D0721-A.M.100.E-G.59BASIC R:0.07407 P:0.04488 F:0.05589
59BASIC ROUGE-SU4 Eval D0721-B.M.100.E-B.59BASIC R:0.10535 P:0.06632 F:0.08140
59BASIC ROUGE-SU4 Eval D0721-B.M.100.E-C.59BASIC R:0.09423 P:0.06070 F:0.07384
59BASIC ROUGE-SU4 Eval D0721-B.M.100.E-E.59BASIC R:0.10325 P:0.06456 F:0.07944
59BASIC ROUGE-SU4 Eval D0721-B.M.100.E-G.59BASIC R:0.08775 P:0.05579 F:0.06821
59BASIC ROUGE-SU4 Eval D0721-C.M.100.E-B.59BASIC R:0.19136 P:0.10277 F:0.13372
59BASIC ROUGE-SU4 Eval D0721-C.M.100.E-C.59BASIC R:0.13559 P:0.07233 F:0.09434
59BASIC ROUGE-SU4 Eval D0721-C.M.100.E-E.59BASIC R:0.19292 P:0.10187 F:0.13333
59BASIC ROUGE-SU4 Eval D0721-C.M.100.E-G.59BASIC R:0.19509 P:0.10549 F:0.13694
59BASIC ROUGE-SU4 Eval D0726-A.M.100.F-A.59BASIC R:0.09386 P:0.05826 F:0.07189
59BASIC ROUGE-SU4 Eval D0726-A.M.100.F-E.59BASIC R:0.08790 P:0.05438 F:0.06719
59BASIC ROUGE-SU4 Eval D0726-A.M.100.F-F.59BASIC R:0.09386 P:0.05826 F:0.07189
59BASIC ROUGE-SU4 Eval D0726-A.M.100.F-G.59BASIC R:0.07110 P:0.04414 F:0.05447
59BASIC ROUGE-SU4 Eval D0726-B.M.100.F-A.59BASIC R:0.10459 P:0.06172 F:0.07763
59BASIC ROUGE-SU4 Eval D0726-B.M.100.F-E.59BASIC R:0.10125 P:0.05875 F:0.07436
59BASIC ROUGE-SU4 Eval D0726-B.M.100.F-F.59BASIC R:0.09499 P:0.05512 F:0.06976
59BASIC ROUGE-SU4 Eval D0726-B.M.100.F-G.59BASIC R:0.09403 P:0.05512 F:0.06950
59BASIC ROUGE-SU4 Eval D0726-C.M.100.F-A.59BASIC R:0.08847 P:0.05728 F:0.06954
59BASIC ROUGE-SU4 Eval D0726-C.M.100.F-E.59BASIC R:0.08766 P:0.05617 F:0.06847
59BASIC ROUGE-SU4 Eval D0726-C.M.100.F-F.59BASIC R:0.08188 P:0.05211 F:0.06369
59BASIC ROUGE-SU4 Eval D0726-C.M.100.F-G.59BASIC R:0.07183 P:0.04730 F:0.05704
59BASIC ROUGE-SU4 Eval D0727-A.M.100.G-A.59BASIC R:0.19568 P:0.11154 F:0.14209
59BASIC ROUGE-SU4 Eval D0727-A.M.100.G-F.59BASIC R:0.18863 P:0.10863 F:0.13787
59BASIC ROUGE-SU4 Eval D0727-A.M.100.G-G.59BASIC R:0.14485 P:0.08398 F:0.10632
59BASIC ROUGE-SU4 Eval D0727-A.M.100.G-H.59BASIC R:0.20664 P:0.11900 F:0.15103
59BASIC ROUGE-SU4 Eval D0727-B.M.100.G-A.59BASIC R:0.08775 P:0.04616 F:0.06050
59BASIC ROUGE-SU4 Eval D0727-B.M.100.G-F.59BASIC R:0.09556 P:0.05328 F:0.06841
59BASIC ROUGE-SU4 Eval D0727-B.M.100.G-G.59BASIC R:0.08185 P:0.04275 F:0.05617
59BASIC ROUGE-SU4 Eval D0727-B.M.100.G-H.59BASIC R:0.09187 P:0.04833 F:0.06334
59BASIC ROUGE-SU4 Eval D0727-C.M.100.G-A.59BASIC R:0.08417 P:0.04295 F:0.05688
59BASIC ROUGE-SU4 Eval D0727-C.M.100.G-F.59BASIC R:0.09343 P:0.04608 F:0.06172
59BASIC ROUGE-SU4 Eval D0727-C.M.100.G-G.59BASIC R:0.09040 P:0.04551 F:0.06054
59BASIC ROUGE-SU4 Eval D0727-C.M.100.G-H.59BASIC R:0.09259 P:0.04551 F:0.06102
59BASIC ROUGE-SU4 Eval D0736-A.M.100.H-G.59BASIC R:0.10947 P:0.05545 F:0.07361
59BASIC ROUGE-SU4 Eval D0736-A.M.100.H-H.59BASIC R:0.09774 P:0.04860 F:0.06492
59BASIC ROUGE-SU4 Eval D0736-A.M.100.H-I.59BASIC R:0.10806 P:0.05514 F:0.07302
59BASIC ROUGE-SU4 Eval D0736-A.M.100.H-J.59BASIC R:0.10850 P:0.06044 F:0.07763
59BASIC ROUGE-SU4 Eval D0736-B.M.100.H-G.59BASIC R:0.06299 P:0.03168 F:0.04216
59BASIC ROUGE-SU4 Eval D0736-B.M.100.H-H.59BASIC R:0.05342 P:0.02475 F:0.03383
59BASIC ROUGE-SU4 Eval D0736-B.M.100.H-I.59BASIC R:0.06494 P:0.02970 F:0.04076
59BASIC ROUGE-SU4 Eval D0736-B.M.100.H-J.59BASIC R:0.06115 P:0.03366 F:0.04342
59BASIC ROUGE-SU4 Eval D0736-C.M.100.H-G.59BASIC R:0.08370 P:0.03096 F:0.04520
59BASIC ROUGE-SU4 Eval D0736-C.M.100.H-H.59BASIC R:0.06518 P:0.01885 F:0.02924
59BASIC ROUGE-SU4 Eval D0736-C.M.100.H-I.59BASIC R:0.09032 P:0.02612 F:0.04052
59BASIC ROUGE-SU4 Eval D0736-C.M.100.H-J.59BASIC R:0.07782 P:0.03231 F:0.04566
59BASIC ROUGE-SU4 Eval D0740-A.M.100.I-D.59BASIC R:0.12147 P:0.07544 F:0.09307
59BASIC ROUGE-SU4 Eval D0740-A.M.100.I-H.59BASIC R:0.10570 P:0.06632 F:0.08150
59BASIC ROUGE-SU4 Eval D0740-A.M.100.I-I.59BASIC R:0.11389 P:0.07193 F:0.08817
59BASIC ROUGE-SU4 Eval D0740-A.M.100.I-J.59BASIC R:0.10596 P:0.06737 F:0.08237
59BASIC ROUGE-SU4 Eval D0740-B.M.100.I-D.59BASIC R:0.09833 P:0.05842 F:0.07329
59BASIC ROUGE-SU4 Eval D0740-B.M.100.I-H.59BASIC R:0.10034 P:0.05842 F:0.07385
59BASIC ROUGE-SU4 Eval D0740-B.M.100.I-I.59BASIC R:0.11167 P:0.06568 F:0.08271
59BASIC ROUGE-SU4 Eval D0740-B.M.100.I-J.59BASIC R:0.09413 P:0.05611 F:0.07031
59BASIC ROUGE-SU4 Eval D0740-C.M.100.I-D.59BASIC R:0.05301 P:0.03182 F:0.03977
59BASIC ROUGE-SU4 Eval D0740-C.M.100.I-H.59BASIC R:0.04895 P:0.02920 F:0.03658
59BASIC ROUGE-SU4 Eval D0740-C.M.100.I-I.59BASIC R:0.05191 P:0.03117 F:0.03895
59BASIC ROUGE-SU4 Eval D0740-C.M.100.I-J.59BASIC R:0.05120 P:0.03084 F:0.03849
59BASIC ROUGE-SU4 Eval D0743-A.M.100.J-B.59BASIC R:0.06786 P:0.02035 F:0.03131
59BASIC ROUGE-SU4 Eval D0743-A.M.100.J-H.59BASIC R:0.10232 P:0.03158 F:0.04826
59BASIC ROUGE-SU4 Eval D0743-A.M.100.J-I.59BASIC R:0.10310 P:0.03141 F:0.04815
59BASIC ROUGE-SU4 Eval D0743-A.M.100.J-J.59BASIC R:0.09516 P:0.02946 F:0.04499
59BASIC ROUGE-SU4 Eval D0743-B.M.100.J-B.59BASIC R:0.09923 P:0.05801 F:0.07322
59BASIC ROUGE-SU4 Eval D0743-B.M.100.J-H.59BASIC R:0.08306 P:0.04936 F:0.06192
59BASIC ROUGE-SU4 Eval D0743-B.M.100.J-I.59BASIC R:0.11310 P:0.06699 F:0.08414
59BASIC ROUGE-SU4 Eval D0743-B.M.100.J-J.59BASIC R:0.11129 P:0.06699 F:0.08364
59BASIC ROUGE-SU4 Eval D0743-C.M.100.J-B.59BASIC R:0.11075 P:0.06538 F:0.08222
59BASIC ROUGE-SU4 Eval D0743-C.M.100.J-H.59BASIC R:0.09314 P:0.05481 F:0.06901
59BASIC ROUGE-SU4 Eval D0743-C.M.100.J-I.59BASIC R:0.10874 P:0.06378 F:0.08040
59BASIC ROUGE-SU4 Eval D0743-C.M.100.J-J.59BASIC R:0.09462 P:0.05641 F:0.07068
---------------------------------------------
59CENTROID ROUGE-1 Average_R: 0.34693 (95%-conf.int. 0.33768 - 0.35567)
59CENTROID ROUGE-1 Average_P: 0.21061 (95%-conf.int. 0.20379 - 0.21714)
59CENTROID ROUGE-1 Average_F: 0.26129 (95%-conf.int. 0.25334 - 0.26847)
.............................................
59CENTROID ROUGE-1 Eval D0703-A.M.100.A-A.59CENTROID R:0.32432 P:0.20253 F:0.24935
59CENTROID ROUGE-1 Eval D0703-A.M.100.A-C.59CENTROID R:0.27852 P:0.17511 F:0.21503
59CENTROID ROUGE-1 Eval D0703-A.M.100.A-D.59CENTROID R:0.30584 P:0.18776 F:0.23268
59CENTROID ROUGE-1 Eval D0703-A.M.100.A-J.59CENTROID R:0.30272 P:0.18776 F:0.23177
59CENTROID ROUGE-1 Eval D0703-B.M.100.A-A.59CENTROID R:0.38889 P:0.26269 F:0.31357
59CENTROID ROUGE-1 Eval D0703-B.M.100.A-C.59CENTROID R:0.39262 P:0.25828 F:0.31159
59CENTROID ROUGE-1 Eval D0703-B.M.100.A-D.59CENTROID R:0.37584 P:0.24724 F:0.29827
59CENTROID ROUGE-1 Eval D0703-B.M.100.A-J.59CENTROID R:0.36877 P:0.24503 F:0.29443
59CENTROID ROUGE-1 Eval D0703-C.M.100.A-A.59CENTROID R:0.36667 P:0.22917 F:0.28205
59CENTROID ROUGE-1 Eval D0703-C.M.100.A-C.59CENTROID R:0.31494 P:0.20208 F:0.24619
59CENTROID ROUGE-1 Eval D0703-C.M.100.A-D.59CENTROID R:0.35430 P:0.22292 F:0.27366
59CENTROID ROUGE-1 Eval D0703-C.M.100.A-J.59CENTROID R:0.39073 P:0.24583 F:0.30179
59CENTROID ROUGE-1 Eval D0706-A.M.100.B-B.59CENTROID R:0.37013 P:0.21965 F:0.27569
59CENTROID ROUGE-1 Eval D0706-A.M.100.B-D.59CENTROID R:0.35294 P:0.20809 F:0.26182
59CENTROID ROUGE-1 Eval D0706-A.M.100.B-E.59CENTROID R:0.36688 P:0.21773 F:0.27328
59CENTROID ROUGE-1 Eval D0706-A.M.100.B-I.59CENTROID R:0.36364 P:0.21580 F:0.27086
59CENTROID ROUGE-1 Eval D0706-B.M.100.B-B.59CENTROID R:0.32353 P:0.19186 F:0.24088
59CENTROID ROUGE-1 Eval D0706-B.M.100.B-D.59CENTROID R:0.34202 P:0.20349 F:0.25517
59CENTROID ROUGE-1 Eval D0706-B.M.100.B-E.59CENTROID R:0.31494 P:0.18798 F:0.23543
59CENTROID ROUGE-1 Eval D0706-B.M.100.B-I.59CENTROID R:0.35599 P:0.21318 F:0.26667
59CENTROID ROUGE-1 Eval D0706-C.M.100.B-B.59CENTROID R:0.36774 P:0.25166 F:0.29882
59CENTROID ROUGE-1 Eval D0706-C.M.100.B-D.59CENTROID R:0.35806 P:0.24503 F:0.29095
59CENTROID ROUGE-1 Eval D0706-C.M.100.B-E.59CENTROID R:0.36538 P:0.25166 F:0.29804
59CENTROID ROUGE-1 Eval D0706-C.M.100.B-I.59CENTROID R:0.36422 P:0.25166 F:0.29765
59CENTROID ROUGE-1 Eval D0711-A.M.100.C-A.59CENTROID R:0.36184 P:0.24609 F:0.29295
59CENTROID ROUGE-1 Eval D0711-A.M.100.C-B.59CENTROID R:0.32667 P:0.21924 F:0.26238
59CENTROID ROUGE-1 Eval D0711-A.M.100.C-C.59CENTROID R:0.31000 P:0.20805 F:0.24899
59CENTROID ROUGE-1 Eval D0711-A.M.100.C-F.59CENTROID R:0.31457 P:0.21253 F:0.25367
59CENTROID ROUGE-1 Eval D0711-B.M.100.C-A.59CENTROID R:0.29932 P:0.18449 F:0.22828
59CENTROID ROUGE-1 Eval D0711-B.M.100.C-B.59CENTROID R:0.31164 P:0.19078 F:0.23667
59CENTROID ROUGE-1 Eval D0711-B.M.100.C-C.59CENTROID R:0.28523 P:0.17820 F:0.21936
59CENTROID ROUGE-1 Eval D0711-B.M.100.C-F.59CENTROID R:0.33559 P:0.20755 F:0.25648
59CENTROID ROUGE-1 Eval D0711-C.M.100.C-A.59CENTROID R:0.42904 P:0.26423 F:0.32704
59CENTROID ROUGE-1 Eval D0711-C.M.100.C-B.59CENTROID R:0.43686 P:0.26016 F:0.32611
59CENTROID ROUGE-1 Eval D0711-C.M.100.C-C.59CENTROID R:0.41892 P:0.25203 F:0.31472
59CENTROID ROUGE-1 Eval D0711-C.M.100.C-F.59CENTROID R:0.39189 P:0.23577 F:0.29441
59CENTROID ROUGE-1 Eval D0716-A.M.100.D-C.59CENTROID R:0.31475 P:0.18935 F:0.23645
59CENTROID ROUGE-1 Eval D0716-A.M.100.D-D.59CENTROID R:0.34333 P:0.20316 F:0.25527
59CENTROID ROUGE-1 Eval D0716-A.M.100.D-E.59CENTROID R:0.31561 P:0.18738 F:0.23515
59CENTROID ROUGE-1 Eval D0716-A.M.100.D-F.59CENTROID R:0.29703 P:0.17751 F:0.22222
59CENTROID ROUGE-1 Eval D0716-B.M.100.D-C.59CENTROID R:0.36842 P:0.22764 F:0.28140
59CENTROID ROUGE-1 Eval D0716-B.M.100.D-D.59CENTROID R:0.42617 P:0.25813 F:0.32152
59CENTROID ROUGE-1 Eval D0716-B.M.100.D-E.59CENTROID R:0.40864 P:0.25000 F:0.31021
59CENTROID ROUGE-1 Eval D0716-B.M.100.D-F.59CENTROID R:0.41333 P:0.25203 F:0.31313
59CENTROID ROUGE-1 Eval D0716-C.M.100.D-C.59CENTROID R:0.39739 P:0.25417 F:0.31004
59CENTROID ROUGE-1 Eval D0716-C.M.100.D-D.59CENTROID R:0.40468 P:0.25208 F:0.31065
59CENTROID ROUGE-1 Eval D0716-C.M.100.D-E.59CENTROID R:0.42244 P:0.26667 F:0.32695
59CENTROID ROUGE-1 Eval D0716-C.M.100.D-F.59CENTROID R:0.42333 P:0.26458 F:0.32564
59CENTROID ROUGE-1 Eval D0721-A.M.100.E-B.59CENTROID R:0.31667 P:0.19547 F:0.24173
59CENTROID ROUGE-1 Eval D0721-A.M.100.E-C.59CENTROID R:0.31494 P:0.19959 F:0.24434
59CENTROID ROUGE-1 Eval D0721-A.M.100.E-E.59CENTROID R:0.28571 P:0.18107 F:0.22166
59CENTROID ROUGE-1 Eval D0721-A.M.100.E-G.59CENTROID R:0.30255 P:0.19547 F:0.23750
59CENTROID ROUGE-1 Eval D0721-B.M.100.E-B.59CENTROID R:0.39414 P:0.23314 F:0.29298
59CENTROID ROUGE-1 Eval D0721-B.M.100.E-C.59CENTROID R:0.41401 P:0.25048 F:0.31212
59CENTROID ROUGE-1 Eval D0721-B.M.100.E-E.59CENTROID R:0.40000 P:0.23507 F:0.29612
59CENTROID ROUGE-1 Eval D0721-B.M.100.E-G.59CENTROID R:0.41290 P:0.24663 F:0.30881
59CENTROID ROUGE-1 Eval D0721-C.M.100.E-B.59CENTROID R:0.26557 P:0.17647 F:0.21204
59CENTROID ROUGE-1 Eval D0721-C.M.100.E-C.59CENTROID R:0.20792 P:0.13725 F:0.16535
59CENTROID ROUGE-1 Eval D0721-C.M.100.E-E.59CENTROID R:0.23333 P:0.15251 F:0.18446
59CENTROID ROUGE-1 Eval D0721-C.M.100.E-G.59CENTROID R:0.19218 P:0.12854 F:0.15405
59CENTROID ROUGE-1 Eval D0726-A.M.100.F-A.59CENTROID R:0.36213 P:0.22708 F:0.27913
59CENTROID ROUGE-1 Eval D0726-A.M.100.F-E.59CENTROID R:0.37000 P:0.23125 F:0.28462
59CENTROID ROUGE-1 Eval D0726-A.M.100.F-F.59CENTROID R:0.35880 P:0.22500 F:0.27657
59CENTROID ROUGE-1 Eval D0726-A.M.100.F-G.59CENTROID R:0.35548 P:0.22292 F:0.27401
59CENTROID ROUGE-1 Eval D0726-B.M.100.F-A.59CENTROID R:0.32026 P:0.18667 F:0.23586
59CENTROID ROUGE-1 Eval D0726-B.M.100.F-E.59CENTROID R:0.32890 P:0.18857 F:0.23971
59CENTROID ROUGE-1 Eval D0726-B.M.100.F-F.59CENTROID R:0.30565 P:0.17524 F:0.22276
59CENTROID ROUGE-1 Eval D0726-B.M.100.F-G.59CENTROID R:0.31250 P:0.18095 F:0.22919
59CENTROID ROUGE-1 Eval D0726-C.M.100.F-A.59CENTROID R:0.39667 P:0.24486 F:0.30280
59CENTROID ROUGE-1 Eval D0726-C.M.100.F-E.59CENTROID R:0.38047 P:0.23251 F:0.28863
59CENTROID ROUGE-1 Eval D0726-C.M.100.F-F.59CENTROID R:0.39661 P:0.24074 F:0.29962
59CENTROID ROUGE-1 Eval D0726-C.M.100.F-G.59CENTROID R:0.37049 P:0.23251 F:0.28571
59CENTROID ROUGE-1 Eval D0727-A.M.100.G-A.59CENTROID R:0.45847 P:0.30872 F:0.36898
59CENTROID ROUGE-1 Eval D0727-A.M.100.G-F.59CENTROID R:0.44079 P:0.29978 F:0.35686
59CENTROID ROUGE-1 Eval D0727-A.M.100.G-G.59CENTROID R:0.43791 P:0.29978 F:0.35591
59CENTROID ROUGE-1 Eval D0727-A.M.100.G-H.59CENTROID R:0.43092 P:0.29306 F:0.34886
59CENTROID ROUGE-1 Eval D0727-B.M.100.G-A.59CENTROID R:0.34021 P:0.19298 F:0.24627
59CENTROID ROUGE-1 Eval D0727-B.M.100.G-F.59CENTROID R:0.34091 P:0.20468 F:0.25579
59CENTROID ROUGE-1 Eval D0727-B.M.100.G-G.59CENTROID R:0.32180 P:0.18129 F:0.23192
59CENTROID ROUGE-1 Eval D0727-B.M.100.G-H.59CENTROID R:0.30928 P:0.17544 F:0.22388
59CENTROID ROUGE-1 Eval D0727-C.M.100.G-A.59CENTROID R:0.37459 P:0.20721 F:0.26682
59CENTROID ROUGE-1 Eval D0727-C.M.100.G-F.59CENTROID R:0.39057 P:0.20901 F:0.27230
59CENTROID ROUGE-1 Eval D0727-C.M.100.G-G.59CENTROID R:0.36964 P:0.20180 F:0.26107
59CENTROID ROUGE-1 Eval D0727-C.M.100.G-H.59CENTROID R:0.38176 P:0.20360 F:0.26557
59CENTROID ROUGE-1 Eval D0736-A.M.100.H-G.59CENTROID R:0.35484 P:0.20755 F:0.26191
59CENTROID ROUGE-1 Eval D0736-A.M.100.H-H.59CENTROID R:0.36131 P:0.20755 F:0.26365
59CENTROID ROUGE-1 Eval D0736-A.M.100.H-I.59CENTROID R:0.36655 P:0.21593 F:0.27177
59CENTROID ROUGE-1 Eval D0736-A.M.100.H-J.59CENTROID R:0.35948 P:0.23061 F:0.28097
59CENTROID ROUGE-1 Eval D0736-B.M.100.H-G.59CENTROID R:0.33588 P:0.16117 F:0.21782
59CENTROID ROUGE-1 Eval D0736-B.M.100.H-H.59CENTROID R:0.37190 P:0.16484 F:0.22843
59CENTROID ROUGE-1 Eval D0736-B.M.100.H-I.59CENTROID R:0.40167 P:0.17582 F:0.24458
59CENTROID ROUGE-1 Eval D0736-B.M.100.H-J.59CENTROID R:0.38462 P:0.20147 F:0.26443
59CENTROID ROUGE-1 Eval D0736-C.M.100.H-G.59CENTROID R:0.30802 P:0.11812 F:0.17076
59CENTROID ROUGE-1 Eval D0736-C.M.100.H-H.59CENTROID R:0.31016 P:0.09385 F:0.14410
59CENTROID ROUGE-1 Eval D0736-C.M.100.H-I.59CENTROID R:0.35829 P:0.10841 F:0.16645
59CENTROID ROUGE-1 Eval D0736-C.M.100.H-J.59CENTROID R:0.30566 P:0.13107 F:0.18347
59CENTROID ROUGE-1 Eval D0740-A.M.100.I-D.59CENTROID R:0.36634 P:0.22981 F:0.28244
59CENTROID ROUGE-1 Eval D0740-A.M.100.I-H.59CENTROID R:0.33333 P:0.21118 F:0.25855
59CENTROID ROUGE-1 Eval D0740-A.M.100.I-I.59CENTROID R:0.34740 P:0.22153 F:0.27054
59CENTROID ROUGE-1 Eval D0740-A.M.100.I-J.59CENTROID R:0.34194 P:0.21946 F:0.26734
59CENTROID ROUGE-1 Eval D0740-B.M.100.I-D.59CENTROID R:0.33442 P:0.19961 F:0.25000
59CENTROID ROUGE-1 Eval D0740-B.M.100.I-H.59CENTROID R:0.33444 P:0.19574 F:0.24695
59CENTROID ROUGE-1 Eval D0740-B.M.100.I-I.59CENTROID R:0.36393 P:0.21512 F:0.27040
59CENTROID ROUGE-1 Eval D0740-B.M.100.I-J.59CENTROID R:0.32039 P:0.19186 F:0.24000
59CENTROID ROUGE-1 Eval D0740-C.M.100.I-D.59CENTROID R:0.35144 P:0.21318 F:0.26538
59CENTROID ROUGE-1 Eval D0740-C.M.100.I-H.59CENTROID R:0.35691 P:0.21512 F:0.26844
59CENTROID ROUGE-1 Eval D0740-C.M.100.I-I.59CENTROID R:0.37700 P:0.22868 F:0.28468
59CENTROID ROUGE-1 Eval D0740-C.M.100.I-J.59CENTROID R:0.38217 P:0.23256 F:0.28916
59CENTROID ROUGE-1 Eval D0743-A.M.100.J-B.59CENTROID R:0.23492 P:0.16895 F:0.19655
59CENTROID ROUGE-1 Eval D0743-A.M.100.J-H.59CENTROID R:0.31173 P:0.23059 F:0.26509
59CENTROID ROUGE-1 Eval D0743-A.M.100.J-I.59CENTROID R:0.30000 P:0.21918 F:0.25330
59CENTROID ROUGE-1 Eval D0743-A.M.100.J-J.59CENTROID R:0.27385 P:0.20320 F:0.23329
59CENTROID ROUGE-1 Eval D0743-B.M.100.J-B.59CENTROID R:0.28205 P:0.16762 F:0.21028
59CENTROID ROUGE-1 Eval D0743-B.M.100.J-H.59CENTROID R:0.26498 P:0.16000 F:0.19952
59CENTROID ROUGE-1 Eval D0743-B.M.100.J-I.59CENTROID R:0.26899 P:0.16190 F:0.20214
59CENTROID ROUGE-1 Eval D0743-B.M.100.J-J.59CENTROID R:0.26480 P:0.16190 F:0.20094
59CENTROID ROUGE-1 Eval D0743-C.M.100.J-B.59CENTROID R:0.33016 P:0.19476 F:0.24500
59CENTROID ROUGE-1 Eval D0743-C.M.100.J-H.59CENTROID R:0.28025 P:0.16479 F:0.20754
59CENTROID ROUGE-1 Eval D0743-C.M.100.J-I.59CENTROID R:0.33227 P:0.19476 F:0.24558
59CENTROID ROUGE-1 Eval D0743-C.M.100.J-J.59CENTROID R:0.29560 P:0.17603 F:0.22066
---------------------------------------------
59CENTROID ROUGE-2 Average_R: 0.07346 (95%-conf.int. 0.06866 - 0.07818)
59CENTROID ROUGE-2 Average_P: 0.04462 (95%-conf.int. 0.04158 - 0.04764)
59CENTROID ROUGE-2 Average_F: 0.05535 (95%-conf.int. 0.05166 - 0.05904)
.............................................
59CENTROID ROUGE-2 Eval D0703-A.M.100.A-A.59CENTROID R:0.07167 P:0.04459 F:0.05498
59CENTROID ROUGE-2 Eval D0703-A.M.100.A-C.59CENTROID R:0.04068 P:0.02548 F:0.03133
59CENTROID ROUGE-2 Eval D0703-A.M.100.A-D.59CENTROID R:0.05556 P:0.03397 F:0.04216
59CENTROID ROUGE-2 Eval D0703-A.M.100.A-J.59CENTROID R:0.06873 P:0.04246 F:0.05249
59CENTROID ROUGE-2 Eval D0703-B.M.100.A-A.59CENTROID R:0.07921 P:0.05333 F:0.06374
59CENTROID ROUGE-2 Eval D0703-B.M.100.A-C.59CENTROID R:0.09492 P:0.06222 F:0.07517
59CENTROID ROUGE-2 Eval D0703-B.M.100.A-D.59CENTROID R:0.07119 P:0.04667 F:0.05638
59CENTROID ROUGE-2 Eval D0703-B.M.100.A-J.59CENTROID R:0.07718 P:0.05111 F:0.06150
59CENTROID ROUGE-2 Eval D0703-C.M.100.A-A.59CENTROID R:0.10438 P:0.06499 F:0.08010
59CENTROID ROUGE-2 Eval D0703-C.M.100.A-C.59CENTROID R:0.06885 P:0.04403 F:0.05371
59CENTROID ROUGE-2 Eval D0703-C.M.100.A-D.59CENTROID R:0.09365 P:0.05870 F:0.07217
59CENTROID ROUGE-2 Eval D0703-C.M.100.A-J.59CENTROID R:0.11371 P:0.07128 F:0.08763
59CENTROID ROUGE-2 Eval D0706-A.M.100.B-B.59CENTROID R:0.09180 P:0.05426 F:0.06821
59CENTROID ROUGE-2 Eval D0706-A.M.100.B-D.59CENTROID R:0.10891 P:0.06395 F:0.08058
59CENTROID ROUGE-2 Eval D0706-A.M.100.B-E.59CENTROID R:0.09836 P:0.05814 F:0.07308
59CENTROID ROUGE-2 Eval D0706-A.M.100.B-I.59CENTROID R:0.08525 P:0.05039 F:0.06334
59CENTROID ROUGE-2 Eval D0706-B.M.100.B-B.59CENTROID R:0.07261 P:0.04288 F:0.05392
59CENTROID ROUGE-2 Eval D0706-B.M.100.B-D.59CENTROID R:0.06579 P:0.03899 F:0.04896
59CENTROID ROUGE-2 Eval D0706-B.M.100.B-E.59CENTROID R:0.04590 P:0.02729 F:0.03423
59CENTROID ROUGE-2 Eval D0706-B.M.100.B-I.59CENTROID R:0.06209 P:0.03704 F:0.04640
59CENTROID ROUGE-2 Eval D0706-C.M.100.B-B.59CENTROID R:0.12378 P:0.08444 F:0.10039
59CENTROID ROUGE-2 Eval D0706-C.M.100.B-D.59CENTROID R:0.09446 P:0.06444 F:0.07661
59CENTROID ROUGE-2 Eval D0706-C.M.100.B-E.59CENTROID R:0.12298 P:0.08444 F:0.10013
59CENTROID ROUGE-2 Eval D0706-C.M.100.B-I.59CENTROID R:0.12581 P:0.08667 F:0.10264
59CENTROID ROUGE-2 Eval D0711-A.M.100.C-A.59CENTROID R:0.12957 P:0.08784 F:0.10470
59CENTROID ROUGE-2 Eval D0711-A.M.100.C-B.59CENTROID R:0.09764 P:0.06532 F:0.07827
59CENTROID ROUGE-2 Eval D0711-A.M.100.C-C.59CENTROID R:0.08418 P:0.05631 F:0.06748
59CENTROID ROUGE-2 Eval D0711-A.M.100.C-F.59CENTROID R:0.09030 P:0.06081 F:0.07268
59CENTROID ROUGE-2 Eval D0711-B.M.100.C-A.59CENTROID R:0.04811 P:0.02954 F:0.03660
59CENTROID ROUGE-2 Eval D0711-B.M.100.C-B.59CENTROID R:0.05190 P:0.03165 F:0.03932
59CENTROID ROUGE-2 Eval D0711-B.M.100.C-C.59CENTROID R:0.04407 P:0.02743 F:0.03381
59CENTROID ROUGE-2 Eval D0711-B.M.100.C-F.59CENTROID R:0.05137 P:0.03165 F:0.03917
59CENTROID ROUGE-2 Eval D0711-C.M.100.C-A.59CENTROID R:0.12000 P:0.07362 F:0.09126
59CENTROID ROUGE-2 Eval D0711-C.M.100.C-B.59CENTROID R:0.11379 P:0.06748 F:0.08472
59CENTROID ROUGE-2 Eval D0711-C.M.100.C-C.59CENTROID R:0.09898 P:0.05930 F:0.07417
59CENTROID ROUGE-2 Eval D0711-C.M.100.C-F.59CENTROID R:0.09556 P:0.05726 F:0.07161
59CENTROID ROUGE-2 Eval D0716-A.M.100.D-C.59CENTROID R:0.06291 P:0.03770 F:0.04715
59CENTROID ROUGE-2 Eval D0716-A.M.100.D-D.59CENTROID R:0.08754 P:0.05159 F:0.06492
59CENTROID ROUGE-2 Eval D0716-A.M.100.D-E.59CENTROID R:0.06711 P:0.03968 F:0.04987
59CENTROID ROUGE-2 Eval D0716-A.M.100.D-F.59CENTROID R:0.06333 P:0.03770 F:0.04726
59CENTROID ROUGE-2 Eval D0716-B.M.100.D-C.59CENTROID R:0.07309 P:0.04499 F:0.05570
59CENTROID ROUGE-2 Eval D0716-B.M.100.D-D.59CENTROID R:0.12203 P:0.07362 F:0.09184
59CENTROID ROUGE-2 Eval D0716-B.M.100.D-E.59CENTROID R:0.10738 P:0.06544 F:0.08132
59CENTROID ROUGE-2 Eval D0716-B.M.100.D-F.59CENTROID R:0.11111 P:0.06748 F:0.08397
59CENTROID ROUGE-2 Eval D0716-C.M.100.D-C.59CENTROID R:0.09539 P:0.06080 F:0.07426
59CENTROID ROUGE-2 Eval D0716-C.M.100.D-D.59CENTROID R:0.07770 P:0.04822 F:0.05951
59CENTROID ROUGE-2 Eval D0716-C.M.100.D-E.59CENTROID R:0.10333 P:0.06499 F:0.07979
59CENTROID ROUGE-2 Eval D0716-C.M.100.D-F.59CENTROID R:0.10438 P:0.06499 F:0.08010
59CENTROID ROUGE-2 Eval D0721-A.M.100.E-B.59CENTROID R:0.03030 P:0.01863 F:0.02307
59CENTROID ROUGE-2 Eval D0721-A.M.100.E-C.59CENTROID R:0.05246 P:0.03313 F:0.04061
59CENTROID ROUGE-2 Eval D0721-A.M.100.E-E.59CENTROID R:0.04918 P:0.03106 F:0.03807
59CENTROID ROUGE-2 Eval D0721-A.M.100.E-G.59CENTROID R:0.05466 P:0.03520 F:0.04282
59CENTROID ROUGE-2 Eval D0721-B.M.100.E-B.59CENTROID R:0.05263 P:0.03101 F:0.03903
59CENTROID ROUGE-2 Eval D0721-B.M.100.E-C.59CENTROID R:0.06431 P:0.03876 F:0.04837
59CENTROID ROUGE-2 Eval D0721-B.M.100.E-E.59CENTROID R:0.05960 P:0.03488 F:0.04401
59CENTROID ROUGE-2 Eval D0721-B.M.100.E-G.59CENTROID R:0.04886 P:0.02907 F:0.03645
59CENTROID ROUGE-2 Eval D0721-C.M.100.E-B.59CENTROID R:0.05629 P:0.03728 F:0.04485
59CENTROID ROUGE-2 Eval D0721-C.M.100.E-C.59CENTROID R:0.04333 P:0.02851 F:0.03439
59CENTROID ROUGE-2 Eval D0721-C.M.100.E-E.59CENTROID R:0.05724 P:0.03728 F:0.04515
59CENTROID ROUGE-2 Eval D0721-C.M.100.E-G.59CENTROID R:0.02303 P:0.01535 F:0.01842
59CENTROID ROUGE-2 Eval D0726-A.M.100.F-A.59CENTROID R:0.06711 P:0.04193 F:0.05161
59CENTROID ROUGE-2 Eval D0726-A.M.100.F-E.59CENTROID R:0.09091 P:0.05660 F:0.06976
59CENTROID ROUGE-2 Eval D0726-A.M.100.F-F.59CENTROID R:0.08054 P:0.05031 F:0.06193
59CENTROID ROUGE-2 Eval D0726-A.M.100.F-G.59CENTROID R:0.07383 P:0.04612 F:0.05677
59CENTROID ROUGE-2 Eval D0726-B.M.100.F-A.59CENTROID R:0.04950 P:0.02874 F:0.03637
59CENTROID ROUGE-2 Eval D0726-B.M.100.F-E.59CENTROID R:0.04698 P:0.02682 F:0.03415
59CENTROID ROUGE-2 Eval D0726-B.M.100.F-F.59CENTROID R:0.04362 P:0.02490 F:0.03170
59CENTROID ROUGE-2 Eval D0726-B.M.100.F-G.59CENTROID R:0.02990 P:0.01724 F:0.02187
59CENTROID ROUGE-2 Eval D0726-C.M.100.F-A.59CENTROID R:0.09764 P:0.06004 F:0.07436
59CENTROID ROUGE-2 Eval D0726-C.M.100.F-E.59CENTROID R:0.06463 P:0.03934 F:0.04891
59CENTROID ROUGE-2 Eval D0726-C.M.100.F-F.59CENTROID R:0.07534 P:0.04555 F:0.05677
59CENTROID ROUGE-2 Eval D0726-C.M.100.F-G.59CENTROID R:0.06623 P:0.04141 F:0.05096
59CENTROID ROUGE-2 Eval D0727-A.M.100.G-A.59CENTROID R:0.10738 P:0.07207 F:0.08625
59CENTROID ROUGE-2 Eval D0727-A.M.100.G-F.59CENTROID R:0.09967 P:0.06757 F:0.08054
59CENTROID ROUGE-2 Eval D0727-A.M.100.G-G.59CENTROID R:0.10891 P:0.07432 F:0.08835
59CENTROID ROUGE-2 Eval D0727-A.M.100.G-H.59CENTROID R:0.09302 P:0.06306 F:0.07516
59CENTROID ROUGE-2 Eval D0727-B.M.100.G-A.59CENTROID R:0.06597 P:0.03725 F:0.04761
59CENTROID ROUGE-2 Eval D0727-B.M.100.G-F.59CENTROID R:0.08197 P:0.04902 F:0.06135
59CENTROID ROUGE-2 Eval D0727-B.M.100.G-G.59CENTROID R:0.06643 P:0.03725 F:0.04773
59CENTROID ROUGE-2 Eval D0727-B.M.100.G-H.59CENTROID R:0.06250 P:0.03529 F:0.04511
59CENTROID ROUGE-2 Eval D0727-C.M.100.G-A.59CENTROID R:0.07566 P:0.04167 F:0.05374
59CENTROID ROUGE-2 Eval D0727-C.M.100.G-F.59CENTROID R:0.08503 P:0.04529 F:0.05910
59CENTROID ROUGE-2 Eval D0727-C.M.100.G-G.59CENTROID R:0.06667 P:0.03623 F:0.04695
59CENTROID ROUGE-2 Eval D0727-C.M.100.G-H.59CENTROID R:0.08532 P:0.04529 F:0.05917
59CENTROID ROUGE-2 Eval D0736-A.M.100.H-G.59CENTROID R:0.05435 P:0.03165 F:0.04000
59CENTROID ROUGE-2 Eval D0736-A.M.100.H-H.59CENTROID R:0.04428 P:0.02532 F:0.03222
59CENTROID ROUGE-2 Eval D0736-A.M.100.H-I.59CENTROID R:0.05036 P:0.02954 F:0.03724
59CENTROID ROUGE-2 Eval D0736-A.M.100.H-J.59CENTROID R:0.05281 P:0.03376 F:0.04119
59CENTROID ROUGE-2 Eval D0736-B.M.100.H-G.59CENTROID R:0.07722 P:0.03683 F:0.04987
59CENTROID ROUGE-2 Eval D0736-B.M.100.H-H.59CENTROID R:0.13808 P:0.06077 F:0.08440
59CENTROID ROUGE-2 Eval D0736-B.M.100.H-I.59CENTROID R:0.14831 P:0.06446 F:0.08986
59CENTROID ROUGE-2 Eval D0736-B.M.100.H-J.59CENTROID R:0.14488 P:0.07551 F:0.09928
59CENTROID ROUGE-2 Eval D0736-C.M.100.H-G.59CENTROID R:0.04274 P:0.01626 F:0.02356
59CENTROID ROUGE-2 Eval D0736-C.M.100.H-H.59CENTROID R:0.04891 P:0.01463 F:0.02252
59CENTROID ROUGE-2 Eval D0736-C.M.100.H-I.59CENTROID R:0.04891 P:0.01463 F:0.02252
59CENTROID ROUGE-2 Eval D0736-C.M.100.H-J.59CENTROID R:0.04198 P:0.01789 F:0.02509
59CENTROID ROUGE-2 Eval D0740-A.M.100.I-D.59CENTROID R:0.09333 P:0.05833 F:0.07179
59CENTROID ROUGE-2 Eval D0740-A.M.100.I-H.59CENTROID R:0.07921 P:0.05000 F:0.06130
59CENTROID ROUGE-2 Eval D0740-A.M.100.I-I.59CENTROID R:0.08525 P:0.05417 F:0.06625
59CENTROID ROUGE-2 Eval D0740-A.M.100.I-J.59CENTROID R:0.06840 P:0.04375 F:0.05337
59CENTROID ROUGE-2 Eval D0740-B.M.100.I-D.59CENTROID R:0.05574 P:0.03314 F:0.04157
59CENTROID ROUGE-2 Eval D0740-B.M.100.I-H.59CENTROID R:0.06020 P:0.03509 F:0.04434
59CENTROID ROUGE-2 Eval D0740-B.M.100.I-I.59CENTROID R:0.07285 P:0.04288 F:0.05398
59CENTROID ROUGE-2 Eval D0740-B.M.100.I-J.59CENTROID R:0.04902 P:0.02924 F:0.03663
59CENTROID ROUGE-2 Eval D0740-C.M.100.I-D.59CENTROID R:0.05806 P:0.03509 F:0.04374
59CENTROID ROUGE-2 Eval D0740-C.M.100.I-H.59CENTROID R:0.07468 P:0.04483 F:0.05603
59CENTROID ROUGE-2 Eval D0740-C.M.100.I-I.59CENTROID R:0.09355 P:0.05653 F:0.07047
59CENTROID ROUGE-2 Eval D0740-C.M.100.I-J.59CENTROID R:0.09325 P:0.05653 F:0.07039
59CENTROID ROUGE-2 Eval D0743-A.M.100.J-B.59CENTROID R:0.03205 P:0.02299 F:0.02677
59CENTROID ROUGE-2 Eval D0743-A.M.100.J-H.59CENTROID R:0.06231 P:0.04598 F:0.05291
59CENTROID ROUGE-2 Eval D0743-A.M.100.J-I.59CENTROID R:0.05994 P:0.04368 F:0.05053
59CENTROID ROUGE-2 Eval D0743-A.M.100.J-J.59CENTROID R:0.05280 P:0.03908 F:0.04492
59CENTROID ROUGE-2 Eval D0743-B.M.100.J-B.59CENTROID R:0.03236 P:0.01916 F:0.02407
59CENTROID ROUGE-2 Eval D0743-B.M.100.J-H.59CENTROID R:0.02229 P:0.01341 F:0.01675
59CENTROID ROUGE-2 Eval D0743-B.M.100.J-I.59CENTROID R:0.02875 P:0.01724 F:0.02155
59CENTROID ROUGE-2 Eval D0743-B.M.100.J-J.59CENTROID R:0.03145 P:0.01916 F:0.02381
59CENTROID ROUGE-2 Eval D0743-C.M.100.J-B.59CENTROID R:0.05769 P:0.03390 F:0.04271
59CENTROID ROUGE-2 Eval D0743-C.M.100.J-H.59CENTROID R:0.03215 P:0.01883 F:0.02375
59CENTROID ROUGE-2 Eval D0743-C.M.100.J-I.59CENTROID R:0.05484 P:0.03202 F:0.04043
59CENTROID ROUGE-2 Eval D0743-C.M.100.J-J.59CENTROID R:0.04762 P:0.02825 F:0.03546
---------------------------------------------
59CENTROID ROUGE-3 Average_R: 0.02572 (95%-conf.int. 0.02241 - 0.02938)
59CENTROID ROUGE-3 Average_P: 0.01566 (95%-conf.int. 0.01372 - 0.01778)
59CENTROID ROUGE-3 Average_F: 0.01942 (95%-conf.int. 0.01700 - 0.02205)
.............................................
59CENTROID ROUGE-3 Eval D0703-A.M.100.A-A.59CENTROID R:0.02414 P:0.01496 F:0.01847
59CENTROID ROUGE-3 Eval D0703-A.M.100.A-C.59CENTROID R:0.00342 P:0.00214 F:0.00263
59CENTROID ROUGE-3 Eval D0703-A.M.100.A-D.59CENTROID R:0.02105 P:0.01282 F:0.01594
59CENTROID ROUGE-3 Eval D0703-A.M.100.A-J.59CENTROID R:0.02431 P:0.01496 F:0.01852
59CENTROID ROUGE-3 Eval D0703-B.M.100.A-A.59CENTROID R:0.02333 P:0.01566 F:0.01874
59CENTROID ROUGE-3 Eval D0703-B.M.100.A-C.59CENTROID R:0.03082 P:0.02013 F:0.02435
59CENTROID ROUGE-3 Eval D0703-B.M.100.A-D.59CENTROID R:0.01712 P:0.01119 F:0.01353
59CENTROID ROUGE-3 Eval D0703-B.M.100.A-J.59CENTROID R:0.02034 P:0.01342 F:0.01617
59CENTROID ROUGE-3 Eval D0703-C.M.100.A-A.59CENTROID R:0.04082 P:0.02532 F:0.03125
59CENTROID ROUGE-3 Eval D0703-C.M.100.A-C.59CENTROID R:0.01656 P:0.01055 F:0.01289
59CENTROID ROUGE-3 Eval D0703-C.M.100.A-D.59CENTROID R:0.04392 P:0.02743 F:0.03377
59CENTROID ROUGE-3 Eval D0703-C.M.100.A-J.59CENTROID R:0.05068 P:0.03165 F:0.03897
59CENTROID ROUGE-3 Eval D0706-A.M.100.B-B.59CENTROID R:0.02649 P:0.01559 F:0.01963
59CENTROID ROUGE-3 Eval D0706-A.M.100.B-D.59CENTROID R:0.04333 P:0.02534 F:0.03198
59CENTROID ROUGE-3 Eval D0706-A.M.100.B-E.59CENTROID R:0.03642 P:0.02144 F:0.02699
59CENTROID ROUGE-3 Eval D0706-A.M.100.B-I.59CENTROID R:0.02318 P:0.01365 F:0.01718
59CENTROID ROUGE-3 Eval D0706-B.M.100.B-B.59CENTROID R:0.00667 P:0.00392 F:0.00494
59CENTROID ROUGE-3 Eval D0706-B.M.100.B-D.59CENTROID R:0.00664 P:0.00392 F:0.00493
59CENTROID ROUGE-3 Eval D0706-B.M.100.B-E.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0706-B.M.100.B-I.59CENTROID R:0.00660 P:0.00392 F:0.00492
59CENTROID ROUGE-3 Eval D0706-C.M.100.B-B.59CENTROID R:0.07237 P:0.04922 F:0.05859
59CENTROID ROUGE-3 Eval D0706-C.M.100.B-D.59CENTROID R:0.05263 P:0.03579 F:0.04261
59CENTROID ROUGE-3 Eval D0706-C.M.100.B-E.59CENTROID R:0.06863 P:0.04698 F:0.05578
59CENTROID ROUGE-3 Eval D0706-C.M.100.B-I.59CENTROID R:0.07166 P:0.04922 F:0.05836
59CENTROID ROUGE-3 Eval D0711-A.M.100.C-A.59CENTROID R:0.07047 P:0.04762 F:0.05683
59CENTROID ROUGE-3 Eval D0711-A.M.100.C-B.59CENTROID R:0.06122 P:0.04082 F:0.04898
59CENTROID ROUGE-3 Eval D0711-A.M.100.C-C.59CENTROID R:0.03401 P:0.02268 F:0.02721
59CENTROID ROUGE-3 Eval D0711-A.M.100.C-F.59CENTROID R:0.04730 P:0.03175 F:0.03800
59CENTROID ROUGE-3 Eval D0711-B.M.100.C-A.59CENTROID R:0.00694 P:0.00425 F:0.00527
59CENTROID ROUGE-3 Eval D0711-B.M.100.C-B.59CENTROID R:0.00699 P:0.00425 F:0.00529
59CENTROID ROUGE-3 Eval D0711-B.M.100.C-C.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0711-B.M.100.C-F.59CENTROID R:0.00692 P:0.00425 F:0.00527
59CENTROID ROUGE-3 Eval D0711-C.M.100.C-A.59CENTROID R:0.05724 P:0.03498 F:0.04342
59CENTROID ROUGE-3 Eval D0711-C.M.100.C-B.59CENTROID R:0.05575 P:0.03292 F:0.04140
59CENTROID ROUGE-3 Eval D0711-C.M.100.C-C.59CENTROID R:0.05172 P:0.03086 F:0.03866
59CENTROID ROUGE-3 Eval D0711-C.M.100.C-F.59CENTROID R:0.05172 P:0.03086 F:0.03866
59CENTROID ROUGE-3 Eval D0716-A.M.100.D-C.59CENTROID R:0.01003 P:0.00599 F:0.00750
59CENTROID ROUGE-3 Eval D0716-A.M.100.D-D.59CENTROID R:0.01361 P:0.00798 F:0.01006
59CENTROID ROUGE-3 Eval D0716-A.M.100.D-E.59CENTROID R:0.01017 P:0.00599 F:0.00754
59CENTROID ROUGE-3 Eval D0716-A.M.100.D-F.59CENTROID R:0.00673 P:0.00399 F:0.00501
59CENTROID ROUGE-3 Eval D0716-B.M.100.D-C.59CENTROID R:0.02349 P:0.01440 F:0.01785
59CENTROID ROUGE-3 Eval D0716-B.M.100.D-D.59CENTROID R:0.06164 P:0.03704 F:0.04627
59CENTROID ROUGE-3 Eval D0716-B.M.100.D-E.59CENTROID R:0.05424 P:0.03292 F:0.04097
59CENTROID ROUGE-3 Eval D0716-B.M.100.D-F.59CENTROID R:0.05442 P:0.03292 F:0.04102
59CENTROID ROUGE-3 Eval D0716-C.M.100.D-C.59CENTROID R:0.03987 P:0.02532 F:0.03097
59CENTROID ROUGE-3 Eval D0716-C.M.100.D-D.59CENTROID R:0.02048 P:0.01266 F:0.01565
59CENTROID ROUGE-3 Eval D0716-C.M.100.D-E.59CENTROID R:0.04040 P:0.02532 F:0.03113
59CENTROID ROUGE-3 Eval D0716-C.M.100.D-F.59CENTROID R:0.04082 P:0.02532 F:0.03125
59CENTROID ROUGE-3 Eval D0721-A.M.100.E-B.59CENTROID R:0.00340 P:0.00208 F:0.00258
59CENTROID ROUGE-3 Eval D0721-A.M.100.E-C.59CENTROID R:0.01325 P:0.00833 F:0.01023
59CENTROID ROUGE-3 Eval D0721-A.M.100.E-E.59CENTROID R:0.00993 P:0.00625 F:0.00767
59CENTROID ROUGE-3 Eval D0721-A.M.100.E-G.59CENTROID R:0.01299 P:0.00833 F:0.01015
59CENTROID ROUGE-3 Eval D0721-B.M.100.E-B.59CENTROID R:0.00997 P:0.00585 F:0.00737
59CENTROID ROUGE-3 Eval D0721-B.M.100.E-C.59CENTROID R:0.01948 P:0.01170 F:0.01462
59CENTROID ROUGE-3 Eval D0721-B.M.100.E-E.59CENTROID R:0.02007 P:0.01170 F:0.01478
59CENTROID ROUGE-3 Eval D0721-B.M.100.E-G.59CENTROID R:0.00987 P:0.00585 F:0.00735
59CENTROID ROUGE-3 Eval D0721-C.M.100.E-B.59CENTROID R:0.03010 P:0.01987 F:0.02394
59CENTROID ROUGE-3 Eval D0721-C.M.100.E-C.59CENTROID R:0.02357 P:0.01545 F:0.01867
59CENTROID ROUGE-3 Eval D0721-C.M.100.E-E.59CENTROID R:0.03061 P:0.01987 F:0.02410
59CENTROID ROUGE-3 Eval D0721-C.M.100.E-G.59CENTROID R:0.00664 P:0.00442 F:0.00531
59CENTROID ROUGE-3 Eval D0726-A.M.100.F-A.59CENTROID R:0.02712 P:0.01688 F:0.02081
59CENTROID ROUGE-3 Eval D0726-A.M.100.F-E.59CENTROID R:0.03741 P:0.02321 F:0.02865
59CENTROID ROUGE-3 Eval D0726-A.M.100.F-F.59CENTROID R:0.02712 P:0.01688 F:0.02081
59CENTROID ROUGE-3 Eval D0726-A.M.100.F-G.59CENTROID R:0.02034 P:0.01266 F:0.01561
59CENTROID ROUGE-3 Eval D0726-B.M.100.F-A.59CENTROID R:0.02333 P:0.01349 F:0.01710
59CENTROID ROUGE-3 Eval D0726-B.M.100.F-E.59CENTROID R:0.02034 P:0.01156 F:0.01474
59CENTROID ROUGE-3 Eval D0726-B.M.100.F-F.59CENTROID R:0.02034 P:0.01156 F:0.01474
59CENTROID ROUGE-3 Eval D0726-B.M.100.F-G.59CENTROID R:0.00671 P:0.00385 F:0.00489
59CENTROID ROUGE-3 Eval D0726-C.M.100.F-A.59CENTROID R:0.04082 P:0.02500 F:0.03101
59CENTROID ROUGE-3 Eval D0726-C.M.100.F-E.59CENTROID R:0.02405 P:0.01458 F:0.01815
59CENTROID ROUGE-3 Eval D0726-C.M.100.F-F.59CENTROID R:0.03460 P:0.02083 F:0.02600
59CENTROID ROUGE-3 Eval D0726-C.M.100.F-G.59CENTROID R:0.02341 P:0.01458 F:0.01797
59CENTROID ROUGE-3 Eval D0727-A.M.100.G-A.59CENTROID R:0.03729 P:0.02494 F:0.02989
59CENTROID ROUGE-3 Eval D0727-A.M.100.G-F.59CENTROID R:0.03356 P:0.02268 F:0.02707
59CENTROID ROUGE-3 Eval D0727-A.M.100.G-G.59CENTROID R:0.03333 P:0.02268 F:0.02699
59CENTROID ROUGE-3 Eval D0727-A.M.100.G-H.59CENTROID R:0.03691 P:0.02494 F:0.02977
59CENTROID ROUGE-3 Eval D0727-B.M.100.G-A.59CENTROID R:0.01053 P:0.00592 F:0.00758
59CENTROID ROUGE-3 Eval D0727-B.M.100.G-F.59CENTROID R:0.01325 P:0.00789 F:0.00989
59CENTROID ROUGE-3 Eval D0727-B.M.100.G-G.59CENTROID R:0.01060 P:0.00592 F:0.00760
59CENTROID ROUGE-3 Eval D0727-B.M.100.G-H.59CENTROID R:0.00702 P:0.00394 F:0.00505
59CENTROID ROUGE-3 Eval D0727-C.M.100.G-A.59CENTROID R:0.03654 P:0.02004 F:0.02588
59CENTROID ROUGE-3 Eval D0727-C.M.100.G-F.59CENTROID R:0.03093 P:0.01639 F:0.02143
59CENTROID ROUGE-3 Eval D0727-C.M.100.G-G.59CENTROID R:0.01347 P:0.00729 F:0.00946
59CENTROID ROUGE-3 Eval D0727-C.M.100.G-H.59CENTROID R:0.03103 P:0.01639 F:0.02145
59CENTROID ROUGE-3 Eval D0736-A.M.100.H-G.59CENTROID R:0.01099 P:0.00637 F:0.00807
59CENTROID ROUGE-3 Eval D0736-A.M.100.H-H.59CENTROID R:0.00373 P:0.00212 F:0.00270
59CENTROID ROUGE-3 Eval D0736-A.M.100.H-I.59CENTROID R:0.00727 P:0.00425 F:0.00536
59CENTROID ROUGE-3 Eval D0736-A.M.100.H-J.59CENTROID R:0.01000 P:0.00637 F:0.00778
59CENTROID ROUGE-3 Eval D0736-B.M.100.H-G.59CENTROID R:0.02734 P:0.01296 F:0.01758
59CENTROID ROUGE-3 Eval D0736-B.M.100.H-H.59CENTROID R:0.08898 P:0.03889 F:0.05412
59CENTROID ROUGE-3 Eval D0736-B.M.100.H-I.59CENTROID R:0.10300 P:0.04444 F:0.06209
59CENTROID ROUGE-3 Eval D0736-B.M.100.H-J.59CENTROID R:0.09286 P:0.04815 F:0.06342
59CENTROID ROUGE-3 Eval D0736-C.M.100.H-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0736-C.M.100.H-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0736-C.M.100.H-I.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0736-C.M.100.H-J.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-3 Eval D0740-A.M.100.I-D.59CENTROID R:0.02694 P:0.01677 F:0.02067
59CENTROID ROUGE-3 Eval D0740-A.M.100.I-H.59CENTROID R:0.01667 P:0.01048 F:0.01287
59CENTROID ROUGE-3 Eval D0740-A.M.100.I-I.59CENTROID R:0.02318 P:0.01468 F:0.01798
59CENTROID ROUGE-3 Eval D0740-A.M.100.I-J.59CENTROID R:0.01316 P:0.00839 F:0.01025
59CENTROID ROUGE-3 Eval D0740-B.M.100.I-D.59CENTROID R:0.00993 P:0.00588 F:0.00739
59CENTROID ROUGE-3 Eval D0740-B.M.100.I-H.59CENTROID R:0.01351 P:0.00784 F:0.00992
59CENTROID ROUGE-3 Eval D0740-B.M.100.I-I.59CENTROID R:0.01672 P:0.00980 F:0.01236
59CENTROID ROUGE-3 Eval D0740-B.M.100.I-J.59CENTROID R:0.00990 P:0.00588 F:0.00738
59CENTROID ROUGE-3 Eval D0740-C.M.100.I-D.59CENTROID R:0.01629 P:0.00980 F:0.01224
59CENTROID ROUGE-3 Eval D0740-C.M.100.I-H.59CENTROID R:0.02623 P:0.01569 F:0.01963
59CENTROID ROUGE-3 Eval D0740-C.M.100.I-I.59CENTROID R:0.04235 P:0.02549 F:0.03182
59CENTROID ROUGE-3 Eval D0740-C.M.100.I-J.59CENTROID R:0.04221 P:0.02549 F:0.03179
59CENTROID ROUGE-3 Eval D0743-A.M.100.J-B.59CENTROID R:0.00647 P:0.00463 F:0.00540
59CENTROID ROUGE-3 Eval D0743-A.M.100.J-H.59CENTROID R:0.02201 P:0.01620 F:0.01866
59CENTROID ROUGE-3 Eval D0743-A.M.100.J-I.59CENTROID R:0.02229 P:0.01620 F:0.01876
59CENTROID ROUGE-3 Eval D0743-A.M.100.J-J.59CENTROID R:0.01567 P:0.01157 F:0.01331
59CENTROID ROUGE-3 Eval D0743-B.M.100.J-B.59CENTROID R:0.00327 P:0.00193 F:0.00243
59CENTROID ROUGE-3 Eval D0743-B.M.100.J-H.59CENTROID R:0.00322 P:0.00193 F:0.00241
59CENTROID ROUGE-3 Eval D0743-B.M.100.J-I.59CENTROID R:0.00645 P:0.00385 F:0.00482
59CENTROID ROUGE-3 Eval D0743-B.M.100.J-J.59CENTROID R:0.00635 P:0.00385 F:0.00479
59CENTROID ROUGE-3 Eval D0743-C.M.100.J-B.59CENTROID R:0.01618 P:0.00947 F:0.01195
59CENTROID ROUGE-3 Eval D0743-C.M.100.J-H.59CENTROID R:0.00325 P:0.00189 F:0.00239
59CENTROID ROUGE-3 Eval D0743-C.M.100.J-I.59CENTROID R:0.01629 P:0.00947 F:0.01198
59CENTROID ROUGE-3 Eval D0743-C.M.100.J-J.59CENTROID R:0.01282 P:0.00758 F:0.00953
---------------------------------------------
59CENTROID ROUGE-4 Average_R: 0.01275 (95%-conf.int. 0.01011 - 0.01554)
59CENTROID ROUGE-4 Average_P: 0.00762 (95%-conf.int. 0.00612 - 0.00928)
59CENTROID ROUGE-4 Average_F: 0.00950 (95%-conf.int. 0.00761 - 0.01154)
.............................................
59CENTROID ROUGE-4 Eval D0703-A.M.100.A-A.59CENTROID R:0.00697 P:0.00430 F:0.00532
59CENTROID ROUGE-4 Eval D0703-A.M.100.A-C.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0703-A.M.100.A-D.59CENTROID R:0.00709 P:0.00430 F:0.00535
59CENTROID ROUGE-4 Eval D0703-A.M.100.A-J.59CENTROID R:0.00702 P:0.00430 F:0.00533
59CENTROID ROUGE-4 Eval D0703-B.M.100.A-A.59CENTROID R:0.01010 P:0.00676 F:0.00810
59CENTROID ROUGE-4 Eval D0703-B.M.100.A-C.59CENTROID R:0.01384 P:0.00901 F:0.01091
59CENTROID ROUGE-4 Eval D0703-B.M.100.A-D.59CENTROID R:0.00692 P:0.00450 F:0.00545
59CENTROID ROUGE-4 Eval D0703-B.M.100.A-J.59CENTROID R:0.01027 P:0.00676 F:0.00815
59CENTROID ROUGE-4 Eval D0703-C.M.100.A-A.59CENTROID R:0.03093 P:0.01911 F:0.02362
59CENTROID ROUGE-4 Eval D0703-C.M.100.A-C.59CENTROID R:0.00669 P:0.00425 F:0.00520
59CENTROID ROUGE-4 Eval D0703-C.M.100.A-D.59CENTROID R:0.03072 P:0.01911 F:0.02356
59CENTROID ROUGE-4 Eval D0703-C.M.100.A-J.59CENTROID R:0.03413 P:0.02123 F:0.02618
59CENTROID ROUGE-4 Eval D0706-A.M.100.B-B.59CENTROID R:0.01338 P:0.00784 F:0.00989
59CENTROID ROUGE-4 Eval D0706-A.M.100.B-D.59CENTROID R:0.02357 P:0.01373 F:0.01735
59CENTROID ROUGE-4 Eval D0706-A.M.100.B-E.59CENTROID R:0.02341 P:0.01373 F:0.01731
59CENTROID ROUGE-4 Eval D0706-A.M.100.B-I.59CENTROID R:0.01003 P:0.00588 F:0.00741
59CENTROID ROUGE-4 Eval D0706-B.M.100.B-B.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0706-B.M.100.B-D.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0706-B.M.100.B-E.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0706-B.M.100.B-I.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0706-C.M.100.B-B.59CENTROID R:0.04319 P:0.02928 F:0.03490
59CENTROID ROUGE-4 Eval D0706-C.M.100.B-D.59CENTROID R:0.03322 P:0.02252 F:0.02684
59CENTROID ROUGE-4 Eval D0706-C.M.100.B-E.59CENTROID R:0.04290 P:0.02928 F:0.03480
59CENTROID ROUGE-4 Eval D0706-C.M.100.B-I.59CENTROID R:0.03947 P:0.02703 F:0.03209
59CENTROID ROUGE-4 Eval D0711-A.M.100.C-A.59CENTROID R:0.04746 P:0.03196 F:0.03820
59CENTROID ROUGE-4 Eval D0711-A.M.100.C-B.59CENTROID R:0.04124 P:0.02740 F:0.03292
59CENTROID ROUGE-4 Eval D0711-A.M.100.C-C.59CENTROID R:0.01718 P:0.01142 F:0.01372
59CENTROID ROUGE-4 Eval D0711-A.M.100.C-F.59CENTROID R:0.03754 P:0.02511 F:0.03009
59CENTROID ROUGE-4 Eval D0711-B.M.100.C-A.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0711-B.M.100.C-B.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0711-B.M.100.C-C.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0711-B.M.100.C-F.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0711-C.M.100.C-A.59CENTROID R:0.03741 P:0.02277 F:0.02831
59CENTROID ROUGE-4 Eval D0711-C.M.100.C-B.59CENTROID R:0.03521 P:0.02070 F:0.02607
59CENTROID ROUGE-4 Eval D0711-C.M.100.C-C.59CENTROID R:0.03484 P:0.02070 F:0.02597
59CENTROID ROUGE-4 Eval D0711-C.M.100.C-F.59CENTROID R:0.03833 P:0.02277 F:0.02857
59CENTROID ROUGE-4 Eval D0716-A.M.100.D-C.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0716-A.M.100.D-D.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0716-A.M.100.D-E.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0716-A.M.100.D-F.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0716-B.M.100.D-C.59CENTROID R:0.01356 P:0.00828 F:0.01028
59CENTROID ROUGE-4 Eval D0716-B.M.100.D-D.59CENTROID R:0.04152 P:0.02484 F:0.03108
59CENTROID ROUGE-4 Eval D0716-B.M.100.D-E.59CENTROID R:0.03425 P:0.02070 F:0.02580
59CENTROID ROUGE-4 Eval D0716-B.M.100.D-F.59CENTROID R:0.03436 P:0.02070 F:0.02584
59CENTROID ROUGE-4 Eval D0716-C.M.100.D-C.59CENTROID R:0.01007 P:0.00637 F:0.00780
59CENTROID ROUGE-4 Eval D0716-C.M.100.D-D.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0716-C.M.100.D-E.59CENTROID R:0.01020 P:0.00637 F:0.00784
59CENTROID ROUGE-4 Eval D0716-C.M.100.D-F.59CENTROID R:0.01031 P:0.00637 F:0.00787
59CENTROID ROUGE-4 Eval D0721-A.M.100.E-B.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0721-A.M.100.E-C.59CENTROID R:0.00334 P:0.00210 F:0.00258
59CENTROID ROUGE-4 Eval D0721-A.M.100.E-E.59CENTROID R:0.00334 P:0.00210 F:0.00258
59CENTROID ROUGE-4 Eval D0721-A.M.100.E-G.59CENTROID R:0.00328 P:0.00210 F:0.00256
59CENTROID ROUGE-4 Eval D0721-B.M.100.E-B.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0721-B.M.100.E-C.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0721-B.M.100.E-E.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0721-B.M.100.E-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0721-C.M.100.E-B.59CENTROID R:0.01689 P:0.01111 F:0.01340
59CENTROID ROUGE-4 Eval D0721-C.M.100.E-C.59CENTROID R:0.01361 P:0.00889 F:0.01075
59CENTROID ROUGE-4 Eval D0721-C.M.100.E-E.59CENTROID R:0.01718 P:0.01111 F:0.01349
59CENTROID ROUGE-4 Eval D0721-C.M.100.E-G.59CENTROID R:0.00336 P:0.00222 F:0.00267
59CENTROID ROUGE-4 Eval D0726-A.M.100.F-A.59CENTROID R:0.01370 P:0.00849 F:0.01048
59CENTROID ROUGE-4 Eval D0726-A.M.100.F-E.59CENTROID R:0.01375 P:0.00849 F:0.01050
59CENTROID ROUGE-4 Eval D0726-A.M.100.F-F.59CENTROID R:0.01027 P:0.00637 F:0.00786
59CENTROID ROUGE-4 Eval D0726-A.M.100.F-G.59CENTROID R:0.00342 P:0.00212 F:0.00262
59CENTROID ROUGE-4 Eval D0726-B.M.100.F-A.59CENTROID R:0.01010 P:0.00581 F:0.00738
59CENTROID ROUGE-4 Eval D0726-B.M.100.F-E.59CENTROID R:0.01027 P:0.00581 F:0.00742
59CENTROID ROUGE-4 Eval D0726-B.M.100.F-F.59CENTROID R:0.01027 P:0.00581 F:0.00742
59CENTROID ROUGE-4 Eval D0726-B.M.100.F-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0726-C.M.100.F-A.59CENTROID R:0.01718 P:0.01048 F:0.01302
59CENTROID ROUGE-4 Eval D0726-C.M.100.F-E.59CENTROID R:0.00694 P:0.00419 F:0.00523
59CENTROID ROUGE-4 Eval D0726-C.M.100.F-F.59CENTROID R:0.01748 P:0.01048 F:0.01310
59CENTROID ROUGE-4 Eval D0726-C.M.100.F-G.59CENTROID R:0.01014 P:0.00629 F:0.00776
59CENTROID ROUGE-4 Eval D0727-A.M.100.G-A.59CENTROID R:0.01027 P:0.00685 F:0.00822
59CENTROID ROUGE-4 Eval D0727-A.M.100.G-F.59CENTROID R:0.00678 P:0.00457 F:0.00546
59CENTROID ROUGE-4 Eval D0727-A.M.100.G-G.59CENTROID R:0.01010 P:0.00685 F:0.00816
59CENTROID ROUGE-4 Eval D0727-A.M.100.G-H.59CENTROID R:0.01356 P:0.00913 F:0.01091
59CENTROID ROUGE-4 Eval D0727-B.M.100.G-A.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0727-B.M.100.G-F.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0727-B.M.100.G-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0727-B.M.100.G-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0727-C.M.100.G-A.59CENTROID R:0.02349 P:0.01282 F:0.01659
59CENTROID ROUGE-4 Eval D0727-C.M.100.G-F.59CENTROID R:0.02083 P:0.01099 F:0.01439
59CENTROID ROUGE-4 Eval D0727-C.M.100.G-G.59CENTROID R:0.00340 P:0.00183 F:0.00238
59CENTROID ROUGE-4 Eval D0727-C.M.100.G-H.59CENTROID R:0.02439 P:0.01282 F:0.01681
59CENTROID ROUGE-4 Eval D0736-A.M.100.H-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-A.M.100.H-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-A.M.100.H-I.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-A.M.100.H-J.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-B.M.100.H-G.59CENTROID R:0.01581 P:0.00745 F:0.01013
59CENTROID ROUGE-4 Eval D0736-B.M.100.H-H.59CENTROID R:0.07296 P:0.03166 F:0.04416
59CENTROID ROUGE-4 Eval D0736-B.M.100.H-I.59CENTROID R:0.08261 P:0.03538 F:0.04954
59CENTROID ROUGE-4 Eval D0736-B.M.100.H-J.59CENTROID R:0.07220 P:0.03724 F:0.04914
59CENTROID ROUGE-4 Eval D0736-C.M.100.H-G.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-C.M.100.H-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-C.M.100.H-I.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0736-C.M.100.H-J.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0740-A.M.100.I-D.59CENTROID R:0.00340 P:0.00211 F:0.00260
59CENTROID ROUGE-4 Eval D0740-A.M.100.I-H.59CENTROID R:0.00337 P:0.00211 F:0.00260
59CENTROID ROUGE-4 Eval D0740-A.M.100.I-I.59CENTROID R:0.00334 P:0.00211 F:0.00259
59CENTROID ROUGE-4 Eval D0740-A.M.100.I-J.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0740-B.M.100.I-D.59CENTROID R:0.00334 P:0.00197 F:0.00248
59CENTROID ROUGE-4 Eval D0740-B.M.100.I-H.59CENTROID R:0.00683 P:0.00394 F:0.00500
59CENTROID ROUGE-4 Eval D0740-B.M.100.I-I.59CENTROID R:0.00676 P:0.00394 F:0.00498
59CENTROID ROUGE-4 Eval D0740-B.M.100.I-J.59CENTROID R:0.00333 P:0.00197 F:0.00248
59CENTROID ROUGE-4 Eval D0740-C.M.100.I-D.59CENTROID R:0.00987 P:0.00592 F:0.00740
59CENTROID ROUGE-4 Eval D0740-C.M.100.I-H.59CENTROID R:0.01656 P:0.00986 F:0.01236
59CENTROID ROUGE-4 Eval D0740-C.M.100.I-I.59CENTROID R:0.02632 P:0.01578 F:0.01973
59CENTROID ROUGE-4 Eval D0740-C.M.100.I-J.59CENTROID R:0.02623 P:0.01578 F:0.01971
59CENTROID ROUGE-4 Eval D0743-A.M.100.J-B.59CENTROID R:0.00327 P:0.00233 F:0.00272
59CENTROID ROUGE-4 Eval D0743-A.M.100.J-H.59CENTROID R:0.00635 P:0.00466 F:0.00538
59CENTROID ROUGE-4 Eval D0743-A.M.100.J-I.59CENTROID R:0.00643 P:0.00466 F:0.00540
59CENTROID ROUGE-4 Eval D0743-A.M.100.J-J.59CENTROID R:0.00316 P:0.00233 F:0.00268
59CENTROID ROUGE-4 Eval D0743-B.M.100.J-B.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0743-B.M.100.J-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0743-B.M.100.J-I.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0743-B.M.100.J-J.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0743-C.M.100.J-B.59CENTROID R:0.00654 P:0.00381 F:0.00481
59CENTROID ROUGE-4 Eval D0743-C.M.100.J-H.59CENTROID R:0.00000 P:0.00000 F:0.00000
59CENTROID ROUGE-4 Eval D0743-C.M.100.J-I.59CENTROID R:0.00658 P:0.00381 F:0.00483
59CENTROID ROUGE-4 Eval D0743-C.M.100.J-J.59CENTROID R:0.00647 P:0.00381 F:0.00480
---------------------------------------------
59CENTROID ROUGE-L Average_R: 0.30348 (95%-conf.int. 0.29556 - 0.31096)
59CENTROID ROUGE-L Average_P: 0.18400 (95%-conf.int. 0.17846 - 0.18935)
59CENTROID ROUGE-L Average_F: 0.22836 (95%-conf.int. 0.22192 - 0.23460)
.............................................
59CENTROID ROUGE-L Eval D0703-A.M.100.A-A.59CENTROID R:0.28378 P:0.17722 F:0.21818
59CENTROID ROUGE-L Eval D0703-A.M.100.A-C.59CENTROID R:0.23826 P:0.14979 F:0.18394
59CENTROID ROUGE-L Eval D0703-A.M.100.A-D.59CENTROID R:0.26804 P:0.16456 F:0.20392
59CENTROID ROUGE-L Eval D0703-A.M.100.A-J.59CENTROID R:0.26871 P:0.16667 F:0.20573
59CENTROID ROUGE-L Eval D0703-B.M.100.A-A.59CENTROID R:0.32353 P:0.21854 F:0.26087
59CENTROID ROUGE-L Eval D0703-B.M.100.A-C.59CENTROID R:0.33557 P:0.22075 F:0.26631
59CENTROID ROUGE-L Eval D0703-B.M.100.A-D.59CENTROID R:0.31208 P:0.20530 F:0.24767
59CENTROID ROUGE-L Eval D0703-B.M.100.A-J.59CENTROID R:0.31561 P:0.20971 F:0.25199
59CENTROID ROUGE-L Eval D0703-C.M.100.A-A.59CENTROID R:0.34667 P:0.21667 F:0.26667
59CENTROID ROUGE-L Eval D0703-C.M.100.A-C.59CENTROID R:0.28247 P:0.18125 F:0.22081
59CENTROID ROUGE-L Eval D0703-C.M.100.A-D.59CENTROID R:0.31788 P:0.20000 F:0.24552
59CENTROID ROUGE-L Eval D0703-C.M.100.A-J.59CENTROID R:0.36093 P:0.22708 F:0.27877
59CENTROID ROUGE-L Eval D0706-A.M.100.B-B.59CENTROID R:0.32468 P:0.19268 F:0.24184
59CENTROID ROUGE-L Eval D0706-A.M.100.B-D.59CENTROID R:0.30392 P:0.17919 F:0.22545
59CENTROID ROUGE-L Eval D0706-A.M.100.B-E.59CENTROID R:0.31494 P:0.18690 F:0.23459
59CENTROID ROUGE-L Eval D0706-A.M.100.B-I.59CENTROID R:0.30519 P:0.18112 F:0.22733
59CENTROID ROUGE-L Eval D0706-B.M.100.B-B.59CENTROID R:0.28758 P:0.17054 F:0.21411
59CENTROID ROUGE-L Eval D0706-B.M.100.B-D.59CENTROID R:0.29967 P:0.17829 F:0.22357
59CENTROID ROUGE-L Eval D0706-B.M.100.B-E.59CENTROID R:0.28571 P:0.17054 F:0.21359
59CENTROID ROUGE-L Eval D0706-B.M.100.B-I.59CENTROID R:0.30744 P:0.18411 F:0.23030
59CENTROID ROUGE-L Eval D0706-C.M.100.B-B.59CENTROID R:0.32581 P:0.22296 F:0.26475
59CENTROID ROUGE-L Eval D0706-C.M.100.B-D.59CENTROID R:0.30968 P:0.21192 F:0.25164
59CENTROID ROUGE-L Eval D0706-C.M.100.B-E.59CENTROID R:0.31410 P:0.21634 F:0.25621
59CENTROID ROUGE-L Eval D0706-C.M.100.B-I.59CENTROID R:0.32268 P:0.22296 F:0.26371
59CENTROID ROUGE-L Eval D0711-A.M.100.C-A.59CENTROID R:0.33882 P:0.23043 F:0.27431
59CENTROID ROUGE-L Eval D0711-A.M.100.C-B.59CENTROID R:0.29667 P:0.19911 F:0.23829
59CENTROID ROUGE-L Eval D0711-A.M.100.C-C.59CENTROID R:0.28000 P:0.18792 F:0.22490
59CENTROID ROUGE-L Eval D0711-A.M.100.C-F.59CENTROID R:0.27815 P:0.18792 F:0.22430
59CENTROID ROUGE-L Eval D0711-B.M.100.C-A.59CENTROID R:0.24830 P:0.15304 F:0.18936
59CENTROID ROUGE-L Eval D0711-B.M.100.C-B.59CENTROID R:0.26027 P:0.15933 F:0.19766
59CENTROID ROUGE-L Eval D0711-B.M.100.C-C.59CENTROID R:0.23826 P:0.14885 F:0.18323
59CENTROID ROUGE-L Eval D0711-B.M.100.C-F.59CENTROID R:0.28136 P:0.17400 F:0.21502
59CENTROID ROUGE-L Eval D0711-C.M.100.C-A.59CENTROID R:0.33663 P:0.20732 F:0.25660
59CENTROID ROUGE-L Eval D0711-C.M.100.C-B.59CENTROID R:0.34471 P:0.20528 F:0.25732
59CENTROID ROUGE-L Eval D0711-C.M.100.C-C.59CENTROID R:0.33108 P:0.19919 F:0.24873
59CENTROID ROUGE-L Eval D0711-C.M.100.C-F.59CENTROID R:0.31081 P:0.18699 F:0.23350
59CENTROID ROUGE-L Eval D0716-A.M.100.D-C.59CENTROID R:0.28197 P:0.16963 F:0.21183
59CENTROID ROUGE-L Eval D0716-A.M.100.D-D.59CENTROID R:0.29667 P:0.17554 F:0.22057
59CENTROID ROUGE-L Eval D0716-A.M.100.D-E.59CENTROID R:0.26910 P:0.15976 F:0.20049
59CENTROID ROUGE-L Eval D0716-A.M.100.D-F.59CENTROID R:0.25413 P:0.15187 F:0.19012
59CENTROID ROUGE-L Eval D0716-B.M.100.D-C.59CENTROID R:0.32566 P:0.20122 F:0.24874
59CENTROID ROUGE-L Eval D0716-B.M.100.D-D.59CENTROID R:0.39597 P:0.23984 F:0.29874
59CENTROID ROUGE-L Eval D0716-B.M.100.D-E.59CENTROID R:0.36545 P:0.22358 F:0.27743
59CENTROID ROUGE-L Eval D0716-B.M.100.D-F.59CENTROID R:0.37000 P:0.22561 F:0.28030
59CENTROID ROUGE-L Eval D0716-C.M.100.D-C.59CENTROID R:0.35179 P:0.22500 F:0.27446
59CENTROID ROUGE-L Eval D0716-C.M.100.D-D.59CENTROID R:0.33779 P:0.21042 F:0.25931
59CENTROID ROUGE-L Eval D0716-C.M.100.D-E.59CENTROID R:0.36634 P:0.23125 F:0.28353
59CENTROID ROUGE-L Eval D0716-C.M.100.D-F.59CENTROID R:0.36333 P:0.22708 F:0.27948
59CENTROID ROUGE-L Eval D0721-A.M.100.E-B.59CENTROID R:0.28333 P:0.17490 F:0.21629
59CENTROID ROUGE-L Eval D0721-A.M.100.E-C.59CENTROID R:0.28896 P:0.18313 F:0.22418
59CENTROID ROUGE-L Eval D0721-A.M.100.E-E.59CENTROID R:0.25649 P:0.16255 F:0.19899
59CENTROID ROUGE-L Eval D0721-A.M.100.E-G.59CENTROID R:0.27389 P:0.17695 F:0.21500
59CENTROID ROUGE-L Eval D0721-B.M.100.E-B.59CENTROID R:0.30619 P:0.18112 F:0.22761
59CENTROID ROUGE-L Eval D0721-B.M.100.E-C.59CENTROID R:0.34395 P:0.20809 F:0.25930
59CENTROID ROUGE-L Eval D0721-B.M.100.E-E.59CENTROID R:0.30820 P:0.18112 F:0.22816
59CENTROID ROUGE-L Eval D0721-B.M.100.E-G.59CENTROID R:0.31290 P:0.18690 F:0.23402
59CENTROID ROUGE-L Eval D0721-C.M.100.E-B.59CENTROID R:0.24918 P:0.16558 F:0.19895
59CENTROID ROUGE-L Eval D0721-C.M.100.E-C.59CENTROID R:0.19142 P:0.12636 F:0.15223
59CENTROID ROUGE-L Eval D0721-C.M.100.E-E.59CENTROID R:0.21667 P:0.14161 F:0.17128
59CENTROID ROUGE-L Eval D0721-C.M.100.E-G.59CENTROID R:0.18241 P:0.12200 F:0.14621
59CENTROID ROUGE-L Eval D0726-A.M.100.F-A.59CENTROID R:0.29568 P:0.18542 F:0.22792
59CENTROID ROUGE-L Eval D0726-A.M.100.F-E.59CENTROID R:0.30667 P:0.19167 F:0.23590
59CENTROID ROUGE-L Eval D0726-A.M.100.F-F.59CENTROID R:0.30897 P:0.19375 F:0.23816
59CENTROID ROUGE-L Eval D0726-A.M.100.F-G.59CENTROID R:0.29568 P:0.18542 F:0.22792
59CENTROID ROUGE-L Eval D0726-B.M.100.F-A.59CENTROID R:0.27778 P:0.16190 F:0.20457
59CENTROID ROUGE-L Eval D0726-B.M.100.F-E.59CENTROID R:0.26910 P:0.15429 F:0.19613
59CENTROID ROUGE-L Eval D0726-B.M.100.F-F.59CENTROID R:0.24585 P:0.14095 F:0.17918
59CENTROID ROUGE-L Eval D0726-B.M.100.F-G.59CENTROID R:0.25658 P:0.14857 F:0.18818
59CENTROID ROUGE-L Eval D0726-C.M.100.F-A.59CENTROID R:0.36000 P:0.22222 F:0.27481
59CENTROID ROUGE-L Eval D0726-C.M.100.F-E.59CENTROID R:0.32997 P:0.20165 F:0.25032
59CENTROID ROUGE-L Eval D0726-C.M.100.F-F.59CENTROID R:0.35593 P:0.21605 F:0.26889
59CENTROID ROUGE-L Eval D0726-C.M.100.F-G.59CENTROID R:0.34754 P:0.21811 F:0.26802
59CENTROID ROUGE-L Eval D0727-A.M.100.G-A.59CENTROID R:0.39867 P:0.26846 F:0.32086
59CENTROID ROUGE-L Eval D0727-A.M.100.G-F.59CENTROID R:0.37500 P:0.25503 F:0.30359
59CENTROID ROUGE-L Eval D0727-A.M.100.G-G.59CENTROID R:0.38562 P:0.26398 F:0.31341
59CENTROID ROUGE-L Eval D0727-A.M.100.G-H.59CENTROID R:0.37171 P:0.25280 F:0.30093
59CENTROID ROUGE-L Eval D0727-B.M.100.G-A.59CENTROID R:0.29897 P:0.16959 F:0.21642
59CENTROID ROUGE-L Eval D0727-B.M.100.G-F.59CENTROID R:0.29870 P:0.17934 F:0.22412
59CENTROID ROUGE-L Eval D0727-B.M.100.G-G.59CENTROID R:0.27682 P:0.15595 F:0.19951
59CENTROID ROUGE-L Eval D0727-B.M.100.G-H.59CENTROID R:0.28522 P:0.16179 F:0.20646
59CENTROID ROUGE-L Eval D0727-C.M.100.G-A.59CENTROID R:0.34528 P:0.19099 F:0.24594
59CENTROID ROUGE-L Eval D0727-C.M.100.G-F.59CENTROID R:0.36364 P:0.19459 F:0.25352
59CENTROID ROUGE-L Eval D0727-C.M.100.G-G.59CENTROID R:0.33993 P:0.18559 F:0.24010
59CENTROID ROUGE-L Eval D0727-C.M.100.G-H.59CENTROID R:0.36824 P:0.19640 F:0.25617
59CENTROID ROUGE-L Eval D0736-A.M.100.H-G.59CENTROID R:0.31183 P:0.18239 F:0.23016
59CENTROID ROUGE-L Eval D0736-A.M.100.H-H.59CENTROID R:0.31752 P:0.18239 F:0.23169
59CENTROID ROUGE-L Eval D0736-A.M.100.H-I.59CENTROID R:0.32384 P:0.19078 F:0.24011
59CENTROID ROUGE-L Eval D0736-A.M.100.H-J.59CENTROID R:0.32026 P:0.20545 F:0.25032
59CENTROID ROUGE-L Eval D0736-B.M.100.H-G.59CENTROID R:0.29389 P:0.14103 F:0.19060
59CENTROID ROUGE-L Eval D0736-B.M.100.H-H.59CENTROID R:0.32645 P:0.14469 F:0.20051
59CENTROID ROUGE-L Eval D0736-B.M.100.H-I.59CENTROID R:0.36402 P:0.15934 F:0.22166
59CENTROID ROUGE-L Eval D0736-B.M.100.H-J.59CENTROID R:0.34615 P:0.18132 F:0.23798
59CENTROID ROUGE-L Eval D0736-C.M.100.H-G.59CENTROID R:0.29114 P:0.11165 F:0.16140
59CENTROID ROUGE-L Eval D0736-C.M.100.H-H.59CENTROID R:0.28877 P:0.08738 F:0.13416
59CENTROID ROUGE-L Eval D0736-C.M.100.H-I.59CENTROID R:0.33690 P:0.10194 F:0.15652
59CENTROID ROUGE-L Eval D0736-C.M.100.H-J.59CENTROID R:0.29434 P:0.12621 F:0.17667
59CENTROID ROUGE-L Eval D0740-A.M.100.I-D.59CENTROID R:0.34653 P:0.21739 F:0.26717
59CENTROID ROUGE-L Eval D0740-A.M.100.I-H.59CENTROID R:0.31699 P:0.20083 F:0.24588
59CENTROID ROUGE-L Eval D0740-A.M.100.I-I.59CENTROID R:0.32143 P:0.20497 F:0.25032
59CENTROID ROUGE-L Eval D0740-A.M.100.I-J.59CENTROID R:0.31613 P:0.20290 F:0.24716
59CENTROID ROUGE-L Eval D0740-B.M.100.I-D.59CENTROID R:0.28896 P:0.17248 F:0.21602
59CENTROID ROUGE-L Eval D0740-B.M.100.I-H.59CENTROID R:0.28477 P:0.16667 F:0.21027
59CENTROID ROUGE-L Eval D0740-B.M.100.I-I.59CENTROID R:0.30164 P:0.17829 F:0.22411
59CENTROID ROUGE-L Eval D0740-B.M.100.I-J.59CENTROID R:0.28155 P:0.16860 F:0.21090
59CENTROID ROUGE-L Eval D0740-C.M.100.I-D.59CENTROID R:0.31310 P:0.18992 F:0.23643
59CENTROID ROUGE-L Eval D0740-C.M.100.I-H.59CENTROID R:0.32476 P:0.19574 F:0.24426
59CENTROID ROUGE-L Eval D0740-C.M.100.I-I.59CENTROID R:0.33546 P:0.20349 F:0.25332
59CENTROID ROUGE-L Eval D0740-C.M.100.I-J.59CENTROID R:0.34076 P:0.20736 F:0.25783
59CENTROID ROUGE-L Eval D0743-A.M.100.J-B.59CENTROID R:0.18730 P:0.13470 F:0.15670
59CENTROID ROUGE-L Eval D0743-A.M.100.J-H.59CENTROID R:0.25926 P:0.19178 F:0.22047
59CENTROID ROUGE-L Eval D0743-A.M.100.J-I.59CENTROID R:0.24063 P:0.17580 F:0.20317
59CENTROID ROUGE-L Eval D0743-A.M.100.J-J.59CENTROID R:0.23692 P:0.17580 F:0.20183
59CENTROID ROUGE-L Eval D0743-B.M.100.J-B.59CENTROID R:0.25962 P:0.15429 F:0.19355
59CENTROID ROUGE-L Eval D0743-B.M.100.J-H.59CENTROID R:0.23975 P:0.14476 F:0.18052
59CENTROID ROUGE-L Eval D0743-B.M.100.J-I.59CENTROID R:0.24051 P:0.14476 F:0.18074
59CENTROID ROUGE-L Eval D0743-B.M.100.J-J.59CENTROID R:0.22741 P:0.13905 F:0.17258
59CENTROID ROUGE-L Eval D0743-C.M.100.J-B.59CENTROID R:0.29206 P:0.17228 F:0.21672
59CENTROID ROUGE-L Eval D0743-C.M.100.J-H.59CENTROID R:0.25159 P:0.14794 F:0.18632
59CENTROID ROUGE-L Eval D0743-C.M.100.J-I.59CENTROID R:0.28435 P:0.16667 F:0.21016
59CENTROID ROUGE-L Eval D0743-C.M.100.J-J.59CENTROID R:0.25786 P:0.15356 F:0.19249
---------------------------------------------
59CENTROID ROUGE-W-1.2 Average_R: 0.10625 (95%-conf.int. 0.10378 - 0.10865)
59CENTROID ROUGE-W-1.2 Average_P: 0.11679 (95%-conf.int. 0.11348 - 0.11997)
59CENTROID ROUGE-W-1.2 Average_F: 0.11086 (95%-conf.int. 0.10814 - 0.11356)
.............................................
59CENTROID ROUGE-W-1.2 Eval D0703-A.M.100.A-A.59CENTROID R:0.09988 P:0.11231 F:0.10573
59CENTROID ROUGE-W-1.2 Eval D0703-A.M.100.A-C.59CENTROID R:0.08358 P:0.09551 F:0.08915
59CENTROID ROUGE-W-1.2 Eval D0703-A.M.100.A-D.59CENTROID R:0.09256 P:0.10477 F:0.09829
59CENTROID ROUGE-W-1.2 Eval D0703-A.M.100.A-J.59CENTROID R:0.10076 P:0.10691 F:0.10374
59CENTROID ROUGE-W-1.2 Eval D0703-B.M.100.A-A.59CENTROID R:0.11202 P:0.14031 F:0.12458
59CENTROID ROUGE-W-1.2 Eval D0703-B.M.100.A-C.59CENTROID R:0.11521 P:0.14342 F:0.12778
59CENTROID ROUGE-W-1.2 Eval D0703-B.M.100.A-D.59CENTROID R:0.10610 P:0.13092 F:0.11721
59CENTROID ROUGE-W-1.2 Eval D0703-B.M.100.A-J.59CENTROID R:0.11209 P:0.13814 F:0.12376
59CENTROID ROUGE-W-1.2 Eval D0703-C.M.100.A-A.59CENTROID R:0.11638 P:0.13524 F:0.12510
59CENTROID ROUGE-W-1.2 Eval D0703-C.M.100.A-C.59CENTROID R:0.09319 P:0.11290 F:0.10210
59CENTROID ROUGE-W-1.2 Eval D0703-C.M.100.A-D.59CENTROID R:0.10817 P:0.12917 F:0.11774
59CENTROID ROUGE-W-1.2 Eval D0703-C.M.100.A-J.59CENTROID R:0.12463 P:0.14123 F:0.13241
59CENTROID ROUGE-W-1.2 Eval D0706-A.M.100.B-B.59CENTROID R:0.11541 P:0.12292 F:0.11905
59CENTROID ROUGE-W-1.2 Eval D0706-A.M.100.B-D.59CENTROID R:0.10907 P:0.11800 F:0.11336
59CENTROID ROUGE-W-1.2 Eval D0706-A.M.100.B-E.59CENTROID R:0.11200 P:0.12053 F:0.11611
59CENTROID ROUGE-W-1.2 Eval D0706-A.M.100.B-I.59CENTROID R:0.10555 P:0.11608 F:0.11056
59CENTROID ROUGE-W-1.2 Eval D0706-B.M.100.B-B.59CENTROID R:0.10293 P:0.10572 F:0.10431
59CENTROID ROUGE-W-1.2 Eval D0706-B.M.100.B-D.59CENTROID R:0.10374 P:0.10884 F:0.10623
59CENTROID ROUGE-W-1.2 Eval D0706-B.M.100.B-E.59CENTROID R:0.10105 P:0.10646 F:0.10368
59CENTROID ROUGE-W-1.2 Eval D0706-B.M.100.B-I.59CENTROID R:0.10348 P:0.11206 F:0.10760
59CENTROID ROUGE-W-1.2 Eval D0706-C.M.100.B-B.59CENTROID R:0.11900 P:0.13899 F:0.12822
59CENTROID ROUGE-W-1.2 Eval D0706-C.M.100.B-D.59CENTROID R:0.10964 P:0.12915 F:0.11860
59CENTROID ROUGE-W-1.2 Eval D0706-C.M.100.B-E.59CENTROID R:0.11491 P:0.13407 F:0.12375
59CENTROID ROUGE-W-1.2 Eval D0706-C.M.100.B-I.59CENTROID R:0.11603 P:0.13924 F:0.12658
59CENTROID ROUGE-W-1.2 Eval D0711-A.M.100.C-A.59CENTROID R:0.12586 P:0.15432 F:0.13864
59CENTROID ROUGE-W-1.2 Eval D0711-A.M.100.C-B.59CENTROID R:0.11038 P:0.13418 F:0.12112
59CENTROID ROUGE-W-1.2 Eval D0711-A.M.100.C-C.59CENTROID R:0.10516 P:0.12674 F:0.11495
59CENTROID ROUGE-W-1.2 Eval D0711-A.M.100.C-F.59CENTROID R:0.10496 P:0.12864 F:0.11560
59CENTROID ROUGE-W-1.2 Eval D0711-B.M.100.C-A.59CENTROID R:0.08868 P:0.09751 F:0.09289
59CENTROID ROUGE-W-1.2 Eval D0711-B.M.100.C-B.59CENTROID R:0.08725 P:0.10009 F:0.09323
59CENTROID ROUGE-W-1.2 Eval D0711-B.M.100.C-C.59CENTROID R:0.08048 P:0.09445 F:0.08691
59CENTROID ROUGE-W-1.2 Eval D0711-B.M.100.C-F.59CENTROID R:0.09633 P:0.11064 F:0.10299
59CENTROID ROUGE-W-1.2 Eval D0711-C.M.100.C-A.59CENTROID R:0.11417 P:0.13146 F:0.12221
59CENTROID ROUGE-W-1.2 Eval D0711-C.M.100.C-B.59CENTROID R:0.11529 P:0.12839 F:0.12149
59CENTROID ROUGE-W-1.2 Eval D0711-C.M.100.C-C.59CENTROID R:0.10889 P:0.12439 F:0.11613
59CENTROID ROUGE-W-1.2 Eval D0711-C.M.100.C-F.59CENTROID R:0.10560 P:0.12244 F:0.11340
59CENTROID ROUGE-W-1.2 Eval D0716-A.M.100.D-C.59CENTROID R:0.09628 P:0.10582 F:0.10082
59CENTROID ROUGE-W-1.2 Eval D0716-A.M.100.D-D.59CENTROID R:0.10055 P:0.11335 F:0.10657
59CENTROID ROUGE-W-1.2 Eval D0716-A.M.100.D-E.59CENTROID R:0.09387 P:0.10407 F:0.09871
59CENTROID ROUGE-W-1.2 Eval D0716-A.M.100.D-F.59CENTROID R:0.08787 P:0.09986 F:0.09348
59CENTROID ROUGE-W-1.2 Eval D0716-B.M.100.D-C.59CENTROID R:0.11593 P:0.12496 F:0.12028
59CENTROID ROUGE-W-1.2 Eval D0716-B.M.100.D-D.59CENTROID R:0.13709 P:0.14860 F:0.14261
59CENTROID ROUGE-W-1.2 Eval D0716-B.M.100.D-E.59CENTROID R:0.12599 P:0.13722 F:0.13137
59CENTROID ROUGE-W-1.2 Eval D0716-B.M.100.D-F.59CENTROID R:0.13039 P:0.14072 F:0.13536
59CENTROID ROUGE-W-1.2 Eval D0716-C.M.100.D-C.59CENTROID R:0.12185 P:0.14526 F:0.13253
59CENTROID ROUGE-W-1.2 Eval D0716-C.M.100.D-D.59CENTROID R:0.11076 P:0.13380 F:0.12119
59CENTROID ROUGE-W-1.2 Eval D0716-C.M.100.D-E.59CENTROID R:0.12034 P:0.14722 F:0.13243
59CENTROID ROUGE-W-1.2 Eval D0716-C.M.100.D-F.59CENTROID R:0.12054 P:0.14656 F:0.13228
59CENTROID ROUGE-W-1.2 Eval D0721-A.M.100.E-B.59CENTROID R:0.10049 P:0.10904 F:0.10459
59CENTROID ROUGE-W-1.2 Eval D0721-A.M.100.E-C.59CENTROID R:0.10246 P:0.11520 F:0.10846
59CENTROID ROUGE-W-1.2 Eval D0721-A.M.100.E-E.59CENTROID R:0.08918 P:0.10153 F:0.09496
59CENTROID ROUGE-W-1.2 Eval D0721-A.M.100.E-G.59CENTROID R:0.09887 P:0.11194 F:0.10500
59CENTROID ROUGE-W-1.2 Eval D0721-B.M.100.E-B.59CENTROID R:0.09920 P:0.11344 F:0.10584
59CENTROID ROUGE-W-1.2 Eval D0721-B.M.100.E-C.59CENTROID R:0.11429 P:0.12996 F:0.12162
59CENTROID ROUGE-W-1.2 Eval D0721-B.M.100.E-E.59CENTROID R:0.09721 P:0.11213 F:0.10414
59CENTROID ROUGE-W-1.2 Eval D0721-B.M.100.E-G.59CENTROID R:0.09673 P:0.11531 F:0.10521
59CENTROID ROUGE-W-1.2 Eval D0721-C.M.100.E-B.59CENTROID R:0.08990 P:0.10995 F:0.09892
59CENTROID ROUGE-W-1.2 Eval D0721-C.M.100.E-C.59CENTROID R:0.06989 P:0.08680 F:0.07743
59CENTROID ROUGE-W-1.2 Eval D0721-C.M.100.E-E.59CENTROID R:0.08072 P:0.09847 F:0.08872
59CENTROID ROUGE-W-1.2 Eval D0721-C.M.100.E-G.59CENTROID R:0.06494 P:0.08122 F:0.07217
59CENTROID ROUGE-W-1.2 Eval D0726-A.M.100.F-A.59CENTROID R:0.10800 P:0.12002 F:0.11369
59CENTROID ROUGE-W-1.2 Eval D0726-A.M.100.F-E.59CENTROID R:0.11560 P:0.12658 F:0.12084
59CENTROID ROUGE-W-1.2 Eval D0726-A.M.100.F-F.59CENTROID R:0.10925 P:0.12202 F:0.11528
59CENTROID ROUGE-W-1.2 Eval D0726-A.M.100.F-G.59CENTROID R:0.10682 P:0.12125 F:0.11358
59CENTROID ROUGE-W-1.2 Eval D0726-B.M.100.F-A.59CENTROID R:0.10079 P:0.10333 F:0.10204
59CENTROID ROUGE-W-1.2 Eval D0726-B.M.100.F-E.59CENTROID R:0.09786 P:0.10128 F:0.09954
59CENTROID ROUGE-W-1.2 Eval D0726-B.M.100.F-F.59CENTROID R:0.08876 P:0.09246 F:0.09057
59CENTROID ROUGE-W-1.2 Eval D0726-B.M.100.F-G.59CENTROID R:0.09293 P:0.09716 F:0.09500
59CENTROID ROUGE-W-1.2 Eval D0726-C.M.100.F-A.59CENTROID R:0.12024 P:0.13034 F:0.12509
59CENTROID ROUGE-W-1.2 Eval D0726-C.M.100.F-E.59CENTROID R:0.11114 P:0.11987 F:0.11534
59CENTROID ROUGE-W-1.2 Eval D0726-C.M.100.F-F.59CENTROID R:0.12121 P:0.13175 F:0.12626
59CENTROID ROUGE-W-1.2 Eval D0726-C.M.100.F-G.59CENTROID R:0.11491 P:0.12913 F:0.12161
59CENTROID ROUGE-W-1.2 Eval D0727-A.M.100.G-A.59CENTROID R:0.13425 P:0.15911 F:0.14563
59CENTROID ROUGE-W-1.2 Eval D0727-A.M.100.G-F.59CENTROID R:0.12283 P:0.15248 F:0.13606
59CENTROID ROUGE-W-1.2 Eval D0727-A.M.100.G-G.59CENTROID R:0.12607 P:0.15284 F:0.13817
59CENTROID ROUGE-W-1.2 Eval D0727-A.M.100.G-H.59CENTROID R:0.13182 P:0.16070 F:0.14483
59CENTROID ROUGE-W-1.2 Eval D0727-B.M.100.G-A.59CENTROID R:0.10465 P:0.10416 F:0.10440
59CENTROID ROUGE-W-1.2 Eval D0727-B.M.100.G-F.59CENTROID R:0.10255 P:0.11060 F:0.10642
59CENTROID ROUGE-W-1.2 Eval D0727-B.M.100.G-G.59CENTROID R:0.09578 P:0.09664 F:0.09621
59CENTROID ROUGE-W-1.2 Eval D0727-B.M.100.G-H.59CENTROID R:0.10083 P:0.10124 F:0.10103
59CENTROID ROUGE-W-1.2 Eval D0727-C.M.100.G-A.59CENTROID R:0.12493 P:0.12428 F:0.12460
59CENTROID ROUGE-W-1.2 Eval D0727-C.M.100.G-F.59CENTROID R:0.12819 P:0.12679 F:0.12749
59CENTROID ROUGE-W-1.2 Eval D0727-C.M.100.G-G.59CENTROID R:0.11631 P:0.11689 F:0.11660
59CENTROID ROUGE-W-1.2 Eval D0727-C.M.100.G-H.59CENTROID R:0.13203 P:0.12674 F:0.12933
59CENTROID ROUGE-W-1.2 Eval D0736-A.M.100.H-G.59CENTROID R:0.10912 P:0.11303 F:0.11104
59CENTROID ROUGE-W-1.2 Eval D0736-A.M.100.H-H.59CENTROID R:0.11280 P:0.11395 F:0.11337
59CENTROID ROUGE-W-1.2 Eval D0736-A.M.100.H-I.59CENTROID R:0.11115 P:0.11699 F:0.11400
59CENTROID ROUGE-W-1.2 Eval D0736-A.M.100.H-J.59CENTROID R:0.11015 P:0.12597 F:0.11753
59CENTROID ROUGE-W-1.2 Eval D0736-B.M.100.H-G.59CENTROID R:0.09837 P:0.08738 F:0.09255
59CENTROID ROUGE-W-1.2 Eval D0736-B.M.100.H-H.59CENTROID R:0.11931 P:0.09784 F:0.10751
59CENTROID ROUGE-W-1.2 Eval D0736-B.M.100.H-I.59CENTROID R:0.14199 P:0.11479 F:0.12695
59CENTROID ROUGE-W-1.2 Eval D0736-B.M.100.H-J.59CENTROID R:0.12391 P:0.11999 F:0.12192
59CENTROID ROUGE-W-1.2 Eval D0736-C.M.100.H-G.59CENTROID R:0.10176 P:0.07089 F:0.08357
59CENTROID ROUGE-W-1.2 Eval D0736-C.M.100.H-H.59CENTROID R:0.09961 P:0.05633 F:0.07196
59CENTROID ROUGE-W-1.2 Eval D0736-C.M.100.H-I.59CENTROID R:0.12412 P:0.06851 F:0.08829
59CENTROID ROUGE-W-1.2 Eval D0736-C.M.100.H-J.59CENTROID R:0.10088 P:0.07718 F:0.08745
59CENTROID ROUGE-W-1.2 Eval D0740-A.M.100.I-D.59CENTROID R:0.12099 P:0.13961 F:0.12963
59CENTROID ROUGE-W-1.2 Eval D0740-A.M.100.I-H.59CENTROID R:0.11107 P:0.12695 F:0.11848
59CENTROID ROUGE-W-1.2 Eval D0740-A.M.100.I-I.59CENTROID R:0.11129 P:0.13127 F:0.12046
59CENTROID ROUGE-W-1.2 Eval D0740-A.M.100.I-J.59CENTROID R:0.10923 P:0.12879 F:0.11821
59CENTROID ROUGE-W-1.2 Eval D0740-B.M.100.I-D.59CENTROID R:0.10200 P:0.11186 F:0.10670
59CENTROID ROUGE-W-1.2 Eval D0740-B.M.100.I-H.59CENTROID R:0.10364 P:0.10795 F:0.10575
59CENTROID ROUGE-W-1.2 Eval D0740-B.M.100.I-I.59CENTROID R:0.10554 P:0.11722 F:0.11107
59CENTROID ROUGE-W-1.2 Eval D0740-B.M.100.I-J.59CENTROID R:0.10168 P:0.10886 F:0.10515
59CENTROID ROUGE-W-1.2 Eval D0740-C.M.100.I-D.59CENTROID R:0.10151 P:0.11884 F:0.10949
59CENTROID ROUGE-W-1.2 Eval D0740-C.M.100.I-H.59CENTROID R:0.11059 P:0.12439 F:0.11708
59CENTROID ROUGE-W-1.2 Eval D0740-C.M.100.I-I.59CENTROID R:0.10977 P:0.13022 F:0.11912
59CENTROID ROUGE-W-1.2 Eval D0740-C.M.100.I-J.59CENTROID R:0.11159 P:0.13012 F:0.12014
59CENTROID ROUGE-W-1.2 Eval D0743-A.M.100.J-B.59CENTROID R:0.07126 P:0.08933 F:0.07928
59CENTROID ROUGE-W-1.2 Eval D0743-A.M.100.J-H.59CENTROID R:0.09631 P:0.12307 F:0.10806
59CENTROID ROUGE-W-1.2 Eval D0743-A.M.100.J-I.59CENTROID R:0.08818 P:0.11432 F:0.09956
59CENTROID ROUGE-W-1.2 Eval D0743-A.M.100.J-J.59CENTROID R:0.08900 P:0.11464 F:0.10021
59CENTROID ROUGE-W-1.2 Eval D0743-B.M.100.J-B.59CENTROID R:0.09606 P:0.09560 F:0.09583
59CENTROID ROUGE-W-1.2 Eval D0743-B.M.100.J-H.59CENTROID R:0.09268 P:0.09280 F:0.09274
59CENTROID ROUGE-W-1.2 Eval D0743-B.M.100.J-I.59CENTROID R:0.08942 P:0.09071 F:0.09006
59CENTROID ROUGE-W-1.2 Eval D0743-B.M.100.J-J.59CENTROID R:0.08837 P:0.08883 F:0.08860
59CENTROID ROUGE-W-1.2 Eval D0743-C.M.100.J-B.59CENTROID R:0.10341 P:0.10677 F:0.10506
59CENTROID ROUGE-W-1.2 Eval D0743-C.M.100.J-H.59CENTROID R:0.09298 P:0.09130 F:0.09213
59CENTROID ROUGE-W-1.2 Eval D0743-C.M.100.J-I.59CENTROID R:0.10081 P:0.10530 F:0.10301
59CENTROID ROUGE-W-1.2 Eval D0743-C.M.100.J-J.59CENTROID R:0.09556 P:0.09578 F:0.09567
---------------------------------------------
59CENTROID ROUGE-SU4 Average_R: 0.11532 (95%-conf.int. 0.11060 - 0.12016)
59CENTROID ROUGE-SU4 Average_P: 0.06936 (95%-conf.int. 0.06621 - 0.07240)
59CENTROID ROUGE-SU4 Average_F: 0.08635 (95%-conf.int. 0.08254 - 0.09000)
.............................................
59CENTROID ROUGE-SU4 Eval D0703-A.M.100.A-A.59CENTROID R:0.10301 P:0.06366 F:0.07869
59CENTROID ROUGE-SU4 Eval D0703-A.M.100.A-C.59CENTROID R:0.07586 P:0.04721 F:0.05820
59CENTROID ROUGE-SU4 Eval D0703-A.M.100.A-D.59CENTROID R:0.09246 P:0.05615 F:0.06987
59CENTROID ROUGE-SU4 Eval D0703-A.M.100.A-J.59CENTROID R:0.09324 P:0.05722 F:0.07092
59CENTROID ROUGE-SU4 Eval D0703-B.M.100.A-A.59CENTROID R:0.12304 P:0.08240 F:0.09870
59CENTROID ROUGE-SU4 Eval D0703-B.M.100.A-C.59CENTROID R:0.13046 P:0.08502 F:0.10295
59CENTROID ROUGE-SU4 Eval D0703-B.M.100.A-D.59CENTROID R:0.12184 P:0.07940 F:0.09614
59CENTROID ROUGE-SU4 Eval D0703-B.M.100.A-J.59CENTROID R:0.11832 P:0.07790 F:0.09395
59CENTROID ROUGE-SU4 Eval D0703-C.M.100.A-A.59CENTROID R:0.15297 P:0.09463 F:0.11693
59CENTROID ROUGE-SU4 Eval D0703-C.M.100.A-C.59CENTROID R:0.10778 P:0.06850 F:0.08376
59CENTROID ROUGE-SU4 Eval D0703-C.M.100.A-D.59CENTROID R:0.14342 P:0.08934 F:0.11010
59CENTROID ROUGE-SU4 Eval D0703-C.M.100.A-J.59CENTROID R:0.16100 P:0.10028 F:0.12358
59CENTROID ROUGE-SU4 Eval D0706-A.M.100.B-B.59CENTROID R:0.11611 P:0.06817 F:0.08590
59CENTROID ROUGE-SU4 Eval D0706-A.M.100.B-D.59CENTROID R:0.11298 P:0.06588 F:0.08323
59CENTROID ROUGE-SU4 Eval D0706-A.M.100.B-E.59CENTROID R:0.11389 P:0.06686 F:0.08426
59CENTROID ROUGE-SU4 Eval D0706-A.M.100.B-I.59CENTROID R:0.11111 P:0.06523 F:0.08220
59CENTROID ROUGE-SU4 Eval D0706-B.M.100.B-B.59CENTROID R:0.10235 P:0.06004 F:0.07568
59CENTROID ROUGE-SU4 Eval D0706-B.M.100.B-D.59CENTROID R:0.10089 P:0.05938 F:0.07476
59CENTROID ROUGE-SU4 Eval D0706-B.M.100.B-E.59CENTROID R:0.09222 P:0.05446 F:0.06848
59CENTROID ROUGE-SU4 Eval D0706-B.M.100.B-I.59CENTROID R:0.10687 P:0.06332 F:0.07952
59CENTROID ROUGE-SU4 Eval D0706-C.M.100.B-B.59CENTROID R:0.15011 P:0.10187 F:0.12137
59CENTROID ROUGE-SU4 Eval D0706-C.M.100.B-D.59CENTROID R:0.13411 P:0.09101 F:0.10843
59CENTROID ROUGE-SU4 Eval D0706-C.M.100.B-E.59CENTROID R:0.15241 P:0.10412 F:0.12372
59CENTROID ROUGE-SU4 Eval D0706-C.M.100.B-I.59CENTROID R:0.14372 P:0.09850 F:0.11689
59CENTROID ROUGE-SU4 Eval D0711-A.M.100.C-A.59CENTROID R:0.15597 P:0.10516 F:0.12562
59CENTROID ROUGE-SU4 Eval D0711-A.M.100.C-B.59CENTROID R:0.13584 P:0.09036 F:0.10853
59CENTROID ROUGE-SU4 Eval D0711-A.M.100.C-C.59CENTROID R:0.11986 P:0.07973 F:0.09576
59CENTROID ROUGE-SU4 Eval D0711-A.M.100.C-F.59CENTROID R:0.11961 P:0.08011 F:0.09595
59CENTROID ROUGE-SU4 Eval D0711-B.M.100.C-A.59CENTROID R:0.09033 P:0.05508 F:0.06843
59CENTROID ROUGE-SU4 Eval D0711-B.M.100.C-B.59CENTROID R:0.09859 P:0.05970 F:0.07437
59CENTROID ROUGE-SU4 Eval D0711-B.M.100.C-C.59CENTROID R:0.08276 P:0.05117 F:0.06324
59CENTROID ROUGE-SU4 Eval D0711-B.M.100.C-F.59CENTROID R:0.09988 P:0.06112 F:0.07583
59CENTROID ROUGE-SU4 Eval D0711-C.M.100.C-A.59CENTROID R:0.16497 P:0.10055 F:0.12495
59CENTROID ROUGE-SU4 Eval D0711-C.M.100.C-B.59CENTROID R:0.16550 P:0.09745 F:0.12267
59CENTROID ROUGE-SU4 Eval D0711-C.M.100.C-C.59CENTROID R:0.14931 P:0.08884 F:0.11140
59CENTROID ROUGE-SU4 Eval D0711-C.M.100.C-F.59CENTROID R:0.14120 P:0.08402 F:0.10535
59CENTROID ROUGE-SU4 Eval D0716-A.M.100.D-C.59CENTROID R:0.09989 P:0.05945 F:0.07454
59CENTROID ROUGE-SU4 Eval D0716-A.M.100.D-D.59CENTROID R:0.11130 P:0.06513 F:0.08217
59CENTROID ROUGE-SU4 Eval D0716-A.M.100.D-E.59CENTROID R:0.09784 P:0.05745 F:0.07239
59CENTROID ROUGE-SU4 Eval D0716-A.M.100.D-F.59CENTROID R:0.09887 P:0.05845 F:0.07347
59CENTROID ROUGE-SU4 Eval D0716-B.M.100.D-C.59CENTROID R:0.12218 P:0.07472 F:0.09273
59CENTROID ROUGE-SU4 Eval D0716-B.M.100.D-D.59CENTROID R:0.16782 P:0.10055 F:0.12575
59CENTROID ROUGE-SU4 Eval D0716-B.M.100.D-E.59CENTROID R:0.15358 P:0.09298 F:0.11583
59CENTROID ROUGE-SU4 Eval D0716-B.M.100.D-F.59CENTROID R:0.16153 P:0.09745 F:0.12156
59CENTROID ROUGE-SU4 Eval D0716-C.M.100.D-C.59CENTROID R:0.13322 P:0.08439 F:0.10333
59CENTROID ROUGE-SU4 Eval D0716-C.M.100.D-D.59CENTROID R:0.13230 P:0.08157 F:0.10092
59CENTROID ROUGE-SU4 Eval D0716-C.M.100.D-E.59CENTROID R:0.15141 P:0.09463 F:0.11647
59CENTROID ROUGE-SU4 Eval D0716-C.M.100.D-F.59CENTROID R:0.14726 P:0.09110 F:0.11256
59CENTROID ROUGE-SU4 Eval D0721-A.M.100.E-B.59CENTROID R:0.08219 P:0.05021 F:0.06234
59CENTROID ROUGE-SU4 Eval D0721-A.M.100.E-C.59CENTROID R:0.08500 P:0.05335 F:0.06555
59CENTROID ROUGE-SU4 Eval D0721-A.M.100.E-E.59CENTROID R:0.07778 P:0.04881 F:0.05998
59CENTROID ROUGE-SU4 Eval D0721-A.M.100.E-G.59CENTROID R:0.08224 P:0.05265 F:0.06420
59CENTROID ROUGE-SU4 Eval D0721-B.M.100.E-B.59CENTROID R:0.11315 P:0.06621 F:0.08354
59CENTROID ROUGE-SU4 Eval D0721-B.M.100.E-C.59CENTROID R:0.12092 P:0.07241 F:0.09058
59CENTROID ROUGE-SU4 Eval D0721-B.M.100.E-E.59CENTROID R:0.10943 P:0.06360 F:0.08045
59CENTROID ROUGE-SU4 Eval D0721-B.M.100.E-G.59CENTROID R:0.11810 P:0.06980 F:0.08774
59CENTROID ROUGE-SU4 Eval D0721-C.M.100.E-B.59CENTROID R:0.09484 P:0.06245 F:0.07531
59CENTROID ROUGE-SU4 Eval D0721-C.M.100.E-C.59CENTROID R:0.07232 P:0.04730 F:0.05719
59CENTROID ROUGE-SU4 Eval D0721-C.M.100.E-E.59CENTROID R:0.08562 P:0.05543 F:0.06729
59CENTROID ROUGE-SU4 Eval D0721-C.M.100.E-G.59CENTROID R:0.05351 P:0.03548 F:0.04267
59CENTROID ROUGE-SU4 Eval D0726-A.M.100.F-A.59CENTROID R:0.11377 P:0.07062 F:0.08715
59CENTROID ROUGE-SU4 Eval D0726-A.M.100.F-E.59CENTROID R:0.12158 P:0.07521 F:0.09293
59CENTROID ROUGE-SU4 Eval D0726-A.M.100.F-F.59CENTROID R:0.11490 P:0.07133 F:0.08802
59CENTROID ROUGE-SU4 Eval D0726-A.M.100.F-G.59CENTROID R:0.11092 P:0.06886 F:0.08497
59CENTROID ROUGE-SU4 Eval D0726-B.M.100.F-A.59CENTROID R:0.09564 P:0.05513 F:0.06994
59CENTROID ROUGE-SU4 Eval D0726-B.M.100.F-E.59CENTROID R:0.09670 P:0.05480 F:0.06996
59CENTROID ROUGE-SU4 Eval D0726-B.M.100.F-F.59CENTROID R:0.08874 P:0.05029 F:0.06420
59CENTROID ROUGE-SU4 Eval D0726-B.M.100.F-G.59CENTROID R:0.09009 P:0.05158 F:0.06560
59CENTROID ROUGE-SU4 Eval D0726-C.M.100.F-A.59CENTROID R:0.13185 P:0.08054 F:0.10000
59CENTROID ROUGE-SU4 Eval D0726-C.M.100.F-E.59CENTROID R:0.11880 P:0.07183 F:0.08953
59CENTROID ROUGE-SU4 Eval D0726-C.M.100.F-F.59CENTROID R:0.13240 P:0.07950 F:0.09935
59CENTROID ROUGE-SU4 Eval D0726-C.M.100.F-G.59CENTROID R:0.12177 P:0.07566 F:0.09333
59CENTROID ROUGE-SU4 Eval D0727-A.M.100.G-A.59CENTROID R:0.15870 P:0.10592 F:0.12705
59CENTROID ROUGE-SU4 Eval D0727-A.M.100.G-F.59CENTROID R:0.15034 P:0.10137 F:0.12109
59CENTROID ROUGE-SU4 Eval D0727-A.M.100.G-G.59CENTROID R:0.15045 P:0.10213 F:0.12167
59CENTROID ROUGE-SU4 Eval D0727-A.M.100.G-H.59CENTROID R:0.14921 P:0.10061 F:0.12018
59CENTROID ROUGE-SU4 Eval D0727-B.M.100.G-A.59CENTROID R:0.11072 P:0.06205 F:0.07953
59CENTROID ROUGE-SU4 Eval D0727-B.M.100.G-F.59CENTROID R:0.11444 P:0.06799 F:0.08530
59CENTROID ROUGE-SU4 Eval D0727-B.M.100.G-G.59CENTROID R:0.10439 P:0.05809 F:0.07464
59CENTROID ROUGE-SU4 Eval D0727-B.M.100.G-H.59CENTROID R:0.09717 P:0.05446 F:0.06980
59CENTROID ROUGE-SU4 Eval D0727-C.M.100.G-A.59CENTROID R:0.13824 P:0.07556 F:0.09771
59CENTROID ROUGE-SU4 Eval D0727-C.M.100.G-F.59CENTROID R:0.15398 P:0.08135 F:0.10646
59CENTROID ROUGE-SU4 Eval D0727-C.M.100.G-G.59CENTROID R:0.13277 P:0.07160 F:0.09303
59CENTROID ROUGE-SU4 Eval D0727-C.M.100.G-H.59CENTROID R:0.14410 P:0.07587 F:0.09940
59CENTROID ROUGE-SU4 Eval D0736-A.M.100.H-G.59CENTROID R:0.10025 P:0.05792 F:0.07342
59CENTROID ROUGE-SU4 Eval D0736-A.M.100.H-H.59CENTROID R:0.09962 P:0.05650 F:0.07211
59CENTROID ROUGE-SU4 Eval D0736-A.M.100.H-I.59CENTROID R:0.10623 P:0.06183 F:0.07816
59CENTROID ROUGE-SU4 Eval D0736-A.M.100.H-J.59CENTROID R:0.10179 P:0.06468 F:0.07910
59CENTROID ROUGE-SU4 Eval D0736-B.M.100.H-G.59CENTROID R:0.12073 P:0.05700 F:0.07744
59CENTROID ROUGE-SU4 Eval D0736-B.M.100.H-H.59CENTROID R:0.17023 P:0.07404 F:0.10320
59CENTROID ROUGE-SU4 Eval D0736-B.M.100.H-I.59CENTROID R:0.18470 P:0.07931 F:0.11097
59CENTROID ROUGE-SU4 Eval D0736-B.M.100.H-J.59CENTROID R:0.17386 P:0.08984 F:0.11846
59CENTROID ROUGE-SU4 Eval D0736-C.M.100.H-G.59CENTROID R:0.09025 P:0.03388 F:0.04927
59CENTROID ROUGE-SU4 Eval D0736-C.M.100.H-H.59CENTROID R:0.08939 P:0.02623 F:0.04056
59CENTROID ROUGE-SU4 Eval D0736-C.M.100.H-I.59CENTROID R:0.10242 P:0.03005 F:0.04647
59CENTROID ROUGE-SU4 Eval D0736-C.M.100.H-J.59CENTROID R:0.08366 P:0.03525 F:0.04960
59CENTROID ROUGE-SU4 Eval D0740-A.M.100.I-D.59CENTROID R:0.12825 P:0.07965 F:0.09827
59CENTROID ROUGE-SU4 Eval D0740-A.M.100.I-H.59CENTROID R:0.11186 P:0.07018 F:0.08625
59CENTROID ROUGE-SU4 Eval D0740-A.M.100.I-I.59CENTROID R:0.12222 P:0.07719 F:0.09462
59CENTROID ROUGE-SU4 Eval D0740-A.M.100.I-J.59CENTROID R:0.11148 P:0.07088 F:0.08666
59CENTROID ROUGE-SU4 Eval D0740-B.M.100.I-D.59CENTROID R:0.09833 P:0.05807 F:0.07302
59CENTROID ROUGE-SU4 Eval D0740-B.M.100.I-H.59CENTROID R:0.09637 P:0.05577 F:0.07065
59CENTROID ROUGE-SU4 Eval D0740-B.M.100.I-I.59CENTROID R:0.11560 P:0.06759 F:0.08530
59CENTROID ROUGE-SU4 Eval D0740-B.M.100.I-J.59CENTROID R:0.09413 P:0.05577 F:0.07004
59CENTROID ROUGE-SU4 Eval D0740-C.M.100.I-D.59CENTROID R:0.10984 P:0.06594 F:0.08241
59CENTROID ROUGE-SU4 Eval D0740-C.M.100.I-H.59CENTROID R:0.12211 P:0.07283 F:0.09124
59CENTROID ROUGE-SU4 Eval D0740-C.M.100.I-I.59CENTROID R:0.13169 P:0.07907 F:0.09881
59CENTROID ROUGE-SU4 Eval D0740-C.M.100.I-J.59CENTROID R:0.13508 P:0.08136 F:0.10155
59CENTROID ROUGE-SU4 Eval D0743-A.M.100.J-B.59CENTROID R:0.06786 P:0.04845 F:0.05654
59CENTROID ROUGE-SU4 Eval D0743-A.M.100.J-H.59CENTROID R:0.10812 P:0.07946 F:0.09160
59CENTROID ROUGE-SU4 Eval D0743-A.M.100.J-I.59CENTROID R:0.10310 P:0.07481 F:0.08671
59CENTROID ROUGE-SU4 Eval D0743-A.M.100.J-J.59CENTROID R:0.09569 P:0.07054 F:0.08121
59CENTROID ROUGE-SU4 Eval D0743-B.M.100.J-B.59CENTROID R:0.08498 P:0.04997 F:0.06293
59CENTROID ROUGE-SU4 Eval D0743-B.M.100.J-H.59CENTROID R:0.06904 P:0.04126 F:0.05165
59CENTROID ROUGE-SU4 Eval D0743-B.M.100.J-I.59CENTROID R:0.07900 P:0.04707 F:0.05899
59CENTROID ROUGE-SU4 Eval D0743-B.M.100.J-J.59CENTROID R:0.07348 P:0.04449 F:0.05542
59CENTROID ROUGE-SU4 Eval D0743-C.M.100.J-B.59CENTROID R:0.09935 P:0.05798 F:0.07323
59CENTROID ROUGE-SU4 Eval D0743-C.M.100.J-H.59CENTROID R:0.07298 P:0.04246 F:0.05369
59CENTROID ROUGE-SU4 Eval D0743-C.M.100.J-I.59CENTROID R:0.09727 P:0.05640 F:0.07140
59CENTROID ROUGE-SU4 Eval D0743-C.M.100.J-J.59CENTROID R:0.08226 P:0.04848 F:0.06101
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-1 Average_R: 0.32325 (95%-conf.int. 0.31345 - 0.33314)
59CENTROID_WEIGHTED ROUGE-1 Average_P: 0.18526 (95%-conf.int. 0.17819 - 0.19290)
59CENTROID_WEIGHTED ROUGE-1 Average_F: 0.23468 (95%-conf.int. 0.22626 - 0.24354)
.............................................
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.30068 P:0.18542 F:0.22939
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.25503 P:0.15833 F:0.19537
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.27835 P:0.16875 F:0.21012
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.29592 P:0.18125 F:0.22481
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.34967 P:0.20617 F:0.25940
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.34228 P:0.19653 F:0.24969
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.34228 P:0.19653 F:0.24969
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.34219 P:0.19846 F:0.25122
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.28333 P:0.14456 F:0.19144
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.26623 P:0.13946 F:0.18304
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.25166 P:0.12925 F:0.17079
59CENTROID_WEIGHTED ROUGE-1 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.29801 P:0.15306 F:0.20225
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.28896 P:0.17349 F:0.21681
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.29739 P:0.17739 F:0.22223
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.27597 P:0.16569 F:0.20706
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.28896 P:0.17349 F:0.21681
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.35294 P:0.22222 F:0.27273
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.36156 P:0.22840 F:0.27995
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.31494 P:0.19959 F:0.24434
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.38511 P:0.24486 F:0.29937
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.28387 P:0.16029 F:0.20489
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.33226 P:0.18761 F:0.23981
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.31090 P:0.17668 F:0.22532
59CENTROID_WEIGHTED ROUGE-1 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.31629 P:0.18033 F:0.22970
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.33553 P:0.15525 F:0.21228
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.36000 P:0.16438 F:0.22570
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.31333 P:0.14307 F:0.19644
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.35430 P:0.16286 F:0.22315
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.33673 P:0.16418 F:0.22074
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.34932 P:0.16915 F:0.22793
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.31208 P:0.15423 F:0.20644
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.30508 P:0.14925 F:0.20044
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.35974 P:0.21373 F:0.26815
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.37543 P:0.21569 F:0.27398
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.37500 P:0.21765 F:0.27544
59CENTROID_WEIGHTED ROUGE-1 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.35473 P:0.20588 F:0.26054
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.35082 P:0.22153 F:0.27157
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.36333 P:0.22567 F:0.27841
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.37874 P:0.23602 F:0.29081
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.34653 P:0.21739 F:0.26717
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.39145 P:0.24486 F:0.30127
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.38926 P:0.23868 F:0.29592
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.35216 P:0.21811 F:0.26938
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.37333 P:0.23045 F:0.28498
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.43322 P:0.27536 F:0.33671
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.46488 P:0.28778 F:0.35549
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.45215 P:0.28364 F:0.34860
59CENTROID_WEIGHTED ROUGE-1 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.46667 P:0.28986 F:0.35760
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.30333 P:0.18958 F:0.23333
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.27922 P:0.17917 F:0.21828
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.26948 P:0.17292 F:0.21066
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.26115 P:0.17083 F:0.20655
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.34853 P:0.19490 F:0.25000
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.30892 P:0.17668 F:0.22479
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.34426 P:0.19126 F:0.24590
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.30000 P:0.16940 F:0.21653
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.41967 P:0.23188 F:0.29871
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.35974 P:0.19746 F:0.25497
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.37333 P:0.20290 F:0.26291
59CENTROID_WEIGHTED ROUGE-1 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.40717 P:0.22645 F:0.29104
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.29900 P:0.18750 F:0.23047
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.28667 P:0.17917 F:0.22052
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.29568 P:0.18542 F:0.22792
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.26578 P:0.16667 F:0.20487
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.31699 P:0.20208 F:0.24682
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.31561 P:0.19792 F:0.24328
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.30233 P:0.18958 F:0.23303
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.32237 P:0.20417 F:0.25000
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.29000 P:0.18954 F:0.22925
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.29630 P:0.19172 F:0.23280
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.27797 P:0.17865 F:0.21751
59CENTROID_WEIGHTED ROUGE-1 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.25902 P:0.17211 F:0.20681
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.48173 P:0.27778 F:0.35237
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.46711 P:0.27203 F:0.34383
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.43464 P:0.25479 F:0.32126
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.49342 P:0.28736 F:0.36320
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.32302 P:0.16235 F:0.21609
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.33442 P:0.17789 F:0.23224
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.30104 P:0.15026 F:0.20046
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.31271 P:0.15717 F:0.20920
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.28339 P:0.13876 F:0.18630
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.31650 P:0.14992 F:0.20346
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.30363 P:0.14673 F:0.19785
59CENTROID_WEIGHTED ROUGE-1 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.31419 P:0.14833 F:0.20152
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.34050 P:0.19916 F:0.25132
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.33577 P:0.19287 F:0.24501
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.35587 P:0.20964 F:0.26385
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.34641 P:0.22222 F:0.27075
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.22519 P:0.11501 F:0.15226
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.20248 P:0.09552 F:0.12980
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.23431 P:0.10916 F:0.14893
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.21329 P:0.11891 F:0.15269
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.27426 P:0.10367 F:0.15046
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.24599 P:0.07337 F:0.11303
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.29412 P:0.08772 F:0.13514
59CENTROID_WEIGHTED ROUGE-1 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.26792 P:0.11324 F:0.15919
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.35644 P:0.20930 F:0.26374
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.32353 P:0.19186 F:0.24088
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.34091 P:0.20349 F:0.25486
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.33871 P:0.20349 F:0.25424
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.33766 P:0.20273 F:0.25335
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.34768 P:0.20468 F:0.25767
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.36066 P:0.21442 F:0.26895
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.32686 P:0.19688 F:0.24574
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.21725 P:0.13178 F:0.16405
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.19293 P:0.11628 F:0.14510
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.20447 P:0.12403 F:0.15440
59CENTROID_WEIGHTED ROUGE-1 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.20064 P:0.12209 F:0.15181
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.23175 P:0.16667 F:0.19389
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.30247 P:0.22374 F:0.25722
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.29375 P:0.21461 F:0.24802
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.27385 P:0.20320 F:0.23329
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.31410 P:0.15630 F:0.20873
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.29338 P:0.14833 F:0.19704
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.34494 P:0.17384 F:0.23117
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.34579 P:0.17703 F:0.23417
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.34921 P:0.18519 F:0.24203
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.31210 P:0.16498 F:0.21586
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.35144 P:0.18519 F:0.24256
59CENTROID_WEIGHTED ROUGE-1 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.33962 P:0.18182 F:0.23684
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-2 Average_R: 0.06704 (95%-conf.int. 0.05987 - 0.07430)
59CENTROID_WEIGHTED ROUGE-2 Average_P: 0.03865 (95%-conf.int. 0.03451 - 0.04293)
59CENTROID_WEIGHTED ROUGE-2 Average_F: 0.04888 (95%-conf.int. 0.04370 - 0.05422)
.............................................
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.06826 P:0.04193 F:0.05195
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.06102 P:0.03774 F:0.04664
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.05903 P:0.03564 F:0.04445
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.08935 P:0.05451 F:0.06771
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.07261 P:0.04264 F:0.05373
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.05085 P:0.02907 F:0.03699
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.07458 P:0.04264 F:0.05426
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.08389 P:0.04845 F:0.06142
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.03030 P:0.01538 F:0.02040
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.02623 P:0.01368 F:0.01798
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.02676 P:0.01368 F:0.01810
59CENTROID_WEIGHTED ROUGE-2 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.03679 P:0.01880 F:0.02488
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.08197 P:0.04902 F:0.06135
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.10561 P:0.06275 F:0.07872
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.07213 P:0.04314 F:0.05399
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.08525 P:0.05098 F:0.06380
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.09901 P:0.06211 F:0.07633
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.09539 P:0.06004 F:0.07370
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.05246 P:0.03313 F:0.04061
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.09804 P:0.06211 F:0.07604
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.02606 P:0.01465 F:0.01876
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.05537 P:0.03114 F:0.03986
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.04854 P:0.02747 F:0.03508
59CENTROID_WEIGHTED ROUGE-2 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.05484 P:0.03114 F:0.03972
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.06977 P:0.03211 F:0.04398
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.08418 P:0.03823 F:0.05258
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.04377 P:0.01988 F:0.02734
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.08361 P:0.03823 F:0.05247
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.07216 P:0.03500 F:0.04714
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.08997 P:0.04333 F:0.05849
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.07797 P:0.03833 F:0.05139
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.06849 P:0.03333 F:0.04484
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.09333 P:0.05523 F:0.06939
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.09310 P:0.05325 F:0.06775
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.08874 P:0.05128 F:0.06500
59CENTROID_WEIGHTED ROUGE-2 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.09215 P:0.05325 F:0.06750
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.08278 P:0.05208 F:0.06394
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.08418 P:0.05208 F:0.06435
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.09396 P:0.05833 F:0.07198
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.08000 P:0.05000 F:0.06154
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.09967 P:0.06211 F:0.07653
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.09492 P:0.05797 F:0.07198
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.06040 P:0.03727 F:0.04610
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.10774 P:0.06625 F:0.08205
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.15132 P:0.09583 F:0.11735
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.15541 P:0.09583 F:0.11856
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.16667 P:0.10417 F:0.12821
59CENTROID_WEIGHTED ROUGE-2 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.16835 P:0.10417 F:0.12870
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.03704 P:0.02306 F:0.02842
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.03607 P:0.02306 F:0.02813
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.03607 P:0.02306 F:0.02813
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.03859 P:0.02516 F:0.03046
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.05592 P:0.03114 F:0.04000
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.05466 P:0.03114 F:0.03968
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.05298 P:0.02930 F:0.03773
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.04235 P:0.02381 F:0.03048
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.15894 P:0.08743 F:0.11281
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.10000 P:0.05464 F:0.07067
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.15488 P:0.08379 F:0.10875
59CENTROID_WEIGHTED ROUGE-2 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.16447 P:0.09107 F:0.11723
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.05369 P:0.03354 F:0.04129
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.05387 P:0.03354 F:0.04134
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.05369 P:0.03354 F:0.04129
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.02013 P:0.01258 F:0.01548
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.05611 P:0.03564 F:0.04359
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.05034 P:0.03145 F:0.03871
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.05705 P:0.03564 F:0.04387
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.02658 P:0.01677 F:0.02057
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.05387 P:0.03509 F:0.04250
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.05102 P:0.03289 F:0.04000
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.03425 P:0.02193 F:0.02674
59CENTROID_WEIGHTED ROUGE-2 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.02318 P:0.01535 F:0.01847
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.18121 P:0.10405 F:0.13219
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.18937 P:0.10983 F:0.13903
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.12871 P:0.07514 F:0.09489
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.19934 P:0.11561 F:0.14635
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.03819 P:0.01910 F:0.02546
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.05574 P:0.02951 F:0.03859
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.03497 P:0.01736 F:0.02320
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.05556 P:0.02778 F:0.03704
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.02303 P:0.01122 F:0.01509
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.03401 P:0.01603 F:0.02179
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.02667 P:0.01282 F:0.01732
59CENTROID_WEIGHTED ROUGE-2 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.03754 P:0.01763 F:0.02399
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.07971 P:0.04641 F:0.05866
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.05166 P:0.02954 F:0.03759
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.06475 P:0.03797 F:0.04787
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.06931 P:0.04430 F:0.05405
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.00772 P:0.00392 F:0.00520
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.01255 P:0.00588 F:0.00801
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.00847 P:0.00392 F:0.00536
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.00707 P:0.00392 F:0.00504
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.04274 P:0.01603 F:0.02332
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.01630 P:0.00481 F:0.00743
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.06522 P:0.01923 F:0.02970
59CENTROID_WEIGHTED ROUGE-2 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.04198 P:0.01763 F:0.02483
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.09000 P:0.05263 F:0.06642
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.07591 P:0.04483 F:0.05637
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.08197 P:0.04873 F:0.06112
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.06840 P:0.04094 F:0.05122
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.05246 P:0.03137 F:0.03926
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.06020 P:0.03529 F:0.04450
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.06623 P:0.03922 F:0.04927
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.04902 P:0.02941 F:0.03676
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.00323 P:0.00195 F:0.00243
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.00649 P:0.00390 F:0.00487
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.00323 P:0.00195 F:0.00243
59CENTROID_WEIGHTED ROUGE-2 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.00643 P:0.00390 F:0.00486
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.03526 P:0.02529 F:0.02945
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.06231 P:0.04598 F:0.05291
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.06309 P:0.04598 F:0.05319
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.05590 P:0.04138 F:0.04756
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.06796 P:0.03365 F:0.04501
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.04459 P:0.02244 F:0.02986
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.07668 P:0.03846 F:0.05123
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.08805 P:0.04487 F:0.05945
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.05769 P:0.03046 F:0.03987
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.05466 P:0.02876 F:0.03769
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.04839 P:0.02538 F:0.03330
59CENTROID_WEIGHTED ROUGE-2 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.04127 P:0.02200 F:0.02870
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-3 Average_R: 0.02501 (95%-conf.int. 0.02053 - 0.02982)
59CENTROID_WEIGHTED ROUGE-3 Average_P: 0.01443 (95%-conf.int. 0.01191 - 0.01724)
59CENTROID_WEIGHTED ROUGE-3 Average_F: 0.01825 (95%-conf.int. 0.01503 - 0.02180)
.............................................
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.01724 P:0.01055 F:0.01309
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.02055 P:0.01266 F:0.01567
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.01053 P:0.00633 F:0.00791
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.02431 P:0.01477 F:0.01838
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.03000 P:0.01754 F:0.02214
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.00685 P:0.00390 F:0.00497
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.03082 P:0.01754 F:0.02236
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.03390 P:0.01949 F:0.02475
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.00340 P:0.00172 F:0.00228
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.00662 P:0.00344 F:0.00453
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.00338 P:0.00172 F:0.00228
59CENTROID_WEIGHTED ROUGE-3 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.00676 P:0.00344 F:0.00456
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.03642 P:0.02170 F:0.02720
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.05333 P:0.03156 F:0.03965
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.02649 P:0.01578 F:0.01978
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.04305 P:0.02564 F:0.03214
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.02667 P:0.01667 F:0.02052
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.02990 P:0.01875 F:0.02305
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.00331 P:0.00208 F:0.00255
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.02970 P:0.01875 F:0.02299
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.00987 P:0.00552 F:0.00708
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.00980 P:0.00552 F:0.00706
59CENTROID_WEIGHTED ROUGE-3 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.00977 P:0.00552 F:0.00705
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.03020 P:0.01382 F:0.01896
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.03741 P:0.01690 F:0.02328
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.00680 P:0.00307 F:0.00423
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.03716 P:0.01690 F:0.02323
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.01736 P:0.00838 F:0.01130
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.02098 P:0.01005 F:0.01359
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.01370 P:0.00670 F:0.00900
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.01038 P:0.00503 F:0.00678
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.06061 P:0.03571 F:0.04494
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.05923 P:0.03373 F:0.04298
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.06207 P:0.03571 F:0.04534
59CENTROID_WEIGHTED ROUGE-3 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.06552 P:0.03770 F:0.04786
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.01338 P:0.00839 F:0.01031
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.01020 P:0.00629 F:0.00778
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.02034 P:0.01258 F:0.01555
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.01684 P:0.01048 F:0.01292
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.04027 P:0.02500 F:0.03085
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.04110 P:0.02500 F:0.03109
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.02034 P:0.01250 F:0.01548
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.05102 P:0.03125 F:0.03876
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.08970 P:0.05660 F:0.06941
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.08191 P:0.05031 F:0.06233
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.09091 P:0.05660 F:0.06976
59CENTROID_WEIGHTED ROUGE-3 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.10204 P:0.06289 F:0.07782
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.01020 P:0.00633 F:0.00781
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.00993 P:0.00633 F:0.00773
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.00993 P:0.00633 F:0.00773
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.00974 P:0.00633 F:0.00767
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.00332 P:0.00184 F:0.00237
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.00649 P:0.00368 F:0.00470
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.00669 P:0.00368 F:0.00475
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.00329 P:0.00184 F:0.00236
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.09365 P:0.05128 F:0.06627
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.03704 P:0.02015 F:0.02610
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.10204 P:0.05495 F:0.07143
59CENTROID_WEIGHTED ROUGE-3 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.10963 P:0.06044 F:0.07792
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.02712 P:0.01688 F:0.02081
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.02721 P:0.01688 F:0.02083
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.02712 P:0.01688 F:0.02081
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.03333 P:0.02110 F:0.02584
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.02712 P:0.01688 F:0.02081
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.03051 P:0.01899 F:0.02341
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.01007 P:0.00633 F:0.00777
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.02041 P:0.01325 F:0.01607
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.02062 P:0.01325 F:0.01613
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.01730 P:0.01104 F:0.01348
59CENTROID_WEIGHTED ROUGE-3 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.00334 P:0.00221 F:0.00266
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.09153 P:0.05233 F:0.06659
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.09732 P:0.05620 F:0.07125
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.03667 P:0.02132 F:0.02696
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.09732 P:0.05620 F:0.07125
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.00351 P:0.00175 F:0.00234
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.00331 P:0.00175 F:0.00229
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.00351 P:0.00175 F:0.00234
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.00332 P:0.00161 F:0.00217
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.00687 P:0.00322 F:0.00438
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.00337 P:0.00161 F:0.00218
59CENTROID_WEIGHTED ROUGE-3 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.00690 P:0.00322 F:0.00439
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.03297 P:0.01911 F:0.02420
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.01866 P:0.01062 F:0.01354
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.02182 P:0.01274 F:0.01609
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.02333 P:0.01486 F:0.01816
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.02165 P:0.00805 F:0.01174
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.02762 P:0.00805 F:0.01247
59CENTROID_WEIGHTED ROUGE-3 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.01931 P:0.00805 F:0.01136
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.02694 P:0.01569 F:0.01983
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.01667 P:0.00980 F:0.01234
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.02318 P:0.01373 F:0.01725
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.01316 P:0.00784 F:0.00983
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.00993 P:0.00592 F:0.00742
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.01351 P:0.00789 F:0.00996
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.01672 P:0.00986 F:0.01240
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.00990 P:0.00592 F:0.00741
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.00647 P:0.00463 F:0.00540
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.02201 P:0.01620 F:0.01866
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.02229 P:0.01620 F:0.01876
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.01567 P:0.01157 F:0.01331
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.02614 P:0.01288 F:0.01726
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.01608 P:0.00805 F:0.01073
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.02903 P:0.01449 F:0.01933
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.03492 P:0.01771 F:0.02350
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.01942 P:0.01020 F:0.01338
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.01948 P:0.01020 F:0.01339
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.01954 P:0.01020 F:0.01340
59CENTROID_WEIGHTED ROUGE-3 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.00962 P:0.00510 F:0.00667
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-4 Average_R: 0.01148 (95%-conf.int. 0.00862 - 0.01455)
59CENTROID_WEIGHTED ROUGE-4 Average_P: 0.00657 (95%-conf.int. 0.00492 - 0.00827)
59CENTROID_WEIGHTED ROUGE-4 Average_F: 0.00833 (95%-conf.int. 0.00625 - 0.01050)
.............................................
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.00697 P:0.00425 F:0.00528
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.01038 P:0.00637 F:0.00789
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.00355 P:0.00212 F:0.00265
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.01053 P:0.00637 F:0.00794
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.02020 P:0.01176 F:0.01487
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.02076 P:0.01176 F:0.01501
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.02055 P:0.01176 F:0.01496
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.02341 P:0.01389 F:0.01744
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.03367 P:0.01984 F:0.02497
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.01672 P:0.00992 F:0.01245
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.02676 P:0.01587 F:0.01992
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.01684 P:0.01048 F:0.01292
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.01678 P:0.01048 F:0.01290
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.01667 P:0.01048 F:0.01287
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.00332 P:0.00185 F:0.00238
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.00330 P:0.00185 F:0.00237
59CENTROID_WEIGHTED ROUGE-4 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.00329 P:0.00185 F:0.00237
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.01695 P:0.00772 F:0.01061
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.01718 P:0.00772 F:0.01065
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.01706 P:0.00772 F:0.01063
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.00351 P:0.00168 F:0.00227
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.00353 P:0.00168 F:0.00228
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.00346 P:0.00168 F:0.00226
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.04082 P:0.02395 F:0.03019
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.03873 P:0.02196 F:0.02803
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.04181 P:0.02395 F:0.03045
59CENTROID_WEIGHTED ROUGE-4 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.04530 P:0.02595 F:0.03300
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.00338 P:0.00211 F:0.00260
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.00344 P:0.00211 F:0.00262
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.00685 P:0.00422 F:0.00522
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.00680 P:0.00422 F:0.00521
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.01695 P:0.01048 F:0.01295
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.01730 P:0.01048 F:0.01305
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.00685 P:0.00419 F:0.00520
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.02062 P:0.01258 F:0.01563
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.04027 P:0.02532 F:0.03109
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.03103 P:0.01899 F:0.02356
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.03061 P:0.01899 F:0.02344
59CENTROID_WEIGHTED ROUGE-4 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.04124 P:0.02532 F:0.03138
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.07432 P:0.04052 F:0.05245
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.02041 P:0.01105 F:0.01434
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.07560 P:0.04052 F:0.05276
59CENTROID_WEIGHTED ROUGE-4 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.08389 P:0.04604 F:0.05945
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.01370 P:0.00849 F:0.01048
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.01375 P:0.00849 F:0.01050
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.01370 P:0.00849 F:0.01048
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.01684 P:0.01062 F:0.01303
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.01712 P:0.01062 F:0.01311
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.01712 P:0.01062 F:0.01311
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.00687 P:0.00444 F:0.00539
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.00694 P:0.00444 F:0.00542
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.00699 P:0.00444 F:0.00543
59CENTROID_WEIGHTED ROUGE-4 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.04795 P:0.02729 F:0.03478
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.05424 P:0.03119 F:0.03961
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.00673 P:0.00390 F:0.00494
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.05424 P:0.03119 F:0.03961
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.00741 P:0.00427 F:0.00542
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.00755 P:0.00427 F:0.00545
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.00368 P:0.00214 F:0.00271
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.00337 P:0.00214 F:0.00262
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.01316 P:0.00485 F:0.00709
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.01685 P:0.00485 F:0.00753
59CENTROID_WEIGHTED ROUGE-4 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.01172 P:0.00485 F:0.00686
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.00340 P:0.00197 F:0.00249
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.00337 P:0.00197 F:0.00249
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.00334 P:0.00197 F:0.00248
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.00334 P:0.00198 F:0.00249
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.00683 P:0.00397 F:0.00502
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.00676 P:0.00397 F:0.00500
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.00333 P:0.00198 F:0.00248
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.00327 P:0.00233 F:0.00272
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.00635 P:0.00466 F:0.00538
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.00643 P:0.00466 F:0.00540
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.00316 P:0.00233 F:0.00268
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.00660 P:0.00324 F:0.00435
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.00651 P:0.00324 F:0.00433
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.00641 P:0.00324 F:0.00430
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.00327 P:0.00171 F:0.00225
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.00328 P:0.00171 F:0.00225
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.00329 P:0.00171 F:0.00225
59CENTROID_WEIGHTED ROUGE-4 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-L Average_R: 0.28841 (95%-conf.int. 0.27991 - 0.29732)
59CENTROID_WEIGHTED ROUGE-L Average_P: 0.16495 (95%-conf.int. 0.15896 - 0.17117)
59CENTROID_WEIGHTED ROUGE-L Average_F: 0.20909 (95%-conf.int. 0.20204 - 0.21641)
.............................................
59CENTROID_WEIGHTED ROUGE-L Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.27365 P:0.16875 F:0.20876
59CENTROID_WEIGHTED ROUGE-L Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.23826 P:0.14792 F:0.18252
59CENTROID_WEIGHTED ROUGE-L Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.25773 P:0.15625 F:0.19455
59CENTROID_WEIGHTED ROUGE-L Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.26871 P:0.16458 F:0.20413
59CENTROID_WEIGHTED ROUGE-L Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.29085 P:0.17148 F:0.21575
59CENTROID_WEIGHTED ROUGE-L Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.29195 P:0.16763 F:0.21298
59CENTROID_WEIGHTED ROUGE-L Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.29195 P:0.16763 F:0.21298
59CENTROID_WEIGHTED ROUGE-L Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.29236 P:0.16956 F:0.21464
59CENTROID_WEIGHTED ROUGE-L Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.26000 P:0.13265 F:0.17567
59CENTROID_WEIGHTED ROUGE-L Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.24026 P:0.12585 F:0.16518
59CENTROID_WEIGHTED ROUGE-L Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.22848 P:0.11735 F:0.15506
59CENTROID_WEIGHTED ROUGE-L Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.27152 P:0.13946 F:0.18427
59CENTROID_WEIGHTED ROUGE-L Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.25325 P:0.15205 F:0.19002
59CENTROID_WEIGHTED ROUGE-L Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.26471 P:0.15789 F:0.19780
59CENTROID_WEIGHTED ROUGE-L Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.25325 P:0.15205 F:0.19002
59CENTROID_WEIGHTED ROUGE-L Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.26299 P:0.15789 F:0.19732
59CENTROID_WEIGHTED ROUGE-L Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.30392 P:0.19136 F:0.23485
59CENTROID_WEIGHTED ROUGE-L Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.31596 P:0.19959 F:0.24464
59CENTROID_WEIGHTED ROUGE-L Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.27273 P:0.17284 F:0.21159
59CENTROID_WEIGHTED ROUGE-L Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.32686 P:0.20782 F:0.25409
59CENTROID_WEIGHTED ROUGE-L Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.24516 P:0.13843 F:0.17695
59CENTROID_WEIGHTED ROUGE-L Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.30000 P:0.16940 F:0.21653
59CENTROID_WEIGHTED ROUGE-L Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.26923 P:0.15301 F:0.19513
59CENTROID_WEIGHTED ROUGE-L Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.27476 P:0.15665 F:0.19954
59CENTROID_WEIGHTED ROUGE-L Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.31250 P:0.14460 F:0.19771
59CENTROID_WEIGHTED ROUGE-L Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.33000 P:0.15068 F:0.20689
59CENTROID_WEIGHTED ROUGE-L Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.29667 P:0.13546 F:0.18599
59CENTROID_WEIGHTED ROUGE-L Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.32450 P:0.14916 F:0.20438
59CENTROID_WEIGHTED ROUGE-L Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.30612 P:0.14925 F:0.20066
59CENTROID_WEIGHTED ROUGE-L Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.31507 P:0.15257 F:0.20559
59CENTROID_WEIGHTED ROUGE-L Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.28859 P:0.14262 F:0.19090
59CENTROID_WEIGHTED ROUGE-L Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.28136 P:0.13765 F:0.18486
59CENTROID_WEIGHTED ROUGE-L Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.32673 P:0.19412 F:0.24354
59CENTROID_WEIGHTED ROUGE-L Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.33106 P:0.19020 F:0.24160
59CENTROID_WEIGHTED ROUGE-L Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.33446 P:0.19412 F:0.24566
59CENTROID_WEIGHTED ROUGE-L Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.32095 P:0.18627 F:0.23573
59CENTROID_WEIGHTED ROUGE-L Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.29836 P:0.18841 F:0.23097
59CENTROID_WEIGHTED ROUGE-L Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.30000 P:0.18634 F:0.22989
59CENTROID_WEIGHTED ROUGE-L Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.30897 P:0.19255 F:0.23725
59CENTROID_WEIGHTED ROUGE-L Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.29373 P:0.18427 F:0.22647
59CENTROID_WEIGHTED ROUGE-L Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.34539 P:0.21605 F:0.26582
59CENTROID_WEIGHTED ROUGE-L Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.36913 P:0.22634 F:0.28061
59CENTROID_WEIGHTED ROUGE-L Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.31561 P:0.19547 F:0.24142
59CENTROID_WEIGHTED ROUGE-L Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.33667 P:0.20782 F:0.25700
59CENTROID_WEIGHTED ROUGE-L Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.39739 P:0.25259 F:0.30886
59CENTROID_WEIGHTED ROUGE-L Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.41472 P:0.25673 F:0.31714
59CENTROID_WEIGHTED ROUGE-L Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.40594 P:0.25466 F:0.31298
59CENTROID_WEIGHTED ROUGE-L Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.42000 P:0.26087 F:0.32184
59CENTROID_WEIGHTED ROUGE-L Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.26667 P:0.16667 F:0.20513
59CENTROID_WEIGHTED ROUGE-L Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.24026 P:0.15417 F:0.18782
59CENTROID_WEIGHTED ROUGE-L Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.24351 P:0.15625 F:0.19036
59CENTROID_WEIGHTED ROUGE-L Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.24522 P:0.16042 F:0.19396
59CENTROID_WEIGHTED ROUGE-L Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.29316 P:0.16393 F:0.21028
59CENTROID_WEIGHTED ROUGE-L Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.28025 P:0.16029 F:0.20394
59CENTROID_WEIGHTED ROUGE-L Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.29836 P:0.16576 F:0.21312
59CENTROID_WEIGHTED ROUGE-L Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.26452 P:0.14936 F:0.19092
59CENTROID_WEIGHTED ROUGE-L Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.37049 P:0.20471 F:0.26371
59CENTROID_WEIGHTED ROUGE-L Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.30363 P:0.16667 F:0.21521
59CENTROID_WEIGHTED ROUGE-L Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.33667 P:0.18297 F:0.23709
59CENTROID_WEIGHTED ROUGE-L Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.37134 P:0.20652 F:0.26542
59CENTROID_WEIGHTED ROUGE-L Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.27907 P:0.17500 F:0.21511
59CENTROID_WEIGHTED ROUGE-L Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.26000 P:0.16250 F:0.20000
59CENTROID_WEIGHTED ROUGE-L Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.26910 P:0.16875 F:0.20743
59CENTROID_WEIGHTED ROUGE-L Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.22924 P:0.14375 F:0.17670
59CENTROID_WEIGHTED ROUGE-L Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.28105 P:0.17917 F:0.21883
59CENTROID_WEIGHTED ROUGE-L Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.27907 P:0.17500 F:0.21511
59CENTROID_WEIGHTED ROUGE-L Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.26910 P:0.16875 F:0.20743
59CENTROID_WEIGHTED ROUGE-L Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.27961 P:0.17708 F:0.21684
59CENTROID_WEIGHTED ROUGE-L Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.26667 P:0.17429 F:0.21080
59CENTROID_WEIGHTED ROUGE-L Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.27946 P:0.18083 F:0.21958
59CENTROID_WEIGHTED ROUGE-L Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.25424 P:0.16340 F:0.19894
59CENTROID_WEIGHTED ROUGE-L Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.23279 P:0.15468 F:0.18586
59CENTROID_WEIGHTED ROUGE-L Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.41528 P:0.23946 F:0.30376
59CENTROID_WEIGHTED ROUGE-L Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.38816 P:0.22605 F:0.28571
59CENTROID_WEIGHTED ROUGE-L Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.36928 P:0.21648 F:0.27295
59CENTROID_WEIGHTED ROUGE-L Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.42763 P:0.24904 F:0.31477
59CENTROID_WEIGHTED ROUGE-L Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.29553 P:0.14853 F:0.19770
59CENTROID_WEIGHTED ROUGE-L Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.29545 P:0.15717 F:0.20519
59CENTROID_WEIGHTED ROUGE-L Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.26990 P:0.13472 F:0.17973
59CENTROID_WEIGHTED ROUGE-L Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.28866 P:0.14508 F:0.19311
59CENTROID_WEIGHTED ROUGE-L Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.26384 P:0.12919 F:0.17345
59CENTROID_WEIGHTED ROUGE-L Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.28956 P:0.13716 F:0.18615
59CENTROID_WEIGHTED ROUGE-L Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.27723 P:0.13397 F:0.18064
59CENTROID_WEIGHTED ROUGE-L Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.29730 P:0.14035 F:0.19068
59CENTROID_WEIGHTED ROUGE-L Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.31900 P:0.18658 F:0.23545
59CENTROID_WEIGHTED ROUGE-L Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.29927 P:0.17191 F:0.21838
59CENTROID_WEIGHTED ROUGE-L Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.32740 P:0.19287 F:0.24274
59CENTROID_WEIGHTED ROUGE-L Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.31699 P:0.20335 F:0.24776
59CENTROID_WEIGHTED ROUGE-L Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.19847 P:0.10136 F:0.13419
59CENTROID_WEIGHTED ROUGE-L Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.18595 P:0.08772 F:0.11921
59CENTROID_WEIGHTED ROUGE-L Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.20921 P:0.09747 F:0.13298
59CENTROID_WEIGHTED ROUGE-L Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.18881 P:0.10526 F:0.13517
59CENTROID_WEIGHTED ROUGE-L Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.26160 P:0.09888 F:0.14351
59CENTROID_WEIGHTED ROUGE-L Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.22460 P:0.06699 F:0.10320
59CENTROID_WEIGHTED ROUGE-L Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.28342 P:0.08453 F:0.13022
59CENTROID_WEIGHTED ROUGE-L Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.25660 P:0.10845 F:0.15246
59CENTROID_WEIGHTED ROUGE-L Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.33333 P:0.19574 F:0.24664
59CENTROID_WEIGHTED ROUGE-L Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.29739 P:0.17636 F:0.22142
59CENTROID_WEIGHTED ROUGE-L Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.30844 P:0.18411 F:0.23058
59CENTROID_WEIGHTED ROUGE-L Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.30323 P:0.18217 F:0.22760
59CENTROID_WEIGHTED ROUGE-L Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.28247 P:0.16959 F:0.21194
59CENTROID_WEIGHTED ROUGE-L Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.29139 P:0.17154 F:0.21595
59CENTROID_WEIGHTED ROUGE-L Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.30164 P:0.17934 F:0.22494
59CENTROID_WEIGHTED ROUGE-L Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.28155 P:0.16959 F:0.21168
59CENTROID_WEIGHTED ROUGE-L Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.20128 P:0.12209 F:0.15199
59CENTROID_WEIGHTED ROUGE-L Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.18006 P:0.10853 F:0.13543
59CENTROID_WEIGHTED ROUGE-L Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.18530 P:0.11240 F:0.13992
59CENTROID_WEIGHTED ROUGE-L Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.19108 P:0.11628 F:0.14458
59CENTROID_WEIGHTED ROUGE-L Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.18095 P:0.13014 F:0.15140
59CENTROID_WEIGHTED ROUGE-L Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.25000 P:0.18493 F:0.21260
59CENTROID_WEIGHTED ROUGE-L Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.23750 P:0.17352 F:0.20053
59CENTROID_WEIGHTED ROUGE-L Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.23692 P:0.17580 F:0.20183
59CENTROID_WEIGHTED ROUGE-L Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.28205 P:0.14035 F:0.18743
59CENTROID_WEIGHTED ROUGE-L Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.27129 P:0.13716 F:0.18220
59CENTROID_WEIGHTED ROUGE-L Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.31962 P:0.16108 F:0.21421
59CENTROID_WEIGHTED ROUGE-L Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.32087 P:0.16427 F:0.21730
59CENTROID_WEIGHTED ROUGE-L Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.30159 P:0.15993 F:0.20902
59CENTROID_WEIGHTED ROUGE-L Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.28662 P:0.15152 F:0.19824
59CENTROID_WEIGHTED ROUGE-L Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.30671 P:0.16162 F:0.21169
59CENTROID_WEIGHTED ROUGE-L Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.31447 P:0.16835 F:0.21930
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-W-1.2 Average_R: 0.10192 (95%-conf.int. 0.09872 - 0.10526)
59CENTROID_WEIGHTED ROUGE-W-1.2 Average_P: 0.10555 (95%-conf.int. 0.10146 - 0.10953)
59CENTROID_WEIGHTED ROUGE-W-1.2 Average_F: 0.10323 (95%-conf.int. 0.09985 - 0.10672)
.............................................
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.09669 P:0.10736 F:0.10175
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.08334 P:0.09404 F:0.08837
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.08984 P:0.10042 F:0.09484
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.09989 P:0.10466 F:0.10222
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.10110 P:0.11053 F:0.10560
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.09658 P:0.10493 F:0.10058
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.10074 P:0.10849 F:0.10447
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.10633 P:0.11437 F:0.11020
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.08820 P:0.08367 F:0.08588
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.07856 P:0.07769 F:0.07812
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.07567 P:0.07377 F:0.07471
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.09481 P:0.08770 F:0.09112
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.09272 P:0.09990 F:0.09618
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.09583 P:0.10489 F:0.10016
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.08808 P:0.09590 F:0.09182
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.09228 P:0.10267 F:0.09720
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.10936 P:0.11925 F:0.11409
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.11164 P:0.12436 F:0.11766
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.09490 P:0.10616 F:0.10021
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.11398 P:0.13105 F:0.12192
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.09230 P:0.08895 F:0.09059
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.09895 P:0.09618 F:0.09755
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.09229 P:0.08884 F:0.09053
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.09341 P:0.09249 F:0.09295
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.10815 P:0.09022 F:0.09837
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.11394 P:0.09423 F:0.10315
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.09863 P:0.08087 F:0.08887
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.11396 P:0.09502 F:0.10363
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.11000 P:0.09569 F:0.10235
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.10747 P:0.09753 F:0.10226
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.09810 P:0.09107 F:0.09445
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.09680 P:0.08795 F:0.09216
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.11371 P:0.12630 F:0.11967
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.11264 P:0.12101 F:0.11668
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.11010 P:0.12133 F:0.11544
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.10734 P:0.12007 F:0.11335
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.10090 P:0.11641 F:0.10810
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.09735 P:0.11520 F:0.10553
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.10298 P:0.11984 F:0.11077
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.09493 P:0.11326 F:0.10329
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.12444 P:0.13578 F:0.12986
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.12821 P:0.14068 F:0.13416
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.10977 P:0.12103 F:0.11513
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.12259 P:0.13394 F:0.12801
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.13390 P:0.15864 F:0.14522
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.13687 P:0.16431 F:0.14934
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.14283 P:0.17365 F:0.15674
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.14097 P:0.17033 F:0.15427
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.09551 P:0.10492 F:0.09999
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.08563 P:0.09749 F:0.09118
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.08549 P:0.09854 F:0.09155
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.08906 P:0.10209 F:0.09513
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.09791 P:0.10585 F:0.10173
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.09549 P:0.10265 F:0.09894
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.10081 P:0.10993 F:0.10517
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.08295 P:0.09348 F:0.08790
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.14245 P:0.14487 F:0.14365
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.10946 P:0.11305 F:0.11123
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.13472 P:0.13665 F:0.13568
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.14099 P:0.14664 F:0.14376
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.10205 P:0.11340 F:0.10743
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.09665 P:0.10583 F:0.10103
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.09703 P:0.10838 F:0.10239
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.07831 P:0.08889 F:0.08327
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.10454 P:0.11723 F:0.11052
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.10089 P:0.11420 F:0.10713
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.09583 P:0.10918 F:0.10207
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.09746 P:0.11145 F:0.10399
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.09556 P:0.10968 F:0.10213
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.10095 P:0.11529 F:0.10764
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.09348 P:0.10759 F:0.10004
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.07936 P:0.09442 F:0.08624
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.15230 P:0.15458 F:0.15343
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.13918 P:0.14795 F:0.14343
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.13117 P:0.13618 F:0.13363
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.15430 P:0.16108 F:0.15762
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.10445 P:0.09211 F:0.09789
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.10335 P:0.09875 F:0.10100
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.09870 P:0.08824 F:0.09318
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.10566 P:0.09399 F:0.09948
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.09210 P:0.08110 F:0.08625
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.09781 P:0.08563 F:0.09132
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.09410 P:0.08371 F:0.08860
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.10331 P:0.08778 F:0.09491
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.11706 P:0.12125 F:0.11912
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.10838 P:0.10948 F:0.10893
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.11788 P:0.12408 F:0.12090
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.11222 P:0.12834 F:0.11974
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.06969 P:0.06588 F:0.06773
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.06685 P:0.05834 F:0.06231
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.07488 P:0.06443 F:0.06926
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.06557 P:0.06758 F:0.06656
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.09736 P:0.06685 F:0.07927
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.08435 P:0.04702 F:0.06038
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.10845 P:0.05901 F:0.07643
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.09382 P:0.07075 F:0.08067
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.11536 P:0.12460 F:0.11980
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.10453 P:0.11183 F:0.10806
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.10628 P:0.11734 F:0.11154
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.10351 P:0.11424 F:0.10861
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.09932 P:0.10956 F:0.10419
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.10781 P:0.11294 F:0.11032
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.10478 P:0.11706 F:0.11058
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.10138 P:0.10917 F:0.10513
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.06610 P:0.07738 F:0.07130
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.06223 P:0.07000 F:0.06589
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.06005 P:0.07124 F:0.06517
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.06289 P:0.07333 F:0.06771
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.06944 P:0.08705 F:0.07725
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.09330 P:0.11922 F:0.10468
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.08734 P:0.11323 F:0.09861
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.08875 P:0.11432 F:0.09993
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.11212 P:0.09343 F:0.10193
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.10535 P:0.08833 F:0.09609
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.12551 P:0.10660 F:0.11528
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.12929 P:0.10883 F:0.11818
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.10910 P:0.10128 F:0.10504
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.10371 P:0.09155 F:0.09725
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.10295 P:0.09667 F:0.09971
59CENTROID_WEIGHTED ROUGE-W-1.2 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.10832 P:0.09760 F:0.10268
---------------------------------------------
59CENTROID_WEIGHTED ROUGE-SU4 Average_R: 0.10574 (95%-conf.int. 0.10005 - 0.11189)
59CENTROID_WEIGHTED ROUGE-SU4 Average_P: 0.06010 (95%-conf.int. 0.05647 - 0.06404)
59CENTROID_WEIGHTED ROUGE-SU4 Average_F: 0.07636 (95%-conf.int. 0.07191 - 0.08129)
.............................................
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-A.M.100.A-A.59CENTROID_WEIGHTED R:0.09375 P:0.05720 F:0.07105
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-A.M.100.A-C.59CENTROID_WEIGHTED R:0.08103 P:0.04979 F:0.06168
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-A.M.100.A-D.59CENTROID_WEIGHTED R:0.07951 P:0.04767 F:0.05960
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-A.M.100.A-J.59CENTROID_WEIGHTED R:0.09615 P:0.05826 F:0.07256
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-B.M.100.A-A.59CENTROID_WEIGHTED R:0.11298 P:0.06588 F:0.08323
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-B.M.100.A-C.59CENTROID_WEIGHTED R:0.10172 P:0.05773 F:0.07366
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-B.M.100.A-D.59CENTROID_WEIGHTED R:0.11379 P:0.06458 F:0.08240
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-B.M.100.A-J.59CENTROID_WEIGHTED R:0.11547 P:0.06621 F:0.08416
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-C.M.100.A-A.59CENTROID_WEIGHTED R:0.08390 P:0.04224 F:0.05619
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-C.M.100.A-C.59CENTROID_WEIGHTED R:0.07389 P:0.03822 F:0.05038
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-C.M.100.A-D.59CENTROID_WEIGHTED R:0.07143 P:0.03621 F:0.04806
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0703-C.M.100.A-J.59CENTROID_WEIGHTED R:0.09127 P:0.04626 F:0.06140
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-A.M.100.B-B.59CENTROID_WEIGHTED R:0.09667 P:0.05743 F:0.07205
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-A.M.100.B-D.59CENTROID_WEIGHTED R:0.10403 P:0.06139 F:0.07721
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-A.M.100.B-E.59CENTROID_WEIGHTED R:0.08889 P:0.05281 F:0.06626
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-A.M.100.B-I.59CENTROID_WEIGHTED R:0.09778 P:0.05809 F:0.07288
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-B.M.100.B-B.59CENTROID_WEIGHTED R:0.11633 P:0.07252 F:0.08934
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-B.M.100.B-D.59CENTROID_WEIGHTED R:0.11929 P:0.07462 F:0.09181
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-B.M.100.B-E.59CENTROID_WEIGHTED R:0.08833 P:0.05544 F:0.06812
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-B.M.100.B-I.59CENTROID_WEIGHTED R:0.12348 P:0.07775 F:0.09542
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-C.M.100.B-B.59CENTROID_WEIGHTED R:0.07561 P:0.04221 F:0.05418
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-C.M.100.B-D.59CENTROID_WEIGHTED R:0.10155 P:0.05669 F:0.07276
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-C.M.100.B-E.59CENTROID_WEIGHTED R:0.09101 P:0.05114 F:0.06548
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0706-C.M.100.B-I.59CENTROID_WEIGHTED R:0.09454 P:0.05330 F:0.06817
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-A.M.100.C-A.59CENTROID_WEIGHTED R:0.11712 P:0.05342 F:0.07337
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-A.M.100.C-B.59CENTROID_WEIGHTED R:0.12500 P:0.05624 F:0.07758
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-A.M.100.C-C.59CENTROID_WEIGHTED R:0.09874 P:0.04443 F:0.06128
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-A.M.100.C-F.59CENTROID_WEIGHTED R:0.12415 P:0.05624 F:0.07741
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-B.M.100.C-A.59CENTROID_WEIGHTED R:0.12296 P:0.05910 F:0.07983
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-B.M.100.C-B.59CENTROID_WEIGHTED R:0.12969 P:0.06190 F:0.08380
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-B.M.100.C-C.59CENTROID_WEIGHTED R:0.11667 P:0.05686 F:0.07646
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-B.M.100.C-F.59CENTROID_WEIGHTED R:0.09988 P:0.04818 F:0.06500
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-C.M.100.C-A.59CENTROID_WEIGHTED R:0.12655 P:0.07437 F:0.09368
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-C.M.100.C-B.59CENTROID_WEIGHTED R:0.13216 P:0.07503 F:0.09572
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-C.M.100.C-C.59CENTROID_WEIGHTED R:0.12731 P:0.07304 F:0.09282
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0711-C.M.100.C-F.59CENTROID_WEIGHTED R:0.12789 P:0.07337 F:0.09325
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-A.M.100.D-C.59CENTROID_WEIGHTED R:0.11841 P:0.07404 F:0.09111
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-A.M.100.D-D.59CENTROID_WEIGHTED R:0.12158 P:0.07474 F:0.09257
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-A.M.100.D-E.59CENTROID_WEIGHTED R:0.12969 P:0.08000 F:0.09896
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-A.M.100.D-F.59CENTROID_WEIGHTED R:0.11299 P:0.07018 F:0.08658
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-B.M.100.D-C.59CENTROID_WEIGHTED R:0.14865 P:0.09205 F:0.11370
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-B.M.100.D-D.59CENTROID_WEIGHTED R:0.15230 P:0.09240 F:0.11502
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-B.M.100.D-E.59CENTROID_WEIGHTED R:0.11889 P:0.07287 F:0.09036
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-B.M.100.D-F.59CENTROID_WEIGHTED R:0.14726 P:0.08996 F:0.11169
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-C.M.100.D-C.59CENTROID_WEIGHTED R:0.18952 P:0.11930 F:0.14643
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-C.M.100.D-D.59CENTROID_WEIGHTED R:0.21191 P:0.12982 F:0.16101
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-C.M.100.D-E.59CENTROID_WEIGHTED R:0.19605 P:0.12175 F:0.15021
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0716-C.M.100.D-F.59CENTROID_WEIGHTED R:0.21518 P:0.13228 F:0.16384
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-A.M.100.E-B.59CENTROID_WEIGHTED R:0.08162 P:0.05049 F:0.06239
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-A.M.100.E-C.59CENTROID_WEIGHTED R:0.07222 P:0.04590 F:0.05613
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-A.M.100.E-E.59CENTROID_WEIGHTED R:0.07222 P:0.04590 F:0.05613
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-A.M.100.E-G.59CENTROID_WEIGHTED R:0.07135 P:0.04626 F:0.05613
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-B.M.100.E-B.59CENTROID_WEIGHTED R:0.10368 P:0.05730 F:0.07381
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-B.M.100.E-C.59CENTROID_WEIGHTED R:0.09314 P:0.05268 F:0.06730
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-B.M.100.E-E.59CENTROID_WEIGHTED R:0.10213 P:0.05607 F:0.07239
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-B.M.100.E-G.59CENTROID_WEIGHTED R:0.08664 P:0.04837 F:0.06208
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-C.M.100.E-B.59CENTROID_WEIGHTED R:0.18575 P:0.10141 F:0.13119
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-C.M.100.E-C.59CENTROID_WEIGHTED R:0.12938 P:0.07016 F:0.09098
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-C.M.100.E-E.59CENTROID_WEIGHTED R:0.17865 P:0.09589 F:0.12480
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0721-C.M.100.E-G.59CENTROID_WEIGHTED R:0.18896 P:0.10386 F:0.13404
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-A.M.100.F-A.59CENTROID_WEIGHTED R:0.09386 P:0.05826 F:0.07189
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-A.M.100.F-E.59CENTROID_WEIGHTED R:0.08790 P:0.05438 F:0.06719
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-A.M.100.F-F.59CENTROID_WEIGHTED R:0.09386 P:0.05826 F:0.07189
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-A.M.100.F-G.59CENTROID_WEIGHTED R:0.07110 P:0.04414 F:0.05447
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-B.M.100.F-A.59CENTROID_WEIGHTED R:0.10570 P:0.06674 F:0.08182
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-B.M.100.F-E.59CENTROID_WEIGHTED R:0.10182 P:0.06321 F:0.07800
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-B.M.100.F-F.59CENTROID_WEIGHTED R:0.09556 P:0.05932 F:0.07320
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-B.M.100.F-G.59CENTROID_WEIGHTED R:0.09516 P:0.05968 F:0.07336
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-C.M.100.F-A.59CENTROID_WEIGHTED R:0.08847 P:0.05728 F:0.06954
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-C.M.100.F-E.59CENTROID_WEIGHTED R:0.08766 P:0.05617 F:0.06847
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-C.M.100.F-F.59CENTROID_WEIGHTED R:0.08188 P:0.05211 F:0.06369
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0726-C.M.100.F-G.59CENTROID_WEIGHTED R:0.07183 P:0.04730 F:0.05704
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-A.M.100.G-A.59CENTROID_WEIGHTED R:0.19568 P:0.11154 F:0.14209
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-A.M.100.G-F.59CENTROID_WEIGHTED R:0.18863 P:0.10863 F:0.13787
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-A.M.100.G-G.59CENTROID_WEIGHTED R:0.14485 P:0.08398 F:0.10632
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-A.M.100.G-H.59CENTROID_WEIGHTED R:0.20664 P:0.11900 F:0.15103
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-B.M.100.G-A.59CENTROID_WEIGHTED R:0.08716 P:0.04320 F:0.05777
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-B.M.100.G-F.59CENTROID_WEIGHTED R:0.09500 P:0.04991 F:0.06544
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-B.M.100.G-G.59CENTROID_WEIGHTED R:0.08126 P:0.03999 F:0.05360
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-B.M.100.G-H.59CENTROID_WEIGHTED R:0.09187 P:0.04553 F:0.06089
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-C.M.100.G-A.59CENTROID_WEIGHTED R:0.08194 P:0.03958 F:0.05338
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-C.M.100.G-F.59CENTROID_WEIGHTED R:0.09170 P:0.04281 F:0.05837
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-C.M.100.G-G.59CENTROID_WEIGHTED R:0.08983 P:0.04281 F:0.05799
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0727-C.M.100.G-H.59CENTROID_WEIGHTED R:0.09028 P:0.04200 F:0.05733
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-A.M.100.H-G.59CENTROID_WEIGHTED R:0.10886 P:0.06290 F:0.07973
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-A.M.100.H-H.59CENTROID_WEIGHTED R:0.09900 P:0.05615 F:0.07166
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-A.M.100.H-I.59CENTROID_WEIGHTED R:0.10867 P:0.06326 F:0.07997
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-A.M.100.H-J.59CENTROID_WEIGHTED R:0.10906 P:0.06930 F:0.08475
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-B.M.100.H-G.59CENTROID_WEIGHTED R:0.05643 P:0.02838 F:0.03777
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-B.M.100.H-H.59CENTROID_WEIGHTED R:0.04843 P:0.02244 F:0.03067
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-B.M.100.H-I.59CENTROID_WEIGHTED R:0.05916 P:0.02706 F:0.03713
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-B.M.100.H-J.59CENTROID_WEIGHTED R:0.05276 P:0.02904 F:0.03746
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-C.M.100.H-G.59CENTROID_WEIGHTED R:0.08297 P:0.03069 F:0.04481
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-C.M.100.H-H.59CENTROID_WEIGHTED R:0.06425 P:0.01858 F:0.02882
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-C.M.100.H-I.59CENTROID_WEIGHTED R:0.09032 P:0.02612 F:0.04052
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0736-C.M.100.H-J.59CENTROID_WEIGHTED R:0.07717 P:0.03204 F:0.04528
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-A.M.100.I-D.59CENTROID_WEIGHTED R:0.12316 P:0.07152 F:0.09049
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-A.M.100.I-H.59CENTROID_WEIGHTED R:0.10738 P:0.06299 F:0.07940
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-A.M.100.I-I.59CENTROID_WEIGHTED R:0.11667 P:0.06890 F:0.08664
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-A.M.100.I-J.59CENTROID_WEIGHTED R:0.10817 P:0.06430 F:0.08066
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-B.M.100.I-D.59CENTROID_WEIGHTED R:0.09833 P:0.05842 F:0.07329
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-B.M.100.I-H.59CENTROID_WEIGHTED R:0.10034 P:0.05842 F:0.07385
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-B.M.100.I-I.59CENTROID_WEIGHTED R:0.11167 P:0.06568 F:0.08271
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-B.M.100.I-J.59CENTROID_WEIGHTED R:0.09413 P:0.05611 F:0.07031
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-C.M.100.I-D.59CENTROID_WEIGHTED R:0.05137 P:0.03084 F:0.03854
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-C.M.100.I-H.59CENTROID_WEIGHTED R:0.04785 P:0.02854 F:0.03575
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-C.M.100.I-I.59CENTROID_WEIGHTED R:0.04973 P:0.02986 F:0.03731
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0740-C.M.100.I-J.59CENTROID_WEIGHTED R:0.04956 P:0.02986 F:0.03727
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-A.M.100.J-B.59CENTROID_WEIGHTED R:0.06569 P:0.04690 F:0.05473
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-A.M.100.J-H.59CENTROID_WEIGHTED R:0.10654 P:0.07829 F:0.09026
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-A.M.100.J-I.59CENTROID_WEIGHTED R:0.10203 P:0.07403 F:0.08580
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-A.M.100.J-J.59CENTROID_WEIGHTED R:0.09569 P:0.07054 F:0.08121
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-B.M.100.J-B.59CENTROID_WEIGHTED R:0.09814 P:0.04820 F:0.06465
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-B.M.100.J-H.59CENTROID_WEIGHTED R:0.08198 P:0.04093 F:0.05460
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-B.M.100.J-I.59CENTROID_WEIGHTED R:0.11201 P:0.05574 F:0.07444
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-B.M.100.J-J.59CENTROID_WEIGHTED R:0.10969 P:0.05547 F:0.07368
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-C.M.100.J-B.59CENTROID_WEIGHTED R:0.10858 P:0.05688 F:0.07465
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-C.M.100.J-H.59CENTROID_WEIGHTED R:0.09150 P:0.04778 F:0.06278
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-C.M.100.J-I.59CENTROID_WEIGHTED R:0.10710 P:0.05575 F:0.07333
59CENTROID_WEIGHTED ROUGE-SU4 Eval D0743-C.M.100.J-J.59CENTROID_WEIGHTED R:0.09677 P:0.05119 F:0.06696
---------------------------------------------
59GRAPH ROUGE-1 Average_R: 0.33220 (95%-conf.int. 0.32274 - 0.34248)
59GRAPH ROUGE-1 Average_P: 0.16720 (95%-conf.int. 0.15916 - 0.17640)
59GRAPH ROUGE-1 Average_F: 0.22100 (95%-conf.int. 0.21196 - 0.23118)
.............................................
59GRAPH ROUGE-1 Eval D0703-A.M.100.A-A.59GRAPH R:0.37162 P:0.23207 F:0.28572
59GRAPH ROUGE-1 Eval D0703-A.M.100.A-C.59GRAPH R:0.32215 P:0.20253 F:0.24870
59GRAPH ROUGE-1 Eval D0703-A.M.100.A-D.59GRAPH R:0.34364 P:0.21097 F:0.26144
59GRAPH ROUGE-1 Eval D0703-A.M.100.A-J.59GRAPH R:0.34694 P:0.21519 F:0.26563
59GRAPH ROUGE-1 Eval D0703-B.M.100.A-A.59GRAPH R:0.36928 P:0.21281 F:0.27001
59GRAPH ROUGE-1 Eval D0703-B.M.100.A-C.59GRAPH R:0.34564 P:0.19397 F:0.24849
59GRAPH ROUGE-1 Eval D0703-B.M.100.A-D.59GRAPH R:0.32886 P:0.18456 F:0.23643
59GRAPH ROUGE-1 Eval D0703-B.M.100.A-J.59GRAPH R:0.33223 P:0.18832 F:0.24038
59GRAPH ROUGE-1 Eval D0703-C.M.100.A-A.59GRAPH R:0.39333 P:0.22736 F:0.28816
59GRAPH ROUGE-1 Eval D0703-C.M.100.A-C.59GRAPH R:0.37013 P:0.21965 F:0.27569
59GRAPH ROUGE-1 Eval D0703-C.M.100.A-D.59GRAPH R:0.39404 P:0.22929 F:0.28989
59GRAPH ROUGE-1 Eval D0703-C.M.100.A-J.59GRAPH R:0.39735 P:0.23121 F:0.29232
59GRAPH ROUGE-1 Eval D0706-A.M.100.B-B.59GRAPH R:0.29545 P:0.13422 F:0.18458
59GRAPH ROUGE-1 Eval D0706-A.M.100.B-D.59GRAPH R:0.29412 P:0.13274 F:0.18292
59GRAPH ROUGE-1 Eval D0706-A.M.100.B-E.59GRAPH R:0.25325 P:0.11504 F:0.15821
59GRAPH ROUGE-1 Eval D0706-A.M.100.B-I.59GRAPH R:0.28896 P:0.13127 F:0.18053
59GRAPH ROUGE-1 Eval D0706-B.M.100.B-B.59GRAPH R:0.28105 P:0.13333 F:0.18086
59GRAPH ROUGE-1 Eval D0706-B.M.100.B-D.59GRAPH R:0.26384 P:0.12558 F:0.17017
59GRAPH ROUGE-1 Eval D0706-B.M.100.B-E.59GRAPH R:0.25649 P:0.12248 F:0.16579
59GRAPH ROUGE-1 Eval D0706-B.M.100.B-I.59GRAPH R:0.29126 P:0.13953 F:0.18867
59GRAPH ROUGE-1 Eval D0706-C.M.100.B-B.59GRAPH R:0.39677 P:0.25466 F:0.31021
59GRAPH ROUGE-1 Eval D0706-C.M.100.B-D.59GRAPH R:0.40645 P:0.26087 F:0.31778
59GRAPH ROUGE-1 Eval D0706-C.M.100.B-E.59GRAPH R:0.41026 P:0.26501 F:0.32201
59GRAPH ROUGE-1 Eval D0706-C.M.100.B-I.59GRAPH R:0.41534 P:0.26915 F:0.32663
59GRAPH ROUGE-1 Eval D0711-A.M.100.C-A.59GRAPH R:0.28289 P:0.11198 F:0.16045
59GRAPH ROUGE-1 Eval D0711-A.M.100.C-B.59GRAPH R:0.31667 P:0.12370 F:0.17791
59GRAPH ROUGE-1 Eval D0711-A.M.100.C-C.59GRAPH R:0.29333 P:0.11458 F:0.16479
59GRAPH ROUGE-1 Eval D0711-A.M.100.C-F.59GRAPH R:0.32119 P:0.12630 F:0.18131
59GRAPH ROUGE-1 Eval D0711-B.M.100.C-A.59GRAPH R:0.27891 P:0.10977 F:0.15754
59GRAPH ROUGE-1 Eval D0711-B.M.100.C-B.59GRAPH R:0.29110 P:0.11379 F:0.16362
59GRAPH ROUGE-1 Eval D0711-B.M.100.C-C.59GRAPH R:0.26846 P:0.10710 F:0.15312
59GRAPH ROUGE-1 Eval D0711-B.M.100.C-F.59GRAPH R:0.28136 P:0.11111 F:0.15931
59GRAPH ROUGE-1 Eval D0711-C.M.100.C-A.59GRAPH R:0.34323 P:0.17077 F:0.22807
59GRAPH ROUGE-1 Eval D0711-C.M.100.C-B.59GRAPH R:0.36177 P:0.17406 F:0.23504
59GRAPH ROUGE-1 Eval D0711-C.M.100.C-C.59GRAPH R:0.36486 P:0.17734 F:0.23867
59GRAPH ROUGE-1 Eval D0711-C.M.100.C-F.59GRAPH R:0.35473 P:0.17241 F:0.23204
59GRAPH ROUGE-1 Eval D0716-A.M.100.D-C.59GRAPH R:0.30164 P:0.15808 F:0.20744
59GRAPH ROUGE-1 Eval D0716-A.M.100.D-D.59GRAPH R:0.30000 P:0.15464 F:0.20408
59GRAPH ROUGE-1 Eval D0716-A.M.100.D-E.59GRAPH R:0.30233 P:0.15636 F:0.20612
59GRAPH ROUGE-1 Eval D0716-A.M.100.D-F.59GRAPH R:0.29703 P:0.15464 F:0.20339
59GRAPH ROUGE-1 Eval D0716-B.M.100.D-C.59GRAPH R:0.38487 P:0.21311 F:0.27432
59GRAPH ROUGE-1 Eval D0716-B.M.100.D-D.59GRAPH R:0.38926 P:0.21129 F:0.27390
59GRAPH ROUGE-1 Eval D0716-B.M.100.D-E.59GRAPH R:0.37542 P:0.20583 F:0.26588
59GRAPH ROUGE-1 Eval D0716-B.M.100.D-F.59GRAPH R:0.36667 P:0.20036 F:0.25913
59GRAPH ROUGE-1 Eval D0716-C.M.100.D-C.59GRAPH R:0.44625 P:0.28364 F:0.34683
59GRAPH ROUGE-1 Eval D0716-C.M.100.D-D.59GRAPH R:0.47157 P:0.29193 F:0.36062
59GRAPH ROUGE-1 Eval D0716-C.M.100.D-E.59GRAPH R:0.45215 P:0.28364 F:0.34860
59GRAPH ROUGE-1 Eval D0716-C.M.100.D-F.59GRAPH R:0.45667 P:0.28364 F:0.34993
59GRAPH ROUGE-1 Eval D0721-A.M.100.E-B.59GRAPH R:0.26333 P:0.11862 F:0.16356
59GRAPH ROUGE-1 Eval D0721-A.M.100.E-C.59GRAPH R:0.23701 P:0.10961 F:0.14990
59GRAPH ROUGE-1 Eval D0721-A.M.100.E-E.59GRAPH R:0.24675 P:0.11411 F:0.15605
59GRAPH ROUGE-1 Eval D0721-A.M.100.E-G.59GRAPH R:0.25796 P:0.12162 F:0.16530
59GRAPH ROUGE-1 Eval D0721-B.M.100.E-B.59GRAPH R:0.21173 P:0.09181 F:0.12808
59GRAPH ROUGE-1 Eval D0721-B.M.100.E-C.59GRAPH R:0.22611 P:0.10028 F:0.13894
59GRAPH ROUGE-1 Eval D0721-B.M.100.E-E.59GRAPH R:0.18361 P:0.07910 F:0.11057
59GRAPH ROUGE-1 Eval D0721-B.M.100.E-G.59GRAPH R:0.21290 P:0.09322 F:0.12967
59GRAPH ROUGE-1 Eval D0721-C.M.100.E-B.59GRAPH R:0.35410 P:0.16514 F:0.22524
59GRAPH ROUGE-1 Eval D0721-C.M.100.E-C.59GRAPH R:0.32013 P:0.14832 F:0.20272
59GRAPH ROUGE-1 Eval D0721-C.M.100.E-E.59GRAPH R:0.32333 P:0.14832 F:0.20336
59GRAPH ROUGE-1 Eval D0721-C.M.100.E-G.59GRAPH R:0.32573 P:0.15291 F:0.20812
59GRAPH ROUGE-1 Eval D0726-A.M.100.F-A.59GRAPH R:0.32890 P:0.13750 F:0.19393
59GRAPH ROUGE-1 Eval D0726-A.M.100.F-E.59GRAPH R:0.31333 P:0.13056 F:0.18432
59GRAPH ROUGE-1 Eval D0726-A.M.100.F-F.59GRAPH R:0.34551 P:0.14444 F:0.20372
59GRAPH ROUGE-1 Eval D0726-A.M.100.F-G.59GRAPH R:0.31894 P:0.13333 F:0.18805
59GRAPH ROUGE-1 Eval D0726-B.M.100.F-A.59GRAPH R:0.26797 P:0.08359 F:0.12743
59GRAPH ROUGE-1 Eval D0726-B.M.100.F-E.59GRAPH R:0.28239 P:0.08665 F:0.13261
59GRAPH ROUGE-1 Eval D0726-B.M.100.F-F.59GRAPH R:0.27243 P:0.08359 F:0.12793
59GRAPH ROUGE-1 Eval D0726-B.M.100.F-G.59GRAPH R:0.28618 P:0.08869 F:0.13541
59GRAPH ROUGE-1 Eval D0726-C.M.100.F-A.59GRAPH R:0.37000 P:0.17874 F:0.24104
59GRAPH ROUGE-1 Eval D0726-C.M.100.F-E.59GRAPH R:0.37037 P:0.17713 F:0.23965
59GRAPH ROUGE-1 Eval D0726-C.M.100.F-F.59GRAPH R:0.39322 P:0.18680 F:0.25328
59GRAPH ROUGE-1 Eval D0726-C.M.100.F-G.59GRAPH R:0.38033 P:0.18680 F:0.25054
59GRAPH ROUGE-1 Eval D0727-A.M.100.G-A.59GRAPH R:0.36877 P:0.14859 F:0.21183
59GRAPH ROUGE-1 Eval D0727-A.M.100.G-F.59GRAPH R:0.37500 P:0.15261 F:0.21694
59GRAPH ROUGE-1 Eval D0727-A.M.100.G-G.59GRAPH R:0.33987 P:0.13922 F:0.19753
59GRAPH ROUGE-1 Eval D0727-A.M.100.G-H.59GRAPH R:0.36842 P:0.14993 F:0.21313
59GRAPH ROUGE-1 Eval D0727-B.M.100.G-A.59GRAPH R:0.38832 P:0.17121 F:0.23764
59GRAPH ROUGE-1 Eval D0727-B.M.100.G-F.59GRAPH R:0.39610 P:0.18485 F:0.25207
59GRAPH ROUGE-1 Eval D0727-B.M.100.G-G.59GRAPH R:0.36332 P:0.15909 F:0.22128
59GRAPH ROUGE-1 Eval D0727-B.M.100.G-H.59GRAPH R:0.37801 P:0.16667 F:0.23134
59GRAPH ROUGE-1 Eval D0727-C.M.100.G-A.59GRAPH R:0.34853 P:0.16512 F:0.22408
59GRAPH ROUGE-1 Eval D0727-C.M.100.G-F.59GRAPH R:0.38721 P:0.17747 F:0.24339
59GRAPH ROUGE-1 Eval D0727-C.M.100.G-G.59GRAPH R:0.36964 P:0.17284 F:0.23554
59GRAPH ROUGE-1 Eval D0727-C.M.100.G-H.59GRAPH R:0.36149 P:0.16512 F:0.22669
59GRAPH ROUGE-1 Eval D0736-A.M.100.H-G.59GRAPH R:0.30108 P:0.13462 F:0.18605
59GRAPH ROUGE-1 Eval D0736-A.M.100.H-H.59GRAPH R:0.33212 P:0.14583 F:0.20267
59GRAPH ROUGE-1 Eval D0736-A.M.100.H-I.59GRAPH R:0.31673 P:0.14263 F:0.19669
59GRAPH ROUGE-1 Eval D0736-A.M.100.H-J.59GRAPH R:0.31373 P:0.15385 F:0.20646
59GRAPH ROUGE-1 Eval D0736-B.M.100.H-G.59GRAPH R:0.40840 P:0.20381 F:0.27192
59GRAPH ROUGE-1 Eval D0736-B.M.100.H-H.59GRAPH R:0.44215 P:0.20381 F:0.27901
59GRAPH ROUGE-1 Eval D0736-B.M.100.H-I.59GRAPH R:0.42678 P:0.19429 F:0.26702
59GRAPH ROUGE-1 Eval D0736-B.M.100.H-J.59GRAPH R:0.44755 P:0.24381 F:0.31566
59GRAPH ROUGE-1 Eval D0736-C.M.100.H-G.59GRAPH R:0.32489 P:0.12460 F:0.18012
59GRAPH ROUGE-1 Eval D0736-C.M.100.H-H.59GRAPH R:0.30481 P:0.09223 F:0.14161
59GRAPH ROUGE-1 Eval D0736-C.M.100.H-I.59GRAPH R:0.34759 P:0.10518 F:0.16149
59GRAPH ROUGE-1 Eval D0736-C.M.100.H-J.59GRAPH R:0.31321 P:0.13430 F:0.18799
59GRAPH ROUGE-1 Eval D0740-A.M.100.I-D.59GRAPH R:0.30363 P:0.16577 F:0.21446
59GRAPH ROUGE-1 Eval D0740-A.M.100.I-H.59GRAPH R:0.29739 P:0.16396 F:0.21138
59GRAPH ROUGE-1 Eval D0740-A.M.100.I-I.59GRAPH R:0.30844 P:0.17117 F:0.22016
59GRAPH ROUGE-1 Eval D0740-A.M.100.I-J.59GRAPH R:0.28387 P:0.15856 F:0.20347
59GRAPH ROUGE-1 Eval D0740-B.M.100.I-D.59GRAPH R:0.26948 P:0.14116 F:0.18527
59GRAPH ROUGE-1 Eval D0740-B.M.100.I-H.59GRAPH R:0.24503 P:0.12585 F:0.16629
59GRAPH ROUGE-1 Eval D0740-B.M.100.I-I.59GRAPH R:0.26885 P:0.13946 F:0.18365
59GRAPH ROUGE-1 Eval D0740-B.M.100.I-J.59GRAPH R:0.24595 P:0.12925 F:0.16945
59GRAPH ROUGE-1 Eval D0740-C.M.100.I-D.59GRAPH R:0.41853 P:0.25686 F:0.31835
59GRAPH ROUGE-1 Eval D0740-C.M.100.I-H.59GRAPH R:0.41158 P:0.25098 F:0.31182
59GRAPH ROUGE-1 Eval D0740-C.M.100.I-I.59GRAPH R:0.40895 P:0.25098 F:0.31106
59GRAPH ROUGE-1 Eval D0740-C.M.100.I-J.59GRAPH R:0.40127 P:0.24706 F:0.30583
59GRAPH ROUGE-1 Eval D0743-A.M.100.J-B.59GRAPH R:0.30476 P:0.15686 F:0.20712
59GRAPH ROUGE-1 Eval D0743-A.M.100.J-H.59GRAPH R:0.26852 P:0.14216 F:0.18590
59GRAPH ROUGE-1 Eval D0743-A.M.100.J-I.59GRAPH R:0.30625 P:0.16013 F:0.21030
59GRAPH ROUGE-1 Eval D0743-A.M.100.J-J.59GRAPH R:0.25231 P:0.13399 F:0.17503
59GRAPH ROUGE-1 Eval D0743-B.M.100.J-B.59GRAPH R:0.28205 P:0.16479 F:0.20803
59GRAPH ROUGE-1 Eval D0743-B.M.100.J-H.59GRAPH R:0.29022 P:0.17228 F:0.21621
59GRAPH ROUGE-1 Eval D0743-B.M.100.J-I.59GRAPH R:0.31329 P:0.18539 F:0.23294
59GRAPH ROUGE-1 Eval D0743-B.M.100.J-J.59GRAPH R:0.28972 P:0.17416 F:0.21755
59GRAPH ROUGE-1 Eval D0743-C.M.100.J-B.59GRAPH R:0.34603 P:0.19640 F:0.25058
59GRAPH ROUGE-1 Eval D0743-C.M.100.J-H.59GRAPH R:0.31529 P:0.17838 F:0.22785
59GRAPH ROUGE-1 Eval D0743-C.M.100.J-I.59GRAPH R:0.37700 P:0.21261 F:0.27189
59GRAPH ROUGE-1 Eval D0743-C.M.100.J-J.59GRAPH R:0.32390 P:0.18559 F:0.23597
---------------------------------------------
59GRAPH ROUGE-2 Average_R: 0.06742 (95%-conf.int. 0.06140 - 0.07388)
59GRAPH ROUGE-2 Average_P: 0.03458 (95%-conf.int. 0.03076 - 0.03854)
59GRAPH ROUGE-2 Average_F: 0.04541 (95%-conf.int. 0.04079 - 0.05030)
.............................................
59GRAPH ROUGE-2 Eval D0703-A.M.100.A-A.59GRAPH R:0.09215 P:0.05732 F:0.07068
59GRAPH ROUGE-2 Eval D0703-A.M.100.A-C.59GRAPH R:0.06441 P:0.04034 F:0.04961
59GRAPH ROUGE-2 Eval D0703-A.M.100.A-D.59GRAPH R:0.08333 P:0.05096 F:0.06324
59GRAPH ROUGE-2 Eval D0703-A.M.100.A-J.59GRAPH R:0.08935 P:0.05520 F:0.06824
59GRAPH ROUGE-2 Eval D0703-B.M.100.A-A.59GRAPH R:0.10561 P:0.06061 F:0.07702
59GRAPH ROUGE-2 Eval D0703-B.M.100.A-C.59GRAPH R:0.10169 P:0.05682 F:0.07290
59GRAPH ROUGE-2 Eval D0703-B.M.100.A-D.59GRAPH R:0.09831 P:0.05492 F:0.07047
59GRAPH ROUGE-2 Eval D0703-B.M.100.A-J.59GRAPH R:0.09732 P:0.05492 F:0.07022
59GRAPH ROUGE-2 Eval D0703-C.M.100.A-A.59GRAPH R:0.11448 P:0.06589 F:0.08364
59GRAPH ROUGE-2 Eval D0703-C.M.100.A-C.59GRAPH R:0.08852 P:0.05233 F:0.06578
59GRAPH ROUGE-2 Eval D0703-C.M.100.A-D.59GRAPH R:0.11037 P:0.06395 F:0.08098
59GRAPH ROUGE-2 Eval D0703-C.M.100.A-J.59GRAPH R:0.11706 P:0.06783 F:0.08589
59GRAPH ROUGE-2 Eval D0706-A.M.100.B-B.59GRAPH R:0.06230 P:0.02815 F:0.03878
59GRAPH ROUGE-2 Eval D0706-A.M.100.B-D.59GRAPH R:0.06931 P:0.03111 F:0.04294
59GRAPH ROUGE-2 Eval D0706-A.M.100.B-E.59GRAPH R:0.03279 P:0.01481 F:0.02040
59GRAPH ROUGE-2 Eval D0706-A.M.100.B-I.59GRAPH R:0.06230 P:0.02815 F:0.03878
59GRAPH ROUGE-2 Eval D0706-B.M.100.B-B.59GRAPH R:0.03960 P:0.01869 F:0.02539
59GRAPH ROUGE-2 Eval D0706-B.M.100.B-D.59GRAPH R:0.03618 P:0.01713 F:0.02325
59GRAPH ROUGE-2 Eval D0706-B.M.100.B-E.59GRAPH R:0.01639 P:0.00779 F:0.01056
59GRAPH ROUGE-2 Eval D0706-B.M.100.B-I.59GRAPH R:0.03595 P:0.01713 F:0.02320
59GRAPH ROUGE-2 Eval D0706-C.M.100.B-B.59GRAPH R:0.08469 P:0.05417 F:0.06608
59GRAPH ROUGE-2 Eval D0706-C.M.100.B-D.59GRAPH R:0.09121 P:0.05833 F:0.07116
59GRAPH ROUGE-2 Eval D0706-C.M.100.B-E.59GRAPH R:0.10032 P:0.06458 F:0.07858
59GRAPH ROUGE-2 Eval D0706-C.M.100.B-I.59GRAPH R:0.09355 P:0.06042 F:0.07342
59GRAPH ROUGE-2 Eval D0711-A.M.100.C-A.59GRAPH R:0.03322 P:0.01307 F:0.01876
59GRAPH ROUGE-2 Eval D0711-A.M.100.C-B.59GRAPH R:0.05051 P:0.01961 F:0.02825
59GRAPH ROUGE-2 Eval D0711-A.M.100.C-C.59GRAPH R:0.03704 P:0.01438 F:0.02072
59GRAPH ROUGE-2 Eval D0711-A.M.100.C-F.59GRAPH R:0.04013 P:0.01569 F:0.02256
59GRAPH ROUGE-2 Eval D0711-B.M.100.C-A.59GRAPH R:0.04811 P:0.01882 F:0.02706
59GRAPH ROUGE-2 Eval D0711-B.M.100.C-B.59GRAPH R:0.06920 P:0.02688 F:0.03872
59GRAPH ROUGE-2 Eval D0711-B.M.100.C-C.59GRAPH R:0.04407 P:0.01747 F:0.02502
59GRAPH ROUGE-2 Eval D0711-B.M.100.C-F.59GRAPH R:0.05479 P:0.02151 F:0.03089
59GRAPH ROUGE-2 Eval D0711-C.M.100.C-A.59GRAPH R:0.03667 P:0.01815 F:0.02428
59GRAPH ROUGE-2 Eval D0711-C.M.100.C-B.59GRAPH R:0.04483 P:0.02145 F:0.02902
59GRAPH ROUGE-2 Eval D0711-C.M.100.C-C.59GRAPH R:0.03072 P:0.01485 F:0.02002
59GRAPH ROUGE-2 Eval D0711-C.M.100.C-F.59GRAPH R:0.05119 P:0.02475 F:0.03337
59GRAPH ROUGE-2 Eval D0716-A.M.100.D-C.59GRAPH R:0.06954 P:0.03627 F:0.04767
59GRAPH ROUGE-2 Eval D0716-A.M.100.D-D.59GRAPH R:0.08418 P:0.04318 F:0.05708
59GRAPH ROUGE-2 Eval D0716-A.M.100.D-E.59GRAPH R:0.08725 P:0.04491 F:0.05930
59GRAPH ROUGE-2 Eval D0716-A.M.100.D-F.59GRAPH R:0.08000 P:0.04145 F:0.05461
59GRAPH ROUGE-2 Eval D0716-B.M.100.D-C.59GRAPH R:0.05316 P:0.02930 F:0.03778
59GRAPH ROUGE-2 Eval D0716-B.M.100.D-D.59GRAPH R:0.05763 P:0.03114 F:0.04043
59GRAPH ROUGE-2 Eval D0716-B.M.100.D-E.59GRAPH R:0.05034 P:0.02747 F:0.03554
59GRAPH ROUGE-2 Eval D0716-B.M.100.D-F.59GRAPH R:0.05051 P:0.02747 F:0.03559
59GRAPH ROUGE-2 Eval D0716-C.M.100.D-C.59GRAPH R:0.12171 P:0.07708 F:0.09439
59GRAPH ROUGE-2 Eval D0716-C.M.100.D-D.59GRAPH R:0.13176 P:0.08125 F:0.10052
59GRAPH ROUGE-2 Eval D0716-C.M.100.D-E.59GRAPH R:0.10333 P:0.06458 F:0.07948
59GRAPH ROUGE-2 Eval D0716-C.M.100.D-F.59GRAPH R:0.12458 P:0.07708 F:0.09524
59GRAPH ROUGE-2 Eval D0721-A.M.100.E-B.59GRAPH R:0.05051 P:0.02262 F:0.03125
59GRAPH ROUGE-2 Eval D0721-A.M.100.E-C.59GRAPH R:0.02951 P:0.01357 F:0.01859
59GRAPH ROUGE-2 Eval D0721-A.M.100.E-E.59GRAPH R:0.04262 P:0.01961 F:0.02686
59GRAPH ROUGE-2 Eval D0721-A.M.100.E-G.59GRAPH R:0.04502 P:0.02112 F:0.02875
59GRAPH ROUGE-2 Eval D0721-B.M.100.E-B.59GRAPH R:0.00658 P:0.00284 F:0.00397
59GRAPH ROUGE-2 Eval D0721-B.M.100.E-C.59GRAPH R:0.00643 P:0.00284 F:0.00394
59GRAPH ROUGE-2 Eval D0721-B.M.100.E-E.59GRAPH R:0.00662 P:0.00284 F:0.00397
59GRAPH ROUGE-2 Eval D0721-B.M.100.E-G.59GRAPH R:0.00977 P:0.00426 F:0.00593
59GRAPH ROUGE-2 Eval D0721-C.M.100.E-B.59GRAPH R:0.06291 P:0.02919 F:0.03988
59GRAPH ROUGE-2 Eval D0721-C.M.100.E-C.59GRAPH R:0.06333 P:0.02919 F:0.03996
59GRAPH ROUGE-2 Eval D0721-C.M.100.E-E.59GRAPH R:0.08081 P:0.03687 F:0.05064
59GRAPH ROUGE-2 Eval D0721-C.M.100.E-G.59GRAPH R:0.06250 P:0.02919 F:0.03979
59GRAPH ROUGE-2 Eval D0726-A.M.100.F-A.59GRAPH R:0.02685 P:0.01116 F:0.01577
59GRAPH ROUGE-2 Eval D0726-A.M.100.F-E.59GRAPH R:0.03030 P:0.01255 F:0.01775
59GRAPH ROUGE-2 Eval D0726-A.M.100.F-F.59GRAPH R:0.03020 P:0.01255 F:0.01773
59GRAPH ROUGE-2 Eval D0726-A.M.100.F-G.59GRAPH R:0.02349 P:0.00976 F:0.01379
59GRAPH ROUGE-2 Eval D0726-B.M.100.F-A.59GRAPH R:0.06271 P:0.01943 F:0.02967
59GRAPH ROUGE-2 Eval D0726-B.M.100.F-E.59GRAPH R:0.05369 P:0.01636 F:0.02508
59GRAPH ROUGE-2 Eval D0726-B.M.100.F-F.59GRAPH R:0.05034 P:0.01534 F:0.02351
59GRAPH ROUGE-2 Eval D0726-B.M.100.F-G.59GRAPH R:0.05316 P:0.01636 F:0.02502
59GRAPH ROUGE-2 Eval D0726-C.M.100.F-A.59GRAPH R:0.04714 P:0.02265 F:0.03060
59GRAPH ROUGE-2 Eval D0726-C.M.100.F-E.59GRAPH R:0.05442 P:0.02589 F:0.03509
59GRAPH ROUGE-2 Eval D0726-C.M.100.F-F.59GRAPH R:0.05137 P:0.02427 F:0.03297
59GRAPH ROUGE-2 Eval D0726-C.M.100.F-G.59GRAPH R:0.04967 P:0.02427 F:0.03261
59GRAPH ROUGE-2 Eval D0727-A.M.100.G-A.59GRAPH R:0.06711 P:0.02688 F:0.03839
59GRAPH ROUGE-2 Eval D0727-A.M.100.G-F.59GRAPH R:0.07641 P:0.03091 F:0.04401
59GRAPH ROUGE-2 Eval D0727-A.M.100.G-G.59GRAPH R:0.05281 P:0.02151 F:0.03057
59GRAPH ROUGE-2 Eval D0727-A.M.100.G-H.59GRAPH R:0.07309 P:0.02957 F:0.04211
59GRAPH ROUGE-2 Eval D0727-B.M.100.G-A.59GRAPH R:0.06944 P:0.03044 F:0.04233
59GRAPH ROUGE-2 Eval D0727-B.M.100.G-F.59GRAPH R:0.08852 P:0.04110 F:0.05614
59GRAPH ROUGE-2 Eval D0727-B.M.100.G-G.59GRAPH R:0.07692 P:0.03349 F:0.04666
59GRAPH ROUGE-2 Eval D0727-B.M.100.G-H.59GRAPH R:0.10417 P:0.04566 F:0.06349
59GRAPH ROUGE-2 Eval D0727-C.M.100.G-A.59GRAPH R:0.03289 P:0.01550 F:0.02107
59GRAPH ROUGE-2 Eval D0727-C.M.100.G-F.59GRAPH R:0.05782 P:0.02636 F:0.03621
59GRAPH ROUGE-2 Eval D0727-C.M.100.G-G.59GRAPH R:0.04667 P:0.02171 F:0.02963
59GRAPH ROUGE-2 Eval D0727-C.M.100.G-H.59GRAPH R:0.04437 P:0.02016 F:0.02772
59GRAPH ROUGE-2 Eval D0736-A.M.100.H-G.59GRAPH R:0.09420 P:0.04187 F:0.05797
59GRAPH ROUGE-2 Eval D0736-A.M.100.H-H.59GRAPH R:0.09225 P:0.04026 F:0.05606
59GRAPH ROUGE-2 Eval D0736-A.M.100.H-I.59GRAPH R:0.09353 P:0.04187 F:0.05784
59GRAPH ROUGE-2 Eval D0736-A.M.100.H-J.59GRAPH R:0.07261 P:0.03543 F:0.04762
59GRAPH ROUGE-2 Eval D0736-B.M.100.H-G.59GRAPH R:0.12355 P:0.06130 F:0.08194
59GRAPH ROUGE-2 Eval D0736-B.M.100.H-H.59GRAPH R:0.18410 P:0.08429 F:0.11564
59GRAPH ROUGE-2 Eval D0736-B.M.100.H-I.59GRAPH R:0.15678 P:0.07088 F:0.09762
59GRAPH ROUGE-2 Eval D0736-B.M.100.H-J.59GRAPH R:0.18375 P:0.09962 F:0.12920
59GRAPH ROUGE-2 Eval D0736-C.M.100.H-G.59GRAPH R:0.05556 P:0.02114 F:0.03063
59GRAPH ROUGE-2 Eval D0736-C.M.100.H-H.59GRAPH R:0.04348 P:0.01301 F:0.02003
59GRAPH ROUGE-2 Eval D0736-C.M.100.H-I.59GRAPH R:0.07065 P:0.02114 F:0.03254
59GRAPH ROUGE-2 Eval D0736-C.M.100.H-J.59GRAPH R:0.05344 P:0.02276 F:0.03192
59GRAPH ROUGE-2 Eval D0740-A.M.100.I-D.59GRAPH R:0.06000 P:0.03261 F:0.04225
59GRAPH ROUGE-2 Eval D0740-A.M.100.I-H.59GRAPH R:0.06271 P:0.03442 F:0.04445
59GRAPH ROUGE-2 Eval D0740-A.M.100.I-I.59GRAPH R:0.06230 P:0.03442 F:0.04434
59GRAPH ROUGE-2 Eval D0740-A.M.100.I-J.59GRAPH R:0.05212 P:0.02899 F:0.03726
59GRAPH ROUGE-2 Eval D0740-B.M.100.I-D.59GRAPH R:0.03607 P:0.01880 F:0.02472
59GRAPH ROUGE-2 Eval D0740-B.M.100.I-H.59GRAPH R:0.03679 P:0.01880 F:0.02488
59GRAPH ROUGE-2 Eval D0740-B.M.100.I-I.59GRAPH R:0.04636 P:0.02393 F:0.03157
59GRAPH ROUGE-2 Eval D0740-B.M.100.I-J.59GRAPH R:0.03922 P:0.02051 F:0.02693
59GRAPH ROUGE-2 Eval D0740-C.M.100.I-D.59GRAPH R:0.14516 P:0.08876 F:0.11016
59GRAPH ROUGE-2 Eval D0740-C.M.100.I-H.59GRAPH R:0.13961 P:0.08481 F:0.10552
59GRAPH ROUGE-2 Eval D0740-C.M.100.I-I.59GRAPH R:0.13226 P:0.08087 F:0.10037
59GRAPH ROUGE-2 Eval D0740-C.M.100.I-J.59GRAPH R:0.14469 P:0.08876 F:0.11003
59GRAPH ROUGE-2 Eval D0743-A.M.100.J-B.59GRAPH R:0.07372 P:0.03777 F:0.04995
59GRAPH ROUGE-2 Eval D0743-A.M.100.J-H.59GRAPH R:0.04361 P:0.02299 F:0.03011
59GRAPH ROUGE-2 Eval D0743-A.M.100.J-I.59GRAPH R:0.06940 P:0.03612 F:0.04751
59GRAPH ROUGE-2 Eval D0743-A.M.100.J-J.59GRAPH R:0.04037 P:0.02135 F:0.02793
59GRAPH ROUGE-2 Eval D0743-B.M.100.J-B.59GRAPH R:0.02589 P:0.01507 F:0.01905
59GRAPH ROUGE-2 Eval D0743-B.M.100.J-H.59GRAPH R:0.02548 P:0.01507 F:0.01894
59GRAPH ROUGE-2 Eval D0743-B.M.100.J-I.59GRAPH R:0.02875 P:0.01695 F:0.02133
59GRAPH ROUGE-2 Eval D0743-B.M.100.J-J.59GRAPH R:0.02516 P:0.01507 F:0.01885
59GRAPH ROUGE-2 Eval D0743-C.M.100.J-B.59GRAPH R:0.08333 P:0.04710 F:0.06018
59GRAPH ROUGE-2 Eval D0743-C.M.100.J-H.59GRAPH R:0.06109 P:0.03442 F:0.04403
59GRAPH ROUGE-2 Eval D0743-C.M.100.J-I.59GRAPH R:0.09355 P:0.05254 F:0.06729
59GRAPH ROUGE-2 Eval D0743-C.M.100.J-J.59GRAPH R:0.06984 P:0.03986 F:0.05075
---------------------------------------------
59GRAPH ROUGE-3 Average_R: 0.02075 (95%-conf.int. 0.01688 - 0.02517)
59GRAPH ROUGE-3 Average_P: 0.01070 (95%-conf.int. 0.00859 - 0.01314)
59GRAPH ROUGE-3 Average_F: 0.01403 (95%-conf.int. 0.01136 - 0.01713)
.............................................
59GRAPH ROUGE-3 Eval D0703-A.M.100.A-A.59GRAPH R:0.02759 P:0.01709 F:0.02111
59GRAPH ROUGE-3 Eval D0703-A.M.100.A-C.59GRAPH R:0.00685 P:0.00427 F:0.00526
59GRAPH ROUGE-3 Eval D0703-A.M.100.A-D.59GRAPH R:0.02807 P:0.01709 F:0.02125
59GRAPH ROUGE-3 Eval D0703-A.M.100.A-J.59GRAPH R:0.02083 P:0.01282 F:0.01587
59GRAPH ROUGE-3 Eval D0703-B.M.100.A-A.59GRAPH R:0.03000 P:0.01714 F:0.02182
59GRAPH ROUGE-3 Eval D0703-B.M.100.A-C.59GRAPH R:0.01712 P:0.00952 F:0.01224
59GRAPH ROUGE-3 Eval D0703-B.M.100.A-D.59GRAPH R:0.02397 P:0.01333 F:0.01713
59GRAPH ROUGE-3 Eval D0703-B.M.100.A-J.59GRAPH R:0.02034 P:0.01143 F:0.01464
59GRAPH ROUGE-3 Eval D0703-C.M.100.A-A.59GRAPH R:0.03401 P:0.01949 F:0.02478
59GRAPH ROUGE-3 Eval D0703-C.M.100.A-C.59GRAPH R:0.01325 P:0.00780 F:0.00982
59GRAPH ROUGE-3 Eval D0703-C.M.100.A-D.59GRAPH R:0.03716 P:0.02144 F:0.02719
59GRAPH ROUGE-3 Eval D0703-C.M.100.A-J.59GRAPH R:0.03716 P:0.02144 F:0.02719
59GRAPH ROUGE-3 Eval D0706-A.M.100.B-B.59GRAPH R:0.03311 P:0.01488 F:0.02053
59GRAPH ROUGE-3 Eval D0706-A.M.100.B-D.59GRAPH R:0.03333 P:0.01488 F:0.02057
59GRAPH ROUGE-3 Eval D0706-A.M.100.B-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0706-A.M.100.B-I.59GRAPH R:0.03311 P:0.01488 F:0.02053
59GRAPH ROUGE-3 Eval D0706-B.M.100.B-B.59GRAPH R:0.00333 P:0.00156 F:0.00212
59GRAPH ROUGE-3 Eval D0706-B.M.100.B-D.59GRAPH R:0.00332 P:0.00156 F:0.00212
59GRAPH ROUGE-3 Eval D0706-B.M.100.B-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0706-B.M.100.B-I.59GRAPH R:0.00330 P:0.00156 F:0.00212
59GRAPH ROUGE-3 Eval D0706-C.M.100.B-B.59GRAPH R:0.02632 P:0.01677 F:0.02049
59GRAPH ROUGE-3 Eval D0706-C.M.100.B-D.59GRAPH R:0.02632 P:0.01677 F:0.02049
59GRAPH ROUGE-3 Eval D0706-C.M.100.B-E.59GRAPH R:0.03268 P:0.02096 F:0.02554
59GRAPH ROUGE-3 Eval D0706-C.M.100.B-I.59GRAPH R:0.02280 P:0.01468 F:0.01786
59GRAPH ROUGE-3 Eval D0711-A.M.100.C-A.59GRAPH R:0.00671 P:0.00262 F:0.00377
59GRAPH ROUGE-3 Eval D0711-A.M.100.C-B.59GRAPH R:0.00680 P:0.00262 F:0.00378
59GRAPH ROUGE-3 Eval D0711-A.M.100.C-C.59GRAPH R:0.00680 P:0.00262 F:0.00378
59GRAPH ROUGE-3 Eval D0711-A.M.100.C-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0711-B.M.100.C-A.59GRAPH R:0.00347 P:0.00135 F:0.00194
59GRAPH ROUGE-3 Eval D0711-B.M.100.C-B.59GRAPH R:0.00350 P:0.00135 F:0.00195
59GRAPH ROUGE-3 Eval D0711-B.M.100.C-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0711-B.M.100.C-F.59GRAPH R:0.00346 P:0.00135 F:0.00194
59GRAPH ROUGE-3 Eval D0711-C.M.100.C-A.59GRAPH R:0.00673 P:0.00332 F:0.00445
59GRAPH ROUGE-3 Eval D0711-C.M.100.C-B.59GRAPH R:0.00697 P:0.00332 F:0.00450
59GRAPH ROUGE-3 Eval D0711-C.M.100.C-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0711-C.M.100.C-F.59GRAPH R:0.00690 P:0.00332 F:0.00448
59GRAPH ROUGE-3 Eval D0716-A.M.100.D-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0716-A.M.100.D-D.59GRAPH R:0.00680 P:0.00347 F:0.00460
59GRAPH ROUGE-3 Eval D0716-A.M.100.D-E.59GRAPH R:0.00678 P:0.00347 F:0.00459
59GRAPH ROUGE-3 Eval D0716-A.M.100.D-F.59GRAPH R:0.00673 P:0.00347 F:0.00458
59GRAPH ROUGE-3 Eval D0716-B.M.100.D-C.59GRAPH R:0.01678 P:0.00921 F:0.01189
59GRAPH ROUGE-3 Eval D0716-B.M.100.D-D.59GRAPH R:0.02055 P:0.01105 F:0.01437
59GRAPH ROUGE-3 Eval D0716-B.M.100.D-E.59GRAPH R:0.01695 P:0.00921 F:0.01193
59GRAPH ROUGE-3 Eval D0716-B.M.100.D-F.59GRAPH R:0.01701 P:0.00921 F:0.01195
59GRAPH ROUGE-3 Eval D0716-C.M.100.D-C.59GRAPH R:0.06312 P:0.03983 F:0.04884
59GRAPH ROUGE-3 Eval D0716-C.M.100.D-D.59GRAPH R:0.05802 P:0.03564 F:0.04416
59GRAPH ROUGE-3 Eval D0716-C.M.100.D-E.59GRAPH R:0.03030 P:0.01887 F:0.02326
59GRAPH ROUGE-3 Eval D0716-C.M.100.D-F.59GRAPH R:0.06122 P:0.03774 F:0.04669
59GRAPH ROUGE-3 Eval D0721-A.M.100.E-B.59GRAPH R:0.01020 P:0.00455 F:0.00629
59GRAPH ROUGE-3 Eval D0721-A.M.100.E-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0721-A.M.100.E-E.59GRAPH R:0.00993 P:0.00455 F:0.00624
59GRAPH ROUGE-3 Eval D0721-A.M.100.E-G.59GRAPH R:0.00974 P:0.00455 F:0.00620
59GRAPH ROUGE-3 Eval D0721-B.M.100.E-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0721-B.M.100.E-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0721-B.M.100.E-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0721-B.M.100.E-G.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0721-C.M.100.E-B.59GRAPH R:0.01003 P:0.00463 F:0.00634
59GRAPH ROUGE-3 Eval D0721-C.M.100.E-C.59GRAPH R:0.02357 P:0.01080 F:0.01481
59GRAPH ROUGE-3 Eval D0721-C.M.100.E-E.59GRAPH R:0.02721 P:0.01235 F:0.01699
59GRAPH ROUGE-3 Eval D0721-C.M.100.E-G.59GRAPH R:0.01993 P:0.00926 F:0.01264
59GRAPH ROUGE-3 Eval D0726-A.M.100.F-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0726-A.M.100.F-E.59GRAPH R:0.00680 P:0.00280 F:0.00397
59GRAPH ROUGE-3 Eval D0726-A.M.100.F-F.59GRAPH R:0.00678 P:0.00280 F:0.00396
59GRAPH ROUGE-3 Eval D0726-A.M.100.F-G.59GRAPH R:0.00678 P:0.00280 F:0.00396
59GRAPH ROUGE-3 Eval D0726-B.M.100.F-A.59GRAPH R:0.01667 P:0.00513 F:0.00785
59GRAPH ROUGE-3 Eval D0726-B.M.100.F-E.59GRAPH R:0.01356 P:0.00410 F:0.00630
59GRAPH ROUGE-3 Eval D0726-B.M.100.F-F.59GRAPH R:0.01017 P:0.00308 F:0.00473
59GRAPH ROUGE-3 Eval D0726-B.M.100.F-G.59GRAPH R:0.01007 P:0.00308 F:0.00472
59GRAPH ROUGE-3 Eval D0726-C.M.100.F-A.59GRAPH R:0.00340 P:0.00163 F:0.00220
59GRAPH ROUGE-3 Eval D0726-C.M.100.F-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0726-C.M.100.F-F.59GRAPH R:0.00346 P:0.00163 F:0.00222
59GRAPH ROUGE-3 Eval D0726-C.M.100.F-G.59GRAPH R:0.00334 P:0.00163 F:0.00219
59GRAPH ROUGE-3 Eval D0727-A.M.100.G-A.59GRAPH R:0.02034 P:0.00810 F:0.01159
59GRAPH ROUGE-3 Eval D0727-A.M.100.G-F.59GRAPH R:0.02685 P:0.01080 F:0.01540
59GRAPH ROUGE-3 Eval D0727-A.M.100.G-G.59GRAPH R:0.01667 P:0.00675 F:0.00961
59GRAPH ROUGE-3 Eval D0727-A.M.100.G-H.59GRAPH R:0.02685 P:0.01080 F:0.01540
59GRAPH ROUGE-3 Eval D0727-B.M.100.G-A.59GRAPH R:0.02807 P:0.01223 F:0.01704
59GRAPH ROUGE-3 Eval D0727-B.M.100.G-F.59GRAPH R:0.04967 P:0.02294 F:0.03138
59GRAPH ROUGE-3 Eval D0727-B.M.100.G-G.59GRAPH R:0.04240 P:0.01835 F:0.02561
59GRAPH ROUGE-3 Eval D0727-B.M.100.G-H.59GRAPH R:0.05614 P:0.02446 F:0.03407
59GRAPH ROUGE-3 Eval D0727-C.M.100.G-A.59GRAPH R:0.00664 P:0.00312 F:0.00425
59GRAPH ROUGE-3 Eval D0727-C.M.100.G-F.59GRAPH R:0.01375 P:0.00623 F:0.00857
59GRAPH ROUGE-3 Eval D0727-C.M.100.G-G.59GRAPH R:0.01010 P:0.00467 F:0.00639
59GRAPH ROUGE-3 Eval D0727-C.M.100.G-H.59GRAPH R:0.01034 P:0.00467 F:0.00643
59GRAPH ROUGE-3 Eval D0736-A.M.100.H-G.59GRAPH R:0.04762 P:0.02104 F:0.02919
59GRAPH ROUGE-3 Eval D0736-A.M.100.H-H.59GRAPH R:0.05597 P:0.02427 F:0.03386
59GRAPH ROUGE-3 Eval D0736-A.M.100.H-I.59GRAPH R:0.05455 P:0.02427 F:0.03359
59GRAPH ROUGE-3 Eval D0736-A.M.100.H-J.59GRAPH R:0.02667 P:0.01294 F:0.01743
59GRAPH ROUGE-3 Eval D0736-B.M.100.H-G.59GRAPH R:0.05859 P:0.02890 F:0.03871
59GRAPH ROUGE-3 Eval D0736-B.M.100.H-H.59GRAPH R:0.12288 P:0.05588 F:0.07682
59GRAPH ROUGE-3 Eval D0736-B.M.100.H-I.59GRAPH R:0.10300 P:0.04624 F:0.06383
59GRAPH ROUGE-3 Eval D0736-B.M.100.H-J.59GRAPH R:0.12143 P:0.06551 F:0.08511
59GRAPH ROUGE-3 Eval D0736-C.M.100.H-G.59GRAPH R:0.01732 P:0.00654 F:0.00949
59GRAPH ROUGE-3 Eval D0736-C.M.100.H-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-3 Eval D0736-C.M.100.H-I.59GRAPH R:0.02210 P:0.00654 F:0.01009
59GRAPH ROUGE-3 Eval D0736-C.M.100.H-J.59GRAPH R:0.01544 P:0.00654 F:0.00919
59GRAPH ROUGE-3 Eval D0740-A.M.100.I-D.59GRAPH R:0.01010 P:0.00546 F:0.00709
59GRAPH ROUGE-3 Eval D0740-A.M.100.I-H.59GRAPH R:0.01000 P:0.00546 F:0.00706
59GRAPH ROUGE-3 Eval D0740-A.M.100.I-I.59GRAPH R:0.01325 P:0.00729 F:0.00941
59GRAPH ROUGE-3 Eval D0740-A.M.100.I-J.59GRAPH R:0.00658 P:0.00364 F:0.00469
59GRAPH ROUGE-3 Eval D0740-B.M.100.I-D.59GRAPH R:0.00662 P:0.00344 F:0.00453
59GRAPH ROUGE-3 Eval D0740-B.M.100.I-H.59GRAPH R:0.00676 P:0.00344 F:0.00456
59GRAPH ROUGE-3 Eval D0740-B.M.100.I-I.59GRAPH R:0.01003 P:0.00515 F:0.00681
59GRAPH ROUGE-3 Eval D0740-B.M.100.I-J.59GRAPH R:0.00660 P:0.00344 F:0.00452
59GRAPH ROUGE-3 Eval D0740-C.M.100.I-D.59GRAPH R:0.07492 P:0.04563 F:0.05672
59GRAPH ROUGE-3 Eval D0740-C.M.100.I-H.59GRAPH R:0.06557 P:0.03968 F:0.04944
59GRAPH ROUGE-3 Eval D0740-C.M.100.I-I.59GRAPH R:0.04560 P:0.02778 F:0.03453
59GRAPH ROUGE-3 Eval D0740-C.M.100.I-J.59GRAPH R:0.06818 P:0.04167 F:0.05173
59GRAPH ROUGE-3 Eval D0743-A.M.100.J-B.59GRAPH R:0.00971 P:0.00495 F:0.00656
59GRAPH ROUGE-3 Eval D0743-A.M.100.J-H.59GRAPH R:0.00629 P:0.00330 F:0.00433
59GRAPH ROUGE-3 Eval D0743-A.M.100.J-I.59GRAPH R:0.00955 P:0.00495 F:0.00652
59GRAPH ROUGE-3 Eval D0743-A.M.100.J-J.59GRAPH R:0.00313 P:0.00165 F:0.00216
59GRAPH ROUGE-3 Eval D0743-B.M.100.J-B.59GRAPH R:0.00327 P:0.00189 F:0.00240
59GRAPH ROUGE-3 Eval D0743-B.M.100.J-H.59GRAPH R:0.00643 P:0.00379 F:0.00477
59GRAPH ROUGE-3 Eval D0743-B.M.100.J-I.59GRAPH R:0.00645 P:0.00379 F:0.00477
59GRAPH ROUGE-3 Eval D0743-B.M.100.J-J.59GRAPH R:0.00317 P:0.00189 F:0.00237
59GRAPH ROUGE-3 Eval D0743-C.M.100.J-B.59GRAPH R:0.02265 P:0.01275 F:0.01632
59GRAPH ROUGE-3 Eval D0743-C.M.100.J-H.59GRAPH R:0.02273 P:0.01275 F:0.01634
59GRAPH ROUGE-3 Eval D0743-C.M.100.J-I.59GRAPH R:0.02932 P:0.01639 F:0.02103
59GRAPH ROUGE-3 Eval D0743-C.M.100.J-J.59GRAPH R:0.02244 P:0.01275 F:0.01626
---------------------------------------------
59GRAPH ROUGE-4 Average_R: 0.01119 (95%-conf.int. 0.00819 - 0.01464)
59GRAPH ROUGE-4 Average_P: 0.00569 (95%-conf.int. 0.00417 - 0.00750)
59GRAPH ROUGE-4 Average_F: 0.00750 (95%-conf.int. 0.00549 - 0.00985)
.............................................
59GRAPH ROUGE-4 Eval D0703-A.M.100.A-A.59GRAPH R:0.00697 P:0.00430 F:0.00532
59GRAPH ROUGE-4 Eval D0703-A.M.100.A-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0703-A.M.100.A-D.59GRAPH R:0.00709 P:0.00430 F:0.00535
59GRAPH ROUGE-4 Eval D0703-A.M.100.A-J.59GRAPH R:0.00702 P:0.00430 F:0.00533
59GRAPH ROUGE-4 Eval D0703-B.M.100.A-A.59GRAPH R:0.01684 P:0.00958 F:0.01221
59GRAPH ROUGE-4 Eval D0703-B.M.100.A-C.59GRAPH R:0.00692 P:0.00383 F:0.00493
59GRAPH ROUGE-4 Eval D0703-B.M.100.A-D.59GRAPH R:0.01384 P:0.00766 F:0.00986
59GRAPH ROUGE-4 Eval D0703-B.M.100.A-J.59GRAPH R:0.01370 P:0.00766 F:0.00983
59GRAPH ROUGE-4 Eval D0703-C.M.100.A-A.59GRAPH R:0.02405 P:0.01373 F:0.01748
59GRAPH ROUGE-4 Eval D0703-C.M.100.A-C.59GRAPH R:0.00334 P:0.00196 F:0.00247
59GRAPH ROUGE-4 Eval D0703-C.M.100.A-D.59GRAPH R:0.02730 P:0.01569 F:0.01993
59GRAPH ROUGE-4 Eval D0703-C.M.100.A-J.59GRAPH R:0.02730 P:0.01569 F:0.01993
59GRAPH ROUGE-4 Eval D0706-A.M.100.B-B.59GRAPH R:0.02676 P:0.01196 F:0.01653
59GRAPH ROUGE-4 Eval D0706-A.M.100.B-D.59GRAPH R:0.02694 P:0.01196 F:0.01657
59GRAPH ROUGE-4 Eval D0706-A.M.100.B-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0706-A.M.100.B-I.59GRAPH R:0.02676 P:0.01196 F:0.01653
59GRAPH ROUGE-4 Eval D0706-B.M.100.B-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0706-B.M.100.B-D.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0706-B.M.100.B-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0706-B.M.100.B-I.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0706-C.M.100.B-B.59GRAPH R:0.01329 P:0.00844 F:0.01032
59GRAPH ROUGE-4 Eval D0706-C.M.100.B-D.59GRAPH R:0.01329 P:0.00844 F:0.01032
59GRAPH ROUGE-4 Eval D0706-C.M.100.B-E.59GRAPH R:0.01980 P:0.01266 F:0.01544
59GRAPH ROUGE-4 Eval D0706-C.M.100.B-I.59GRAPH R:0.01316 P:0.00844 F:0.01028
59GRAPH ROUGE-4 Eval D0711-A.M.100.C-A.59GRAPH R:0.00339 P:0.00132 F:0.00190
59GRAPH ROUGE-4 Eval D0711-A.M.100.C-B.59GRAPH R:0.00344 P:0.00132 F:0.00191
59GRAPH ROUGE-4 Eval D0711-A.M.100.C-C.59GRAPH R:0.00344 P:0.00132 F:0.00191
59GRAPH ROUGE-4 Eval D0711-A.M.100.C-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-B.M.100.C-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-B.M.100.C-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-B.M.100.C-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-B.M.100.C-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-C.M.100.C-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-C.M.100.C-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-C.M.100.C-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0711-C.M.100.C-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0716-A.M.100.D-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0716-A.M.100.D-D.59GRAPH R:0.00344 P:0.00175 F:0.00232
59GRAPH ROUGE-4 Eval D0716-A.M.100.D-E.59GRAPH R:0.00342 P:0.00175 F:0.00232
59GRAPH ROUGE-4 Eval D0716-A.M.100.D-F.59GRAPH R:0.00340 P:0.00175 F:0.00231
59GRAPH ROUGE-4 Eval D0716-B.M.100.D-C.59GRAPH R:0.00339 P:0.00185 F:0.00239
59GRAPH ROUGE-4 Eval D0716-B.M.100.D-D.59GRAPH R:0.00346 P:0.00185 F:0.00241
59GRAPH ROUGE-4 Eval D0716-B.M.100.D-E.59GRAPH R:0.00342 P:0.00185 F:0.00240
59GRAPH ROUGE-4 Eval D0716-B.M.100.D-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0716-C.M.100.D-C.59GRAPH R:0.03691 P:0.02321 F:0.02850
59GRAPH ROUGE-4 Eval D0716-C.M.100.D-D.59GRAPH R:0.03448 P:0.02110 F:0.02618
59GRAPH ROUGE-4 Eval D0716-C.M.100.D-E.59GRAPH R:0.00340 P:0.00211 F:0.00260
59GRAPH ROUGE-4 Eval D0716-C.M.100.D-F.59GRAPH R:0.03780 P:0.02321 F:0.02876
59GRAPH ROUGE-4 Eval D0721-A.M.100.E-B.59GRAPH R:0.00687 P:0.00304 F:0.00421
59GRAPH ROUGE-4 Eval D0721-A.M.100.E-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0721-A.M.100.E-E.59GRAPH R:0.00669 P:0.00304 F:0.00418
59GRAPH ROUGE-4 Eval D0721-A.M.100.E-G.59GRAPH R:0.00656 P:0.00304 F:0.00415
59GRAPH ROUGE-4 Eval D0721-B.M.100.E-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0721-B.M.100.E-C.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0721-B.M.100.E-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0721-B.M.100.E-G.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0721-C.M.100.E-B.59GRAPH R:0.00338 P:0.00155 F:0.00213
59GRAPH ROUGE-4 Eval D0721-C.M.100.E-C.59GRAPH R:0.01361 P:0.00620 F:0.00852
59GRAPH ROUGE-4 Eval D0721-C.M.100.E-E.59GRAPH R:0.01375 P:0.00620 F:0.00855
59GRAPH ROUGE-4 Eval D0721-C.M.100.E-G.59GRAPH R:0.01007 P:0.00465 F:0.00636
59GRAPH ROUGE-4 Eval D0726-A.M.100.F-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0726-A.M.100.F-E.59GRAPH R:0.00344 P:0.00141 F:0.00200
59GRAPH ROUGE-4 Eval D0726-A.M.100.F-F.59GRAPH R:0.00342 P:0.00141 F:0.00200
59GRAPH ROUGE-4 Eval D0726-A.M.100.F-G.59GRAPH R:0.00342 P:0.00141 F:0.00200
59GRAPH ROUGE-4 Eval D0726-B.M.100.F-A.59GRAPH R:0.00673 P:0.00206 F:0.00315
59GRAPH ROUGE-4 Eval D0726-B.M.100.F-E.59GRAPH R:0.00685 P:0.00206 F:0.00317
59GRAPH ROUGE-4 Eval D0726-B.M.100.F-F.59GRAPH R:0.00342 P:0.00103 F:0.00158
59GRAPH ROUGE-4 Eval D0726-B.M.100.F-G.59GRAPH R:0.00339 P:0.00103 F:0.00158
59GRAPH ROUGE-4 Eval D0726-C.M.100.F-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0726-C.M.100.F-E.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0726-C.M.100.F-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0726-C.M.100.F-G.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0727-A.M.100.G-A.59GRAPH R:0.00685 P:0.00271 F:0.00388
59GRAPH ROUGE-4 Eval D0727-A.M.100.G-F.59GRAPH R:0.01017 P:0.00407 F:0.00581
59GRAPH ROUGE-4 Eval D0727-A.M.100.G-G.59GRAPH R:0.00337 P:0.00136 F:0.00194
59GRAPH ROUGE-4 Eval D0727-A.M.100.G-H.59GRAPH R:0.01017 P:0.00407 F:0.00581
59GRAPH ROUGE-4 Eval D0727-B.M.100.G-A.59GRAPH R:0.01064 P:0.00461 F:0.00643
59GRAPH ROUGE-4 Eval D0727-B.M.100.G-F.59GRAPH R:0.03344 P:0.01536 F:0.02105
59GRAPH ROUGE-4 Eval D0727-B.M.100.G-G.59GRAPH R:0.02500 P:0.01075 F:0.01503
59GRAPH ROUGE-4 Eval D0727-B.M.100.G-H.59GRAPH R:0.03546 P:0.01536 F:0.02144
59GRAPH ROUGE-4 Eval D0727-C.M.100.G-A.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0727-C.M.100.G-F.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0727-C.M.100.G-G.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0727-C.M.100.G-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0736-A.M.100.H-G.59GRAPH R:0.02963 P:0.01301 F:0.01808
59GRAPH ROUGE-4 Eval D0736-A.M.100.H-H.59GRAPH R:0.04151 P:0.01789 F:0.02500
59GRAPH ROUGE-4 Eval D0736-A.M.100.H-I.59GRAPH R:0.03676 P:0.01626 F:0.02255
59GRAPH ROUGE-4 Eval D0736-A.M.100.H-J.59GRAPH R:0.01347 P:0.00650 F:0.00877
59GRAPH ROUGE-4 Eval D0736-B.M.100.H-G.59GRAPH R:0.03953 P:0.01938 F:0.02601
59GRAPH ROUGE-4 Eval D0736-B.M.100.H-H.59GRAPH R:0.09871 P:0.04457 F:0.06141
59GRAPH ROUGE-4 Eval D0736-B.M.100.H-I.59GRAPH R:0.08261 P:0.03682 F:0.05094
59GRAPH ROUGE-4 Eval D0736-B.M.100.H-J.59GRAPH R:0.09386 P:0.05039 F:0.06558
59GRAPH ROUGE-4 Eval D0736-C.M.100.H-G.59GRAPH R:0.01316 P:0.00493 F:0.00717
59GRAPH ROUGE-4 Eval D0736-C.M.100.H-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0736-C.M.100.H-I.59GRAPH R:0.01685 P:0.00493 F:0.00763
59GRAPH ROUGE-4 Eval D0736-C.M.100.H-J.59GRAPH R:0.01172 P:0.00493 F:0.00694
59GRAPH ROUGE-4 Eval D0740-A.M.100.I-D.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-A.M.100.I-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-A.M.100.I-I.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-A.M.100.I-J.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-B.M.100.I-D.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-B.M.100.I-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-B.M.100.I-I.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-B.M.100.I-J.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0740-C.M.100.I-D.59GRAPH R:0.04934 P:0.02994 F:0.03727
59GRAPH ROUGE-4 Eval D0740-C.M.100.I-H.59GRAPH R:0.04305 P:0.02595 F:0.03238
59GRAPH ROUGE-4 Eval D0740-C.M.100.I-I.59GRAPH R:0.02303 P:0.01397 F:0.01739
59GRAPH ROUGE-4 Eval D0740-C.M.100.I-J.59GRAPH R:0.04262 P:0.02595 F:0.03226
59GRAPH ROUGE-4 Eval D0743-A.M.100.J-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-A.M.100.J-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-A.M.100.J-I.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-A.M.100.J-J.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-B.M.100.J-B.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-B.M.100.J-H.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-B.M.100.J-I.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-B.M.100.J-J.59GRAPH R:0.00000 P:0.00000 F:0.00000
59GRAPH ROUGE-4 Eval D0743-C.M.100.J-B.59GRAPH R:0.00980 P:0.00549 F:0.00704
59GRAPH ROUGE-4 Eval D0743-C.M.100.J-H.59GRAPH R:0.00656 P:0.00366 F:0.00470
59GRAPH ROUGE-4 Eval D0743-C.M.100.J-I.59GRAPH R:0.01316 P:0.00733 F:0.00942
59GRAPH ROUGE-4 Eval D0743-C.M.100.J-J.59GRAPH R:0.00971 P:0.00549 F:0.00701
---------------------------------------------
59GRAPH ROUGE-L Average_R: 0.29681 (95%-conf.int. 0.28854 - 0.30523)
59GRAPH ROUGE-L Average_P: 0.14905 (95%-conf.int. 0.14238 - 0.15686)
59GRAPH ROUGE-L Average_F: 0.19718 (95%-conf.int. 0.18977 - 0.20556)
.............................................
59GRAPH ROUGE-L Eval D0703-A.M.100.A-A.59GRAPH R:0.30743 P:0.19198 F:0.23636
59GRAPH ROUGE-L Eval D0703-A.M.100.A-C.59GRAPH R:0.25168 P:0.15823 F:0.19430
59GRAPH ROUGE-L Eval D0703-A.M.100.A-D.59GRAPH R:0.28522 P:0.17511 F:0.21700
59GRAPH ROUGE-L Eval D0703-A.M.100.A-J.59GRAPH R:0.30612 P:0.18987 F:0.23437
59GRAPH ROUGE-L Eval D0703-B.M.100.A-A.59GRAPH R:0.33660 P:0.19397 F:0.24611
59GRAPH ROUGE-L Eval D0703-B.M.100.A-C.59GRAPH R:0.31879 P:0.17891 F:0.22919
59GRAPH ROUGE-L Eval D0703-B.M.100.A-D.59GRAPH R:0.29530 P:0.16573 F:0.21231
59GRAPH ROUGE-L Eval D0703-B.M.100.A-J.59GRAPH R:0.31561 P:0.17891 F:0.22837
59GRAPH ROUGE-L Eval D0703-C.M.100.A-A.59GRAPH R:0.35667 P:0.20617 F:0.26130
59GRAPH ROUGE-L Eval D0703-C.M.100.A-C.59GRAPH R:0.31818 P:0.18882 F:0.23700
59GRAPH ROUGE-L Eval D0703-C.M.100.A-D.59GRAPH R:0.34768 P:0.20231 F:0.25578
59GRAPH ROUGE-L Eval D0703-C.M.100.A-J.59GRAPH R:0.36424 P:0.21195 F:0.26797
59GRAPH ROUGE-L Eval D0706-A.M.100.B-B.59GRAPH R:0.28571 P:0.12979 F:0.17849
59GRAPH ROUGE-L Eval D0706-A.M.100.B-D.59GRAPH R:0.27451 P:0.12389 F:0.17073
59GRAPH ROUGE-L Eval D0706-A.M.100.B-E.59GRAPH R:0.23701 P:0.10767 F:0.14807
59GRAPH ROUGE-L Eval D0706-A.M.100.B-I.59GRAPH R:0.27597 P:0.12537 F:0.17241
59GRAPH ROUGE-L Eval D0706-B.M.100.B-B.59GRAPH R:0.26144 P:0.12403 F:0.16824
59GRAPH ROUGE-L Eval D0706-B.M.100.B-D.59GRAPH R:0.24430 P:0.11628 F:0.15756
59GRAPH ROUGE-L Eval D0706-B.M.100.B-E.59GRAPH R:0.24026 P:0.11473 F:0.15530
59GRAPH ROUGE-L Eval D0706-B.M.100.B-I.59GRAPH R:0.27832 P:0.13333 F:0.18029
59GRAPH ROUGE-L Eval D0706-C.M.100.B-B.59GRAPH R:0.34516 P:0.22153 F:0.26986
59GRAPH ROUGE-L Eval D0706-C.M.100.B-D.59GRAPH R:0.34516 P:0.22153 F:0.26986
59GRAPH ROUGE-L Eval D0706-C.M.100.B-E.59GRAPH R:0.33333 P:0.21532 F:0.26163
59GRAPH ROUGE-L Eval D0706-C.M.100.B-I.59GRAPH R:0.34505 P:0.22360 F:0.27136
59GRAPH ROUGE-L Eval D0711-A.M.100.C-A.59GRAPH R:0.24671 P:0.09766 F:0.13993
59GRAPH ROUGE-L Eval D0711-A.M.100.C-B.59GRAPH R:0.27000 P:0.10547 F:0.15169
59GRAPH ROUGE-L Eval D0711-A.M.100.C-C.59GRAPH R:0.25333 P:0.09896 F:0.14232
59GRAPH ROUGE-L Eval D0711-A.M.100.C-F.59GRAPH R:0.26490 P:0.10417 F:0.14954
59GRAPH ROUGE-L Eval D0711-B.M.100.C-A.59GRAPH R:0.26190 P:0.10308 F:0.14793
59GRAPH ROUGE-L Eval D0711-B.M.100.C-B.59GRAPH R:0.26370 P:0.10308 F:0.14822
59GRAPH ROUGE-L Eval D0711-B.M.100.C-C.59GRAPH R:0.24161 P:0.09639 F:0.13780
59GRAPH ROUGE-L Eval D0711-B.M.100.C-F.59GRAPH R:0.25085 P:0.09906 F:0.14203
59GRAPH ROUGE-L Eval D0711-C.M.100.C-A.59GRAPH R:0.31683 P:0.15764 F:0.21053
59GRAPH ROUGE-L Eval D0711-C.M.100.C-B.59GRAPH R:0.33788 P:0.16256 F:0.21951
59GRAPH ROUGE-L Eval D0711-C.M.100.C-C.59GRAPH R:0.33784 P:0.16420 F:0.22099
59GRAPH ROUGE-L Eval D0711-C.M.100.C-F.59GRAPH R:0.33108 P:0.16092 F:0.21657
59GRAPH ROUGE-L Eval D0716-A.M.100.D-C.59GRAPH R:0.26557 P:0.13918 F:0.18264
59GRAPH ROUGE-L Eval D0716-A.M.100.D-D.59GRAPH R:0.25333 P:0.13058 F:0.17233
59GRAPH ROUGE-L Eval D0716-A.M.100.D-E.59GRAPH R:0.27243 P:0.14089 F:0.18573
59GRAPH ROUGE-L Eval D0716-A.M.100.D-F.59GRAPH R:0.25083 P:0.13058 F:0.17175
59GRAPH ROUGE-L Eval D0716-B.M.100.D-C.59GRAPH R:0.34868 P:0.19308 F:0.24853
59GRAPH ROUGE-L Eval D0716-B.M.100.D-D.59GRAPH R:0.34228 P:0.18579 F:0.24085
59GRAPH ROUGE-L Eval D0716-B.M.100.D-E.59GRAPH R:0.33223 P:0.18215 F:0.23530
59GRAPH ROUGE-L Eval D0716-B.M.100.D-F.59GRAPH R:0.34333 P:0.18761 F:0.24263
59GRAPH ROUGE-L Eval D0716-C.M.100.D-C.59GRAPH R:0.39088 P:0.24845 F:0.30380
59GRAPH ROUGE-L Eval D0716-C.M.100.D-D.59GRAPH R:0.38127 P:0.23602 F:0.29156
59GRAPH ROUGE-L Eval D0716-C.M.100.D-E.59GRAPH R:0.36964 P:0.23188 F:0.28499
59GRAPH ROUGE-L Eval D0716-C.M.100.D-F.59GRAPH R:0.37667 P:0.23395 F:0.28863
59GRAPH ROUGE-L Eval D0721-A.M.100.E-B.59GRAPH R:0.25333 P:0.11411 F:0.15735
59GRAPH ROUGE-L Eval D0721-A.M.100.E-C.59GRAPH R:0.22727 P:0.10511 F:0.14374
59GRAPH ROUGE-L Eval D0721-A.M.100.E-E.59GRAPH R:0.24026 P:0.11111 F:0.15195
59GRAPH ROUGE-L Eval D0721-A.M.100.E-G.59GRAPH R:0.24522 P:0.11562 F:0.15715
59GRAPH ROUGE-L Eval D0721-B.M.100.E-B.59GRAPH R:0.18893 P:0.08192 F:0.11429
59GRAPH ROUGE-L Eval D0721-B.M.100.E-C.59GRAPH R:0.18790 P:0.08333 F:0.11546
59GRAPH ROUGE-L Eval D0721-B.M.100.E-E.59GRAPH R:0.15410 P:0.06638 F:0.09279
59GRAPH ROUGE-L Eval D0721-B.M.100.E-G.59GRAPH R:0.17742 P:0.07768 F:0.10805
59GRAPH ROUGE-L Eval D0721-C.M.100.E-B.59GRAPH R:0.33115 P:0.15443 F:0.21063
59GRAPH ROUGE-L Eval D0721-C.M.100.E-C.59GRAPH R:0.29373 P:0.13609 F:0.18600
59GRAPH ROUGE-L Eval D0721-C.M.100.E-E.59GRAPH R:0.30000 P:0.13761 F:0.18867
59GRAPH ROUGE-L Eval D0721-C.M.100.E-G.59GRAPH R:0.29967 P:0.14067 F:0.19146
59GRAPH ROUGE-L Eval D0726-A.M.100.F-A.59GRAPH R:0.28571 P:0.11944 F:0.16846
59GRAPH ROUGE-L Eval D0726-A.M.100.F-E.59GRAPH R:0.28667 P:0.11944 F:0.16862
59GRAPH ROUGE-L Eval D0726-A.M.100.F-F.59GRAPH R:0.29568 P:0.12361 F:0.17434
59GRAPH ROUGE-L Eval D0726-A.M.100.F-G.59GRAPH R:0.27907 P:0.11667 F:0.16455
59GRAPH ROUGE-L Eval D0726-B.M.100.F-A.59GRAPH R:0.23203 P:0.07238 F:0.11034
59GRAPH ROUGE-L Eval D0726-B.M.100.F-E.59GRAPH R:0.24917 P:0.07645 F:0.11700
59GRAPH ROUGE-L Eval D0726-B.M.100.F-F.59GRAPH R:0.23920 P:0.07339 F:0.11232
59GRAPH ROUGE-L Eval D0726-B.M.100.F-G.59GRAPH R:0.25000 P:0.07747 F:0.11829
59GRAPH ROUGE-L Eval D0726-C.M.100.F-A.59GRAPH R:0.31667 P:0.15298 F:0.20630
59GRAPH ROUGE-L Eval D0726-C.M.100.F-E.59GRAPH R:0.30303 P:0.14493 F:0.19608
59GRAPH ROUGE-L Eval D0726-C.M.100.F-F.59GRAPH R:0.31864 P:0.15137 F:0.20524
59GRAPH ROUGE-L Eval D0726-C.M.100.F-G.59GRAPH R:0.30492 P:0.14976 F:0.20087
59GRAPH ROUGE-L Eval D0727-A.M.100.G-A.59GRAPH R:0.35548 P:0.14324 F:0.20420
59GRAPH ROUGE-L Eval D0727-A.M.100.G-F.59GRAPH R:0.34539 P:0.14056 F:0.19981
59GRAPH ROUGE-L Eval D0727-A.M.100.G-G.59GRAPH R:0.31699 P:0.12985 F:0.18423
59GRAPH ROUGE-L Eval D0727-A.M.100.G-H.59GRAPH R:0.34539 P:0.14056 F:0.19981
59GRAPH ROUGE-L Eval D0727-B.M.100.G-A.59GRAPH R:0.34364 P:0.15152 F:0.21031
59GRAPH ROUGE-L Eval D0727-B.M.100.G-F.59GRAPH R:0.34740 P:0.16212 F:0.22107
59GRAPH ROUGE-L Eval D0727-B.M.100.G-G.59GRAPH R:0.33564 P:0.14697 F:0.20443
59GRAPH ROUGE-L Eval D0727-B.M.100.G-H.59GRAPH R:0.33677 P:0.14848 F:0.20609
59GRAPH ROUGE-L Eval D0727-C.M.100.G-A.59GRAPH R:0.30945 P:0.14660 F:0.19895
59GRAPH ROUGE-L Eval D0727-C.M.100.G-F.59GRAPH R:0.34007 P:0.15586 F:0.21375
59GRAPH ROUGE-L Eval D0727-C.M.100.G-G.59GRAPH R:0.32673 P:0.15278 F:0.20820
59GRAPH ROUGE-L Eval D0727-C.M.100.G-H.59GRAPH R:0.33108 P:0.15123 F:0.20762
59GRAPH ROUGE-L Eval D0736-A.M.100.H-G.59GRAPH R:0.29749 P:0.13301 F:0.18383
59GRAPH ROUGE-L Eval D0736-A.M.100.H-H.59GRAPH R:0.31387 P:0.13782 F:0.19154
59GRAPH ROUGE-L Eval D0736-A.M.100.H-I.59GRAPH R:0.30249 P:0.13622 F:0.18785
59GRAPH ROUGE-L Eval D0736-A.M.100.H-J.59GRAPH R:0.29739 P:0.14583 F:0.19570
59GRAPH ROUGE-L Eval D0736-B.M.100.H-G.59GRAPH R:0.34733 P:0.17333 F:0.23126
59GRAPH ROUGE-L Eval D0736-B.M.100.H-H.59GRAPH R:0.38843 P:0.17905 F:0.24511
59GRAPH ROUGE-L Eval D0736-B.M.100.H-I.59GRAPH R:0.39331 P:0.17905 F:0.24608
59GRAPH ROUGE-L Eval D0736-B.M.100.H-J.59GRAPH R:0.39860 P:0.21714 F:0.28113
59GRAPH ROUGE-L Eval D0736-C.M.100.H-G.59GRAPH R:0.29536 P:0.11327 F:0.16374
59GRAPH ROUGE-L Eval D0736-C.M.100.H-H.59GRAPH R:0.26738 P:0.08091 F:0.12423
59GRAPH ROUGE-L Eval D0736-C.M.100.H-I.59GRAPH R:0.31016 P:0.09385 F:0.14410
59GRAPH ROUGE-L Eval D0736-C.M.100.H-J.59GRAPH R:0.29057 P:0.12460 F:0.17441
59GRAPH ROUGE-L Eval D0740-A.M.100.I-D.59GRAPH R:0.26733 P:0.14595 F:0.18882
59GRAPH ROUGE-L Eval D0740-A.M.100.I-H.59GRAPH R:0.27124 P:0.14955 F:0.19280
59GRAPH ROUGE-L Eval D0740-A.M.100.I-I.59GRAPH R:0.27273 P:0.15135 F:0.19467
59GRAPH ROUGE-L Eval D0740-A.M.100.I-J.59GRAPH R:0.25484 P:0.14234 F:0.18266
59GRAPH ROUGE-L Eval D0740-B.M.100.I-D.59GRAPH R:0.24675 P:0.12925 F:0.16964
59GRAPH ROUGE-L Eval D0740-B.M.100.I-H.59GRAPH R:0.22185 P:0.11395 F:0.15056
59GRAPH ROUGE-L Eval D0740-B.M.100.I-I.59GRAPH R:0.24590 P:0.12755 F:0.16797
59GRAPH ROUGE-L Eval D0740-B.M.100.I-J.59GRAPH R:0.23625 P:0.12415 F:0.16277
59GRAPH ROUGE-L Eval D0740-C.M.100.I-D.59GRAPH R:0.35463 P:0.21765 F:0.26975
59GRAPH ROUGE-L Eval D0740-C.M.100.I-H.59GRAPH R:0.37621 P:0.22941 F:0.28502
59GRAPH ROUGE-L Eval D0740-C.M.100.I-I.59GRAPH R:0.35463 P:0.21765 F:0.26975
59GRAPH ROUGE-L Eval D0740-C.M.100.I-J.59GRAPH R:0.34395 P:0.21176 F:0.26213
59GRAPH ROUGE-L Eval D0743-A.M.100.J-B.59GRAPH R:0.28571 P:0.14706 F:0.19417
59GRAPH ROUGE-L Eval D0743-A.M.100.J-H.59GRAPH R:0.25000 P:0.13235 F:0.17307
59GRAPH ROUGE-L Eval D0743-A.M.100.J-I.59GRAPH R:0.28125 P:0.14706 F:0.19313
59GRAPH ROUGE-L Eval D0743-A.M.100.J-J.59GRAPH R:0.23077 P:0.12255 F:0.16009
59GRAPH ROUGE-L Eval D0743-B.M.100.J-B.59GRAPH R:0.25641 P:0.14981 F:0.18912
59GRAPH ROUGE-L Eval D0743-B.M.100.J-H.59GRAPH R:0.26183 P:0.15543 F:0.19506
59GRAPH ROUGE-L Eval D0743-B.M.100.J-I.59GRAPH R:0.27848 P:0.16479 F:0.20706
59GRAPH ROUGE-L Eval D0743-B.M.100.J-J.59GRAPH R:0.25545 P:0.15356 F:0.19181
59GRAPH ROUGE-L Eval D0743-C.M.100.J-B.59GRAPH R:0.31429 P:0.17838 F:0.22759
59GRAPH ROUGE-L Eval D0743-C.M.100.J-H.59GRAPH R:0.29936 P:0.16937 F:0.21634
59GRAPH ROUGE-L Eval D0743-C.M.100.J-I.59GRAPH R:0.34505 P:0.19459 F:0.24884
59GRAPH ROUGE-L Eval D0743-C.M.100.J-J.59GRAPH R:0.30818 P:0.17658 F:0.22452
---------------------------------------------
59GRAPH ROUGE-W-1.2 Average_R: 0.10448 (95%-conf.int. 0.10136 - 0.10744)
59GRAPH ROUGE-W-1.2 Average_P: 0.09503 (95%-conf.int. 0.09084 - 0.10003)
59GRAPH ROUGE-W-1.2 Average_F: 0.09877 (95%-conf.int. 0.09524 - 0.10274)
.............................................
59GRAPH ROUGE-W-1.2 Eval D0703-A.M.100.A-A.59GRAPH R:0.10908 P:0.12266 F:0.11547
59GRAPH ROUGE-W-1.2 Eval D0703-A.M.100.A-C.59GRAPH R:0.08642 P:0.09876 F:0.09218
59GRAPH ROUGE-W-1.2 Eval D0703-A.M.100.A-D.59GRAPH R:0.10138 P:0.11475 F:0.10765
59GRAPH ROUGE-W-1.2 Eval D0703-A.M.100.A-J.59GRAPH R:0.11240 P:0.11926 F:0.11573
59GRAPH ROUGE-W-1.2 Eval D0703-B.M.100.A-A.59GRAPH R:0.11548 P:0.12340 F:0.11931
59GRAPH ROUGE-W-1.2 Eval D0703-B.M.100.A-C.59GRAPH R:0.10690 P:0.11352 F:0.11011
59GRAPH ROUGE-W-1.2 Eval D0703-B.M.100.A-D.59GRAPH R:0.10240 P:0.10779 F:0.10503
59GRAPH ROUGE-W-1.2 Eval D0703-B.M.100.A-J.59GRAPH R:0.11007 P:0.11573 F:0.11283
59GRAPH ROUGE-W-1.2 Eval D0703-C.M.100.A-A.59GRAPH R:0.11967 P:0.12862 F:0.12398
59GRAPH ROUGE-W-1.2 Eval D0703-C.M.100.A-C.59GRAPH R:0.10410 P:0.11664 F:0.11001
59GRAPH ROUGE-W-1.2 Eval D0703-C.M.100.A-D.59GRAPH R:0.11386 P:0.12575 F:0.11951
59GRAPH ROUGE-W-1.2 Eval D0703-C.M.100.A-J.59GRAPH R:0.12545 P:0.13148 F:0.12839
59GRAPH ROUGE-W-1.2 Eval D0706-A.M.100.B-B.59GRAPH R:0.10617 P:0.08656 F:0.09537
59GRAPH ROUGE-W-1.2 Eval D0706-A.M.100.B-D.59GRAPH R:0.09965 P:0.08253 F:0.09029
59GRAPH ROUGE-W-1.2 Eval D0706-A.M.100.B-E.59GRAPH R:0.08398 P:0.06918 F:0.07586
59GRAPH ROUGE-W-1.2 Eval D0706-A.M.100.B-I.59GRAPH R:0.09919 P:0.08350 F:0.09067
59GRAPH ROUGE-W-1.2 Eval D0706-B.M.100.B-B.59GRAPH R:0.09362 P:0.07692 F:0.08445
59GRAPH ROUGE-W-1.2 Eval D0706-B.M.100.B-D.59GRAPH R:0.08475 P:0.07113 F:0.07734
59GRAPH ROUGE-W-1.2 Eval D0706-B.M.100.B-E.59GRAPH R:0.08557 P:0.07212 F:0.07827
59GRAPH ROUGE-W-1.2 Eval D0706-B.M.100.B-I.59GRAPH R:0.09412 P:0.08154 F:0.08738
59GRAPH ROUGE-W-1.2 Eval D0706-C.M.100.B-B.59GRAPH R:0.12402 P:0.13586 F:0.12967
59GRAPH ROUGE-W-1.2 Eval D0706-C.M.100.B-D.59GRAPH R:0.12685 P:0.14015 F:0.13317
59GRAPH ROUGE-W-1.2 Eval D0706-C.M.100.B-E.59GRAPH R:0.12260 P:0.13415 F:0.12812
59GRAPH ROUGE-W-1.2 Eval D0706-C.M.100.B-I.59GRAPH R:0.12561 P:0.14137 F:0.13302
59GRAPH ROUGE-W-1.2 Eval D0711-A.M.100.C-A.59GRAPH R:0.08435 P:0.06020 F:0.07026
59GRAPH ROUGE-W-1.2 Eval D0711-A.M.100.C-B.59GRAPH R:0.09092 P:0.06433 F:0.07535
59GRAPH ROUGE-W-1.2 Eval D0711-A.M.100.C-C.59GRAPH R:0.08671 P:0.06082 F:0.07149
59GRAPH ROUGE-W-1.2 Eval D0711-A.M.100.C-F.59GRAPH R:0.08793 P:0.06273 F:0.07322
59GRAPH ROUGE-W-1.2 Eval D0711-B.M.100.C-A.59GRAPH R:0.09394 P:0.06596 F:0.07750
59GRAPH ROUGE-W-1.2 Eval D0711-B.M.100.C-B.59GRAPH R:0.09030 P:0.06615 F:0.07636
59GRAPH ROUGE-W-1.2 Eval D0711-B.M.100.C-C.59GRAPH R:0.08135 P:0.06097 F:0.06970
59GRAPH ROUGE-W-1.2 Eval D0711-B.M.100.C-F.59GRAPH R:0.08646 P:0.06342 F:0.07317
59GRAPH ROUGE-W-1.2 Eval D0711-C.M.100.C-A.59GRAPH R:0.10296 P:0.09577 F:0.09923
59GRAPH ROUGE-W-1.2 Eval D0711-C.M.100.C-B.59GRAPH R:0.10807 P:0.09723 F:0.10236
59GRAPH ROUGE-W-1.2 Eval D0711-C.M.100.C-C.59GRAPH R:0.10762 P:0.09931 F:0.10330
59GRAPH ROUGE-W-1.2 Eval D0711-C.M.100.C-F.59GRAPH R:0.10451 P:0.09790 F:0.10110
59GRAPH ROUGE-W-1.2 Eval D0716-A.M.100.D-C.59GRAPH R:0.09487 P:0.09082 F:0.09280
59GRAPH ROUGE-W-1.2 Eval D0716-A.M.100.D-D.59GRAPH R:0.08660 P:0.08504 F:0.08581
59GRAPH ROUGE-W-1.2 Eval D0716-A.M.100.D-E.59GRAPH R:0.09609 P:0.09281 F:0.09442
59GRAPH ROUGE-W-1.2 Eval D0716-A.M.100.D-F.59GRAPH R:0.08741 P:0.08654 F:0.08697
59GRAPH ROUGE-W-1.2 Eval D0716-B.M.100.D-C.59GRAPH R:0.12373 P:0.11952 F:0.12159
59GRAPH ROUGE-W-1.2 Eval D0716-B.M.100.D-D.59GRAPH R:0.11997 P:0.11654 F:0.11823
59GRAPH ROUGE-W-1.2 Eval D0716-B.M.100.D-E.59GRAPH R:0.11661 P:0.11381 F:0.11519
59GRAPH ROUGE-W-1.2 Eval D0716-B.M.100.D-F.59GRAPH R:0.12075 P:0.11679 F:0.11874
59GRAPH ROUGE-W-1.2 Eval D0716-C.M.100.D-C.59GRAPH R:0.13696 P:0.16226 F:0.14854
59GRAPH ROUGE-W-1.2 Eval D0716-C.M.100.D-D.59GRAPH R:0.13072 P:0.15692 F:0.14263
59GRAPH ROUGE-W-1.2 Eval D0716-C.M.100.D-E.59GRAPH R:0.12129 P:0.14745 F:0.13310
59GRAPH ROUGE-W-1.2 Eval D0716-C.M.100.D-F.59GRAPH R:0.12650 P:0.15284 F:0.13843
59GRAPH ROUGE-W-1.2 Eval D0721-A.M.100.E-B.59GRAPH R:0.09445 P:0.07478 F:0.08347
59GRAPH ROUGE-W-1.2 Eval D0721-A.M.100.E-C.59GRAPH R:0.07961 P:0.06532 F:0.07176
59GRAPH ROUGE-W-1.2 Eval D0721-A.M.100.E-E.59GRAPH R:0.08758 P:0.07276 F:0.07949
59GRAPH ROUGE-W-1.2 Eval D0721-A.M.100.E-G.59GRAPH R:0.08966 P:0.07408 F:0.08113
59GRAPH ROUGE-W-1.2 Eval D0721-B.M.100.E-B.59GRAPH R:0.06118 P:0.05128 F:0.05579
59GRAPH ROUGE-W-1.2 Eval D0721-B.M.100.E-C.59GRAPH R:0.06250 P:0.05210 F:0.05683
59GRAPH ROUGE-W-1.2 Eval D0721-B.M.100.E-E.59GRAPH R:0.05132 P:0.04340 F:0.04703
59GRAPH ROUGE-W-1.2 Eval D0721-B.M.100.E-G.59GRAPH R:0.05634 P:0.04923 F:0.05255
59GRAPH ROUGE-W-1.2 Eval D0721-C.M.100.E-B.59GRAPH R:0.11149 P:0.09570 F:0.10299
59GRAPH ROUGE-W-1.2 Eval D0721-C.M.100.E-C.59GRAPH R:0.09894 P:0.08624 F:0.09215
59GRAPH ROUGE-W-1.2 Eval D0721-C.M.100.E-E.59GRAPH R:0.10191 P:0.08725 F:0.09401
59GRAPH ROUGE-W-1.2 Eval D0721-C.M.100.E-G.59GRAPH R:0.09980 P:0.08761 F:0.09331
59GRAPH ROUGE-W-1.2 Eval D0726-A.M.100.F-A.59GRAPH R:0.09871 P:0.07313 F:0.08402
59GRAPH ROUGE-W-1.2 Eval D0726-A.M.100.F-E.59GRAPH R:0.09887 P:0.07217 F:0.08344
59GRAPH ROUGE-W-1.2 Eval D0726-A.M.100.F-F.59GRAPH R:0.09956 P:0.07413 F:0.08498
59GRAPH ROUGE-W-1.2 Eval D0726-A.M.100.F-G.59GRAPH R:0.09225 P:0.06981 F:0.07948
59GRAPH ROUGE-W-1.2 Eval D0726-B.M.100.F-A.59GRAPH R:0.08514 P:0.04671 F:0.06032
59GRAPH ROUGE-W-1.2 Eval D0726-B.M.100.F-E.59GRAPH R:0.08837 P:0.04895 F:0.06300
59GRAPH ROUGE-W-1.2 Eval D0726-B.M.100.F-F.59GRAPH R:0.08278 P:0.04615 F:0.05926
59GRAPH ROUGE-W-1.2 Eval D0726-B.M.100.F-G.59GRAPH R:0.08727 P:0.04883 F:0.06262
59GRAPH ROUGE-W-1.2 Eval D0726-C.M.100.F-A.59GRAPH R:0.11042 P:0.09367 F:0.10136
59GRAPH ROUGE-W-1.2 Eval D0726-C.M.100.F-E.59GRAPH R:0.10788 P:0.09106 F:0.09876
59GRAPH ROUGE-W-1.2 Eval D0726-C.M.100.F-F.59GRAPH R:0.11375 P:0.09677 F:0.10458
59GRAPH ROUGE-W-1.2 Eval D0726-C.M.100.F-G.59GRAPH R:0.10603 P:0.09325 F:0.09923
59GRAPH ROUGE-W-1.2 Eval D0727-A.M.100.G-A.59GRAPH R:0.12634 P:0.08961 F:0.10485
59GRAPH ROUGE-W-1.2 Eval D0727-A.M.100.G-F.59GRAPH R:0.12136 P:0.09015 F:0.10345
59GRAPH ROUGE-W-1.2 Eval D0727-A.M.100.G-G.59GRAPH R:0.10988 P:0.07972 F:0.09240
59GRAPH ROUGE-W-1.2 Eval D0727-A.M.100.G-H.59GRAPH R:0.12178 P:0.08884 F:0.10273
59GRAPH ROUGE-W-1.2 Eval D0727-B.M.100.G-A.59GRAPH R:0.12378 P:0.09576 F:0.10798
59GRAPH ROUGE-W-1.2 Eval D0727-B.M.100.G-F.59GRAPH R:0.12544 P:0.10515 F:0.11440
59GRAPH ROUGE-W-1.2 Eval D0727-B.M.100.G-G.59GRAPH R:0.12188 P:0.09559 F:0.10715
59GRAPH ROUGE-W-1.2 Eval D0727-B.M.100.G-H.59GRAPH R:0.12724 P:0.09930 F:0.11155
59GRAPH ROUGE-W-1.2 Eval D0727-C.M.100.G-A.59GRAPH R:0.10615 P:0.09044 F:0.09767
59GRAPH ROUGE-W-1.2 Eval D0727-C.M.100.G-F.59GRAPH R:0.11548 P:0.09782 F:0.10592
59GRAPH ROUGE-W-1.2 Eval D0727-C.M.100.G-G.59GRAPH R:0.11138 P:0.09587 F:0.10304
59GRAPH ROUGE-W-1.2 Eval D0727-C.M.100.G-H.59GRAPH R:0.11436 P:0.09402 F:0.10320
59GRAPH ROUGE-W-1.2 Eval D0736-A.M.100.H-G.59GRAPH R:0.11313 P:0.08958 F:0.09999
59GRAPH ROUGE-W-1.2 Eval D0736-A.M.100.H-H.59GRAPH R:0.11886 P:0.09178 F:0.10358
59GRAPH ROUGE-W-1.2 Eval D0736-A.M.100.H-I.59GRAPH R:0.11385 P:0.09161 F:0.10153
59GRAPH ROUGE-W-1.2 Eval D0736-A.M.100.H-J.59GRAPH R:0.10722 P:0.09374 F:0.10003
59GRAPH ROUGE-W-1.2 Eval D0736-B.M.100.H-G.59GRAPH R:0.12770 P:0.11796 F:0.12264
59GRAPH ROUGE-W-1.2 Eval D0736-B.M.100.H-H.59GRAPH R:0.15305 P:0.13052 F:0.14089
59GRAPH ROUGE-W-1.2 Eval D0736-B.M.100.H-I.59GRAPH R:0.14935 P:0.12557 F:0.13643
59GRAPH ROUGE-W-1.2 Eval D0736-B.M.100.H-J.59GRAPH R:0.15018 P:0.15124 F:0.15071
59GRAPH ROUGE-W-1.2 Eval D0736-C.M.100.H-G.59GRAPH R:0.11046 P:0.07695 F:0.09071
59GRAPH ROUGE-W-1.2 Eval D0736-C.M.100.H-H.59GRAPH R:0.10092 P:0.05708 F:0.07292
59GRAPH ROUGE-W-1.2 Eval D0736-C.M.100.H-I.59GRAPH R:0.11958 P:0.06601 F:0.08506
59GRAPH ROUGE-W-1.2 Eval D0736-C.M.100.H-J.59GRAPH R:0.10668 P:0.08162 F:0.09248
59GRAPH ROUGE-W-1.2 Eval D0740-A.M.100.I-D.59GRAPH R:0.09450 P:0.09490 F:0.09470
59GRAPH ROUGE-W-1.2 Eval D0740-A.M.100.I-H.59GRAPH R:0.09542 P:0.09491 F:0.09516
59GRAPH ROUGE-W-1.2 Eval D0740-A.M.100.I-I.59GRAPH R:0.09411 P:0.09661 F:0.09534
59GRAPH ROUGE-W-1.2 Eval D0740-A.M.100.I-J.59GRAPH R:0.08853 P:0.09084 F:0.08967
59GRAPH ROUGE-W-1.2 Eval D0740-B.M.100.I-D.59GRAPH R:0.08418 P:0.08102 F:0.08257
59GRAPH ROUGE-W-1.2 Eval D0740-B.M.100.I-H.59GRAPH R:0.07905 P:0.07225 F:0.07550
59GRAPH ROUGE-W-1.2 Eval D0740-B.M.100.I-I.59GRAPH R:0.08315 P:0.08104 F:0.08208
59GRAPH ROUGE-W-1.2 Eval D0740-B.M.100.I-J.59GRAPH R:0.08324 P:0.07820 F:0.08064
59GRAPH ROUGE-W-1.2 Eval D0740-C.M.100.I-D.59GRAPH R:0.11892 P:0.14085 F:0.12896
59GRAPH ROUGE-W-1.2 Eval D0740-C.M.100.I-H.59GRAPH R:0.13096 P:0.14904 F:0.13942
59GRAPH ROUGE-W-1.2 Eval D0740-C.M.100.I-I.59GRAPH R:0.11567 P:0.13883 F:0.12620
59GRAPH ROUGE-W-1.2 Eval D0740-C.M.100.I-J.59GRAPH R:0.11640 P:0.13733 F:0.12600
59GRAPH ROUGE-W-1.2 Eval D0743-A.M.100.J-B.59GRAPH R:0.10436 P:0.09363 F:0.09870
59GRAPH ROUGE-W-1.2 Eval D0743-A.M.100.J-H.59GRAPH R:0.09307 P:0.08512 F:0.08892
59GRAPH ROUGE-W-1.2 Eval D0743-A.M.100.J-I.59GRAPH R:0.10048 P:0.09323 F:0.09672
59GRAPH ROUGE-W-1.2 Eval D0743-A.M.100.J-J.59GRAPH R:0.08426 P:0.07768 F:0.08084
59GRAPH ROUGE-W-1.2 Eval D0743-B.M.100.J-B.59GRAPH R:0.09299 P:0.09098 F:0.09197
59GRAPH ROUGE-W-1.2 Eval D0743-B.M.100.J-H.59GRAPH R:0.09684 P:0.09534 F:0.09608
59GRAPH ROUGE-W-1.2 Eval D0743-B.M.100.J-I.59GRAPH R:0.09941 P:0.09913 F:0.09927
59GRAPH ROUGE-W-1.2 Eval D0743-B.M.100.J-J.59GRAPH R:0.09424 P:0.09314 F:0.09369
59GRAPH ROUGE-W-1.2 Eval D0743-C.M.100.J-B.59GRAPH R:0.12183 P:0.12104 F:0.12143
59GRAPH ROUGE-W-1.2 Eval D0743-C.M.100.J-H.59GRAPH R:0.11241 P:0.10621 F:0.10922
59GRAPH ROUGE-W-1.2 Eval D0743-C.M.100.J-I.59GRAPH R:0.12593 P:0.12655 F:0.12624
59GRAPH ROUGE-W-1.2 Eval D0743-C.M.100.J-J.59GRAPH R:0.11581 P:0.11169 F:0.11371
---------------------------------------------
59GRAPH ROUGE-SU4 Average_R: 0.10958 (95%-conf.int. 0.10420 - 0.11524)
59GRAPH ROUGE-SU4 Average_P: 0.05489 (95%-conf.int. 0.05117 - 0.05905)
59GRAPH ROUGE-SU4 Average_F: 0.07265 (95%-conf.int. 0.06822 - 0.07750)
.............................................
59GRAPH ROUGE-SU4 Eval D0703-A.M.100.A-A.59GRAPH R:0.13021 P:0.08047 F:0.09947
59GRAPH ROUGE-SU4 Eval D0703-A.M.100.A-C.59GRAPH R:0.09655 P:0.06009 F:0.07408
59GRAPH ROUGE-SU4 Eval D0703-A.M.100.A-D.59GRAPH R:0.12191 P:0.07403 F:0.09212
59GRAPH ROUGE-SU4 Eval D0703-A.M.100.A-J.59GRAPH R:0.11538 P:0.07082 F:0.08777
59GRAPH ROUGE-SU4 Eval D0703-B.M.100.A-A.59GRAPH R:0.11913 P:0.06788 F:0.08648
59GRAPH ROUGE-SU4 Eval D0703-B.M.100.A-C.59GRAPH R:0.11379 P:0.06310 F:0.08118
59GRAPH ROUGE-SU4 Eval D0703-B.M.100.A-D.59GRAPH R:0.11207 P:0.06214 F:0.07995
59GRAPH ROUGE-SU4 Eval D0703-B.M.100.A-J.59GRAPH R:0.10410 P:0.05832 F:0.07476
59GRAPH ROUGE-SU4 Eval D0703-C.M.100.A-A.59GRAPH R:0.15811 P:0.09035 F:0.11499
59GRAPH ROUGE-SU4 Eval D0703-C.M.100.A-C.59GRAPH R:0.13444 P:0.07893 F:0.09946
59GRAPH ROUGE-SU4 Eval D0703-C.M.100.A-D.59GRAPH R:0.15476 P:0.08904 F:0.11304
59GRAPH ROUGE-SU4 Eval D0703-C.M.100.A-J.59GRAPH R:0.15646 P:0.09002 F:0.11429
59GRAPH ROUGE-SU4 Eval D0706-A.M.100.B-B.59GRAPH R:0.10500 P:0.04701 F:0.06494
59GRAPH ROUGE-SU4 Eval D0706-A.M.100.B-D.59GRAPH R:0.10570 P:0.04701 F:0.06508
59GRAPH ROUGE-SU4 Eval D0706-A.M.100.B-E.59GRAPH R:0.07278 P:0.03259 F:0.04502
59GRAPH ROUGE-SU4 Eval D0706-A.M.100.B-I.59GRAPH R:0.09889 P:0.04428 F:0.06117
59GRAPH ROUGE-SU4 Eval D0706-B.M.100.B-B.59GRAPH R:0.08725 P:0.04082 F:0.05562
59GRAPH ROUGE-SU4 Eval D0706-B.M.100.B-D.59GRAPH R:0.07469 P:0.03506 F:0.04772
59GRAPH ROUGE-SU4 Eval D0706-B.M.100.B-E.59GRAPH R:0.07278 P:0.03428 F:0.04661
59GRAPH ROUGE-SU4 Eval D0706-B.M.100.B-I.59GRAPH R:0.08749 P:0.04134 F:0.05615
59GRAPH ROUGE-SU4 Eval D0706-C.M.100.B-B.59GRAPH R:0.14128 P:0.08982 F:0.10982
59GRAPH ROUGE-SU4 Eval D0706-C.M.100.B-D.59GRAPH R:0.14128 P:0.08982 F:0.10982
59GRAPH ROUGE-SU4 Eval D0706-C.M.100.B-E.59GRAPH R:0.14364 P:0.09193 F:0.11211
59GRAPH ROUGE-SU4 Eval D0706-C.M.100.B-I.59GRAPH R:0.14262 P:0.09158 F:0.11154
59GRAPH ROUGE-SU4 Eval D0711-A.M.100.C-A.59GRAPH R:0.08333 P:0.03246 F:0.04672
59GRAPH ROUGE-SU4 Eval D0711-A.M.100.C-B.59GRAPH R:0.09589 P:0.03684 F:0.05323
59GRAPH ROUGE-SU4 Eval D0711-A.M.100.C-C.59GRAPH R:0.08847 P:0.03399 F:0.04911
59GRAPH ROUGE-SU4 Eval D0711-A.M.100.C-F.59GRAPH R:0.09524 P:0.03684 F:0.05313
59GRAPH ROUGE-SU4 Eval D0711-B.M.100.C-A.59GRAPH R:0.08333 P:0.03225 F:0.04650
59GRAPH ROUGE-SU4 Eval D0711-B.M.100.C-B.59GRAPH R:0.08744 P:0.03360 F:0.04855
59GRAPH ROUGE-SU4 Eval D0711-B.M.100.C-C.59GRAPH R:0.07586 P:0.02977 F:0.04276
59GRAPH ROUGE-SU4 Eval D0711-B.M.100.C-F.59GRAPH R:0.08130 P:0.03157 F:0.04548
59GRAPH ROUGE-SU4 Eval D0711-C.M.100.C-A.59GRAPH R:0.09831 P:0.04825 F:0.06473
59GRAPH ROUGE-SU4 Eval D0711-C.M.100.C-B.59GRAPH R:0.10585 P:0.05019 F:0.06809
59GRAPH ROUGE-SU4 Eval D0711-C.M.100.C-C.59GRAPH R:0.10475 P:0.05019 F:0.06786
59GRAPH ROUGE-SU4 Eval D0711-C.M.100.C-F.59GRAPH R:0.10301 P:0.04936 F:0.06674
59GRAPH ROUGE-SU4 Eval D0716-A.M.100.D-C.59GRAPH R:0.09371 P:0.04849 F:0.06391
59GRAPH ROUGE-SU4 Eval D0716-A.M.100.D-D.59GRAPH R:0.09075 P:0.04617 F:0.06120
59GRAPH ROUGE-SU4 Eval D0716-A.M.100.D-E.59GRAPH R:0.09556 P:0.04878 F:0.06459
59GRAPH ROUGE-SU4 Eval D0716-A.M.100.D-F.59GRAPH R:0.09548 P:0.04907 F:0.06482
59GRAPH ROUGE-SU4 Eval D0716-B.M.100.D-C.59GRAPH R:0.11824 P:0.06470 F:0.08364
59GRAPH ROUGE-SU4 Eval D0716-B.M.100.D-D.59GRAPH R:0.12471 P:0.06685 F:0.08704
59GRAPH ROUGE-SU4 Eval D0716-B.M.100.D-E.59GRAPH R:0.11320 P:0.06131 F:0.07954
59GRAPH ROUGE-SU4 Eval D0716-B.M.100.D-F.59GRAPH R:0.11530 P:0.06223 F:0.08083
59GRAPH ROUGE-SU4 Eval D0716-C.M.100.D-C.59GRAPH R:0.17614 P:0.11088 F:0.13609
59GRAPH ROUGE-SU4 Eval D0716-C.M.100.D-D.59GRAPH R:0.18786 P:0.11509 F:0.14274
59GRAPH ROUGE-SU4 Eval D0716-C.M.100.D-E.59GRAPH R:0.15989 P:0.09930 F:0.12251
59GRAPH ROUGE-SU4 Eval D0716-C.M.100.D-F.59GRAPH R:0.17637 P:0.10842 F:0.13429
59GRAPH ROUGE-SU4 Eval D0721-A.M.100.E-B.59GRAPH R:0.07420 P:0.03293 F:0.04562
59GRAPH ROUGE-SU4 Eval D0721-A.M.100.E-C.59GRAPH R:0.05833 P:0.02660 F:0.03654
59GRAPH ROUGE-SU4 Eval D0721-A.M.100.E-E.59GRAPH R:0.06833 P:0.03116 F:0.04280
59GRAPH ROUGE-SU4 Eval D0721-A.M.100.E-G.59GRAPH R:0.07135 P:0.03318 F:0.04530
59GRAPH ROUGE-SU4 Eval D0721-B.M.100.E-B.59GRAPH R:0.05351 P:0.02286 F:0.03203
59GRAPH ROUGE-SU4 Eval D0721-B.M.100.E-C.59GRAPH R:0.05501 P:0.02405 F:0.03347
59GRAPH ROUGE-SU4 Eval D0721-B.M.100.E-E.59GRAPH R:0.04377 P:0.01857 F:0.02608
59GRAPH ROUGE-SU4 Eval D0721-B.M.100.E-G.59GRAPH R:0.05519 P:0.02381 F:0.03327
59GRAPH ROUGE-SU4 Eval D0721-C.M.100.E-B.59GRAPH R:0.10494 P:0.04825 F:0.06611
59GRAPH ROUGE-SU4 Eval D0721-C.M.100.E-C.59GRAPH R:0.09379 P:0.04283 F:0.05881
59GRAPH ROUGE-SU4 Eval D0721-C.M.100.E-E.59GRAPH R:0.10217 P:0.04618 F:0.06361
59GRAPH ROUGE-SU4 Eval D0721-C.M.100.E-G.59GRAPH R:0.09643 P:0.04463 F:0.06102
59GRAPH ROUGE-SU4 Eval D0726-A.M.100.F-A.59GRAPH R:0.08987 P:0.03699 F:0.05241
59GRAPH ROUGE-SU4 Eval D0726-A.M.100.F-E.59GRAPH R:0.08790 P:0.03605 F:0.05113
59GRAPH ROUGE-SU4 Eval D0726-A.M.100.F-F.59GRAPH R:0.10011 P:0.04120 F:0.05838
59GRAPH ROUGE-SU4 Eval D0726-A.M.100.F-G.59GRAPH R:0.08760 P:0.03605 F:0.05108
59GRAPH ROUGE-SU4 Eval D0726-B.M.100.F-A.59GRAPH R:0.08781 P:0.02689 F:0.04117
59GRAPH ROUGE-SU4 Eval D0726-B.M.100.F-E.59GRAPH R:0.09272 P:0.02792 F:0.04292
59GRAPH ROUGE-SU4 Eval D0726-B.M.100.F-F.59GRAPH R:0.08874 P:0.02672 F:0.04107
59GRAPH ROUGE-SU4 Eval D0726-B.M.100.F-G.59GRAPH R:0.09516 P:0.02895 F:0.04439
59GRAPH ROUGE-SU4 Eval D0726-C.M.100.F-A.59GRAPH R:0.11644 P:0.05546 F:0.07513
59GRAPH ROUGE-SU4 Eval D0726-C.M.100.F-E.59GRAPH R:0.11130 P:0.05247 F:0.07132
59GRAPH ROUGE-SU4 Eval D0726-C.M.100.F-F.59GRAPH R:0.12660 P:0.05927 F:0.08074
59GRAPH ROUGE-SU4 Eval D0726-C.M.100.F-G.59GRAPH R:0.11953 P:0.05791 F:0.07802
59GRAPH ROUGE-SU4 Eval D0727-A.M.100.G-A.59GRAPH R:0.11433 P:0.04533 F:0.06492
59GRAPH ROUGE-SU4 Eval D0727-A.M.100.G-F.59GRAPH R:0.12050 P:0.04826 F:0.06892
59GRAPH ROUGE-SU4 Eval D0727-A.M.100.G-G.59GRAPH R:0.10179 P:0.04105 F:0.05851
59GRAPH ROUGE-SU4 Eval D0727-A.M.100.G-H.59GRAPH R:0.12331 P:0.04939 F:0.07053
59GRAPH ROUGE-SU4 Eval D0727-B.M.100.G-A.59GRAPH R:0.11896 P:0.05164 F:0.07202
59GRAPH ROUGE-SU4 Eval D0727-B.M.100.G-F.59GRAPH R:0.13611 P:0.06263 F:0.08579
59GRAPH ROUGE-SU4 Eval D0727-B.M.100.G-G.59GRAPH R:0.12040 P:0.05189 F:0.07252
59GRAPH ROUGE-SU4 Eval D0727-B.M.100.G-H.59GRAPH R:0.12956 P:0.05624 F:0.07843
59GRAPH ROUGE-SU4 Eval D0727-C.M.100.G-A.59GRAPH R:0.10870 P:0.05078 F:0.06922
59GRAPH ROUGE-SU4 Eval D0727-C.M.100.G-F.59GRAPH R:0.12687 P:0.05729 F:0.07894
59GRAPH ROUGE-SU4 Eval D0727-C.M.100.G-G.59GRAPH R:0.11864 P:0.05469 F:0.07487
59GRAPH ROUGE-SU4 Eval D0727-C.M.100.G-H.59GRAPH R:0.11400 P:0.05130 F:0.07076
59GRAPH ROUGE-SU4 Eval D0736-A.M.100.H-G.59GRAPH R:0.11070 P:0.04870 F:0.06764
59GRAPH ROUGE-SU4 Eval D0736-A.M.100.H-H.59GRAPH R:0.12406 P:0.05357 F:0.07483
59GRAPH ROUGE-SU4 Eval D0736-A.M.100.H-I.59GRAPH R:0.11661 P:0.05168 F:0.07162
59GRAPH ROUGE-SU4 Eval D0736-A.M.100.H-J.59GRAPH R:0.10459 P:0.05060 F:0.06820
59GRAPH ROUGE-SU4 Eval D0736-B.M.100.H-G.59GRAPH R:0.16207 P:0.07963 F:0.10679
59GRAPH ROUGE-SU4 Eval D0736-B.M.100.H-H.59GRAPH R:0.21368 P:0.09671 F:0.13316
59GRAPH ROUGE-SU4 Eval D0736-B.M.100.H-I.59GRAPH R:0.19192 P:0.08575 F:0.11854
59GRAPH ROUGE-SU4 Eval D0736-B.M.100.H-J.59GRAPH R:0.21043 P:0.11315 F:0.14717
59GRAPH ROUGE-SU4 Eval D0736-C.M.100.H-G.59GRAPH R:0.11354 P:0.04262 F:0.06198
59GRAPH ROUGE-SU4 Eval D0736-C.M.100.H-H.59GRAPH R:0.09311 P:0.02732 F:0.04224
59GRAPH ROUGE-SU4 Eval D0736-C.M.100.H-I.59GRAPH R:0.11918 P:0.03497 F:0.05407
59GRAPH ROUGE-SU4 Eval D0736-C.M.100.H-J.59GRAPH R:0.10311 P:0.04344 F:0.06113
59GRAPH ROUGE-SU4 Eval D0740-A.M.100.I-D.59GRAPH R:0.10169 P:0.05484 F:0.07125
59GRAPH ROUGE-SU4 Eval D0740-A.M.100.I-H.59GRAPH R:0.09732 P:0.05302 F:0.06864
59GRAPH ROUGE-SU4 Eval D0740-A.M.100.I-I.59GRAPH R:0.10611 P:0.05820 F:0.07517
59GRAPH ROUGE-SU4 Eval D0740-A.M.100.I-J.59GRAPH R:0.09161 P:0.05058 F:0.06518
59GRAPH ROUGE-SU4 Eval D0740-B.M.100.I-D.59GRAPH R:0.07000 P:0.03621 F:0.04773
59GRAPH ROUGE-SU4 Eval D0740-B.M.100.I-H.59GRAPH R:0.05896 P:0.02989 F:0.03967
59GRAPH ROUGE-SU4 Eval D0740-B.M.100.I-I.59GRAPH R:0.07295 P:0.03736 F:0.04941
59GRAPH ROUGE-SU4 Eval D0740-B.M.100.I-J.59GRAPH R:0.06811 P:0.03534 F:0.04653
59GRAPH ROUGE-SU4 Eval D0740-C.M.100.I-D.59GRAPH R:0.18251 P:0.11089 F:0.13796
59GRAPH ROUGE-SU4 Eval D0740-C.M.100.I-H.59GRAPH R:0.17602 P:0.10624 F:0.13250
59GRAPH ROUGE-SU4 Eval D0740-C.M.100.I-I.59GRAPH R:0.16557 P:0.10060 F:0.12516
59GRAPH ROUGE-SU4 Eval D0740-C.M.100.I-J.59GRAPH R:0.17320 P:0.10558 F:0.13119
59GRAPH ROUGE-SU4 Eval D0743-A.M.100.J-B.59GRAPH R:0.10152 P:0.05160 F:0.06842
59GRAPH ROUGE-SU4 Eval D0743-A.M.100.J-H.59GRAPH R:0.08122 P:0.04249 F:0.05579
59GRAPH ROUGE-SU4 Eval D0743-A.M.100.J-I.59GRAPH R:0.10096 P:0.05215 F:0.06877
59GRAPH ROUGE-SU4 Eval D0743-A.M.100.J-J.59GRAPH R:0.07466 P:0.03918 F:0.05139
59GRAPH ROUGE-SU4 Eval D0743-B.M.100.J-B.59GRAPH R:0.08004 P:0.04626 F:0.05863
59GRAPH ROUGE-SU4 Eval D0743-B.M.100.J-H.59GRAPH R:0.07713 P:0.04531 F:0.05709
59GRAPH ROUGE-SU4 Eval D0743-B.M.100.J-I.59GRAPH R:0.08820 P:0.05165 F:0.06515
59GRAPH ROUGE-SU4 Eval D0743-B.M.100.J-J.59GRAPH R:0.07721 P:0.04594 F:0.05760
59GRAPH ROUGE-SU4 Eval D0743-C.M.100.J-B.59GRAPH R:0.11944 P:0.06703 F:0.08587
59GRAPH ROUGE-SU4 Eval D0743-C.M.100.J-H.59GRAPH R:0.09804 P:0.05484 F:0.07034
59GRAPH ROUGE-SU4 Eval D0743-C.M.100.J-I.59GRAPH R:0.13443 P:0.07495 F:0.09624
59GRAPH ROUGE-SU4 Eval D0743-C.M.100.J-J.59GRAPH R:0.11075 P:0.06277 F:0.08013
---------------------------------------------
A ROUGE-1 Average_R: 0.44586 (95%-conf.int. 0.38911 - 0.50429)
A ROUGE-1 Average_P: 0.26838 (95%-conf.int. 0.23480 - 0.30103)
A ROUGE-1 Average_F: 0.33471 (95%-conf.int. 0.29181 - 0.37615)
.............................................
A ROUGE-1 Eval D0703-A.M.100.A-A.A R:0.35473 P:0.19663 F:0.25301
A ROUGE-1 Eval D0703-B.M.100.A-A.A R:0.40196 P:0.26623 F:0.32031
A ROUGE-1 Eval D0703-C.M.100.A-A.A R:0.50000 P:0.28736 F:0.36497
A ROUGE-1 Eval D0703-C.M.100.A-C.A R:0.65260 P:0.38506 F:0.48434
A ROUGE-1 Eval D0703-C.M.100.A-D.A R:0.67881 P:0.39272 F:0.49757
A ROUGE-1 Eval D0703-C.M.100.A-J.A R:0.68212 P:0.39464 F:0.50000
A ROUGE-1 Eval D0706-A.M.100.B-B.A R:0.25649 P:0.15134 F:0.19036
A ROUGE-1 Eval D0711-A.M.100.C-A.A R:0.39803 P:0.24008 F:0.29951
A ROUGE-1 Eval D0711-B.M.100.C-A.A R:0.40816 P:0.27211 F:0.32653
A ROUGE-1 Eval D0711-C.M.100.C-A.A R:0.44554 P:0.29605 F:0.35573
A ROUGE-1 Eval D0726-A.M.100.F-A.A R:0.38538 P:0.21363 F:0.27488
A ROUGE-1 Eval D0726-B.M.100.F-A.A R:0.39869 P:0.25902 F:0.31402
A ROUGE-1 Eval D0726-C.M.100.F-A.A R:0.36000 P:0.21302 F:0.26766
A ROUGE-1 Eval D0727-A.M.100.G-A.A R:0.52492 P:0.30268 F:0.38396
A ROUGE-1 Eval D0727-B.M.100.G-A.A R:0.38488 P:0.21705 F:0.27757
A ROUGE-1 Eval D0727-C.M.100.G-A.A R:0.39414 P:0.26362 F:0.31593
---------------------------------------------
A ROUGE-2 Average_R: 0.15283 (95%-conf.int. 0.09515 - 0.21998)
A ROUGE-2 Average_P: 0.09116 (95%-conf.int. 0.05685 - 0.12940)
A ROUGE-2 Average_F: 0.11410 (95%-conf.int. 0.07066 - 0.16273)
.............................................
A ROUGE-2 Eval D0703-A.M.100.A-A.A R:0.07850 P:0.04331 F:0.05582
A ROUGE-2 Eval D0703-B.M.100.A-A.A R:0.13861 P:0.09150 F:0.11023
A ROUGE-2 Eval D0703-C.M.100.A-A.A R:0.14141 P:0.08092 F:0.10294
A ROUGE-2 Eval D0703-C.M.100.A-C.A R:0.41639 P:0.24470 F:0.30825
A ROUGE-2 Eval D0703-C.M.100.A-D.A R:0.41806 P:0.24085 F:0.30563
A ROUGE-2 Eval D0703-C.M.100.A-J.A R:0.43144 P:0.24855 F:0.31540
A ROUGE-2 Eval D0706-A.M.100.B-B.A R:0.00984 P:0.00578 F:0.00728
A ROUGE-2 Eval D0711-A.M.100.C-A.A R:0.08638 P:0.05190 F:0.06484
A ROUGE-2 Eval D0711-B.M.100.C-A.A R:0.11684 P:0.07763 F:0.09328
A ROUGE-2 Eval D0711-C.M.100.C-A.A R:0.15000 P:0.09934 F:0.11952
A ROUGE-2 Eval D0726-A.M.100.F-A.A R:0.07718 P:0.04259 F:0.05489
A ROUGE-2 Eval D0726-B.M.100.F-A.A R:0.08581 P:0.05556 F:0.06745
A ROUGE-2 Eval D0726-C.M.100.F-A.A R:0.06061 P:0.03571 F:0.04494
A ROUGE-2 Eval D0727-A.M.100.G-A.A R:0.17114 P:0.09827 F:0.12485
A ROUGE-2 Eval D0727-B.M.100.G-A.A R:0.06597 P:0.03704 F:0.04744
A ROUGE-2 Eval D0727-C.M.100.G-A.A R:0.07237 P:0.04825 F:0.05790
---------------------------------------------
A ROUGE-3 Average_R: 0.09226 (95%-conf.int. 0.03709 - 0.16014)
A ROUGE-3 Average_P: 0.05443 (95%-conf.int. 0.02288 - 0.09281)
A ROUGE-3 Average_F: 0.06842 (95%-conf.int. 0.02820 - 0.11749)
.............................................
A ROUGE-3 Eval D0703-A.M.100.A-A.A R:0.01724 P:0.00947 F:0.01222
A ROUGE-3 Eval D0703-B.M.100.A-A.A R:0.05333 P:0.03509 F:0.04233
A ROUGE-3 Eval D0703-C.M.100.A-A.A R:0.07143 P:0.04070 F:0.05185
A ROUGE-3 Eval D0703-C.M.100.A-C.A R:0.35762 P:0.20930 F:0.26406
A ROUGE-3 Eval D0703-C.M.100.A-D.A R:0.35473 P:0.20349 F:0.25862
A ROUGE-3 Eval D0703-C.M.100.A-J.A R:0.37500 P:0.21512 F:0.27340
A ROUGE-3 Eval D0706-A.M.100.B-B.A R:0.00000 P:0.00000 F:0.00000
A ROUGE-3 Eval D0711-A.M.100.C-A.A R:0.03691 P:0.02209 F:0.02764
A ROUGE-3 Eval D0711-B.M.100.C-A.A R:0.04514 P:0.02989 F:0.03597
A ROUGE-3 Eval D0711-C.M.100.C-A.A R:0.10101 P:0.06667 F:0.08032
A ROUGE-3 Eval D0726-A.M.100.F-A.A R:0.02712 P:0.01490 F:0.01923
A ROUGE-3 Eval D0726-B.M.100.F-A.A R:0.01667 P:0.01075 F:0.01307
A ROUGE-3 Eval D0726-C.M.100.F-A.A R:0.01361 P:0.00798 F:0.01006
A ROUGE-3 Eval D0727-A.M.100.G-A.A R:0.05085 P:0.02907 F:0.03699
A ROUGE-3 Eval D0727-B.M.100.G-A.A R:0.01754 P:0.00980 F:0.01257
A ROUGE-3 Eval D0727-C.M.100.G-A.A R:0.02658 P:0.01766 F:0.02122
---------------------------------------------
A ROUGE-4 Average_R: 0.07043 (95%-conf.int. 0.01769 - 0.13437)
A ROUGE-4 Average_P: 0.04112 (95%-conf.int. 0.01098 - 0.07772)
A ROUGE-4 Average_F: 0.05190 (95%-conf.int. 0.01353 - 0.09846)
.............................................
A ROUGE-4 Eval D0703-A.M.100.A-A.A R:0.00697 P:0.00381 F:0.00493
A ROUGE-4 Eval D0703-B.M.100.A-A.A R:0.01347 P:0.00883 F:0.01067
A ROUGE-4 Eval D0703-C.M.100.A-A.A R:0.03780 P:0.02144 F:0.02736
A ROUGE-4 Eval D0703-C.M.100.A-C.A R:0.32107 P:0.18713 F:0.23645
A ROUGE-4 Eval D0703-C.M.100.A-D.A R:0.32423 P:0.18519 F:0.23574
A ROUGE-4 Eval D0703-C.M.100.A-J.A R:0.33447 P:0.19103 F:0.24317
A ROUGE-4 Eval D0706-A.M.100.B-B.A R:0.00000 P:0.00000 F:0.00000
A ROUGE-4 Eval D0711-A.M.100.C-A.A R:0.02034 P:0.01212 F:0.01519
A ROUGE-4 Eval D0711-B.M.100.C-A.A R:0.02105 P:0.01389 F:0.01674
A ROUGE-4 Eval D0711-C.M.100.C-A.A R:0.07483 P:0.04922 F:0.05938
A ROUGE-4 Eval D0726-A.M.100.F-A.A R:0.01027 P:0.00562 F:0.00726
A ROUGE-4 Eval D0726-B.M.100.F-A.A R:0.01010 P:0.00649 F:0.00790
A ROUGE-4 Eval D0726-C.M.100.F-A.A R:0.00344 P:0.00201 F:0.00254
A ROUGE-4 Eval D0727-A.M.100.G-A.A R:0.02397 P:0.01365 F:0.01739
A ROUGE-4 Eval D0727-B.M.100.G-A.A R:0.00000 P:0.00000 F:0.00000
A ROUGE-4 Eval D0727-C.M.100.G-A.A R:0.01342 P:0.00889 F:0.01070
---------------------------------------------
A ROUGE-L Average_R: 0.40037 (95%-conf.int. 0.34692 - 0.45834)
A ROUGE-L Average_P: 0.24099 (95%-conf.int. 0.20945 - 0.27355)
A ROUGE-L Average_F: 0.30056 (95%-conf.int. 0.26109 - 0.34149)
.............................................
A ROUGE-L Eval D0703-A.M.100.A-A.A R:0.31757 P:0.17603 F:0.22651
A ROUGE-L Eval D0703-B.M.100.A-A.A R:0.35294 P:0.23377 F:0.28125
A ROUGE-L Eval D0703-C.M.100.A-A.A R:0.42333 P:0.24330 F:0.30901
A ROUGE-L Eval D0703-C.M.100.A-C.A R:0.60065 P:0.35441 F:0.44579
A ROUGE-L Eval D0703-C.M.100.A-D.A R:0.62252 P:0.36015 F:0.45631
A ROUGE-L Eval D0703-C.M.100.A-J.A R:0.63907 P:0.36973 F:0.46844
A ROUGE-L Eval D0706-A.M.100.B-B.A R:0.24351 P:0.14368 F:0.18073
A ROUGE-L Eval D0711-A.M.100.C-A.A R:0.35197 P:0.21230 F:0.26485
A ROUGE-L Eval D0711-B.M.100.C-A.A R:0.38095 P:0.25397 F:0.30476
A ROUGE-L Eval D0711-C.M.100.C-A.A R:0.41254 P:0.27412 F:0.32938
A ROUGE-L Eval D0726-A.M.100.F-A.A R:0.34551 P:0.19153 F:0.24645
A ROUGE-L Eval D0726-B.M.100.F-A.A R:0.35621 P:0.23142 F:0.28056
A ROUGE-L Eval D0726-C.M.100.F-A.A R:0.30333 P:0.17949 F:0.22553
A ROUGE-L Eval D0727-A.M.100.G-A.A R:0.48173 P:0.27778 F:0.35237
A ROUGE-L Eval D0727-B.M.100.G-A.A R:0.32990 P:0.18605 F:0.23792
A ROUGE-L Eval D0727-C.M.100.G-A.A R:0.33550 P:0.22440 F:0.26893
---------------------------------------------
A ROUGE-W-1.2 Average_R: 0.14374 (95%-conf.int. 0.12116 - 0.16876)
A ROUGE-W-1.2 Average_P: 0.15717 (95%-conf.int. 0.13268 - 0.18481)
A ROUGE-W-1.2 Average_F: 0.14995 (95%-conf.int. 0.12644 - 0.17606)
.............................................
A ROUGE-W-1.2 Eval D0703-A.M.100.A-A.A R:0.10482 P:0.10462 F:0.10472
A ROUGE-W-1.2 Eval D0703-B.M.100.A-A.A R:0.12437 P:0.15274 F:0.13710
A ROUGE-W-1.2 Eval D0703-C.M.100.A-A.A R:0.14104 P:0.15071 F:0.14571
A ROUGE-W-1.2 Eval D0703-C.M.100.A-C.A R:0.23244 P:0.25894 F:0.24498
A ROUGE-W-1.2 Eval D0703-C.M.100.A-D.A R:0.23944 P:0.26292 F:0.25063
A ROUGE-W-1.2 Eval D0703-C.M.100.A-J.A R:0.25685 P:0.26763 F:0.26213
A ROUGE-W-1.2 Eval D0706-A.M.100.B-B.A R:0.08304 P:0.08792 F:0.08541
A ROUGE-W-1.2 Eval D0711-A.M.100.C-A.A R:0.12503 P:0.13597 F:0.13027
A ROUGE-W-1.2 Eval D0711-B.M.100.C-A.A R:0.13445 P:0.15992 F:0.14608
A ROUGE-W-1.2 Eval D0711-C.M.100.C-A.A R:0.14171 P:0.17604 F:0.15702
A ROUGE-W-1.2 Eval D0726-A.M.100.F-A.A R:0.12408 P:0.12188 F:0.12297
A ROUGE-W-1.2 Eval D0726-B.M.100.F-A.A R:0.12865 P:0.14702 F:0.13722
A ROUGE-W-1.2 Eval D0726-C.M.100.F-A.A R:0.10872 P:0.11297 F:0.11080
A ROUGE-W-1.2 Eval D0727-A.M.100.G-A.A R:0.17104 P:0.17360 F:0.17231
A ROUGE-W-1.2 Eval D0727-B.M.100.G-A.A R:0.11339 P:0.11220 F:0.11279
A ROUGE-W-1.2 Eval D0727-C.M.100.G-A.A R:0.11310 P:0.13604 F:0.12351
---------------------------------------------
A ROUGE-SU4 Average_R: 0.19129 (95%-conf.int. 0.14045 - 0.25124)
A ROUGE-SU4 Average_P: 0.11354 (95%-conf.int. 0.08398 - 0.14725)
A ROUGE-SU4 Average_F: 0.14237 (95%-conf.int. 0.10499 - 0.18510)
.............................................
A ROUGE-SU4 Eval D0703-A.M.100.A-A.A R:0.10475 P:0.05735 F:0.07412
A ROUGE-SU4 Eval D0703-B.M.100.A-A.A R:0.15884 P:0.10426 F:0.12589
A ROUGE-SU4 Eval D0703-C.M.100.A-A.A R:0.18893 P:0.10733 F:0.13689
A ROUGE-SU4 Eval D0703-C.M.100.A-C.A R:0.42444 P:0.24773 F:0.31286
A ROUGE-SU4 Eval D0703-C.M.100.A-D.A R:0.43027 P:0.24611 F:0.31312
A ROUGE-SU4 Eval D0703-C.M.100.A-J.A R:0.44388 P:0.25389 F:0.32302
A ROUGE-SU4 Eval D0706-A.M.100.B-B.A R:0.06444 P:0.03761 F:0.04750
A ROUGE-SU4 Eval D0711-A.M.100.C-A.A R:0.14358 P:0.08569 F:0.10733
A ROUGE-SU4 Eval D0711-B.M.100.C-A.A R:0.14977 P:0.09892 F:0.11915
A ROUGE-SU4 Eval D0711-C.M.100.C-A.A R:0.19774 P:0.13021 F:0.15702
A ROUGE-SU4 Eval D0726-A.M.100.F-A.A R:0.12799 P:0.07009 F:0.09058
A ROUGE-SU4 Eval D0726-B.M.100.F-A.A R:0.13199 P:0.08495 F:0.10337
A ROUGE-SU4 Eval D0726-C.M.100.F-A.A R:0.11301 P:0.06613 F:0.08344
A ROUGE-SU4 Eval D0727-A.M.100.G-A.A R:0.20705 P:0.11803 F:0.15035
A ROUGE-SU4 Eval D0727-B.M.100.G-A.A R:0.13486 P:0.07513 F:0.09650
A ROUGE-SU4 Eval D0727-C.M.100.G-A.A R:0.12876 P:0.08537 F:0.10267
---------------------------------------------
B ROUGE-1 Average_R: 0.41250 (95%-conf.int. 0.37856 - 0.44332)
B ROUGE-1 Average_P: 0.22892 (95%-conf.int. 0.20166 - 0.25179)
B ROUGE-1 Average_F: 0.29353 (95%-conf.int. 0.26309 - 0.32034)
.............................................
B ROUGE-1 Eval D0706-A.M.100.B-B.B R:0.40584 P:0.25880 F:0.31605
B ROUGE-1 Eval D0706-B.M.100.B-B.B R:0.42484 P:0.24904 F:0.31401
B ROUGE-1 Eval D0706-C.M.100.B-B.B R:0.51613 P:0.27073 F:0.35516
B ROUGE-1 Eval D0711-A.M.100.C-B.B R:0.40000 P:0.21858 F:0.28269
B ROUGE-1 Eval D0711-B.M.100.C-B.B R:0.45890 P:0.24542 F:0.31981
B ROUGE-1 Eval D0711-C.M.100.C-B.B R:0.46416 P:0.26204 F:0.33497
B ROUGE-1 Eval D0721-A.M.100.E-B.B R:0.46333 P:0.22937 F:0.30684
B ROUGE-1 Eval D0721-B.M.100.E-B.B R:0.41694 P:0.26016 F:0.32040
B ROUGE-1 Eval D0721-C.M.100.E-B.B R:0.41311 P:0.26415 F:0.32225
B ROUGE-1 Eval D0743-A.M.100.J-B.B R:0.38095 P:0.18519 F:0.24923
B ROUGE-1 Eval D0743-B.M.100.J-B.B R:0.33333 P:0.14752 F:0.20452
B ROUGE-1 Eval D0743-C.M.100.J-B.B R:0.28889 P:0.13188 F:0.18109
---------------------------------------------
B ROUGE-2 Average_R: 0.11418 (95%-conf.int. 0.09257 - 0.13682)
B ROUGE-2 Average_P: 0.06381 (95%-conf.int. 0.05046 - 0.07740)
B ROUGE-2 Average_F: 0.08164 (95%-conf.int. 0.06481 - 0.09797)
.............................................
B ROUGE-2 Eval D0706-A.M.100.B-B.B R:0.11803 P:0.07500 F:0.09172
B ROUGE-2 Eval D0706-B.M.100.B-B.B R:0.13531 P:0.07900 F:0.09976
B ROUGE-2 Eval D0706-C.M.100.B-B.B R:0.16612 P:0.08673 F:0.11396
B ROUGE-2 Eval D0711-A.M.100.C-B.B R:0.05387 P:0.02930 F:0.03796
B ROUGE-2 Eval D0711-B.M.100.C-B.B R:0.14187 P:0.07551 F:0.09856
B ROUGE-2 Eval D0711-C.M.100.C-B.B R:0.17241 P:0.09690 F:0.12407
B ROUGE-2 Eval D0721-A.M.100.E-B.B R:0.12795 P:0.06302 F:0.08445
B ROUGE-2 Eval D0721-B.M.100.E-B.B R:0.08553 P:0.05317 F:0.06558
B ROUGE-2 Eval D0721-C.M.100.E-B.B R:0.15232 P:0.09705 F:0.11856
B ROUGE-2 Eval D0743-A.M.100.J-B.B R:0.09615 P:0.04651 F:0.06269
B ROUGE-2 Eval D0743-B.M.100.J-B.B R:0.06796 P:0.02991 F:0.04154
B ROUGE-2 Eval D0743-C.M.100.J-B.B R:0.04808 P:0.02183 F:0.03003
---------------------------------------------
B ROUGE-3 Average_R: 0.05173 (95%-conf.int. 0.03617 - 0.06780)
B ROUGE-3 Average_P: 0.02914 (95%-conf.int. 0.02021 - 0.03887)
B ROUGE-3 Average_F: 0.03719 (95%-conf.int. 0.02562 - 0.04948)
.............................................
B ROUGE-3 Eval D0706-A.M.100.B-B.B R:0.05960 P:0.03774 F:0.04622
B ROUGE-3 Eval D0706-B.M.100.B-B.B R:0.06333 P:0.03682 F:0.04657
B ROUGE-3 Eval D0706-C.M.100.B-B.B R:0.08224 P:0.04274 F:0.05625
B ROUGE-3 Eval D0711-A.M.100.C-B.B R:0.01020 P:0.00552 F:0.00716
B ROUGE-3 Eval D0711-B.M.100.C-B.B R:0.06643 P:0.03519 F:0.04601
B ROUGE-3 Eval D0711-C.M.100.C-B.B R:0.10453 P:0.05848 F:0.07500
B ROUGE-3 Eval D0721-A.M.100.E-B.B R:0.06122 P:0.03000 F:0.04027
B ROUGE-3 Eval D0721-B.M.100.E-B.B R:0.02326 P:0.01440 F:0.01779
B ROUGE-3 Eval D0721-C.M.100.E-B.B R:0.08361 P:0.05308 F:0.06494
B ROUGE-3 Eval D0743-A.M.100.J-B.B R:0.02913 P:0.01402 F:0.01893
B ROUGE-3 Eval D0743-B.M.100.J-B.B R:0.01961 P:0.00858 F:0.01194
B ROUGE-3 Eval D0743-C.M.100.J-B.B R:0.00971 P:0.00439 F:0.00605
---------------------------------------------
B ROUGE-4 Average_R: 0.02766 (95%-conf.int. 0.01657 - 0.04061)
B ROUGE-4 Average_P: 0.01580 (95%-conf.int. 0.00935 - 0.02327)
B ROUGE-4 Average_F: 0.02008 (95%-conf.int. 0.01191 - 0.02939)
.............................................
B ROUGE-4 Eval D0706-A.M.100.B-B.B R:0.03344 P:0.02110 F:0.02587
B ROUGE-4 Eval D0706-B.M.100.B-B.B R:0.03030 P:0.01754 F:0.02222
B ROUGE-4 Eval D0706-C.M.100.B-B.B R:0.03987 P:0.02062 F:0.02718
B ROUGE-4 Eval D0711-A.M.100.C-B.B R:0.00000 P:0.00000 F:0.00000
B ROUGE-4 Eval D0711-B.M.100.C-B.B R:0.03534 P:0.01862 F:0.02439
B ROUGE-4 Eval D0711-C.M.100.C-B.B R:0.08099 P:0.04510 F:0.05794
B ROUGE-4 Eval D0721-A.M.100.E-B.B R:0.02405 P:0.01173 F:0.01577
B ROUGE-4 Eval D0721-B.M.100.E-B.B R:0.02013 P:0.01242 F:0.01536
B ROUGE-4 Eval D0721-C.M.100.E-B.B R:0.05068 P:0.03205 F:0.03927
B ROUGE-4 Eval D0743-A.M.100.J-B.B R:0.00980 P:0.00469 F:0.00634
B ROUGE-4 Eval D0743-B.M.100.J-B.B R:0.00330 P:0.00144 F:0.00201
B ROUGE-4 Eval D0743-C.M.100.J-B.B R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
B ROUGE-L Average_R: 0.37242 (95%-conf.int. 0.34138 - 0.40313)
B ROUGE-L Average_P: 0.20666 (95%-conf.int. 0.18241 - 0.22849)
B ROUGE-L Average_F: 0.26499 (95%-conf.int. 0.23621 - 0.28984)
.............................................
B ROUGE-L Eval D0706-A.M.100.B-B.B R:0.37338 P:0.23810 F:0.29078
B ROUGE-L Eval D0706-B.M.100.B-B.B R:0.38889 P:0.22797 F:0.28744
B ROUGE-L Eval D0706-C.M.100.B-B.B R:0.46774 P:0.24535 F:0.32187
B ROUGE-L Eval D0711-A.M.100.C-B.B R:0.34667 P:0.18944 F:0.24500
B ROUGE-L Eval D0711-B.M.100.C-B.B R:0.43836 P:0.23443 F:0.30549
B ROUGE-L Eval D0711-C.M.100.C-B.B R:0.41638 P:0.23507 F:0.30049
B ROUGE-L Eval D0721-A.M.100.E-B.B R:0.41000 P:0.20297 F:0.27152
B ROUGE-L Eval D0721-B.M.100.E-B.B R:0.34528 P:0.21545 F:0.26533
B ROUGE-L Eval D0721-C.M.100.E-B.B R:0.38033 P:0.24319 F:0.29668
B ROUGE-L Eval D0743-A.M.100.J-B.B R:0.34603 P:0.16821 F:0.22638
B ROUGE-L Eval D0743-B.M.100.J-B.B R:0.30449 P:0.13475 F:0.18682
B ROUGE-L Eval D0743-C.M.100.J-B.B R:0.25714 P:0.11739 F:0.16119
---------------------------------------------
B ROUGE-W-1.2 Average_R: 0.13058 (95%-conf.int. 0.11996 - 0.14141)
B ROUGE-W-1.2 Average_P: 0.12974 (95%-conf.int. 0.11464 - 0.14405)
B ROUGE-W-1.2 Average_F: 0.12950 (95%-conf.int. 0.11702 - 0.14152)
.............................................
B ROUGE-W-1.2 Eval D0706-A.M.100.B-B.B R:0.13538 P:0.15493 F:0.14450
B ROUGE-W-1.2 Eval D0706-B.M.100.B-B.B R:0.13104 P:0.13304 F:0.13203
B ROUGE-W-1.2 Eval D0706-C.M.100.B-B.B R:0.16933 P:0.15160 F:0.15998
B ROUGE-W-1.2 Eval D0711-A.M.100.C-B.B R:0.11445 P:0.11328 F:0.11386
B ROUGE-W-1.2 Eval D0711-B.M.100.C-B.B R:0.14823 P:0.14856 F:0.14839
B ROUGE-W-1.2 Eval D0711-C.M.100.C-B.B R:0.13706 P:0.14469 F:0.14077
B ROUGE-W-1.2 Eval D0721-A.M.100.E-B.B R:0.15371 P:0.13375 F:0.14304
B ROUGE-W-1.2 Eval D0721-B.M.100.E-B.B R:0.11377 P:0.13724 F:0.12441
B ROUGE-W-1.2 Eval D0721-C.M.100.E-B.B R:0.13604 P:0.16010 F:0.14709
B ROUGE-W-1.2 Eval D0743-A.M.100.J-B.B R:0.11935 P:0.10113 F:0.10949
B ROUGE-W-1.2 Eval D0743-B.M.100.J-B.B R:0.11464 P:0.08496 F:0.09759
B ROUGE-W-1.2 Eval D0743-C.M.100.J-B.B R:0.09205 P:0.07356 F:0.08177
---------------------------------------------
B ROUGE-SU4 Average_R: 0.14804 (95%-conf.int. 0.12688 - 0.16734)
B ROUGE-SU4 Average_P: 0.08149 (95%-conf.int. 0.06807 - 0.09389)
B ROUGE-SU4 Average_F: 0.10481 (95%-conf.int. 0.08826 - 0.12018)
.............................................
B ROUGE-SU4 Eval D0706-A.M.100.B-B.B R:0.13556 P:0.08561 F:0.10494
B ROUGE-SU4 Eval D0706-B.M.100.B-B.B R:0.16555 P:0.09598 F:0.12151
B ROUGE-SU4 Eval D0706-C.M.100.B-B.B R:0.19978 P:0.10349 F:0.13635
B ROUGE-SU4 Eval D0711-A.M.100.C-B.B R:0.12614 P:0.06808 F:0.08843
B ROUGE-SU4 Eval D0711-B.M.100.C-B.B R:0.18545 P:0.09789 F:0.12814
B ROUGE-SU4 Eval D0711-C.M.100.C-B.B R:0.20643 P:0.11513 F:0.14782
B ROUGE-SU4 Eval D0721-A.M.100.E-B.B R:0.17180 P:0.08389 F:0.11273
B ROUGE-SU4 Eval D0721-B.M.100.E-B.B R:0.13545 P:0.08368 F:0.10345
B ROUGE-SU4 Eval D0721-C.M.100.E-B.B R:0.16049 P:0.10163 F:0.12445
B ROUGE-SU4 Eval D0743-A.M.100.J-B.B R:0.12269 P:0.05885 F:0.07955
B ROUGE-SU4 Eval D0743-B.M.100.J-B.B R:0.09868 P:0.04304 F:0.05994
B ROUGE-SU4 Eval D0743-C.M.100.J-B.B R:0.08306 P:0.03739 F:0.05157
---------------------------------------------
C ROUGE-1 Average_R: 0.42702 (95%-conf.int. 0.39584 - 0.45508)
C ROUGE-1 Average_P: 0.25392 (95%-conf.int. 0.22902 - 0.27512)
C ROUGE-1 Average_F: 0.31759 (95%-conf.int. 0.29179 - 0.34059)
.............................................
C ROUGE-1 Eval D0703-A.M.100.A-C.C R:0.31544 P:0.16756 F:0.21886
C ROUGE-1 Eval D0703-B.M.100.A-C.C R:0.37919 P:0.20471 F:0.26588
C ROUGE-1 Eval D0703-C.M.100.A-C.C R:0.48701 P:0.28249 F:0.35757
C ROUGE-1 Eval D0711-A.M.100.C-C.C R:0.42667 P:0.24806 F:0.31372
C ROUGE-1 Eval D0711-B.M.100.C-C.C R:0.46980 P:0.26515 F:0.33898
C ROUGE-1 Eval D0711-C.M.100.C-C.C R:0.44595 P:0.25882 F:0.32754
C ROUGE-1 Eval D0716-A.M.100.D-C.C R:0.49836 P:0.34703 F:0.40915
C ROUGE-1 Eval D0716-B.M.100.D-C.C R:0.44408 P:0.26946 F:0.33540
C ROUGE-1 Eval D0716-C.M.100.D-C.C R:0.41694 P:0.29630 F:0.34642
C ROUGE-1 Eval D0721-A.M.100.E-C.C R:0.48377 P:0.25601 F:0.33483
C ROUGE-1 Eval D0721-B.M.100.E-C.C R:0.38535 P:0.27626 F:0.32181
C ROUGE-1 Eval D0721-C.M.100.E-C.C R:0.49505 P:0.27322 F:0.35211
---------------------------------------------
C ROUGE-2 Average_R: 0.13664 (95%-conf.int. 0.10939 - 0.16291)
C ROUGE-2 Average_P: 0.08065 (95%-conf.int. 0.06498 - 0.09673)
C ROUGE-2 Average_F: 0.10116 (95%-conf.int. 0.08130 - 0.12033)
.............................................
C ROUGE-2 Eval D0703-A.M.100.A-C.C R:0.07797 P:0.04122 F:0.05393
C ROUGE-2 Eval D0703-B.M.100.A-C.C R:0.11525 P:0.06193 F:0.08057
C ROUGE-2 Eval D0703-C.M.100.A-C.C R:0.16066 P:0.09280 F:0.11765
C ROUGE-2 Eval D0711-A.M.100.C-C.C R:0.07071 P:0.04094 F:0.05186
C ROUGE-2 Eval D0711-B.M.100.C-C.C R:0.17288 P:0.09714 F:0.12439
C ROUGE-2 Eval D0711-C.M.100.C-C.C R:0.14334 P:0.08284 F:0.10500
C ROUGE-2 Eval D0716-A.M.100.D-C.C R:0.20199 P:0.14023 F:0.16554
C ROUGE-2 Eval D0716-B.M.100.D-C.C R:0.15947 P:0.09639 F:0.12015
C ROUGE-2 Eval D0716-C.M.100.D-C.C R:0.11842 P:0.08392 F:0.09823
C ROUGE-2 Eval D0721-A.M.100.E-C.C R:0.21967 P:0.11572 F:0.15159
C ROUGE-2 Eval D0721-B.M.100.E-C.C R:0.08682 P:0.06207 F:0.07239
C ROUGE-2 Eval D0721-C.M.100.E-C.C R:0.17667 P:0.09707 F:0.12530
---------------------------------------------
C ROUGE-3 Average_R: 0.06752 (95%-conf.int. 0.04811 - 0.08673)
C ROUGE-3 Average_P: 0.03987 (95%-conf.int. 0.02861 - 0.05114)
C ROUGE-3 Average_F: 0.05000 (95%-conf.int. 0.03576 - 0.06401)
.............................................
C ROUGE-3 Eval D0703-A.M.100.A-C.C R:0.01712 P:0.00901 F:0.01181
C ROUGE-3 Eval D0703-B.M.100.A-C.C R:0.05822 P:0.03114 F:0.04058
C ROUGE-3 Eval D0703-C.M.100.A-C.C R:0.07616 P:0.04381 F:0.05562
C ROUGE-3 Eval D0711-A.M.100.C-C.C R:0.02381 P:0.01373 F:0.01742
C ROUGE-3 Eval D0711-B.M.100.C-C.C R:0.08904 P:0.04981 F:0.06388
C ROUGE-3 Eval D0711-C.M.100.C-C.C R:0.07241 P:0.04167 F:0.05290
C ROUGE-3 Eval D0716-A.M.100.D-C.C R:0.12040 P:0.08333 F:0.09849
C ROUGE-3 Eval D0716-B.M.100.D-C.C R:0.08725 P:0.05253 F:0.06558
C ROUGE-3 Eval D0716-C.M.100.D-C.C R:0.05648 P:0.03991 F:0.04677
C ROUGE-3 Eval D0721-A.M.100.E-C.C R:0.13245 P:0.06944 F:0.09111
C ROUGE-3 Eval D0721-B.M.100.E-C.C R:0.03896 P:0.02778 F:0.03243
C ROUGE-3 Eval D0721-C.M.100.E-C.C R:0.09091 P:0.04972 F:0.06428
---------------------------------------------
C ROUGE-4 Average_R: 0.03761 (95%-conf.int. 0.02328 - 0.05183)
C ROUGE-4 Average_P: 0.02196 (95%-conf.int. 0.01375 - 0.03043)
C ROUGE-4 Average_F: 0.02765 (95%-conf.int. 0.01726 - 0.03836)
.............................................
C ROUGE-4 Eval D0703-A.M.100.A-C.C R:0.00692 P:0.00362 F:0.00475
C ROUGE-4 Eval D0703-B.M.100.A-C.C R:0.02768 P:0.01473 F:0.01923
C ROUGE-4 Eval D0703-C.M.100.A-C.C R:0.04682 P:0.02682 F:0.03410
C ROUGE-4 Eval D0711-A.M.100.C-C.C R:0.00687 P:0.00394 F:0.00501
C ROUGE-4 Eval D0711-B.M.100.C-C.C R:0.05882 P:0.03276 F:0.04208
C ROUGE-4 Eval D0711-C.M.100.C-C.C R:0.04181 P:0.02395 F:0.03045
C ROUGE-4 Eval D0716-A.M.100.D-C.C R:0.07770 P:0.05361 F:0.06345
C ROUGE-4 Eval D0716-B.M.100.D-C.C R:0.05085 P:0.03049 F:0.03812
C ROUGE-4 Eval D0716-C.M.100.D-C.C R:0.01342 P:0.00946 F:0.01110
C ROUGE-4 Eval D0721-A.M.100.E-C.C R:0.08696 P:0.04538 F:0.05964
C ROUGE-4 Eval D0721-B.M.100.E-C.C R:0.01639 P:0.01166 F:0.01363
C ROUGE-4 Eval D0721-C.M.100.E-C.C R:0.05102 P:0.02778 F:0.03597
---------------------------------------------
C ROUGE-L Average_R: 0.38559 (95%-conf.int. 0.35423 - 0.41341)
C ROUGE-L Average_P: 0.22880 (95%-conf.int. 0.20750 - 0.24669)
C ROUGE-L Average_F: 0.28641 (95%-conf.int. 0.26279 - 0.30773)
.............................................
C ROUGE-L Eval D0703-A.M.100.A-C.C R:0.29195 P:0.15508 F:0.20256
C ROUGE-L Eval D0703-B.M.100.A-C.C R:0.33557 P:0.18116 F:0.23529
C ROUGE-L Eval D0703-C.M.100.A-C.C R:0.42208 P:0.24482 F:0.30989
C ROUGE-L Eval D0711-A.M.100.C-C.C R:0.39333 P:0.22868 F:0.28921
C ROUGE-L Eval D0711-B.M.100.C-C.C R:0.44966 P:0.25379 F:0.32446
C ROUGE-L Eval D0711-C.M.100.C-C.C R:0.40203 P:0.23333 F:0.29528
C ROUGE-L Eval D0716-A.M.100.D-C.C R:0.43934 P:0.30594 F:0.36070
C ROUGE-L Eval D0716-B.M.100.D-C.C R:0.42105 P:0.25549 F:0.31801
C ROUGE-L Eval D0716-C.M.100.D-C.C R:0.36482 P:0.25926 F:0.30311
C ROUGE-L Eval D0721-A.M.100.E-C.C R:0.43831 P:0.23196 F:0.30337
C ROUGE-L Eval D0721-B.M.100.E-C.C R:0.32484 P:0.23288 F:0.27128
C ROUGE-L Eval D0721-C.M.100.E-C.C R:0.45215 P:0.24954 F:0.32159
---------------------------------------------
C ROUGE-W-1.2 Average_R: 0.13465 (95%-conf.int. 0.12179 - 0.14621)
C ROUGE-W-1.2 Average_P: 0.14726 (95%-conf.int. 0.13283 - 0.16140)
C ROUGE-W-1.2 Average_F: 0.14023 (95%-conf.int. 0.12701 - 0.15269)
.............................................
C ROUGE-W-1.2 Eval D0703-A.M.100.A-C.C R:0.10002 P:0.09656 F:0.09826
C ROUGE-W-1.2 Eval D0703-B.M.100.A-C.C R:0.11543 P:0.11792 F:0.11666
C ROUGE-W-1.2 Eval D0703-C.M.100.A-C.C R:0.14304 P:0.15665 F:0.14954
C ROUGE-W-1.2 Eval D0711-A.M.100.C-C.C R:0.13361 P:0.13949 F:0.13649
C ROUGE-W-1.2 Eval D0711-B.M.100.C-C.C R:0.15939 P:0.16899 F:0.16405
C ROUGE-W-1.2 Eval D0711-C.M.100.C-C.C R:0.13542 P:0.14924 F:0.14199
C ROUGE-W-1.2 Eval D0716-A.M.100.D-C.C R:0.16617 P:0.21139 F:0.18607
C ROUGE-W-1.2 Eval D0716-B.M.100.D-C.C R:0.15133 P:0.16018 F:0.15563
C ROUGE-W-1.2 Eval D0716-C.M.100.D-C.C R:0.12220 P:0.16186 F:0.13926
C ROUGE-W-1.2 Eval D0721-A.M.100.E-C.C R:0.16602 P:0.15588 F:0.16079
C ROUGE-W-1.2 Eval D0721-B.M.100.E-C.C R:0.10851 P:0.14621 F:0.12457
C ROUGE-W-1.2 Eval D0721-C.M.100.E-C.C R:0.15550 P:0.16147 F:0.15843
---------------------------------------------
C ROUGE-SU4 Average_R: 0.17162 (95%-conf.int. 0.14682 - 0.19451)
C ROUGE-SU4 Average_P: 0.10140 (95%-conf.int. 0.08568 - 0.11667)
C ROUGE-SU4 Average_F: 0.12711 (95%-conf.int. 0.10847 - 0.14464)
.............................................
C ROUGE-SU4 Eval D0703-A.M.100.A-C.C R:0.09310 P:0.04882 F:0.06405
C ROUGE-SU4 Eval D0703-B.M.100.A-C.C R:0.13851 P:0.07384 F:0.09633
C ROUGE-SU4 Eval D0703-C.M.100.A-C.C R:0.19000 P:0.10899 F:0.13852
C ROUGE-SU4 Eval D0711-A.M.100.C-C.C R:0.15126 P:0.08694 F:0.11042
C ROUGE-SU4 Eval D0711-B.M.100.C-C.C R:0.20632 P:0.11506 F:0.14773
C ROUGE-SU4 Eval D0711-C.M.100.C-C.C R:0.17766 P:0.10193 F:0.12954
C ROUGE-SU4 Eval D0716-A.M.100.D-C.C R:0.24747 P:0.17093 F:0.20220
C ROUGE-SU4 Eval D0716-B.M.100.D-C.C R:0.20608 P:0.12373 F:0.15462
C ROUGE-SU4 Eval D0716-C.M.100.D-C.C R:0.17336 P:0.12225 F:0.14339
C ROUGE-SU4 Eval D0721-A.M.100.E-C.C R:0.23056 P:0.12050 F:0.15828
C ROUGE-SU4 Eval D0721-B.M.100.E-C.C R:0.13453 P:0.09574 F:0.11187
C ROUGE-SU4 Eval D0721-C.M.100.E-C.C R:0.19944 P:0.10875 F:0.14075
---------------------------------------------
D ROUGE-1 Average_R: 0.45829 (95%-conf.int. 0.43057 - 0.48666)
D ROUGE-1 Average_P: 0.24035 (95%-conf.int. 0.22413 - 0.25496)
D ROUGE-1 Average_F: 0.31467 (95%-conf.int. 0.29515 - 0.33291)
.............................................
D ROUGE-1 Eval D0703-A.M.100.A-D.D R:0.42612 P:0.18209 F:0.25515
D ROUGE-1 Eval D0703-B.M.100.A-D.D R:0.48658 P:0.26268 F:0.34118
D ROUGE-1 Eval D0703-C.M.100.A-D.D R:0.50993 P:0.26460 F:0.34841
D ROUGE-1 Eval D0706-A.M.100.B-D.D R:0.38235 P:0.21081 F:0.27178
D ROUGE-1 Eval D0706-B.M.100.B-D.D R:0.42671 P:0.23732 F:0.30501
D ROUGE-1 Eval D0706-C.M.100.B-D.D R:0.55161 P:0.27404 F:0.36617
D ROUGE-1 Eval D0716-A.M.100.D-D.D R:0.47000 P:0.25543 F:0.33098
D ROUGE-1 Eval D0716-B.M.100.D-D.D R:0.54362 P:0.26214 F:0.35371
D ROUGE-1 Eval D0716-C.M.100.D-D.D R:0.41137 P:0.23563 F:0.29963
D ROUGE-1 Eval D0740-A.M.100.I-D.D R:0.46535 P:0.25134 F:0.32639
D ROUGE-1 Eval D0740-B.M.100.I-D.D R:0.40909 P:0.23204 F:0.29612
D ROUGE-1 Eval D0740-C.M.100.I-D.D R:0.44409 P:0.26628 F:0.33293
---------------------------------------------
D ROUGE-2 Average_R: 0.14007 (95%-conf.int. 0.11716 - 0.16235)
D ROUGE-2 Average_P: 0.07381 (95%-conf.int. 0.06071 - 0.08571)
D ROUGE-2 Average_F: 0.09652 (95%-conf.int. 0.07991 - 0.11198)
.............................................
D ROUGE-2 Eval D0703-A.M.100.A-D.D R:0.07986 P:0.03392 F:0.04762
D ROUGE-2 Eval D0703-B.M.100.A-D.D R:0.19661 P:0.10565 F:0.13744
D ROUGE-2 Eval D0703-C.M.100.A-D.D R:0.17057 P:0.08808 F:0.11617
D ROUGE-2 Eval D0706-A.M.100.B-D.D R:0.08251 P:0.04529 F:0.05848
D ROUGE-2 Eval D0706-B.M.100.B-D.D R:0.15789 P:0.08743 F:0.11254
D ROUGE-2 Eval D0706-C.M.100.B-D.D R:0.16938 P:0.08374 F:0.11207
D ROUGE-2 Eval D0716-A.M.100.D-D.D R:0.17172 P:0.09290 F:0.12057
D ROUGE-2 Eval D0716-B.M.100.D-D.D R:0.18644 P:0.08943 F:0.12088
D ROUGE-2 Eval D0716-C.M.100.D-D.D R:0.09459 P:0.05395 F:0.06871
D ROUGE-2 Eval D0740-A.M.100.I-D.D R:0.15333 P:0.08244 F:0.10723
D ROUGE-2 Eval D0740-B.M.100.I-D.D R:0.12131 P:0.06852 F:0.08757
D ROUGE-2 Eval D0740-C.M.100.I-D.D R:0.14194 P:0.08478 F:0.10615
---------------------------------------------
D ROUGE-3 Average_R: 0.06205 (95%-conf.int. 0.04557 - 0.07617)
D ROUGE-3 Average_P: 0.03278 (95%-conf.int. 0.02418 - 0.03978)
D ROUGE-3 Average_F: 0.04284 (95%-conf.int. 0.03163 - 0.05237)
.............................................
D ROUGE-3 Eval D0703-A.M.100.A-D.D R:0.01404 P:0.00593 F:0.00834
D ROUGE-3 Eval D0703-B.M.100.A-D.D R:0.09247 P:0.04945 F:0.06444
D ROUGE-3 Eval D0703-C.M.100.A-D.D R:0.09122 P:0.04688 F:0.06193
D ROUGE-3 Eval D0706-A.M.100.B-D.D R:0.01667 P:0.00911 F:0.01178
D ROUGE-3 Eval D0706-B.M.100.B-D.D R:0.06977 P:0.03846 F:0.04959
D ROUGE-3 Eval D0706-C.M.100.B-D.D R:0.08882 P:0.04369 F:0.05857
D ROUGE-3 Eval D0716-A.M.100.D-D.D R:0.07483 P:0.04029 F:0.05238
D ROUGE-3 Eval D0716-B.M.100.D-D.D R:0.09247 P:0.04412 F:0.05974
D ROUGE-3 Eval D0716-C.M.100.D-D.D R:0.04437 P:0.02519 F:0.03214
D ROUGE-3 Eval D0740-A.M.100.I-D.D R:0.07744 P:0.04144 F:0.05399
D ROUGE-3 Eval D0740-B.M.100.I-D.D R:0.06291 P:0.03538 F:0.04529
D ROUGE-3 Eval D0740-C.M.100.I-D.D R:0.05863 P:0.03488 F:0.04374
---------------------------------------------
D ROUGE-4 Average_R: 0.03053 (95%-conf.int. 0.01961 - 0.04038)
D ROUGE-4 Average_P: 0.01598 (95%-conf.int. 0.01036 - 0.02090)
D ROUGE-4 Average_F: 0.02096 (95%-conf.int. 0.01354 - 0.02758)
.............................................
D ROUGE-4 Eval D0703-A.M.100.A-D.D R:0.00355 P:0.00149 F:0.00210
D ROUGE-4 Eval D0703-B.M.100.A-D.D R:0.04152 P:0.02210 F:0.02885
D ROUGE-4 Eval D0703-C.M.100.A-D.D R:0.05119 P:0.02618 F:0.03464
D ROUGE-4 Eval D0706-A.M.100.B-D.D R:0.00337 P:0.00183 F:0.00237
D ROUGE-4 Eval D0706-B.M.100.B-D.D R:0.02685 P:0.01473 F:0.01902
D ROUGE-4 Eval D0706-C.M.100.B-D.D R:0.05648 P:0.02764 F:0.03712
D ROUGE-4 Eval D0716-A.M.100.D-D.D R:0.04811 P:0.02578 F:0.03357
D ROUGE-4 Eval D0716-B.M.100.D-D.D R:0.04844 P:0.02299 F:0.03118
D ROUGE-4 Eval D0716-C.M.100.D-D.D R:0.00690 P:0.00390 F:0.00498
D ROUGE-4 Eval D0740-A.M.100.I-D.D R:0.04762 P:0.02536 F:0.03310
D ROUGE-4 Eval D0740-B.M.100.I-D.D R:0.03344 P:0.01873 F:0.02401
D ROUGE-4 Eval D0740-C.M.100.I-D.D R:0.02303 P:0.01365 F:0.01714
---------------------------------------------
D ROUGE-L Average_R: 0.40338 (95%-conf.int. 0.37677 - 0.43177)
D ROUGE-L Average_P: 0.21127 (95%-conf.int. 0.19643 - 0.22434)
D ROUGE-L Average_F: 0.27673 (95%-conf.int. 0.25826 - 0.29407)
.............................................
D ROUGE-L Eval D0703-A.M.100.A-D.D R:0.38144 P:0.16300 F:0.22840
D ROUGE-L Eval D0703-B.M.100.A-D.D R:0.43289 P:0.23370 F:0.30353
D ROUGE-L Eval D0703-C.M.100.A-D.D R:0.44040 P:0.22852 F:0.30090
D ROUGE-L Eval D0706-A.M.100.B-D.D R:0.32680 P:0.18018 F:0.23229
D ROUGE-L Eval D0706-B.M.100.B-D.D R:0.36808 P:0.20471 F:0.26310
D ROUGE-L Eval D0706-C.M.100.B-D.D R:0.48387 P:0.24038 F:0.32119
D ROUGE-L Eval D0716-A.M.100.D-D.D R:0.42000 P:0.22826 F:0.29577
D ROUGE-L Eval D0716-B.M.100.D-D.D R:0.50336 P:0.24272 F:0.32751
D ROUGE-L Eval D0716-C.M.100.D-D.D R:0.34448 P:0.19732 F:0.25091
D ROUGE-L Eval D0740-A.M.100.I-D.D R:0.40594 P:0.21925 F:0.28472
D ROUGE-L Eval D0740-B.M.100.I-D.D R:0.37013 P:0.20994 F:0.26792
D ROUGE-L Eval D0740-C.M.100.I-D.D R:0.38019 P:0.22797 F:0.28503
---------------------------------------------
D ROUGE-W-1.2 Average_R: 0.13785 (95%-conf.int. 0.12743 - 0.14907)
D ROUGE-W-1.2 Average_P: 0.13338 (95%-conf.int. 0.12400 - 0.14189)
D ROUGE-W-1.2 Average_F: 0.13514 (95%-conf.int. 0.12623 - 0.14442)
.............................................
D ROUGE-W-1.2 Eval D0703-A.M.100.A-D.D R:0.12664 P:0.09977 F:0.11161
D ROUGE-W-1.2 Eval D0703-B.M.100.A-D.D R:0.14740 P:0.14926 F:0.14832
D ROUGE-W-1.2 Eval D0703-C.M.100.A-D.D R:0.14652 P:0.14430 F:0.14540
D ROUGE-W-1.2 Eval D0706-A.M.100.B-D.D R:0.11486 P:0.11620 F:0.11553
D ROUGE-W-1.2 Eval D0706-B.M.100.B-D.D R:0.13289 P:0.13033 F:0.13160
D ROUGE-W-1.2 Eval D0706-C.M.100.B-D.D R:0.16721 P:0.14300 F:0.15416
D ROUGE-W-1.2 Eval D0716-A.M.100.D-D.D R:0.13947 P:0.14442 F:0.14190
D ROUGE-W-1.2 Eval D0716-B.M.100.D-D.D R:0.18108 P:0.15626 F:0.16776
D ROUGE-W-1.2 Eval D0716-C.M.100.D-D.D R:0.11382 P:0.12643 F:0.11979
D ROUGE-W-1.2 Eval D0740-A.M.100.I-D.D R:0.14289 P:0.14196 F:0.14242
D ROUGE-W-1.2 Eval D0740-B.M.100.I-D.D R:0.12440 P:0.12964 F:0.12697
D ROUGE-W-1.2 Eval D0740-C.M.100.I-D.D R:0.12727 P:0.14727 F:0.13654
---------------------------------------------
D ROUGE-SU4 Average_R: 0.17573 (95%-conf.int. 0.15476 - 0.19736)
D ROUGE-SU4 Average_P: 0.09149 (95%-conf.int. 0.07975 - 0.10225)
D ROUGE-SU4 Average_F: 0.12011 (95%-conf.int. 0.10497 - 0.13418)
.............................................
D ROUGE-SU4 Eval D0703-A.M.100.A-D.D R:0.12367 P:0.05201 F:0.07322
D ROUGE-SU4 Eval D0703-B.M.100.A-D.D R:0.21034 P:0.11213 F:0.14628
D ROUGE-SU4 Eval D0703-C.M.100.A-D.D R:0.20635 P:0.10569 F:0.13978
D ROUGE-SU4 Eval D0706-A.M.100.B-D.D R:0.11633 P:0.06338 F:0.08205
D ROUGE-SU4 Eval D0706-B.M.100.B-D.D R:0.16890 P:0.09283 F:0.11981
D ROUGE-SU4 Eval D0706-C.M.100.B-D.D R:0.21854 P:0.10714 F:0.14379
D ROUGE-SU4 Eval D0716-A.M.100.D-D.D R:0.21290 P:0.11428 F:0.14873
D ROUGE-SU4 Eval D0716-B.M.100.D-D.D R:0.23851 P:0.11339 F:0.15371
D ROUGE-SU4 Eval D0716-C.M.100.D-D.D R:0.14490 P:0.08204 F:0.10476
D ROUGE-SU4 Eval D0740-A.M.100.I-D.D R:0.18136 P:0.09675 F:0.12618
D ROUGE-SU4 Eval D0740-B.M.100.I-D.D R:0.15167 P:0.08505 F:0.10899
D ROUGE-SU4 Eval D0740-C.M.100.I-D.D R:0.17869 P:0.10603 F:0.13309
---------------------------------------------
E ROUGE-1 Average_R: 0.43504 (95%-conf.int. 0.41498 - 0.45675)
E ROUGE-1 Average_P: 0.24478 (95%-conf.int. 0.23520 - 0.25557)
E ROUGE-1 Average_F: 0.31309 (95%-conf.int. 0.30092 - 0.32757)
.............................................
E ROUGE-1 Eval D0706-A.M.100.B-E.E R:0.37662 P:0.22481 F:0.28156
E ROUGE-1 Eval D0706-B.M.100.B-E.E R:0.42857 P:0.24044 F:0.30805
E ROUGE-1 Eval D0706-C.M.100.B-E.E R:0.47115 P:0.26630 F:0.34027
E ROUGE-1 Eval D0716-A.M.100.D-E.E R:0.50498 P:0.29457 F:0.37209
E ROUGE-1 Eval D0716-B.M.100.D-E.E R:0.51827 P:0.27083 F:0.35575
E ROUGE-1 Eval D0716-C.M.100.D-E.E R:0.41254 P:0.24510 F:0.30750
E ROUGE-1 Eval D0721-A.M.100.E-E.E R:0.46104 P:0.23089 F:0.30769
E ROUGE-1 Eval D0721-B.M.100.E-E.E R:0.39672 P:0.22787 F:0.28947
E ROUGE-1 Eval D0721-C.M.100.E-E.E R:0.43667 P:0.24952 F:0.31757
E ROUGE-1 Eval D0726-A.M.100.F-E.E R:0.41000 P:0.23977 F:0.30259
E ROUGE-1 Eval D0726-B.M.100.F-E.E R:0.43522 P:0.23732 F:0.30715
E ROUGE-1 Eval D0726-C.M.100.F-E.E R:0.43098 P:0.23315 F:0.30260
---------------------------------------------
E ROUGE-2 Average_R: 0.13210 (95%-conf.int. 0.11637 - 0.14963)
E ROUGE-2 Average_P: 0.07377 (95%-conf.int. 0.06550 - 0.08257)
E ROUGE-2 Average_F: 0.09461 (95%-conf.int. 0.08371 - 0.10622)
.............................................
E ROUGE-2 Eval D0706-A.M.100.B-E.E R:0.09508 P:0.05653 F:0.07090
E ROUGE-2 Eval D0706-B.M.100.B-E.E R:0.14426 P:0.08059 F:0.10341
E ROUGE-2 Eval D0706-C.M.100.B-E.E R:0.11650 P:0.06557 F:0.08391
E ROUGE-2 Eval D0716-A.M.100.D-E.E R:0.18792 P:0.10916 F:0.13810
E ROUGE-2 Eval D0716-B.M.100.D-E.E R:0.19463 P:0.10122 F:0.13318
E ROUGE-2 Eval D0716-C.M.100.D-E.E R:0.14333 P:0.08481 F:0.10656
E ROUGE-2 Eval D0721-A.M.100.E-E.E R:0.16721 P:0.08333 F:0.11123
E ROUGE-2 Eval D0721-B.M.100.E-E.E R:0.10596 P:0.06061 F:0.07711
E ROUGE-2 Eval D0721-C.M.100.E-E.E R:0.11448 P:0.06513 F:0.08303
E ROUGE-2 Eval D0726-A.M.100.F-E.E R:0.11785 P:0.06863 F:0.08674
E ROUGE-2 Eval D0726-B.M.100.F-E.E R:0.13423 P:0.07286 F:0.09445
E ROUGE-2 Eval D0726-C.M.100.F-E.E R:0.10204 P:0.05495 F:0.07143
---------------------------------------------
E ROUGE-3 Average_R: 0.05797 (95%-conf.int. 0.04756 - 0.06974)
E ROUGE-3 Average_P: 0.03221 (95%-conf.int. 0.02676 - 0.03858)
E ROUGE-3 Average_F: 0.04138 (95%-conf.int. 0.03418 - 0.04965)
.............................................
E ROUGE-3 Eval D0706-A.M.100.B-E.E R:0.03974 P:0.02353 F:0.02956
E ROUGE-3 Eval D0706-B.M.100.B-E.E R:0.06623 P:0.03683 F:0.04734
E ROUGE-3 Eval D0706-C.M.100.B-E.E R:0.05556 P:0.03114 F:0.03991
E ROUGE-3 Eval D0716-A.M.100.D-E.E R:0.09492 P:0.05490 F:0.06956
E ROUGE-3 Eval D0716-B.M.100.D-E.E R:0.10169 P:0.05263 F:0.06936
E ROUGE-3 Eval D0716-C.M.100.D-E.E R:0.06061 P:0.03571 F:0.04494
E ROUGE-3 Eval D0721-A.M.100.E-E.E R:0.07616 P:0.03777 F:0.05050
E ROUGE-3 Eval D0721-B.M.100.E-E.E R:0.04013 P:0.02286 F:0.02913
E ROUGE-3 Eval D0721-C.M.100.E-E.E R:0.04082 P:0.02312 F:0.02952
E ROUGE-3 Eval D0726-A.M.100.F-E.E R:0.06122 P:0.03550 F:0.04494
E ROUGE-3 Eval D0726-B.M.100.F-E.E R:0.04068 P:0.02198 F:0.02854
E ROUGE-3 Eval D0726-C.M.100.F-E.E R:0.03780 P:0.02026 F:0.02638
---------------------------------------------
E ROUGE-4 Average_R: 0.02847 (95%-conf.int. 0.02200 - 0.03508)
E ROUGE-4 Average_P: 0.01580 (95%-conf.int. 0.01229 - 0.01935)
E ROUGE-4 Average_F: 0.02031 (95%-conf.int. 0.01574 - 0.02488)
.............................................
E ROUGE-4 Eval D0706-A.M.100.B-E.E R:0.02676 P:0.01578 F:0.01985
E ROUGE-4 Eval D0706-B.M.100.B-E.E R:0.03010 P:0.01667 F:0.02146
E ROUGE-4 Eval D0706-C.M.100.B-E.E R:0.02970 P:0.01657 F:0.02127
E ROUGE-4 Eval D0716-A.M.100.D-E.E R:0.04795 P:0.02761 F:0.03504
E ROUGE-4 Eval D0716-B.M.100.D-E.E R:0.04795 P:0.02469 F:0.03260
E ROUGE-4 Eval D0716-C.M.100.D-E.E R:0.01701 P:0.00998 F:0.01258
E ROUGE-4 Eval D0721-A.M.100.E-E.E R:0.04013 P:0.01980 F:0.02652
E ROUGE-4 Eval D0721-B.M.100.E-E.E R:0.02027 P:0.01149 F:0.01467
E ROUGE-4 Eval D0721-C.M.100.E-E.E R:0.02062 P:0.01163 F:0.01487
E ROUGE-4 Eval D0726-A.M.100.F-E.E R:0.04124 P:0.02381 F:0.03019
E ROUGE-4 Eval D0726-B.M.100.F-E.E R:0.01370 P:0.00737 F:0.00958
E ROUGE-4 Eval D0726-C.M.100.F-E.E R:0.01042 P:0.00556 F:0.00725
---------------------------------------------
E ROUGE-L Average_R: 0.38920 (95%-conf.int. 0.36695 - 0.41085)
E ROUGE-L Average_P: 0.21897 (95%-conf.int. 0.20868 - 0.23038)
E ROUGE-L Average_F: 0.28009 (95%-conf.int. 0.26608 - 0.29462)
.............................................
E ROUGE-L Eval D0706-A.M.100.B-E.E R:0.34091 P:0.20349 F:0.25486
E ROUGE-L Eval D0706-B.M.100.B-E.E R:0.36364 P:0.20401 F:0.26138
E ROUGE-L Eval D0706-C.M.100.B-E.E R:0.41987 P:0.23732 F:0.30324
E ROUGE-L Eval D0716-A.M.100.D-E.E R:0.44186 P:0.25775 F:0.32558
E ROUGE-L Eval D0716-B.M.100.D-E.E R:0.47508 P:0.24826 F:0.32611
E ROUGE-L Eval D0716-C.M.100.D-E.E R:0.39604 P:0.23529 F:0.29520
E ROUGE-L Eval D0721-A.M.100.E-E.E R:0.41558 P:0.20813 F:0.27736
E ROUGE-L Eval D0721-B.M.100.E-E.E R:0.32459 P:0.18644 F:0.23684
E ROUGE-L Eval D0721-C.M.100.E-E.E R:0.40333 P:0.23048 F:0.29334
E ROUGE-L Eval D0726-A.M.100.F-E.E R:0.36000 P:0.21053 F:0.26569
E ROUGE-L Eval D0726-B.M.100.F-E.E R:0.40532 P:0.22101 F:0.28605
E ROUGE-L Eval D0726-C.M.100.F-E.E R:0.38047 P:0.20583 F:0.26714
---------------------------------------------
E ROUGE-W-1.2 Average_R: 0.13682 (95%-conf.int. 0.12868 - 0.14466)
E ROUGE-W-1.2 Average_P: 0.13944 (95%-conf.int. 0.13361 - 0.14621)
E ROUGE-W-1.2 Average_F: 0.13793 (95%-conf.int. 0.13122 - 0.14464)
.............................................
E ROUGE-W-1.2 Eval D0706-A.M.100.B-E.E R:0.11911 P:0.12892 F:0.12382
E ROUGE-W-1.2 Eval D0706-B.M.100.B-E.E R:0.13419 P:0.13288 F:0.13353
E ROUGE-W-1.2 Eval D0706-C.M.100.B-E.E R:0.14833 P:0.14202 F:0.14511
E ROUGE-W-1.2 Eval D0716-A.M.100.D-E.E R:0.15552 P:0.16942 F:0.16217
E ROUGE-W-1.2 Eval D0716-B.M.100.D-E.E R:0.16602 P:0.15445 F:0.16003
E ROUGE-W-1.2 Eval D0716-C.M.100.D-E.E R:0.12820 P:0.14761 F:0.13722
E ROUGE-W-1.2 Eval D0721-A.M.100.E-E.E R:0.14799 P:0.13314 F:0.14017
E ROUGE-W-1.2 Eval D0721-B.M.100.E-E.E R:0.10692 P:0.12055 F:0.11333
E ROUGE-W-1.2 Eval D0721-C.M.100.E-E.E R:0.13475 P:0.14372 F:0.13909
E ROUGE-W-1.2 Eval D0726-A.M.100.F-E.E R:0.13634 P:0.13969 F:0.13799
E ROUGE-W-1.2 Eval D0726-B.M.100.F-E.E R:0.14279 P:0.14055 F:0.14166
E ROUGE-W-1.2 Eval D0726-C.M.100.F-E.E R:0.13988 P:0.13356 F:0.13665
---------------------------------------------
E ROUGE-SU4 Average_R: 0.17118 (95%-conf.int. 0.15593 - 0.18898)
E ROUGE-SU4 Average_P: 0.09508 (95%-conf.int. 0.08743 - 0.10454)
E ROUGE-SU4 Average_F: 0.12218 (95%-conf.int. 0.11221 - 0.13451)
.............................................
E ROUGE-SU4 Eval D0706-A.M.100.B-E.E R:0.13833 P:0.08169 F:0.10272
E ROUGE-SU4 Eval D0706-B.M.100.B-E.E R:0.16222 P:0.08996 F:0.11574
E ROUGE-SU4 Eval D0706-C.M.100.B-E.E R:0.17160 P:0.09589 F:0.12303
E ROUGE-SU4 Eval D0716-A.M.100.D-E.E R:0.23720 P:0.13681 F:0.17353
E ROUGE-SU4 Eval D0716-B.M.100.D-E.E R:0.24005 P:0.12383 F:0.16338
E ROUGE-SU4 Eval D0716-C.M.100.D-E.E R:0.17684 P:0.10392 F:0.13091
E ROUGE-SU4 Eval D0721-A.M.100.E-E.E R:0.19167 P:0.09473 F:0.12679
E ROUGE-SU4 Eval D0721-B.M.100.E-E.E R:0.14029 P:0.07967 F:0.10163
E ROUGE-SU4 Eval D0721-C.M.100.E-E.E R:0.16324 P:0.09220 F:0.11784
E ROUGE-SU4 Eval D0726-A.M.100.F-E.E R:0.15183 P:0.08779 F:0.11125
E ROUGE-SU4 Eval D0726-B.M.100.F-E.E R:0.16325 P:0.08793 F:0.11430
E ROUGE-SU4 Eval D0726-C.M.100.F-E.E R:0.15686 P:0.08380 F:0.10924
---------------------------------------------
F ROUGE-1 Average_R: 0.43704 (95%-conf.int. 0.40906 - 0.46426)
F ROUGE-1 Average_P: 0.23944 (95%-conf.int. 0.22249 - 0.25648)
F ROUGE-1 Average_F: 0.30911 (95%-conf.int. 0.28861 - 0.32968)
.............................................
F ROUGE-1 Eval D0711-A.M.100.C-F.F R:0.42384 P:0.23573 F:0.30296
F ROUGE-1 Eval D0711-B.M.100.C-F.F R:0.45763 P:0.26786 F:0.33793
F ROUGE-1 Eval D0711-C.M.100.C-F.F R:0.39527 P:0.21547 F:0.27890
F ROUGE-1 Eval D0716-A.M.100.D-F.F R:0.49835 P:0.27808 F:0.35697
F ROUGE-1 Eval D0716-B.M.100.D-F.F R:0.52333 P:0.28755 F:0.37116
F ROUGE-1 Eval D0716-C.M.100.D-F.F R:0.46333 P:0.26782 F:0.33944
F ROUGE-1 Eval D0726-A.M.100.F-F.F R:0.35216 P:0.19521 F:0.25118
F ROUGE-1 Eval D0726-B.M.100.F-F.F R:0.47176 P:0.24274 F:0.32055
F ROUGE-1 Eval D0726-C.M.100.F-F.F R:0.38983 P:0.19558 F:0.26048
F ROUGE-1 Eval D0727-A.M.100.G-F.F R:0.49013 P:0.24346 F:0.32532
F ROUGE-1 Eval D0727-B.M.100.G-F.F R:0.37662 P:0.23293 F:0.28784
F ROUGE-1 Eval D0727-C.M.100.G-F.F R:0.41751 P:0.21088 F:0.28022
---------------------------------------------
F ROUGE-2 Average_R: 0.11798 (95%-conf.int. 0.09450 - 0.14307)
F ROUGE-2 Average_P: 0.06431 (95%-conf.int. 0.05139 - 0.07845)
F ROUGE-2 Average_F: 0.08318 (95%-conf.int. 0.06650 - 0.10100)
.............................................
F ROUGE-2 Eval D0711-A.M.100.C-F.F R:0.08696 P:0.04815 F:0.06198
F ROUGE-2 Eval D0711-B.M.100.C-F.F R:0.14384 P:0.08383 F:0.10593
F ROUGE-2 Eval D0711-C.M.100.C-F.F R:0.08191 P:0.04444 F:0.05762
F ROUGE-2 Eval D0716-A.M.100.D-F.F R:0.20333 P:0.11296 F:0.14523
F ROUGE-2 Eval D0716-B.M.100.D-F.F R:0.17845 P:0.09761 F:0.12619
F ROUGE-2 Eval D0716-C.M.100.D-F.F R:0.13805 P:0.07946 F:0.10086
F ROUGE-2 Eval D0726-A.M.100.F-F.F R:0.09732 P:0.05370 F:0.06921
F ROUGE-2 Eval D0726-B.M.100.F-F.F R:0.15101 P:0.07732 F:0.10227
F ROUGE-2 Eval D0726-C.M.100.F-F.F R:0.08904 P:0.04444 F:0.05929
F ROUGE-2 Eval D0727-A.M.100.G-F.F R:0.14618 P:0.07225 F:0.09670
F ROUGE-2 Eval D0727-B.M.100.G-F.F R:0.05902 P:0.03636 F:0.04500
F ROUGE-2 Eval D0727-C.M.100.G-F.F R:0.07483 P:0.03761 F:0.05006
---------------------------------------------
F ROUGE-3 Average_R: 0.04686 (95%-conf.int. 0.03559 - 0.05989)
F ROUGE-3 Average_P: 0.02564 (95%-conf.int. 0.01917 - 0.03314)
F ROUGE-3 Average_F: 0.03312 (95%-conf.int. 0.02479 - 0.04257)
.............................................
F ROUGE-3 Eval D0711-A.M.100.C-F.F R:0.04392 P:0.02421 F:0.03121
F ROUGE-3 Eval D0711-B.M.100.C-F.F R:0.06920 P:0.04016 F:0.05082
F ROUGE-3 Eval D0711-C.M.100.C-F.F R:0.02414 P:0.01304 F:0.01693
F ROUGE-3 Eval D0716-A.M.100.D-F.F R:0.09764 P:0.05400 F:0.06954
F ROUGE-3 Eval D0716-B.M.100.D-F.F R:0.06122 P:0.03333 F:0.04316
F ROUGE-3 Eval D0716-C.M.100.D-F.F R:0.05442 P:0.03119 F:0.03965
F ROUGE-3 Eval D0726-A.M.100.F-F.F R:0.04407 P:0.02421 F:0.03125
F ROUGE-3 Eval D0726-B.M.100.F-F.F R:0.04407 P:0.02245 F:0.02975
F ROUGE-3 Eval D0726-C.M.100.F-F.F R:0.01730 P:0.00859 F:0.01148
F ROUGE-3 Eval D0727-A.M.100.G-F.F R:0.05369 P:0.02640 F:0.03540
F ROUGE-3 Eval D0727-B.M.100.G-F.F R:0.02649 P:0.01626 F:0.02015
F ROUGE-3 Eval D0727-C.M.100.G-F.F R:0.02749 P:0.01375 F:0.01833
---------------------------------------------
F ROUGE-4 Average_R: 0.02016 (95%-conf.int. 0.01259 - 0.02909)
F ROUGE-4 Average_P: 0.01105 (95%-conf.int. 0.00674 - 0.01614)
F ROUGE-4 Average_F: 0.01427 (95%-conf.int. 0.00877 - 0.02077)
.............................................
F ROUGE-4 Eval D0711-A.M.100.C-F.F R:0.02048 P:0.01124 F:0.01451
F ROUGE-4 Eval D0711-B.M.100.C-F.F R:0.04545 P:0.02626 F:0.03329
F ROUGE-4 Eval D0711-C.M.100.C-F.F R:0.01045 P:0.00562 F:0.00731
F ROUGE-4 Eval D0716-A.M.100.D-F.F R:0.05102 P:0.02809 F:0.03623
F ROUGE-4 Eval D0716-B.M.100.D-F.F R:0.02405 P:0.01304 F:0.01691
F ROUGE-4 Eval D0716-C.M.100.D-F.F R:0.01718 P:0.00980 F:0.01248
F ROUGE-4 Eval D0726-A.M.100.F-F.F R:0.02397 P:0.01311 F:0.01695
F ROUGE-4 Eval D0726-B.M.100.F-F.F R:0.01027 P:0.00521 F:0.00691
F ROUGE-4 Eval D0726-C.M.100.F-F.F R:0.00000 P:0.00000 F:0.00000
F ROUGE-4 Eval D0727-A.M.100.G-F.F R:0.01695 P:0.00829 F:0.01113
F ROUGE-4 Eval D0727-B.M.100.G-F.F R:0.00334 P:0.00204 F:0.00253
F ROUGE-4 Eval D0727-C.M.100.G-F.F R:0.01389 P:0.00691 F:0.00923
---------------------------------------------
F ROUGE-L Average_R: 0.39610 (95%-conf.int. 0.37003 - 0.42070)
F ROUGE-L Average_P: 0.21705 (95%-conf.int. 0.20171 - 0.23266)
F ROUGE-L Average_F: 0.28018 (95%-conf.int. 0.26152 - 0.29966)
.............................................
F ROUGE-L Eval D0711-A.M.100.C-F.F R:0.39073 P:0.21731 F:0.27929
F ROUGE-L Eval D0711-B.M.100.C-F.F R:0.43051 P:0.25198 F:0.31789
F ROUGE-L Eval D0711-C.M.100.C-F.F R:0.34797 P:0.18969 F:0.24553
F ROUGE-L Eval D0716-A.M.100.D-F.F R:0.45545 P:0.25414 F:0.32624
F ROUGE-L Eval D0716-B.M.100.D-F.F R:0.46333 P:0.25458 F:0.32861
F ROUGE-L Eval D0716-C.M.100.D-F.F R:0.40667 P:0.23507 F:0.29793
F ROUGE-L Eval D0726-A.M.100.F-F.F R:0.33223 P:0.18416 F:0.23697
F ROUGE-L Eval D0726-B.M.100.F-F.F R:0.43189 P:0.22222 F:0.29345
F ROUGE-L Eval D0726-C.M.100.F-F.F R:0.34576 P:0.17347 F:0.23103
F ROUGE-L Eval D0727-A.M.100.G-F.F R:0.44079 P:0.21895 F:0.29257
F ROUGE-L Eval D0727-B.M.100.G-F.F R:0.33442 P:0.20683 F:0.25559
F ROUGE-L Eval D0727-C.M.100.G-F.F R:0.37710 P:0.19048 F:0.25311
---------------------------------------------
F ROUGE-W-1.2 Average_R: 0.13334 (95%-conf.int. 0.12484 - 0.14120)
F ROUGE-W-1.2 Average_P: 0.13435 (95%-conf.int. 0.12481 - 0.14440)
F ROUGE-W-1.2 Average_F: 0.13366 (95%-conf.int. 0.12524 - 0.14203)
.............................................
F ROUGE-W-1.2 Eval D0711-A.M.100.C-F.F R:0.13308 P:0.13427 F:0.13367
F ROUGE-W-1.2 Eval D0711-B.M.100.C-F.F R:0.15107 P:0.16422 F:0.15737
F ROUGE-W-1.2 Eval D0711-C.M.100.C-F.F R:0.11429 P:0.12008 F:0.11711
F ROUGE-W-1.2 Eval D0716-A.M.100.D-F.F R:0.15008 P:0.15926 F:0.15453
F ROUGE-W-1.2 Eval D0716-B.M.100.D-F.F R:0.14731 P:0.14326 F:0.14526
F ROUGE-W-1.2 Eval D0716-C.M.100.D-F.F R:0.12923 P:0.14531 F:0.13680
F ROUGE-W-1.2 Eval D0726-A.M.100.F-F.F R:0.11894 P:0.11743 F:0.11818
F ROUGE-W-1.2 Eval D0726-B.M.100.F-F.F R:0.14767 P:0.13804 F:0.14269
F ROUGE-W-1.2 Eval D0726-C.M.100.F-F.F R:0.11652 P:0.10468 F:0.11028
F ROUGE-W-1.2 Eval D0727-A.M.100.G-F.F R:0.14841 P:0.13456 F:0.14115
F ROUGE-W-1.2 Eval D0727-B.M.100.G-F.F R:0.11392 P:0.12657 F:0.11991
F ROUGE-W-1.2 Eval D0727-C.M.100.G-F.F R:0.12738 P:0.11891 F:0.12300
---------------------------------------------
F ROUGE-SU4 Average_R: 0.16305 (95%-conf.int. 0.14230 - 0.18442)
F ROUGE-SU4 Average_P: 0.08829 (95%-conf.int. 0.07667 - 0.10082)
F ROUGE-SU4 Average_F: 0.11445 (95%-conf.int. 0.09981 - 0.12998)
.............................................
F ROUGE-SU4 Eval D0711-A.M.100.C-F.F R:0.14966 P:0.08224 F:0.10615
F ROUGE-SU4 Eval D0711-B.M.100.C-F.F R:0.18293 P:0.10585 F:0.13410
F ROUGE-SU4 Eval D0711-C.M.100.C-F.F R:0.12674 P:0.06822 F:0.08870
F ROUGE-SU4 Eval D0716-A.M.100.D-F.F R:0.23164 P:0.12773 F:0.16466
F ROUGE-SU4 Eval D0716-B.M.100.D-F.F R:0.22260 P:0.12082 F:0.15663
F ROUGE-SU4 Eval D0716-C.M.100.D-F.F R:0.18208 P:0.10404 F:0.13242
F ROUGE-SU4 Eval D0726-A.M.100.F-F.F R:0.12059 P:0.06604 F:0.08534
F ROUGE-SU4 Eval D0726-B.M.100.F-F.F R:0.18544 P:0.09417 F:0.12491
F ROUGE-SU4 Eval D0726-C.M.100.F-F.F R:0.12718 P:0.06293 F:0.08420
F ROUGE-SU4 Eval D0727-A.M.100.G-F.F R:0.18806 P:0.09216 F:0.12370
F ROUGE-SU4 Eval D0727-B.M.100.G-F.F R:0.11778 P:0.07211 F:0.08945
F ROUGE-SU4 Eval D0727-C.M.100.G-F.F R:0.13725 P:0.06839 F:0.09129
---------------------------------------------
G ROUGE-1 Average_R: 0.42301 (95%-conf.int. 0.39639 - 0.45196)
G ROUGE-1 Average_P: 0.24699 (95%-conf.int. 0.22663 - 0.27084)
G ROUGE-1 Average_F: 0.31097 (95%-conf.int. 0.29031 - 0.33675)
.............................................
G ROUGE-1 Eval D0721-A.M.100.E-G.G R:0.42675 P:0.26908 F:0.33005
G ROUGE-1 Eval D0721-B.M.100.E-G.G R:0.42581 P:0.24044 F:0.30734
G ROUGE-1 Eval D0721-C.M.100.E-G.G R:0.43322 P:0.26389 F:0.32799
G ROUGE-1 Eval D0726-A.M.100.F-G.G R:0.37209 P:0.18391 F:0.24615
G ROUGE-1 Eval D0726-B.M.100.F-G.G R:0.40789 P:0.22836 F:0.29280
G ROUGE-1 Eval D0726-C.M.100.F-G.G R:0.39344 P:0.21505 F:0.27810
G ROUGE-1 Eval D0727-A.M.100.G-G.G R:0.48693 P:0.29389 F:0.36655
G ROUGE-1 Eval D0727-B.M.100.G-G.G R:0.43253 P:0.21259 F:0.28507
G ROUGE-1 Eval D0727-C.M.100.G-G.G R:0.38944 P:0.21974 F:0.28095
G ROUGE-1 Eval D0736-A.M.100.H-G.G R:0.44444 P:0.22711 F:0.30061
G ROUGE-1 Eval D0736-B.M.100.H-G.G R:0.53435 P:0.33333 F:0.41055
G ROUGE-1 Eval D0736-C.M.100.H-G.G R:0.32489 P:0.24919 F:0.28205
---------------------------------------------
G ROUGE-2 Average_R: 0.14022 (95%-conf.int. 0.10958 - 0.17979)
G ROUGE-2 Average_P: 0.08282 (95%-conf.int. 0.06264 - 0.10806)
G ROUGE-2 Average_F: 0.10385 (95%-conf.int. 0.07951 - 0.13467)
.............................................
G ROUGE-2 Eval D0721-A.M.100.E-G.G R:0.16720 P:0.10505 F:0.12903
G ROUGE-2 Eval D0721-B.M.100.E-G.G R:0.09772 P:0.05495 F:0.07034
G ROUGE-2 Eval D0721-C.M.100.E-G.G R:0.13487 P:0.08184 F:0.10187
G ROUGE-2 Eval D0726-A.M.100.F-G.G R:0.10403 P:0.05116 F:0.06859
G ROUGE-2 Eval D0726-B.M.100.F-G.G R:0.11628 P:0.06481 F:0.08323
G ROUGE-2 Eval D0726-C.M.100.F-G.G R:0.10596 P:0.05766 F:0.07468
G ROUGE-2 Eval D0727-A.M.100.G-G.G R:0.17492 P:0.10516 F:0.13135
G ROUGE-2 Eval D0727-B.M.100.G-G.G R:0.07692 P:0.03761 F:0.05052
G ROUGE-2 Eval D0727-C.M.100.G-G.G R:0.08333 P:0.04682 F:0.05995
G ROUGE-2 Eval D0736-A.M.100.H-G.G R:0.17391 P:0.08840 F:0.11722
G ROUGE-2 Eval D0736-B.M.100.H-G.G R:0.31660 P:0.19664 F:0.24260
G ROUGE-2 Eval D0736-C.M.100.H-G.G R:0.10684 P:0.08170 F:0.09259
---------------------------------------------
G ROUGE-3 Average_R: 0.07036 (95%-conf.int. 0.04183 - 0.10968)
G ROUGE-3 Average_P: 0.04183 (95%-conf.int. 0.02456 - 0.06672)
G ROUGE-3 Average_F: 0.05235 (95%-conf.int. 0.03111 - 0.08295)
.............................................
G ROUGE-3 Eval D0721-A.M.100.E-G.G R:0.10065 P:0.06301 F:0.07750
G ROUGE-3 Eval D0721-B.M.100.E-G.G R:0.03618 P:0.02026 F:0.02597
G ROUGE-3 Eval D0721-C.M.100.E-G.G R:0.05980 P:0.03614 F:0.04505
G ROUGE-3 Eval D0726-A.M.100.F-G.G R:0.04407 P:0.02156 F:0.02895
G ROUGE-3 Eval D0726-B.M.100.F-G.G R:0.03356 P:0.01862 F:0.02395
G ROUGE-3 Eval D0726-C.M.100.F-G.G R:0.02676 P:0.01449 F:0.01880
G ROUGE-3 Eval D0727-A.M.100.G-G.G R:0.08000 P:0.04790 F:0.05992
G ROUGE-3 Eval D0727-B.M.100.G-G.G R:0.02473 P:0.01203 F:0.01619
G ROUGE-3 Eval D0727-C.M.100.G-G.G R:0.02020 P:0.01130 F:0.01449
G ROUGE-3 Eval D0736-A.M.100.H-G.G R:0.09524 P:0.04815 F:0.06396
G ROUGE-3 Eval D0736-B.M.100.H-G.G R:0.25391 P:0.15700 F:0.19403
G ROUGE-3 Eval D0736-C.M.100.H-G.G R:0.03896 P:0.02970 F:0.03371
---------------------------------------------
G ROUGE-4 Average_R: 0.04425 (95%-conf.int. 0.02042 - 0.08013)
G ROUGE-4 Average_P: 0.02654 (95%-conf.int. 0.01237 - 0.04894)
G ROUGE-4 Average_F: 0.03311 (95%-conf.int. 0.01546 - 0.06076)
.............................................
G ROUGE-4 Eval D0721-A.M.100.E-G.G R:0.06885 P:0.04294 F:0.05289
G ROUGE-4 Eval D0721-B.M.100.E-G.G R:0.01661 P:0.00926 F:0.01189
G ROUGE-4 Eval D0721-C.M.100.E-G.G R:0.03356 P:0.02020 F:0.02522
G ROUGE-4 Eval D0726-A.M.100.F-G.G R:0.02740 P:0.01333 F:0.01793
G ROUGE-4 Eval D0726-B.M.100.F-G.G R:0.01356 P:0.00749 F:0.00965
G ROUGE-4 Eval D0726-C.M.100.F-G.G R:0.00676 P:0.00364 F:0.00473
G ROUGE-4 Eval D0727-A.M.100.G-G.G R:0.04040 P:0.02410 F:0.03019
G ROUGE-4 Eval D0727-B.M.100.G-G.G R:0.00000 P:0.00000 F:0.00000
G ROUGE-4 Eval D0727-C.M.100.G-G.G R:0.00680 P:0.00379 F:0.00487
G ROUGE-4 Eval D0736-A.M.100.H-G.G R:0.05556 P:0.02793 F:0.03717
G ROUGE-4 Eval D0736-B.M.100.H-G.G R:0.21344 P:0.13139 F:0.16265
G ROUGE-4 Eval D0736-C.M.100.H-G.G R:0.02193 P:0.01667 F:0.01894
---------------------------------------------
G ROUGE-L Average_R: 0.39030 (95%-conf.int. 0.35910 - 0.42354)
G ROUGE-L Average_P: 0.22774 (95%-conf.int. 0.20634 - 0.25305)
G ROUGE-L Average_F: 0.28683 (95%-conf.int. 0.26270 - 0.31564)
.............................................
G ROUGE-L Eval D0721-A.M.100.E-G.G R:0.40127 P:0.25301 F:0.31034
G ROUGE-L Eval D0721-B.M.100.E-G.G R:0.36774 P:0.20765 F:0.26542
G ROUGE-L Eval D0721-C.M.100.E-G.G R:0.40717 P:0.24802 F:0.30827
G ROUGE-L Eval D0726-A.M.100.F-G.G R:0.33887 P:0.16749 F:0.22418
G ROUGE-L Eval D0726-B.M.100.F-G.G R:0.36842 P:0.20626 F:0.26446
G ROUGE-L Eval D0726-C.M.100.F-G.G R:0.36721 P:0.20072 F:0.25956
G ROUGE-L Eval D0727-A.M.100.G-G.G R:0.45752 P:0.27613 F:0.34440
G ROUGE-L Eval D0727-B.M.100.G-G.G R:0.39446 P:0.19388 F:0.25998
G ROUGE-L Eval D0727-C.M.100.G-G.G R:0.35974 P:0.20298 F:0.25953
G ROUGE-L Eval D0736-A.M.100.H-G.G R:0.41935 P:0.21429 F:0.28364
G ROUGE-L Eval D0736-B.M.100.H-G.G R:0.52290 P:0.32619 F:0.40176
G ROUGE-L Eval D0736-C.M.100.H-G.G R:0.27426 P:0.21036 F:0.23810
---------------------------------------------
G ROUGE-W-1.2 Average_R: 0.13911 (95%-conf.int. 0.12686 - 0.15450)
G ROUGE-W-1.2 Average_P: 0.14799 (95%-conf.int. 0.13267 - 0.16782)
G ROUGE-W-1.2 Average_F: 0.14292 (95%-conf.int. 0.12956 - 0.15974)
.............................................
G ROUGE-W-1.2 Eval D0721-A.M.100.E-G.G R:0.14756 P:0.16304 F:0.15491
G ROUGE-W-1.2 Eval D0721-B.M.100.E-G.G R:0.11767 P:0.13261 F:0.12469
G ROUGE-W-1.2 Eval D0721-C.M.100.E-G.G R:0.13984 P:0.15929 F:0.14893
G ROUGE-W-1.2 Eval D0726-A.M.100.F-G.G R:0.12612 P:0.11283 F:0.11911
G ROUGE-W-1.2 Eval D0726-B.M.100.F-G.G R:0.12978 P:0.13119 F:0.13048
G ROUGE-W-1.2 Eval D0726-C.M.100.F-G.G R:0.12826 P:0.12552 F:0.12688
G ROUGE-W-1.2 Eval D0727-A.M.100.G-G.G R:0.15874 P:0.16968 F:0.16403
G ROUGE-W-1.2 Eval D0727-B.M.100.G-G.G R:0.13322 P:0.11728 F:0.12474
G ROUGE-W-1.2 Eval D0727-C.M.100.G-G.G R:0.11570 P:0.12017 F:0.11789
G ROUGE-W-1.2 Eval D0736-A.M.100.H-G.G R:0.15776 P:0.14276 F:0.14989
G ROUGE-W-1.2 Eval D0736-B.M.100.H-G.G R:0.20293 P:0.23432 F:0.21750
G ROUGE-W-1.2 Eval D0736-C.M.100.H-G.G R:0.10768 P:0.15004 F:0.12538
---------------------------------------------
G ROUGE-SU4 Average_R: 0.17358 (95%-conf.int. 0.15024 - 0.20613)
G ROUGE-SU4 Average_P: 0.10119 (95%-conf.int. 0.08482 - 0.12244)
G ROUGE-SU4 Average_F: 0.12747 (95%-conf.int. 0.10821 - 0.15284)
.............................................
G ROUGE-SU4 Eval D0721-A.M.100.E-G.G R:0.19336 P:0.12075 F:0.14866
G ROUGE-SU4 Eval D0721-B.M.100.E-G.G R:0.13962 P:0.07794 F:0.10004
G ROUGE-SU4 Eval D0721-C.M.100.E-G.G R:0.16611 P:0.10013 F:0.12494
G ROUGE-SU4 Eval D0726-A.M.100.F-G.G R:0.13481 P:0.06572 F:0.08836
G ROUGE-SU4 Eval D0726-B.M.100.F-G.G R:0.15146 P:0.08380 F:0.10790
G ROUGE-SU4 Eval D0726-C.M.100.F-G.G R:0.14478 P:0.07818 F:0.10153
G ROUGE-SU4 Eval D0727-A.M.100.G-G.G R:0.20302 P:0.12124 F:0.15182
G ROUGE-SU4 Eval D0727-B.M.100.G-G.G R:0.15184 P:0.07356 F:0.09911
G ROUGE-SU4 Eval D0727-C.M.100.G-G.G R:0.13107 P:0.07309 F:0.09385
G ROUGE-SU4 Eval D0736-A.M.100.H-G.G R:0.18881 P:0.09511 F:0.12650
G ROUGE-SU4 Eval D0736-B.M.100.H-G.G R:0.31890 P:0.19660 F:0.24324
G ROUGE-SU4 Eval D0736-C.M.100.H-G.G R:0.14192 P:0.10797 F:0.12264
---------------------------------------------
H ROUGE-1 Average_R: 0.42275 (95%-conf.int. 0.38923 - 0.46357)
H ROUGE-1 Average_P: 0.22947 (95%-conf.int. 0.20296 - 0.25579)
H ROUGE-1 Average_F: 0.29571 (95%-conf.int. 0.26700 - 0.32610)
.............................................
H ROUGE-1 Eval D0727-A.M.100.G-H.H R:0.48684 P:0.27106 F:0.34823
H ROUGE-1 Eval D0727-B.M.100.G-H.H R:0.37457 P:0.19854 F:0.25952
H ROUGE-1 Eval D0727-C.M.100.G-H.H R:0.38851 P:0.21905 F:0.28015
H ROUGE-1 Eval D0736-A.M.100.H-H.H R:0.39416 P:0.19251 F:0.25868
H ROUGE-1 Eval D0736-B.M.100.H-H.H R:0.59091 P:0.27875 F:0.37881
H ROUGE-1 Eval D0736-C.M.100.H-H.H R:0.41176 P:0.13029 F:0.19795
H ROUGE-1 Eval D0740-A.M.100.I-H.H R:0.35948 P:0.22634 F:0.27778
H ROUGE-1 Eval D0740-B.M.100.I-H.H R:0.42384 P:0.25859 F:0.32121
H ROUGE-1 Eval D0740-C.M.100.I-H.H R:0.46945 P:0.31602 F:0.37775
H ROUGE-1 Eval D0743-A.M.100.J-H.H R:0.38889 P:0.22703 F:0.28669
H ROUGE-1 Eval D0743-B.M.100.J-H.H R:0.41640 P:0.21154 F:0.28055
H ROUGE-1 Eval D0743-C.M.100.J-H.H R:0.32484 P:0.19318 F:0.24228
---------------------------------------------
H ROUGE-2 Average_R: 0.11829 (95%-conf.int. 0.08308 - 0.16683)
H ROUGE-2 Average_P: 0.06383 (95%-conf.int. 0.04430 - 0.08731)
H ROUGE-2 Average_F: 0.08242 (95%-conf.int. 0.05737 - 0.11452)
.............................................
H ROUGE-2 Eval D0727-A.M.100.G-H.H R:0.13289 P:0.07366 F:0.09478
H ROUGE-2 Eval D0727-B.M.100.G-H.H R:0.04167 P:0.02198 F:0.02878
H ROUGE-2 Eval D0727-C.M.100.G-H.H R:0.07167 P:0.04023 F:0.05153
H ROUGE-2 Eval D0736-A.M.100.H-H.H R:0.08856 P:0.04301 F:0.05790
H ROUGE-2 Eval D0736-B.M.100.H-H.H R:0.33891 P:0.15882 F:0.21628
H ROUGE-2 Eval D0736-C.M.100.H-H.H R:0.09239 P:0.02891 F:0.04404
H ROUGE-2 Eval D0740-A.M.100.I-H.H R:0.10891 P:0.06832 F:0.08397
H ROUGE-2 Eval D0740-B.M.100.I-H.H R:0.14716 P:0.08943 F:0.11125
H ROUGE-2 Eval D0740-C.M.100.I-H.H R:0.17208 P:0.11547 F:0.13820
H ROUGE-2 Eval D0743-A.M.100.J-H.H R:0.09969 P:0.05797 F:0.07331
H ROUGE-2 Eval D0743-B.M.100.J-H.H R:0.10510 P:0.05314 F:0.07059
H ROUGE-2 Eval D0743-C.M.100.J-H.H R:0.03537 P:0.02095 F:0.02631
---------------------------------------------
H ROUGE-3 Average_R: 0.05343 (95%-conf.int. 0.02692 - 0.09472)
H ROUGE-3 Average_P: 0.02822 (95%-conf.int. 0.01424 - 0.04863)
H ROUGE-3 Average_F: 0.03669 (95%-conf.int. 0.01864 - 0.06297)
.............................................
H ROUGE-3 Eval D0727-A.M.100.G-H.H R:0.04362 P:0.02407 F:0.03102
H ROUGE-3 Eval D0727-B.M.100.G-H.H R:0.01053 P:0.00552 F:0.00724
H ROUGE-3 Eval D0727-C.M.100.G-H.H R:0.01379 P:0.00771 F:0.00989
H ROUGE-3 Eval D0736-A.M.100.H-H.H R:0.03358 P:0.01622 F:0.02187
H ROUGE-3 Eval D0736-B.M.100.H-H.H R:0.25000 P:0.11637 F:0.15881
H ROUGE-3 Eval D0736-C.M.100.H-H.H R:0.03867 P:0.01197 F:0.01828
H ROUGE-3 Eval D0740-A.M.100.I-H.H R:0.03000 P:0.01875 F:0.02308
H ROUGE-3 Eval D0740-B.M.100.I-H.H R:0.07095 P:0.04294 F:0.05350
H ROUGE-3 Eval D0740-C.M.100.I-H.H R:0.09508 P:0.06360 F:0.07622
H ROUGE-3 Eval D0743-A.M.100.J-H.H R:0.04403 P:0.02550 F:0.03230
H ROUGE-3 Eval D0743-B.M.100.J-H.H R:0.03859 P:0.01942 F:0.02584
H ROUGE-3 Eval D0743-C.M.100.J-H.H R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
H ROUGE-4 Average_R: 0.02924 (95%-conf.int. 0.00966 - 0.06318)
H ROUGE-4 Average_P: 0.01517 (95%-conf.int. 0.00514 - 0.03104)
H ROUGE-4 Average_F: 0.01986 (95%-conf.int. 0.00672 - 0.04102)
.............................................
H ROUGE-4 Eval D0727-A.M.100.G-H.H R:0.02034 P:0.01117 F:0.01442
H ROUGE-4 Eval D0727-B.M.100.G-H.H R:0.00000 P:0.00000 F:0.00000
H ROUGE-4 Eval D0727-C.M.100.G-H.H R:0.00000 P:0.00000 F:0.00000
H ROUGE-4 Eval D0736-A.M.100.H-H.H R:0.01132 P:0.00543 F:0.00734
H ROUGE-4 Eval D0736-B.M.100.H-H.H R:0.19313 P:0.08929 F:0.12212
H ROUGE-4 Eval D0736-C.M.100.H-H.H R:0.01124 P:0.00344 F:0.00527
H ROUGE-4 Eval D0740-A.M.100.I-H.H R:0.00337 P:0.00210 F:0.00259
H ROUGE-4 Eval D0740-B.M.100.I-H.H R:0.03072 P:0.01852 F:0.02311
H ROUGE-4 Eval D0740-C.M.100.I-H.H R:0.05629 P:0.03753 F:0.04503
H ROUGE-4 Eval D0743-A.M.100.J-H.H R:0.02540 P:0.01465 F:0.01858
H ROUGE-4 Eval D0743-B.M.100.J-H.H R:0.01948 P:0.00976 F:0.01300
H ROUGE-4 Eval D0743-C.M.100.J-H.H R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
H ROUGE-L Average_R: 0.37628 (95%-conf.int. 0.34285 - 0.41886)
H ROUGE-L Average_P: 0.20412 (95%-conf.int. 0.18066 - 0.22940)
H ROUGE-L Average_F: 0.26316 (95%-conf.int. 0.23541 - 0.29394)
.............................................
H ROUGE-L Eval D0727-A.M.100.G-H.H R:0.42434 P:0.23626 F:0.30353
H ROUGE-L Eval D0727-B.M.100.G-H.H R:0.34021 P:0.18033 F:0.23572
H ROUGE-L Eval D0727-C.M.100.G-H.H R:0.34459 P:0.19429 F:0.24848
H ROUGE-L Eval D0736-A.M.100.H-H.H R:0.36131 P:0.17647 F:0.23712
H ROUGE-L Eval D0736-B.M.100.H-H.H R:0.56612 P:0.26706 F:0.36292
H ROUGE-L Eval D0736-C.M.100.H-H.H R:0.34225 P:0.10829 F:0.16452
H ROUGE-L Eval D0740-A.M.100.I-H.H R:0.29085 P:0.18313 F:0.22475
H ROUGE-L Eval D0740-B.M.100.I-H.H R:0.38411 P:0.23434 F:0.29109
H ROUGE-L Eval D0740-C.M.100.I-H.H R:0.41479 P:0.27922 F:0.33376
H ROUGE-L Eval D0743-A.M.100.J-H.H R:0.33333 P:0.19459 F:0.24573
H ROUGE-L Eval D0743-B.M.100.J-H.H R:0.38801 P:0.19712 F:0.26143
H ROUGE-L Eval D0743-C.M.100.J-H.H R:0.29299 P:0.17424 F:0.21852
---------------------------------------------
H ROUGE-W-1.2 Average_R: 0.13438 (95%-conf.int. 0.12176 - 0.15186)
H ROUGE-W-1.2 Average_P: 0.12957 (95%-conf.int. 0.11317 - 0.14841)
H ROUGE-W-1.2 Average_F: 0.13108 (95%-conf.int. 0.11748 - 0.14873)
.............................................
H ROUGE-W-1.2 Eval D0727-A.M.100.G-H.H R:0.14459 P:0.14431 F:0.14445
H ROUGE-W-1.2 Eval D0727-B.M.100.G-H.H R:0.11297 P:0.10599 F:0.10937
H ROUGE-W-1.2 Eval D0727-C.M.100.G-H.H R:0.11911 P:0.12087 F:0.11998
H ROUGE-W-1.2 Eval D0736-A.M.100.H-H.H R:0.13258 P:0.11388 F:0.12252
H ROUGE-W-1.2 Eval D0736-B.M.100.H-H.H R:0.21504 P:0.18767 F:0.20042
H ROUGE-W-1.2 Eval D0736-C.M.100.H-H.H R:0.12355 P:0.07306 F:0.09182
H ROUGE-W-1.2 Eval D0740-A.M.100.I-H.H R:0.10363 P:0.11771 F:0.11022
H ROUGE-W-1.2 Eval D0740-B.M.100.I-H.H R:0.14069 P:0.15275 F:0.14647
H ROUGE-W-1.2 Eval D0740-C.M.100.I-H.H R:0.14350 P:0.18029 F:0.15980
H ROUGE-W-1.2 Eval D0743-A.M.100.J-H.H R:0.12285 P:0.12389 F:0.12337
H ROUGE-W-1.2 Eval D0743-B.M.100.J-H.H R:0.14553 P:0.12261 F:0.13309
H ROUGE-W-1.2 Eval D0743-C.M.100.J-H.H R:0.10614 P:0.10541 F:0.10577
---------------------------------------------
H ROUGE-SU4 Average_R: 0.15598 (95%-conf.int. 0.12804 - 0.19522)
H ROUGE-SU4 Average_P: 0.08323 (95%-conf.int. 0.06756 - 0.10310)
H ROUGE-SU4 Average_F: 0.10783 (95%-conf.int. 0.08806 - 0.13371)
.............................................
H ROUGE-SU4 Eval D0727-A.M.100.G-H.H R:0.17905 P:0.09851 F:0.12709
H ROUGE-SU4 Eval D0727-B.M.100.G-H.H R:0.11013 P:0.05761 F:0.07565
H ROUGE-SU4 Eval D0727-C.M.100.G-H.H R:0.12616 P:0.07028 F:0.09027
H ROUGE-SU4 Eval D0736-A.M.100.H-H.H R:0.12469 P:0.05998 F:0.08100
H ROUGE-SU4 Eval D0736-B.M.100.H-H.H R:0.33048 P:0.15314 F:0.20930
H ROUGE-SU4 Eval D0736-C.M.100.H-H.H R:0.15363 P:0.04717 F:0.07218
H ROUGE-SU4 Eval D0740-A.M.100.I-H.H R:0.12416 P:0.07741 F:0.09536
H ROUGE-SU4 Eval D0740-B.M.100.I-H.H R:0.15193 P:0.09172 F:0.11439
H ROUGE-SU4 Eval D0740-C.M.100.I-H.H R:0.21177 P:0.14134 F:0.16953
H ROUGE-SU4 Eval D0743-A.M.100.J-H.H R:0.12922 P:0.07465 F:0.09463
H ROUGE-SU4 Eval D0743-B.M.100.J-H.H R:0.13646 P:0.06845 F:0.09117
H ROUGE-SU4 Eval D0743-C.M.100.J-H.H R:0.08987 P:0.05288 F:0.06658
---------------------------------------------
I ROUGE-1 Average_R: 0.42481 (95%-conf.int. 0.38761 - 0.46273)
I ROUGE-1 Average_P: 0.20214 (95%-conf.int. 0.17621 - 0.22614)
I ROUGE-1 Average_F: 0.27288 (95%-conf.int. 0.24103 - 0.30281)
.............................................
I ROUGE-1 Eval D0706-A.M.100.B-I.I R:0.43182 P:0.22852 F:0.29887
I ROUGE-1 Eval D0706-B.M.100.B-I.I R:0.33010 P:0.15814 F:0.21384
I ROUGE-1 Eval D0706-C.M.100.B-I.I R:0.52077 P:0.25154 F:0.33923
I ROUGE-1 Eval D0736-A.M.100.H-I.I R:0.46619 P:0.22862 F:0.30679
I ROUGE-1 Eval D0736-B.M.100.H-I.I R:0.56904 P:0.26054 F:0.35743
I ROUGE-1 Eval D0736-C.M.100.H-I.I R:0.41711 P:0.13978 F:0.20939
I ROUGE-1 Eval D0740-A.M.100.I-I.I R:0.38636 P:0.21795 F:0.27869
I ROUGE-1 Eval D0740-B.M.100.I-I.I R:0.37049 P:0.17358 F:0.23640
I ROUGE-1 Eval D0740-C.M.100.I-I.I R:0.46006 P:0.25946 F:0.33180
I ROUGE-1 Eval D0743-A.M.100.J-I.I R:0.42812 P:0.19599 F:0.26889
I ROUGE-1 Eval D0743-B.M.100.J-I.I R:0.39557 P:0.17218 F:0.23993
I ROUGE-1 Eval D0743-C.M.100.J-I.I R:0.34824 P:0.13164 F:0.19106
---------------------------------------------
I ROUGE-2 Average_R: 0.12829 (95%-conf.int. 0.10049 - 0.16069)
I ROUGE-2 Average_P: 0.06090 (95%-conf.int. 0.04634 - 0.07718)
I ROUGE-2 Average_F: 0.08230 (95%-conf.int. 0.06317 - 0.10414)
.............................................
I ROUGE-2 Eval D0706-A.M.100.B-I.I R:0.14098 P:0.07427 F:0.09729
I ROUGE-2 Eval D0706-B.M.100.B-I.I R:0.09150 P:0.04361 F:0.05907
I ROUGE-2 Eval D0706-C.M.100.B-I.I R:0.17419 P:0.08372 F:0.11309
I ROUGE-2 Eval D0736-A.M.100.H-I.I R:0.17626 P:0.08596 F:0.11556
I ROUGE-2 Eval D0736-B.M.100.H-I.I R:0.27119 P:0.12331 F:0.16953
I ROUGE-2 Eval D0736-C.M.100.H-I.I R:0.13587 P:0.04505 F:0.06766
I ROUGE-2 Eval D0740-A.M.100.I-I.I R:0.07869 P:0.04420 F:0.05661
I ROUGE-2 Eval D0740-B.M.100.I-I.I R:0.09934 P:0.04630 F:0.06316
I ROUGE-2 Eval D0740-C.M.100.I-I.I R:0.13871 P:0.07790 F:0.09977
I ROUGE-2 Eval D0743-A.M.100.J-I.I R:0.09779 P:0.04454 F:0.06120
I ROUGE-2 Eval D0743-B.M.100.J-I.I R:0.08626 P:0.03734 F:0.05212
I ROUGE-2 Eval D0743-C.M.100.J-I.I R:0.05484 P:0.02061 F:0.02996
---------------------------------------------
I ROUGE-3 Average_R: 0.05974 (95%-conf.int. 0.03772 - 0.08772)
I ROUGE-3 Average_P: 0.02797 (95%-conf.int. 0.01781 - 0.04099)
I ROUGE-3 Average_F: 0.03798 (95%-conf.int. 0.02438 - 0.05569)
.............................................
I ROUGE-3 Eval D0706-A.M.100.B-I.I R:0.04967 P:0.02604 F:0.03417
I ROUGE-3 Eval D0706-B.M.100.B-I.I R:0.03300 P:0.01565 F:0.02123
I ROUGE-3 Eval D0706-C.M.100.B-I.I R:0.08469 P:0.04050 F:0.05480
I ROUGE-3 Eval D0736-A.M.100.H-I.I R:0.09818 P:0.04762 F:0.06413
I ROUGE-3 Eval D0736-B.M.100.H-I.I R:0.19313 P:0.08721 F:0.12016
I ROUGE-3 Eval D0736-C.M.100.H-I.I R:0.06630 P:0.02174 F:0.03274
I ROUGE-3 Eval D0740-A.M.100.I-I.I R:0.01656 P:0.00926 F:0.01188
I ROUGE-3 Eval D0740-B.M.100.I-I.I R:0.05017 P:0.02326 F:0.03178
I ROUGE-3 Eval D0740-C.M.100.I-I.I R:0.06515 P:0.03643 F:0.04673
I ROUGE-3 Eval D0743-A.M.100.J-I.I R:0.03503 P:0.01587 F:0.02184
I ROUGE-3 Eval D0743-B.M.100.J-I.I R:0.03871 P:0.01667 F:0.02330
I ROUGE-3 Eval D0743-C.M.100.J-I.I R:0.00977 P:0.00365 F:0.00531
---------------------------------------------
I ROUGE-4 Average_R: 0.03388 (95%-conf.int. 0.01830 - 0.05508)
I ROUGE-4 Average_P: 0.01570 (95%-conf.int. 0.00860 - 0.02507)
I ROUGE-4 Average_F: 0.02138 (95%-conf.int. 0.01162 - 0.03425)
.............................................
I ROUGE-4 Eval D0706-A.M.100.B-I.I R:0.03010 P:0.01571 F:0.02064
I ROUGE-4 Eval D0706-B.M.100.B-I.I R:0.00667 P:0.00314 F:0.00427
I ROUGE-4 Eval D0706-C.M.100.B-I.I R:0.04605 P:0.02191 F:0.02969
I ROUGE-4 Eval D0736-A.M.100.H-I.I R:0.05515 P:0.02660 F:0.03589
I ROUGE-4 Eval D0736-B.M.100.H-I.I R:0.13913 P:0.06238 F:0.08614
I ROUGE-4 Eval D0736-C.M.100.H-I.I R:0.03933 P:0.01275 F:0.01926
I ROUGE-4 Eval D0740-A.M.100.I-I.I R:0.00334 P:0.00186 F:0.00239
I ROUGE-4 Eval D0740-B.M.100.I-I.I R:0.03041 P:0.01402 F:0.01919
I ROUGE-4 Eval D0740-C.M.100.I-I.I R:0.03289 P:0.01832 F:0.02353
I ROUGE-4 Eval D0743-A.M.100.J-I.I R:0.01608 P:0.00725 F:0.00999
I ROUGE-4 Eval D0743-B.M.100.J-I.I R:0.02280 P:0.00976 F:0.01367
I ROUGE-4 Eval D0743-C.M.100.J-I.I R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
I ROUGE-L Average_R: 0.38029 (95%-conf.int. 0.34425 - 0.41975)
I ROUGE-L Average_P: 0.18099 (95%-conf.int. 0.15693 - 0.20486)
I ROUGE-L Average_F: 0.24432 (95%-conf.int. 0.21534 - 0.27355)
.............................................
I ROUGE-L Eval D0706-A.M.100.B-I.I R:0.38636 P:0.20447 F:0.26742
I ROUGE-L Eval D0706-B.M.100.B-I.I R:0.29773 P:0.14264 F:0.19288
I ROUGE-L Eval D0706-C.M.100.B-I.I R:0.43450 P:0.20988 F:0.28304
I ROUGE-L Eval D0736-A.M.100.H-I.I R:0.44484 P:0.21815 F:0.29274
I ROUGE-L Eval D0736-B.M.100.H-I.I R:0.54393 P:0.24904 F:0.34165
I ROUGE-L Eval D0736-C.M.100.H-I.I R:0.36898 P:0.12366 F:0.18524
I ROUGE-L Eval D0740-A.M.100.I-I.I R:0.33442 P:0.18864 F:0.24122
I ROUGE-L Eval D0740-B.M.100.I-I.I R:0.33115 P:0.15515 F:0.21130
I ROUGE-L Eval D0740-C.M.100.I-I.I R:0.41853 P:0.23604 F:0.30185
I ROUGE-L Eval D0743-A.M.100.J-I.I R:0.35313 P:0.16166 F:0.22179
I ROUGE-L Eval D0743-B.M.100.J-I.I R:0.37025 P:0.16116 F:0.22457
I ROUGE-L Eval D0743-C.M.100.J-I.I R:0.30351 P:0.11473 F:0.16652
---------------------------------------------
I ROUGE-W-1.2 Average_R: 0.13375 (95%-conf.int. 0.11955 - 0.14957)
I ROUGE-W-1.2 Average_P: 0.11536 (95%-conf.int. 0.09941 - 0.13150)
I ROUGE-W-1.2 Average_F: 0.12314 (95%-conf.int. 0.10847 - 0.13848)
.............................................
I ROUGE-W-1.2 Eval D0706-A.M.100.B-I.I R:0.13527 P:0.13265 F:0.13395
I ROUGE-W-1.2 Eval D0706-B.M.100.B-I.I R:0.09810 P:0.08499 F:0.09108
I ROUGE-W-1.2 Eval D0706-C.M.100.B-I.I R:0.15767 P:0.13227 F:0.14386
I ROUGE-W-1.2 Eval D0736-A.M.100.H-I.I R:0.16150 P:0.14151 F:0.15085
I ROUGE-W-1.2 Eval D0736-B.M.100.H-I.I R:0.19713 P:0.16670 F:0.18064
I ROUGE-W-1.2 Eval D0736-C.M.100.H-I.I R:0.14384 P:0.08794 F:0.10915
I ROUGE-W-1.2 Eval D0740-A.M.100.I-I.I R:0.10926 P:0.11400 F:0.11158
I ROUGE-W-1.2 Eval D0740-B.M.100.I-I.I R:0.11376 P:0.10015 F:0.10652
I ROUGE-W-1.2 Eval D0740-C.M.100.I-I.I R:0.13547 P:0.14942 F:0.14210
I ROUGE-W-1.2 Eval D0743-A.M.100.J-I.I R:0.12359 P:0.10040 F:0.11079
I ROUGE-W-1.2 Eval D0743-B.M.100.J-I.I R:0.13406 P:0.09833 F:0.11345
I ROUGE-W-1.2 Eval D0743-C.M.100.J-I.I R:0.10622 P:0.07155 F:0.08550
---------------------------------------------
I ROUGE-SU4 Average_R: 0.16035 (95%-conf.int. 0.13378 - 0.18953)
I ROUGE-SU4 Average_P: 0.07513 (95%-conf.int. 0.06064 - 0.09020)
I ROUGE-SU4 Average_F: 0.10190 (95%-conf.int. 0.08268 - 0.12204)
.............................................
I ROUGE-SU4 Eval D0706-A.M.100.B-I.I R:0.16056 P:0.08391 F:0.11022
I ROUGE-SU4 Eval D0706-B.M.100.B-I.I R:0.10631 P:0.05024 F:0.06823
I ROUGE-SU4 Eval D0706-C.M.100.B-I.I R:0.20219 P:0.09635 F:0.13051
I ROUGE-SU4 Eval D0736-A.M.100.H-I.I R:0.20085 P:0.09705 F:0.13087
I ROUGE-SU4 Eval D0736-B.M.100.H-I.I R:0.28211 P:0.12678 F:0.17494
I ROUGE-SU4 Eval D0736-C.M.100.H-I.I R:0.18808 P:0.06121 F:0.09236
I ROUGE-SU4 Eval D0740-A.M.100.I-I.I R:0.12389 P:0.06908 F:0.08870
I ROUGE-SU4 Eval D0740-B.M.100.I-I.I R:0.12065 P:0.05573 F:0.07624
I ROUGE-SU4 Eval D0740-C.M.100.I-I.I R:0.19399 P:0.10817 F:0.13889
I ROUGE-SU4 Eval D0743-A.M.100.J-I.I R:0.14797 P:0.06681 F:0.09206
I ROUGE-SU4 Eval D0743-B.M.100.J-I.I R:0.12121 P:0.05200 F:0.07278
I ROUGE-SU4 Eval D0743-C.M.100.J-I.I R:0.09836 P:0.03659 F:0.05334
---------------------------------------------
J ROUGE-1 Average_R: 0.37166 (95%-conf.int. 0.32505 - 0.40792)
J ROUGE-1 Average_P: 0.25700 (95%-conf.int. 0.22849 - 0.28941)
J ROUGE-1 Average_F: 0.29945 (95%-conf.int. 0.26979 - 0.33295)
.............................................
J ROUGE-1 Eval D0703-A.M.100.A-J.J R:0.35034 P:0.23356 F:0.28027
J ROUGE-1 Eval D0703-B.M.100.A-J.J R:0.43522 P:0.25686 F:0.32306
J ROUGE-1 Eval D0703-C.M.100.A-J.J R:0.44371 P:0.29778 F:0.35639
J ROUGE-1 Eval D0736-A.M.100.H-J.J R:0.36928 P:0.26157 F:0.30623
J ROUGE-1 Eval D0736-B.M.100.H-J.J R:0.45105 P:0.40952 F:0.42928
J ROUGE-1 Eval D0736-C.M.100.H-J.J R:0.16604 P:0.27673 F:0.20755
J ROUGE-1 Eval D0740-A.M.100.I-J.J R:0.42581 P:0.26036 F:0.32314
J ROUGE-1 Eval D0740-B.M.100.I-J.J R:0.37864 P:0.24684 F:0.29885
J ROUGE-1 Eval D0740-C.M.100.I-J.J R:0.42994 P:0.27778 F:0.33750
J ROUGE-1 Eval D0743-A.M.100.J-J.J R:0.38462 P:0.22645 F:0.28506
J ROUGE-1 Eval D0743-B.M.100.J-J.J R:0.34268 P:0.18998 F:0.24444
J ROUGE-1 Eval D0743-C.M.100.J-J.J R:0.29245 P:0.18023 F:0.22302
---------------------------------------------
J ROUGE-2 Average_R: 0.10526 (95%-conf.int. 0.07618 - 0.14013)
J ROUGE-2 Average_P: 0.07413 (95%-conf.int. 0.05233 - 0.10610)
J ROUGE-2 Average_F: 0.08585 (95%-conf.int. 0.06149 - 0.11902)
.............................................
J ROUGE-2 Eval D0703-A.M.100.A-J.J R:0.06873 P:0.04566 F:0.05487
J ROUGE-2 Eval D0703-B.M.100.A-J.J R:0.15436 P:0.09073 F:0.11429
J ROUGE-2 Eval D0703-C.M.100.A-J.J R:0.09365 P:0.06264 F:0.07507
J ROUGE-2 Eval D0736-A.M.100.H-J.J R:0.10891 P:0.07692 F:0.09016
J ROUGE-2 Eval D0736-B.M.100.H-J.J R:0.24382 P:0.22115 F:0.23193
J ROUGE-2 Eval D0736-C.M.100.H-J.J R:0.03435 P:0.05769 F:0.04306
J ROUGE-2 Eval D0740-A.M.100.I-J.J R:0.15309 P:0.09325 F:0.11590
J ROUGE-2 Eval D0740-B.M.100.I-J.J R:0.11765 P:0.07643 F:0.09266
J ROUGE-2 Eval D0740-C.M.100.I-J.J R:0.13826 P:0.08903 F:0.10831
J ROUGE-2 Eval D0743-A.M.100.J-J.J R:0.08385 P:0.04918 F:0.06200
J ROUGE-2 Eval D0743-B.M.100.J-J.J R:0.03459 P:0.01910 F:0.02461
J ROUGE-2 Eval D0743-C.M.100.J-J.J R:0.06349 P:0.03899 F:0.04831
---------------------------------------------
J ROUGE-3 Average_R: 0.04467 (95%-conf.int. 0.02388 - 0.07293)
J ROUGE-3 Average_P: 0.03155 (95%-conf.int. 0.01535 - 0.05736)
J ROUGE-3 Average_F: 0.03670 (95%-conf.int. 0.01867 - 0.06322)
.............................................
J ROUGE-3 Eval D0703-A.M.100.A-J.J R:0.00694 P:0.00460 F:0.00553
J ROUGE-3 Eval D0703-B.M.100.A-J.J R:0.06780 P:0.03968 F:0.05006
J ROUGE-3 Eval D0703-C.M.100.A-J.J R:0.03716 P:0.02477 F:0.02973
J ROUGE-3 Eval D0736-A.M.100.H-J.J R:0.05000 P:0.03521 F:0.04132
J ROUGE-3 Eval D0736-B.M.100.H-J.J R:0.16786 P:0.15210 F:0.15959
J ROUGE-3 Eval D0736-C.M.100.H-J.J R:0.00000 P:0.00000 F:0.00000
J ROUGE-3 Eval D0740-A.M.100.I-J.J R:0.07237 P:0.04391 F:0.05466
J ROUGE-3 Eval D0740-B.M.100.I-J.J R:0.05941 P:0.03846 F:0.04669
J ROUGE-3 Eval D0740-C.M.100.I-J.J R:0.06169 P:0.03958 F:0.04822
J ROUGE-3 Eval D0743-A.M.100.J-J.J R:0.03762 P:0.02198 F:0.02775
J ROUGE-3 Eval D0743-B.M.100.J-J.J R:0.00000 P:0.00000 F:0.00000
J ROUGE-3 Eval D0743-C.M.100.J-J.J R:0.01282 P:0.00784 F:0.00973
---------------------------------------------
J ROUGE-4 Average_R: 0.02328 (95%-conf.int. 0.01036 - 0.04217)
J ROUGE-4 Average_P: 0.01690 (95%-conf.int. 0.00657 - 0.03405)
J ROUGE-4 Average_F: 0.01942 (95%-conf.int. 0.00805 - 0.03737)
.............................................
J ROUGE-4 Eval D0703-A.M.100.A-J.J R:0.00351 P:0.00231 F:0.00279
J ROUGE-4 Eval D0703-B.M.100.A-J.J R:0.02740 P:0.01597 F:0.02018
J ROUGE-4 Eval D0703-C.M.100.A-J.J R:0.02048 P:0.01361 F:0.01635
J ROUGE-4 Eval D0736-A.M.100.H-J.J R:0.02020 P:0.01418 F:0.01666
J ROUGE-4 Eval D0736-B.M.100.H-J.J R:0.11191 P:0.10131 F:0.10635
J ROUGE-4 Eval D0736-C.M.100.H-J.J R:0.00000 P:0.00000 F:0.00000
J ROUGE-4 Eval D0740-A.M.100.I-J.J R:0.04319 P:0.02610 F:0.03254
J ROUGE-4 Eval D0740-B.M.100.I-J.J R:0.03000 P:0.01935 F:0.02353
J ROUGE-4 Eval D0740-C.M.100.I-J.J R:0.02623 P:0.01677 F:0.02046
J ROUGE-4 Eval D0743-A.M.100.J-J.J R:0.01899 P:0.01105 F:0.01397
J ROUGE-4 Eval D0743-B.M.100.J-J.J R:0.00000 P:0.00000 F:0.00000
J ROUGE-4 Eval D0743-C.M.100.J-J.J R:0.00000 P:0.00000 F:0.00000
---------------------------------------------
J ROUGE-L Average_R: 0.33258 (95%-conf.int. 0.28709 - 0.36776)
J ROUGE-L Average_P: 0.22939 (95%-conf.int. 0.20343 - 0.26202)
J ROUGE-L Average_F: 0.26784 (95%-conf.int. 0.23820 - 0.30250)
.............................................
J ROUGE-L Eval D0703-A.M.100.A-J.J R:0.32993 P:0.21995 F:0.26394
J ROUGE-L Eval D0703-B.M.100.A-J.J R:0.38206 P:0.22549 F:0.28360
J ROUGE-L Eval D0703-C.M.100.A-J.J R:0.37748 P:0.25333 F:0.30319
J ROUGE-L Eval D0736-A.M.100.H-J.J R:0.34641 P:0.24537 F:0.28726
J ROUGE-L Eval D0736-B.M.100.H-J.J R:0.43007 P:0.39048 F:0.40932
J ROUGE-L Eval D0736-C.M.100.H-J.J R:0.13208 P:0.22013 F:0.16510
J ROUGE-L Eval D0740-A.M.100.I-J.J R:0.38387 P:0.23471 F:0.29131
J ROUGE-L Eval D0740-B.M.100.I-J.J R:0.33010 P:0.21519 F:0.26054
J ROUGE-L Eval D0740-C.M.100.I-J.J R:0.37580 P:0.24280 F:0.29500
J ROUGE-L Eval D0743-A.M.100.J-J.J R:0.33231 P:0.19565 F:0.24629
J ROUGE-L Eval D0743-B.M.100.J-J.J R:0.30841 P:0.17098 F:0.22000
J ROUGE-L Eval D0743-C.M.100.J-J.J R:0.25786 P:0.15891 F:0.19664
---------------------------------------------
J ROUGE-W-1.2 Average_R: 0.11916 (95%-conf.int. 0.10389 - 0.13120)
J ROUGE-W-1.2 Average_P: 0.14780 (95%-conf.int. 0.12909 - 0.17267)
J ROUGE-W-1.2 Average_F: 0.12992 (95%-conf.int. 0.11557 - 0.14640)
.............................................
J ROUGE-W-1.2 Eval D0703-A.M.100.A-J.J R:0.11634 P:0.13267 F:0.12397
J ROUGE-W-1.2 Eval D0703-B.M.100.A-J.J R:0.13618 P:0.14907 F:0.14233
J ROUGE-W-1.2 Eval D0703-C.M.100.A-J.J R:0.12693 P:0.15342 F:0.13892
J ROUGE-W-1.2 Eval D0736-A.M.100.H-J.J R:0.12693 P:0.16029 F:0.14167
J ROUGE-W-1.2 Eval D0736-B.M.100.H-J.J R:0.15990 P:0.26838 F:0.20040
J ROUGE-W-1.2 Eval D0736-C.M.100.H-J.J R:0.05401 P:0.16059 F:0.08083
J ROUGE-W-1.2 Eval D0740-A.M.100.I-J.J R:0.14372 P:0.16143 F:0.15206
J ROUGE-W-1.2 Eval D0740-B.M.100.I-J.J R:0.11830 P:0.13788 F:0.12734
J ROUGE-W-1.2 Eval D0740-C.M.100.I-J.J R:0.11646 P:0.14419 F:0.12885
J ROUGE-W-1.2 Eval D0743-A.M.100.J-J.J R:0.11948 P:0.12212 F:0.12079
J ROUGE-W-1.2 Eval D0743-B.M.100.J-J.J R:0.11357 P:0.10352 F:0.10831
J ROUGE-W-1.2 Eval D0743-C.M.100.J-J.J R:0.09843 P:0.10211 F:0.10024
---------------------------------------------
J ROUGE-SU4 Average_R: 0.13489 (95%-conf.int. 0.11141 - 0.16000)
J ROUGE-SU4 Average_P: 0.09377 (95%-conf.int. 0.07625 - 0.11603)
J ROUGE-SU4 Average_F: 0.10890 (95%-conf.int. 0.09040 - 0.13177)
.............................................
J ROUGE-SU4 Eval D0703-A.M.100.A-J.J R:0.10781 P:0.07121 F:0.08577
J ROUGE-SU4 Eval D0703-B.M.100.A-J.J R:0.17804 P:0.10392 F:0.13124
J ROUGE-SU4 Eval D0703-C.M.100.A-J.J R:0.16327 P:0.10860 F:0.13044
J ROUGE-SU4 Eval D0736-A.M.100.H-J.J R:0.13367 P:0.09395 F:0.11034
J ROUGE-SU4 Eval D0736-B.M.100.H-J.J R:0.21823 P:0.19761 F:0.20741
J ROUGE-SU4 Eval D0736-C.M.100.H-J.J R:0.05901 P:0.10044 F:0.07434
J ROUGE-SU4 Eval D0740-A.M.100.I-J.J R:0.17163 P:0.10387 F:0.12942
J ROUGE-SU4 Eval D0740-B.M.100.I-J.J R:0.12957 P:0.08369 F:0.10169
J ROUGE-SU4 Eval D0740-C.M.100.I-J.J R:0.16830 P:0.10774 F:0.13138
J ROUGE-SU4 Eval D0743-A.M.100.J-J.J R:0.13091 P:0.07629 F:0.09640
J ROUGE-SU4 Eval D0743-B.M.100.J-J.J R:0.09159 P:0.05020 F:0.06485
J ROUGE-SU4 Eval D0743-C.M.100.J-J.J R:0.08763 P:0.05348 F:0.06642