File size: 1,067 Bytes
4053425 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
====== Perplexity statistics ======
Mean PPL(Q) : 6.727317 ± 0.041420
Mean PPL(base) : 6.554978 ± 0.040159
Cor(ln(PPL(Q)), ln(PPL(base))): 99.40%
Mean ln(PPL(Q)/PPL(base)) : 0.025952 ± 0.000673
Mean PPL(Q)/PPL(base) : 1.026291 ± 0.000690
Mean PPL(Q)-PPL(base) : 0.172339 ± 0.004636
====== KL divergence statistics ======
Mean KLD: 0.027914 ± 0.000205
Maximum KLD: 4.537546
99.9% KLD: 0.976142
99.0% KLD: 0.269461
99.0% KLD: 0.269461
Median KLD: 0.013357
10.0% KLD: 0.000647
5.0% KLD: 0.000181
1.0% KLD: 0.000024
Minimum KLD: -0.000027
====== Token probability statistics ======
Mean Δp: -0.560 ± 0.013 %
Maximum Δp: 93.996%
99.9% Δp: 24.784%
99.0% Δp: 11.162%
95.0% Δp: 5.084%
90.0% Δp: 2.924%
75.0% Δp: 0.553%
Median Δp: -0.024%
25.0% Δp: -1.216%
10.0% Δp: -4.225%
5.0% Δp: -7.063%
1.0% Δp: -18.017%
0.1% Δp: -50.417%
Minimum Δp: -97.194%
RMS Δp : 5.026 ± 0.046 %
Same top p: 92.222 ± 0.071 %
|