File size: 1,066 Bytes
4cdcdde |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
====== Perplexity statistics ======
Mean PPL(Q) : 10.130249 ± 0.073552
Mean PPL(base) : 10.036835 ± 0.072696
Cor(ln(PPL(Q)), ln(PPL(base))): 99.79%
Mean ln(PPL(Q)/PPL(base)) : 0.009264 ± 0.000475
Mean PPL(Q)/PPL(base) : 1.009307 ± 0.000479
Mean PPL(Q)-PPL(base) : 0.093414 ± 0.004859
====== KL divergence statistics ======
Mean KLD: 0.012012 ± 0.000059
Maximum KLD: 2.987801
99.9% KLD: 0.227534
99.0% KLD: 0.085719
99.0% KLD: 0.085719
Median KLD: 0.007136
10.0% KLD: 0.000206
5.0% KLD: 0.000040
1.0% KLD: 0.000002
Minimum KLD: -0.000146
====== Token probability statistics ======
Mean Δp: -0.144 ± 0.007 %
Maximum Δp: 88.099%
99.9% Δp: 17.014%
99.0% Δp: 8.223%
95.0% Δp: 3.729%
90.0% Δp: 2.080%
75.0% Δp: 0.351%
Median Δp: -0.002%
25.0% Δp: -0.591%
10.0% Δp: -2.522%
5.0% Δp: -4.245%
1.0% Δp: -9.152%
0.1% Δp: -21.093%
Minimum Δp: -54.638%
RMS Δp : 2.845 ± 0.021 %
Same top p: 94.427 ± 0.059 %
|