TGI (text generation inference) compatibility seems to have broken
#1
by
Pyroserenus
- opened
I am able to load old models with actorder=false in TGI, but not able to load models with actorder=true.
Tested in TGI docker 1.0.2 and 1.0.3