What is this?
This is a working tokenizer_config.json for Skyfall.
Currently if you are using chat completition with Skyfall it will error out. Text completion works, though. This tokenizer fixes it.
Simply replace the existing tokenizer_config.json in your Skyfall directory.
I am not replacing it on every model, because I want you to have the option of keeping the original.
Credit goes to Toasty Pigeon on discord.