Skyfall-Tokenizer / README.md
FrenzyBiscuit's picture
Update README.md
3c7cf3c verified

What is this?

This is a working tokenizer_config.json for Skyfall.

Currently if you are using chat completition with Skyfall it will error out. Text completion works, though. This tokenizer fixes it.

Simply replace the existing tokenizer_config.json in your Skyfall directory.

I am not replacing it on every model, because I want you to have the option of keeping the original.

Credit goes to Toasty Pigeon on discord.