This is [ToastyPigeon/Qwen2.5-14B-Instruct-1M-Unalign](https://huggingface.co/ToastyPigeon/Qwen2.5-14B-Instruct-1M-Unalign) trained on a mix of [ToastyPigeon/gutenberg-sft](https://huggingface.co/datasets/ToastyPigeon/gutenberg-sft) and the Chosen column of [sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo](https://huggingface.co/datasets/sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo) for about \~10.5M total tokens. 

Created to be merge fodder. May or may not be worth using on its own.