Edit Models filters

Intel/orca_dpo_pairs

allenai/ultrafeedback_binarized_cleaned

jondurbin/truthy-dpo-v0.1

Open-Orca/SlimOrca

nvidia/HelpSteer

migtissera/Synthia-v1.3

TIGER-Lab/MathInstruct

unalignment/toxic-dpo-v0.1

Muennighoff/natural-instructions

Vezora/Tested-22k-Python-Alpaca

codeparrot/apps

facebook/belebele

jondurbin/cinematika-v0.1

lmsys/lmsys-chat-1m

Squish42/bluemoon-fandom-1-1-rp-cleaned

kingbri/PIPPA-shareGPT

HuggingFaceH4/ultrachat_200k

meta-math/MetaMathQA

teknium/OpenHermes-2.5

unalignment/spicy-3.1

Open-Orca/OpenOrca

argilla/distilabel-capybara-dpo-7k-binarized

hkust-nlp/deita-10k-v0

openchat/openchat_sharegpt4_dataset

jondurbin/airoboros-3.2

argilla/ultrafeedback-binarized-preferences-cleaned

teknium/openhermes

HuggingFaceH4/ultrafeedback_binarized

athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW

Open-Orca/SlimOrca-Dedup

argilla/ultrafeedback-binarized-preferences

MinervaAI/Aesir-Preview

LDJnr/Pure-Dove

mlabonne/chatml_dpo_pairs

LDJnr/Verified-Camel

argilla/distilabel-math-preference-dpo

HuggingFaceH4/capybara

alexredna/oasst2_dpo_pairs

cerebras/SlimPajama-627B

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

glaiveai/glaive-function-calling-v2

wenbopan/Chinese-dpo-pairs

OpenAssistant/oasst2

PygmalionAI/PIPPA

lemonilia/LimaRP

Anthropic/hh-rlhf

HuggingFaceH4/no_robots

MaziyarPanahi/truthy-dpo-v0.1-axolotl

PKU-Alignment/PKU-SafeRLHF

allenai/ai2_arc

chargoddard/rpguild

openai/summarize_from_feedback

pankajmathur/orca_mini_v1_dataset

NeuralNovel/Neural-Story-v1

argilla/distilabel-intel-orca-dpo-pairs

databricks/databricks-dolly-15k

kyujinpy/orca_math_dpo

mlabonne/CodeLlama-2-20k

wikimedia/wikipedia

BAAI/Infinity-Instruct

Locutusque/Hercules-v3.0

argilla/OpenHermesPreferences

codefuse-ai/Evol-instruction-66k

LDJnr/LessWrong-Amplify-Instruct

Norquinal/claude_multiround_chat_30k

OpenAssistant/oasst_top1_2023-08-25

Undi95/toxic-dpo-v0.1-NoWarning

cognitivecomputations/dolphin

fka/awesome-chatgpt-prompts

glaiveai/glaive-code-assistant

imone/OpenOrca_FLAN

BramVanroy/dolly-15k-dutch

HumanLLMs/Human-Like-DPO-Dataset

Lin-Chen/ShareGPT4V

V3N0M/Jenna-50K-Alpaca-Uncensored

antiven0m/physical-reasoning-dpo

berkeley-nest/Nectar

ise-uiuc/Magicoder-OSS-Instruct-75K

pankajmathur/WizardLM_Orca

teknium/trismegistus-project

unalignment/toxic-dpo-v0.2

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

microsoft/orca-math-word-problems-200k

cis-lmu/Glot500

m-a-p/CodeFeedback-Filtered-Instruction

allenai/MADLAD-400

cognitivecomputations/dolphin-coder

bigcode/starcoderdata

jondurbin/gutenberg-dpo-v0.1

oscar-corpus/OSCAR-2109

cognitivecomputations/samantha-data

garage-bAInd/Open-Platypus

legacy-datasets/wikipedia

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

EleutherAI/pile

anthracite-org/kalo-opus-instruct-22k-no-refusal

jondurbin/airoboros-2.2.1

kiranpantha/dataset-for-peft-cv-nepds

tiiuae/falcon-refinedweb

facebook/voxpopuli

m-a-p/Code-Feedback

AI-MO/NuminaMath-CoT

togethercomputer/RedPajama-Data-1T

AI-MO/NuminaMath-TIR

Gryphe/Sonnet3.5-Charcard-Roleplay

mozilla-foundation/common_voice_17_0

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

nothingiisreal/Reddit-Dirty-And-WritingPrompts

HuggingFaceFW/fineweb

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

internlm/Agent-FLAN

Locutusque/function-calling-chatml

yahma/alpaca-cleaned

microsoft/orca-agentinstruct-1M-v1

HuggingFaceTB/smoltalk

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

allenai/tulu-3-sft-mixture

tatsu-lab/alpaca

open-r1/OpenR1-Math-220k

mlabonne/orpo-dpo-mix-40k

NousResearch/hermes-function-calling-v1

anthracite-org/nopm_claude_writing_fixed

argilla/dpo-mix-7k

nbeerbower/gutenberg2-dpo

Nopm/Opus_WritingStruct

mozilla-foundation/common_voice_8_0

OpenCoder-LLM/opc-sft-stage1

huggan/smithsonian_butterflies_subset

camel-ai/biology

camel-ai/physics

allura-org/Celeste-1.x-data-mixture

camel-ai/chemistry

Gryphe/ChatGPT-4o-Writing-Prompts

HuggingFaceFW/fineweb-edu

OpenCoder-LLM/opc-sft-stage2

nvidia/HelpSteer2

grimulkan/LimaRP-augmented

open-thoughts/OpenThoughts-114k

openbmb/UltraFeedback

netcat420/MFANN

HuggingFaceTB/cosmopedia

allenai/tulu-v2-sft-mixture

trl-lib/ultrafeedback_binarized

anon8231489123/ShareGPT_Vicuna_unfiltered

glaiveai/glaive-code-assistant-v3

FreedomIntelligence/medical-o1-reasoning-SFT

jondurbin/airoboros-3.1

cognitivecomputations/dolphin-2.9.3

metaeval/reclor

derek-thomas/ScienceQA

TFMC/imatrix-dataset-for-japanese-llm

mrapacz/greek-interlinear-translations

open-web-math/open-web-math

HuggingFaceFW/fineweb-2

mlabonne/FineTome-100k

flax-sentence-embeddings/stackexchange_xml

b-mc2/sql-create-context

jondurbin/airoboros-2.2

Models

601

Full-text search

Active filters: Intel/orca_dpo_pairs

TheBloke/go-bruins-v2-GGUF

Text Generation • Updated Dec 10, 2023 • 779 • 12

TheBloke/go-bruins-v2-AWQ

Text Generation • Updated Dec 10, 2023 • 82

janhq/go-bruins-v2-GGUF

Text Generation • Updated Dec 11, 2023 • 17

Delcos/go-bruins-v2-11b

Text Generation • Updated Dec 11, 2023

Philipp-Sc/mistral-7b-reverse-instruct

Text Generation • Updated Dec 20, 2023 • 106 • 5

jondurbin/bagel-dpo-7b-v0.1

Text Generation • Updated Jan 30, 2024 • 1.97k • 42

TheBloke/bagel-dpo-7B-v0.1-AWQ

Text Generation • Updated Dec 13, 2023 • 88

TheBloke/bagel-dpo-7B-v0.1-GGUF

Updated Dec 13, 2023 • 282 • 5

TheBloke/bagel-dpo-7B-v0.1-GPTQ

Text Generation • Updated Dec 13, 2023 • 42

SinanAkkoyun/pic_7B_mistral_Full_v0.2-awq

Text Generation • Updated Dec 14, 2023 • 73

bartowski/bagel-dpo-7b-v0.1-exl2

Text Generation • Updated Apr 11, 2024 • 7

model-hub/stablelm-zephyr-3b

Text Generation • Updated Dec 14, 2023 • 9

mncai/agiin-13.6B-v0.1

Text Generation • Updated Dec 15, 2023 • 3.75k • 2

janhq/solar-10.7b-instruct-v1.0-GGUF

Updated Dec 15, 2023 • 14 • 1

TheBloke/agiin-13.6B-v0.1-AWQ

Text Generation • Updated Dec 16, 2023 • 62

TheBloke/agiin-13.6B-v0.1-GGUF

Updated Dec 16, 2023 • 133 • 3

TheBloke/agiin-13.6B-v0.1-GPTQ

Text Generation • Updated Dec 16, 2023 • 12

rohansolo/DeciDPObyBB

Text Generation • Updated Dec 16, 2023

mncai/mistral-7b-dpo-v6

Text Generation • Updated Dec 18, 2023 • 1.88k • 11

mncai/mistral-7b-dpo-merge-v1.1

Text Generation • Updated Dec 18, 2023 • 1.88k

mncai/agiin-11.1B-v0.1

Text Generation • Updated Dec 17, 2023 • 7 • 1

xDAN-AI/xDAN-L1-Chat-RL-v1

Text Generation • Updated Dec 29, 2023 • 2.01k • 63

kyujinpy/Sakura-SOLRCA-Instruct-DPO

Text Generation • Updated Mar 4, 2024 • 1.87k

kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v1

Text Generation • Updated Mar 4, 2024 • 3.77k

Lipu124/Spd1

Updated Dec 25, 2023

xDAN-AI/xDAN-L1-Chat-RL-v1-awq

Text Generation • Updated Dec 25, 2023

LoneStriker/xDAN-L1-Chat-RL-v1-3.0bpw-h6-exl2

Text Generation • Updated Dec 26, 2023 • 9

LoneStriker/xDAN-L1-Chat-RL-v1-4.0bpw-h6-exl2

Text Generation • Updated Dec 26, 2023 • 7

LoneStriker/xDAN-L1-Chat-RL-v1-5.0bpw-h6-exl2

Text Generation • Updated Dec 26, 2023 • 7

LoneStriker/xDAN-L1-Chat-RL-v1-6.0bpw-h6-exl2

Text Generation • Updated Dec 26, 2023 • 10 • 1