Clybius commited on
Commit
ae73923
·
verified ·
1 Parent(s): a73bedf

Upload NoobOmniV3.1-FixedTE_00001_.safetensors

Browse files

device = "cuda"
dtype = torch.float32

noobaisubbase = subtract(noobai, base, device=device, dtype=dtype)

grouped_diffs_perp = [
itercompsubbase,
ratatoskrsubbase,
mobiussubbase,
zavysubbase,
colorfulsubbase,
bigaspsubbase,
]

recipe = orthonorm(noobaisubbase, *grouped_diffs_perp, device=device, dtype=dtype)
recipe = ties_with_dare(noobai, recipe, alpha=1.0, k=1.0, probability=0.5, della_eps=0.3, rescale=1.0, vote_sgn=1.0, seed=80085, device=device, dtype=dtype)

merger.merge_and_save(recipe, output="NoobOmniV3.1.safetensors", save_dtype=torch.float16)

I then replaced the TE with a merge of NoobAI CLIP + LLM2CLIP + SAE CLIP (SAE CLIP by zer0int (https://huggingface.co/zer0int))

NoobOmniV3.1-FixedTE_00001_.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bce5dc2c079bec7ecd84ea10f2004919d152165a271d7ef86c71cf8767313ac3
3
+ size 6938296074