Soshyant PRO

Respair

AI & ML interests

Speech and Audio Processing, Natural Language Processing

Recent Activity

updated a model about 5 hours ago
Respair/ar_cache
updated a model about 5 hours ago
Respair/Text_Aligners
liked a Space about 19 hours ago
litagin/galgame-voice-finder
View all activity

Organizations

ShoukanLabs's profile picture StyleTTS 2 Community's profile picture falche's profile picture Ferdowsi Neural Lab's profile picture Hugging Face Discord Community's profile picture Deposit's profile picture ะ ัƒััะบะธะต_ะ‘ั€ะพะท (Russian & Central Asian Bros)'s profile picture

Respair's activity

reacted to leonardlin's post with ๐Ÿ‘ 5 days ago
view post
Post
1962
My weekened project ended up being doing some testing between torchtune, axolotl, and unsloth. I *think* it's a 1:1 comparison of what LoRA fine-tuning performance looks like between the different hardware I have in my dev boxes (4090, 3090, 7900 XTX, W7900) with a few other interesting tidbits.

Tonight I wrote up a WandB report (the panel editor is super broken in Firefox ๐Ÿ˜”) that sums up some of the more interesting bits from the results: https://wandb.ai/augmxnt/train-bench/reports/torchtune-vs-axolotl-vs-unsloth-Trainer-Comparison--Vmlldzo4MzU3NTAx
  • 1 reply
ยท