Hugging Face's logo

HunyuanVideo Community

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

a-r-r-o-w  new activity 13 days ago
hunyuanvideo-community/HunyuanVideo:No cfg?
a-r-r-o-w  new activity about 1 month ago
hunyuanvideo-community/HunyuanVideo:Black output
sayakpaul  new activity about 1 month ago
hunyuanvideo-community/HunyuanVideo:Black output
View all activity

hunyuanvideo-community's activity

sayakpaul 
posted an update about 4 hours ago
view post
Post
320
We have authored a post to go over the state of video generation in the Diffusers ecosystem 🧨

We cover the models supported, the knobs of optims our users can fire, fine-tuning, and more 🔥

5-6GBs for HunyuanVideo, sky is the limit 🌌 🤗
https://huggingface.co/blog/video_gen
a-r-r-o-w 
in hunyuanvideo-community/HunyuanVideo 13 days ago

No cfg?

1
#2 opened 13 days ago by
wang0422
a-r-r-o-w 
in hunyuanvideo-community/HunyuanVideo about 1 month ago

Black output

12
#1 opened about 1 month ago by
Shuaishuai0219
sayakpaul 
in hunyuanvideo-community/HunyuanVideo about 1 month ago

Black output

12
#1 opened about 1 month ago by
Shuaishuai0219
sayakpaul 
posted an update about 1 month ago
a-r-r-o-w 
updated a model about 1 month ago
sayakpaul 
posted an update about 1 month ago
view post
Post
2133
In the past seven days, the Diffusers team has shipped:

1. Two new video models
2. One new image model
3. Two new quantization backends
4. Three new fine-tuning scripts
5. Multiple fixes and library QoL improvements

Coffee on me if someone can guess 1 - 4 correctly.
  • 1 reply
·
sayakpaul 
posted an update about 2 months ago
view post
Post
2103
Introducing a high-quality open-preference dataset to further this line of research for image generation.

Despite being such an inseparable component for modern image generation, open preference datasets are a rarity!

So, we decided to work on one with the community!

Check it out here:
https://huggingface.co/blog/image-preferences
  • 7 replies
·
sayakpaul 
posted an update about 2 months ago
view post
Post
2139
The Control family of Flux from @black-forest-labs should be discussed more!

It enables structural controls like ControlNets while being significantly less expensive to run!

So, we're working on a Control LoRA training script 🤗

It's still WIP, so go easy:
https://github.com/huggingface/diffusers/pull/10130
sayakpaul 
authored a paper about 2 months ago
sayakpaul 
posted an update about 2 months ago
sayakpaul 
posted an update 2 months ago
view post
Post
2657
It's been a while we shipped native quantization support in diffusers 🧨

We currently support bistandbytes as the official backend but using others like torchao is already very simple.

This post is just a reminder of what's possible:

1. Loading a model with a quantization config
2. Saving a model with quantization config
3. Loading a pre-quantized model
4. enable_model_cpu_offload()
5. Training and loading LoRAs into quantized checkpoints

Docs:
https://huggingface.co/docs/diffusers/main/en/quantization/bitsandbytes
  • 1 reply
·
sayakpaul 
posted an update 4 months ago
view post
Post
2764
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:

* Decrease the rank of a LoRA
* Increase the rank of a LoRA

The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to torch.compile() them.

Check it out here:
sayakpaul/flux-lora-resizing
  • 1 reply
·
dn6 
posted an update 5 months ago
view post
Post
2728
Sharing for anyone using Diffusers from_single_file loading and affected by the Runway SD 1.5 issue.

If you have runwayml/stable-diffusion-v1-5 saved locally in your HF cache then loading single file checkpoints in the following way should still work. 

from diffusers import StableDiffusionPipeline

pipe = StableDiffusionPipeline.from_single_file("<url or path to single file checkpoint>")


If you do not have the model repo saved in your cache, then automatically inferring the pipeline config will not work since the reference repo runwayml/stable-diffusion-v1-5 doesn't exist anymore.

You can use an alternative SD1.5 repo id to still configure your pipeline.

from diffusers import StableDiffusionPipeline

pipe = StableDiffusionPipeline.from_single_file("<url or path to single file checkpoint>", config="Lykon/DreamShaper")


We're working on resolving the issue ASAP.
  • 2 replies
·
sayakpaul 
authored a paper 5 months ago
sayakpaul 
posted an update 6 months ago
sayakpaul 
posted an update 6 months ago
view post
Post
4494
Flux.1-Dev like images but in fewer steps.

Merging code (very simple), inference code, merged params: sayakpaul/FLUX.1-merged

Enjoy the Monday 🤗
·
sayakpaul 
posted an update 6 months ago
view post
Post
3801
With larger and larger diffusion transformers coming up, it's becoming increasingly important to have some good quantization tools for them.

We present our findings from a series of experiments on quantizing different diffusion pipelines based on diffusion transformers.

We demonstrate excellent memory savings with a bit of sacrifice on inference latency which is expected to improve in the coming days.

Diffusers 🤝 Quanto ❤️

This was a juicy collaboration between @dacorvo and myself.

Check out the post to learn all about it
https://huggingface.co/blog/quanto-diffusers
·
multimodalart 
posted an update 6 months ago
sayakpaul 
posted an update 7 months ago