腾讯混元文生图大模型采用了全新的 DiT 架构(DiT 即 Diffusion With Transformer),这是 OpenAI Sora 和 ****** ********* 3 的同款架构和关键技术,是一种基于 Transformer 架构的扩散模型。
本地ComfyUI部署,使用CPU辅助计算,最低6G显存即可运行!
节点安装地址: https://github.com/city96/ComfyUI_ExtraModels/
1.主模型HunYuanDiT.pt文件放在models/checkpoints/下
2.下载到/models/clip/hydit/: https://hf-mirror.com/Tencent-Hunyuan/HunyuanDiT/tree/main/t2i/clip_text_encoder
3.下载到/models/t5/HunyuanDiT/: https://hf-mirror.com/city96/mt5-xl-encoder-fp16/resolve/main/model.safetensors ,并改名为mT5-xl-encoder-fp16.safetensors
4.使用任意SDXL VAE,或下载到/models/vae/: https://hf-mirror.com/madebyollin/sdxl-vae-fp16-fix/resolve/main/diffusion_pytorch_model.bin ,并改名为sdxl-vae-fp16-fix.bin