Differential Diffusion for in-painting

Differential Diffusion is the newest method (framework) of in-painting without an in-painting model. Instead, all that is needed is a mask (map) where the lighter the area, the greater the re-painting applied. ...

5 Mar 2024

Generate transparent images with Layer Diffusion

Ever wished you could generate Stable Diffusion XL images with transparent backgrounds? Well, your wish has been answered by the smart people behind the Transparent Image Layer Diffusion using Latent Transparency paper. They have made their code and models available, and what do you know, Chenlei Hu has ported it to ComfyUI! ...

3 Mar 2024

SDXL-based 4-step models compared

With the advent of techniques like Adversarial Diffusion Distillation and Latent Consistency models, A.I. image synthesis based on Stable Diffusion XL has been getting faster and faster. Here is just quick comparison of a few models at 4-steps, some of which are fine-tuned and trained for realism. ...

2 Mar 2024

Consistent portraits revisisted: InstantID

Not long ago, in a attempt to obtain Consistent portraits using IP-Adapters for SDXL, I shared a comparison between IP-Adapter-Plus-Face and IP-Adapter-FaceID. Today I’ll look at InstantID. ...

25 Feb 2024

New Stable Cascase Checkpoints for ComfyUI

An update to my previous post on Stable Cascade with ComfyUI - instead of requiring four separate model files, we now only need two checkpoints, and the ComfyUI workflow is now very straightfoward! ...

24 Feb 2024

Stable Cascade with ComfyUI

On 12 Feb 2024, Stability.ai released Stable Cascade “research preview” (non-commercial license), and over the weekend, ComfyUI was updated to support this new model! Time to give it a go! ...

18 Feb 2024

Comparing face IP-Adapters for SDXL

As a follow up to my last post regarding Consistent portraits using IP-Adapters for SDXL, this is a short comparison of the two face IP-Adapters for SDXL by h94 / xiaohu: namely, ip-adapter-plus-face_sdxl_vit-h.bin and ip-adapter-faceid_sdxl.bin. ...

14 Jan 2024

Consistent portraits using IP-Adapters for SDXL

Getting consistent character portraits generated by SDXL has been a challenge… until now! ComfyUI IPAdapter Plus (dated 30 Dec 2023) now supports both IP-Adapter and IP-Adapter-FaceID (released 4 Jan 2024)! ...

7 Jan 2024

QR Code Monster for SDXL

Time to try another ControlNet for Stable Diffusion XL - QR Code Monster v1 in ComfyUI. This ControlNet can influence SDXL such that the generated image “hides” a scan-able QR code, which at first glance, looks like a photo! ...

14 Nov 2023

Generating animations / videos with SDXL LCM

I never tried generating video clips or animations with SDXL before, simply because my GPU is not powerful enough. But after testing out the LCM LoRA for SDXL yesterday, I thought I’d try the SDXL LCM LoRA with Hotshot-XL, which is something akin to AnimateDiff. ...

13 Nov 2023