CLIPSeg with SDXL in ComfyUI

Onward with SDXL and ComfyUI! Sometimes I want to tweak generated images by replacing selected parts that don’t look good while retaining the rest of the image that does look good. Rather than manually creating a mask, I’d like to leverage CLIPSeg to generate a masks from a text prompt. ...

31 Jul 2023

SDXL with Offset Example LoRA in ComfyUI for Windows

Yesterday I mentioned in passing that my Nvidia RTX 2060 with 12GB could not run both SDXL 1.0 Base and Refiner models in a single ComfyUI workflow. Today, I show you my workaround and also experiment with adding the SDXL 1.0 Official Offset Example LoRA to the workflow. ...

30 Jul 2023

Stable Diffusion SDXL 1.0 with ComfyUI

Stability.ai has released Stable Diffusion XL (SDXL) 1.0 (26 July 2023)! Time to test it out using a no-code GUI called ComfyUI! ...

29 Jul 2023

The Art of Linda Bergkvist

Not long ago, I was reminded of one of my favourite digital artists, Linda Bergkvist a.k.a. Enayla. I love her macabre yet stunningly beautiful and evocative art, but alas, she’s not posted her art since around 2007. This post is a departure from my usual techie stuff – it’s just appreciation post! ...

23 Apr 2023

myByways Simple-SD v1.1 Python script using Safetensors

Epic Diffusion recently came to my attention, a high-quality merge of various models by John Slegers: “Epîc Diffusion is a general purpose model based on Stable Diffusion 1.x intended to replace the official SD releases as your default model. It is focused on providing high quality output in a wide range of different styles…” Figured I’d give it a spin. ...

24 Jan 2023

Fast Stable Diffusion using Core ML on M1

Recently (around 14 December 2022), Apple’s Machine Learning Research team published “Stable Diffusion with Core ML on Apple Silicon” with Python and Swift source code optimized for Apple Silicon (M1/M2) on Github apple/ml-stable-diffusion. Here I’m trying it out on a MacBook (though the code also works on iPhones and iPads)… ...

18 Dec 2022

myByways Simple-SD v1.0 Python script

I refactored my previous Stable Diffusion code, to clean up, OO it a little, and add new features like tiling, upscaling, PNG metadata. As I mentioned before, I don’t understand AI/ML… but I do understand programming! So here is my new, more elegant Simple-SD v1.0 Python script. ...

9 Oct 2022

Adding CLIPSeg automatic masking to Stable Diffusion

I have more ideas for Stable Diffusion. My nights and weekends are consumed! This time: For inpainting, why create a mask image manually, when A.I. can automatically build a mask from a text prompt? Someone much smarter has already published a paper (arXiv:2112.10003 [cs.CV]), with source code, to do just this! ...

28 Sep 2022

Stable Diffusion script with inpainting mask

More Stable Diffusion! This time attempting to add inpainting / masking based on my previous code, to merge both txt2img.py and img2img.py capabilities, disregarding the out-of-box inpainting.py code, which does not have parameters for positive or negative prompts. Keyword being attempting… ...

26 Sep 2022

My simplified Stable Diffusion Python script

I’ve been playing around with the Stable Diffusion scripts a little (to be exact, Ben Firshman’s version). To help me understand the script, I decided to re-write it the way I prefer to use it… either breaking or optimizing it in the process :P ...

21 Sep 2022