Fun with Llama 3 (8B) in Ollama

I saw a post on Reddit, entitled “Llama 3 rocks with taking on a personality!”. A fun experiment! I thought to replicate it, blatantly copying the puzzle presented. Llama 3, released by Meta just before the weekend, is impressive. ...

21 Apr 2024

Testing new PAG and Perp-Neg nodes in ComfyUI

I know it’s bad form to start off with a disclaimer: but the truth is, I do not know what I am doing. I am just testing out two new ComfyUI nodes, PerturbedAttentionGuidance and PerpNegGuider. ...

17 Apr 2024

Mistral System Message setup to improve Image Generation Prompts

In my last post, I used ComfyUI-IF_AI_tools to integrate to the brxce/stable-diffusion-prompt-generator model running in Ollama. I wonder if I could use the base Mistral 7B model to help improve my uncreative prompts instead… ...

31 Mar 2024

LLM Prompt Generation with Ollama in ComfyUI

In my last post, I described running Mistral, a Large Language Model, locally using Ollama. To accompany that piece, I created a prompt and manually used AI to generate an image. Today, I’ll wire up a ComfyUI workflow to Ollama to do this seamlessly, thanks to ComfyUI-IF_AI_tools. ...

28 Mar 2024

A game with Mistral 7B using Ollama

I keep posting about Stable Diffusion, but I do experiment with Large Language Models too! I do not have much to contribute in this regard, instead, here is the transcript of a game I played with the open source Mistral 7B model via Ollama. ...

20 Mar 2024

Stable Video Diffusion

More and more AI generated images are shared as short video clips. So, here a quick test of Stable Video Diffusion - which was released back in November last year. Don’t know why I didn’t post this when I posted about AnimateDiff and the Hotshot Motion model around the same time. ...

10 Mar 2024

TripoSR image-to-3D-object

Do you want to convert a 2D image into a 3D model auto-magically? On 5 March 2024, Stability AI and Tripo AI released TripoSR: Fast 3D Object Generation from Single Images that does exactly that! ...

9 Mar 2024

Differential Diffusion for in-painting

Differential Diffusion is the newest method (framework) of in-painting without an in-painting model. Instead, all that is needed is a mask (map) where the lighter the area, the greater the re-painting applied. ...

5 Mar 2024

Generate transparent images with Layer Diffusion

Ever wished you could generate Stable Diffusion XL images with transparent backgrounds? Well, your wish has been answered by the smart people behind the Transparent Image Layer Diffusion using Latent Transparency paper. They have made their code and models available, and what do you know, Chenlei Hu has ported it to ComfyUI! ...

3 Mar 2024

SDXL-based 4-step models compared

With the advent of techniques like Adversarial Diffusion Distillation and Latent Consistency models, A.I. image synthesis based on Stable Diffusion XL has been getting faster and faster. Here is just quick comparison of a few models at 4-steps, some of which are fine-tuned and trained for realism. ...

2 Mar 2024