From ComfyUI to Deforum: Embracing Imperfection in AI Art

Dear friends,

since quite a white I am posting AI morph experiments daily on my social media channels.

In the beginning I was super excited about the aesthetics, but now it starts to get a bit boring for my taste. It kind of repeats.

Good that I have only scheduled videos for two more weeks in advance 💪

I create those videos with ComfyUi and AnimateDiff.

And as I explained in previous articles before, it is difficult to control camera movement and schedule prompts on specific keyframes. The results look technically astonishing — but lack personality and character.

Working on some new and exciting projects brought me back to good old Deforum.

And I have to say: I am a Deforum guy. I really love this tool.

Even though the images flicker and the movement is not always super smooth — it creates the most creative results in my opinion.

With Deforum, you can schedule prompts on specific keyframes and use tools like Parseq or the Blender plugin to control camera movement. This allows you to create long videos and tell stories.

Yes, you are limited and don’t have all the cool extensions which ComfyUi offers, but I think this pushes you to use this as a creative tool and not just as a instant-AI-video-creation app.

I actually created an account at LumaLabs where you can create “realistic” looking AI videos just with prompts. Until now it did not catch me. I probably miss the manual creative layer.

The video below was one of the first animations I created with StableDiffusion and Deforum. I still think that it is more interesting than some perfectly executed videos of people dancing in an AI world.

I am happy to jump back into Deforum and will share my experiments with you soon.

Much love,
Marius

Thanks for reading Marius Jopen! Subscribe for free to receive new posts and support my work.