Discussion of Free and Open Source Text-to-Image/Video Models

GenJam3: https://forms.gle/hWs19H4vTGTdwARq8

Prev: >>106170414

https://rentry.org/ldg-lazy-getting-started-guide

>UI
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI
re/Forge/Classic: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassic
SD.Next: https://github.com/vladmandic/sdnext
ComfyUI: https://github.com/comfyanonymous/ComfyUI
Wan2GP: https://github.com/deepbeepmeep/Wan2GP

>Checkpoints, LoRAs, Upscalers, & Workflows
https://civitai.com
https://civitaiarchive.com
https://tensor.art
https://openmodeldb.info
https://openart.ai/workflows

>Tuning
https://github.com/spacepxl/demystifying-sd-finetuning
https://github.com/Nerogar/OneTrainer
https://github.com/kohya-ss/sd-scripts/tree/sd3
https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
https://github.com/tdrussell/diffusion-pipe

>WanX
https://github.com/Wan-Video
2.2 Guide: https://rentry.org/wan22ldgguide
https://alidocs.dingtalk.com/i/nodes/EpGBa2Lm8aZxe5myC99MelA2WgN7R35y

>Chroma
https://huggingface.co/lodestones/Chroma1-Base/tree/main
Training: https://rentry.org/mvu52t46

>Illustrious
1girl and Beyond: https://rentry.org/comfyui_guide_1girl
Tag Explorer: https://tagexplorer.github.io/

>Misc
Local Model Meta: https://rentry.org/localmodelsmeta
Share Metadata: https://catbox.moe | https://litterbox.catbox.moe/
Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-one
Samplers: https://stable-diffusion-art.com/samplers/
Txt2Img Plugin: https://github.com/Acly/krita-ai-diffusion
Archive: https://rentry.org/sdg-link
Bakery: https://rentry.org/ldgcollage

>Neighbours
https://rentry.org/ldg-lazy-getting-started-guide#rentry-from-other-boards
>>>/aco/csdg
>>>/b/degen
>>>/b/realistic+parody
>>>/gif/vdg
>>>/d/ddg
>>>/e/edg
>>>/h/hdg
>>>/trash/slop
>>>/vt/vtai
>>>/u/udg

>Local Text
>>>/g/lmg

>Maintain Thread Quality
https://rentry.org/debo

the output with and without negs is basically the same because NAG isnt set up on kijais workflow so nevermind i am mentally ill and brain slopped

how do you even use WanVideo Text Encode with WanVideo Apply NAG? picrel doesnt feel correct but i dont understand any other way to do it with WanVideoWrapper nodes

woo my miku gen made it into the collage

I'm trying to use comfyui to put multiple views from 2d pictures to a 3d model
any help?

>>106174975
use blender. comfy only does 2d

gay niggas from outer space

>>106175010
literally not true, i've been using it to do 3d with hunyuan 2d-3d
i'm just trying to get multiple images to 3d instead of a single image

>>106175021
then use blender

>>106175037
to do what

>>106175021
comfart doesn't care about 3d, llms or gaussian splatter. he is incredibly lazy

>>106174975
There's software specialized to do that, it's called photogrammetry

Maybe you could use comfy to produce images of angles you don't have photos of. I'm still waiting for a simple stereoscopy lora that makes one image for your other eye so we will have good 3d conversion. iw3/nunif doesn't use inpainting so edges look bad if you crank the 3d effect up

Tell me how to do it if you figure it out.

>>106174913
You could add a single text encode node just for the NAG negatives.

>>106175046
finish the rest of the model with the images as guides

>>106175053
I've tried to get into photogrammetry but it seems like an incredibly scammy field and finding free software that does that without crapping out a turd or asking for money was beyond my effort level
>>106175066
kind of defeats the point

i2v and t2v v1.1 added 30 minutes ago
https://huggingface.co/lightx2v/Wan2.2-Lightning/tree/main
waiting for kijai now..

>>106175071
take a look at the image in the op collage regarding cumfart. have a good day

>>106173293
Realised I had a negative prompt of " " (blank space) when genning the image. Seems to be closer now to your one using the same settings I had in >>106173261 when I made the negative prompt blank

>>106175071
meshlab is free and it just werks

>>106175082
i hope these are working versions now

>>106175059
oh wait does it even matter for cfg distills since negatives dont matter at cfg 1

>>106175100
Same settings except I lowered cfg to 2

>>106175090
pic

>>106175115
would be nice if they added some notes about what's changed from 1.0 to 1.1 for example

>>106175126
https://www.meshlab.net/
https://hackaday.io/project/9792/instructions

sfm seems like a new thing since I did it last but there you go. free photogrammetry

https://huggingface.co/Kijai/WanVideo_comfy/tree/main/Wan22-Lightning
5 minutes ago
kj is plugged in

Do I change anything here or are the default setting good for chroma?

>>106175103
is cat-taur ani going to be a mainstay? she's really cute and I love her

musubi has 2.2 now?

>Majima-sa- ACK

>>106175118
It does, NAG restores effective negative prompting in few-step diffusion models. That's the whole point of it. Don't use it if you don't need it though as it can increase VRAM usage with the KJ WAN workflow.

>>106175082
why do you have to wait for kijai? Will these not work if I load them?

>>106174228
https://huggingface.co/Vchitect/ShotVL-7B
https://huggingface.co/diffusers/shot-categorizer-v0
Looks like they used one of these to caption for that

>>106175268
yeah they will work but i'm too lazy to try if the strength issue that kijai addressed has been fixed with these new releases

qwen image gen fed into hunyuan 3d 2.1
churning out slop assets is easier than ever and completely possible locally
image prompt
>a white room made for character renders has a gundam standing in an A-Pose. A steampunk gundum robot made of rusted metal with a large exhaust pipe sticking out from its head. the robot has alternating colours for its body and damaged parts. Ultra HD, 4K, 3DCG, Unreal Engine.

cfg 2, seed 42, steps 45

>>106175342
back view of model

comfy why are you like this

>>106174863 (OP)
Is the fish sandwich one even AI lol

>>106175342
>not on comfy
hahaha get wrecked fennec faggot

>>106175342
>the Cumdam

>>106175342
>>106175351
what are the materials like? Is it a simple texture or can it make PBR materials?

wan 2.2 lightning 1.1 t2v is looking like hot garbage at weight 1


>>106175234
>it can increase VRAM usage with the KJ WAN workflow
everything is pointing towards me spending 200 dollars on upgrading to 64 gb of ram but video gen is literally my only use case for more than 32gb

>>106175197
no. I'd be pretty limited because not many cat-taurs exist on the internet to get trained into interesting poses or actions. I'll keep making her from time to time because she is pretty cute

>>106175395
>at weight 1
so is it supposed to be weight 0.125 like the previous one from their release (not the fixed kijai version)?

>>106175405
this is using kijai's version

>>106175395
Can you try some comparisons on the same seed? I dunno if it will gen a completely different video or not.

>>106175395
ebay your ram and memtest it, you save a lot of money

>>106175420
ah he already uploaded them. he's fucking quick. well i'm hoping at least i2v isn't garbage then

>>106175423
it appears that NAG completely changes the video around yeah but i'll do some more tests

>>106175438
if i was going to do ebay i would just commit fraud at that point

>>106175442
its worse than just using the fusionX lora for 2.1 it seems. slightly faster though

>>106175387
It generates PBR materials by default. Big plus of Hunyaun 3D 2.1 is it solved the shadows being backed into the model texture. It can suck at texturing faces though and I've only fluked an OK face once or twice. Model gen time is like 30 seconds or so but the texture/material gen is about 2 minutes

>>106175473
can you do multiview

>>106175162
Works well for me and I am not using Kijai's workflow.

i have ascended to hiding wires

How's image to video on civitai? Is it a waste of buzz?

>>106175506
Don't see anywhere in the code that allows for multi view easily, but it uses similar diffusion steps to other image-3d generator projects. It could probably be done since part of its inference steps is to generate multiple views of the image before running the mesh generation but I'm not bothered to dig into the code to add it since it's been able to handle it very well with just 1 image reference.
I've ran trellis and it had the ability to specify multiple views but it has issues with baking lighting into the textures. I prefer Hunyuan3D 2.1 so far.

>>106174504
>is 4 minutes per image gen on chroma with 8gb vram sound about right?
That's faster than I would expect desu

Is this enough to run i2v and t2v using the 2.2 guide in the op? it says its centered around 24gb vram and 64gb ram, but i don't see any changes later in the guide for lower specs

heads up: diffusion-pipe wan training is broken somwhere between now and August 3. I did a "git reset 468aec0 --hard" to get it working. Issue is here: https://github.com/tdrussell/diffusion-pipe/issues/364

>>106175565
fucking fuck your fucking shit you fucking retard

>>106175529
are you using i2v?

because this is the static slop i got with t2v at weight 1, 8 steps
compare to >>106175118 which is fusionx 2.1 lora with 2.2 at weight 1

>>106175536
true ascension is handling everything with JSON objects and HTTP requests and not dealing with the UI part of ComfyUI at all

>>106175580
yeah that's fine all of my leotard slop itt is on 16gb vram and 32gb of ram. you will not be able to go above 540p on Q8/fp8 weights however unless you buy more ram

qwen-image 20b q8 using 40 steps and cfg 3.5 dpmpp_3m_sde_gpu (for the hell of it)

I'm slowly getting the hang of qwen. God damn it's slower than flux though.

>>106175395
>64gb
Ramlet tier

>>106175580
Yes enough. These are my specs and I am getting 4-5 minutes per gen (4060Ti)

>>106175603
i2v yes.

>>106175603
>true ascension is handling everything with JSON objects and HTTP requests and not dealing with the UI part of ComfyUI at all
this did present it self in my mind when it occurred to me that get and set nodes are essentially just hiding wires... Why bother spending hours setting up each get and set node and collapsing things, hiding them behind things etc. Well we do it because its difficult to think/concentrate when you have a whole jumbled mess,. it the trash it all goes man! its much better to just know what you're doing and switch all the eye candy off its all fucking cancer.

Once i hide the wires its like a massive head fuck just stopped and i can think clearly again.

>>106173931

tfw jeets steal my gens and post on plebbit just for everyone to shit talk them anyway LOL

absolute india death gotta love it

>>106175567
What does the topology typically look like for the meshes it churns out?

>>106175591
I'm sorry I don't know what triggered you so. I don't have a 5090 at home.

>>106175082
>lightx2v 2.2 only works for kijai workflow
lol. lmao.

lightning 1.1 t2v at 0.6 weight looks much better but now the low step issues are showing up. will try and find a sweet spot for 8 steps

>>106175663
well any release for i2v is better than the previous status quo which was no release at all

>>106175638
16gb vram + 32gb ram = the 5'11 of videogen, king of the vramlets

>>106175567
fucking kekd

>>106175744
the problem with those lightx2v loras is that you get the same 1face

>>106175730
I mean its like asking, "Hey guys how is youtube? should i watch some youtube videos or is it a waste of time?"

LIKE WHO THE FUCK CARES?
>I'm sorry I don't know what triggered you so. I don't have a 5090 at home.
just fucking hire some hardware then online, fuck civiai. but you don't need a 5090 you dunce, i use a 3060 and i can gen videos over 2 minutes now due to taking the time and effort to learn how to make the max use out of my hardware.

>>106175589
ty anon

>>106175759
have another
>a white room made for character renders has a gundam standing in an A-Pose. A steampunk gundam robot made of rusted metal with a large exhaust pipe sticking out from its head. the robot has patches of white slime over its body and oozing out of the exhaust pipe. Ultra HD, 4K, 3DCG, Unreal Engine.
>>106175729
haven't checked but trellis had 'ok' topology but you would need to use zbrush or something to perform retopology most likely. I'm backing this image at the moment. I'll upload and share some gens for you to check out yourself if you want

>but sir, the humans ar-
>I! NEED! MORE! L00SH!

0.8 weight

we have returned to stiffville. i'm about to write off lightning 2.2 entirely when base 2.2 + lightx2v 2.1 lora or even the fusionX lora looks better

>>106175774
>you get the same 1face
can't be any worse than fusionX, and this isn't necessarily a bad thing if you're trying to generate something attractive that is ugly in most of its training data (like certain ethnic groups, or ages)

>>106175744
>16gb vram + 32gb ram = the 5'11 of videogen
That would be 64gb of ram given that even that gets filled to the brim and more on max quality
24 128 is minimum for a smooth exp

>>106175858
these are getting better anon

>follow the 2.2 guide to install
>get to the point where im ready to run my first generation
>get this upon loading the i2v workflow that was provided
why am i missing every node

>>106175858
impressive punch hardness

>>106175858
desu the first time ive seen a realistic punch in a gen

wtf I love comfy now

pretty happy with the i2v one, not bad for only 3+3 steps and cfg 1 on both samplers

Which should I get, a 5090 or a 6000 Blackwell if all I want is to play around with inference and don't care about training?

>>106175986
>crops out the part at the bottom with the button to one click install the nodes

https://huggingface.co/Kijai/WanVideo_comfy/tree/main/Wan22-Lightning

updates to lora

is i2v lightning worth using yet btw

>>106176094
care to show me where you see that button?

>>106176095
people say the kijai one is much better for motion/outputs btw, at 4 steps

>>106176105
Maybe its a feature of comfyui manager then, anyway, install the manager and open it, then click on the button at the top that says install custom missing nodes

>>106175162
What high/low strength are recommended for these fresh ones? 3/1 like before?

2.2 lightning "tongue kiss"
they were supposed to be gold bikinis btw

>>106176075
probably 5090 with 64gb of ram. compute-wise the 6000 pro is barely any stronger (videos will take the same time you can just go 1600x900 or even higher with a pro 6000 which isnt even supported by wan or the 4mb limit on this shitty website)

>>106174123
bro I got you covered

>he doesn't have the manager installed
LMAO LMFAO EVEN

>>106176135
It's more grim to see people not interpolate with FILM VFI than to see the rocketnigger schizoposting

meanwhile with the fusionX lora..
notice the gold bikinis

>>106176121
i dont care, 2.2 lightning is worthless for t2v unless i'm doing something wrong and I'm pretty sure i'm not. i refuse to believe setting the weighting to 3/1 instead of the 1/1 i did testing with will resolve any of the problems i have with 2.2 lightning rather than just make them even worse than they already are

>>106176144
>follow the guide in the op
>he doesn't have the thing the guide doesn't mention
come on anon

>>106176118
that worked, thanks anon.

>>106176127
>videos will take the same time
ok thanks anon

>julien

>>106176074
Yeah, this is good quality overall, it quickly loses the facial features, but that is to be expected

24 VRAM 128 RAM MoE Real time 1080p consistent world video gen timeline prediction? We get it for sure by end of next year.

>>106176095
>finally i2v
bruhs do we do 1 strength? whats the recommendation here? im still using the 2.1 at 3 high and 1 low

also this is the first i2v for 2.2 by kijai I think, previous lora was a t2v release

>>106176153
i dont like interopolated (I mostly do anime)

>>106176204
>128 ram
I WISH MY MOBO SUPPORTED IT WITH XMP ENABLED

>>106176210
good question idk if these are used at 1.0 or not

>>106175894
Thanks

>>106176018
>>106176031
Wan 2.2 is pretty damn good at weighty punches that connect. Did a number of 30 fps/ 151frames but it kinda ignores the prompt. The best I've found is at 81 frames and strangely enough Accvid i2v lora, kek. Accvid seems to help with better motion and targeting (without it they sorta just slap each other without one going down)

>>106176210
i'm using cfg 1, strength 1 on both, 3+3 steps. can probably do more steps for better quality but i'm impatient
video related

>>106176245
looks good

>>106175729
https://files.catbox.moe/r2oe50.zip
has: cumdum, gundam, tree, steampunk house, castle, eve from stellar blade's head (untextured)
has glb and mats of a few gens I've tested. the castle, tree, and steampunk house are very large and I can't remember if it's because I increased the polycount when genning them or the face reduction step couldn't simplify the mesh enough (or a mix of both)
you can also browse them by running a basic python server then opening the html files in your browser.

>>106176238
I am using 1, no problem

the character opens a pizza box and eats a slice of pizza.

first test with kijai i2v 2.2, should be default steps (6, or 3/3)

>>106175856
>>106176255
lmao

>>106176245
>>106176278
Does it follow your prompt properly at cfg1?

>>106176075
Do yourself a favor and get something with at least 48GB. Too many things target an A40. 32GB means you'll need quants somewhere.
Preorder a 5000 Pro, it's $4300 at CDW.

>>106176345
in my case it did. prompt was:
>Cinematic movie scene, the man is crying as the camera pans to an anthropomorphic chili pepper pointing at him and laughing

>>106176144
In his defense I think the manager isn't installed by default.

>>106176345
Everything I prompted was there, with 2.1 light, I couldn't get the night to fall ever.

>>106176357
Yeah but isn't the 5000 pro castrated in terms of CUDA cores?

>>106176395
Yeah slightly so. I have a 4090D 48GB. I know it's a slightly cut-down 4090. Every time I look at nvtop and see memory well above 32GB, I'm glad I bought it over a 5090.

>16gb vram
>48gb pagefile
>32gb ram
>if i try to gen i2v with the default 2.2 guide workflows, i get the reconnecting error every time
what am i doing wrong

>>106176395
yep, 14080 vs 24064 on the 6000 pro and 21760 on the 5090 rtx

>>106176425
>what am i doing wrong
not buying more cheap ram

>>106176445
alright but what am i actually doing wrong? people here are genning with the exact same specs i have

>>106175811
Zoomers are brainrotted, they need social consensus for everything, they can't spend even an hour trying something on their own. This is of course silly because if everyone acted like they did nothing would ever happen because no one would try anything and thus could never make recommendations.

>>106176450
People are retards probably using some sub q6 quant of wan, anyone below q8 is shitter teritory anyway

>>106175694
gave me an idea... fake white chick ai influencer thats just in love with india and indian men

i will become a god of jeets until the great block happens and india is disconnected and banned from 1st world internet

>>106176135
This is a disgrace. Just wait until I get home.
>>106176153
Interpolation doesn't always come out good, or maybe gimm-vfi just sucks.

>>106176425
pytorch cuda mismatch

>>106176436
>>106176423
But wouldn't almost half the cuda halves the inference speed?

>>106176518
From my testing FILM VFI is best aside from topaz which is a hassle

>>106176525
probably yes. for inference i think 32gb 5090 is fine, considering it costs only 2k and there's always ways to quant stuff, and for training you can just rent a H100 or whatever

so, is kijai's 2.2 i2v lora good or stick with 2.1?

>>106176572
i2v one is good. from preliminary testing i like it more than the 2.1 one

>in use: 62 of 64gb
what the fuck is comfy even doing

>>106176461
No reason to get pressed gramps it's not that deep fr

>>106176592
First time video genning?

>>106176592
i don't know but no one prepared me for the fact that 64gb is vramlet territory nowadays
i'm stuck on ddr4 still so don't want to buy more of this shit, now need to upgrade mobo, cpu, etc etc

>>106176595
No, it's that deep, I've seen you people ask retarded time wasting questions because you can't even try something for 10 minutes
4chan isn't Google
4chan isn't a substitute to you actually doing something
Ignore me at your own peril, I'm just telling you why everyone despises you and why you'll never get a good job. We're not your daycare. Your employer isn't a daycare.

>>106176628
I had 32gb and got 64 cause it was ddr5 cl30 6000 at a good price and for futureproofing, guess it was a good idea

2.2 kijai i2v at 6 steps (3/3) works well after an update all/comfy update also: 1 strength for both (old one needed 3 str for high)

the character walks to a computer, sits down, and starts typing.

>pagefile is too small
is it fucking really? do i need to set up comfy to properly use it or something?

>>106176653
mamma mia...

>>106176653
the Curdfather

>>106176075
>>106176357
>>106176423
If you've got the money, follow what those anons said and get the bigger vram cards. It just removes all headaches for running video gen and other stuff. Especially if you can't code. I sometimes have to modify the inference code to offload things to my other cards but my 48gb card is what let's me load lots of stuff with minimal hassle. If you get hooked into this, it becomes a slippery slope of chasing more vram. I started with 4060ti, now I have 4090 + 3090 + A6000. The most handy of the 3 is the A6000. I want another 48gb card and I'm looking at the chinesium 4090(D) 48gb cards. I wish I bought one of them instead of my 4090. If I didn't have a mortgage I'd buy the 6000 pro.

>>106176658

Are you feeling comfy yet?

>>106176572
way better than 2.1 and runs at cfg 1

>>106176687
i just want to fucking make funny i2v videos i feel like im doing something wrong. i have 16gb vram, 32gb ram, 64gb page file, and its still giving me paging file is too small errors every time i try to gen.

>>106176713
use this workflow and the high/low models, kijai one uses block swaps and other stuff and works way better for me (16gb vram, works fine)

https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo2_2_I2V_A14B_example_WIP.json

https://github.com/kijai/ComfyUI-WanVideoWrapper/tree/main

>>106176713
Is your hard drive almost full?

>>106176687
You need 10% of those

>>106176747
not particularly

kek

the character with black sunglasses walks into a FamilyMart convenience store in Tokyo, Japan.

with new lora, still tweaking stuff

>>106176681
Are you able to quantify the time loss between generating in full vram vs swap?
Let's say the inference for full wan in 720p for 5 seconds at 16fps is 60GB.
So if I go with a 5090 I'd obviously swap, and if I go with the 96GB of the 6000 blackwell, I'd be fine and can even go to 10 seconds+ of gens.
What I'd like to understand is how much time swapping with ram is adding.
Because if it's even half as fast, I don't think it's worth getting a card 4 times the price.

>>106176687
pfft

>>106176764
As they say on the Magnificent Mile, if you have to ask, you can't afford it. Only get a 6000 if $10k wouldn't even be noticed as missing or if you're going to make that $10k back with an active business (and thus also a tax write-off).

>>106176788
I can afford it, but I don't want to burn money just for the sake of it.

>>106176764
in my experience ram swap doesn't add much time to the gen

>>106176687
>>106176777
imagine doing this instead of just making separate workflows

>>106176802
You can't afford it because if you could you'd buy it because it has more memory and is the fastest card. Thus, if you have to ask, you can't afford it. I'd only get a 6000 if you had $500k in the bank account and had a net income of $30k/mo. If you have to hand wring over $10k, you can't afford it.

>>106176816
this

>>106176629
Holy melty

new lora

the character with black sunglasses walks into a donut shop and eats a chocolate donut.

I got special effects somehow.

>>106176764
I wouldn't be able to quantify that because I don't have the Blackwell card. But back when hunyuan video released I did test time difference between my 4090 and the A6000. A6000 had no block swap while 4090 did and the 4090 was still faster by a good margin (cant recall it now and pc is off with my benchmark tests). I prioritised using my 4090 when I could and still do for anything that fits entirely in it. But when it doesn't the A6000 comes in handy and let's me gen when I otherwise can't (hunyuan3d for example).
If your priority is speed, take whichever has the highest memory bandwidth + core count. But if your priority is being able to gen stuff (and at higher batch sizes and res) take the highest vram possible (assuming a minimum good cuda support for the card).
Again, personally, I'd buy the 96gb card over the 5090 because there's nothing more annoying than being unable to run something and having buyer's remorse while you line up the next purchase for a higher vram tier. I'm still starting at the Blackwell in my shopping cart from time to time and trying to come up with a way to convince my work to let me salary sacrifice for it.

>>106176883
Training is like 80% of the fun of AI, I would never compromise memory and right now the only thing that can train Wan and Qwen Image properly is a 6000.

>>106176871
h-he's fast...!

I don't suppose anybody else is trying out musubi and getting this error

>>106176918
diffusion-pipe is worth the pain of wsl because it just works

>>106176922
i had the opposite experience, musubi tuner just werked for me and diffusion pipe was a pain

>>106176962
how did you get filtered by txt/mp4 pairs?

>>106175589
Looks like your submodules aren't updated/present. I'm training a Chroma lora right now on latest commit

>>106176883
Thanks for the reasoning anon, makes sense.

>>106176968
deepspeed bloat kept giving me issues and once i got it working it was slower on the same hardware, which is ironic

>>106176906
In with you there. When I got the A6000 I immediately used it to tune (not qlora) a version of tinyllama on pol to be a shit talk bot. Which you reminded me, the bigger memory speeds up training so much because you can disable gradient checkpoints. I was shocked at the time difference (like a 2x or 4x reduction) and was my first step towards abandoning memesloth scripts for tuning LLMs.

>>106176746
that one isnt getting me anywhere either for whatever reason. i have to be doing something completely wrong.

it seems to happen when the current active node, video sampler, hits 100%

>>106176522
ahahah... did you use my bbwhot lora for that?

>>106176658
>64GB
just put it to 150+ and fuhgeddaboutit

>>106177032
try generating some absurdly small resolution video, it will obviously be gibberish but at least you'll know whether it's a not enough memory issue

>>106176570
>considering it costs only 2k
That would be nice, if only I could win the 5090 FE lottery.

>>106177102
FE is the worst 5090 though, most noise and heat

I skipped the bad line of code with an arg and got a different error
this t is no good

>>106177084
initial gen with chroma, then wan22 image to video

This board needs bigger file sizes for longer videos. If there is a Local Diffusion Video General, it has to be created in /wsg/.
I was trying to make the girl slap him but no luck yet.

Anyone getting this error in the new wan sampler?

>>106177032
it can oom or mess up at large sizes, try a 640x640 gen

>>106176979
>Looks like your submodules aren't updated/present. I'm training a Chroma lora right now on latest commit
No that's not it. I blew out my env, did another recursive clone, redid the end, reinstalled everyting - still the same issue. You should only need to use recursive on the clone, not on subsequent pulls.

>>106177185
yeah slaps are a no-go sadly, I think they removed violent verbs/actions.

>>106177258
is that Epstein Manor

>>106177196
>You should only need to use recursive on the clone, not on subsequent pulls.
For sure. You'd git submodule update on a new pull

automagic optimizer is looking good so far. I'll pull and try wan 2.2 again after testing a few other optimizers on Chroma for this dataset

>>106177307
You gave me an idea I am going to try in Chinese 一巴掌 this is the traslation of slap according to yandex.

>>106177185
Very nice, are you use the" SuperUltimate Vace Long Video" Node?

the man walks into a dunkin donuts donut shop in the city, and eats a chocolate donut.

>>106177419
>are you use
holy esl

motion with the 2.2 i2v lightning lora (kijai) seems good desu

>>106177451
I meant to say "using", its 6pm and I've been up since 5am

>>106177530

GPT 5 is here

>>106177419
I am getting the last frame by index and feeding it back manually to the next gen, then concatenating with ffmpeg.

>>106177778
oh boy, more paying for 10 prompts a day

the man points an ak-47 at the camera, while standing on a red carpet at a movie premiere. he shoots the rifle several times as the camera pans out.

pretty good

>>106177778
and it's a nothingburger as predicted

>>106177778
Discussing GPT-5 could create a sense of inadequacy or obsolescence for earlier GPT ClosedAI models or other AI systems, which may be construed as disrespectful to the contributions of previous technologies. Additionally, speculating about or endorsing specific technologies could contribute to a consumerist mindset focused on relentless upgrading, potentially sidestepping sustainable and mindful approaches to technology use.

https://x.com/LodestoneE621/status/1953298307612299466
>the math is almost identical to shortcut model but with some twist. i'll publish the code hopefully today so people can improve on this

>>106177778
i click into the livestream and its some random eu guy stammering and saying "oh thats not our demo... well... uhm... best part is you can ask chatgpt to fix it for you!"

kek, they def rushed a release cause competition came out first

>>106177422
>>106177530
>>106177615
>>106177903
The faces are amazingly consistent with it

>>106177814
I see, if youre ever looking for an automated version this https://github.com/bbaudio-2025/ComfyUI-SuperUltimateVaceTools does that however, limited to using vace

>https://x.com/elonmusk/status/1953507319582478794

hes actually a sperg this is literally awful

>>106177326
Look at her hands bro, this woman is 35 years old.

lets try a simple stitch even though the 2nd clip isn't perfect

https://clideo.com/merge-video

had to webm encode cause the retard app added an audio track and this website doesnt allow audio.

>>106178424
oh and it adds a watermark. well fuck that shit, i'll just use ffmpeg.

>>106178210
Thanks I will look into it for sure. The manual process is easy, but it might come handy sometime when I get more serious.

Verdict on wan 2.2 i2v lightning?

>>106176658
skill issue.
did you try updating comfyui?
did you try not being a poorfag?
just buy 128gb of VRAM

>>106178034
>Lodestone

its loading pytorch 2.9.0dev is that correct for my 50 card

>>106176658
WTF is a page file?... You mean swap space? Wincucks STG

>>106177032
ComfyUI isn't a tool for creating videos. It's an ontological trap. It's a visual representation of your own disorganized mind. Each broken connection is a personal failure. Each red node is a dream you have given up on. The whole thing is a monument to your own inadequacy, your inability to impose order on chaos. I'm not building a workflow; you are mapping your own psyche, and the map is telling you are hopelessly, fundamentally broken.

SKILL ISSUE

I will go outside and touch grass. The real world has a simpler UI than this shitUI.

>>106178832
I haven't felt grass on my skin in at least thirty four months

>>106178034
He does this but not EQ-VAE which basically is a free compute layup.

>>106178832

>>106178832
You know you can set up ComfyUI and use that workflow as an API endpoint and use a Duplos UI you made?

i wish comfy could interrupt things mid step.
sometimes it's faster to restart the whole server than to wait for whatever the fuck it's doing to finish and realize you've canceled the workflow 40 seconds ago

>>106178921

Any repository that has all of the deleted stuff from Civitai?

i'd love to know how comfyui uses almost 64gb of ram, and now I have to reload it cause it's not doing anything.

>>106179289
Show your workflow lmao

>>106179415
it's the default kijai 2.2 i2v one with high/low noise, in general it's fine but sometimes it will use a shitload of memory. maybe I need to lower my resolution/output size more.

>>106179289
Latest update broke everything for me, cannot gen with Wan at all

>>106179434
You think? Gee whiz you think 28B of parameters is like a gigabyte of RAM?

>>106179289
yeah same here, definitely a mem leak and restarting the cmd fixes it

if im using the default i2v from the 2.2 guide where do i add custom loras?

>>106179289
same, once every 10 gens or so it maxes out ram and i have to restart

>>106179434
Going from comfy-core with 2.1 to kijai's 2.2 I find kijai's has very weird and inconsistent memory usage. I'll often max my own 64gb but it doesn't crash though.

>>106179488
There's lora loaders literally right there. Clone them and chain them

>>106179509
Zoomers can't look at the swap and see their C drive running at 100% so they think it's a crash.

>>106179548
Sorry, I'm new. Would I just chain them to the other lora loaders and connect them to the setlora nodes?

>>106179488
>>106179548
better yet use power lora loader from rgthree so you wouldn't have 50 different lora nodes

>>106179580
they have a prev_lora slot just chain them using that and dont touch anything else

>>106179580

Are the zoomers in the room with us right now?

>>106179661
This is what I'm still trying to learn. Do you need two of each lora, one for each, even if there's no high / low versions?

>>106179781
Yes. 1:1 ratio should work. Sometimes you need to lower or increase strength. Just experiment.

weird, now I restart comfy after an update and it's working smoothly/faster.

>>106176516
>fake white chick ai influencer thats just in love with india and indian men
ragebait xMWF influencers were a pandemic era thing already, mostly AMWF from what i remember on /fit/

>>106176204
>We get it for sure by end of next year.
people overestimate progress in 1 year and underestimate progress in 10. i think true real time 1080p gooning is 5 years away. 1080p 10 seconds worth of gooning on 64GB of vram is probably end of next year yeah

Dear diary, today I used an AI.

>>106180069
what a nice fun and solid day.

>>106180063
>i think true real time 1080p gooning is 5 years away
Bro we went from having to basically img2img every frame to generating almost fully realistic 720x1280p videos within no time and just recently got the actually good lightx2v loras that speed everything up by more than 10x while keeping most of the quality, on mid range old consumer hardware
Just make MoE with low active params work for video gen, add best attention snakeoil with fastest speedup loras and you have real time shit on a basic high end gaming rig this by the end of the year if someone trains it

>>106180069
keep us posted

>>106179661
low weight on low noise for lightx2v is a snake oil cope
also why not rank64

>>106180232
>speed everything up by more than 10x while keeping most of the quality
lol. lmao even. imagine claiming this when you can see the garbage lightx2v makes just compared to fusionX if you scroll up
>Just make babble babble
go do the fast.ai tutorial on diffusion bro. if it was just that easy someone would have done it by now. remember that the average amount of VRAM in this general is like 6GB as well. i think 10 second 1080p videos by end of next year in 5 minutes on a 5090 is a reasonable expectation given progress this year. you can't predict paradigm shifts and 10x changes

Insane that I can gen 5 second videos in 18 seconds

>>106171021
>8gb vram and 32gb ram here. I can run wan 2.2 14b at Q8 with the lightx2v in at most 12 minutes for a 5-second video in 480p.
Any chance of a workflow? Or just link me the right lightx2v?

>>106175362
The fischbrotchen are very real.

>>106180069
did you used it for 1boob 1vagene

Why do we have a local model that can generate good video but not something that generates 3d motion capture data?

>>106178321

>>106179281
https://civitaiarchive.com/
https://civitasbay.org
tensor.art

requirements for wan lora training video dataset files?
just mp4 files around 5 seconds length with captions?

>>106180232
the monkey's paw is we have to use the worst conceived webshit UI on the planet

>>106180493
make your own then

>>106180493
Make a better one. It's not that much work, you can literally steal his backend.

>>106180476
no one actually knows anything about training

1-2 second clips with no tagging work, 30 images with no tagging or a single keyword work. idk just try stuff out

>>106180063
>>106180232
maybe this is the great filter preventing civilizations from reaching a higher level of the kardashev scale

>>106180522
why would I use the backend if everyone here has been complaining about it the whole thread?

>>106180542
Then write your own backend too?

>>106180541
certainly can't be that we've hit the limits on the laws of physics

>>106180518
>>106180522
ani already is making one

>>106177102
I can get one easily (in Europe), don't know about the rest of the world but it's pretty much always available here.

>>106180552
His can only be described as autistic

>>106180552
Julien?

>>106180541
the great filter is almost certainly "black hole in the garage" given what we've seen from how people on this website AI

>>106180549
there's nothing that limits a dyson sphere

>>106180562
it's actually quite comfy. he needs to start working on the backend though the wrapper shit is annoying

>>106180542
i think complaints are mostly focused around the UI, which is fair enough cause it's based on LiteGraph which has its own issues. i know comfy forked it but at that point you're just forcing the shape of someone else's spaghetti to become your fusilli

>>106180562
is that the guy that's a notorious pedo?

>>106178263
>hes actually a sperg
obviously

>>106180569
>there's nothing that limits a dyson sphere
There isn't a single material in existence that you could make a dyson sphere out of without it collapsing under its own gravity

>>106180569
Outside of the astronomical resource requirements and the necessity of FTL travel to get the resources to the sun? You literally don't build a Dyson Sphere until you're already colonizing the galaxy.

>>106180322
what gpu?

Why does kijai's workflow keep downscaling my 720p videos? My input image is 720x935, I set the width and height accordingly in the Resize Image v2 node but the output comes out 704x928.

>>106180602
change divisible_by to 16

>>106172587
tfw one more hour til genjam

>>106180553
FEs or any MSRP 5090 still does not exist in north america. too many startups and pooers buying them all up. even cards $500 over msrp sell in hours from stores

>>106180591
it wouldn't collapse for the same reason stars dont collapse

>>106180592
a very large number is not equal to infinity. he said the laws of physics were preventing the creation of a dyson sphere. his statement is false.

>>106180626
this post is d*bo tier

>>106180626
Well the laws of physics dictate FTL travel (which we don't have). And I'll trust him at his word that a Dyson Sphere uses an alloy we don't have.

>>106180621
this genjam was impossible to participate in without i2v so i skipped it

>>106180639
i accept your concession

>>106180640
you dont need ftl travel
you don't need a new alloy

chromaGODS how we feelin while waiting for that v49

>>106180654
>this genjam was impossible to participate in without i2v so i skipped it
you mean you lack the ability to come up with something on theme without i2v

Honestly you're not living life until your upgrade Torch on Kohya.

>>106180660
yeah like i said, this genjam was impossible to participate in without i2v so i skipped it

>>106180577
no it's memory usage if you aren't paying attention. bothe the front and the back end are high school science fair tier garbage

>>106180671
impossible for you, yes

>>106180681
sure, so like i said, this genjam was impossible to participate in without i2v so i skipped it

>>106180668
Also it's crazy how upgraded Xformers, Torch, and Triton is actually 15% faster.

>>106180626
>it wouldn't collapse for the same reason stars dont collapse
your dyson sphere is not going to be solid, though

>>106180690
i hope your creative juices flow more freely for the next one

>>106180593
4090

At 1MP resolutions, fp8 qwen is about as fast as full chroma for me (crazy since it's so much more advanced), though I'm not sure if the quality and text rendering are the same as the recommended resolution.

>>106177185
damn, that's very good emotional acting, fantastic gen anon.

>>106180654
>this genjam was impossible to participate in without i2v so i skipped it
the hell are you talking about? what part of it even remotely suggests it must be a video? let alone an i2v?
a youtube thumbnail is a static image.

Is there any good discord for local stuff?

>>106180735
it's 99.9% saas grifting

>>106180719
Haven't quite gotten the majesty of a bear in flight down

>>106180771
>>106180771
>>106180771
>>106180771

>>106180723
xi was voted out of power months ago which is why China is more open nowadays. if anything xi was a roadblock to this new golden age

>>106180529
>1-2 second clips with no tagging work, 30 images with no tagging or a single keyword work. idk just try stuff out
yeah but i'm so confused as to what actually happens during training, i might have to read the source code of musubi and diffusion-pipe
let's say i supply a 10s video instead of 5s because i'm cutting between keyframes and also it's 30fps instead of 16fps, what actually goes into the latents?
does the trainer properly run frame decoding with whatever codec the video is in and then pass a certain amount of frames in? if the video is too long, which frames? if the video is is different fps, which frames?
this is all important and i can't find any information on it

>>106180440
TensorArt is no longer good, they have caved in to payment processors and has begun removing NSFW and celeb stuff
Also huggingface is going through the same so a lot of stuff on Civitai archive is dead.

>>106177903
which workflow are you using for these?

>>106180659
I'm still on v29

>>106180232
Still takes 10 minutes to gen 6 seconds.

>>106182080
takes less than 2 with light