Thread 106312195

Discussion of Free and Open Source Text-to-Image/Video Models

Sipping margaritas and phone-baking
Prev: >>106308594

https://rentry.org/ldg-lazy-getting-started-guide

>UI
ComfyUI: https://github.com/comfyanonymous/ComfyUI
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI
re/Forge/Classic: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassic
SD.Next: https://github.com/vladmandic/sdnext
Wan2GP: https://github.com/deepbeepmeep/Wan2GP

>Checkpoints, LoRAs, Upscalers, & Workflows
https://civitai.com
https://civitaiarchive.com/
https://tensor.art
https://openmodeldb.info
https://openart.ai/workflows

>Tuning
https://github.com/spacepxl/demystifying-sd-finetuning
https://github.com/Nerogar/OneTrainer
https://github.com/kohya-ss/sd-scripts/tree/sd3
https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
https://github.com/tdrussell/diffusion-pipe

>WanX
https://github.com/Wan-Video
2.1: https://rentry.org/wan21kjguide
2.2: https://rentry.org/wan22ldgguide
https://alidocs.dingtalk.com/i/nodes/EpGBa2Lm8aZxe5myC99MelA2WgN7R35y

>Chroma
https://huggingface.co/lodestones/Chroma1-HD/tree/main
Training: https://rentry.org/mvu52t46

>Illustrious
1girl and Beyond: https://rentry.org/comfyui_guide_1girl
Tag Explorer: https://tagexplorer.github.io/

>Misc
Local Model Meta: https://rentry.org/localmodelsmeta
Share Metadata: https://catbox.moe | https://litterbox.catbox.moe/
Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-one
Samplers: https://stable-diffusion-art.com/samplers/
Txt2Img Plugin: https://github.com/Acly/krita-ai-diffusion
Archive: https://rentry.org/sdg-link
Bakery: https://rentry.org/ldgcollage

>Neighbours
https://rentry.org/ldg-lazy-getting-started-guide#rentry-from-other-boards
>>>/aco/csdg
>>>/b/degen
>>>/b/realistic+parody
>>>/gif/vdg
>>>/d/ddg
>>>/e/edg
>>>/h/hdg
>>>/trash/slop
>>>/vt/vtai
>>>/u/udg

>Local Text
>>>/g/lmg

>Maintain Thread Quality
https://rentry.org/debo

comfy should be dragged out on the street and shot

I don't know why many people on discord servers are obsessed with GloRas. I can never manage to get good loras with it, they are always undercooked and if I change settings they burn fast. Normal lora still gives me better results than Glora.

Does anyone have some training settings? Can we share Lora settings in this thread?

>>106312199
>ComfyUI
>UI is not comfy at all
I have yet to see a nodes program that isn't aids. The idea of nodes is to make development easier but in practice it's always the contrary.

>>106312229
Lora and lycoris are the only ones worth training so far. It would probably be smart to compile working settings on rentry or something like that.

>>106312259
People say X model or Glora is better but on the end if only 3 autists use them and there is almost no information about those, you are better off using more popular models with more information about them, even if they are a bit worse.

The fact we don't have some tables or charts about what settings are better for loras is criminal. After these years the lack of guides is bad.

>>106312290
>The fact we don't have some tables or charts about what settings are better for loras is criminal
Calm down Cartman

Blessed thread of frenship

>>106312290
Because most of the training settings have nothing to do with the quality of the lora. Steps, learning rate and lora rank are basically the only things that influence quality. Everything else is more about speed/optimization. The dataset is by far the most important aspect.

Steps = 4,000 steps as a base. If the training samples matches your images, then you can end the training early.
Learning Rate = just keep that shit as low as possible. 0.0001 if using anything but prodigy optimizer.
Lora Rank = Lower rank makes it more compatible with other loras. Higher rank makes it less compatible but you get more finer details. 16 or 32 is fine. If you're doing something like a style lora with thousands of images in the dataset, it'll probably work better at 64.

You can always play around with those but your main focus should be building a solid varied dataset with good captions.

>>106312290
I actually pester these people for settings and every single time the results have been complete ass. The problem is that many people look research papers as guidelines.

>>106312240
Unreal Engine 4's entire engine runs on blueprints, which is node based. People have had no problem making complex 3D games use nodes.

Blender uses nodes for their shaders. People have had no problem with that either.

Unity, another 3D engine, also uses nodes for shaders and some visual scripting.

If you think the leading engines are all "aids", then that's a (You) problem.

>>106312360
>0.0001
that's so low that it might not be able to pick up the concept

>>106312408
I've made dozens of lora that turned out perfect so ive no idea what you're on about.

>>106312394
On discord I always see jackasses saying my settings suck, then I try theirs... And I get worse results than what I was using before.

I'm always better off blind guessing and using my intuition than using their settings. I always have to change stuff and at some point I change so many things that I'm better off using my own settings.

I just don't want to be constantly blind guessing. I still dont know the point of the network, why some people use 1/2 ratios vs 1/1 ratios with the alfa, I don't know the average learning rates
>But anon all datasets are different
There must be an average and some values to touch around. I've seen people laughing at me because I used too many epochs or high learning rate.

Nigger, there are no guides about correct values.

>>106312394
What do you mean.

>>106312423
Post settings please. And images if you can.

>spent the entire day trying to gen something
>quality always turns out shit
>start thinking my workflow must be borked
>change sampler/scheduler/steps/cfg
>all shit
>try a different wan lora with my original workflow
>works fine
>the lora i was using was just shit despite following the creators exact settings
>everyone in the comments praising it and have no problem gen'ing with it
sigh
i just dont understand

https://civitai.com/models/1874153/oral-insertion-wan-22

>>106312423
is that with a constant learning rate?

is prodigy a meme optimizer

>>106312456
I mean that you can use optimal settings copied from researchpapers but still get much better results from something that should not even work. Rank/alpha values, restarts, dataset, tagging etc.

>>106312468
Just because my settings worked for me doesn't mean it'll work for you.

>>106312490
Yes

>>106312516
>is prodigy a meme
Not the anon who suggested it. It's not bad. Can take a bit to get to the optimal rate when constant at 1e-4 adamw just werks. My favorite so far is automagic.

lora+ is also decent as a free boost for training vanilla lora's on adamw

>>106312542
Qwen edit is out!

>>106312483
most people on civitai are monkey-brained retards who clap and cheer for the sloppiest of broken slop. don't trust the recommendations of civitai users, always test things yourself

>>106312549
>lora+
The what now

>>106312483
works well for me. even on low quality images

>>106312582
are you using lightx2?
what strength for both high/low?
steps/end_at_step values?

>>106312351
>>106312199
the duality of man
>doomscrolling
>see pic related
guess im thinking out loud too much near these hot mics
BEAHAGAhAHAH

>>106312609
loli asmr is the best thing ever

>>106312602
Nta but it works for me as well, i use lightx2 with native workflow. For that specific lora; both at 1.00 strength. I use 10 steps total with 3/7 split. You could try upping the cfg in the high noise Ksampler, and don't forget the trigger words to make the wiener man show up.

>>106312199
comfyui is good tho. you sound a bit nuts to take offense to that degree.

>>106312675
The preview looks fine in the high noise sampler, but the low noise always turns it to shit.

>3/7 split
what does that mean?
end_at_step 3 for high, and start_at_step 7 for low or something?

>>106312542
Did you have to post loli? You have a dozen loras and you post loli.
And I'm gonna be honest with you, that looks like slop. Don't you have anything better?

>>106312530
So it's all blind guessing in the end.

>>106312552
What's that have to do with me?

>>106312698
>Did you have to post loli?
Yes I did because that's the only subject matter I train loras for.

>And I'm gonna be honest with you, that looks like slop.
Looks comparable to the original images in the dataset so I see no issues.

>>106312710
Ok, can anyone else post their training settings and images?(no loli please)

>>106312721
This Anon is the reason no one wastes time spoon feeding people.

>>106312195 (OP)
OH GOD NOT THE QWEN KEYBOARD!!! CHROMA BROS?????
UHHHMMM WHATS YOUR USECASE FOR LEGIBLE PICS????? UR A CHINK PLANT!!

>>106312721
you go, the loli stays

>>106312721
Start with prodigy/cosine with rank 32, alpha 32, all lrs set to 1. prodigy is retard-proof and makes training virtually impossible to fuck up unless your dataset is bad

>>106312688
>end_at_step 3 for high, and start_at_step 7 for low
No, see screenshot. Also I've got shift (ModelSamplingSD3) set to 5.00 for both.

it is amazing that every thread about imagegen on /g/ is dogshit yet somehow reddit is still worse

>>106312710
Sorry, was checking the cute loli and forgot to unquote

>>106312773
How does Qwen realism compare to Chroma? I'm too impatient to wait around for a NSFW finetune so I just trained Chroma loras and my god they're stunning. I wish I could post them.

>>106312762
I see. It seems you let the low noise do most of the steps. Maybe I need to lower my end_at_step for high noise

>Also I've got shift (ModelSamplingSD3) set to 5.00 for both.
that just controls speed so I doubt that has anything to do with it

>>106312784
its great at super specific styles and text, but its over cooked and does not have any variance between gens at different seeds, it also does not really have good style control

>>106312483
that lora DOES work well for me too, it is even pretty flexible

>>106312408
IMO that's still a pretty common LR, I also trained a bunch with that.

>>106312748
i had to try various settings with prodigy a bunch of times, prodigy schedulefree is the overall easiest variant tho.

>>106312564
>lora+
>The what now
Trains the lora b weights at a higher lr than lora a. You can wrap your optimizer in this (or write custom code) https://huggingface.co/docs/peft/developer_guides/lora#lora-optimized-lora

I found loraplus_lr_ratio=2.0 was good, but I only train a few loras a week and am by no means an expert

>>106312195 (OP)
Time to call it a night.

>>106312698
for future reference: prodding the thread's resident retarded degenerates about being disgusting sexual deviants just makes them post more of their shit. don't do it

>>106312516
no, it is a very successful optimizer that trained a lot of the loras on civitai

i still would give prodigy schedulefree a try first, it tends to be easier https://github.com/LoganBooker/prodigy-plus-schedule-free, less likely to fry the result on more steps

for chroma/flux/... i'd just try adamw8 first, the flowmatch models also seem to fry less even with adamw8 and quite a lot of steps

>>106312199
>blaming the calculator when your math’s wrong
Its your fault anon, do better

>>106312739
>Post pedo shit
>People don't want it

>>106312938
They asked for settings + image and that's what they got. The image is irrelevant. Anon getting butthurt because they didn't like the subject isn't my problem. I do not waste my time training normie shit.

>>106312869
Sometimes it motivates lurkers to post their settings. I just want some guidance by comparing many settings. Most of them are just trial and error, but maybe we can get some averages.
https://github.com/spacepxl/demystifying-sd-finetuning

>>106312483
it seems like that lora works well on multiple models / workflows too, recent rapid-aio as well as the q8 gguf with causvid and lightx2v and without.

this one feels like 3d tries to distract from 2d

>>106312285
... what?

>>106312987
Chroma minus vae plus pixel space. He's researching in the open, so it's not guaranteed to succeed, but cool to see him try!

>>106312748
Also use fp16, not bf16 since it can have covergence problems without some meme bruteforce setting

>>106312854
thats a big pour
isn't that cat drunk enough?

>>106312825
Interesting. I wonder how well it works with CAME optimizer

>>106313041
Trying to apply https://github.com/ShoufaChen/PixelFlow or is it some other version?

Does anyone here know about token bleeding?
If you train with tags like hug and huge, even if they are 2 different concepts, can there be concept bleeding because both have the same token 'hug'?

I don't know how stable diffusion manages tokens.

Can Chroma and Qwen use character loras without them bleeding into each other?
For example let's say I'm using loras for CharacterA and CharacterB. Can I prompt for something like "CharacterA is standing on the left, CharacterA is standing on the right" using both loras without it fucking up like it does with SDXL?

>>106313113
generally speaking yes, it can and will happen quite easily on a larger SDXL training, I'm thinking it's not just the TE either. the overall better performance of newer models like wan/chroma/qwen/... is also because of this.

will it happen so easily as a "hug" concept training (full checkpoint or lora) bleeding strongly into "huge"? I don't think so, not with reasonable training data.

>>106313155
they have a better chance of it working than SDXL. but it's also not the case that the stuff the loras manipulate is necessarily separate, it deppends on how cleanly the lora was trained. just about no one tests this systematically.

if you did a full Chroma or even more so WAN [probably also Hidream or Qwen] training you could likely prompt two entirely characters quite reliably tho

>>106313185
Basically there are two obstacles:

1. Some models aren't good at doing separate characters to begin with. WAN / Hidream [reportedly also Qwen, haven't tried it tho] definitely are much better at multiple separate characters in general, with SDXL it's more of a dice roll how much the characters blend into each other.

2. If it's a character lora training some essentially just make all 1girls / 1boys look like character or change all jackets to the character's signature jacket or w/e. Those just naturally are not going to be very separate if you apply even one (vs the base checkpoint) never mind multiple.

Was it trained like that or did it learn it as new separate(-ish) concepts to a degree that it works cleanly with multiple characters? Who knows. It's definitely much more likely to work that way in full checkpoint trainings tho.

>>106312874
>another tutorial where you need to be hermes trismegistus to understand wtf they are talking about
When will someone make a lora training guide for retards. I don't understand shit what the lora trainer githubs are saying

>>106313364
everything about ai development and training is in a state of flux. the technology isn't settled enough to make a training guide for retards

>>106313041
Isn't working in pixel space giga slow?

Hmm, Qwen is better than Flux but I'm getting antsy about the lack of loras being released (only like 5 a day):
https://civitai.com/search/models?baseModel=Qwen&modelType=LORA&sortBy=models_v9%3AcreatedAt%3Adesc

Specifically I want more artstyle loras. I think I've cemented my belief that NO ONE should ever use a model's default output, because it'll just look like everyone's else's same output if they type in the same prompt. The solution to this problem is that everyone should just use unique loras, then everyone's art will be unique.

>>106312483
This is one of the best working loras I've ever tried, sorry.

pony v7 actually seems really good but its sfw only on a shitty app atm

>>106313433
>Qwen is better than Flux
So is Wan and Hidream. But most people train SDXL because it takes less processing power and they're set up to do that.

>>106313364
Yes, it's complex and not well established, and has a whole lot of variants between algorithms/settings and model types. Almost none of it is intuitive.

You will have to be a more persistent or more clever retard to get something in a few weeks to a few months, like everyone else.

>>106313462
i thought the pony guy gave up on it

>>106313423
The obvious method to work in pixel space is obviously extremely slow, but https://github.com/ShoufaChen/PixelFlow and probably variants of it seem feasible.

>>106312483
everyone has a lora like that. i couldn't get the ass worship lora to work

i hope you know that oral insertion lora is for i2v so if you're trying to do t2v and having issues that may be why

>>106313482
No? its apparently only on the app for now, "partners" next then will open release

>>106313448
I've tired it 10x times and they all distort heavily in the final output. It was working fine yesterday so maybe something changed despite me replicating my exact workflow.

>>106313502
Nope I'm doing I2V. Guess I'll figure it out eventually. I'll try reusing my old workflow that worked with it and trying it again to make sure that wasn't just luck. If it works in the old, then I must've definitely borked something in the new one.

>>106313479
>But most people train SDXL because it takes less processing power and they're set up to do that.
hmm, I'm not familiar with the barriers to training. Is it the case that 24GB VRAM isn't enough to train certain models locally? Can you give me a list of which models would be capable of doing that and which models aren't?

PSA to all Qwen-Image lora trainers: after lots of tests, I realized it seems Qwen memorizes the tokens used in the image captions, and tends to output its usual slop if you prompt anything too different from what is present in the dataset. So apparently (to be confirmed) trigger words are absolutely necessary for Qwen.
I never needed this for Chroma, but it seems that, since Qwen is a larger model with more parameters and layers, Loras don't change the model as much, and you need to explicitly "tell" the model to use the Lora style.

>>106312483
make sure you are using FP16 versions of TE and models for one

>>106313502
this should be illegal

>>106313559
won't someone think of the pixels?

>>106313559
female pedophilia is ok.

>>106313542
You can train a lot on 8-16GB VRAM too it's just even slower with the model layers/blocks/... getting swapped out to system RAM and back Most people simply don't do very slow trainings to begin with as there is finite time most people have for trainings and retries.

No, I don't have a table what works when never mind how fast/slow it is.

>>106313574
Not for the pixels, for the sake of human brains and survival. My dick shouldn't get hard over what an ai shat out.

>>106313546
>Loras don't change the model as much, and you need to explicitly "tell" the model to use the Lora style.
I wonder if that would have the benefit where you could merge every lora into qwen at the same time, without damaging qwen's quality, and then just be able to call each lora via its trigger word. You could just have an infinitely growing model merged with all the loras that everyone makes.

i doubt it but just a funny thought.

>>106313590
ok so it's just a matter of time. yeah it would be interesting to see a table of how long each model takes to train a lora.

>>106313559
first time on 4chan?

>>106313559
You should be illegal

Wait, you probably are an illegal

>>106313599
>for the sake of human brains and survival
we were doing just fine brainrotting before AI. at least with AI now our creativity is unleashed

>>106313500
I don't know much about it, but just intuitively it sounds like in practice it wont scale. Cool research project though.

>>106313502
>>106313574
>>106313726
not on my watch buddy

I don't understand how anon doesn't realize he's going to go to prison. After Roblox they're going to pedo hunt globally.

InfiniteTalk gguf is up, has anyone tried it yet? I cant at this current moment

https://huggingface.co/Kijai/WanVideo_comfy/tree/main/InfiniteTalk

>>106313364
I wanna write a guide but I'm already cringing because there's so much make believe bullshit that for some reason works really well

>>106313730
soul

>>106313783
oh no poor christcucks

>>106313811
If it works really well then it's not bullshit? Or maybe you just think it works well in your specific case based on the type of loras you train and the type of results you personally are looking for.

>>106313783
Pretty sure they're going after real criminals not some guy on 4chan gen'ing his fetish slop. I'd never share my actual real shit.

>>106313829
no, basically every culture believes in civility and doubt you'll find any part of the world where this behavior wouldn't end with your death, even the most corrupt of countries that turn a blind eye don't let faggots like you operate in the open
tick tock

>>106313852
1) Proxy evading grey-CSAM is going to force 4chan to crack down
2) Those gens are guaranteed just the tip and any sane law enforcement agency can use those gens to get a warrant, retard.

>>106313854
nooo not the heckin pedo christcuckerinos

Local Diffusion?

>>106313864
LEA is already all over 4chan and has been for a long time. Mods may delete/ban them, but it won't escalate further than that. It's not worth the time. You're overly paranoid.

>>106313889
I wonder who wins, you or the government
You think they won't crack down on you you're insane and they will root people like you out starting with restricting your access to the internet and forcing you to decloak, that's not even talking about go after the lifestyle factors that make you this way, they're going to find the NEET incels and put you in ze pod:)

>>106313903
Oh no they're absolutely going to do whatever is necessary to make it impossible to ban proxy ban evasions, because we all know you can just as easily spam AI CSAM with infinite rotating IPs and you can produce faster than they can moderate. Just saying this only ends with you in prison or forever silenced on the internet.

>>106313910
what do you mean?

>>106313864
If they are chasing after grey area CSAM they must have a queue a mile long from /b/ at this point, they're not going to chase after some postings of a hot latina flirting with young boys, like are you for real ?

>>106313940
Cute bet anon

>>106313950
Concentrate on leveling up your product and yourself as a man.

>>106313966
Cute coming from some incel that can only act this way because he thinks he safe in his mom's basement

>>106311060
>>106311003
>>106311065
I think qwen edit probably needs its own custom lightning LORA, the lightning LORA doesn't fry qwen image like that

>>106313910
Go away and kvetch about your fever dreams somewhere else, rabbi

>>106313975
I did actually retest with cfg to 1 for the lighting lora, and it worked, pic rel 4 step same prompt/seed, just cfg 1 change. The style change is noticeable but not as before

Babby's first wan(x) output
I used the example script from the hf repo, all default, no comfyui. It used 60GB of VRAM and took 39 minutes.
I even got to witness the infamous wan 1girl motormouth.

>>106313971
I just speak my mind, it flows naturally, no strings attached. That’s how I keep the discussion going long term.
And you're an idiot if you think about me and dedicate posts to me.

>>106313990
oh lol, you forgot about CFG, never mind

>>106314052
Well with regular qwen you had to leave it at the same cfg iirc, only distilled required 1, so I assumed I could do the same with qwen edit... but no, well. I should've tested it immediately after I saw how deeply FRIED the lighting output was but meh

seal team 6 is triangulating my location as we speak

my location: Ms Hernandez's Spanish Class

>ComfyUI-nunchaku still not updated
svdq bros...

>>106314098
Someone warn her, she's to hot to go to prison!

>>106314098
Ay caramba...

>>106314129
Too hot even

>>106314098
bro just noticed the pencil... she stole it!!! ARREST HER NOW!!!

>>106314098
so if this is allowed, I can post a man wearing a thong with a massive penis in a class full of little girls blushing at him? yes?

>>106314187
instead of asking like a pussy just do it anon

>>106313864
see >>106312869 and just report them next time instead of goading them

>>106314187
Do it regardless

>>106314187
No, and this latina does not have a massive penis in a thong

Go be gay elsewhere

>>106314201
he's been posting daily without anyone saying anything and he was permabanned before I said anything today you blind ignorant faggot moron

>>106314187
if you can t2v a penis in a thong then absolutely share that because I highly doubt base wan can do banana hammock cleavage

also men and women are different. latina mommies dont follow little boys home when they think that they're cute

>>106314209
he's a valued member of the /ldg/ community schizoanon

>>106314209
I personally don't give a shit and im not a little faggot to report. I just think it's annoying they can post that shit while the reverse cannot.

>>106314226
that post is a permaban, he just uses a proxy so he'll do it all day because he thinks he's safe

>>106314209
nobody else says anything because we've learned that it makes him post more of his shit retard. permabanning him doesn't do jack shit so the least you can do is shut the fuck about it when you report him because otherwise he just kvetches and posts more

>>106314239
are you fucking stupid? how many times do we need to have this discussion? he knows what he's doing is a permaban, he doesn't need replies because he knows he shat all over the public bathroom, he doesn't need to hear someone scream to feel validation
we've been doing this for months

>>106314226
it's easy, one is faggot shit for homosexuals (go rope) the other is for straight men, can you see the difference yet, you fucking faggot?

>>106314237
He is safe, no legal body will chase after someone for this, you are retarded.

I mean sure, if this was during the Biden administration, and he put a red cap on the latina, then he would probably be on a list.

>>106314252
you are a faggot retard. i'm talking about apples and you turn around and bitch about oranges

>>106313533
So I used my old workflow from yesterday and that lora came out fine. I guess I really did bork something up somewhere. I'm actually glad it wasn't anything like an update or something. Now to have fun figuring out what it was.

>>106314279
how do you inbred mushbrained mutts manage to turn anons not wanting to deal with seeing some faggot neet pedo posting in the thread 24/7 into a political issue?

>>106314337
please stop shitting up the thread with your homosexual kvetching thanks

Local Diffusion?

>>106314431
anons mad at the one guy posting his diffusions atm

qwen edit preserves styles for edits, but doesn't seem to have style strong transfer capabilities .

from this:
https://ar.inspiredpencil.com/pictures-2023/raiden-mgs4-art
>Replace them with a high school girl giving an angry middle finger gesture, but keep the exact same art style.

>>106314130
Damn, very cool

>>106314391
This entire thread is homosexual kvetching. If it's not homosexual kvetching about the latina pedofag, it's homosexual kvetching about qwen, or chroma, or about some fag spamming miku pics, or about the splinter threads, or about comfyui or comfyanon, or about ani, or about one of the million schizos that populate this place. This thread is a locus for homosexual neets to kvetch about various subjects inbetween posting slopped 5second slowmo mp4s of whatever their fetish of the month is for other homosexual neets to complain about.

>>106314337
go away jew and pretend elsewhere

>>106314130
badass

>>106314462
can you give it multiple images or is it the same as kontext where you have to stitch them together

>>106314462
here's an example of style preservation. it actually does not slop the newly-rendered back parts of Meryl and Raiden. I'm pretty sure Kontext would fuck that up.

For style transfer, unless someone figures out a good prompt, I think it could be implemented in a LORA by a smart enough LORA baker.

>>106314534
no idea, waiting for someone else to figure that out lol

>>106313375
>everything about ai development and training is in a state of flux
Yes, but finished models like wan2.2 or chroma are solved.

>>106314657
>chroma
flux

Why is this bitch holding two umbrellas? She's either holding two umbrellas, or holding one closed one.

>>106314337
you fuckin gay or some shit?

>>106314676
this is normal. do you not carry a backup umbrella when it's raining?

>>106314676
more importantly, she's still absolutely soaked. did her umbrella work at all??

>>106314699
No...
>>106314742
Obviously because in all my other gens she refuses to open her fucking umbrella.

>>106314676
I left mine at home before it started raining and she's bringing me an extra (she loves me :3)

>>106314742
we'll reach agi when someone makes an image model that can do this correctly, and when it can make it rain outside a window without making everything inside it wet

a boy sits in a futuristic pursuit hovercraft. the hovercraft takes off flying into the air and making the water ripple. the man with black hair waves at him

I guess he's coming with

>>106314676
It's so funny how this character lora bleeded her characteristics into the display on the building

>>106314807
reminds me of spy kids

I'm scratching my head trying to figure out how to make Chroma understand the idea of a photo taken from far away with a zoom lens. It's a particular look.

>>106314807
that movie was so bad and it had the potential to be good
i liked it as a kid though. lots of hot mommy energy especially at the end now that i think about it

>>106314879
get an example image and use JoyCaption to caption it to know what to write

What's the point of the network in the Lora training? Why do some people use different alpha values? I don't get it. I don't know why ones use 8/8 or 16/16 or 32/16

>>106314820
Not even the worst example of that from all the images I generated.

>>106314901
Do we know what kind of prompts were used to generate the captions for the Chroma dataset?

>>106314901
gemini would be a better choice since that's what chroma was captioned with
>>106314912
iirc network affects how much the lora will learn and how much of the base model it will change. alpha is just to create a value alpha/dim that acts as a scalar multiplier on the learning rate

>>106314898
The black guy in the back knows what's up

>>106314912
https://chatgpt.com/?openaicom_referred=true

I finally managed to fucking create pic related but lost the prompt and I don't know how to tweak it a little bit. Anyone can help?
It's for a profile picture, I just want the same face/scene only with the school uniform being black (normal gakuran) and maybe a more "puzzled" face. Like he's a programmer programming or something.
Anything close enough to that is welcome as long as we keep that Jojo-esque style.

>>106314993
You don't save that info as part of the image meta data?

>>106314993
either qwen edit or illustrious+lora and inpainting

>>106314795
AGI achieved?

>>106315004
To be honest, I'm not even into image generation, I just messed with it because I wanted an original profile picture.

>>106315021
the future is now, glad i can finally quit my job. is this qwen?

>>106315011
Can you make single try with to know if it's worth it, I'm fucking tired of companies forcing me to make an account for anything. I get it but I'm tired of it.

>>106315022
i know this is the local thread but if you don't want to fuck around more than you have to then just ask chatgpt to do

>>106315022
If you just want to tweak it a bit, maybe some img2img workflow would work best? If you want to recreate it from a prompt, then what is your current prompting failing to do?

>>106312405
nta but comfyui is still the worst node interface ever

He was surprisingly eager.

is there a plan for ipadapter now that cubiq isn't maintaining his nodes anymore? it's going to break eventually

>>106315140
nope, comfy is such a cunt that no serious developer wants to keep feeding his shitty ui ecosystem

>>106315024
yeah qwen. funnily it can't render open windows correctly. it keeps combining multiple types of windows, maybe I'm prompting it wrong.

>>106314898
it's based and the only movie i actually own. fitting, isn't it

>>106315186
Must be one of those European windows.

>>106315168
the only people that contribute to comfy are just syphoning money from the VCs. most of them are junior devs that don't really know what they are doing.

Seems with Qwen Edit if you do some calibration markings you can help it from cropping and zooming in.

>>106314954
At what number is considered overkill for most cases then?
>Create alpha value that acts as scalar...
I don't know what you are talking about, can you explain it easier please?

>>106312195 (OP)
Can I generate (good) videos on Wan with just an Intel IGPU and 8 GB of system RAM? I'm willing to wait for hours

>>106315428
try it retard

>>106315332
Divide your dimension (rank) by your alpha. the learning rate is multiplied by the resulting number. So if your alpha is the same as your rank (for example 32 dim/32 alpha) then the resulting multiplier is 1. If it's half your rank, eg 16 alpha/32 dim = 1/2, then the learning rate is cut in half. The alpha acts as a dampener on the learning rate.
>At what number is considered overkill for most cases then?
It entirely depends on what you're training and how much you want the lora to learn. The larger the dim, the more the lora will learn. Rank 16 is generally enough for anime concepts, 32 is generally enough for realistic concepts and all of the details involved. Style loras will generally need dim 64 or higher. Different datasets and network dimensions will require you to readjust your learning rate, either using the network alpha or with other means.

Note my liberal use of the word "generally". There's basically no set rules for any of this. There are rules of thumb but you're going to have to experiment and run tests to figure out what works best for what you're trying to train on.

>>106314676
And the reason I was trying to make an image was to make a video of Silver Wolf walking through a rainy city. And the final result is... pretty bad.

The rain effect is really poor although another gen had it slightly better. The floor, which I didn't like in the original image either, is weird and not at all how wet rainy floors actually behave. The water droplets are also attached to the umbrella in an unnatural way. And the closed umbrella she's holding just sort of sticks to her hand. It also can't really do anime stlye animation for complex motions and turns it into 3D instead.

The transparency effect of the umbrella is really good though, but it sometimes causes shapes to lose their consistency.

I'm still learning though, both image and video generation.

>>106315461
>Rank 16 is generally enough for anime concepts, 32 is generally enough for realistic concepts and all of the details involved. Style loras will generally need dim 64 or higher.
this smells of bullshit. larger dims are better for larger datasets and it takes a lot to get to 64 (thousands of images)

>>106314990
>alpha is a scaling factor that controls how much the lora contributes to the final output
Holy fuck please don't ever use LLMs to try to learn things. The clanker's explanation is technically correct, depending on how you interpret it, but is highly misleading.

Alpha doesn't affect the "strength" of the lora. It is a multiplier on the lora weights' output, but when training the lora you initialize the weights with small random values. So alpha is effectively a multiplier on the learning rate. Cutting alpha in half is the same (almost) as cutting the learning rate in half. You can set alpha as low as you want, the lora weights will just grow that much larger (albeit more slowly) to counteract it. You aren't somehow magically putting a constraint on how strong the lora can get.

>>106315255
>fitting, isn't it
the 2000s was the decade of the robot mommy in videogames and film

>>106315428
no. but while you're waiting to graduate high school you can practice prompting for wan on their website https://wan.video

>>106315472
blogposts like these are so cute because they remind me of my own honeymoon phase

neat, q8 edit model works, 8 step lightning lora works (set to 8 steps)

https://huggingface.co/QuantStack/Qwen-Image-Edit-GGUF/tree/main

31 seconds

>>106315558
>honeymoon phase
Which I feel I'm pretty deep in. For the last two weeks I've been obsessing over local diffusion, to the point that it's affecting my work.

Making some porn image and jerking off seems to get me to focus on other things though.

>>106315529
It's what I learned reading around and it's what works for me. I'm not a pro at this and I don't claim to be objectively correct, which is why I gave the caveat that he should try it himself and find out what works.

>>106315565
remove miku hatsune's hair and replace it with a blonde ponytail.

cute!

>>106315593
and this anons workflow is fine I just added gguf node + connected it to the lora, and clip to default.

https://files.catbox.moe/05a4gc.png

>>106315565
it would be neat if you swallowed a shotgun

>>106315611
do you have to complain every day, it's literally the first test of a new model. get some SSRIs or something.

>>106315461
>The alpha acts as a dampener on the learning rate.
I've read that it's the opposite, that it increases the effect of the learning rate, to the point that it's simply better to leave the alpha at zero and just change your LR as per usual instead of involving yet another variable.

>>106315461
So 32/32 with LR of 0.0001 is exactly the same as 16/32 with LR of 0.0002? What's the point of putting a bigger or lower number then? And why do people use half instead of just changing the LR?

>>106315637
I've heard of people leaving it at 1 and forgetting about it but I've literally never heard of anyone leaving it at 0.

>>106315624
oh don't worry. i'm staying tuned for all the neat tests involving miku hatsune, todd howard, cia, jc denton, billy mitchell, ryan gosling and red sports cars and swimming pools. i can't fuckin wait

complaining about miku while being interested in AI is like complaining about skulls and roses while being interested in street fashion
if those cliches werent there you'd just find something else to kvetch about

>>106315671
Well, yes, 1.0, my bad, but even so, the dampening effect of lpha on LR is something I've never heard before, quite the opposite.

>>106315678
it's called iteration anon

>>106312360
>Steps, le and rank are the only things that matter
I didn't know that, it's very simple them. What would you change first of the three to improve results ?

>>106315654
I'm going to give you the explanation from kohya-ss github since it explains it better than I could
>The smaller the Network alpha value, the larger the stored LoRA neural net weights.
>How much the weight weakens when used (usage strength) is calculated by "Network_Alpha/Network_Rank" (roughly a value between 0 and 1) and is closely related to the Network Rank number.
>If the accuracy of LoRA after learning is not good enough, the weight data may be too small and collapsed to 0. In such a case, try lowering the Network Alpha value (=increasing the save weight value).
>The default is 1 (that is, maximize the stored weight value).
>If Network Alpha and Network Rank have the same value, the effect will be turned off.
>For example, with an Alpha of 16 and a Rank of 32, the strength of the weight used is 16/32 = 0.5, meaning that the learning rate is only half as powerful as the Learning Rate setting.

>>106315273
Yeah, seems good.

>>106315709
it's called you're a subhuman piece of trash

it gave him nips

>>106315723
and you hang out in a thread to be mad at miku hatsune on an anime website...why?

>>106315743
i don't care about miku. the point is you have zero thoughts rattling around in your skull. you are a worthless automaton

anyways, miku feet, qwen already beats kontext:

>>106315773
does kontext not do feet

>>106315741
It's fucking Sonic lmao

>>106315721
So if the value is just a multiplier of the LR, what's the point of using it at all instead of just... Changing the learning rate?

Following this, 8/8 Is the same as 32/32 right? And instead of changing from 32/32 to 32/16, changing the LR by X2 would be the same?

What am I missing?

>>106315811
I too would fly my spaceship next to an attacker ship while doing absolutely nothing.

>>106315721
>And collapse to 0
What the hell are you talking about?

I'm trying to improve the quality of T2V gens with wan 2.1 what sort of settings should I be using?

I'm using the lightx2V lora rank64 I2V because the T2V version is garbage for some reason. I'm running it at 8 steps cfg 1 euler + simple @ 1280 x 720

>>106315137
>He was surprisingly eager.
for science

>>106315817
>So if the value is just a multiplier of the LR, what's the point of using it at all instead of just... Changing the learning rate?
Because it seems like it does other things aside from just changing the learning rate.
>Following this, 8/8 Is the same as 32/32 right?
In terms of the effect from the alpha, seemingly yes.
>And instead of changing from 32/32 to 32/16, changing the LR by X2 would be the same?
Seems like it would have the same effect on the learning rate, yes.

>>106315876
Ask whoever wrote it. I'm just quoting it, like I said.

https://github.com/QwenLM/Qwen-Image
>2025.08.19: We have observed performance misalignments of Qwen-Image-Edit. To ensure optimal results, please update to the latest diffusers commit. Improvements are expected, especially in identity preservation and instruction following.
Does this affect comfyui?

Also, where's the qwen image edit workflow?

Good result with Qwen-Image-Edit for simple background removal, but still struggling when I try slightly more complex things.

Currently feels like it was trained on the very specific use cases that they demo and does a good job on those but doesn't generalize well yet.

>>106315921
Comfy doesn't use diffusers so no. I don't think he put up an example workflow for the edit model.

>>106315956
it's basically everything you need to make a visual novel

>>106315982
>buttchin

>>106315921
comfy is never first and has to hamfist the code into his format. whatever can't fit into an existing node it usually ends up being more nodebloat

KijUI when

So.. I just trained a chroma character lora with the diffusion-pipe modified with TRACE and it just worked? Loss was over 1.0 for a bit but ended normally

>>106316026
I see you've gone to the Comfy school of contrast and oversaturation

>>106316026
this is fried
>>106316037
good style transfer but you can see whatever censorship they did working to cover more of her boobs

>>106316059
>whatever censorship they did
i just didnt post the ones where it added nipples lol

>>106316072
lmao nevermind then

>>106315773
change Miku Hatsune's clothes to a black business suit with a cyan color tie, and change her pose to waving hello. she is standing in a grocery store filled with green leek vegetables.

>>106316085
i think because the boobs are so unnaturally massive it fills in stuff since im asking for realism

>>106312483
that lora has worked pretty well for me honestly. weirdly enough it's the opposite for me where most of what i want from wan 2.2 has worked really well, at least from what i've tried so far, but i never once had luck doing anything nsfw related with 2.1

>>106312542
cute butt

>>106316026

>>106316039
>>106316059
You right. Here's CFG 1 (wut)

>>106316194
life experience has trained a LORA for my brain to be incredibly averse to these borderline personality disorder phenotypes

>comfyui new memory management makes me oom after 2 generations after it tries to allocate more than my 128gb ram
oh my fucking god

fix this shit
https://github.com/comfyanonymous/ComfyUI/issues/9413
https://github.com/comfyanonymous/ComfyUI/issues/9413
https://github.com/comfyanonymous/ComfyUI/issues/9413

>>106316108
I challenge you to get it to zoom out and show her entire body. I've been trying for half an hour and the best I could get was a midget compressed into the frame.

the only reason i care about negative prompts at all is so i never have to see a tattoo again

>>106316388
>so i never have to see a tattoo again
based king

why can you not put negatives in the positive prompt? like "no beard" or "no glasses". i know that it doesn't work (at least it seems like it doesn't) but what's the technical explanation for that?

>>106316432
de de de

>>106316432
No, beard!

>>106316317
>he pulled
>he pulled
>he pulled
never update anon. it's never worth it.

change the clothes of the anime girl to a white tshirt that says "LDG" in stylish text, and blue jeans. Replace the desktop computer on the left with a popcorn machine.

>>106316432
actually in theory it should "work", in the sense that it should be taken into account, but the issue is that any association between the tokesn "no" and "beard" influencing the gen is overpowered by the existence of the token "beard" itself in the first place. if that makes sense. "beardless" might be better since its all one word so the suffix may impact it more. "clean shaven" is best of course.

>>106316432
>Do NOT think about a pink elephant!
Text encoders are too retarded for that. Even Qwen, which has a full-sized LLM for that, can't handle it.

replace the anime girl's clothes with a white tshirt and denim shorts.

yeah qwen edit works well

>>106316432
The real answer is that the model's aren't trained that way. The image caption models are instructed to describe, not to negate.

So what free software do we have regarding music creation? none of that suno stuff. I want it run locally.

Has the tech got to the point where you beatbox to the ai a tune then add a prompt telling what the sound I just made should be?

>>106316551
also if you do a different pose or gesture, it maintains the artstyle (so cartoonish for fortnite)

>>106316432
Basically captions are all positive descriptors. They really *should* train T5-based models with negatives though. e.g. This picture is not a dog.

lets do a realistic test.

the japanese woman with large breasts is holding a heineken beer and is crossing her legs.

Chroma1-HD-Flash.safetensors is superior. krea lora and vidya lora

>>106316608
try to get it to reframe the image to show the subject's whole body.

Anyone else not using lightx2v for wan 2.2?
The results are way too shit, and the slow mo is annoying.

>>106316593
Ace-Step is the best local, but it's not near current day Suno / Udio, they are currently training their new 1.5 version, which could be out any day.

>>106316651
>broken leg
>leg on the pool side but actually under water

>>106316621
the japanese woman with large breasts is sitting on a chair in the classroom, writing on a piece of paper with a pencil.

>>106316704
gosh how embarassing

>>106316709
the japanese woman with large breasts is standing beside the chalkboard in the classroom that has "LDG" written on it in chalk, she is pointing at the chalkboard. keep her expression the same.

>>106316737
looks like a 4o output. yikes

>>106316754
is it good enough to augment datasets for loras?

>>106316754
diff image

so it doesn't have the hobbit problem

>>106316760
well yeah, the local gpt-oss model wrote part of the prompt

>>106316332
First try.

> Make her stand with one leg in the air. Her body proportions, height, and weight stay the same.

>>106316836
nice, qwen edit and image can do it all seems like. but has someone made a lora like the kontext clothes remover one? for science?

Do you guys use loras trained on realistic content for 2D?

is there any point in wan in using cfg > 1 for the low noise model? It seems to be that once the high noise has done the basic job, cfg can be kept at 1 for a faster result.

https://github.com/Cerzi/videoswarm/
> A mass video player for easy browsing of large video datasets

the japanese woman with large breasts is holding a milk carton that says "MILK", and is waving at the camera. keep her face and facial expression the same.

Trying wan 2.2 i2v with that 4step lora thing.
Can someone give me a workflow? CFG settings? Steps? Should i still use dpmm++ sde gpu or just euler?

Sorry i'm new to this

>refersh comfy nunchaku
>no update yet
WHEN ARE THESE CHINKS UPDATING IT REEEEEEEEEEEEEEE

I wonder how long until we see this in MTG:Arena

>>106316915
don't ignore me!

also i have a 5070ti so what do i do

replace the background with a grass field. In the distance there is a large billboard with a milk carton that has the text "MILK" on it, beside a cartoon cow.

>>106316879
that looks like CPU rape

>>106316940
I would say soon given Wan "just werks" but Wizards of the Coast groomed the woke anti-AI zealots so they won't have the balls to run off their last bastion of paypiggies

>>106316915
https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo2_2_I2V_A14B_example_WIP.json

Just use the provide kijai example.

>>106316915
>workflow
same as your non 4step one

>CFG settings
4/4

>Steps
4/5

>Should i still use dpmm++ sde gpu or just euler
honestly I see no difference so I just use dpmm++

the japanese girl is sitting on a white beach chair at the beach and is holding a tropical drink.

very impressive, kontext would have made her 2 feet tall.

>>106316976
would kontext even be able to handle that much lewd

>>106316957
>>106316976
what model is that, I want to try this

>>106316991
https://docs.comfy.org/tutorials/image/qwen/qwen-image-edit

using Q8 from here:

https://huggingface.co/QuantStack/Qwen-Image-Edit-GGUF/tree/main

also, im genning with the 8 step lightx2 lora for qwen that works, 8 steps, cfg 1.0.

>>106312854
Time to cut kitty off and call them a cab.

>>106317000
thanks anon

so why do workflows still set framerate of wan 2.2 to 16 if 24 is the new one?

anyone tried to use radial attention?
https://github.com/woct0rdho/ComfyUI-RadialAttn

>>106317044
24 is only for the 5B model, 14B is still 16.

>>106317044
the framerate is arbitrary and you can set it to whatever works best

the japanese girl is standing on sand at the beach and is holding a beach ball. Behind her is a large tidal wave that is 100 feet tall.

dont worry, she will be fine.

>>106316967
I'd prefer the art at least stay non-AI, since what they're doing now consistently produces bangers anyway

Maybe Riot will use this and charge $500 for an animated splash art

the japanese girl is splashing water around standing in the water on a sunny beach with sand and palm trees, on a sunny day with a blue sky.

kontext is kill, this works way better.

>>106317104
friendship with flux ended, qwen is my new friend

>>106317104
the japanese girl is splashing water around standing on a sunny beach with sand and palm trees, on a sunny day with a blue sky. she is facing away from the camera, and is showing her ass.

ass is an easy prompt for getting them to turn around. same with shoes for showing feet.

>>106317104
>kontext is kill, this works way better.
you should make a few comparison shots

>>106317156
from initial testing, kontext had a tendency to make people hobbits or flat. someone said it's on purpose to avoid "deepfakes".

censorship once again ruins stuff. but kontext is decent at style edits, but qwen is much better.

>>106316177
holy sameface

>>106317180
>from initial testing, kontext had a tendency to make people hobbits or flat. someone said it's on purpose to avoid "deepfakes".
that's even more retarded than their hate against nsfw

>>106316177
me in the middle

>>106317192
buttchin family

>>106316859
I read that it can remove clothes, just doesn't know breasts/genitals well

>>106315914
>Because it seems like it does other things
And what are those? I'm interested in knowing

>>106317180
no, it doesn't always do it, so it's probably incompetence just like butt chins

>>106316786
It absolutely has the hobbit problem if you try to force it to show the whole body

>>106317227
I wouldn't even be shocked if they fucked up training and switched the width/height on 30% of the training images

>>106316940
It could work and it's basically free, but the (vocal) MTG playerbase wouldn't take well to AI content.

remove the text that says "cyberpunk". replace it with the text "miku" in the same style. replace the man in the image with Miku Hatsune, in a black leather jacket.

>>106316940
>>106317098
both the edits you made could be done by a beginner in an hour with after effects 10 years ago like golden cards in hearthstone

>>106317264
but this is something that you could not after effects

post more mtg edits though, i'd love to see some unhinged cards animated

>>106316836
Do it without changing the pose or scene contents from >>106316332

>>106316879
The ultimate gooner software

>>106316879
guys this is literally just the matrix on the bald dude's computer screen but zoomed in 10,000x

>>106317276
Yeah I was just trying out a LiveWallpaper lora, I like that style of effect for animated cards/splash arts

I'm gonna download the 14B I2V model now and see if I can get better results without the lora

Do cloud services like runpod block you if you generate big titty 1girls? I know the Google notebook thing that everyone used back in the 1.4 days would lock accounts out for “misuse”

>>106317054
Its far too unstable to use for anything. The 3 times it worked, it was even slower, despite meeting all of the requirements to run it.

make the image realistic.

rei if she real:

>>106317576
that's even more cartoony than the cartoon

>>106317485
I wonder if it's the implementation, since I don't think this is official

Qwen-Image-Edit told to uncrop a photo. I'm sure if kontext did this someone would accuse it of "safety"

>>106317527
anime : v
flux interpretation : w

So how exactly do the light loras make wan faster anyway?

>>106317597
why would anyone do that, the face is never gonna look right

Fresh

>>106317608
>>106317608
>>106317608

lets see how multi character edits fare:

the anime girls are all sitting on a white chair.

success!

>>106317449
no. you are literally getting your own virtual instance that you have to configure to do whatever you want.