Double Major Edition

Discussion of Free and Open Source Text-to-Image/Video Models

Prev: >>105658422

https://rentry.org/ldg-lazy-getting-started-guide

>UI
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI
re/Forge/Classic: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassic
SD.Next: https://github.com/vladmandic/sdnext
ComfyUI: https://github.com/comfyanonymous/ComfyUI
Wan2GP: https://github.com/deepbeepmeep/Wan2GP

>Models, LoRAs, & Upscalers
https://civitai.com
https://civitaiarchive.com
https://tensor.art
https://openmodeldb.info

>Cook
https://github.com/spacepxl/demystifying-sd-finetuning
https://github.com/Nerogar/OneTrainer
https://github.com/kohya-ss/sd-scripts/tree/sd3
https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
https://github.com/tdrussell/diffusion-pipe

>Chroma
Training: https://rentry.org/mvu52t46

>WanX (video)
https://rentry.org/wan21kjguide
https://github.com/Wan-Video/Wan2.1

>Misc
Share Metadata: https://catbox.moe | https://litterbox.catbox.moe/
Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-one
Archive: https://rentry.org/sdg-link
Samplers: https://stable-diffusion-art.com/samplers/
Txt2Img Plugin: https://github.com/Acly/krita-ai-diffusion
Bakery: https://rentry.org/ldgcollage | https://rentry.org/ldgtemplate
Local Model Meta: https://rentry.org/localmodelsmeta

>Neighbors
https://rentry.org/ldg-lazy-getting-started-guide#rentry-from-other-boards
>>>/aco/csdg
>>>/b/degen
>>>/b/celeb+ai
>>>/gif/vdg
>>>/d/ddg
>>>/e/edg
>>>/h/hdg
>>>/trash/slop
>>>/vt/vtai
>>>/u/udg

>Local Text
>>>/g/lmg

>Maintain Thread Quality
https://rentry.org/debo

>>105662481 (OP)
1st for fatty wans

Blessed thread of frenship

>>105661660
>https://civitai.com/models/1612109
the examples look really good but how does it compare to the illustrious version of lumina?

>>105662074
To be fair you wouldn't even need to write them for a lot of models, only the most popular ones would be enough, like illu, noob eps and vpred, chroma, wan
>>105662165
>simply copy the settings
A lot of the good ones don't have any metadata, or were trained with on-site settings, especially styles, and like the other anon said, you would have to change them if you want to train on another model
Wan's don't even have any metadata at all

>>105662522

>>105662522
based

>>105662527
anyone know how to prompt this thing? or what kind of data and tags it's been trained on? the examples look good but if I try and reuse prompts from illustrious I get suboptimal results.

>>105662610
artist:artfaggotry

>>105662610
i might join their coomcord later i doubt anyone outside of there really knows how to use it best unfortunately

>>105662610
the model page says it's kind of unstable and hasn't been tested enough to confirm a proper usage method.
it uses gemma, i guess it was trained on hybrid captions so use a big detailed paragraph and a list of tags.

>>105662527
>Extremely High Difficulty of Use: Due to the reasons above, the barrier to entry for using the current model is very high. It may require specific parameter tuning and extensive experimentation to generate specific content, and the results might not be satisfactory. Please be fully prepared for this.
Promptlets our response?

>>105662527
Going off the examples neta looks better IMHO. Right is ilu.

>>105662651
crazy how model trainers will spend thousands of dollars and weeks of manpower to train a model just to give it ZERO documentation.

>>105662696
i think a comparison with the same settings (prompt/sampler etc.) would be better. but obviously lumina will win because it has an extremely good vae/text encoder

>>105662719
They are both based on Lumina2 https://huggingface.co/OnomaAIResearch/Illustrious-Lumina-v0.03

It's here:

GTA: WAN City
https://files.catbox.moe/o226fh.mp4

I hope my low-effort shitpost keeps you mildly entertained for 123 seconds

>>105662610
https://civitai.com/images/80807024

why do you have to prompt like that? it sounds retarded

I'm training a lora and it looks off, it should be enough with 40 images. Images look bad quality. Dataset should be good and correctly tagged. I'm training anime. Please help me out anons.

keep_tokens = 1
num_repeats = 5
shuffle_caption = true

[train_mode]
train_mode = "lora"

[general_args.args]
max_data_loader_n_workers = 1
persistent_data_loader_workers = true
pretrained_model_name: illustriousXL_v01.safetensors
vae = "sdxl_vae.safetensors"
no_half_vae = true
mixed_precision = "fp16"
gradient_checkpointing = true
gradient_accumulation_steps = 1
seed = 400
max_token_length = 225
prior_loss_weight = 1.0
xformers = true
cache_latents = true
cache_latents_to_disk = true
sdxl = true
max_train_steps = 500

[general_args.dataset_args]
resolution = [ 1024, 1024,]
batch_size = 4

[network_args.args]
network_dim = 32
network_alpha = 32.0
min_timestep = 0
max_timestep = 1000

[optimizer_args.args]
optimizer_type = "AdamW8bit"
lr_scheduler = "cosine"
loss_type = "l2"
learning_rate = 0.0003
warmup_ratio = 0.05
unet_lr = 0.0003
text_encoder_lr = 6e-5
max_grad_norm = 1.0
min_snr_gamma = 8

[saving_args.args]
save_precision = "fp16"
save_model_as = "safetensors"
save_every_n_steps = 100

[noise_args.args]
multires_noise_iterations = 6
multires_noise_discount = 0.3

[sample_args.args]
sample_every_n_steps = 100
sample_sampler = "euler_a"

[bucket_args.dataset_args]
enable_bucket = true
min_bucket_reso = 256
max_bucket_reso = 2048
bucket_reso_steps = 256

[network_args.args.network_args]

[optimizer_args.args.optimizer_args]
weight_decay = "0.01"
betas = "0.9, 0.99"

>>105662729
Instrumental version:
https://files.catbox.moe/fzt9g6.mp4

The song is called Jetty by Don Toliver
Here's my conversation with Sonnet 4 making all the prompts
https://files.catbox.moe/h1n4ov.txt
Pretty awesome you can make something like this in a few spare evenings huh?

More twerking jeans gens
https://files.catbox.moe/24qt0s.webm
https://files.catbox.moe/vtqe5u.webm
https://files.catbox.moe/xekfuf.webm
https://files.catbox.moe/5nbrj7.webm

https://civitai.com/models/1095750/neta-noob
https://nieta-art.feishu.cn/wiki/IEzPwnyrUiIy9mkk9TNcQB79nzd
>we used rich and diverse data resources, including dataset from Danbooru (8,400,000) and carefully hand-picked 400,000 pairs. With powerful computing power, we conducted 6 rounds of deep training with 8 x A100 to ensure that the model could learn various features and style essences of ACGN art styles.
interesting

>>105662727
oh snap i didn't know they were training one too. i thought onomanuts were still grifting their 3.5 sdxl v-pred model. gonna download and do a comparison probably.

Miguposting a wan gen. 360p and 121 frames is all I can eek out of my 3090. If I ever get a bigger memory GPU I'll try high resolutions, but I have a feeling the most hentai-oriented data is at 360p.

>>105662729
I think you did a good job
Brought back nostalgic memories from playing the game 20 years ago
It was nice to see it slowly come together as you posted your progress in the thread
Would have been cool if the background music sounded more like it was from the 80s, but oh well

>>105662762
>eps and not vpred
I sleep

>>105662797
too obvious

looks like i can't make comparison they distribute it in fp32 which goes above my vram. corporations hate vramlets...

maybe this is also it. i'm not sure https://huggingface.co/OnomaAIResearch/Illustrious-Lumina-v0.03/blob/main/consolidated_ema.00-of-01.pth

forgive my blindness there's a version that';s under 12gb

At 121 frames I find wan gens will sometimes loop. I think a bit beyond that that always loop, but I'd OOM before reaching it.

>>105662736
very well done, anon
theres some slop but if i was a 2000s kid and played VC i'd think this would be vice city in 2020
very nice
8.5/10

>>105662729
Looks great, seconding that the biggest weakness is the music. Also the general lack of action shots, maybe more scenes with driving.

>>105662797
>Would have been cool if the background music sounded more like it was from the 80s, but oh well
the entire inspiration for this came from the one line in the song mentioning Tommy Vercetti kek, and its a leaked song so it has no official music video

I could have done a much better job, and I have in the past (at least in my opinion) but this kept me entertained while kicking my weed habit and cost 0 dollars to make.

Now I am free to mess around with NAG, i2v, loras and all that fun stuff

>>105662481 (OP)
>SD1.4 gen
Let it go, genxir

>>105662830
Niheiesque

>>105662854
>the general lack of action shots, maybe more scenes with driving
yeah if i were to do it again I would try to add a car jumping and a "INSANE STUNT BONUS $100" reference, maybe a reference to hidden packages as well

>vace can go beyond 10 seconds
>try to go for 20 seconds
>OOM
>have to daisy chain and the gen changes character consistency ever 10 seconds

Well, 96gb ram here we come

>>105662732
desu you should put this in a pastebin next time

just genned a fat girl with a cock. so awesome

>>105662689
my /m/an

fellas, is pony still the best models for something more "realistic" in sdxl? I dont want to go 3min per gen since i like to iterate.

>>105662949
Most would recommend lustify in most cases and if you are looking for porn. Though I think ponyrealism is still good if you want fantastical characteristics like exotic skin color or other physical features.

>>105662949
I did a simple 50/50 mix of https://civitai.com/models/1327813?modelVersionId=1499159 v1 and https://civitai.com/models/1125067?modelVersionId=1471829 v3 with CLIP from the 1st checkpoint a couple months ago and it was performing relatively well. Can't be bothered to check the newer versions though

>>105662729
Post on YouTube with a better and preferably non copyrighted music and racks 1 million views minimum (don't go "blablah I cannot change the track because the whole thing is inspired by a music that mention Tommyyy", we get it but it doesn't fit).

>>105662959
i tried juggernaut which seems to have used lustify and it struggles to make huge clothed breasts
I heard there are some realistic illustrious finetunes, how are they compared to pony?

>still no consistent output
You would think that this would be on top 5 priorities for model and UI coders.

>>105662732
did you look only example images or did you try lora with different prompts? I would turn off Text Encoder training completely and train only UNET.

>>105662732
Completely unrelated, but doesn't sdxl only parse 74 tokens
>max_token_length = 225

>>105663034
last juggernaut is based on lustify yeah. you could try cyberrealistic, the sdxl one, 5.7. both pony and illu based "realism" models just have that hint of plastic. you can of course gen with them and upscale with sdxl.

>>105662949
use chroma svdquant, takes around 50s per gen at 25 steps on 3060

>>105663078
Yeah, it's telling me prompt is too long and it's being truncated. Is it possible to train illustrious with 225 tokens?
>>105663056
Will do that, anon. If anyone can help me with the tokens problem, please do.

Here's three comparisons with marisa/reimu/miku on the publicly available versions of the two Lumina finetunes. Same settings on both. Used Gemma 12b to initially upsample the prompt with this template: https://files.catbox.moe/uw2vrp.txt

Illustrious_Lumina_0.03_ema
1. https://files.catbox.moe/1yu9nj.png
2. https://files.catbox.moe/a8854n.png
3. https://files.catbox.moe/nuvhpq.png (where's miku? it just gave up?)

netaaniluminaAlpha_alphaRound7Ep4S68303
1. https://files.catbox.moe/13iuh2.png
2. https://files.catbox.moe/3oylkt.png
3. https://files.catbox.moe/9kwqam.png

>>105663162
nice neta looks pretty good

>>105663162
you can get access to their huggingface repo through their discord if you want. round 7 ep4 is where they started training on 1280×1280 images i believe, so it's still healing

>>105663162
>RES4LYF
based

>>105663115
Does anyone know how to fix the 225 problem?
Reducing prompts to 75 is not possible because I eliminate a lot of data.
It's must be possible to train an illustrious model with more than 75 tokens

>>105663231
i want someone to upload it to another hf repo or make a torrent

>>105662729
are you actually indian?

deis+sigmoid offset also seems to work

for those with an RTX Pro 6000 blackwell, have you been satified with your purchase for /ldg/ uses?

>>105663366
Surely you'd only buy that for training.

Can I delete the pip cache? Why is this shit bloating so much?

Is there a meta workflow for making 10+ second videos? Has anyone messed with kijai's trick to extend a video? His example isn't very promising.

>>105663301
from memory most tooling should chunk the captions if over the limit, you have shuffling enabled which will help.
I really can't provide any accurate / relevant advice in respect to loras as I haven't really trained those specifically.

>>105663384
it works but there's definitely a transition between chunks

>>105663329
chud

>>105663366
I'm mixed, it's great but it's quite expensive. I use it for training loras/finetunes without having to worry about memory constraints in addition to gens. Gaming performance is a nice bonus. Definitely undervolt it though I have it running at 500 watts and only lost like 2% performance.

Something I should say, you can actually fit Flex in a 5090 so we might actually see a real finetune this year.

>>105663380
your problem isn't the size of the cache, it's the capacity of your storage device. you could just delete the cache but you're saving a paltry amount of GBs

>>105663393
Someone on reddit managed to use the last 15 frames of the previous video to make it more seamless, no clue how they did it though

I can ignore this right? Would like to have everything on my second drive

>>105663577
Why not use the portable version instead?

>>105663592
Because I didn't know there was one. But even if I did, in my mind a portable version is always worse performance-wise. Is having it on a different drive really a big deal? It's also an SSD

>>105663462
I have enough storage but this all this python shit forces itself on my system drive which is a small SSD and I can't fuckign tell it to go somewhere else.

>>105663602
symlinks are a thing

Is there any tool that saves/transforms Lora metadata into a config file for kohya?

>>105663577
>>105663601
I don't see how it could possibly make a difference if the D:\ drive is an internal SSD formatted NTFS by the current version of Windows.

>>105663631
>if the D:\ drive is an internal SSD formatted NTFS by the current version of Windows
It is. Thanks anon, I don't think it will matter either but that prompt made me worry a bit

>>105663625
I've been using Grok2 for that, just show it the kohya config file first and then tell it to convert

>>105663646
I can see that it's not but this is at least to me completely indistinguishable from a good bigASP V2 output

>>105663646
I don't want to use AI language models because they are usually retarded.

I extracted a Jason file from a safetensor file but kohya is not loading the json. I'm starting to hate kohya.

>>105663686
some Zoomer parent is going to name their kid Json but pronounced Jason if they haven't done so already, just you wait

>>105663686
kohya uses TOML not json

>>105663703
I think there is not a single anon here that knows what he is doing. You never answer any of my questions or I get half assed answers.

Am I the only anon here training models?

>kohya

>>105663711
Can you switch from kohya to Lora easy scripts and viceversa?

Is there any way I can take a Lora's metadata and use it as a TOML file for kohya?

>>105663725
What do I use then

>>105663664
if you have patience and hardware to wrangle chroma, I'd say it's much better than asp2 due to lighting and ability to do varied expressions. I think the asp guy is gonna release one more version for sdxl, so we'll see how it does.

>>105663727
>kohya to Lora easy scripts and viceversa
unless something changed recently then no, you need to translate them yourself
>Lora's metadata and use it as a TOML file for kohya
either manually enter shit yourself or just ask claude or something to do it for you

>>105662949
i've been using pony and it does not satisfy me, i think my expectations are just too high because i DON'T want airbrushed pretty women forever in harsh lighting

>>105663727
>filtered by learning rate and optimizer parameters

>>105663757
How the hell is there not yet a tool that automatically does it already?

correct no one else here trains models you should leave and find another place to post

>>105663719
you'll find that most anons here are vramlets and esl/third worlders looking to steal the images for their discords.

i used to train loras for sdxl/pony and now train for chroma. chroma was a pain in the asshole to set up because windows and it's still fairly new. but it works now. everything default and yolo.

>>105663771
No, I just don't want to manually type every time.

>>105663784
>manually type once for 2 minutes
>he says after manually typing on 4chan for 20 minutes
you're not very smart anon

>>105663782
>looking to steal the images for their discords.
Source?

>>105663772
just because one backend has a feature doesn't mean the other does as well. stuff here is still fragmented and different backends focus on different models

>>105663782
Why is everyone masturbating about chroma? Is it that good? I'm still using illustrious

>try out a bunch of realism-related buzzwords
>end up either with plastic bimbo whores with tons of filters or with actually somewhat realistic image, but the girls are almost always butterfaces
I seem to have a severe skill issue. The difference between these two is literally just "beautiful" and "iphone snapshot" in the prompt btw

>>105663799
it's okay for realism stuff

>>105663795
So? There aren't many trainers, how is it that there is no automatic metadata loader for one of them?

>>105663798
This is what I'm talking about, all of the generations are fucking AI slop.

No one here trains shit or puts up the effort. It's all indians.

>>105663804
take an amateur picture and have Joy Caption caption it

>>105663794
i made it up but it's probably happening somewhere.

>>105663799
it has a very solid base. shitposting and "two more epochs" aside: it has been very fun to play with. it understands most degenerate shit but has flux qualiy. however, the meme currently is that it still likes to make bodyhorror very occasionally and it's not a "1girl, standing, smiling" prompter. you need to prompt with natural language with many ESL are incapable of. even their discord still has shizo prompters.

>>105663804
left girl is not a butterface though

>>105663821
what this anon said. joycaption tends to describe styles the way chroma etc expect them.
most realism related buzzwords will immediately deepfry/HDR your image. you need to avoid the retarded "masterpiece, high quality, realistic" shit.

>>105663804
>beauty means botox and makeup applied by paintbrush
i hate ponyfags

How do I solve the 225 tokens problem in Lora easy trainer, please, anyone?

>>105663856
if the model doesn't natively support 225 tokens don't bother

>>105663859
It's an illustrious model

>>105663822
>has flux qualiy
not even close, the hands are fucking garbage

>>105663880
Illustrious = SDXL. Just like noobai, pony and all the other "finetunes"

i have been gooning non stop
2pm, came three times, already drunk

>>105663902
For what I know they are 75tokens, but you can train with 75 chunks, or not?

I've seen illustrious loras trained with more than 75 tokens

>>105663916
that's just chopping your dataset into multiple chunked captions
again, don't bother

death to newfags

I got over genning gingers today.

>>105663804
Try same prompts on V38

>>105663759
bigASP V2 is the largest photographic finetune ever done of SDXL by a uge margin, it's ONLY trained on actual photos and the dataset was 10M images (versus for example 2.6M for Pony V6)

>>105663923
Then how do I train now? Even if I remove tags I still have more than 75 tokens

>>105663998
now that would explain why lustify/bigasp are so much fun to use. the gens sometimes come out better than flux.

>>105663923
Then how do I train now? Even if I remove tags I still have excess tokens

>>105664003
why would you set the token length to less than 225 if you're using Kohya, first of all

>>105663916
it doesn't matter, if it's a style lora just tag everything and click train

>>105664010
I'm not using kohya, I'm using Lora easy trainer but it's saying the tokens are too long so I investigate and I see sdxl models can only use 75 tokens so I try kohya but it sucks balls.

I only want to train a lora.

>>105664005
yeah no other model like at all had ever been finetuned on that large of an all-photo dataset before bigASP V2, and there's no equivalent yet after it either. I'm hoping he does a V4 evenetually on a newer arch, Chroma is good but it'll never be really the same thing just due to the nature of the dataset

>>105664017
You don't know what you are talking about

>>105664033
>it's saying the tokens are too long
is it preventing you from training or is it just a warning? if it's the latter you can just ignore it

>>105664033
Again as I already said, if the model has a strict 75 token requirement all any trainer does to get around it is to arbitrarily chunk your caption or even better truncate it to 75 tokens.

>>105664048
Retard, if I do that the trainer ignores the excess tags and tags gets missing; the model is not trained correctly

>>105664052
I don't want to remove tags, there must be a way for sdxl models

>>105664089
>bro there must be a way to fit one gallon into a measuring cup

Hey anons, want to get back into this after getting out when I moved a few years back during the early days of stable diffusion (3 years ago or so). What kind of hardware do I need for good results? Is an rtx 3080 sufficient? Can I just buy some cheap nvidia gpus for additional vram if not?

>>105664113
For real fun you need something with 16 GB or even better 24 GB of VRAM.

>>105664124
Can I just buy additional gpus or is that not fast enough?

>>105664141
next day shipping is as fast as it gets, can't beat it

>>105664100
How do people train sdxl models then? They don't tag anything?

>>105664141
Additional GPUs isn't great and at best you can just offload the text encoder so you don't to load and unload it. But Wan 14B uses about 20.6 GB peak with some Loras which is where the fun is right now. Also if you have a 24 GB card you can do the other fun thing which is training.

>>105663963
But now I'm stuck genning the crucifixion.

>>105664152
Sorry I meant instead of buying a single gpu with a lot of vram (expensive), could I buy another gpu with maybe 8-10gb vram and have the vram be pooled?

>>105664113
For imagegen or video? If you want just pics you can cope with a 12GB gpu

>>105664159
>75 tokens roughly equals 50 to 60 English words on average.
>needs more than that to train

>>105664089
whatever software it is you're using must have some kind of token length setting, just set it longer

Reminder we don't have a local model that can do this
https://www.reddit.com/r/StableDiffusion/comments/1lgjhfz/how_are_these_hyperrealistic_celebrity_mashup/#lightbox

Rules for thee and not for me.

>>105664192
good. fuck celebs and fuck the retards who are into celebs.

>>105664168
you're willing to invest money into this?

>>105664203
nah, fuck you, people who enjoy cucking a model deserve the rope

>>105664203
I don't give a shit about celebs. But if local models don't have them, what gives them the right to have them?

>>105664192
>celebs
wooow

>>105664205
>invest money
Several thousand dollars isn't a lot for any hobby if you're not absolute destitute poorfag.

>pisses on your output

Cucked/poorly tagged datasets are the number one reason why a model fails to deliver properly

>>105664174
even outside the context of natural language caption, just WD-EVA02-Large-Tagger-V3 by itself will often output an (accurate) tag list that's longer than 75 tokens

>>105664192
>Rules for thee and not for me.
it's sad that the local ecosystem is more cucked than fucking Saas, usually it's supposed to be the opposite

>>105664207
>>105664209
make a lora or cry harder. it's very obviously a twitter bait post to show "hey guys look what we can gen". that entire post and the comments are astroturfing (even if they aren't doing it on purpose)

did the api fag wake up

>>105664232
>needs to use every tag an AI tagger generates because he has no brain
Anon let me give you a quick tip, don't tag more than you want to prompt yourself.

>>105664238
I don't give a fuck about your mental gynmanstic you motherfucker, cucking a base model is gay, you are a faggot

>>105664238
>make a lora or cry harder.

I've never seen anyone make a LoRA of two celebs. Questionable whether it's even possible.

>>105664246
nta but i'm curious, how do you tag your datasets?

>>105664246
in a large and varied dataset you don't want shit to be untagged generally cause then it just shows up whenever it feels like essentially

>>105663329
was also my first thought

>>105664263
And that's why LoRAs are a cope. You can't teach it multiple concepts together. You'd need a finetune for that. Anyways, nothing beats a base model.

>>105664259
wow you really are a little bitch lmao

>>105664263
well probably not. but you can lora + regional prompting or even just inpaint to do the same thing.
and if you're reading this rn and thinking "wow that's too much" you should go to /sdg/ where your kind is accepted.

>>105664287
>You can't teach it multiple concepts together
yes you can dude wtf

>>105664170
>>105664162
Thanks anons. Video is very nice but seems like it might be out of my price range to do properly. I'd also want good text/chat llm functionality, almost like the cloud llms but slower, with no limits, custom agent creation, and large contexts.
>training
I don't really get how this works. So basically I can train it to output things I like and reject what I don't?
>>105664205
Possibly, depends on how much. I guess $3000 would be my limit? Not that I want to spend nearly that much but I definitely want good pictures.

>>105662959
What did you use for this?

>>105664289
>yeah bro, just do this tedious thing to get a subpar result compared to a base model that already knows the concepts
wow! what a great idea retard!

>>105664270
10 word sentence + relevant tags up to the token limit.

>Donald Duck with wide open beak, sailor hat tilted, expressive eyes, vibrant vintage cartoon style. Disney, cartoon, vintage poster, classic animation, iconic character, blue background, sailor hat, anthropomorphic duck, comic art, retro illustration, hand-drawn, pop culture, humor, 20th century, animated icon, expressive face.

>>105664297
Then how come there's no LoRA teaching the models 2, or up to thousands of missing celebs and concepts?

>>105664287
>And that's why LoRAs are a cope.
Loras are a mistake, it's the perfect excuse for corpos to complely destroy a model and tell you to pretend you can fix everything by stacking loras

>>105664287
>And that's why LoRAs are a cope. You can't teach it multiple concepts together
but you can?

>>105664315
>footfag anon is defending the cuckening of local base models
he's getting me more and more dissapointed about him with time...

>>105664311
The purpose of loras is to tease out patterns the model knows but can't be articulated or was forgotten. There is no such thing as a kitchen sink model that can do every single possible output, even 4o has obvious limitations.

>>105664298
>I'd also want good text/chat llm functionality
RAMMAX for this instead of using GPU only

>>105664289
>and if you're reading this rn and thinking "wow that's too much" you should go to /sdg/ where your kind is accepted.
a bit rich to say from an AI bro who can't even draw with a pencil

>>105664308
there are? i have a few loras that know multiple characters or styles. it's called a multiconcept lora. you just give it multiple datasets and make sure you balance them out with repeats.

>>105664240
looks like it. time to abandon the thread until xe gets bored or passes out from the heroin.

>>105664332
>There is no such thing as a kitchen sink model that can do every single possible output, even 4o has obvious limitations.
but 4o knows way more concepts than your regular cucked local base model, I'm not asking for a model to know everything, I'm asking for a model that didn't get through a censorship filter because the Saas niggers don't give a fuck about that in the first place

>>105664355
4o is heavily censored and they'll soon enough block catfish deepfakes if they haven't already if "prompt yourself with a celeb" catches on.

>>105664338
what's better?
>making the model learn 1000 celebrities natively
>or making a "double celebrity lora" that'll cover the 1000 celebrities? plot twist, you'll need 1000^2 = 1 000 000 loras to cover up all the 1000 celebrities double combinaisons

>>105664299
pixelwave flux w/a lora and some inpainting:

fantasy illustration,A fireplace, with two rocking chairs with people. In between them is a small white folded blanket, with a black kitten curled up and sleeping. In one rocking chair sits a female elf, with long blonde hair blue eyes and long pointy elf ears. She is barefoot wearing a brown peasant dress and is sewing a green sweater in her hands. Around her is a rustic peasant cabin in a pastoral fantasy setting. On the other side an old man with short red hair and a long beard sits in a rocking chair smoking a pipe, his legs crossed. He is wearing peasant clothes with boots.
The fireplace is stone, the walls of the house are wood with various ornaments on the wall, darkly obscured by the fireplace.

>>105664361
>they'll soon enough
Wishful thinking.

>>105664289
Masking etc... is still cope. You go from unlimited possible variations to only a few within confined spaces that you think up.

>>105664368
>gets sued because local model generates nude deepfakes of celebrities natively

>>105664383
>gets sued
like HunyuanVideo? Chroma?

>>105664390
Chroma very well could be the first model to get banned and the creator taken to international court if they're not a US citizen.

>>105664355
you're assuming that the local models are necessarily going out of their way to painstakingly ensure very specific people are captioned as exactly who they are to begin with, though. There's absolutely no chance that Grok 3's (shitty) autoregressive image gen can do people like fucking Laura Loomer highly accurately with no specific intent during training for example lmao

>>105663944

>>105664398
>could be
Wishful thinking.

>>105664368
i don't care about any of that dogshit. i agree that the model natively knowing concepts is far better than a lora. i'm talking about your blatantly wrong statement of "You can't teach it (Lora) multiple concepts together."

>>105664405
Actually yes given it has no safety checks and can be generate illegal images.

>>105664333
>RAMMAX
My current server has 64gb, I think I use about 32gb for max loads and maybe 10 on average. Do you think that's enough headroom? Otherwise, I'd probably need to look into building a separate ai server. Would probably need enterprise gear to have enough RAM, and then add a GPU to that for image and video.

>>105664329
who with the what

>>105664298
>be out of my price range to do properly
You can gen 720p wan video with 16gb vram, you will have to use fp8 /q8 quantization but pretty much everyone does.

Of course speed is another issue, but there are already lots of optimizations which gives decent performance on cheaper hardware. I'd say a 5060 ti 16gb would be enough to generate 720p video without breaking the piggy bank.

>>105664413
>it has no safety checks and can be generate illegal images.
like the numerous SDXL nsfw finetunes? did anyone of them got sued?

4o is good because they probably use multiple models. Like they probably have some secret sauce algo that renders different regions and then that is passed through something else to make it look consistent. It's obvious the traditional 1 model concept has plateaued and they're hiding automated workflow techniques. Maybe someone at OpenAI or Google will get fired and make an open source version. Or maybe the Chinese will steal it and release it eventually.

>>105664368
A rank 128 lora on modern models easily has the capacity to learn 1000 celebrities simultaneously.

99% of people have never trained anything, or if they have it's a basic bitch single concept lora overfit on 30 examples, and it shows.

>>105664377
Congrats because it actually looks good especially the faces. krita for in painting?

>>105664390
>HunyuanVideo?
China don't give a shit
>Chroma?
Which celebrities does Chroma accurately portray ?

>>105664383
beyond the celebs people make all kinds of assumptions about how much "NSFW" any given base model actually knew in the first place when they cry about censorship, you don't really wind up with a model that can do it properly (especially not with like multiperson scenes) without quite a bit of very intentional effort. And why would companies who ultimately have commercial interests bother with that? I think most of these models didn't know "NSFW" particularly well in the first place, I don't believe any of them were at one time insanely good at it and then aggressively nerfed later on prior to release.

>>105664398
New antichromosome FUD dropped theyre getting desperate

>>105664423
There wasn't multiple laws passed when those were made. Chroma is a model not yet released and can produce high quality, photorealistic images. Also all it takes is public notice, if someone makes something viral with Chroma and it gets public attention he could be the one to be made example of. It's not if but *when* an uncensored local model creator gets a public flogging much like creators of piracy websites.

>>105664436
> krita for inpainting
Comfy

>>105663405
oh you are lel.
i think it's a bit funny.
jai hind and all that.

>>105664423
it really sounds like these anons are trying to argue that nobody has ever trained a highly accurate celeb Lora in any context before lmao

>>105664413
>generate illegal images.
There's no law against generating celebrities and sexual situations, only posting those images/videos online.

>>105664455
>There wasn't multiple laws passed when those were made.
that doesn't invalidate my point, will those SDXL finetuners get sued at some point because they're keeping those models on the internet?

>>105664426
Well, how come the entire community is taking slow route if it's possible? It's not like it'd be comparable to a full finetune. I know there's DoRA as well, closer to full finetuning, but that never took off for some reason.

>>105664455
>all it takes is public notice
Another Wishful thinking, we got the same discussion when HunyuanVideo was released
>omg a video model that can do NSFW natively? the US will fucking ban it!
turns out currently absolutely no one knows that HunyuanVideo even exists lol

>>105664445
Most aren't good at nsfw because they all use the same curated datasets. As far as I know Hyvid is the only real base model that was clearly trained on unfiltered (but poorly labeled) porn but if I were to guess it was an oversight of what they used to caption a pile of scraped videos. But both SDXL and Flux were trained on breasts so if you had celebrity names you can at the very least generate topless versions of the which is now illegal in every western country.

>>105664341
phree bumps :3

>>105664455
>multiple laws passed
what laws? the only law so far we got is about the fact you aren't allowed to post NSFW celebrities online anymore, that's all, it has nothing to do with posting models that can do celebrities and NSFW

>>105664463
You missed the part of "purposely creating a model which can be used to generate illegal images which is shared online". There is an entirely different party.

>>105664470
I only train Dora, it's much better than Lora, only slightly slower to train.

>>105663427
Did you try step video with it? How does it compare to Wan 720p?

>>105664403

>>105664497
nope, it's only about preventing people to share those images on the internet, not banning the tool, unless you have a law that says that it's not allowed to make a model that can do both celebrities and NSFW (it doesn't exist lol)

>>105664496
There is already precedent on creating tools which enable criminal behavior and if a model becomes known as the model for generating illegal images, there is no "I'm not actually touching him" childish exception when it comes to law. And you should be well aware that you can be arrested and prosecuted for a crime that is in a legal grey area.

Even if you find a way to train the LoRA, the model would likely overfit. It will never be as good as a native model. There aren't many LoRAs teaching it multiple concepts, let alone hundreds or thousands for a reason.

>>105664502
>I only train Dora, it's much better than Lora, only slightly slower to train.
I'd actually like to get a Dora version of that self forcing lora, maybe that would fix the stiffness issues?
https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank32.safetensors

>emad crying
Yes buddy having small penis is actually good

>>105664512
>bro it's only sharing images not sharing loras or models!
>it's illegal if it's an image
>"Make Britney Spears nude.safetensors" is not illegal

> celebs mentioned
> immediate shitfest

every time lmao. just ignore and hide him.

>>105664497
Every model out there can generate images that would be considered sexually explicit, even the incredibly neutered Flux.

But that is besides the point, there is now law against training a model on sexual imagery / video and at the same time training on celebrities. No law says your model must have safeguards against combining celebrities and sexual situations.

>>105664525
>blablabla muh wishful thinking
show me a single example where someone got arrested because they made an AI tool the government didn't like
>>105664540
yep, it's not, unless you have the law that talks about the tool and not the image?

>>105664383
That's like saying Flux is natively capable of booba and got BFL in big trouble

>>105664470
dora was broken with vpred models for a while iirc. non of my old dora models worked with noob vpred when it first came out.
>Well, how come the entire community is taking slow route if it's possible?
documentation and proper guides is extremely scarce. it's the same reason most people don't know how to inpaint properly. you need to dig deep for good advise

>>105664552
Honestly it's rich when a no-gen no-trainer talks about this.

>>105664556
to be honest, the software we are using sucks so much ass it's hard even with guides

Is the comfy implementation for DoRAs even correct? Last I used it months ago it didn't affect the output.

>>105664555
>That's like saying Flux is natively capable of booba and got BFL in big trouble
yep, that's their retarded reasoning, Flux can do boobs and knows a few celebrities, that alone would be enough to be a disqualification according to those corpo cucklickers

>>105664581
no and he still refuses to implement the other formats

>>105664550
Knowingly creating a model now that can generate images which are illegal without any attempts to prevent it (e.g. safety finetuning) will likely get you in trouble and I doubt you have the balls to test it yourself. This conversation ultimately is always beggars upset about other people not taking risks for them.

>>105664585
how is anon using them, then?

>>105664581
Don't worry he was quick to implement the Nvidia 2B model no one will ever use because that check cleared.

>>105664587
>I doubt you have the balls to test it yourself.
the chroma guy has the balls, he's currently doing it

>>105664581
I personally had noise outputs on Comfy using DoRAs, but that was fixed by this April 22 commit. https://github.com/comfyanonymous/ComfyUI/commit/a8f63c0d5b40b4ed12faa1376e973b0e790b1c0d

>>105664599
Given the model is incapable of generating even the most common celebrities he's probably at low risk.

>>105664596
The anon you're replying to is just trolling. He's never tried to use a DoRA in his life.

>>105664603
>DoRA
Show me a well trained DoRA with metadata enabled

>>105664607
>Given the model is incapable of generating even the most common celebrities
what's the threshold? I doubt Will Smith will be happy to know we can Natively do NSFW with him lol

>>105664618
Feel free to do some well-known female celebrities.

>>105664624
so you mean that the government won't give a fuck if we do NSFW with male celebrities? that sounds a bit sexist lol

>>105664633
>government won't give a fuck if we do NSFW with male celebrities
yes

>>105664633
You are surprised to learn that the government prefers females? You think they made the revenge porn / deep fakes law based on male nudes?

>>105664581
>DoRAs
Whoops I meant B-LoRAs
https://civitai.com/models/570064/b-lora-jean-michel-basquiat-style

>>105664636
>>105664640
So... can we add male celebrities to our base models then?

>>105664616
I've only ever used this one. https://civitai.com/models/756624?modelVersionId=1711928

>>105664645
yea

>>105664645
No, you're just not as likely to get a public call for your head and it should be obvious right now with all the finetunes there's an extreme bias against male nudity just in general.

>>105664611
not talking about Dora. there is almost double digit formats anon

>>105664661
>No
why? you just said that the government doesn't give a fuck about male NSFW celebrities images
>>105664636
>>government won't give a fuck if we do NSFW with male celebrities
>yes

>>105664678
we are two anon you low iq dimwit

>>105664678
Actually that's not what I said, you only attempted to misconstrue what I said as some sort of gotcha. I noticed you never actually produced any female celebrities with Chroma.

bigma status?

>>105664690
>Actually that's not what I said
>>105664636
>so you mean that the government won't give a fuck if we do NSFW with male celebrities?
>yes

>>105664697
>You are surprised to learn that the government prefers females? You think they made the revenge porn / deep fakes law based on male nudes?
The word yes literally is never used in that reply.

>>105664701
>The word yes literally is never used in that reply.
So, is the chroma guy in trouble because we can natively render a NSFW image of a male celebrity such as Will Smith?

>>105664646
It has been trained on v-prediction model but it uses noise offset, why

>>105664693
it's nuts

Keep my name OUT of your fucking model

>>105664693
forever training :)

>>105664717
Maybe he just makes doras the same way I make loras. With random settings I got from online.

>>105664727
kek

>>105664116
I've always had trouble with keyblades. Awesome gen.

>>105664711
It depends on how viral the model gets, if someone makes a Oscar the Grouch fucking Will Smith eating spaghetti with it you'll find out. But Chroma feels like it's losing steam, every epoch celebrities that are known burn out because he has no active mitigation for burning tokens.

>>105664587
>generate images which are illegal
Stop this nonsense, it's not illegal to generate these images, only distributing those images online.

Just how retarded are you ?

japan diffusion general

>>105664730
but isn't it the advantage of v-pred models that you don't have to play russian roulette with noise offset settings and such

>>105664755
>if someone makes a Oscar the Grouch fucking Will Smith eating spaghetti
we can already do that with SDXL or with Flux + Loras, how do you prove which model was used to do such image? there's so much possibilities

>>105664693
Cosmos is out

>>105664760
So if you made a model that was made specifically for making sexual deepfakes of celebrities you're going to bet 10 years of your life that you won't get in trouble?

>>105664768
Cite the law, I don't talk the wishful thinking language.

>>105664764
Man, I don't even know what noise offset is. What's the most up-to-date guide/reference for SDXL lora training you can think of?

>>105664755
I'm looking forward to the lumina tune

>>105664766
>some guy gets arrested for the illegal image
>the investigation reveals they used Chroma

>>105664777
how? what if that image has no metadata? if that's the case it's literally impossible to reproduce it

I want to try training an illustrious Lora even if I have more than 75 tokens, how do you do it?

>>105664777
>some guy gets arrested for murder
>the investigation reveals they used a Colt .44

>>105664775
>What's the most up-to-date guide/reference for SDXL lora training you can think of
the one in my head probably, I just read research papers

>>105664768
Even that would be legal, but Chroma is not specifically created to make sexual deepfakes, in fact it sucks at that since it sucks at creating remotely good celebrities.

>>105664783
1) all models have generative attributes
2) arrested guy will have all his computer seized
3) implying he scrubs his ComfyUI output folder

>>105664788
>>105664777
that's funny because leftists want to erase the 2nd amendment, it's always more censorship with those traitors

>>105664791
Damn it.

>>105664797
>3) implying he scrubs his ComfyUI output folder
that doesn't seem far fetched at all, and again you can save images without the metadata on comfyui

>>105664808
4) implying he won't just say what he used for a reduced sentence
As far as I'm aware everyone arrested for illegal AI images never kept what they used secret. You also ignored
>1) all models have generative attributes
Every model has a signature in the pixels, SDXL gens don't have the same signature as Flux gens. And Flux gens don't have the same signature as Chroma gens.

Anyways, that's enough of that, I don't really care.

>>105664728
>253x253
wut

>>105664825
>Every model has a signature in the pixels, SDXL gens don't have the same signature as Flux gens. And Flux gens don't have the same signature as Chroma gens.
bruh you can get a lot of styles with one single base model if you use loras, this would be way too hard for them to pinpoint exactly what was his secret sauce, you're reaching too hard

>>105664838
Every model has a final layer which constructs the data for the VAE to decode, every model has a signature in the same way every camera has a signature and if someone had 50 cameras you can determine which camera they used for a picture forensically.

Are you actually just the Chromadev coping?

>>105664855
>>105664855
new
>>105664855
>>105664855

>>105664852
I don't believe your bullshit, provide an example (you won't because you know it can't be done)

>>105664837
>be me Chroma
>can make realistic NSFW
>can accurately render the current president of the United States
oh noes... lodestone will go to prison :(

>>105664858
>sweating intensifies
Yeah anon, it really do be like that. Also you are very wishful in ignoring
>4) implying he won't just say what he used for a reduced sentence
Pretty crazy to put all your faith in some anon not ratting you out.

>>105664866
>changes subject when asked to provide the evidence of the signature
huh? that was easy...

>>105664455
>Chroma is a model not yet released and can produce high quality, photorealistic images

Chroma is really not that good at photography nor do I expect it to ever be given it's a dataset of just 5M images split up amongst lots of different content types. I frankly don't really understand why Furryrock guy bothered putting realistic stuff in (in terms of photos, not like 3D, that's more understandable), leave that to somebody else, the best photo fine tune is always gonna be one ONLY trained on photos.

>>105664555
stock Flux is literally worse at nipples than SD 3.5 Medium though

>>105664598
Cosmos 2B really isn't bad, the coherence and prompt adherece is very strong for a 2B. Image quality in the sense of raw fidelity leaves a bit to be desired though, it's a bit JPEGy.

>>105664616
I train bigASP V2 Doras of specific people all the time for personal use, in Kohyaian terms there's not much settings difference vs what I'd do for a Lora, except like, rather than Dim 32 / Alpha 32 Lora I do Dim 64 / Alpha 32 / Factor 5 Dora (which comes out at around 80MB, so decently smaller than a Lora but better quality).

Beyond that I just use the same ol' reliable Prodigy optimizer / cosine schedulert / Batch Size 2 / all LRs starting at 1.0 automatically controlled / 0.03 noise offset / 0.3 multires discount / 6 multires noise iterations settings that in my experience produce basically perfect single-subject results on every single UNET-based model ever released (including Kolors).

>>105664761
かわいい足

>>105665027
any chance you could upload .yaml file so I could try your settings?

>>105662658
It's poorly trained.

>>105662730
Schizo prompting

>>105662732
500 steps total at batch size 4 has no fucking chance of ever producing a good lora under any circumstances, for one

>>105663011
good taste in classic anime

>>105665124
prodigy can easily work with this

>>105662732
Start with a lower network dim and alpha first like 8/8. Higher dim/alpha can cause faster overcooking.

Reduce batch size. Batch size shouldn't be higher than 2 might cause underfitting.

Try using constant with warm-up.

Drop the min snr gamma, multires noise iterations and discount, weight decay, and beta. You don't need those yet or at all. You can experiment with them once you get a passable lora.

Try training only the out blocks and 2nd mid block.

If you know how code, you edit the training scripts and have even more control. The individual lora modules themselves can have separate settings.

>>105663782
>now train for chroma. chroma was a pain in the asshole to set up because windows
I'm no longer a vramlet with 96 gb, looking into lora training since I came from 6 gb. Not sure where to start do you think you could have some basic steps laid out? I can tinker and fiddle until things work.

>>105665139
x to doubt if it's a single subject
unless it's an extremely simple 2d character or something maybe

>>105664528
>There aren't many LoRAs teaching it multiple concepts, let alone hundreds or thousands for a reason.

Because most people are doing the training sloppily and training tools don't allow for granular training.

>>105663384
>>105663535
VACE, I assume, similar worklfow to >>105571625
Except no last 15 frames