Thread 105618255

New Era of Videoslop and Infinite Meme Potential Edition

Discussion of Free and Open Source Text-to-Image Models

Prev: >>105615405

https://rentry.org/ldg-lazy-getting-started-guide

>UI
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI
re/Forge/Classic: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassic
SD.Next: https://github.com/vladmandic/sdnext
ComfyUI: https://github.com/comfyanonymous/ComfyUI

>Models, LoRAs, & Upscalers
https://civitai.com
https://civitaiarchive.com
https://tensor.art
https://openmodeldb.info

>Cook
https://github.com/spacepxl/demystifying-sd-finetuning
https://github.com/Nerogar/OneTrainer
https://github.com/kohya-ss/sd-scripts/tree/sd3
https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
https://github.com/tdrussell/diffusion-pipe

>Chroma
Training: https://rentry.org/mvu52t46

>WanX (video)
https://rentry.org/wan21kjguide
https://github.com/Wan-Video/Wan2.1

>Misc
Share Metadata: https://catbox.moe | https://litterbox.catbox.moe/
Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-one
Archive: https://rentry.org/sdg-link
Samplers: https://stable-diffusion-art.com/samplers/
Txt2Img Plugin: https://github.com/Acly/krita-ai-diffusion
Bakery: https://rentry.org/ldgcollage | https://rentry.org/ldgtemplate
Local Model Meta: https://rentry.org/localmodelsmeta

>Neighbors
https://rentry.org/ldg-lazy-getting-started-guide#rentry-from-other-boards
>>>/aco/csdg
>>>/b/degen
>>>/b/celeb+ai
>>>/gif/vdg
>>>/d/ddg
>>>/e/edg
>>>/h/hdg
>>>/trash/slop
>>>/vt/vtai
>>>/u/udg

>Local Text
>>>/g/lmg

>Maintain Thread Quality
https://rentry.org/debo

>

Beat me to it.

>>105618255 (OP)
>the collage is dominated by videos
We're so back!

get this hothead out of here

double collaged

WARNING:lightx2 WILL RESULT IN STIFF, SLOWER MOTION GENS. STATIC BACKGROUNDS, NON-FLOWING HAIR AND GENERALLY LESS MOTION COHERENCE.

>the new speed lora makes the jiggly titties lora ineffective
sad.

>>105618255 (OP)
>no ani in either collage
>no anistudio in OP
oof

based video collage ldg thread

>>105618255 (OP)
My favorite collage thus far

>>105618266
I've been trying to fix the low bitrate/quality issues when adding lots of videos to a collage, but MediaRecorder fucking sucks when used this way and I don't know how else to collage videos without it via TamperMonkey.

can it handle slow motion shooting?

>>105618281
it is what it is anon

>>105618278
That info's already on the wan rentry anyway

>>105618281
>anons acted like they were excited to use it over comfy
>no one actually used it despite binaries being released
>not a single screenshot of another anon from this thread using it
hmm
it's almost as if..

>>105618299
forgot webm sheeeit. gn

>>105618303
I'll use it when/if it's feature complete and has controlnet support, and is at least of equal s/it speed to comfy and forge.

>>105618303
he's been very honest about everything. if ani says it's not worth it right now then I can wait. he is making progress so one day everything will just change again

>>105618255 (OP)
What self forcing showed is that going for a few steps isn't a meme anymore, it's now definitely possible to distill something and keep the most quality out of it, the future will have base models working fine on 1 step, can't wait to see that

>>105618310
considering his filename I don't think that will be much of an issue

he didnt fly so good!

>>105618244
left without magcache, right with
details certainly take a hit

Supersonic cat!

h-he's fast!

Do you think we're gonna see 30sec+ coherent videos in the near future? Probably not feasible with current local hardware, right? Never was a fan of short vid format desu, but longer videos might be cool.

>>105618303
It's like when you pretend to interested in the locals retards bottle-cap collection when they regale you with tales of how their crows own the skies, it's just lip service.

>>105618383
VRAM requirements are too much, given every frame of a video needs to be stuffed into context. More frames, more VRAM needed, least for now.

>>105618383
locally? no.

>>105618385
why the fuck are you here if you don't support people learning and developing FOSS software? why the fuck are you here if all you do is bitch about other anons? why the fuck are you here if all you use to gen is saas bullshit?

>>105618383
>Do you think we're gonna see 30sec+ coherent videos in the near future?
it's already happening
https://www.youtube.com/watch?v=RXRy1uSuYmM

uh oh stinky

when are we getting kling 2.1 at home

STOP THE SLOP
STOP THE SLOP
STOP THE SLOP

>>105618383
vace is a small step forward, because you can use a series of frames as input for a new gen

>>105618391
>locally? no.
is there any cloudshit that can do this already?

>>105618403
probably never. I can't imagine it gets much better than this

>>105618397
>11 views
whats this owo

>>105618403
I want veo 3 at home, I want the voice!

This was the only one that was not slow motion shit after like 5 attempts

>>105618416
https://www.youtube.com/watch?v=7mBqm8uO4Cg

>>105618404
whenever someone says "this is so good. what is this?" the answer invariably comes back, "slop! slop!" again and again!

>>105618440
lmao, sovl!

>>105618434
if those 5 attempts took 5 minutes, that's still less time than a single gen at regular speed without the lora

>>105618444
this, and you don't even have to wait for the whole process to finish before noticing a flaw, you can activate animated preview on comfyui (it's on the rentry for those who want to see how to do that)

why not cool off a bit?

videogen gets faster but im not sure if 8gb is enough to enter the field

>>105618457
>im not sure if 8gb is enough to enter the field
nah sorry man that's gonna be tough for you :(

>>105618456
kek

>make gen with wai v14 or take other art
>make wan do stuff in a minute or two

>>105618457
what gpu? i have 8gb and im genning with wan

>>105618473
RTX 2080

>>105618472
I know who her father is

Any image generation setup where you can rate the generations and then the model takes that into account for subsequent generations over and over?

I think I saw something like this pretty early on in the sd 1.5 days.

>>105618465
sigh i knew this day would come

>>105618480
kek

>>105618493
how

>>105618496
what?

>>105618495
you can try the 1.3b self forcing one, the quality is also pretty good
https://www.youtube.com/watch?v=JdkESdtdYCY

>>105618449
guy pearce in albert pyun's "nemesis" (1992)

Miku ready to race:

>>105618520
better:

this feels like a paradigm shift, its like when neil armstrong stepped on the moon for the first time

detailed chroma sissies... our response? maybe in 2 more epochs we will overthrow base chroma for good...

Omg it migu

i have like $5 worth of runpod credits, is that enough to train a wan lora?

>>105618552
So... a fake paradigm shift? Makes sense, given the quality loss.

>>105618568
Based and truthpilled

>>105618568
wdym fake?

>>105618568
>>105618574

>>105618576
because debo is a conspiracy theorist kek

>>105618583
You are free to have fun, but just know that it's fake fun.

basic "miku walking" prompt, it's actually like the anime, neat.

>>105618568
>fake
oy vey!

>>105618583
Not at all, you can have fun, thats the point, the quality hit shits on it to the point where the only thing you can do is have simple fun, maybe make basic memes where quality doesn't matter, but for anything else, you basically need at least q8 480p wan without causvid or anything else and with slg, and preferably 720p

>>105618590
>(((NASA)))

How do these differ? Which to get for 4070Super?

>>105618589
that's quite impressive, a bit too smooth for anime but still

>>105618590
https://archive.org/details/american-moon-massimo-mazzucco-2017

>>105618589
running test:

>>105618609
>How do these differ?
the lower the "ppl", the better the quality

>>105618517
damn, completely missed that movie

>>105618611
rentry workflow has interpolation, the raw output might be ideal here maybe. it saves both

>>105618609
use rentry workflow which has multigpu, then you can set virtual vram and even use Q8 models.

>>105618609
>q4 of a video generation model
oof, at least wait for svdquant 4bit of it https://github.com/mit-han-lab/nunchaku/issues/431

>>105618635
>svdquant 4bit
we still don't know if the quality of svdquant is better or worse than Q4

>>105618383
> Probably not feasible with current local hardware, right?
No, it is feasible the same way you can basically dream/fantasize in your head for more than 30s. I don't think internally your head has all of the "state" present before it gets generated, it probably just iteratively continues

We already had very coarse "morphing" models for that, then we had [first/last]frame referenced video and more general models with N frames in arbitrary positions, eventually it's just gonna work pretty well with any of this or a prompt for any of the "frames" or approximate time in the video.

>>105618285
her legs are extraordinarily veiny

>>105618609
Depends. Maybe you just want q8 for nearly no difference to the original and offload more to RAM.

>>105618655
How much Is it going to tank the speed? I have 48G but DDR4

>>105618648
>>105618383
>>105618406
>>105618397
>>105618391
>>105618390
Already there, just needs to be polished into a workflow
https://www.reddit.com/r/StableDiffusion/comments/1lcxpp3/bianca_goes_in_the_garden_or_vace_fusionx/

And also, unlike LLM coherency over long text, video coherency should matter less given that for a lot of use cases you don't need to completely change the old scenes which then you also revisit later. You can do a lot with just always generating the next scene while keeping the characters and for example rooms consistent by feeding them as references.

To change the ComfyUI models path with extra_models_config.yaml, can I copy the entire Models folder away or do I need to leave an empty placeholder on the system disk?

>>105618664
woaw woman walking in slow motion for 30+ seconds how amazing

here, have a cute sign
>gens are so fast now I cant just watch a video while I wait

>>105618589
kek
https://youtu.be/6qmUTclZhUo?t=16

>>105618691
way better without the interpolation

>>105618697
thats interpolated

>>105618664
>And also, unlike LLM coherency over long text, video coherency should matter less given that for a lot of use cases you don't need to completely change the old scenes which then you also revisit later.
One trick I can imagine with not much effort for human editing is that you'd just select some key reference frames in scenes you want to revisit. Or the AI just does it in a random point after the scene change.

This could then be an i2v reference frame or tooling can just extract segments, latent space, CLIP, prompt, whatever to reproduce the scene.

It seems more realistically useful to me than making a LLM user pick "the key sentence from this scene" which arguably could also keep the topic but just doesn't work in many instances.

>>105618699
yeah I meant you should disable it for anime gens, but I phrased it stupidly

>>105618691
>gens are so fast now I cant just watch a video while I wait
same, now I have to think of new ideas more frequently, it's almost a flaw in design desu kek

>>105618706
i agree, dont know why people here still interpolate anime gens

>>105618700
>One trick I can imagine with not much effort for human editing is that you'd just select some key reference frames in scenes you want to revisit. Or the AI just does it in a random point after the scene change.
Sure, dependin on the complexity of the change it will still cause temporal problems I think but just using the last frame before the switch to the next should be enough for a lot of things.

you know with this speed increase, everything changes desu, even 720p is now more viable.

>>105618714
>even 720p is now more viable
it made 480p basically the same level as flux for me with 8gb vram. 720p has to be shortened to work though

guys is it supposed to take this long?

>>105618720
no, probably not if this is imagegen... although on some models I suppose you could do it with a very high resolution

did you turn off nvidia's slow ass sysmem fallback for example?

>>105618685
Nice, catbox? Maybe it's time for me to try those 5min faster gens for at least those simpler motions.

>the lightx2v lora works on Skyreels V2 t2v 720p
I'm genning 768x1024 res 5 second videos at native 24 fps in 3 minutes. I don't care if the quality is slightly lower. This used to take an hour meaning it wasn't feasible at all, and now it is. Actually feels like magic, and all that happened was a lora to make shit faster.

https://self-forcing.github.io/
>Self Forcing trains autoregressive video diffusion models by simulating the inference process during training, performing autoregressive rollout with KV caching. It resolves the train-test distribution mismatch and enables real-time, streaming video generation on a single RTX 4090 while matching the quality of state-of-the-art diffusion models.
so basically it makes the training faster now?

>>105618684
If you tried generating a character walking forward like that in a scene you would have seen that it's not so easy.

>>105618738
>Actually feels like magic,
it is magic, when you look at their paper they discovered insane shit that'll change the paradigm of the diffusion ecosystem for good
>hurdur the chinks only know how to copy, they can't create anything new
checkmate nigga!

>>105618749
I feel like doing sketch 2 image with this style would be very interesting, did you ever publish a catbox for any of the images with the workflow?

>>105618739
>https://self-forcing.github.io/
can this be applied for image models aswell? the furry fags wants his chroma to work well on fewer steps, maybe that's the perfect thing for him

>>105618767
yeah but heres a reup https://files.catbox.moe/seta1p.png

>that 1 out of 400 genned images that is 11/10
gachabros won

>>105618773
It should work on any diffusion model, yes

>>105618782
Oh yeah I remember you uploading it before. And when I opened the workflow I realized why I didn't modify it, lol. Maybe when LLM's allow me to easily change it to add the sketch controlnet and for it to just work I'll play with it one day. Cool images.

>>105618773 >>105618739
looks very neat

said miku removes the tape on the leek, got a second miku:

leek get

>>105618814
i can clean it up more later if need be https://files.catbox.moe/s20gjm.png

>>105618903
jesus what the fuck is happening to the text nodes.
and why light mode?

>>105618255 (OP)
Genners, post your rigg specs

>>105618952
4090, 128gb

>>105618964
catbox?

>>105618964
so smooth. is that an esrgan trick (lollypop or something)

the king of kong got paid:

what's the best way to inpaint illust gens?

>>105619002
STAP IT

>>105619005
krita, reforge, never comfy because the comfy extension for inpainting has a shit ui

a group of pixelized characters walk around in a circle.

THE RIDE NEVER ENDS

https://xcancel.com/xunhuang1995/status/1932107954574275059#m
this is a good thread to read if you want to understand how self forcing works

When generating videos, what tea cache / upsampling / skip layer settings are you guys using?
I keep experimenting with different numbers, but I'm never sure if I'm choosing the optimal quality-versus-time tradeoff.

>>105619068
so basically it's not really a distillation method, but they noticed that the training method works so well we can go for a few steps and it'll work well anyway, really interesting, does that mean that going for a full 50 steps training will make the model as good as veo 3? :^)

>>105618981
I can upload a catbox for the base gen (unexportable inpainting steps happened after that) but you'll have to manually load the ControlNet source image as well as manually mask the characters. Too bad there's no "Load Image" node that embeds the image and mask data inside the workflow.
Base gen: https://files.catbox.moe/1gjngb.png
ControlNet source image: https://files.catbox.moe/368eo5.jpg
>>105618990
I just upscale with LSDIR and ~.5 denoise. The smoothness you're seeing is probably from detailing (inpainting small areas like hands and faces on a cropped and upscaled canvas) and the film grain tag which makes images upscale a little better.

subnautica image + wan + shark swims by prompt:

>run 720p wan workflow
>12GB offload
>17.2GB used
>run it again
>12GB offload
>suddenly 20GB used
WHY ARE YOU FUCKING WITH ME LIKE THIS

>>105619068
>xcancel
Stop trying to make this work, blueskytard. Everybody has a fucking x account at this point

>>105619094
>upscale info
thanks

>>105619114
I'm right winger, but I don't want to get a fucking account, do you have an account on 4chan nigger?

>>105618380
For you

Blessed thread of frenship

>>105619130
I'LL BITE YOUR FACE, CUNT

>>105618380
>He hops on the plane

>>105618735
>https://litter.catbox.moe/mbqdapodl6xk2nw1.json
Added some links to the Civitai LoRAs and removed most of my schizo notes from my testing of random shit.
>>105619107
If you change resolution or number of frames, RAM usage goes up although Torch 12.8 kept giving me out of memory errors after consecutive generations on my 3090 when using the same settings, so I moved back to 12.7. There was also some issue with the TorchCompileModelWanVideo node which is why there is now a TorchCompileModelWanVideoV2 node but I don't remember what the issue was or if it was related to video quality degrading when changing between different resolution sizes and not clearing VRAM and freeing model and node cache.

How do I generate videos locally?

>>105619149
Close your eyes and use your I M A G I N A T I O N

>>105619149
https://rentry.org/wan21kjguide

>>105619146
>TorchCompileModelWanVideoV2
Yeah, using that
>Torch 12.8
That might be it. I've got a 3090 too. It's weird, sometimes it'll generate subsequent videos fine, then all of a sudden the vram usage increases by like 2-4GB for no reason I can see given all the settings are literally exactly the same on a batch run. Anyway, cheers

>>105619107
>>105619146
>>105619160
Sorry, meant Pytorch 2.8 instead of Torch 12.8 and I downgraded to Pytorch 2.7. Brain was thinking of CUDA 12.8 probably and fused the numbers together because I'm retarded.

>>105619114
Fuck off, retarded shill.

>>105618964
CUTE!!

>>105618255 (OP)
>wake up and Kijai is STILL at it
>https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan2_1-MiniMaxRemover_1_3B_fp16.safetensors
>object remover
>https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan2_1-Wan-I2V-MAGREF-14B_fp8_e4m3fn.safetensors
>no idea what it is but its i2v

>>105619168
>>https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan2_1-Wan-I2V-MAGREF-14B_fp8_e4m3fn.safetensors
looks like another VACE like method
https://arxiv.org/pdf/2505.23742?

>>105619168
>>105619174
https://magref-video.github.io/magref.github.io/

>>105619178
interesting, wonder how long implementation will take

Anything that will run OK on a 1660 Super? 6GB of VRAM is a bit limiting.

>>105619174
Nice, I do love VACE

>>105619178
Fucking kek'd. Looks pretty good, wonder if it'll work on 16gb

>>105619203
>Looks pretty good,
Idk, I think VACE looks better though?

>>105619200
W-what h-happens next?

>>105619203
>wonder if it'll work on 16gb
gotta wait for quants

>>105619075
just use ldg wan workflow, you can increase teacache if you want but i wouldnt go above 0.19

Kind of annoying how this LightNAG thing does slowmo like 9 times out of 10. Otherwise, a 720p with 129 frames via RifleXRoPE took just under six minutes. If the slowmo is fixed, it'll make 720p fully viable imo

>>105619203
what I like about it is the multi subject reference, VACE fucking sucks at that

>>105619222
Quality wise, compare that to a 480p 5 second version which took about 12 minutes

>>105619222
>>105619231
>Kind of annoying how this LightNAG thing does slowmo like 9 times out of 10.
there's a simple method to increase the speed, increase the fps, go from 16 to 24

>>105619230
bruv that doesn't look like steve jobs at all

>>105619234
Or edit in in post to speed it up, which is easy enough. Still annoying though

>>105619231
>>105619222
Yeah, no contest on the visual quality being better with it on 720p vs stock 480p, but the motion is still not quite as lively. I've seen it across multiple gens of my own. No contest that it's better than causvid though, maybe when it's added properly the motion issues will be fixed too.

>>105619267
>maybe when it's added properly the motion issues will be fixed too.
it's not even a i2v self forcing, we're using the t2v one and it's working as good as it is on i2v, that alone is a miracle lol

I challenge anyone to succeed making a video of a woman inserting anything between her tits and it working as expected. This is the best I got so far, but it's still not what I expected (for the cash to "disappear" or get stuck between her tits)

>>105619274
You'd need a LoRA for that to be consistent, I highly doubt the original dataset Alibaba used had a lot of "girl drops X between her fat cleavage" clips.

>>105619280
its pretty well known they purged anything suggestive from the dataset for this model lol

>use the lightx2v lora with Wan2.1 to make a 5-second 480p video
>It takes over 10 minutes and looks like shit
Is this the fate of anyone who only has 12GB of VRAM, or am I making some retarded mistake that is making it run way slower than it should?

>self forcing workflow eating 70gbs of ram
MoE video gen models when?

>>105619327
The lower the quantization you use, the harder stuff like lightx2v will hit you quality wise. Personally, I only think lightx2v is worth it on 720p

the only non vramlet card is a RTX PRO 6000 btw

>>105619338
>I only think lightx2v is worth it on 720p
it's definitely worth it on 720p, you still wait less than going for normal wan 480p and since wan's vae is far from great, you see less details artifacts on 720p

>>105619230
>VACE
speaking of vace, the self forcing lora also works with it, gotta remove the first frames though it still keeps the image input somehow

a man wearing sunglasses walks to a computer in a PC cafe, and starts typing.

>>105618623
that one looks clean, how did you upscale it?

close enough...

>>105619395
https://www.youtube.com/watch?v=o527mub_kDY

(slow motion:100)

>>105619638
>more slow motion
AAAAHHHHHHHHHHHHHH

>>105619658
maybe going for "simple" scheduler doesn't make it
https://www.reddit.com/r/StableDiffusion/comments/1lcz7ij/comment/my8fggw/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
>Kijai's Wrapper was just updated with a new "flowmatch_distilled" scheduler. Might be worth trying, looks promising from my initial tests!

Miku Hatsune playing a guitar.

can take illu/noob gens and make animations in basically minutes now.

if only wan wasnt censored

>>105619742
>Kijai's Wrapper
boooooooo
what about nativebros

>>105619819
time to swallow the wrapper bud

>>105619823
hmm......... nyo.

>>105619819
kek, I'm surprised he made a native node for his version of NAG (see kjnodes). wish he did more native stuff

>>105619819
https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/wanvideo/utils/basic_flowmatch.py
find a way to shoehorn this into comfy

try pic rel with https://github.com/BlakeOne/ComfyUI-CustomScheduler

for MagCache, are you supposed to use the chroma_calibration node instead of magCache chroma?

>>105619892
those are timesteps not sigmas

>>105619892
>a scheduler with fixed denoising time steps
they all do that though?

>>105618434
nice that her hair doesn't catch on fire this time

>>105618434
if this were regular wan her hair and breasts would be bouncing as she walks and that weird jittery alias would be gone.

>>105619967
>hair and breasts would be bouncing
only if you put that dogshit bounce lora in

So after all said and gone, teacache > lightx2v > causvid for a good speed/quality ratio without slowmo?

>>105619742
>could add as a kjnode for general use
>exclusive to wrapper instead

>>105620005
teacache is probably still the best speed/quality ratio
lightx2v is magic if you're fine with almost exclusively slow motion gens

>>105620009
kek, don't be so angry George, I'm sure he'll add it at some point :(

>>105620009
>8 secondes
how?
>>105620015
>lightx2v is magic if you're fine with almost exclusively slow motion gens
when you apply a lora, the fast motion comes back, so it's the perfect tool if you want something of quality, fast, and compatible with loras

>>105620031
https://rentry.org/wan21kjguide#generating-more-than-5-seconds-of-video

>>105620031
>when you apply a lora, the fast motion comes back
im using like 3 loras and it still likes slow motion

>>105620031
nice seba jun

>>105620041
>nice seba jun
thanks anon
https://www.youtube.com/watch?v=Y4HWvsGs0rY
uwu

>>105620036
cool, thanks anon, you can't go further than 8 seconds right?

>>105620054
Nope, not without VACE.

>>105620048
I've been vibing to this song since before his death. RIP

>>105620064
that guy is the reason I don't believe in god, the humanity deserved 30 more years of his music

>>105620031
>when you apply a lora, the fast motion comes back
no? do you use a specific lora or something?
also it's not just 'slow motion' but general lack of motion as well. some elements are simply not as lively.

>>105620104
>some elements are simply not as lively.
there will be some improvements, we'll get the official self forcing model soon, we also need to use the right scheduler >>105619742, and I'm sure that extracting it with a Dora instead of a Lora would be better aswell

>>105620119
>we'll get the official self forcing model soon
do we not have it? what's the lora extracted from?

>>105620134
>do we not have it?
no, it's an unofficial one, made by another team (the same team that made CausVid btw)

There's some sort of accumulation happening either with kj's nag node or maybe the self forcing Lora (leaning towards the node) that eventually requires a restart of comfy. After like 30 gens I had a yellowing that washed out the colors in my videos.

>>105620141
when are we getting the official one? or is it just soon tm

>>105619742
>>105619877
>https://files.catbox.moe/g87the.rar
Search for FlowMatchSigmas after you put it in custom_nodes. Remove ModelSamplingSD3 & BasicScheduler from your stack too, obviously, since it replaces the scheduler and has a shift value.
I haven't tested it extensively or done side by sides, I've only checked that it works.

does someone remembr/have a workflow where it would take 15ish frames from the previous video and use it for the next generation? so you could extend a video without it going completely shizo

>We only use 1.3B generators in this work and the 14B model used for distillation (i.e., the real score or teacher model) is just the official Wan14B checkpoint
why is this general expecting a 14b model

>>105620177
nice job anon

>>105620177
Quality seems improved vs >>105620009

>>105620213
did you go for a shift of 3?

>>105620218
Yeah

>>105620223
try to go for 8, I know that a bigger shift helps for the movement

>>105620230
I thought it was recommended to use a lower shift for i2v

>>105620243
yeah, shift of 3 for I2V but that's for 50 steps, we're at 4 steps there, the less steps, the bigger the shift

>>105620177
results look basically the same for me

>>105620271
It's definitely executing the flowmatch code. Need to do side by sides with the simple sampler for conclusive results I guess, but it's there to test.

>>105620286
>sampler
*scheduler

>>105620177
FlowMatchSigmas seems to have slightly higher sigmas than "Simple" (same shift for both)

Okay, comfy not letting you cancel a gen until the step completes is fucking annoying when said step takes up to or over a minute.

>>105620309
thats when you kill the cmd window and restart

>>105620314
Yeah, but then I have to load the fucking model again and torch compile, BLEH.

>>105620309
>Okay, comfy not letting you cancel a gen until the step completes is fucking annoying when said step takes up to or over a minute.
Ikr, why can't it stop right away, that's fucking retarded

>>105619274
>>105619280
Probably cheating to use a banana, only used the jiggle lora. Seemed to be pretty consistent though. Spent another 15 minutes trying to get her to take a bite first and that was too much.

>onetrainer still has no wan lora support
baka

>>105620307
can you explain this for retards like me?

>>105620336
Winblows still has musubi-tuner for wan loras

>>105620343
i am a vramlet

>>105620338
a scheduler is basically something that tells the model how much noise it has to remove per step, the fact that both schedulers have different values doesn't tell much, we don't know what scheduler curve the model wants to get that movement lol

>>105620177
hmm

>>105620365
smaller movements seem to be a teensy bit more coherent

>>105620365
What script do you use to make these? You shared it once before but I didn't save the link.

>>105619174
>Deng
>Guo
>Yin
>Fang
>Yang
>Wang
>Yuan
>Wang
>Liu
>Huang
>Ma
did they pick the most stereotypically named chinese people they could find?

>>105620383
>You shared it once before but I didn't save the link.
it was for images only, I should modify the script so that it works for video aswell, brb

>>105619242
he looks younger but with the same features as the older steve jobs
basically druggie steve jobs

>>105620365
Pikachu's flappers have less motion smearing artifacts. The guy walking to her left isn't gliding as much either

>>105619174
is this a drag n drop for any current vace workflow or is it kijai nodes only?

>>105620412
i dont think anyone knows yet

>https://huggingface.co/MAGREF-Video/MAGREF/tree/main
they uploadin'

>>105620370
>>105620410
yeah it seems to improve things a bit, but I don't think that's what will bring the movement back, maybe changing the shift can do the truck?

>>105620439
>changing the shift
nope doesnt do much really
i think the movement is simply here to stay

>>105618255 (OP)
Been meaning to migrate over from Forge back to Comfy. Is there a plugin that lets you see thumbnails of the loras and checkpoints when selecting or is it always just text?
I really appreciate that ease of access UI bit, and the civitai helper that auto downloads thumbs and file info

>>105620450
It's originally a t2v lora, I'd say wait for the i2v version before saying for sure either way

>>105620473
do we Know if an i2v one is being made?

>>105620478
I'd assume so. He only uploaded the t2v one less than a day ago, the other's hopefully cooking

>>105620383
here, take this
https://github.com/BigStationW/Compare-pictures-and-videos

>>105620506
Nice, thanks for sharing. I've been doing side by side comparisons by manually merging shit via either Photoshop or CapCut.

>>105620459
managing loras on comfyui is actual pain.
i second this question because having to remember a million trigger words or manually adding them into the prompt is killing me

>>105620520
kek, I was doing that aswell but now that we live in the chatgpt era, we can automate a lot of things by ourselves now, that's cool

>>105620459
For what it's worth, rgthree's "Power Lora Loader" lets you right click on a lora name, select "Show Info", and then fetch and display the activation keyword and example images from CivitAI. I don't know if there's any lora loader that lets you see the images while selecting the lora, though.

>>105620177
your scheduler doesn't have a denoise parameter, can you add that?

>>105620557
Okay. I'll post it on the Wan Rentry under the "lightx2v + NAG" section in a bit.

>>105620570
if you want I can put it on my github so that people can get this in a more official way so to say

>>105620570
oh damn, i nearly forgot about NAG. i greatly await the workflow because i couldn't get it working when it first came out.

>>105620589
the workflow is already there
https://rentry.org/wan21kjguide#lightx2v-nag-huge-speed-increase

>>105620594
oh my. you guys work fast, i swear i checked it recently and it wasn't there.
thank you very much.

does anyone know a good model for anime background?

>generate video with random seed
>out of curiosity, check what the seed was
>it was "42"
never seen a double-digit seed before...
You guys ever get a really strange-looking seed by pure coincidence, like "666666666" or something like that?

>>105620575
Are you >>105620506 ?

>>105620695
yes

Is video generation with sub-16 gb vram still a nightmare?

>>105620712
slow

>>105620705
>https://files.catbox.moe/tteuuq.rar
Add it to your GH and I'll link it on the rentry until (or if) Kijai adds his own to KJNodes.

>>105620594
is there a nag with teacache?

>>105620309
>>105620321
> click cancel, nothing happens

> overload mem on purpose by opening a bunch of random shit
> instantly stops

???

such fucking bullshit. just make the cancel button actually work for fuck's sake.

>>105620841
>teacache
there's no teacache anymore, it's only 4 steps there's nothing to skip

>>105620836
all right, thanks for the code anon, brb I'll be adding it

>>105618305
box value bros...

>>105620844
tried it and it's fast but my loras aren't working

i've placed it between the self forcing and Patch Model Patcher Order but just animates randomly

>>105620836
>>105620854
all right it's there, thanks for your work anon
https://github.com/BigStationW/flowmatch_scheduler-comfyui

>>105620881
show a screen of your workflow, loras are working fine on my side

>>105620906
Working for me too

How do I update the piece of shit comfy? Github says update but checking update from within the app itself does nothing?

I'm back on linux after a while. Want to play with some text2image and image2image. I remember last time i used automatic1111's webui. Can I use ComfyUI with AMD GPU? I have RX 6700 XT and I'm on arch.

>>105618149
whats the booru tag for this creature

happy with this one

>>105620594
Glad to see a proper update of this guide. Also VACE (or SkyReels VACE) can do around 10 secs without riflexrope. It can also be daisy chained (non of that last frame shit). 20 seconds with NAG + lightx2v lora takes about 4min 30secs on a 4070tis, 4 step LCM. Its pretty insane stuff.

>>105621055
can you show what a 20 second render looks like with those settings? I'm curious to see if it manages to keep consistency

>>105621055
does it take the last x frames or how does it keep consistency? and could you post a wf.

where can i find third reich and hitler youth outfit loras or at least a decent sdxl models that knows it?

>>105619094
so when are you adding ani?

>>105620935
ComfyUI_windows_portable\update\update_comfyui.bat

>>105621043
These are what Balthus would probably gen if he was born in 2008 instead of 1908

>>105621212
>"German World War 2 uniform" isn't cute enough for you?

>>105619958
Perhaps that was the effect of Teacache
>>105619967
Yeah, video related, it's the original
>>105620004
Incorrect

>>105621430
>>105621430
>>105621430
>>105621430

>>105620319
if you have at least 64gb of ram, you dont load the model again, its already cached in ram

>>105621370
something in between those 2 would be the perfect amount of bounce

>>105619217
a commercial break from their sponsors

>>105620683
https://news.mit.edu/2019/answer-life-universe-and-everything-sum-three-cubes-mathematics-0910